2025-11-03T16:51:10.752077Z :MaxByteSizeEqualZero INFO: Random seed for debugging is 1762188670752037
2025-11-03T16:51:11.537592Z node 1 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[1:7568542714375834578:2265];send_to=[0:7307199536658146131:7762515];
2025-11-03T16:51:11.537656Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
2025-11-03T16:51:11.599370Z node 1 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
test_client.cpp: SetPath # /home/runner/.ya/build/build_root/7jz3/0019ac/r3tmp/tmpg18Qzl/pdisk_1.dat
2025-11-03T16:51:11.628854Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-11-03T16:51:11.840080Z node 1 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-11-03T16:51:11.853208Z node 2 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-11-03T16:51:11.853349Z node 2 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=incorrect path status: LookupError;
2025-11-03T16:51:11.891703Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(1, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-11-03T16:51:11.891863Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(1, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-11-03T16:51:11.901010Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(2, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-11-03T16:51:11.901102Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(2, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-11-03T16:51:11.929126Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(1, (0,0,0,0)) VolatileState: Connecting -> Connected
2025-11-03T16:51:11.932743Z node 1 :HIVE WARN: hive_impl.cpp:811: HIVE#72057594037968897 Handle TEvInterconnect::TEvNodeConnected, NodeId 2 Cookie 2
2025-11-03T16:51:11.933866Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(2, (0,0,0,0)) VolatileState: Connecting -> Connected
2025-11-03T16:51:12.018723Z node 1 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
2025-11-03T16:51:12.037750Z node 2 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
TServer::EnableGrpc on GrpcPort 24598, node 1
2025-11-03T16:51:12.129377Z node 1 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-11-03T16:51:12.240939Z node 1 :NET_CLASSIFIER WARN: net_classifier.cpp:190: distributable config is empty, broken or outdated, will use file: /home/runner/.ya/build/build_root/7jz3/0019ac/r3tmp/yandexeyC14T.tmp
2025-11-03T16:51:12.240991Z node 1 :NET_CLASSIFIER WARN: net_classifier.cpp:196: will try to initialize from file: /home/runner/.ya/build/build_root/7jz3/0019ac/r3tmp/yandexeyC14T.tmp
2025-11-03T16:51:12.241214Z node 1 :NET_CLASSIFIER WARN: net_classifier.cpp:202: successfully initialized from file: /home/runner/.ya/build/build_root/7jz3/0019ac/r3tmp/yandexeyC14T.tmp
2025-11-03T16:51:12.241374Z node 1 :NET_CLASSIFIER ERROR: net_classifier.cpp:228: got bad distributable configuration
2025-11-03T16:51:12.284525Z INFO: TTestServer started on Port 4004 GrpcPort 24598
TClient is connected to server localhost:4004
PQClient connected to localhost:24598
WaitRootIsUp 'Root'...
TClient::Ls request: Root
TClient::Ls response: 2025-11-03T16:51:12.528128Z node 1 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "Root"
    PathId: 1
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 1
    CreateStep: 0
    ParentPathId: 1
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 1
      SubDomainVersion: 0
      SecurityStateVersion: 0
    }
    ChildrenExist: false
  }
  Children {
    Name: ".sys"
    PathId: 18446744073709551615
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 0
    CreateStep: 0
    ParentPathId: 18446744073709551615
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 0
      Pl...
(TRUNCATED)
WaitRootIsUp 'Root' success.
2025-11-03T16:51:12.576865Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpAlterSubDomain, opId: 281474976715657:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_alter_subdomain.cpp:311)
waiting...
2025-11-03T16:51:12.621878Z node 2 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
waiting...
waiting...
waiting...
2025-11-03T16:51:15.826619Z node 1 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [1:7568542731555704551:2332], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-03T16:51:15.827208Z node 1 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [1:7568542731555704524:2328], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-03T16:51:15.827306Z node 1 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-03T16:51:15.829565Z node 1 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [1:7568542731555704559:2334], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-03T16:51:15.829639Z node 1 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-03T16:51:15.830961Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateResourcePool, opId: 281474976715661:3, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_resource_pool.cpp:179)
2025-11-03T16:51:15.881937Z node 1 :KQP_WORKLOAD_SERVICE WARN: helpers.h:73: [WorkloadService] [TPoolCreatorActor] ActorId: [1:7568542731555704554:2333], DatabaseId: /Root, PoolId: default, Scheduled retry for error: { <main>: Error: Transaction 281474976715661 completed, doublechecking }
2025-11-03T16:51:16.120310Z node 1 :TX_PROXY ERROR: schemereq.cpp:593: Actor# [1:7568542731555704646:2687] txid# 281474976715662, issues: { message: "Check failed: path: \'/Root/.metadata/workload_manager/pools/default\', error: path exist, request accepts it (id: [OwnerId: 72057594046644480, LocalPathId: 8], type: EPathTypeResourcePool, state: EPathStateNoChanges)" severity: 1 }
2025-11-03T16:51:16.162744Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976715663:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:690)
2025-11-03T16:51:16.186504Z node 1 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:570: Compilation failed, self: [1:7568542735850671952:2340], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-11-03T16:51:16.189891Z node 1 :KQP_SESSION WARN: kqp_session_actor.cpp:2506: SessionId: ydb://session/3?node_id=1&id=Njk0Nzg3OTktNWIwZGRmZDItZmRlOTlmNjItYjg1NTUwODU=, ActorId: [1:7568542731555704512:2325], ActorState: ExecuteState, TraceId: 01k95a2jq6e8k3489ckr9ywvwe, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-11-03T16:51:16.188153Z node 2 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:570: Compilation failed, self: [2:7568542731346961143:2305], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-11-03T16:51:16.188442Z node 2 :KQP_SESSION WARN: kqp_session_actor.cpp:2506: SessionId: ydb://session/3?node_id=2&id=Yjg0ZTFkYWYtNTlmNTdkMmEtOTE5OGYyZDctNzdlMjU3NmM=, ActorId: [2:7568542731346961102:2298], ActorState: ExecuteState, TraceId: 01k95a2jvd27x3bkjzztr9myrf, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-11-03T16:51:16.190697Z node 2 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-11-03T16:51:16.193701Z node 1 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-11-03T16:51:16.411165Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976715664:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:690)
2025-11-03T16:51:16.530210Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[1:7568542714375834578:2265];send_to=[0:7307199536658146131:7762515];
2025-11-03T16:51:16.530277Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
2025-11-03T16:51:16.647401Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976715665:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:690)
=== Init DC: UPSERT INTO `/Root/PQ/Config/V2/Cluster` (name, balancer, local, enabled, weight) VALUES ("dc1", "localhost:24598", true, true, 1000);
2025-11-03T16:51:16.976393Z node 1 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976715666. Ctx: { TraceId: 01k95a2kptbv4afk3ax88sazys, Database: , SessionId: ydb://session/3?node_id=1&id=YjM3ODkwZjEtNjZlMTJiY2EtYmRiMjEwN2MtYjUxNDQ0YTk=, PoolId: default, DatabaseId: /Root}. Database not set, use /Root
=== CheckClustersList. Subcribe to ClusterTracker from [1:7568542740145639666:2994] 
=== CheckClustersList. Ok
2025-11-03T16:51:23.416552Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976715671:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:690)
waiting...
PQ Client: create topic: rt3.dc1--test-topic with 1 partitions
CallPersQueueGRPC request to localhost:24598
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-11-03T16:51:23.547548Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
CallPersQueueGRPC request to localhost:24598
MetaRequest {
  CmdCreateTopic {
    Topic: "rt3.dc1--test-topic"
    NumPartitions: 1
    Config {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
  }
}
CallPersQueueGRPC response:
Status: 129
ProxyErrorCode: 53
SchemeStatus: 1
FlatTxId {
  TxId: 281474976715672
  SchemeShardTabletId: 72057594046644480
  PathId: 13
}
ErrorCode: OK
AddTopic: rt3.dc1--test-topic
===Run query:``DECLARE $version as Int64; DECLARE $path AS Utf8; DECLARE $cluster as Utf8; UPSERT INTO `/Root/PQ/Config/V2/Topics` (path, dc) VALUES ($path, $cluster); UPSERT INTO `/Root/PQ/Config/V2/Versions` (name, version) VALUES ("Topics", $version);`` with topic = test-topic, dc = dc1
2025-11-03T16:51:23.602579Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1655: [72075186224037893][] pipe [1:7568542765915443861:3263] connected; active server actors: 1
2025-11-03T16:51:23.602899Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1519: [72075186224037893][rt3.dc1--test-topic] updating configuration. Deleted partitions []. Added partitions [0]
2025-11-03T16:51:23.604742Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:971: [72075186224037893][rt3.dc1--test-topic] Discovered subdomain [OwnerId: 72057594046644480, LocalPathId: 1] state, outOfSpace = 0 at RB 72075186224037893
2025-11-03T16:51:23.609268Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:140: [72075186224037893][rt3.dc1--test-topic] BALANCER INIT DONE for rt3.dc1--test-topic: (0, 72075186224037892) 
2025-11-03T16:51:23.623794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2960: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-11-03T16:51:23.632434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2992: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-11-03T16:51:23.632733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:787: [PQ: 72075186224037892] no config, start with empty partitions and default config
2025-11-03T16:51:23.632779Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:913: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-11-03T16:51:23.632815Z node 2 :PERSQUEUE INFO: pq_impl.cpp:612: [PQ: 72075186224037892] doesn't have tx writes info
2025-11-03T16:51:23.633387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [1:7568542765915443860:3262], now have 1 active actors on pipe
2025-11-03T16:51:23.633409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [1:7568542765915443883:2439], now have 1 active actors on pipe
2025-11-03T16:51:23.636294Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:404: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1
2025-11-03T16:51:23.639447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-03T16:51:23.648408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-03T16:51:23.656429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [1:7568542765915443921:3309], now have 1 active actors on pipe
2025-11-03T16:51:23.657174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-03T16:51:23.661110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-03T16:51:23.662172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-11-03T16:51:23.662256Z node 2 :PERSQUEUE DEBUG: partition.cpp:1312: [72075186224037892][Partition][0][StateInit] HandleOnInit TEvPQ::TEvProposePartitionConfig
2025-11-03T16:51:23.662518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-11-03T16:51:23.662902Z node 2 :PERSQUEUE INFO: partition_init.cpp:1101: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7568542765706699938:2375]
2025-11-03T16:51:23.665878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-11-03T16:51:23.665915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-11-03T16:51:23.665934Z node 2 :PERSQUEUE INFO: partition.cpp:707: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1 [2:7568542765706699938:2375]
2025-11-03T16:51:23.665975Z node 2 :PERSQUEUE DEBUG: partition.cpp:727: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 0 Head Offset 0 PartNo 0 PackedSize 0 count 0 nextOffset 0 batches 0
2025-11-03T16:51:23.666014Z node 2 :PERSQUEUE DEBUG: partition_mlp.cpp:83: [72075186224037892][Partition][0][StateIdle] Initializing MLP Consumers: 0
2025-11-03T16:51:23.668842Z node 2 :PERSQUEUE DEBUG: partition.cpp:4273: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 1
2025-11-03T16:51:23.668898Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:23.669003Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:23.669016Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-03T16:51:23.669037Z node 2 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-11-03T16:51:23.669050Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:23.669060Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:23.669076Z node 2 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-11-03T16:51:23.669120Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:923: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-11-03T16:51:23.669164Z node 2 :PERSQUEUE DEBUG: partition_mlp.cpp:60: [72075186224037892][Partition][0][StateIdle] Process MLP pending events. Count 0
2025-11-03T16:51:23.669666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-03T16:51:23.669768Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:183: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:51:23.673966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-03T16:51:23.674082Z node 2 :PERSQUEUE DEBUG: partition.cpp:1416: [72075186224037892][Partition][0][StateIdle] Handle TEvPQ::TEvTxCommit Step 1762188683703, TxId 281474976715672
2025-11-03T16:51:23.674105Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:23.674117Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:23.674234Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:23.674462Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-03T16:51:23.677109Z node 2 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-03T16:51:23.677268Z node 2 :PERSQUEUE DEBUG: partition_mlp.cpp:83: [72075186224037892][Partition][0][StateIdle] Initializing MLP Consumers: 0
2025-11-03T16:51:23.677388Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-11-03T16:51:23.677414Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:23.677436Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:23.677448Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:23.677475Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:183: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:51:23.678604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:398: [PQ: 72075186224037892] Apply new config PartitionConfig { LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 } PartitionIds: 0 TopicName: "rt3.dc1--test-topic" Version: 0 LocalDC: true Codecs { Ids: 0 Ids: 1 Ids: 2 Codecs: "raw" Codecs: "gzip" Codecs: "lzop" } TopicPath: "/Root/PQ/rt3.dc1--test-topic" YcCloudId: "" YcFolderId: "" YdbDatabaseId: "" YdbDatabasePath: "/Root" Partitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } AllPartitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } Consumers { Name: "user" ReadFromTimestampsMs: 0 FormatVersion: 0 Version: 0 Generation: 0 } MonitoringProjectId: ""
2025-11-03T16:51:23.678729Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:913: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-11-03T16:51:23.679050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-03T16:51:23.683265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-03T16:51:23.683357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-03T16:51:23.685474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-03T16:51:23.711030Z node 1 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976715673. Ctx: { TraceId: 01k95a2tavc2zwa5tx1q5x47dq, Database: , SessionId: ydb://session/3?node_id=1&id=MmQ0MTk5Y2QtMjliMzIzYmItOGE2ODljNGEtYzM2NDUzOGI=, PoolId: default, DatabaseId: /Root}. Database not set, use /Root
===Query complete
TClient::Ls request: /Root/PQ/rt3.dc1--test-topic
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976715672
    CreateStep: 1762188683703
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts...
(TRUNCATED)
GetTopicVersionFromPath:  record Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976715672
    CreateStep: 1762188683703
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      YdbDatabasePath: "/Root"
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
    Partitions {
      PartitionId: 0
      TabletId: 72075186224037892
      Status: Active
    }
    AlterVersion: 1
    BalancerTabletID: 72075186224037893
    NextPartitionId: 1
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 1
      PlanResolution: 7
      Coordinators: 72057594046316545
      TimeCastBucketsPerMediator: 2
      Mediators: 72057594046382081
    }
    DomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    PathsInside: 12
    PathsLimit: 10000
    ShardsInside: 6
    ShardsLimit: 200000
    ResourcesDomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    DiskSpaceUsage {
      Tables {
        TotalSize: 0
        DataSize: 0
        IndexSize: 0
      }
      Topics {
        ReserveSize: 0
        AccountSize: 0
        DataSize: 0
        UsedReserveSize: 0
      }
    }
    PQPartitionsInside: 1
    PQPartitionsLimit: 1000000
    SchemeLimits {
      MaxDepth: 32
      MaxPaths: 10000
      MaxChildrenInDir: 100000
      MaxAclBytesSize: 10240
      MaxTableColumns: 200
      MaxTableColumnNameLength: 255
      MaxTableKeyColumns: 30
      MaxTableIndices: 20
      MaxShards: 200000
      MaxShardsInPath: 35000
      MaxConsistentCopyTargets: 10000
      MaxPathElementLength: 255
      ExtraPathSymbolsAllowed: "!\"#$%&\'()*+,-.:;<=>?@[\\]^_`{|}~"
      MaxPQPartitions: 1000000
      MaxTableCdcStreams: 5
      MaxExports: 10
      MaxImports: 10
      MaxColumnTableColumns: 10000
    }
  }
}
Path: "/Root/PQ/rt3.dc1--test-topic"
 name rt3.dc1--test-topic version1
CallPersQueueGRPC request to localhost:24598
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-11-03T16:51:23.745970Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
MetaResponse {
  CmdGetTopicMetadataResult {
    TopicInfo {
      Topic: "rt3.dc1--test-topic"
      NumPartitions: 1
      Config {
        PartitionConfig {
          LifetimeSeconds: 86400
          LowWatermark: 8388608
          SourceIdLifetimeSeconds: 86400
          WriteSpeedInBytesPerSecond: 20000000
          BurstSize: 20000000
          SourceIdMaxCounts: 6000000
        }
        Version: 1
        LocalDC: true
        Codecs {
          Ids: 0
          Ids: 1
          Ids: 2
          Codecs: "raw"
          Codecs: "gzip"
          Codecs: "lzop"
        }
        TopicPath: "/Root/PQ/rt3.dc1--test-topic"
        YdbDatabasePath: "/Root"
        Consumers {
          Name: "user"
          ReadFromTimestampsMs: 0
          FormatVersion: 0
          Version: 0
        }
      }
      ErrorCode: OK
    }
  }
}
=== Topic created, have version: 1
2025-11-03T16:51:23.758189Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: try to update token
2025-11-03T16:51:23.758649Z :INFO: [] MessageGroupId [src] SessionId [] Write session: Do CDS request
2025-11-03T16:51:23.760331Z :INFO: [] MessageGroupId [src] SessionId [] Start write session. Will connect to endpoint: localhost:24598
2025-11-03T16:51:23.768927Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:23.768956Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:23.768969Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:23.769865Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-11-03T16:51:23.769919Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1
2025-11-03T16:51:23.779874Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src" }
2025-11-03T16:51:23.781501Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src" }
2025-11-03T16:51:23.781664Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1 topic: "test-topic" message_group_id: "src" from ipv6:[::1]:57742
2025-11-03T16:51:23.781689Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:57742 proto=v1  topic=test-topic durationSec=0
2025-11-03T16:51:23.781703Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-11-03T16:51:23.783294Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1 sessionId:  describe result for acl check
2025-11-03T16:51:23.783422Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-11-03T16:51:23.783437Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-11-03T16:51:23.783446Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-11-03T16:51:23.783461Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7568542765915443990:2456] (SourceId=src, PreferedPartition=(NULL)) StartKqpSession
2025-11-03T16:51:23.785528Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7568542765915443990:2456] (SourceId=src, PreferedPartition=(NULL)) Select from the table
2025-11-03T16:51:23.872349Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:23.872377Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:23.872388Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:23.972781Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:23.972818Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:23.972833Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:24.001328Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [1:7568542765915443990:2456] (SourceId=src, PreferedPartition=(NULL)) RequestPQRB
2025-11-03T16:51:24.003466Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1655: [72075186224037893][rt3.dc1--test-topic] pipe [1:7568542765915444029:2456] connected; active server actors: 1
2025-11-03T16:51:24.003691Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [1:7568542765915443990:2456] (SourceId=src, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=src
2025-11-03T16:51:24.003715Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7568542765915443990:2456] (SourceId=src, PreferedPartition=(NULL)) Update the table
2025-11-03T16:51:24.008491Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1659: [72075186224037893][rt3.dc1--test-topic] pipe [1:7568542765915444029:2456] disconnected.
2025-11-03T16:51:24.008541Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1670: [72075186224037893][rt3.dc1--test-topic] pipe [1:7568542765915444029:2456] disconnected; active server actors: 1
2025-11-03T16:51:24.008571Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1695: [72075186224037893][rt3.dc1--test-topic] pipe [1:7568542765915444029:2456] disconnected no session
2025-11-03T16:51:24.072987Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:24.073013Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:24.073022Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:24.099593Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7568542765915443990:2456] (SourceId=src, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-11-03T16:51:24.099630Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7568542765915443990:2456] (SourceId=src, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-11-03T16:51:24.099653Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7568542765915443990:2456] (SourceId=src, PreferedPartition=(NULL)) Start idle
2025-11-03T16:51:24.099680Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-11-03T16:51:24.100483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [1:7568542770210411349:2456], now have 1 active actors on pipe
2025-11-03T16:51:24.100630Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1
2025-11-03T16:51:24.100827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:24.100862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:24.100934Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src|ba76e191-4ab8a2c3-267b7721-f6ee4e3d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src
2025-11-03T16:51:24.101011Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:24.101035Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:24.101047Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-03T16:51:24.101107Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:24.101152Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-03T16:51:24.101210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-03T16:51:24.101634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:24.101657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:24.101721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-03T16:51:24.102061Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1 partition: 0 MaxSeqNo: 0 sessionId: src|ba76e191-4ab8a2c3-267b7721-f6ee4e3d_0
2025-11-03T16:51:24.102881Z :INFO: [] MessageGroupId [src] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1762188684102 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-11-03T16:51:24.103011Z :INFO: [] MessageGroupId [src] SessionId [] Write session established. Init response: session_id: "src|ba76e191-4ab8a2c3-267b7721-f6ee4e3d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-11-03T16:51:24.104052Z :INFO: [] MessageGroupId [src] SessionId [src|ba76e191-4ab8a2c3-267b7721-f6ee4e3d_0] Write session: close. Timeout = 0 ms
2025-11-03T16:51:24.104098Z :INFO: [] MessageGroupId [src] SessionId [src|ba76e191-4ab8a2c3-267b7721-f6ee4e3d_0] Write session will now close
2025-11-03T16:51:24.104132Z :DEBUG: [] MessageGroupId [src] SessionId [src|ba76e191-4ab8a2c3-267b7721-f6ee4e3d_0] Write session: aborting
2025-11-03T16:51:24.104260Z :INFO: [] MessageGroupId [src] SessionId [src|ba76e191-4ab8a2c3-267b7721-f6ee4e3d_0] Write session: gracefully shut down, all writes complete
2025-11-03T16:51:24.104295Z :DEBUG: [] MessageGroupId [src] SessionId [src|ba76e191-4ab8a2c3-267b7721-f6ee4e3d_0] Write session: destroy
2025-11-03T16:51:24.105383Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId: src|ba76e191-4ab8a2c3-267b7721-f6ee4e3d_0 grpc read done: success: 0 data: 
2025-11-03T16:51:24.105410Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 1 sessionId: src|ba76e191-4ab8a2c3-267b7721-f6ee4e3d_0 grpc read failed
2025-11-03T16:51:24.105439Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 1 sessionId: src|ba76e191-4ab8a2c3-267b7721-f6ee4e3d_0 grpc closed
2025-11-03T16:51:24.105461Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1 sessionId: src|ba76e191-4ab8a2c3-267b7721-f6ee4e3d_0 is DEAD
2025-11-03T16:51:24.106373Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-11-03T16:51:24.106648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [1:7568542770210411349:2456] destroyed
2025-11-03T16:51:24.106687Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-11-03T16:51:24.106727Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:24.106753Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:24.106765Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:24.117426Z :DEBUG: [/Root] MessageGroupId [group_id] SessionId [] Write session: try to update token
2025-11-03T16:51:24.118365Z :INFO: [/Root] MessageGroupId [group_id] SessionId [] Write session: Do CDS request
2025-11-03T16:51:24.118424Z :INFO: [/Root] MessageGroupId [group_id] SessionId [] Start write session. Will connect to endpoint: localhost:24598
2025-11-03T16:51:24.131437Z :DEBUG: [/Root] MessageGroupId [group_id] SessionId [] Write session: send init request: init_request { topic: "test-topic" message_group_id: "group_id" }
2025-11-03T16:51:24.132443Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-11-03T16:51:24.132480Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2
2025-11-03T16:51:24.132899Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "group_id" }
2025-11-03T16:51:24.133014Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2 topic: "test-topic" message_group_id: "group_id" from ipv6:[::1]:42266
2025-11-03T16:51:24.133027Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:42266 proto=v1  topic=test-topic durationSec=0
2025-11-03T16:51:24.133036Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-11-03T16:51:24.134230Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2 sessionId:  describe result for acl check
2025-11-03T16:51:24.134333Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-11-03T16:51:24.134366Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-11-03T16:51:24.134376Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-11-03T16:51:24.134400Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7568542770210411360:2472] (SourceId=group_id, PreferedPartition=(NULL)) StartKqpSession
2025-11-03T16:51:24.136751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7568542770210411360:2472] (SourceId=group_id, PreferedPartition=(NULL)) Select from the table
2025-11-03T16:51:24.142421Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [1:7568542770210411360:2472] (SourceId=group_id, PreferedPartition=(NULL)) RequestPQRB
2025-11-03T16:51:24.142809Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1655: [72075186224037893][rt3.dc1--test-topic] pipe [1:7568542770210411379:2472] connected; active server actors: 1
2025-11-03T16:51:24.142855Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [1:7568542770210411360:2472] (SourceId=group_id, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=group_id
2025-11-03T16:51:24.142869Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7568542770210411360:2472] (SourceId=group_id, PreferedPartition=(NULL)) Update the table
2025-11-03T16:51:24.143074Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1659: [72075186224037893][rt3.dc1--test-topic] pipe [1:7568542770210411379:2472] disconnected.
2025-11-03T16:51:24.143098Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1670: [72075186224037893][rt3.dc1--test-topic] pipe [1:7568542770210411379:2472] disconnected; active server actors: 1
2025-11-03T16:51:24.143111Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1695: [72075186224037893][rt3.dc1--test-topic] pipe [1:7568542770210411379:2472] disconnected no session
2025-11-03T16:51:24.152325Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7568542770210411360:2472] (SourceId=group_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-11-03T16:51:24.152353Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7568542770210411360:2472] (SourceId=group_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-11-03T16:51:24.153631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [1:7568542770210411396:2472], now have 1 active actors on pipe
2025-11-03T16:51:24.154040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:24.152367Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7568542770210411360:2472] (SourceId=group_id, PreferedPartition=(NULL)) Start idle
2025-11-03T16:51:24.154071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:24.152391Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-11-03T16:51:24.153737Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1
2025-11-03T16:51:24.154126Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie group_id|d928fe31-806a822b-fec8ecc7-59f51ec0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner group_id
2025-11-03T16:51:24.155755Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2 partition: 0 MaxSeqNo: 0 sessionId: group_id|d928fe31-806a822b-fec8ecc7-59f51ec0_0
2025-11-03T16:51:24.154157Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:24.154170Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:24.154191Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-03T16:51:24.154222Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:24.154266Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-03T16:51:24.154306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-03T16:51:24.155110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:24.155127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:24.155186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-03T16:51:24.157492Z :INFO: [/Root] MessageGroupId [group_id] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1762188684157 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-11-03T16:51:24.157608Z :INFO: [/Root] MessageGroupId [group_id] SessionId [] Write session established. Init response: session_id: "group_id|d928fe31-806a822b-fec8ecc7-59f51ec0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-11-03T16:51:24.157833Z :DEBUG: [/Root] MessageGroupId [group_id] SessionId [group_id|d928fe31-806a822b-fec8ecc7-59f51ec0_0] Write 1 messages with Id from 1 to 1
2025-11-03T16:51:24.157936Z :INFO: [/Root] MessageGroupId [group_id] SessionId [group_id|d928fe31-806a822b-fec8ecc7-59f51ec0_0] Write session: close. Timeout = 18446744073709551 ms
2025-11-03T16:51:24.158472Z :DEBUG: [/Root] MessageGroupId [group_id] SessionId [group_id|d928fe31-806a822b-fec8ecc7-59f51ec0_0] Write session: try to update token
2025-11-03T16:51:24.158525Z :DEBUG: [/Root] MessageGroupId [group_id] SessionId [group_id|d928fe31-806a822b-fec8ecc7-59f51ec0_0] Send 1 message(s) (0 left), first sequence number is 1
2025-11-03T16:51:24.159895Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: group_id|d928fe31-806a822b-fec8ecc7-59f51ec0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:51:24.160164Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:51:24.160879Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:24.160539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:24.160569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:24.160635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-11-03T16:51:24.161216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:24.161232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:24.161520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0group_id' SeqNo: 1 partNo : 0 messageNo: 1 size 98 offset: -1
2025-11-03T16:51:24.161560Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:51:24.161607Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:24.161633Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:24.161646Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-03T16:51:24.161762Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0group_id' seqNo 1 partNo 0
2025-11-03T16:51:24.163567Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0group_id' seqNo 1 partNo 0 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 174 count 1 nextOffset 1 batches 1
2025-11-03T16:51:24.163615Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:24.164176Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 0,1 HeadOffset 0 endOffset 0 curOffset 1 d0000000000_00000000000000000000_00000_0000000001_00000? size 162 WTime 1762188684163
2025-11-03T16:51:24.164319Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-03T16:51:24.164450Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 0 partNo 0 count 1 size 162
2025-11-03T16:51:24.166999Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 0 count 1 size 162 actorID [2:7568542765706699922:2375]
2025-11-03T16:51:24.167049Z node 2 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-03T16:51:24.167088Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 107 WriteNewSizeFromSupportivePartitions# 0
2025-11-03T16:51:24.167117Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:51:24.167158Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0group_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 1, partNo: 0, Offset: 0 is stored on disk
2025-11-03T16:51:24.167271Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 0 suffix '63' size 162
2025-11-03T16:51:24.167369Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:923: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-11-03T16:51:24.167406Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:965: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-11-03T16:51:24.167422Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:24.167433Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:24.167442Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:24.167469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:51:24.167503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1  requestId: <none> cookie: 1
2025-11-03T16:51:24.169839Z :DEBUG: [/Root] MessageGroupId [group_id] SessionId [group_id|d928fe31-806a822b-fec8ecc7-59f51ec0_0] Write session got write response: sequence_numbers: 1 offsets: 0 already_written: false write_statistics { persist_duration_ms: 3 queued_in_partition_duration_ms: 3 }
2025-11-03T16:51:24.169904Z :DEBUG: [/Root] MessageGroupId [group_id] SessionId [group_id|d928fe31-806a822b-fec8ecc7-59f51ec0_0] Write session: acknoledged message 1
2025-11-03T16:51:24.167730Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:24.167610Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:880: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 partno 0 count 1 size 1024000 endOffset 1 max time lag 0ms effective offset 0
2025-11-03T16:51:24.167854Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1105: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 162 count 1 last offset 0, current partition end offset: 1
2025-11-03T16:51:24.167870Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1121: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-11-03T16:51:24.167920Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 0 partno 0 count 1 parts_count 0 source 1 size 162 accessed 0 times before, last time 2025-11-03T16:51:24.000000Z
2025-11-03T16:51:24.167955Z node 2 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 3. All 1 blobs are from cache.
2025-11-03T16:51:24.168018Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:572: FormAnswer for 1 blobs
2025-11-03T16:51:24.168091Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 0 suffix '63'
2025-11-03T16:51:24.168153Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 0 totakecount 1 count 1 size 142 from pos 0 cbcount 1
2025-11-03T16:51:24.168220Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1015: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1762188684161 queuesize 0 startOffset 0
2025-11-03T16:51:24.173345Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:24.173369Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:24.173380Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:24.258643Z :INFO: [/Root] MessageGroupId [group_id] SessionId [group_id|d928fe31-806a822b-fec8ecc7-59f51ec0_0] Write session will now close
2025-11-03T16:51:24.258714Z :DEBUG: [/Root] MessageGroupId [group_id] SessionId [group_id|d928fe31-806a822b-fec8ecc7-59f51ec0_0] Write session: aborting
2025-11-03T16:51:24.259227Z :INFO: [/Root] MessageGroupId [group_id] SessionId [group_id|d928fe31-806a822b-fec8ecc7-59f51ec0_0] Write session: gracefully shut down, all writes complete
2025-11-03T16:51:24.259419Z :INFO: [/Root] [/Root] [964c1896-73204af8-a5b2df82-d4a43213] Starting read session
2025-11-03T16:51:24.259449Z :DEBUG: [/Root] [/Root] [964c1896-73204af8-a5b2df82-d4a43213] Starting cluster discovery
2025-11-03T16:51:24.262095Z :DEBUG: [/Root] MessageGroupId [group_id] SessionId [group_id|d928fe31-806a822b-fec8ecc7-59f51ec0_0] Write session is aborting and will not restart
2025-11-03T16:51:24.265034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [1:7568542770210411396:2472] destroyed
2025-11-03T16:51:24.265074Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-11-03T16:51:24.265100Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:24.265111Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:24.265121Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:24.263931Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: group_id|d928fe31-806a822b-fec8ecc7-59f51ec0_0 grpc read done: success: 0 data: 
2025-11-03T16:51:24.263952Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 2 sessionId: group_id|d928fe31-806a822b-fec8ecc7-59f51ec0_0 grpc read failed
2025-11-03T16:51:24.263991Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 2 sessionId: group_id|d928fe31-806a822b-fec8ecc7-59f51ec0_0 grpc closed
2025-11-03T16:51:24.264003Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2 sessionId: group_id|d928fe31-806a822b-fec8ecc7-59f51ec0_0 is DEAD
2025-11-03T16:51:24.264687Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-11-03T16:51:24.272921Z :DEBUG: [/Root] [/Root] [964c1896-73204af8-a5b2df82-d4a43213] Cluster discovery request succeeded
2025-11-03T16:51:24.273002Z :DEBUG: [/Root] [/Root] [964c1896-73204af8-a5b2df82-d4a43213] Starting session to cluster dc1 (localhost:24598)
2025-11-03T16:51:24.273210Z :DEBUG: [/Root] [/Root] [964c1896-73204af8-a5b2df82-d4a43213] [dc1] In Reconnect, ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:51:24.273256Z :DEBUG: [/Root] [/Root] [964c1896-73204af8-a5b2df82-d4a43213] [dc1] New values: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:51:24.273306Z :DEBUG: [/Root] [/Root] [964c1896-73204af8-a5b2df82-d4a43213] [dc1] Reconnecting session to cluster dc1 in 0.000000s
2025-11-03T16:51:24.275380Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:24.275419Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:24.275432Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:24.280491Z :DEBUG: [/Root] [/Root] [964c1896-73204af8-a5b2df82-d4a43213] [dc1] Successfully connected. Initializing session
2025-11-03T16:51:24.281451Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:109: new grpc connection
2025-11-03T16:51:24.281482Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:131: new session created cookie 1
2025-11-03T16:51:24.284285Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { topic: "test-topic" } read_only_original: true consumer: "shared/user" read_params { max_read_size: 104857600 } } }
2025-11-03T16:51:24.284555Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 1 consumer shared/user session shared/user_1_1_6053570980499942116_v1 read init: from# ipv6:[::1]:42266, request# { init_request { topics_read_settings { topic: "test-topic" } read_only_original: true consumer: "shared/user" read_params { max_read_size: 104857600 } } }
2025-11-03T16:51:24.284932Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 1 consumer shared/user session shared/user_1_1_6053570980499942116_v1 auth for : user
2025-11-03T16:51:24.285508Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 1 consumer shared/user session shared/user_1_1_6053570980499942116_v1 Handle describe topics response
2025-11-03T16:51:24.285630Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 1 consumer shared/user session shared/user_1_1_6053570980499942116_v1 auth is DEAD
2025-11-03T16:51:24.285698Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 1 consumer shared/user session shared/user_1_1_6053570980499942116_v1 auth ok: topics# 1, initDone# 0
2025-11-03T16:51:24.286818Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 1 consumer shared/user session shared/user_1_1_6053570980499942116_v1 register session: topic# rt3.dc1--test-topic
2025-11-03T16:51:24.287145Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1655: [72075186224037893][rt3.dc1--test-topic] pipe [1:7568542770210411407:2477] connected; active server actors: 1
2025-11-03T16:51:24.287177Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1706: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [1:7568542770210411407:2477] session shared/user_1_1_6053570980499942116_v1
2025-11-03T16:51:24.287241Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:639: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-11-03T16:51:24.287306Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:669: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-11-03T16:51:24.287364Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:871: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_1_1_6053570980499942116_v1" (Sender=[1:7568542770210411404:2477], Pipe=[1:7568542770210411407:2477], Partitions=[], ActiveFamilyCount=0)
2025-11-03T16:51:24.287392Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1186: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-11-03T16:51:24.287474Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1258: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-11-03T16:51:24.287530Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1305: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_1_6053570980499942116_v1" (Sender=[1:7568542770210411404:2477], Pipe=[1:7568542770210411407:2477], Partitions=[], ActiveFamilyCount=0)
2025-11-03T16:51:24.287609Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:549: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_1_1_6053570980499942116_v1" sender [1:7568542770210411404:2477] lock partition 0 for ReadingSession "shared/user_1_1_6053570980499942116_v1" (Sender=[1:7568542770210411404:2477], Pipe=[1:7568542770210411407:2477], Partitions=[], ActiveFamilyCount=1) generation 1 step 1
2025-11-03T16:51:24.287686Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1325: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-11-03T16:51:24.287720Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1402: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000216s
2025-11-03T16:51:24.289459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [1:7568542770210411410:2480], now have 1 active actors on pipe
2025-11-03T16:51:24.289964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:24.289992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:24.290037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1748: [PQ: 72075186224037892] Created session shared/user_1_1_6053570980499942116_v1 on pipe: [1:7568542770210411410:2480]
2025-11-03T16:51:24.290114Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:24.290121Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_1_6053570980499942116_v1:1 with generation 1
2025-11-03T16:51:24.290135Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:24.290157Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-03T16:51:24.290230Z node 2 :PERSQUEUE DEBUG: partition.cpp:3666: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_1_1_6053570980499942116_v1
2025-11-03T16:51:24.290242Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:24.290380Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-03T16:51:24.288679Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 1 consumer shared/user session shared/user_1_1_6053570980499942116_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 1 Session: "shared/user_1_1_6053570980499942116_v1" ClientId: "user" PipeClient { RawX1: 7568542770210411407 RawX2: 4503603922340269 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-11-03T16:51:24.288767Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 1 consumer shared/user session shared/user_1_1_6053570980499942116_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-11-03T16:51:24.289778Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_6053570980499942116_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 1, pipe: [1:7568542770210411410:2480]
2025-11-03T16:51:24.291475Z :INFO: [/Root] [/Root] [964c1896-73204af8-a5b2df82-d4a43213] [dc1] Server session id: shared/user_1_1_6053570980499942116_v1
2025-11-03T16:51:24.291821Z :DEBUG: [/Root] [/Root] [964c1896-73204af8-a5b2df82-d4a43213] [dc1] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:51:24.293017Z node 2 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-03T16:51:24.293103Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-11-03T16:51:24.293132Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:24.293142Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:24.293151Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:24.293178Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:51:24.292970Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_1_1_6053570980499942116_v1 grpc read done: success# 1, data# { read { } }
2025-11-03T16:51:24.293149Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_1_1_6053570980499942116_v1 got read request: guid# 535a345f-bb9a831b-9e3e2b2b-3a4951e
2025-11-03T16:51:24.293242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-11-03T16:51:24.293784Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_1_1_6053570980499942116_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 1 WriteTimestampMS: 1762188684161 CreateTimestampMS: 1762188684157 SizeLag: 162 WriteTimestampEstimateMS: 1762188684275 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-11-03T16:51:24.293816Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 1 consumer shared/user session shared/user_1_1_6053570980499942116_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 1 readOffset 0 committedOffset 0
2025-11-03T16:51:24.293848Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 1 consumer shared/user session shared/user_1_1_6053570980499942116_v1 sending to client partition status
2025-11-03T16:51:24.294414Z :INFO: [/Root] [/Root] [964c1896-73204af8-a5b2df82-d4a43213] [dc1] Confirm partition stream create. Partition stream id: 1. Cluster: "dc1". Topic: "test-topic". Partition: 0. Read offset: (NULL)
2025-11-03T16:51:24.295159Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_1_1_6053570980499942116_v1 grpc read done: success# 1, data# { start_read { topic { path: "test-topic" } cluster: "dc1" assign_id: 1 } }
2025-11-03T16:51:24.295247Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:539: session cookie 1 consumer shared/user session shared/user_1_1_6053570980499942116_v1 got StartRead from client: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 0, commitOffset# 0
2025-11-03T16:51:24.295285Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1023: session cookie 1 consumer shared/user session shared/user_1_1_6053570980499942116_v1 Start reading TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 1 readOffset 0 committedOffset 0 clientCommitOffset 0 clientReadOffset 0
2025-11-03T16:51:24.295303Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_1_1_6053570980499942116_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 0 endOffset 1
2025-11-03T16:51:24.295341Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_1_1_6053570980499942116_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 0, endOffset# 1, WTime# 1762188684161, sizeLag# 162
2025-11-03T16:51:24.295352Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_1_1_6053570980499942116_v1TEvPartitionReady. Aval parts: 1
2025-11-03T16:51:24.295381Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_1_1_6053570980499942116_v1 performing read request: guid# 535a345f-bb9a831b-9e3e2b2b-3a4951e, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 1, size# 194, partitionsAsked# 1, maxTimeLag# 0ms
2025-11-03T16:51:24.295426Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_1_1_6053570980499942116_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 1 maxSize 194 maxTimeLagMs 0 readTimestampMs 0 readOffset 0 EndOffset 1 ClientCommitOffset 0 committedOffset 0 Guid 535a345f-bb9a831b-9e3e2b2b-3a4951e
2025-11-03T16:51:24.295957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:24.295988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:24.296081Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:880: [72075186224037892][Partition][0][StateIdle] read cookie 4 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 partno 0 count 1 size 194 endOffset 1 max time lag 0ms effective offset 0
2025-11-03T16:51:24.296191Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1105: [72075186224037892][Partition][0][StateIdle] read cookie 4 added 1 blobs, size 162 count 1 last offset 0, current partition end offset: 1
2025-11-03T16:51:24.296200Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1121: [72075186224037892][Partition][0][StateIdle] Reading cookie 4. Send blob request.
2025-11-03T16:51:24.296225Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 0 partno 0 count 1 parts_count 0 source 1 size 162 accessed 1 times before, last time 2025-11-03T16:51:24.000000Z
2025-11-03T16:51:24.296242Z node 2 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 4. All 1 blobs are from cache.
2025-11-03T16:51:24.296267Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:572: FormAnswer for 1 blobs
2025-11-03T16:51:24.296326Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 0 totakecount 1 count 1 size 142 from pos 0 cbcount 1
2025-11-03T16:51:24.296376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-03T16:51:24.296699Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 0 suffix '63'
2025-11-03T16:51:24.297012Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_1_1_6053570980499942116_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 1 Result { Offset: 0 Data: "... 98 bytes ..." SourceId: "\000group_id" SeqNo: 1 WriteTimestampMS: 1762188684161 CreateTimestampMS: 1762188684157 UncompressedSize: 7 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 20 RealReadOffset: 0 WaitQuotaTimeMs: 0 EndOffset: 1 StartOffset: 0 } Cookie: 0 }
2025-11-03T16:51:24.297143Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_1_1_6053570980499942116_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 1 from offset 1
2025-11-03T16:51:24.297186Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_1_1_6053570980499942116_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 1 ReadOffset 1 ReadGuid 535a345f-bb9a831b-9e3e2b2b-3a4951e has messages 1
2025-11-03T16:51:24.297256Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_1_1_6053570980499942116_v1 read done: guid# 535a345f-bb9a831b-9e3e2b2b-3a4951e, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 204
2025-11-03T16:51:24.297283Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_1_1_6053570980499942116_v1 response to read: guid# 535a345f-bb9a831b-9e3e2b2b-3a4951e
2025-11-03T16:51:24.297431Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_1_1_6053570980499942116_v1 Process answer. Aval parts: 0
2025-11-03T16:51:24.300399Z :DEBUG: [/Root] [/Root] [964c1896-73204af8-a5b2df82-d4a43213] [dc1] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:51:24.300758Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_1_1_6053570980499942116_v1 grpc read done: success# 1, data# { read { } }
2025-11-03T16:51:24.300866Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_1_1_6053570980499942116_v1 got read request: guid# 82823838-db996005-c40828cd-2264a1f8
2025-11-03T16:51:24.301304Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 0 (0-0)
2025-11-03T16:51:24.301467Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (0-0)
2025-11-03T16:51:24.301537Z :DEBUG: [/Root] [/Root] [964c1896-73204af8-a5b2df82-d4a43213] [dc1] The application data is transferred to the client. Number of messages 1, size 7 bytes
2025-11-03T16:51:24.301645Z :DEBUG: [/Root] [/Root] [964c1896-73204af8-a5b2df82-d4a43213] [dc1] Commit offsets [0, 1). Partition stream id: 1
2025-11-03T16:51:24.301854Z :INFO: [/Root] [/Root] [964c1896-73204af8-a5b2df82-d4a43213] Closing read session. Close timeout: 0.000000s
2025-11-03T16:51:24.301896Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): dc1:test-topic:0:1:0:0
2025-11-03T16:51:24.301952Z :INFO: [/Root] [/Root] [964c1896-73204af8-a5b2df82-d4a43213] Counters: { Errors: 0 CurrentSessionLifetimeMs: 42 BytesRead: 7 MessagesRead: 1 BytesReadCompressed: 27 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-11-03T16:51:24.302074Z :NOTICE: [/Root] [/Root] [964c1896-73204af8-a5b2df82-d4a43213] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Close with zero timeout " }
2025-11-03T16:51:24.302120Z :DEBUG: [/Root] [/Root] [964c1896-73204af8-a5b2df82-d4a43213] [dc1] Abort session to cluster
2025-11-03T16:51:24.302517Z :NOTICE: [/Root] [/Root] [964c1896-73204af8-a5b2df82-d4a43213] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
2025-11-03T16:51:24.302670Z :DEBUG: [/Root] MessageGroupId [group_id] SessionId [group_id|d928fe31-806a822b-fec8ecc7-59f51ec0_0] Write session: destroy
2025-11-03T16:51:24.305927Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:92: session cookie 1 consumer shared/user session shared/user_1_1_6053570980499942116_v1 grpc closed
2025-11-03T16:51:24.305962Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 1 consumer shared/user session shared/user_1_1_6053570980499942116_v1 is DEAD
2025-11-03T16:51:24.309077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2258: [PQ: 72075186224037892] Destroy direct read session shared/user_1_1_6053570980499942116_v1
2025-11-03T16:51:24.309128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [1:7568542770210411410:2480] destroyed
2025-11-03T16:51:24.309199Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_1_6053570980499942116_v1
2025-11-03T16:51:24.309893Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1659: [72075186224037893][rt3.dc1--test-topic] pipe [1:7568542770210411407:2477] disconnected.
2025-11-03T16:51:24.309911Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1670: [72075186224037893][rt3.dc1--test-topic] pipe [1:7568542770210411407:2477] disconnected; active server actors: 1
2025-11-03T16:51:24.309925Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1679: [72075186224037893][rt3.dc1--test-topic] pipe [1:7568542770210411407:2477] client user disconnected session shared/user_1_1_6053570980499942116_v1
2025-11-03T16:51:24.376128Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:24.376159Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:24.376169Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:24.479571Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:24.479597Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:24.479607Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:24.581372Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:24.581395Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:24.581404Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:24.733986Z node 1 :KQP_EXECUTER ERROR: kqp_executer_impl.h:1006: ActorId: [1:7568542770210411441:2481] TxId: 281474976715678. Ctx: { TraceId: 01k95a2v3tbz4zp5pfh2ze8th1, Database: /Root, SessionId: ydb://session/3?node_id=1&id=YWM2MWM3ZGYtYmRmNzUzOWYtZmFhZjkwMTUtMjgzMmRiN2E=, PoolId: default}. UNAVAILABLE: Failed to send EvStartKqpTasksRequest because node is unavailable: 2
2025-11-03T16:51:24.734544Z node 1 :KQP_COMPUTE ERROR: dq_compute_actor_impl.h:1210: SelfId: [1:7568542770210411450:2481], TxId: 281474976715678, task: 3. Ctx: { CheckpointId : .  TraceId : 01k95a2v3tbz4zp5pfh2ze8th1.  RunScriptActorId : [0:0:0].  CustomerSuppliedId : .  PoolId : default.  SessionId : ydb://session/3?node_id=1&id=YWM2MWM3ZGYtYmRmNzUzOWYtZmFhZjkwMTUtMjgzMmRiN2E=.  CurrentExecutionId : .  Database : /Root.  DatabaseId : /Root. }. Handle abort execution event from: [1:7568542770210411441:2481], status: UNAVAILABLE, reason: { <main>: Error: Terminate execution }
2025-11-03T16:51:26.036084Z :TSimpleWriteSession_AutoSeqNo_BasicUsage INFO: Random seed for debugging is 1762188686036064
2025-11-03T16:51:26.685086Z node 3 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[3:7568542779931437580:2080];send_to=[0:7307199536658146131:7762515];
2025-11-03T16:51:26.685134Z node 3 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
test_client.cpp: SetPath # /home/runner/.ya/build/build_root/7jz3/0019ac/r3tmp/tmpbT9nj3/pdisk_1.dat
2025-11-03T16:51:26.750081Z node 3 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-11-03T16:51:26.782152Z node 3 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-11-03T16:51:26.768737Z node 4 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-11-03T16:51:26.800927Z node 4 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-11-03T16:51:26.801050Z node 4 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=incorrect path status: LookupError;
2025-11-03T16:51:26.963835Z node 3 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-11-03T16:51:26.995865Z node 3 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
2025-11-03T16:51:27.018257Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(3, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-11-03T16:51:27.018341Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(3, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-11-03T16:51:27.020230Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(4, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-11-03T16:51:27.020299Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(4, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-11-03T16:51:27.029918Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(3, (0,0,0,0)) VolatileState: Connecting -> Connected
2025-11-03T16:51:27.034130Z node 3 :HIVE WARN: hive_impl.cpp:811: HIVE#72057594037968897 Handle TEvInterconnect::TEvNodeConnected, NodeId 4 Cookie 4
2025-11-03T16:51:27.035706Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(4, (0,0,0,0)) VolatileState: Connecting -> Connected
2025-11-03T16:51:27.051389Z node 4 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
TServer::EnableGrpc on GrpcPort 17440, node 3
2025-11-03T16:51:27.282730Z node 3 :NET_CLASSIFIER WARN: net_classifier.cpp:190: distributable config is empty, broken or outdated, will use file: /home/runner/.ya/build/build_root/7jz3/0019ac/r3tmp/yandexRytXQv.tmp
2025-11-03T16:51:27.282763Z node 3 :NET_CLASSIFIER WARN: net_classifier.cpp:196: will try to initialize from file: /home/runner/.ya/build/build_root/7jz3/0019ac/r3tmp/yandexRytXQv.tmp
2025-11-03T16:51:27.282891Z node 3 :NET_CLASSIFIER WARN: net_classifier.cpp:202: successfully initialized from file: /home/runner/.ya/build/build_root/7jz3/0019ac/r3tmp/yandexRytXQv.tmp
2025-11-03T16:51:27.283028Z node 3 :NET_CLASSIFIER ERROR: net_classifier.cpp:228: got bad distributable configuration
2025-11-03T16:51:27.328472Z INFO: TTestServer started on Port 29641 GrpcPort 17440
2025-11-03T16:51:27.351120Z node 3 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
TClient is connected to server localhost:29641
PQClient connected to localhost:17440
WaitRootIsUp 'Root'...
TClient::Ls request: Root
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "Root"
    PathId: 1
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 1
    CreateStep: 0
    ParentPathId: 1
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 1
      SubDomainVersion: 0
      SecurityStateVersion: 0
    }
    ChildrenExist: false
  }
  Children {
    Name: ".sys"
    PathId: 18446744073709551615
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 0
    CreateStep: 0
    ParentPathId: 18446744073709551615
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 0
      Pl...
(TRUNCATED)
WaitRootIsUp 'Root' success.
2025-11-03T16:51:27.651367Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpAlterSubDomain, opId: 281474976710657:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_alter_subdomain.cpp:311)
waiting...
waiting...
waiting...
waiting...
2025-11-03T16:51:27.734616Z node 3 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-11-03T16:51:27.772139Z node 4 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-11-03T16:51:30.884209Z node 4 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [4:7568542797073071268:2303], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-03T16:51:30.884215Z node 4 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [4:7568542797073071257:2300], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-03T16:51:30.884298Z node 4 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-03T16:51:30.886585Z node 4 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [4:7568542797073071273:2305], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-03T16:51:30.886738Z node 4 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-03T16:51:30.898023Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateResourcePool, opId: 281474976720657:3, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_resource_pool.cpp:179)
2025-11-03T16:51:30.947384Z node 4 :KQP_WORKLOAD_SERVICE WARN: helpers.h:73: [WorkloadService] [TPoolCreatorActor] ActorId: [4:7568542797073071272:2304], DatabaseId: /Root, PoolId: default, Scheduled retry for error: { <main>: Error: Transaction 281474976720657 completed, doublechecking }
2025-11-03T16:51:31.010738Z node 4 :TX_PROXY ERROR: schemereq.cpp:593: Actor# [4:7568542797073071302:2143] txid# 281474976720658, issues: { message: "Check failed: path: \'/Root/.metadata/workload_manager/pools/default\', error: path exist, request accepts it (id: [OwnerId: 72057594046644480, LocalPathId: 8], type: EPathTypeResourcePool, state: EPathStateNoChanges)" severity: 1 }
2025-11-03T16:51:31.009086Z node 3 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:570: Compilation failed, self: [3:7568542797111307803:2334], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-11-03T16:51:31.011530Z node 3 :KQP_SESSION WARN: kqp_session_actor.cpp:2506: SessionId: ydb://session/3?node_id=3&id=ODQzODA5ZDAtOGQ5OGM2NDAtOTU3YzU1NDMtYzhhN2ExOTA=, ActorId: [3:7568542797111307777:2327], ActorState: ExecuteState, TraceId: 01k95a31gw3b441tw9z9qfcj34, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-11-03T16:51:31.011941Z node 3 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-11-03T16:51:31.032023Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710661:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:690)
2025-11-03T16:51:31.046899Z node 4 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:570: Compilation failed, self: [4:7568542801368038605:2309], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-11-03T16:51:31.049998Z node 4 :KQP_SESSION WARN: kqp_session_actor.cpp:2506: SessionId: ydb://session/3?node_id=4&id=MmExOTdhYjYtZjRkMTM1NzMtMWU3NGVmLTIzYjk5Zjdm, ActorId: [4:7568542797073071255:2299], ActorState: ExecuteState, TraceId: 01k95a31e153znj2qksm99n9pw, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-11-03T16:51:31.050460Z node 4 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-11-03T16:51:31.149511Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710662:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:690)
2025-11-03T16:51:31.311271Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710663:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:690)
=== Init DC: UPSERT INTO `/Root/PQ/Config/V2/Cluster` (name, balancer, local, enabled, weight) VALUES ("dc1", "localhost:17440", true, true, 1000);
2025-11-03T16:51:31.560003Z node 3 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976710664. Ctx: { TraceId: 01k95a31za3p91zphsjewspk5w, Database: , SessionId: ydb://session/3?node_id=3&id=YzIyZjYyNTQtYmQ2MTAyNDgtMmMwY2EyMzAtYWI0OGYyOWU=, PoolId: default, DatabaseId: /Root}. Database not set, use /Root
=== CheckClustersList. Subcribe to ClusterTracker from [3:7568542801406275497:2961] 
2025-11-03T16:51:31.685596Z node 3 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[3:7568542779931437580:2080];send_to=[0:7307199536658146131:7762515];
2025-11-03T16:51:31.685697Z node 3 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
=== CheckClustersList. Ok
2025-11-03T16:51:38.540207Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710669:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:690)
waiting...
PQ Client: create topic: rt3.dc1--test-topic with 1 partitions
CallPersQueueGRPC request to localhost:17440
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-11-03T16:51:38.672138Z node 3 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
CallPersQueueGRPC request to localhost:17440
MetaRequest {
  CmdCreateTopic {
    Topic: "rt3.dc1--test-topic"
    NumPartitions: 1
    Config {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
  }
}
CallPersQueueGRPC response:
Status: 129
ProxyErrorCode: 53
SchemeStatus: 1
FlatTxId {
  TxId: 281474976710670
  SchemeShardTabletId: 72057594046644480
  PathId: 13
}
ErrorCode: OK
AddTopic: rt3.dc1--test-topic
===Run query:``DECLARE $version as Int64; DECLARE $path AS Utf8; DECLARE $cluster as Utf8; UPSERT INTO `/Root/PQ/Config/V2/Topics` (path, dc) VALUES ($path, $cluster); UPSERT INTO `/Root/PQ/Config/V2/Versions` (name, version) VALUES ("Topics", $version);`` with topic = test-topic, dc = dc1
2025-11-03T16:51:38.754299Z node 3 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1655: [72075186224037893][] pipe [3:7568542831471046976:3227] connected; active server actors: 1
2025-11-03T16:51:38.754473Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1519: [72075186224037893][rt3.dc1--test-topic] updating configuration. Deleted partitions []. Added partitions [0]
2025-11-03T16:51:38.755368Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:971: [72075186224037893][rt3.dc1--test-topic] Discovered subdomain [OwnerId: 72057594046644480, LocalPathId: 1] state, outOfSpace = 0 at RB 72075186224037893
2025-11-03T16:51:38.757426Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:140: [72075186224037893][rt3.dc1--test-topic] BALANCER INIT DONE for rt3.dc1--test-topic: (0, 72075186224037892) 
2025-11-03T16:51:38.784394Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2960: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-11-03T16:51:38.789562Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2992: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-11-03T16:51:38.789869Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:787: [PQ: 72075186224037892] no config, start with empty partitions and default config
2025-11-03T16:51:38.789900Z node 4 :PERSQUEUE NOTICE: pq_impl.cpp:913: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-11-03T16:51:38.789942Z node 4 :PERSQUEUE INFO: pq_impl.cpp:612: [PQ: 72075186224037892] doesn't have tx writes info
2025-11-03T16:51:38.791537Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:404: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 4, Generation 1
2025-11-03T16:51:38.791740Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [3:7568542831471046975:3226], now have 1 active actors on pipe
2025-11-03T16:51:38.791772Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [3:7568542831471047021:2428], now have 1 active actors on pipe
2025-11-03T16:51:38.792670Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-03T16:51:38.798859Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-03T16:51:38.806906Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [3:7568542831471047049:3279], now have 1 active actors on pipe
2025-11-03T16:51:38.807492Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-03T16:51:38.820959Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-03T16:51:38.821962Z node 4 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-11-03T16:51:38.822019Z node 4 :PERSQUEUE DEBUG: partition.cpp:1312: [72075186224037892][Partition][0][StateInit] HandleOnInit TEvPQ::TEvProposePartitionConfig
2025-11-03T16:51:38.822312Z node 4 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-11-03T16:51:38.822504Z node 4 :PERSQUEUE INFO: partition_init.cpp:1101: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [4:7568542831432810122:2382]
2025-11-03T16:51:38.831874Z node 4 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-11-03T16:51:38.831927Z node 4 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-11-03T16:51:38.831952Z node 4 :PERSQUEUE INFO: partition.cpp:707: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1 [4:7568542831432810122:2382]
2025-11-03T16:51:38.831995Z node 4 :PERSQUEUE DEBUG: partition.cpp:727: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 0 Head Offset 0 PartNo 0 PackedSize 0 count 0 nextOffset 0 batches 0
2025-11-03T16:51:38.832035Z node 4 :PERSQUEUE DEBUG: partition_mlp.cpp:83: [72075186224037892][Partition][0][StateIdle] Initializing MLP Consumers: 0
2025-11-03T16:51:38.833760Z node 4 :PERSQUEUE DEBUG: partition.cpp:4273: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 1
2025-11-03T16:51:38.833802Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:38.833884Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:38.833895Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-03T16:51:38.833915Z node 4 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-11-03T16:51:38.833928Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:38.833941Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:38.833950Z node 4 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-11-03T16:51:38.833982Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:923: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-11-03T16:51:38.834021Z node 4 :PERSQUEUE DEBUG: partition_mlp.cpp:60: [72075186224037892][Partition][0][StateIdle] Process MLP pending events. Count 0
2025-11-03T16:51:38.834682Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-03T16:51:38.834838Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:183: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:51:38.845244Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-03T16:51:38.845397Z node 4 :PERSQUEUE DEBUG: partition.cpp:1416: [72075186224037892][Partition][0][StateIdle] Handle TEvPQ::TEvTxCommit Step 1762188698851, TxId 281474976710670
2025-11-03T16:51:38.845423Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:38.845438Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:38.845561Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:38.845757Z node 4 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-03T16:51:38.849615Z node 4 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-03T16:51:38.849810Z node 4 :PERSQUEUE DEBUG: partition_mlp.cpp:83: [72075186224037892][Partition][0][StateIdle] Initializing MLP Consumers: 0
2025-11-03T16:51:38.849928Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-11-03T16:51:38.849957Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:38.849970Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:38.849980Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:38.850016Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:183: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:51:38.850396Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:398: [PQ: 72075186224037892] Apply new config PartitionConfig { LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 } PartitionIds: 0 TopicName: "rt3.dc1--test-topic" Version: 0 LocalDC: true Codecs { Ids: 0 Ids: 1 Ids: 2 Codecs: "raw" Codecs: "gzip" Codecs: "lzop" } TopicPath: "/Root/PQ/rt3.dc1--test-topic" YcCloudId: "" YcFolderId: "" YdbDatabaseId: "" YdbDatabasePath: "/Root" Partitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } AllPartitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } Consumers { Name: "user" ReadFromTimestampsMs: 0 FormatVersion: 0 Version: 0 Generation: 0 } MonitoringProjectId: ""
2025-11-03T16:51:38.850508Z node 4 :PERSQUEUE NOTICE: pq_impl.cpp:913: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-11-03T16:51:38.850792Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-03T16:51:38.869091Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-03T16:51:38.869201Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-03T16:51:38.876069Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-03T16:51:38.909253Z node 3 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976710671. Ctx: { TraceId: 01k95a394sdvndt94d0b454k5w, Database: , SessionId: ydb://session/3?node_id=3&id=MmQ2NzZiYzMtNGU3YjJkOS0zMDE5OWMwZC1jNTI5MGY4OQ==, PoolId: default, DatabaseId: /Root}. Database not set, use /Root
2025-11-03T16:51:38.935080Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:38.935118Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:38.935134Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
===Query complete
TClient::Ls request: /Root/PQ/rt3.dc1--test-topic
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976710670
    CreateStep: 1762188698851
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts...
(TRUNCATED)
GetTopicVersionFromPath:  record Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976710670
    CreateStep: 1762188698851
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      YdbDatabasePath: "/Root"
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
    Partitions {
      PartitionId: 0
      TabletId: 72075186224037892
      Status: Active
    }
    AlterVersion: 1
    BalancerTabletID: 72075186224037893
    NextPartitionId: 1
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 1
      PlanResolution: 7
      Coordinators: 72057594046316545
      TimeCastBucketsPerMediator: 2
      Mediators: 72057594046382081
    }
    DomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    PathsInside: 12
    PathsLimit: 10000
    ShardsInside: 6
    ShardsLimit: 200000
    ResourcesDomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    DiskSpaceUsage {
      Tables {
        TotalSize: 0
        DataSize: 0
        IndexSize: 0
      }
      Topics {
        ReserveSize: 0
        AccountSize: 0
        DataSize: 0
        UsedReserveSize: 0
      }
    }
    PQPartitionsInside: 1
    PQPartitionsLimit: 1000000
    SchemeLimits {
      MaxDepth: 32
      MaxPaths: 10000
      MaxChildrenInDir: 100000
      MaxAclBytesSize: 10240
      MaxTableColumns: 200
      MaxTableColumnNameLength: 255
      MaxTableKeyColumns: 30
      MaxTableIndices: 20
      MaxShards: 200000
      MaxShardsInPath: 35000
      MaxConsistentCopyTargets: 10000
      MaxPathElementLength: 255
      ExtraPathSymbolsAllowed: "!\"#$%&\'()*+,-.:;<=>?@[\\]^_`{|}~"
      MaxPQPartitions: 1000000
      MaxTableCdcStreams: 5
      MaxExports: 10
      MaxImports: 10
      MaxColumnTableColumns: 10000
    }
  }
}
Path: "/Root/PQ/rt3.dc1--test-topic"
 name rt3.dc1--test-topic version1
CallPersQueueGRPC request to localhost:17440
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-11-03T16:51:38.962587Z node 3 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
MetaResponse {
  CmdGetTopicMetadataResult {
    TopicInfo {
      Topic: "rt3.dc1--test-topic"
      NumPartitions: 1
      Config {
        PartitionConfig {
          LifetimeSeconds: 86400
          LowWatermark: 8388608
          SourceIdLifetimeSeconds: 86400
          WriteSpeedInBytesPerSecond: 20000000
          BurstSize: 20000000
          SourceIdMaxCounts: 6000000
        }
        Version: 1
        LocalDC: true
        Codecs {
          Ids: 0
          Ids: 1
          Ids: 2
          Codecs: "raw"
          Codecs: "gzip"
          Codecs: "lzop"
        }
        TopicPath: "/Root/PQ/rt3.dc1--test-topic"
        YdbDatabasePath: "/Root"
        Consumers {
          Name: "user"
          ReadFromTimestampsMs: 0
          FormatVersion: 0
          Version: 0
        }
      }
      ErrorCode: OK
    }
  }
}
=== Topic created, have version: 1
2025-11-03T16:51:38.976966Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: try to update token
2025-11-03T16:51:38.977472Z :INFO: [] MessageGroupId [src] SessionId [] Write session: Do CDS request
2025-11-03T16:51:38.977522Z :INFO: [] MessageGroupId [src] SessionId [] Start write session. Will connect to endpoint: localhost:17440
2025-11-03T16:51:38.987107Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src" }
2025-11-03T16:51:38.988034Z node 3 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-11-03T16:51:38.988071Z node 3 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1
2025-11-03T16:51:38.989469Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src" }
2025-11-03T16:51:38.989580Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1 topic: "test-topic" message_group_id: "src" from ipv6:[::1]:34950
2025-11-03T16:51:38.989596Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:34950 proto=v1  topic=test-topic durationSec=0
2025-11-03T16:51:38.989604Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-11-03T16:51:38.991227Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1 sessionId:  describe result for acl check
2025-11-03T16:51:38.991335Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-11-03T16:51:38.991345Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-11-03T16:51:38.991353Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-11-03T16:51:38.991368Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [3:7568542831471047136:2444] (SourceId=src, PreferedPartition=(NULL)) StartKqpSession
2025-11-03T16:51:38.993943Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [3:7568542831471047136:2444] (SourceId=src, PreferedPartition=(NULL)) Select from the table
2025-11-03T16:51:39.040081Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:39.040114Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:39.040127Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:39.140073Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:39.140103Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:39.140116Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:39.160113Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [3:7568542831471047136:2444] (SourceId=src, PreferedPartition=(NULL)) RequestPQRB
2025-11-03T16:51:39.162378Z node 3 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1655: [72075186224037893][rt3.dc1--test-topic] pipe [3:7568542835766014468:2444] connected; active server actors: 1
2025-11-03T16:51:39.162549Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [3:7568542831471047136:2444] (SourceId=src, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=src
2025-11-03T16:51:39.162566Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [3:7568542831471047136:2444] (SourceId=src, PreferedPartition=(NULL)) Update the table
2025-11-03T16:51:39.194549Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1659: [72075186224037893][rt3.dc1--test-topic] pipe [3:7568542835766014468:2444] disconnected.
2025-11-03T16:51:39.194589Z node 3 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1670: [72075186224037893][rt3.dc1--test-topic] pipe [3:7568542835766014468:2444] disconnected; active server actors: 1
2025-11-03T16:51:39.194609Z node 3 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1695: [72075186224037893][rt3.dc1--test-topic] pipe [3:7568542835766014468:2444] disconnected no session
2025-11-03T16:51:39.244134Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:39.244178Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:39.244196Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:39.301964Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [3:7568542831471047136:2444] (SourceId=src, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-11-03T16:51:39.302002Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [3:7568542831471047136:2444] (SourceId=src, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-11-03T16:51:39.302019Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [3:7568542831471047136:2444] (SourceId=src, PreferedPartition=(NULL)) Start idle
2025-11-03T16:51:39.302047Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-11-03T16:51:39.304074Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 4, Generation: 1
2025-11-03T16:51:39.304062Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [3:7568542835766014495:2444], now have 1 active actors on pipe
2025-11-03T16:51:39.306254Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:39.306298Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:39.306403Z node 4 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src|3860522e-82bb74c2-7603c1b9-bd46df40_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src
2025-11-03T16:51:39.306445Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:39.306468Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:39.306481Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-03T16:51:39.306531Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:39.306624Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-03T16:51:39.306715Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-03T16:51:39.307417Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:39.307446Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:39.307521Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-03T16:51:39.307852Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1 partition: 0 MaxSeqNo: 0 sessionId: src|3860522e-82bb74c2-7603c1b9-bd46df40_0
2025-11-03T16:51:39.316128Z :INFO: [] MessageGroupId [src] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1762188699316 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-11-03T16:51:39.316259Z :INFO: [] MessageGroupId [src] SessionId [] Write session established. Init response: session_id: "src|3860522e-82bb74c2-7603c1b9-bd46df40_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-11-03T16:51:39.317578Z :INFO: [] MessageGroupId [src] SessionId [src|3860522e-82bb74c2-7603c1b9-bd46df40_0] Write session: close. Timeout = 0 ms
2025-11-03T16:51:39.317642Z :INFO: [] MessageGroupId [src] SessionId [src|3860522e-82bb74c2-7603c1b9-bd46df40_0] Write session will now close
2025-11-03T16:51:39.317689Z :DEBUG: [] MessageGroupId [src] SessionId [src|3860522e-82bb74c2-7603c1b9-bd46df40_0] Write session: aborting
2025-11-03T16:51:39.318176Z :INFO: [] MessageGroupId [src] SessionId [src|3860522e-82bb74c2-7603c1b9-bd46df40_0] Write session: gracefully shut down, all writes complete
2025-11-03T16:51:39.318215Z :DEBUG: [] MessageGroupId [src] SessionId [src|3860522e-82bb74c2-7603c1b9-bd46df40_0] Write session: destroy
2025-11-03T16:51:39.325491Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId: src|3860522e-82bb74c2-7603c1b9-bd46df40_0 grpc read done: success: 0 data: 
2025-11-03T16:51:39.325521Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 1 sessionId: src|3860522e-82bb74c2-7603c1b9-bd46df40_0 grpc read failed
2025-11-03T16:51:39.325550Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 1 sessionId: src|3860522e-82bb74c2-7603c1b9-bd46df40_0 grpc closed
2025-11-03T16:51:39.325566Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1 sessionId: src|3860522e-82bb74c2-7603c1b9-bd46df40_0 is DEAD
2025-11-03T16:51:39.326198Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-11-03T16:51:39.327289Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [3:7568542835766014495:2444] destroyed
2025-11-03T16:51:39.327344Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-11-03T16:51:39.327379Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:39.327396Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:39.327413Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:39.345907Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:39.345951Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:39.345968Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:39.365895Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [] Write session: try to update token
2025-11-03T16:51:39.366565Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [] Write session: Do CDS request
2025-11-03T16:51:39.366631Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [] Do schedule cds request after 0 ms
2025-11-03T16:51:39.366760Z :INFO: [/Root] MessageGroupId [test-message-group-id] Running cds request ms
2025-11-03T16:51:39.383082Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [] Got CDS response: 
write_sessions_clusters { clusters { endpoint: "localhost:17440" name: "dc1" available: true } primary_cluster_selection_reason: CLIENT_LOCATION } version: 1
2025-11-03T16:51:39.383163Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [] Start write session. Will connect to endpoint: localhost:17440
2025-11-03T16:51:39.404856Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [] Write session: send init request: init_request { topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" }
2025-11-03T16:51:39.405337Z node 3 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-11-03T16:51:39.405366Z node 3 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2
2025-11-03T16:51:39.405990Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" }
2025-11-03T16:51:39.406115Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2 topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" from ipv6:[::1]:34990
2025-11-03T16:51:39.406136Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:34990 proto=v1  topic=test-topic durationSec=0
2025-11-03T16:51:39.406145Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-11-03T16:51:39.407556Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2 sessionId:  describe result for acl check
2025-11-03T16:51:39.407678Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-11-03T16:51:39.407689Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-11-03T16:51:39.407697Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-11-03T16:51:39.407715Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [3:7568542835766014508:2462] (SourceId=test-message-group-id, PreferedPartition=(NULL)) StartKqpSession
2025-11-03T16:51:39.410286Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [3:7568542835766014508:2462] (SourceId=test-message-group-id, PreferedPartition=(NULL)) Select from the table
2025-11-03T16:51:39.416901Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [3:7568542835766014508:2462] (SourceId=test-message-group-id, PreferedPartition=(NULL)) RequestPQRB
2025-11-03T16:51:39.421891Z node 3 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1655: [72075186224037893][rt3.dc1--test-topic] pipe [3:7568542835766014528:2462] connected; active server actors: 1
2025-11-03T16:51:39.421944Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [3:7568542835766014508:2462] (SourceId=test-message-group-id, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=test-message-group-id
2025-11-03T16:51:39.421963Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [3:7568542835766014508:2462] (SourceId=test-message-group-id, PreferedPartition=(NULL)) Update the table
2025-11-03T16:51:39.422290Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1659: [72075186224037893][rt3.dc1--test-topic] pipe [3:7568542835766014528:2462] disconnected.
2025-11-03T16:51:39.422309Z node 3 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1670: [72075186224037893][rt3.dc1--test-topic] pipe [3:7568542835766014528:2462] disconnected; active server actors: 1
2025-11-03T16:51:39.422327Z node 3 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1695: [72075186224037893][rt3.dc1--test-topic] pipe [3:7568542835766014528:2462] disconnected no session
2025-11-03T16:51:39.437606Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [3:7568542835766014508:2462] (SourceId=test-message-group-id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-11-03T16:51:39.437645Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [3:7568542835766014508:2462] (SourceId=test-message-group-id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-11-03T16:51:39.437663Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [3:7568542835766014508:2462] (SourceId=test-message-group-id, PreferedPartition=(NULL)) Start idle
2025-11-03T16:51:39.437690Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-11-03T16:51:39.440445Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [3:7568542835766014544:2462], now have 1 active actors on pipe
2025-11-03T16:51:39.441157Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:39.441195Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:39.441280Z node 4 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie test-message-group-id|567b2f42-d5ce001b-ddeeaa2e-db99cae8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner test-message-group-id
2025-11-03T16:51:39.441316Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:39.441336Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:39.441350Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-03T16:51:39.441397Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:39.441452Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-03T16:51:39.441527Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-03T16:51:39.442386Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:39.442414Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:39.442483Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-03T16:51:39.443957Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1762188699443 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-11-03T16:51:39.440845Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 4, Generation: 1
2025-11-03T16:51:39.444159Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [] Write session established. Init response: session_id: "test-message-group-id|567b2f42-d5ce001b-ddeeaa2e-db99cae8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-11-03T16:51:39.442958Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2 partition: 0 MaxSeqNo: 0 sessionId: test-message-group-id|567b2f42-d5ce001b-ddeeaa2e-db99cae8_0
2025-11-03T16:51:39.444437Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|567b2f42-d5ce001b-ddeeaa2e-db99cae8_0] Write 1 messages with Id from 1 to 1
2025-11-03T16:51:39.444733Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|567b2f42-d5ce001b-ddeeaa2e-db99cae8_0] Write 1 messages with Id from 2 to 2
2025-11-03T16:51:39.444893Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|567b2f42-d5ce001b-ddeeaa2e-db99cae8_0] Write 1 messages with Id from 3 to 3
2025-11-03T16:51:39.445046Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|567b2f42-d5ce001b-ddeeaa2e-db99cae8_0] Write 1 messages with Id from 4 to 4
2025-11-03T16:51:39.445194Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|567b2f42-d5ce001b-ddeeaa2e-db99cae8_0] Write 1 messages with Id from 5 to 5
2025-11-03T16:51:39.445221Z :TSimpleWriteSession_AutoSeqNo_BasicUsage INFO: All messages are written
2025-11-03T16:51:39.445380Z :INFO: [/Root] [/Root] [c3833220-c2302504-95bb402a-23a18f0f] Starting read session
2025-11-03T16:51:39.445409Z :DEBUG: [/Root] [/Root] [c3833220-c2302504-95bb402a-23a18f0f] Starting cluster discovery
Get event on client
2025-11-03T16:51:39.447810Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:39.448026Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|567b2f42-d5ce001b-ddeeaa2e-db99cae8_0] Write session: try to update token
2025-11-03T16:51:39.448117Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|567b2f42-d5ce001b-ddeeaa2e-db99cae8_0] Send 1 message(s) (4 left), first sequence number is 1
2025-11-03T16:51:39.447837Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:39.447859Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:39.448716Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|567b2f42-d5ce001b-ddeeaa2e-db99cae8_0] Write session: try to update token
2025-11-03T16:51:39.448760Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|567b2f42-d5ce001b-ddeeaa2e-db99cae8_0] Send 1 message(s) (3 left), first sequence number is 2
2025-11-03T16:51:39.451863Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|567b2f42-d5ce001b-ddeeaa2e-db99cae8_0] Write session: try to update token
2025-11-03T16:51:39.451920Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|567b2f42-d5ce001b-ddeeaa2e-db99cae8_0] Send 3 message(s) (0 left), first sequence number is 3
2025-11-03T16:51:39.452515Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: test-message-group-id|567b2f42-d5ce001b-ddeeaa2e-db99cae8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:51:39.452855Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:51:39.454082Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:39.454123Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:39.454232Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-11-03T16:51:39.454973Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: test-message-group-id|567b2f42-d5ce001b-ddeeaa2e-db99cae8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:51:39.455576Z :DEBUG: [/Root] [/Root] [c3833220-c2302504-95bb402a-23a18f0f] Cluster discovery request succeeded
2025-11-03T16:51:39.455057Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:39.455642Z :DEBUG: [/Root] [/Root] [c3833220-c2302504-95bb402a-23a18f0f] Starting session to cluster dc1 (localhost:17440)
2025-11-03T16:51:39.455452Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:51:39.455828Z :DEBUG: [/Root] [/Root] [c3833220-c2302504-95bb402a-23a18f0f] [dc1] In Reconnect, ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:51:39.455861Z :DEBUG: [/Root] [/Root] [c3833220-c2302504-95bb402a-23a18f0f] [dc1] New values: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:51:39.455894Z :DEBUG: [/Root] [/Root] [c3833220-c2302504-95bb402a-23a18f0f] [dc1] Reconnecting session to cluster dc1 in 0.000000s
2025-11-03T16:51:39.456030Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:39.456066Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:39.456436Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0test-message-group-id' SeqNo: 1 partNo : 0 messageNo: 1 size 1908 offset: -1
2025-11-03T16:51:39.456500Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:39.456516Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:39.456551Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:51:39.456603Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:39.456631Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:39.456644Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-03T16:51:39.456754Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0test-message-group-id' seqNo 1 partNo 0
2025-11-03T16:51:39.461553Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0test-message-group-id' seqNo 1 partNo 0 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 1997 count 1 nextOffset 1 batches 1
2025-11-03T16:51:39.461615Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:39.462162Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 0,1 HeadOffset 0 endOffset 0 curOffset 1 d0000000000_00000000000000000000_00000_0000000001_00000? size 1985 WTime 1762188699462
2025-11-03T16:51:39.462384Z node 4 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-03T16:51:39.462505Z node 4 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 0 partNo 0 count 1 size 1985
2025-11-03T16:51:39.462550Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 2  requestId: <none> cookie: 2
2025-11-03T16:51:39.463670Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: test-message-group-id|567b2f42-d5ce001b-ddeeaa2e-db99cae8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:51:39.464118Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:51:39.464473Z :DEBUG: [/Root] [/Root] [c3833220-c2302504-95bb402a-23a18f0f] [dc1] Successfully connected. Initializing session
2025-11-03T16:51:39.464548Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:39.465290Z node 3 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:109: new grpc connection
2025-11-03T16:51:39.465318Z node 3 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:131: new session created cookie 1
2025-11-03T16:51:39.466023Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { topic: "test-topic" } read_only_original: true consumer: "shared/user" read_params { max_read_size: 104857600 } } }
2025-11-03T16:51:39.466265Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 1 consumer shared/user session shared/user_3_1_10844929437138650019_v1 read init: from# ipv6:[::1]:34990, request# { init_request { topics_read_settings { topic: "test-topic" } read_only_original: true consumer: "shared/user" read_params { max_read_size: 104857600 } } }
2025-11-03T16:51:39.466690Z node 3 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 1 consumer shared/user session shared/user_3_1_10844929437138650019_v1 auth for : user
2025-11-03T16:51:39.467436Z node 3 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 1 consumer shared/user session shared/user_3_1_10844929437138650019_v1 Handle describe topics response
2025-11-03T16:51:39.467557Z node 3 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 1 consumer shared/user session shared/user_3_1_10844929437138650019_v1 auth is DEAD
2025-11-03T16:51:39.467625Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 1 consumer shared/user session shared/user_3_1_10844929437138650019_v1 auth ok: topics# 1, initDone# 0
2025-11-03T16:51:39.468770Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 1 consumer shared/user session shared/user_3_1_10844929437138650019_v1 register session: topic# rt3.dc1--test-topic
2025-11-03T16:51:39.469813Z node 3 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1655: [72075186224037893][rt3.dc1--test-topic] pipe [3:7568542835766014551:2467] connected; active server actors: 1
2025-11-03T16:51:39.469979Z node 3 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1706: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [3:7568542835766014551:2467] session shared/user_3_1_10844929437138650019_v1
2025-11-03T16:51:39.470026Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:639: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-11-03T16:51:39.470073Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:669: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-11-03T16:51:39.470109Z node 3 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:871: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_3_1_10844929437138650019_v1" (Sender=[3:7568542835766014548:2467], Pipe=[3:7568542835766014551:2467], Partitions=[], ActiveFamilyCount=0)
2025-11-03T16:51:39.470141Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1186: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-11-03T16:51:39.470184Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1258: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-11-03T16:51:39.470230Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1305: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_3_1_10844929437138650019_v1" (Sender=[3:7568542835766014548:2467], Pipe=[3:7568542835766014551:2467], Partitions=[], ActiveFamilyCount=0)
2025-11-03T16:51:39.470294Z node 3 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:549: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_3_1_10844929437138650019_v1" sender [3:7568542835766014548:2467] lock partition 0 for ReadingSession "shared/user_3_1_10844929437138650019_v1" (Sender=[3:7568542835766014548:2467], Pipe=[3:7568542835766014551:2467], Partitions=[], ActiveFamilyCount=1) generation 1 step 1
2025-11-03T16:51:39.470341Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1325: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-11-03T16:51:39.470369Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1402: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000162s
2025-11-03T16:51:39.471221Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 1 consumer shared/user session shared/user_3_1_10844929437138650019_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 1 Session: "shared/user_3_1_10844929437138650019_v1" ClientId: "user" PipeClient { RawX1: 7568542835766014551 RawX2: 4503612512274851 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-11-03T16:51:39.471316Z node 3 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 1 consumer shared/user session shared/user_3_1_10844929437138650019_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-11-03T16:51:39.467616Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:39.467667Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:39.467739Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:39.467752Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:39.467819Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0test-message-group-id' SeqNo: 2 partNo : 0 messageNo: 4 size 2801 offset: -1
2025-11-03T16:51:39.467885Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:51:39.467931Z node 4 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:51:39.467954Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 3  requestId: <none> cookie: 3
2025-11-03T16:51:39.472460Z :INFO: [/Root] [/Root] [c3833220-c2302504-95bb402a-23a18f0f] [dc1] Server session id: shared/user_3_1_10844929437138650019_v1
2025-11-03T16:51:39.472806Z :DEBUG: [/Root] [/Root] [c3833220-c2302504-95bb402a-23a18f0f] [dc1] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:51:39.472505Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:39.473950Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:39.474320Z node 3 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_3_1_10844929437138650019_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 1, pipe: [3:7568542835766014554:2470]
2025-11-03T16:51:39.473993Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:39.474056Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0test-message-group-id' SeqNo: 3 partNo : 0 messageNo: 5 size 3693 offset: -1
2025-11-03T16:51:39.474086Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0test-message-group-id' SeqNo: 4 partNo : 0 messageNo: 5 size 4590 offset: -1
2025-11-03T16:51:39.474106Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0test-message-group-id' SeqNo: 5 partNo : 0 messageNo: 5 size 5485 offset: -1
2025-11-03T16:51:39.474175Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [3:7568542835766014554:2470], now have 1 active actors on pipe
2025-11-03T16:51:39.474202Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:51:39.474275Z node 4 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:51:39.476398Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_3_1_10844929437138650019_v1 grpc read done: success# 1, data# { read { } }
2025-11-03T16:51:39.476557Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_3_1_10844929437138650019_v1 got read request: guid# b11ae679-b0907f79-268ec7ba-98f1338
2025-11-03T16:51:39.474774Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:39.474812Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:39.474845Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:1748: [PQ: 72075186224037892] Created session shared/user_3_1_10844929437138650019_v1 on pipe: [3:7568542835766014554:2470]
2025-11-03T16:51:39.474944Z node 4 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:51:39.474969Z node 4 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_3_1_10844929437138650019_v1:1 with generation 1
2025-11-03T16:51:39.475493Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 0 count 1 size 1985 actorID [4:7568542831432810104:2382]
2025-11-03T16:51:39.475555Z node 4 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-03T16:51:39.475607Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1930 WriteNewSizeFromSupportivePartitions# 0
2025-11-03T16:51:39.475618Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 0 suffix '63' size 1985
2025-11-03T16:51:39.475640Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:51:39.475683Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0test-message-group-id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 1, partNo: 0, Offset: 0 is stored on disk
2025-11-03T16:51:39.475859Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:923: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-11-03T16:51:39.475879Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:965: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-11-03T16:51:39.475899Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:39.475943Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:39.475958Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (5)
2025-11-03T16:51:39.476096Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0test-message-group-id' seqNo 2 partNo 0
2025-11-03T16:51:39.477559Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0test-message-group-id' seqNo 2 partNo 0 FormedBlobsCount 0 NewHead: Offset 1 PartNo 0 PackedSize 2890 count 1 nextOffset 2 batches 1
2025-11-03T16:51:39.477628Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0test-message-group-id' seqNo 3 partNo 0
2025-11-03T16:51:39.477661Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0test-message-group-id' seqNo 3 partNo 0 FormedBlobsCount 0 NewHead: Offset 1 PartNo 0 PackedSize 6640 count 2 nextOffset 3 batches 1
2025-11-03T16:51:39.477683Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0test-message-group-id' seqNo 4 partNo 0
2025-11-03T16:51:39.477707Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0test-message-group-id' seqNo 4 partNo 0 FormedBlobsCount 0 NewHead: Offset 1 PartNo 0 PackedSize 11287 count 3 nextOffset 4 batches 1
2025-11-03T16:51:39.477733Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0test-message-group-id' seqNo 5 partNo 0
2025-11-03T16:51:39.477754Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0test-message-group-id' seqNo 5 partNo 0 FormedBlobsCount 0 NewHead: Offset 1 PartNo 0 PackedSize 16829 count 4 nextOffset 5 batches 1
2025-11-03T16:51:39.477813Z node 4 :PERSQUEUE DEBUG: partition.cpp:3666: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_3_1_10844929437138650019_v1
2025-11-03T16:51:39.477835Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:39.478645Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 1,4 HeadOffset 1 endOffset 1 curOffset 5 d0000000000_00000000000000000001_00000_0000000004_00000? size 16713 WTime 1762188699477
2025-11-03T16:51:39.478919Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:51:39.478968Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1  requestId: <none> cookie: 1
2025-11-03T16:51:39.479041Z node 4 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-03T16:51:39.479150Z node 4 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 1 partNo 0 count 4 size 16713
2025-11-03T16:51:39.479350Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:880: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 partno 0 count 1 size 1024000 endOffset 1 max time lag 0ms effective offset 0
2025-11-03T16:51:39.479520Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:1105: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 1985 count 1 last offset 0, current partition end offset: 1
2025-11-03T16:51:39.479534Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:1121: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-11-03T16:51:39.479603Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 0 partno 0 count 1 parts_count 0 source 1 size 1985 accessed 0 times before, last time 2025-11-03T16:51:39.000000Z
2025-11-03T16:51:39.479624Z node 4 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 3. All 1 blobs are from cache.
2025-11-03T16:51:39.479661Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:572: FormAnswer for 1 blobs
2025-11-03T16:51:39.479794Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 0 totakecount 1 count 1 size 1965 from pos 0 cbcount 1
2025-11-03T16:51:39.479864Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:1015: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1762188699454 queuesize 0 startOffset 0
2025-11-03T16:51:39.480463Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 0 suffix '63'
2025-11-03T16:51:39.484078Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:39.488497Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|567b2f42-d5ce001b-ddeeaa2e-db99cae8_0] Write session got write response: sequence_numbers: 1 offsets: 0 already_written: false write_statistics { persist_duration_ms: 15 queued_in_partition_duration_ms: 4 }
2025-11-03T16:51:39.488562Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|567b2f42-d5ce001b-ddeeaa2e-db99cae8_0] Write session: acknoledged message 1
2025-11-03T16:51:39.510528Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 1 count 4 size 16713 actorID [4:7568542831432810104:2382]
2025-11-03T16:51:39.510603Z node 4 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-03T16:51:39.510682Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 16657 WriteNewSizeFromSupportivePartitions# 0
2025-11-03T16:51:39.510724Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:51:39.510760Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0test-message-group-id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 2, partNo: 0, Offset: 1 is stored on disk
2025-11-03T16:51:39.510776Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:51:39.510794Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0test-message-group-id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 3, partNo: 0, Offset: 2 is stored on disk
2025-11-03T16:51:39.510806Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:51:39.510824Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0test-message-group-id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 4, partNo: 0, Offset: 3 is stored on disk
2025-11-03T16:51:39.510836Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:51:39.510857Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0test-message-group-id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 5, partNo: 0, Offset: 4 is stored on disk
2025-11-03T16:51:39.511029Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:39.511043Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:39.511055Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:39.511088Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:51:39.511125Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-11-03T16:51:39.511167Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 4  requestId: <none> cookie: 2
2025-11-03T16:51:39.511198Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 5  requestId: <none> cookie: 3
2025-11-03T16:51:39.515966Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 1 partno 0 count 4 parts 0 suffix '63' size 16713
2025-11-03T16:51:39.520781Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_3_1_10844929437138650019_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 1 WriteTimestampMS: 1762188699454 SizeLag: 1985 WriteTimestampEstimateMS: 1762188699476 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-11-03T16:51:39.520841Z node 3 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 1 consumer shared/user session shared/user_3_1_10844929437138650019_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 1 readOffset 0 committedOffset 0
2025-11-03T16:51:39.520931Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:39.521003Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:39.521691Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 1 consumer shared/user session shared/user_3_1_10844929437138650019_v1 sending to client partition status
2025-11-03T16:51:39.524500Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|567b2f42-d5ce001b-ddeeaa2e-db99cae8_0] Write session got write response: sequence_numbers: 2 offsets: 1 already_written: false write_statistics { persist_duration_ms: 33 queued_in_partition_duration_ms: 10 }
2025-11-03T16:51:39.524567Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|567b2f42-d5ce001b-ddeeaa2e-db99cae8_0] Write session: acknoledged message 2
2025-11-03T16:51:39.525050Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|567b2f42-d5ce001b-ddeeaa2e-db99cae8_0] Write session got write response: sequence_numbers: 3 sequence_numbers: 4 sequence_numbers: 5 offsets: 2 offsets: 3 offsets: 4 already_written: false already_written: false already_written: false write_statistics { persist_duration_ms: 33 queued_in_partition_duration_ms: 4 }
2025-11-03T16:51:39.525088Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|567b2f42-d5ce001b-ddeeaa2e-db99cae8_0] Write session: acknoledged message 3
2025-11-03T16:51:39.525124Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|567b2f42-d5ce001b-ddeeaa2e-db99cae8_0] Write session: acknoledged message 4
2025-11-03T16:51:39.525147Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|567b2f42-d5ce001b-ddeeaa2e-db99cae8_0] Write session: acknoledged message 5
2025-11-03T16:51:39.528099Z :INFO: [/Root] [/Root] [c3833220-c2302504-95bb402a-23a18f0f] [dc1] Confirm partition stream create. Partition stream id: 1. Cluster: "dc1". Topic: "test-topic". Partition: 0. Read offset: (NULL)
2025-11-03T16:51:39.528368Z :TSimpleWriteSession_AutoSeqNo_BasicUsage INFO: Read message count is 0 (from 5 in total), committed offset count is 0 (maximum offset: 0)
Get event on client
2025-11-03T16:51:39.529040Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_3_1_10844929437138650019_v1 grpc read done: success# 1, data# { start_read { topic { path: "test-topic" } cluster: "dc1" assign_id: 1 } }
2025-11-03T16:51:39.529173Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:539: session cookie 1 consumer shared/user session shared/user_3_1_10844929437138650019_v1 got StartRead from client: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 0, commitOffset# 0
2025-11-03T16:51:39.529216Z node 3 :PQ_READ_PROXY INFO: partition_actor.cpp:1023: session cookie 1 consumer shared/user session shared/user_3_1_10844929437138650019_v1 Start reading TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 1 readOffset 0 committedOffset 0 clientCommitOffset 0 clientReadOffset 0
2025-11-03T16:51:39.529240Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_3_1_10844929437138650019_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 0 endOffset 1
2025-11-03T16:51:39.529289Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_3_1_10844929437138650019_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 0, endOffset# 1, WTime# 1762188699454, sizeLag# 1985
2025-11-03T16:51:39.529303Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_3_1_10844929437138650019_v1TEvPartitionReady. Aval parts: 1
2025-11-03T16:51:39.529337Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_3_1_10844929437138650019_v1 performing read request: guid# b11ae679-b0907f79-268ec7ba-98f1338, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 1, size# 2382, partitionsAsked# 1, maxTimeLag# 0ms
2025-11-03T16:51:39.529407Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_3_1_10844929437138650019_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 1 maxSize 2382 maxTimeLagMs 0 readTimestampMs 0 readOffset 0 EndOffset 1 ClientCommitOffset 0 committedOffset 0 Guid b11ae679-b0907f79-268ec7ba-98f1338
2025-11-03T16:51:39.530203Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:39.530236Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:39.530340Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:880: [72075186224037892][Partition][0][StateIdle] read cookie 4 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 partno 0 count 1 size 2382 endOffset 5 max time lag 0ms effective offset 0
2025-11-03T16:51:39.530522Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:1105: [72075186224037892][Partition][0][StateIdle] read cookie 4 added 1 blobs, size 1985 count 1 last offset 0, current partition end offset: 5
2025-11-03T16:51:39.530539Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:1121: [72075186224037892][Partition][0][StateIdle] Reading cookie 4. Send blob request.
2025-11-03T16:51:39.530579Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 0 partno 0 count 1 parts_count 0 source 1 size 1985 accessed 1 times before, last time 2025-11-03T16:51:39.000000Z
2025-11-03T16:51:39.530612Z node 4 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 4. All 1 blobs are from cache.
2025-11-03T16:51:39.530670Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:572: FormAnswer for 1 blobs
2025-11-03T16:51:39.530805Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 0 totakecount 1 count 1 size 1965 from pos 0 cbcount 1
2025-11-03T16:51:39.530920Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-03T16:51:39.531502Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 0 suffix '63'
2025-11-03T16:51:39.532097Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_3_1_10844929437138650019_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 5 Result { Offset: 0 Data: "... 1908 bytes ..." SourceId: "\000test-message-group-id" SeqNo: 1 WriteTimestampMS: 1762188699454 CreateTimestampMS: 1 UncompressedSize: 2048 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 2005 RealReadOffset: 0 WaitQuotaTimeMs: 0 EndOffset: 5 StartOffset: 0 } Cookie: 0 }
2025-11-03T16:51:39.532224Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_3_1_10844929437138650019_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 1 endOffset 5
2025-11-03T16:51:39.532257Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_3_1_10844929437138650019_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 5 ReadOffset 1 ReadGuid b11ae679-b0907f79-268ec7ba-98f1338 has messages 1
2025-11-03T16:51:39.532308Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_3_1_10844929437138650019_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 1, endOffset# 5, WTime# 1762188699454, sizeLag# 2005
2025-11-03T16:51:39.532324Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_3_1_10844929437138650019_v1TEvPartitionReady. Aval parts: 0
2025-11-03T16:51:39.532358Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_3_1_10844929437138650019_v1 read done: guid# b11ae679-b0907f79-268ec7ba-98f1338, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 2029
2025-11-03T16:51:39.532384Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_3_1_10844929437138650019_v1 response to read: guid# b11ae679-b0907f79-268ec7ba-98f1338
2025-11-03T16:51:39.532592Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_3_1_10844929437138650019_v1 Process answer. Aval parts: 1
2025-11-03T16:51:39.536467Z :DEBUG: [/Root] [/Root] [c3833220-c2302504-95bb402a-23a18f0f] [dc1] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:51:39.536802Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 0 (0-0)
2025-11-03T16:51:39.536933Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (0-0)
2025-11-03T16:51:39.536995Z :DEBUG: [/Root] [/Root] [c3833220-c2302504-95bb402a-23a18f0f] [dc1] The application data is transferred to the client. Number of messages 1, size 2048 bytes
2025-11-03T16:51:39.537147Z :DEBUG: [/Root] [/Root] [c3833220-c2302504-95bb402a-23a18f0f] [dc1] Commit offsets [0, 1). Partition stream id: 1
2025-11-03T16:51:39.537322Z :TSimpleWriteSession_AutoSeqNo_BasicUsage INFO: Read message count is 1 (from 5 in total), committed offset count is 0 (maximum offset: 0)
Get event on client
2025-11-03T16:51:39.540943Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_3_1_10844929437138650019_v1 grpc read done: success# 1, data# { read { } }
2025-11-03T16:51:39.541063Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_3_1_10844929437138650019_v1 got read request: guid# a8fc9f9d-cc69de55-49e309a1-f4830a89
2025-11-03T16:51:39.541153Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_3_1_10844929437138650019_v1 performing read request: guid# a8fc9f9d-cc69de55-49e309a1-f4830a89, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 4, size# 2406, partitionsAsked# 1, maxTimeLag# 0ms
2025-11-03T16:51:39.541213Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_3_1_10844929437138650019_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 4 maxSize 2406 maxTimeLagMs 0 readTimestampMs 0 readOffset 1 EndOffset 5 ClientCommitOffset 0 committedOffset 0 Guid a8fc9f9d-cc69de55-49e309a1-f4830a89
2025-11-03T16:51:39.542372Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:39.542406Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:39.542465Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:39.542475Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:39.542532Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:39.542551Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:39.542567Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-03T16:51:39.542642Z node 4 :PERSQUEUE DEBUG: partition.cpp:3666: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user offset is set to 1 (startOffset 0) session shared/user_3_1_10844929437138650019_v1
2025-11-03T16:51:39.542681Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:39.542806Z node 4 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-03T16:51:39.542847Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:880: [72075186224037892][Partition][0][StateIdle] read cookie 5 Topic 'rt3.dc1--test-topic' partition 0 user user offset 1 partno 0 count 4 size 2406 endOffset 5 max time lag 0ms effective offset 1
2025-11-03T16:51:39.543075Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:1105: [72075186224037892][Partition][0][StateIdle] read cookie 5 added 1 blobs, size 16713 count 4 last offset 1, current partition end offset: 5
2025-11-03T16:51:39.543091Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:1121: [72075186224037892][Partition][0][StateIdle] Reading cookie 5. Send blob request.
2025-11-03T16:51:39.543228Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 1 partno 0 count 4 parts_count 0 source 1 size 16713 accessed 0 times before, last time 2025-11-03T16:51:39.000000Z
2025-11-03T16:51:39.543269Z node 4 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 5. All 1 blobs are from cache.
2025-11-03T16:51:39.543331Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:572: FormAnswer for 1 blobs
2025-11-03T16:51:39.543826Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 1 totakecount 4 count 4 size 16691 from pos 0 cbcount 4
2025-11-03T16:51:39.544264Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-11-03T16:51:39.541650Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_3_1_10844929437138650019_v1 grpc read done: success# 1, data# { commit { cookies { assign_id: 1 partition_cookie: 1 } } }
2025-11-03T16:51:39.541827Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1449: session cookie 1 consumer shared/user session shared/user_3_1_10844929437138650019_v1 commit request from client for 1 in TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-11-03T16:51:39.541857Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:129: session cookie 1 consumer shared/user session shared/user_3_1_10844929437138650019_v1 commit request from 1 to 1 in TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-11-03T16:51:39.541918Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:203: session cookie 1 consumer shared/user session shared/user_3_1_10844929437138650019_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) committing to position 1 prev 0 end 5 by cookie 1
2025-11-03T16:51:39.546078Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_3_1_10844929437138650019_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 5 Result { Offset: 1 Data: "... 2801 bytes ..." SourceId: "\000test-message-group-id" SeqNo: 2 WriteTimestampMS: 1762188699475 CreateTimestampMS: 2 UncompressedSize: 3072 PartitionKey: "" ExplicitHash: "" } Result { Offset: 2 Data: "... 3693 bytes ..." SourceId: "\000test-message-group-id" SeqNo: 3 WriteTimestampMS: 1762188699476 CreateTimestampMS: 3 UncompressedSize: 4096 PartitionKey: "" ExplicitHash: "" } Result { Offset: 3 Data: "... 4590 bytes ..." SourceId: "\000test-message-group-id" SeqNo: 4 WriteTimestampMS: 1762188699476 CreateTimestampMS: 4 UncompressedSize: 5120 PartitionKey: "" ExplicitHash: "" } Result { Offset: 4 Data: "... 5485 bytes ..." SourceId: "\000test-message-group-id" SeqNo: 5 WriteTimestampMS: 1762188699476 CreateTimestampMS: 5 UncompressedSize: 6144 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 18446744073709551532 RealReadOffset: 4 WaitQuotaTimeMs: 0 EndOffset: 5 StartOffset: 0 } Cookie: 1 }
2025-11-03T16:51:39.546289Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_3_1_10844929437138650019_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 1 from offset 5
2025-11-03T16:51:39.546324Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_3_1_10844929437138650019_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 5 ReadOffset 5 ReadGuid a8fc9f9d-cc69de55-49e309a1-f4830a89 has messages 1
2025-11-03T16:51:39.546434Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_3_1_10844929437138650019_v1 read done: guid# a8fc9f9d-cc69de55-49e309a1-f4830a89, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 16661
2025-11-03T16:51:39.546456Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_3_1_10844929437138650019_v1 response to read: guid# a8fc9f9d-cc69de55-49e309a1-f4830a89
2025-11-03T16:51:39.547633Z :DEBUG: [/Root] [/Root] [c3833220-c2302504-95bb402a-23a18f0f] [dc1] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:51:39.545064Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 1 partno 0 count 4 parts 0 suffix '63'
2025-11-03T16:51:39.546727Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_3_1_10844929437138650019_v1 Process answer. Aval parts: 0
2025-11-03T16:51:39.548174Z node 4 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:51:39.548431Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_3_1_10844929437138650019_v1 grpc read done: success# 1, data# { read { } }
2025-11-03T16:51:39.548554Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_3_1_10844929437138650019_v1 got read request: guid# e06ec3bc-f0d569fd-c68fe1b1-d51d4d79
2025-11-03T16:51:39.552521Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 0 (1-4)
2025-11-03T16:51:39.552732Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (1-1)
2025-11-03T16:51:39.552798Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 0} (2-2)
2025-11-03T16:51:39.552844Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 1} (3-3)
2025-11-03T16:51:39.552873Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 2} (4-4)
2025-11-03T16:51:39.552912Z :DEBUG: [/Root] [/Root] [c3833220-c2302504-95bb402a-23a18f0f] [dc1] The application data is transferred to the client. Number of messages 4, size 18432 bytes
2025-11-03T16:51:39.553024Z :DEBUG: [/Root] [/Root] [c3833220-c2302504-95bb402a-23a18f0f] [dc1] Commit offsets [1, 2). Partition stream id: 1
2025-11-03T16:51:39.553060Z :DEBUG: [/Root] [/Root] [c3833220-c2302504-95bb402a-23a18f0f] [dc1] Commit offsets [2, 3). Partition stream id: 1
2025-11-03T16:51:39.553087Z :DEBUG: [/Root] [/Root] [c3833220-c2302504-95bb402a-23a18f0f] [dc1] Commit offsets [3, 4). Partition stream id: 1
2025-11-03T16:51:39.553113Z :DEBUG: [/Root] [/Root] [c3833220-c2302504-95bb402a-23a18f0f] [dc1] Commit offsets [4, 5). Partition stream id: 1
2025-11-03T16:51:39.553349Z :TSimpleWriteSession_AutoSeqNo_BasicUsage INFO: Read message count is 5 (from 5 in total), committed offset count is 0 (maximum offset: 4)
Get event on client
2025-11-03T16:51:39.554583Z node 4 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-03T16:51:39.554676Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-11-03T16:51:39.554704Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:39.554717Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:39.554730Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:39.554786Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:51:39.554839Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-11-03T16:51:39.556003Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_3_1_10844929437138650019_v1 grpc read done: success# 1, data# { commit { cookies { assign_id: 1 partition_cookie: 2 } } }
2025-11-03T16:51:39.556236Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_3_1_10844929437138650019_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { Cookie: 1 }
2025-11-03T16:51:39.556305Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:961: session cookie 1 consumer shared/user session shared/user_3_1_10844929437138650019_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) commit done to position 1 endOffset 5 with cookie 1
2025-11-03T16:51:39.556334Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1449: session cookie 1 consumer shared/user session shared/user_3_1_10844929437138650019_v1 commit request from client for 2 in TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-11-03T16:51:39.556362Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:129: session cookie 1 consumer shared/user session shared/user_3_1_10844929437138650019_v1 commit request from 2 to 2 in TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-11-03T16:51:39.556421Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:203: session cookie 1 consumer shared/user session shared/user_3_1_10844929437138650019_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) committing to position 5 prev 1 end 5 by cookie 2
2025-11-03T16:51:39.556525Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:707: session cookie 1 consumer shared/user session shared/user_3_1_10844929437138650019_v1 replying for commits: assignId# 1, from# 1, to# 1, offset# 1
2025-11-03T16:51:39.560645Z :DEBUG: [/Root] [/Root] [c3833220-c2302504-95bb402a-23a18f0f] [dc1] Committed response: cookies { assign_id: 1 partition_cookie: 1 }
2025-11-03T16:51:39.561252Z :TSimpleWriteSession_AutoSeqNo_BasicUsage INFO: Got commit ack with offset 1
2025-11-03T16:51:39.561303Z :TSimpleWriteSession_AutoSeqNo_BasicUsage INFO: Read message count is 5 (from 5 in total), committed offset count is 1 (maximum offset: 4)
Get event on client
2025-11-03T16:51:39.561500Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:39.561543Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:39.561608Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:39.561644Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:39.561656Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-03T16:51:39.561709Z node 4 :PERSQUEUE DEBUG: partition.cpp:3666: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user offset is set to 5 (startOffset 0) session shared/user_3_1_10844929437138650019_v1
2025-11-03T16:51:39.561724Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:39.561848Z node 4 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-03T16:51:39.569149Z node 4 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-03T16:51:39.569214Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:923: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 5 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-11-03T16:51:39.569257Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-11-03T16:51:39.569283Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:39.569294Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:39.569305Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:39.569337Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:51:39.569362Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 2
2025-11-03T16:51:39.572157Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_3_1_10844929437138650019_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { Cookie: 2 }
2025-11-03T16:51:39.572217Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:961: session cookie 1 consumer shared/user session shared/user_3_1_10844929437138650019_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) commit done to position 5 endOffset 5 with cookie 2
2025-11-03T16:51:39.572268Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:707: session cookie 1 consumer shared/user session shared/user_3_1_10844929437138650019_v1 replying for commits: assignId# 1, from# 2, to# 2, offset# 5
2025-11-03T16:51:39.572980Z :DEBUG: [/Root] [/Root] [c3833220-c2302504-95bb402a-23a18f0f] [dc1] Committed response: cookies { assign_id: 1 partition_cookie: 2 }
2025-11-03T16:51:39.574392Z :TSimpleWriteSession_AutoSeqNo_BasicUsage INFO: Got commit ack with offset 5
2025-11-03T16:51:39.574440Z :TSimpleWriteSession_AutoSeqNo_BasicUsage INFO: Read message count is 5 (from 5 in total), committed offset count is 5 (maximum offset: 4)
2025-11-03T16:51:39.574490Z :TSimpleWriteSession_AutoSeqNo_BasicUsage INFO: Time took to write and read 5 messages, 0 [MiB] in total is 0 [s]
2025-11-03T16:51:39.574548Z :INFO: [/Root] [/Root] [c3833220-c2302504-95bb402a-23a18f0f] Closing read session. Close timeout: 0.000000s
2025-11-03T16:51:39.574599Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): dc1:test-topic:0:1:4:5
2025-11-03T16:51:39.574645Z :INFO: [/Root] [/Root] [c3833220-c2302504-95bb402a-23a18f0f] Counters: { Errors: 0 CurrentSessionLifetimeMs: 129 BytesRead: 20480 MessagesRead: 5 BytesReadCompressed: 18142 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-11-03T16:51:39.574758Z :NOTICE: [/Root] [/Root] [c3833220-c2302504-95bb402a-23a18f0f] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Close with zero timeout " }
2025-11-03T16:51:39.574807Z :DEBUG: [/Root] [/Root] [c3833220-c2302504-95bb402a-23a18f0f] [dc1] Abort session to cluster
2025-11-03T16:51:39.575345Z :NOTICE: [/Root] [/Root] [c3833220-c2302504-95bb402a-23a18f0f] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
2025-11-03T16:51:39.575529Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|567b2f42-d5ce001b-ddeeaa2e-db99cae8_0] Write session: close. Timeout = 18446744073709551 ms
2025-11-03T16:51:39.575565Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|567b2f42-d5ce001b-ddeeaa2e-db99cae8_0] Write session will now close
2025-11-03T16:51:39.575601Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|567b2f42-d5ce001b-ddeeaa2e-db99cae8_0] Write session: aborting
2025-11-03T16:51:39.576007Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|567b2f42-d5ce001b-ddeeaa2e-db99cae8_0] Write session: gracefully shut down, all writes complete
2025-11-03T16:51:39.576050Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|567b2f42-d5ce001b-ddeeaa2e-db99cae8_0] Write session: destroy
2025-11-03T16:51:39.580842Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_3_1_10844929437138650019_v1 grpc read done: success# 0, data# {  }
2025-11-03T16:51:39.580874Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:125: session cookie 1 consumer shared/user session shared/user_3_1_10844929437138650019_v1 grpc read failed
2025-11-03T16:51:39.580898Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:92: session cookie 1 consumer shared/user session shared/user_3_1_10844929437138650019_v1 grpc closed
2025-11-03T16:51:39.580927Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 1 consumer shared/user session shared/user_3_1_10844929437138650019_v1 is DEAD
2025-11-03T16:51:39.581688Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: test-message-group-id|567b2f42-d5ce001b-ddeeaa2e-db99cae8_0 grpc read done: success: 0 data: 
2025-11-03T16:51:39.581700Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 2 sessionId: test-message-group-id|567b2f42-d5ce001b-ddeeaa2e-db99cae8_0 grpc read failed
2025-11-03T16:51:39.581726Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 2 sessionId: test-message-group-id|567b2f42-d5ce001b-ddeeaa2e-db99cae8_0 grpc closed
2025-11-03T16:51:39.581743Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2 sessionId: test-message-group-id|567b2f42-d5ce001b-ddeeaa2e-db99cae8_0 is DEAD
2025-11-03T16:51:39.582304Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-11-03T16:51:39.582551Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1659: [72075186224037893][rt3.dc1--test-topic] pipe [3:7568542835766014551:2467] disconnected.
2025-11-03T16:51:39.582570Z node 3 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1670: [72075186224037893][rt3.dc1--test-topic] pipe [3:7568542835766014551:2467] disconnected; active server actors: 1
2025-11-03T16:51:39.582585Z node 3 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1679: [72075186224037893][rt3.dc1--test-topic] pipe [3:7568542835766014551:2467] client user disconnected session shared/user_3_1_10844929437138650019_v1
2025-11-03T16:51:39.591665Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [3:7568542835766014544:2462] destroyed
2025-11-03T16:51:39.591708Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2258: [PQ: 72075186224037892] Destroy direct read session shared/user_3_1_10844929437138650019_v1
2025-11-03T16:51:39.591728Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [3:7568542835766014554:2470] destroyed
2025-11-03T16:51:39.591761Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-11-03T16:51:39.591790Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:39.591803Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:39.591815Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:39.591881Z node 4 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_3_1_10844929437138650019_v1
2025-11-03T16:51:39.652139Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:39.652171Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:39.652184Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:39.752145Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:39.752176Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:39.752192Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:39.982474Z node 3 :KQP_EXECUTER ERROR: kqp_executer_impl.h:1006: ActorId: [3:7568542835766014589:2471] TxId: 281474976710676. Ctx: { TraceId: 01k95a39w5c1jvxczytv431mmf, Database: /Root, SessionId: ydb://session/3?node_id=3&id=M2ZmMjYyMjQtNGE4Yzg5NDktYjMzYWExN2MtNzQwZTc3OQ==, PoolId: default}. UNAVAILABLE: Failed to send EvStartKqpTasksRequest because node is unavailable: 4
2025-11-03T16:51:39.982672Z node 3 :KQP_COMPUTE ERROR: dq_compute_actor_impl.h:1210: SelfId: [3:7568542835766014597:2471], TxId: 281474976710676, task: 3. Ctx: { CheckpointId : .  TraceId : 01k95a39w5c1jvxczytv431mmf.  RunScriptActorId : [0:0:0].  CustomerSuppliedId : .  PoolId : default.  SessionId : ydb://session/3?node_id=3&id=M2ZmMjYyMjQtNGE4Yzg5NDktYjMzYWExN2MtNzQwZTc3OQ==.  CurrentExecutionId : .  Database : /Root.  DatabaseId : /Root. }. Handle abort execution event from: [3:7568542835766014589:2471], status: UNAVAILABLE, reason: { <main>: Error: Terminate execution }
2025-11-03T16:51:41.652080Z :BrokenCredentialsProvider INFO: Random seed for debugging is 1762188701652056
2025-11-03T16:51:42.755889Z node 5 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[5:7568542848109481764:2079];send_to=[0:7307199536658146131:7762515];
2025-11-03T16:51:42.755945Z node 5 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
test_client.cpp: SetPath # /home/runner/.ya/build/build_root/7jz3/0019ac/r3tmp/tmp6Rmhw6/pdisk_1.dat
2025-11-03T16:51:42.915054Z node 6 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-11-03T16:51:42.930278Z node 5 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-11-03T16:51:42.940511Z node 5 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-11-03T16:51:42.940719Z node 6 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-11-03T16:51:42.940862Z node 6 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=incorrect path status: LookupError;
2025-11-03T16:51:43.195272Z node 5 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
2025-11-03T16:51:43.226810Z node 6 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-11-03T16:51:43.228314Z node 5 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-11-03T16:51:43.241869Z node 5 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(5, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-11-03T16:51:43.241965Z node 5 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(5, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-11-03T16:51:43.246221Z node 5 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(6, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-11-03T16:51:43.246313Z node 5 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(6, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-11-03T16:51:43.253740Z node 5 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(5, (0,0,0,0)) VolatileState: Connecting -> Connected
2025-11-03T16:51:43.261696Z node 5 :HIVE WARN: hive_impl.cpp:811: HIVE#72057594037968897 Handle TEvInterconnect::TEvNodeConnected, NodeId 6 Cookie 6
2025-11-03T16:51:43.262741Z node 5 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(6, (0,0,0,0)) VolatileState: Connecting -> Connected
TServer::EnableGrpc on GrpcPort 21480, node 5
2025-11-03T16:51:43.520847Z node 5 :NET_CLASSIFIER WARN: net_classifier.cpp:190: distributable config is empty, broken or outdated, will use file: /home/runner/.ya/build/build_root/7jz3/0019ac/r3tmp/yandexRFJoYd.tmp
2025-11-03T16:51:43.520877Z node 5 :NET_CLASSIFIER WARN: net_classifier.cpp:196: will try to initialize from file: /home/runner/.ya/build/build_root/7jz3/0019ac/r3tmp/yandexRFJoYd.tmp
2025-11-03T16:51:43.521064Z node 5 :NET_CLASSIFIER WARN: net_classifier.cpp:202: successfully initialized from file: /home/runner/.ya/build/build_root/7jz3/0019ac/r3tmp/yandexRFJoYd.tmp
2025-11-03T16:51:43.521255Z node 5 :NET_CLASSIFIER ERROR: net_classifier.cpp:228: got bad distributable configuration
2025-11-03T16:51:43.575044Z INFO: TTestServer started on Port 16880 GrpcPort 21480
2025-11-03T16:51:43.704257Z node 6 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-11-03T16:51:43.780093Z node 5 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-11-03T16:51:43.835965Z node 5 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-11-03T16:51:43.884196Z node 6 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
TClient is connected to server localhost:16880
PQClient connected to localhost:21480
WaitRootIsUp 'Root'...
TClient::Ls request: Root
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "Root"
    PathId: 1
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 1
    CreateStep: 0
    ParentPathId: 1
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 1
      SubDomainVersion: 0
      SecurityStateVersion: 0
    }
    ChildrenExist: false
  }
  Children {
    Name: ".sys"
    PathId: 18446744073709551615
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 0
    CreateStep: 0
    ParentPathId: 18446744073709551615
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 0
      Pl...
(TRUNCATED)
WaitRootIsUp 'Root' success.
2025-11-03T16:51:43.937557Z node 5 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpAlterSubDomain, opId: 281474976710657:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_alter_subdomain.cpp:311)
waiting...
waiting...
waiting...
waiting...
2025-11-03T16:51:47.756408Z node 5 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[5:7568542848109481764:2079];send_to=[0:7307199536658146131:7762515];
2025-11-03T16:51:47.756500Z node 5 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
2025-11-03T16:51:48.073329Z node 5 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [5:7568542873879286502:2329], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-03T16:51:48.073540Z node 5 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-03T16:51:48.077642Z node 5 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [5:7568542873879286536:2333], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-03T16:51:48.077751Z node 5 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [5:7568542873879286537:2334], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-03T16:51:48.077908Z node 5 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-03T16:51:48.083400Z node 5 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateResourcePool, opId: 281474976710661:3, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_resource_pool.cpp:179)
2025-11-03T16:51:48.090396Z node 5 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [5:7568542873879286569:2337], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-03T16:51:48.090504Z node 5 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-03T16:51:48.090915Z node 5 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [5:7568542873879286574:2338], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-03T16:51:48.090977Z node 5 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-03T16:51:48.128003Z node 5 :KQP_WORKLOAD_SERVICE WARN: helpers.h:73: [WorkloadService] [TPoolCreatorActor] ActorId: [5:7568542873879286540:2335], DatabaseId: /Root, PoolId: default, Scheduled retry for error: { <main>: Error: Transaction 281474976710661 completed, doublechecking }
2025-11-03T16:51:48.134251Z node 5 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710662:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:690)
2025-11-03T16:51:48.222539Z node 5 :TX_PROXY ERROR: schemereq.cpp:593: Actor# [5:7568542873879286687:2731] txid# 281474976710663, issues: { message: "Check failed: path: \'/Root/.metadata/workload_manager/pools/default\', error: path exist, request accepts it (id: [OwnerId: 72057594046644480, LocalPathId: 8], type: EPathTypeResourcePool, state: EPathStateNoChanges)" severity: 1 }
2025-11-03T16:51:48.281573Z node 5 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:570: Compilation failed, self: [5:7568542873879286712:2347], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:5:17: Error: At function: KiReadTable!
        <main>:5:17: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Versions]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-11-03T16:51:48.282557Z node 5 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710664:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:690)
2025-11-03T16:51:48.285237Z node 5 :KQP_SESSION WARN: kqp_session_actor.cpp:2506: SessionId: ydb://session/3?node_id=5&id=OTdiYWNiN2UtYjUyNGQzYWEtYTI5NDdlZWItM2M2YmNmYmE=, ActorId: [5:7568542873879286498:2328], ActorState: ExecuteState, TraceId: 01k95a3j759frsx849c5d5257f, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-11-03T16:51:48.285748Z node 5 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 5 column: 17 } message: "At function: KiReadTable!" end_position { row: 5 column: 17 } severity: 1 issues { position { row: 5 column: 17 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Versions]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 5 column: 17 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-11-03T16:51:48.449214Z node 6 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:570: Compilation failed, self: [6:7568542872459083438:2310], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:5:17: Error: At function: KiReadTable!
        <main>:5:17: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Versions]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-11-03T16:51:48.452351Z node 6 :KQP_SESSION WARN: kqp_session_actor.cpp:2506: SessionId: ydb://session/3?node_id=6&id=MzEwNGFjOTgtNzBiMDg0NzItZTgwODFkNTAtZWE0MTRjNWE=, ActorId: [6:7568542872459083406:2303], ActorState: ExecuteState, TraceId: 01k95a3jgq9kgsp3jze3hjge3h, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-11-03T16:51:48.452813Z node 6 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 5 column: 17 } message: "At function: KiReadTable!" end_position { row: 5 column: 17 } severity: 1 issues { position { row: 5 column: 17 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Versions]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 5 column: 17 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-11-03T16:51:48.548983Z node 5 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710665:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:690)
=== Init DC: UPSERT INTO `/Root/PQ/Config/V2/Cluster` (name, balancer, local, enabled, weight) VALUES ("dc1", "localhost:21480", true, true, 1000);
2025-11-03T16:51:48.942104Z node 5 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976710666. Ctx: { TraceId: 01k95a3jx15bf0wyx0150ggzj8, Database: , SessionId: ydb://session/3?node_id=5&id=NDViYzNjZDktM2ZhZjFjZjItYmY4NDI3NjEtNDc2MjQ1OGU=, PoolId: default, DatabaseId: /Root}. Database not set, use /Root
=== CheckClustersList. Subcribe to ClusterTracker from [5:7568542878174254341:2989] 
=== CheckClustersList. Ok
2025-11-03T16:51:57.834808Z node 5 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710671:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:690)
waiting...
PQ Client: create topic: rt3.dc1--test-topic with 1 partitions
CallPersQueueGRPC request to localhost:21480
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-11-03T16:51:58.027005Z node 5 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
CallPersQueueGRPC request to localhost:21480
MetaRequest {
  CmdCreateTopic {
    Topic: "rt3.dc1--test-topic"
    NumPartitions: 1
    Config {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
  }
}
CallPersQueueGRPC response:
Status: 129
ProxyErrorCode: 53
SchemeStatus: 1
FlatTxId {
  TxId: 281474976710672
  SchemeShardTabletId: 72057594046644480
  PathId: 13
}
ErrorCode: OK
AddTopic: rt3.dc1--test-topic
===Run query:``DECLARE $version as Int64; DECLARE $path AS Utf8; DECLARE $cluster as Utf8; UPSERT INTO `/Root/PQ/Config/V2/Topics` (path, dc) VALUES ($path, $cluster); UPSERT INTO `/Root/PQ/Config/V2/Versions` (name, version) VALUES ("Topics", $version);`` with topic = test-topic, dc = dc1
2025-11-03T16:51:58.156278Z node 5 :FLAT_TX_SCHEMESHARD WARN: schemeshard_impl.cpp:7727: Cannot get console configs
2025-11-03T16:51:58.156308Z node 5 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
2025-11-03T16:51:58.162425Z node 5 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1655: [72075186224037893][] pipe [5:7568542916828960470:3276] connected; active server actors: 1
2025-11-03T16:51:58.162661Z node 5 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1519: [72075186224037893][rt3.dc1--test-topic] updating configuration. Deleted partitions []. Added partitions [0]
2025-11-03T16:51:58.165317Z node 5 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:971: [72075186224037893][rt3.dc1--test-topic] Discovered subdomain [OwnerId: 72057594046644480, LocalPathId: 1] state, outOfSpace = 0 at RB 72075186224037893
2025-11-03T16:51:58.167094Z node 5 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:140: [72075186224037893][rt3.dc1--test-topic] BALANCER INIT DONE for rt3.dc1--test-topic: (0, 72075186224037892) 
2025-11-03T16:51:58.183158Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2960: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-11-03T16:51:58.191278Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2992: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-11-03T16:51:58.192892Z node 5 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:404: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 6, Generation 1
2025-11-03T16:51:58.191633Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:787: [PQ: 72075186224037892] no config, start with empty partitions and default config
2025-11-03T16:51:58.191675Z node 6 :PERSQUEUE NOTICE: pq_impl.cpp:913: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-11-03T16:51:58.191720Z node 6 :PERSQUEUE INFO: pq_impl.cpp:612: [PQ: 72075186224037892] doesn't have tx writes info
2025-11-03T16:51:58.193048Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [5:7568542916828960489:2459], now have 1 active actors on pipe
2025-11-03T16:51:58.193076Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [5:7568542916828960469:3275], now have 1 active actors on pipe
2025-11-03T16:51:58.193648Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-03T16:51:58.205613Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-03T16:51:58.212205Z node 5 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976710673. Ctx: { TraceId: 01k95a3w0a1cgqdb67xka66dnf, Database: , SessionId: ydb://session/3?node_id=5&id=YWY4N2YwMmQtOTc1YTI5ZGQtYTkzM2NjMi05NTRiMDdkNQ==, PoolId: default, DatabaseId: /Root}. Database not set, use /Root
2025-11-03T16:51:58.216086Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [5:7568542916828960522:3314], now have 1 active actors on pipe
2025-11-03T16:51:58.218328Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-03T16:51:58.228002Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-03T16:51:58.228920Z node 6 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-11-03T16:51:58.228976Z node 6 :PERSQUEUE DEBUG: partition.cpp:1312: [72075186224037892][Partition][0][StateInit] HandleOnInit TEvPQ::TEvProposePartitionConfig
2025-11-03T16:51:58.229275Z node 6 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-11-03T16:51:58.229488Z node 6 :PERSQUEUE INFO: partition_init.cpp:1101: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [6:7568542915408756792:2379]
2025-11-03T16:51:58.233135Z node 6 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-11-03T16:51:58.233259Z node 6 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-11-03T16:51:58.233290Z node 6 :PERSQUEUE INFO: partition.cpp:707: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1 [6:7568542915408756792:2379]
2025-11-03T16:51:58.233320Z node 6 :PERSQUEUE DEBUG: partition.cpp:727: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 0 Head Offset 0 PartNo 0 PackedSize 0 count 0 nextOffset 0 batches 0
2025-11-03T16:51:58.233356Z node 6 :PERSQUEUE DEBUG: partition_mlp.cpp:83: [72075186224037892][Partition][0][StateIdle] Initializing MLP Consumers: 0
2025-11-03T16:51:58.234829Z node 6 :PERSQUEUE DEBUG: partition.cpp:4273: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 1
2025-11-03T16:51:58.234862Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:58.234945Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:58.234957Z node 6 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-03T16:51:58.234981Z node 6 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-11-03T16:51:58.234994Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:58.235007Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:58.235019Z node 6 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-11-03T16:51:58.235051Z node 6 :PERSQUEUE DEBUG: partition_read.cpp:923: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-11-03T16:51:58.235089Z node 6 :PERSQUEUE DEBUG: partition_mlp.cpp:60: [72075186224037892][Partition][0][StateIdle] Process MLP pending events. Count 0
2025-11-03T16:51:58.235375Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-03T16:51:58.235512Z node 6 :PERSQUEUE DEBUG: partition_compaction.cpp:183: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:51:58.250192Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-03T16:51:58.250344Z node 6 :PERSQUEUE DEBUG: partition.cpp:1416: [72075186224037892][Partition][0][StateIdle] Handle TEvPQ::TEvTxCommit Step 1762188718255, TxId 281474976710672
2025-11-03T16:51:58.250370Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:58.250385Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:58.250521Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:58.250754Z node 6 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-03T16:51:58.258408Z node 6 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-03T16:51:58.258612Z node 6 :PERSQUEUE DEBUG: partition_mlp.cpp:83: [72075186224037892][Partition][0][StateIdle] Initializing MLP Consumers: 0
2025-11-03T16:51:58.258741Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-11-03T16:51:58.258768Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:58.258782Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:58.258796Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:58.258831Z node 6 :PERSQUEUE DEBUG: partition_compaction.cpp:183: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:51:58.259202Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:398: [PQ: 72075186224037892] Apply new config PartitionConfig { LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 } PartitionIds: 0 TopicName: "rt3.dc1--test-topic" Version: 0 LocalDC: true Codecs { Ids: 0 Ids: 1 Ids: 2 Codecs: "raw" Codecs: "gzip" Codecs: "lzop" } TopicPath: "/Root/PQ/rt3.dc1--test-topic" YcCloudId: "" YcFolderId: "" YdbDatabaseId: "" YdbDatabasePath: "/Root" Partitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } AllPartitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } Consumers { Name: "user" ReadFromTimestampsMs: 0 FormatVersion: 0 Version: 0 Generation: 0 } MonitoringProjectId: ""
2025-11-03T16:51:58.259306Z node 6 :PERSQUEUE NOTICE: pq_impl.cpp:913: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-11-03T16:51:58.259617Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
===Query complete
TClient::Ls request: /Root/PQ/rt3.dc1--test-topic
TClient::Ls response: Status: 128
StatusCode: PATH_NOT_EXIST
Issues {
  message: "Path not exist"
  issue_code: 200200
  severity: 1
}
SchemeStatus: 2
ErrorReason: "Path not found"
GetTopicVersionFromPath:  record Status: 128
StatusCode: PATH_NOT_EXIST
Issues {
  message: "Path not exist"
  issue_code: 200200
  severity: 1
}
SchemeStatus: 2
ErrorReason: "Path not found"
 name rt3.dc1--test-topic version0
2025-11-03T16:51:58.269621Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-03T16:51:58.269729Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-03T16:51:58.273047Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-03T16:51:58.335604Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:58.335650Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:58.335668Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:58.436561Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:58.436595Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:58.436607Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:58.540390Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:58.540427Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:58.540445Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:58.641853Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:58.641885Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:58.641902Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:58.743097Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:58.743130Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:58.743158Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
TClient::Ls request: /Root/PQ/rt3.dc1--test-topic
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976710672
    CreateStep: 1762188718255
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts...
(TRUNCATED)
GetTopicVersionFromPath:  record Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976710672
    CreateStep: 1762188718255
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      YdbDatabasePath: "/Root"
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
    Partitions {
      PartitionId: 0
      TabletId: 72075186224037892
      Status: Active
    }
    AlterVersion: 1
    BalancerTabletID: 72075186224037893
    NextPartitionId: 1
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 1
      PlanResolution: 7
      Coordinators: 72057594046316545
      TimeCastBucketsPerMediator: 2
      Mediators: 72057594046382081
    }
    DomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    PathsInside: 12
    PathsLimit: 10000
    ShardsInside: 6
    ShardsLimit: 200000
    ResourcesDomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    DiskSpaceUsage {
      Tables {
        TotalSize: 1328
        DataSize: 1328
        IndexSize: 0
      }
      Topics {
        ReserveSize: 0
        AccountSize: 0
        DataSize: 0
        UsedReserveSize: 0
      }
    }
    PQPartitionsInside: 1
    PQPartitionsLimit: 1000000
    SchemeLimits {
      MaxDepth: 32
      MaxPaths: 10000
      MaxChildrenInDir: 100000
      MaxAclBytesSize: 10240
      MaxTableColumns: 200
      MaxTableColumnNameLength: 255
      MaxTableKeyColumns: 30
      MaxTableIndices: 20
      MaxShards: 200000
      MaxShardsInPath: 35000
      MaxConsistentCopyTargets: 10000
      MaxPathElementLength: 255
      ExtraPathSymbolsAllowed: "!\"#$%&\'()*+,-.:;<=>?@[\\]^_`{|}~"
      MaxPQPartitions: 1000000
      MaxTableCdcStreams: 5
      MaxExports: 10
      MaxImports: 10
      MaxColumnTableColumns: 10000
    }
  }
}
Path: "/Root/PQ/rt3.dc1--test-topic"
 name rt3.dc1--test-topic version1
CallPersQueueGRPC request to localhost:21480
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-11-03T16:51:58.771101Z node 5 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
MetaResponse {
  CmdGetTopicMetadataResult {
    TopicInfo {
      Topic: "rt3.dc1--test-topic"
      NumPartitions: 1
      Config {
        PartitionConfig {
          LifetimeSeconds: 86400
          LowWatermark: 8388608
          SourceIdLifetimeSeconds: 86400
          WriteSpeedInBytesPerSecond: 20000000
          BurstSize: 20000000
          SourceIdMaxCounts: 6000000
        }
        Version: 1
        LocalDC: true
        Codecs {
          Ids: 0
          Ids: 1
          Ids: 2
          Codecs: "raw"
          Codecs: "gzip"
          Codecs: "lzop"
        }
        TopicPath: "/Root/PQ/rt3.dc1--test-topic"
        YdbDatabasePath: "/Root"
        Consumers {
          Name: "user"
          ReadFromTimestampsMs: 0
          FormatVersion: 0
          Version: 0
        }
      }
      ErrorCode: OK
    }
  }
}
=== Topic created, have version: 1
2025-11-03T16:51:58.789439Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: try to update token
2025-11-03T16:51:58.789853Z :INFO: [] MessageGroupId [src] SessionId [] Write session: Do CDS request
2025-11-03T16:51:58.789897Z :INFO: [] MessageGroupId [src] SessionId [] Start write session. Will connect to endpoint: localhost:21480
2025-11-03T16:51:58.833209Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src" }
2025-11-03T16:51:58.835911Z node 5 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-11-03T16:51:58.835952Z node 5 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1
2025-11-03T16:51:58.838619Z node 5 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src" }
2025-11-03T16:51:58.838775Z node 5 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1 topic: "test-topic" message_group_id: "src" from ipv6:[::1]:44422
2025-11-03T16:51:58.838793Z node 5 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:44422 proto=v1  topic=test-topic durationSec=0
2025-11-03T16:51:58.838804Z node 5 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-11-03T16:51:58.841154Z node 5 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1 sessionId:  describe result for acl check
2025-11-03T16:51:58.841319Z node 5 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-11-03T16:51:58.841332Z node 5 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-11-03T16:51:58.841341Z node 5 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-11-03T16:51:58.841362Z node 5 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [5:7568542916828960617:2472] (SourceId=src, PreferedPartition=(NULL)) StartKqpSession
2025-11-03T16:51:58.844176Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:58.844209Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:58.844226Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:58.849679Z node 5 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [5:7568542916828960617:2472] (SourceId=src, PreferedPartition=(NULL)) Select from the table
2025-11-03T16:51:58.948293Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:58.948327Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:58.948342Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:59.052120Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:59.052160Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:59.052175Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:59.142034Z node 5 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [5:7568542916828960617:2472] (SourceId=src, PreferedPartition=(NULL)) RequestPQRB
2025-11-03T16:51:59.147550Z node 5 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1655: [72075186224037893][rt3.dc1--test-topic] pipe [5:7568542921123927966:2472] connected; active server actors: 1
2025-11-03T16:51:59.147807Z node 5 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [5:7568542916828960617:2472] (SourceId=src, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=src
2025-11-03T16:51:59.147833Z node 5 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [5:7568542916828960617:2472] (SourceId=src, PreferedPartition=(NULL)) Update the table
2025-11-03T16:51:59.149929Z node 5 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1659: [72075186224037893][rt3.dc1--test-topic] pipe [5:7568542921123927966:2472] disconnected.
2025-11-03T16:51:59.149964Z node 5 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1670: [72075186224037893][rt3.dc1--test-topic] pipe [5:7568542921123927966:2472] disconnected; active server actors: 1
2025-11-03T16:51:59.149986Z node 5 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1695: [72075186224037893][rt3.dc1--test-topic] pipe [5:7568542921123927966:2472] disconnected no session
2025-11-03T16:51:59.152174Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:59.152232Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:59.152252Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:59.256166Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:59.256206Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:59.256223Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:59.316710Z node 5 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [5:7568542916828960617:2472] (SourceId=src, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-11-03T16:51:59.316758Z node 5 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [5:7568542916828960617:2472] (SourceId=src, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-11-03T16:51:59.316777Z node 5 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [5:7568542916828960617:2472] (SourceId=src, PreferedPartition=(NULL)) Start idle
2025-11-03T16:51:59.316820Z node 5 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-11-03T16:51:59.319372Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [5:7568542921123927990:2472], now have 1 active actors on pipe
2025-11-03T16:51:59.319733Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 6, Generation: 1
2025-11-03T16:51:59.320031Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:59.320065Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:59.320149Z node 6 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src|9c56f6fe-1dc9668a-154ac65e-6f831f15_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src
2025-11-03T16:51:59.320193Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:59.320219Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:59.320233Z node 6 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-03T16:51:59.320278Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:59.320323Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-03T16:51:59.320374Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-03T16:51:59.324385Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:59.324432Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:59.324522Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-03T16:51:59.325049Z node 5 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1 partition: 0 MaxSeqNo: 0 sessionId: src|9c56f6fe-1dc9668a-154ac65e-6f831f15_0
2025-11-03T16:51:59.328595Z :INFO: [] MessageGroupId [src] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1762188719328 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-11-03T16:51:59.328733Z :INFO: [] MessageGroupId [src] SessionId [] Write session established. Init response: session_id: "src|9c56f6fe-1dc9668a-154ac65e-6f831f15_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-11-03T16:51:59.333208Z :INFO: [] MessageGroupId [src] SessionId [src|9c56f6fe-1dc9668a-154ac65e-6f831f15_0] Write session: close. Timeout = 0 ms
2025-11-03T16:51:59.333266Z :INFO: [] MessageGroupId [src] SessionId [src|9c56f6fe-1dc9668a-154ac65e-6f831f15_0] Write session will now close
2025-11-03T16:51:59.333317Z :DEBUG: [] MessageGroupId [src] SessionId [src|9c56f6fe-1dc9668a-154ac65e-6f831f15_0] Write session: aborting
2025-11-03T16:51:59.333881Z :INFO: [] MessageGroupId [src] SessionId [src|9c56f6fe-1dc9668a-154ac65e-6f831f15_0] Write session: gracefully shut down, all writes complete
2025-11-03T16:51:59.333931Z :DEBUG: [] MessageGroupId [src] SessionId [src|9c56f6fe-1dc9668a-154ac65e-6f831f15_0] Write session: destroy
2025-11-03T16:51:59.334905Z node 5 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId: src|9c56f6fe-1dc9668a-154ac65e-6f831f15_0 grpc read done: success: 0 data: 
2025-11-03T16:51:59.334940Z node 5 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 1 sessionId: src|9c56f6fe-1dc9668a-154ac65e-6f831f15_0 grpc read failed
2025-11-03T16:51:59.334978Z node 5 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 1 sessionId: src|9c56f6fe-1dc9668a-154ac65e-6f831f15_0 grpc closed
2025-11-03T16:51:59.334997Z node 5 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1 sessionId: src|9c56f6fe-1dc9668a-154ac65e-6f831f15_0 is DEAD
2025-11-03T16:51:59.335835Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-11-03T16:51:59.342858Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [5:7568542921123927990:2472] destroyed
2025-11-03T16:51:59.342915Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-11-03T16:51:59.342953Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:59.342968Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:59.342982Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:59.355228Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:59.355260Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:59.355276Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:59.366371Z :INFO: [/Root] [/Root] [1671c692-d2a120d3-d81cd6a5-885fced6] Starting read session
2025-11-03T16:51:59.366440Z :DEBUG: [/Root] [/Root] [1671c692-d2a120d3-d81cd6a5-885fced6] Starting session to cluster null (localhost:21480)
2025-11-03T16:51:59.368519Z :DEBUG: [/Root] [/Root] [1671c692-d2a120d3-d81cd6a5-885fced6] [null] In Reconnect, ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:51:59.368557Z :DEBUG: [/Root] [/Root] [1671c692-d2a120d3-d81cd6a5-885fced6] [null] New values: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:51:59.368596Z :DEBUG: [/Root] [/Root] [1671c692-d2a120d3-d81cd6a5-885fced6] [null] Reconnecting session to cluster null in 0.000000s
2025-11-03T16:51:59.369983Z :ERROR: [/Root] [/Root] [1671c692-d2a120d3-d81cd6a5-885fced6] [null] Got error. Status: CLIENT_UNAUTHENTICATED. Description: <main>: Error: Can't get Authentication info from CredentialsProvider. ydb/public/sdk/cpp/src/client/persqueue_public/ut/basic_usage_ut.cpp:451: exception during creation 
2025-11-03T16:51:59.370053Z :DEBUG: [/Root] [/Root] [1671c692-d2a120d3-d81cd6a5-885fced6] [null] In Reconnect, ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:51:59.370092Z :DEBUG: [/Root] [/Root] [1671c692-d2a120d3-d81cd6a5-885fced6] [null] New values: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:51:59.370218Z :INFO: [/Root] [/Root] [1671c692-d2a120d3-d81cd6a5-885fced6] [null] Closing session to cluster: SessionClosed { Status: CLIENT_UNAUTHENTICATED Issues: "<main>: Error: Failed to establish connection to server "" ( cluster null). Attempts done: 1     <main>: Error: Can't get Authentication info from CredentialsProvider. ydb/public/sdk/cpp/src/client/persqueue_public/ut/basic_usage_ut.cpp:451: exception during creation " }
Get event on client
2025-11-03T16:51:59.370444Z :NOTICE: [/Root] [/Root] [1671c692-d2a120d3-d81cd6a5-885fced6] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
2025-11-03T16:51:59.370482Z :DEBUG: [/Root] [/Root] [1671c692-d2a120d3-d81cd6a5-885fced6] [null] Abort session to cluster
Got close event: SessionClosed { Status: CLIENT_UNAUTHENTICATED Issues: "<main>: Error: Failed to establish connection to server "" ( cluster null). Attempts done: 1     <main>: Error: Can't get Authentication info from CredentialsProvider. ydb/public/sdk/cpp/src/client/persqueue_public/ut/basic_usage_ut.cpp:451: exception during creation " }2025-11-03T16:51:59.370607Z :INFO: [/Root] [/Root] [1671c692-d2a120d3-d81cd6a5-885fced6] Closing read session. Close timeout: 0.000000s
2025-11-03T16:51:59.370647Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset):
2025-11-03T16:51:59.370708Z :INFO: [/Root] [/Root] [1671c692-d2a120d3-d81cd6a5-885fced6] Counters: { Errors: 1 CurrentSessionLifetimeMs: 4 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-11-03T16:51:59.370798Z :NOTICE: [/Root] [/Root] [1671c692-d2a120d3-d81cd6a5-885fced6] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
2025-11-03T16:51:59.455288Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:59.455322Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:59.455340Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:59.556146Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:59.556180Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:59.556195Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:59.660370Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:59.660410Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:59.660429Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:14.544769Z :WriteAndReadSomeMessagesWithAsyncCompression INFO: Random seed for debugging is 1762188674544727
2025-11-03T16:51:15.109736Z node 1 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[1:7568542729158413761:2073];send_to=[0:7307199536658146131:7762515];
2025-11-03T16:51:15.109783Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
2025-11-03T16:51:15.223148Z node 1 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
test_client.cpp: SetPath # /home/runner/.ya/build/build_root/7jz3/001974/r3tmp/tmpHoC75j/pdisk_1.dat
2025-11-03T16:51:15.280372Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-11-03T16:51:15.645648Z node 2 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-11-03T16:51:15.646065Z node 2 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=incorrect path status: LookupError;
2025-11-03T16:51:15.668095Z node 1 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-11-03T16:51:15.765169Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(1, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-11-03T16:51:15.767499Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(1, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-11-03T16:51:15.770573Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(2, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-11-03T16:51:15.770687Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(2, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-11-03T16:51:15.791411Z node 1 :HIVE WARN: hive_impl.cpp:811: HIVE#72057594037968897 Handle TEvInterconnect::TEvNodeConnected, NodeId 2 Cookie 2
2025-11-03T16:51:15.791569Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(1, (0,0,0,0)) VolatileState: Connecting -> Connected
2025-11-03T16:51:15.792781Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(2, (0,0,0,0)) VolatileState: Connecting -> Connected
2025-11-03T16:51:15.885953Z node 1 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
2025-11-03T16:51:15.908454Z node 1 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-11-03T16:51:15.909538Z node 2 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
TServer::EnableGrpc on GrpcPort 15392, node 1
2025-11-03T16:51:16.160107Z node 1 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-11-03T16:51:16.180646Z node 1 :NET_CLASSIFIER WARN: net_classifier.cpp:190: distributable config is empty, broken or outdated, will use file: /home/runner/.ya/build/build_root/7jz3/001974/r3tmp/yandexr8HEFv.tmp
2025-11-03T16:51:16.180671Z node 1 :NET_CLASSIFIER WARN: net_classifier.cpp:196: will try to initialize from file: /home/runner/.ya/build/build_root/7jz3/001974/r3tmp/yandexr8HEFv.tmp
2025-11-03T16:51:16.180813Z node 1 :NET_CLASSIFIER WARN: net_classifier.cpp:202: successfully initialized from file: /home/runner/.ya/build/build_root/7jz3/001974/r3tmp/yandexr8HEFv.tmp
2025-11-03T16:51:16.180931Z node 1 :NET_CLASSIFIER ERROR: net_classifier.cpp:228: got bad distributable configuration
2025-11-03T16:51:16.277164Z node 2 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-11-03T16:51:16.304896Z INFO: TTestServer started on Port 4127 GrpcPort 15392
TClient is connected to server localhost:4127
PQClient connected to localhost:15392
WaitRootIsUp 'Root'...
TClient::Ls request: Root
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "Root"
    PathId: 1
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 1
    CreateStep: 0
    ParentPathId: 1
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 1
      SubDomainVersion: 0
      SecurityStateVersion: 0
    }
    ChildrenExist: false
  }
  Children {
    Name: ".sys"
    PathId: 18446744073709551615
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 0
    CreateStep: 0
    ParentPathId: 18446744073709551615
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 0
      Pl...
(TRUNCATED)
WaitRootIsUp 'Root' success.
2025-11-03T16:51:16.650437Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpAlterSubDomain, opId: 281474976715657:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_alter_subdomain.cpp:311)
waiting...
waiting...
waiting...
waiting...
2025-11-03T16:51:19.755581Z node 2 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [2:7568542745941532111:2300], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-03T16:51:19.755688Z node 2 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-03T16:51:19.756775Z node 2 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [2:7568542745941532122:2303], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-03T16:51:19.757669Z node 2 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [2:7568542745941532125:2304], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-03T16:51:19.757752Z node 2 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-03T16:51:19.756269Z node 1 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [1:7568542746338283928:2328], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-03T16:51:19.756544Z node 1 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-03T16:51:19.760682Z node 1 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [1:7568542746338283956:2332], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-03T16:51:19.760735Z node 1 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [1:7568542746338283957:2333], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-03T16:51:19.760837Z node 1 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-03T16:51:19.764661Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateResourcePool, opId: 281474976715661:3, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_resource_pool.cpp:179)
2025-11-03T16:51:19.781077Z node 2 :TX_PROXY ERROR: schemereq.cpp:593: Actor# [2:7568542745941532128:2137] txid# 281474976720657, issues: { message: "Check failed: path: \'/Root/.metadata/workload_manager/pools/default\', error: path exists but creating right now (id: [OwnerId: 72057594046644480, LocalPathId: 8], type: EPathTypeResourcePool, state: EPathStateCreate)" severity: 1 }
2025-11-03T16:51:19.791432Z node 2 :KQP_WORKLOAD_SERVICE WARN: helpers.h:73: [WorkloadService] [TPoolCreatorActor] ActorId: [2:7568542745941532126:2305], DatabaseId: /Root, PoolId: default, Scheduled retry for error: { <main>: Error: Transaction 281474976715661 completed, doublechecking }
2025-11-03T16:51:19.791356Z node 1 :KQP_WORKLOAD_SERVICE WARN: helpers.h:73: [WorkloadService] [TPoolCreatorActor] ActorId: [1:7568542746338283960:2334], DatabaseId: /Root, PoolId: default, Scheduled retry for error: { <main>: Error: Transaction 281474976715661 completed, doublechecking }
2025-11-03T16:51:19.882822Z node 2 :TX_PROXY ERROR: schemereq.cpp:593: Actor# [2:7568542745941532155:2143] txid# 281474976720658, issues: { message: "Check failed: path: \'/Root/.metadata/workload_manager/pools/default\', error: path exist, request accepts it (id: [OwnerId: 72057594046644480, LocalPathId: 8], type: EPathTypeResourcePool, state: EPathStateNoChanges)" severity: 1 }
2025-11-03T16:51:19.886289Z node 1 :TX_PROXY ERROR: schemereq.cpp:593: Actor# [1:7568542746338284054:2695] txid# 281474976715662, issues: { message: "Check failed: path: \'/Root/.metadata/workload_manager/pools/default\', error: path exist, request accepts it (id: [OwnerId: 72057594046644480, LocalPathId: 8], type: EPathTypeResourcePool, state: EPathStateNoChanges)" severity: 1 }
2025-11-03T16:51:20.121053Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[1:7568542729158413761:2073];send_to=[0:7307199536658146131:7762515];
2025-11-03T16:51:20.121133Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
2025-11-03T16:51:20.143375Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976715663:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:690)
2025-11-03T16:51:20.144331Z node 1 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:570: Compilation failed, self: [1:7568542746338284064:2340], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-11-03T16:51:20.146551Z node 1 :KQP_SESSION WARN: kqp_session_actor.cpp:2506: SessionId: ydb://session/3?node_id=1&id=MjY0YjA0MDMtOTJmZDBkOGUtNmJhMTQ2NTUtMWM5ZmYzYjI=, ActorId: [1:7568542746338283925:2326], ActorState: ExecuteState, TraceId: 01k95a2pj23qr0cb23jantkgga, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-11-03T16:51:20.147931Z node 1 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-11-03T16:51:20.155832Z node 2 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:570: Compilation failed, self: [2:7568542745941532170:2309], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-11-03T16:51:20.156087Z node 2 :KQP_SESSION WARN: kqp_session_actor.cpp:2506: SessionId: ydb://session/3?node_id=2&id=ZDg2NjEwZTAtOWZmYTkzMjQtYjIzNmFjYWEtZWM1MzI5NWQ=, ActorId: [2:7568542745941532109:2299], ActorState: ExecuteState, TraceId: 01k95a2pj89thqwc6t5y0btd97, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-11-03T16:51:20.156456Z node 2 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-11-03T16:51:20.337125Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976715664:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:690)
2025-11-03T16:51:20.487720Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976715665:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:690)
=== Init DC: UPSERT INTO `/Root/PQ/Config/V2/Cluster` (name, balancer, local, enabled, weight) VALUES ("dc1", "localhost:15392", true, true, 1000);
2025-11-03T16:51:20.782169Z node 1 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976715666. Ctx: { TraceId: 01k95a2qe50803hs5aya12may1, Database: , SessionId: ydb://session/3?node_id=1&id=NWFiNWVlMTYtYzY1M2E2NzMtMTViNjBkNzctOWMyODBlYTg=, PoolId: default, DatabaseId: /Root}. Database not set, use /Root
=== CheckClustersList. Subcribe to ClusterTracker from [1:7568542750633251767:2998] 
=== CheckClustersList. Ok
2025-11-03T16:51:27.344434Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976715671:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:690)
waiting...
PQ Client: create topic: rt3.dc1--test-topic with 1 partitions
CallPersQueueGRPC request to localhost:15392
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-11-03T16:51:27.458001Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
CallPersQueueGRPC request to localhost:15392
MetaRequest {
  CmdCreateTopic {
    Topic: "rt3.dc1--test-topic"
    NumPartitions: 1
    Config {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
  }
}
CallPersQueueGRPC response:
Status: 129
ProxyErrorCode: 53
SchemeStatus: 1
FlatTxId {
  TxId: 281474976715672
  SchemeShardTabletId: 72057594046644480
  PathId: 13
}
ErrorCode: OK
AddTopic: rt3.dc1--test-topic
===Run query:``DECLARE $version as Int64; DECLARE $path AS Utf8; DECLARE $cluster as Utf8; UPSERT INTO `/Root/PQ/Config/V2/Topics` (path, dc) VALUES ($path, $cluster); UPSERT INTO `/Root/PQ/Config/V2/Versions` (name, version) VALUES ("Topics", $version);`` with topic = test-topic, dc = dc1
2025-11-03T16:51:27.491875Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1655: [72075186224037893][] pipe [1:7568542780698023237:3249] connected; active server actors: 1
2025-11-03T16:51:27.492099Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1519: [72075186224037893][rt3.dc1--test-topic] updating configuration. Deleted partitions []. Added partitions [0]
2025-11-03T16:51:27.493893Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:971: [72075186224037893][rt3.dc1--test-topic] Discovered subdomain [OwnerId: 72057594046644480, LocalPathId: 1] state, outOfSpace = 0 at RB 72075186224037893
2025-11-03T16:51:27.494483Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:140: [72075186224037893][rt3.dc1--test-topic] BALANCER INIT DONE for rt3.dc1--test-topic: (0, 72075186224037892) 
2025-11-03T16:51:27.559803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2960: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-11-03T16:51:27.563468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2992: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-11-03T16:51:27.563787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:787: [PQ: 72075186224037892] no config, start with empty partitions and default config
2025-11-03T16:51:27.563835Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:913: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-11-03T16:51:27.563873Z node 2 :PERSQUEUE INFO: pq_impl.cpp:612: [PQ: 72075186224037892] doesn't have tx writes info
2025-11-03T16:51:27.564388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [1:7568542780698023236:3248], now have 1 active actors on pipe
2025-11-03T16:51:27.564420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [1:7568542780698023262:2437], now have 1 active actors on pipe
2025-11-03T16:51:27.564622Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:404: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1
2025-11-03T16:51:27.565065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-03T16:51:27.571651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-03T16:51:27.579364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [1:7568542780698023302:3297], now have 1 active actors on pipe
2025-11-03T16:51:27.580760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-03T16:51:27.584158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-03T16:51:27.585396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-11-03T16:51:27.585461Z node 2 :PERSQUEUE DEBUG: partition.cpp:1312: [72075186224037892][Partition][0][StateInit] HandleOnInit TEvPQ::TEvProposePartitionConfig
2025-11-03T16:51:27.585756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-11-03T16:51:27.586104Z node 2 :PERSQUEUE INFO: partition_init.cpp:1101: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7568542780301270973:2382]
2025-11-03T16:51:27.589175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-11-03T16:51:27.589209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-11-03T16:51:27.589230Z node 2 :PERSQUEUE INFO: partition.cpp:707: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1 [2:7568542780301270973:2382]
2025-11-03T16:51:27.589254Z node 2 :PERSQUEUE DEBUG: partition.cpp:727: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 0 Head Offset 0 PartNo 0 PackedSize 0 count 0 nextOffset 0 batches 0
2025-11-03T16:51:27.589289Z node 2 :PERSQUEUE DEBUG: partition_mlp.cpp:83: [72075186224037892][Partition][0][StateIdle] Initializing MLP Consumers: 0
2025-11-03T16:51:27.590666Z node 2 :PERSQUEUE DEBUG: partition.cpp:4273: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 1
2025-11-03T16:51:27.590707Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:27.590843Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:27.590861Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-03T16:51:27.590880Z node 2 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-11-03T16:51:27.590889Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:27.590901Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:27.590912Z node 2 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-11-03T16:51:27.590943Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:923: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-11-03T16:51:27.590973Z node 2 :PERSQUEUE DEBUG: partition_mlp.cpp:60: [72075186224037892][Partition][0][StateIdle] Process MLP pending events. Count 0
2025-11-03T16:51:27.591501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-03T16:51:27.591618Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:183: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:51:27.603499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-03T16:51:27.603699Z node 2 :PERSQUEUE DEBUG: partition.cpp:1416: [72075186224037892][Partition][0][StateIdle] Handle TEvPQ::TEvTxCommit Step 1762188687623, TxId 281474976715672
2025-11-03T16:51:27.603737Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:27.603751Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:27.603907Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:27.604229Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-03T16:51:27.609548Z node 2 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-03T16:51:27.609817Z node 2 :PERSQUEUE DEBUG: partition_mlp.cpp:83: [72075186224037892][Partition][0][StateIdle] Initializing MLP Consumers: 0
2025-11-03T16:51:27.609963Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-11-03T16:51:27.610005Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:27.610023Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:27.610035Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:27.610077Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:183: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:51:27.610510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:398: [PQ: 72075186224037892] Apply new config PartitionConfig { LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 } PartitionIds: 0 TopicName: "rt3.dc1--test-topic" Version: 0 LocalDC: true Codecs { Ids: 0 Ids: 1 Ids: 2 Codecs: "raw" Codecs: "gzip" Codecs: "lzop" } TopicPath: "/Root/PQ/rt3.dc1--test-topic" YcCloudId: "" YcFolderId: "" YdbDatabaseId: "" YdbDatabasePath: "/Root" Partitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } AllPartitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } Consumers { Name: "user" ReadFromTimestampsMs: 0 FormatVersion: 0 Version: 0 Generation: 0 } MonitoringProjectId: ""
2025-11-03T16:51:27.610630Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:913: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-11-03T16:51:27.611007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-03T16:51:27.617886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-03T16:51:27.618029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-03T16:51:27.624252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-03T16:51:27.644244Z node 1 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976715673. Ctx: { TraceId: 01k95a2y4s550a4957ev9gys0y, Database: , SessionId: ydb://session/3?node_id=1&id=ZmU1MTQ3NjItOGIwYjQ0NDAtZWZhOTlkYjAtMzc2ZWY0NDQ=, PoolId: default, DatabaseId: /Root}. Database not set, use /Root
===Query complete
TClient::Ls request: /Root/PQ/rt3.dc1--test-topic
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976715672
    CreateStep: 1762188687623
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts...
(TRUNCATED)
GetTopicVersionFromPath:  record Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976715672
    CreateStep: 1762188687623
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      YdbDatabasePath: "/Root"
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
    Partitions {
      PartitionId: 0
      TabletId: 72075186224037892
      Status: Active
    }
    AlterVersion: 1
    BalancerTabletID: 72075186224037893
    NextPartitionId: 1
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 1
      PlanResolution: 7
      Coordinators: 72057594046316545
      TimeCastBucketsPerMediator: 2
      Mediators: 72057594046382081
    }
    DomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    PathsInside: 12
    PathsLimit: 10000
    ShardsInside: 6
    ShardsLimit: 200000
    ResourcesDomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    DiskSpaceUsage {
      Tables {
        TotalSize: 0
        DataSize: 0
        IndexSize: 0
      }
      Topics {
        ReserveSize: 0
        AccountSize: 0
        DataSize: 0
        UsedReserveSize: 0
      }
    }
    PQPartitionsInside: 1
    PQPartitionsLimit: 1000000
    SchemeLimits {
      MaxDepth: 32
      MaxPaths: 10000
      MaxChildrenInDir: 100000
      MaxAclBytesSize: 10240
      MaxTableColumns: 200
      MaxTableColumnNameLength: 255
      MaxTableKeyColumns: 30
      MaxTableIndices: 20
      MaxShards: 200000
      MaxShardsInPath: 35000
      MaxConsistentCopyTargets: 10000
      MaxPathElementLength: 255
      ExtraPathSymbolsAllowed: "!\"#$%&\'()*+,-.:;<=>?@[\\]^_`{|}~"
      MaxPQPartitions: 1000000
      MaxTableCdcStreams: 5
      MaxExports: 10
      MaxImports: 10
      MaxColumnTableColumns: 10000
    }
  }
}
Path: "/Root/PQ/rt3.dc1--test-topic"
 name rt3.dc1--test-topic version1
CallPersQueueGRPC request to localhost:15392
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-11-03T16:51:27.688610Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
MetaResponse {
  CmdGetTopicMetadataResult {
    TopicInfo {
      Topic: "rt3.dc1--test-topic"
      NumPartitions: 1
      Config {
        PartitionConfig {
          LifetimeSeconds: 86400
          LowWatermark: 8388608
          SourceIdLifetimeSeconds: 86400
          WriteSpeedInBytesPerSecond: 20000000
          BurstSize: 20000000
          SourceIdMaxCounts: 6000000
        }
        Version: 1
        LocalDC: true
        Codecs {
          Ids: 0
          Ids: 1
          Ids: 2
          Codecs: "raw"
          Codecs: "gzip"
          Codecs: "lzop"
        }
        TopicPath: "/Root/PQ/rt3.dc1--test-topic"
        YdbDatabasePath: "/Root"
        Consumers {
          Name: "user"
          ReadFromTimestampsMs: 0
          FormatVersion: 0
          Version: 0
        }
      }
      ErrorCode: OK
    }
  }
}
=== Topic created, have version: 1
2025-11-03T16:51:27.691268Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:27.691311Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:27.691324Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:27.701099Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: try to update token
2025-11-03T16:51:27.701624Z :INFO: [] MessageGroupId [src] SessionId [] Write session: Do CDS request
2025-11-03T16:51:27.701685Z :INFO: [] MessageGroupId [src] SessionId [] Start write session. Will connect to endpoint: localhost:15392
2025-11-03T16:51:27.718980Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-11-03T16:51:27.719026Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1
2025-11-03T16:51:27.734179Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src" }
2025-11-03T16:51:27.736802Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src" }
2025-11-03T16:51:27.736965Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1 topic: "test-topic" message_group_id: "src" from ipv6:[::1]:39066
2025-11-03T16:51:27.736982Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:39066 proto=v1  topic=test-topic durationSec=0
2025-11-03T16:51:27.736992Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-11-03T16:51:27.738494Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1 sessionId:  describe result for acl check
2025-11-03T16:51:27.738626Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-11-03T16:51:27.738644Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-11-03T16:51:27.738655Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-11-03T16:51:27.738668Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7568542780698023373:2455] (SourceId=src, PreferedPartition=(NULL)) StartKqpSession
2025-11-03T16:51:27.740575Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7568542780698023373:2455] (SourceId=src, PreferedPartition=(NULL)) Select from the table
2025-11-03T16:51:27.791543Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:27.791569Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:27.791578Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:27.897819Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:27.897848Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:27.897859Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:27.971652Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [1:7568542780698023373:2455] (SourceId=src, PreferedPartition=(NULL)) RequestPQRB
2025-11-03T16:51:27.971911Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1655: [72075186224037893][rt3.dc1--test-topic] pipe [1:7568542780698023412:2455] connected; active server actors: 1
2025-11-03T16:51:27.971957Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [1:7568542780698023373:2455] (SourceId=src, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=src
2025-11-03T16:51:27.971989Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7568542780698023373:2455] (SourceId=src, PreferedPartition=(NULL)) Update the table
2025-11-03T16:51:27.972284Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1659: [72075186224037893][rt3.dc1--test-topic] pipe [1:7568542780698023412:2455] disconnected.
2025-11-03T16:51:27.972321Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1670: [72075186224037893][rt3.dc1--test-topic] pipe [1:7568542780698023412:2455] disconnected; active server actors: 1
2025-11-03T16:51:27.972346Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1695: [72075186224037893][rt3.dc1--test-topic] pipe [1:7568542780698023412:2455] disconnected no session
2025-11-03T16:51:27.997912Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:27.997938Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:27.997948Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:28.069802Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7568542780698023373:2455] (SourceId=src, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-11-03T16:51:28.069844Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7568542780698023373:2455] (SourceId=src, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-11-03T16:51:28.069868Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7568542780698023373:2455] (SourceId=src, PreferedPartition=(NULL)) Start idle
2025-11-03T16:51:28.069892Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-11-03T16:51:28.072557Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1
2025-11-03T16:51:28.076079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [1:7568542784992990732:2455], now have 1 active actors on pipe
2025-11-03T16:51:28.076198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:28.076223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:28.076304Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src|4acd20e6-45fc889-f3a1686d-ed281285_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src
2025-11-03T16:51:28.076341Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:28.076359Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:28.076375Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-03T16:51:28.076426Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:28.076465Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-03T16:51:28.076516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-03T16:51:28.077510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:28.077534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:28.077614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-03T16:51:28.077925Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1 partition: 0 MaxSeqNo: 0 sessionId: src|4acd20e6-45fc889-f3a1686d-ed281285_0
2025-11-03T16:51:28.080084Z :INFO: [] MessageGroupId [src] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1762188688080 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-11-03T16:51:28.080236Z :INFO: [] MessageGroupId [src] SessionId [] Write session established. Init response: session_id: "src|4acd20e6-45fc889-f3a1686d-ed281285_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-11-03T16:51:28.084104Z :INFO: [] MessageGroupId [src] SessionId [src|4acd20e6-45fc889-f3a1686d-ed281285_0] Write session: close. Timeout = 0 ms
2025-11-03T16:51:28.084160Z :INFO: [] MessageGroupId [src] SessionId [src|4acd20e6-45fc889-f3a1686d-ed281285_0] Write session will now close
2025-11-03T16:51:28.084205Z :DEBUG: [] MessageGroupId [src] SessionId [src|4acd20e6-45fc889-f3a1686d-ed281285_0] Write session: aborting
2025-11-03T16:51:28.084726Z :INFO: [] MessageGroupId [src] SessionId [src|4acd20e6-45fc889-f3a1686d-ed281285_0] Write session: gracefully shut down, all writes complete
2025-11-03T16:51:28.084772Z :DEBUG: [] MessageGroupId [src] SessionId [src|4acd20e6-45fc889-f3a1686d-ed281285_0] Write session: destroy
2025-11-03T16:51:28.091401Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId: src|4acd20e6-45fc889-f3a1686d-ed281285_0 grpc read done: success: 0 data: 
2025-11-03T16:51:28.091434Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 1 sessionId: src|4acd20e6-45fc889-f3a1686d-ed281285_0 grpc read failed
2025-11-03T16:51:28.091466Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 1 sessionId: src|4acd20e6-45fc889-f3a1686d-ed281285_0 grpc closed
2025-11-03T16:51:28.091482Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1 sessionId: src|4acd20e6-45fc889-f3a1686d-ed281285_0 is DEAD
2025-11-03T16:51:28.092330Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-11-03T16:51:28.096371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [1:7568542784992990732:2455] destroyed
2025-11-03T16:51:28.096420Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-11-03T16:51:28.096453Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:28.096467Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:28.096479Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:28.104249Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:28.104276Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:28.104286Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:28.110311Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [] Write session: try to update token
2025-11-03T16:51:28.110704Z :INFO: [/Root] MessageGroupId [src_id] SessionId [] Write session: Do CDS request
2025-11-03T16:51:28.112315Z :INFO: [/Root] MessageGroupId [src_id] SessionId [] Start write session. Will connect to endpoint: localhost:15392
2025-11-03T16:51:28.137132Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-11-03T16:51:28.144367Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-11-03T16:51:28.144412Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2
2025-11-03T16:51:28.144964Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-11-03T16:51:28.145090Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:39084
2025-11-03T16:51:28.145106Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:39084 proto=v1  topic=test-topic durationSec=0
2025-11-03T16:51:28.145116Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-11-03T16:51:28.146563Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2 sessionId:  describe result for acl check
2025-11-03T16:51:28.146689Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-11-03T16:51:28.146700Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-11-03T16:51:28.146724Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-11-03T16:51:28.146740Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7568542784992990745:2473] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-11-03T16:51:28.149139Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7568542784992990745:2473] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-11-03T16:51:28.173425Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [1:7568542784992990745:2473] (SourceId=src_id, PreferedPartition=(NULL)) RequestPQRB
2025-11-03T16:51:28.174125Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1655: [72075186224037893][rt3.dc1--test-topic] pipe [1:7568542784992990771:2473] connected; active server actors: 1
2025-11-03T16:51:28.174151Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [1:7568542784992990745:2473] (SourceId=src_id, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=src_id
2025-11-03T16:51:28.174164Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7568542784992990745:2473] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-11-03T16:51:28.175005Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1659: [72075186224037893][rt3.dc1--test-topic] pipe [1:7568542784992990771:2473] disconnected.
2025-11-03T16:51:28.175022Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1670: [72075186224037893][rt3.dc1--test-topic] pipe [1:7568542784992990771:2473] disconnected; active server actors: 1
2025-11-03T16:51:28.175036Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1695: [72075186224037893][rt3.dc1--test-topic] pipe [1:7568542784992990771:2473] disconnected no session
2025-11-03T16:51:28.190627Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7568542784992990745:2473] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-11-03T16:51:28.190656Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7568542784992990745:2473] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-11-03T16:51:28.190667Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7568542784992990745:2473] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-11-03T16:51:28.190687Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-11-03T16:51:28.196214Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1
2025-11-03T16:51:28.197506Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2 partition: 0 MaxSeqNo: 0 sessionId: src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0
2025-11-03T16:51:28.196095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [1:7568542784992990788:2473], now have 1 active actors on pipe
2025-11-03T16:51:28.196433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:28.196454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:28.196513Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-11-03T16:51:28.196543Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:28.196557Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:28.196567Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-03T16:51:28.196601Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:28.196632Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-03T16:51:28.196669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-03T16:51:28.197182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:28.197197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:28.197246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-03T16:51:28.200166Z :INFO: [/Root] MessageGroupId [src_id] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1762188688200 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-11-03T16:51:28.200314Z :INFO: [/Root] MessageGroupId [src_id] SessionId [] Write session established. Init response: session_id: "src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-11-03T16:51:28.200542Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write 1 messages with Id from 1 to 1
2025-11-03T16:51:28.200693Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write 1 messages with Id from 2 to 2
2025-11-03T16:51:28.200746Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write 1 messages with Id from 3 to 3
2025-11-03T16:51:28.200789Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write 1 messages with Id from 4 to 4
2025-11-03T16:51:28.200843Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write 1 messages with Id from 5 to 5
2025-11-03T16:51:28.200891Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write 1 messages with Id from 6 to 6
2025-11-03T16:51:28.200931Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write 1 messages with Id from 7 to 7
2025-11-03T16:51:28.200963Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write 1 messages with Id from 8 to 8
2025-11-03T16:51:28.200998Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write 1 messages with Id from 9 to 9
2025-11-03T16:51:28.201030Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write 1 messages with Id from 10 to 10
2025-11-03T16:51:28.201061Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write 1 messages with Id from 11 to 11
2025-11-03T16:51:28.201095Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write 1 messages with Id from 12 to 12
2025-11-03T16:51:28.201206Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write session: try to update token
2025-11-03T16:51:28.201269Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Send 1 message(s) (11 left), first sequence number is 1
2025-11-03T16:51:28.201579Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write session: try to update token
2025-11-03T16:51:28.201617Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Send 1 message(s) (10 left), first sequence number is 2
2025-11-03T16:51:28.201726Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write session: try to update token
2025-11-03T16:51:28.201754Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Send 1 message(s) (9 left), first sequence number is 3
2025-11-03T16:51:28.201905Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write session: try to update token
2025-11-03T16:51:28.201943Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Send 1 message(s) (8 left), first sequence number is 4
2025-11-03T16:51:28.202001Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write session: try to update token
2025-11-03T16:51:28.202029Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Send 1 message(s) (7 left), first sequence number is 5
2025-11-03T16:51:28.202225Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write session: try to update token
2025-11-03T16:51:28.202249Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Send 1 message(s) (6 left), first sequence number is 6
2025-11-03T16:51:28.202290Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write session: try to update token
2025-11-03T16:51:28.202311Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Send 1 message(s) (5 left), first sequence number is 7
2025-11-03T16:51:28.202509Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write session: try to update token
2025-11-03T16:51:28.202538Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Send 1 message(s) (4 left), first sequence number is 8
2025-11-03T16:51:28.203177Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write session: try to update token
2025-11-03T16:51:28.203198Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Send 3 message(s) (1 left), first sequence number is 9
2025-11-03T16:51:28.203359Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write session: try to update token
2025-11-03T16:51:28.203398Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Send 1 message(s) (0 left), first sequence number is 12
2025-11-03T16:51:28.205686Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write 1 messages with Id from 13 to 13
2025-11-03T16:51:28.205787Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write 1 messages with Id from 14 to 14
2025-11-03T16:51:28.205829Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write 1 messages with Id from 15 to 15
2025-11-03T16:51:28.205881Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write 1 messages with Id from 16 to 16
2025-11-03T16:51:28.205923Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write 1 messages with Id from 17 to 17
2025-11-03T16:51:28.205958Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write 1 messages with Id from 18 to 18
2025-11-03T16:51:28.205992Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write 1 messages with Id from 19 to 19
2025-11-03T16:51:28.206026Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write 1 messages with Id from 20 to 20
2025-11-03T16:51:28.206068Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write 1 messages with Id from 21 to 21
2025-11-03T16:51:28.206114Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write 1 messages with Id from 22 to 22
2025-11-03T16:51:28.206185Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write session: try to update token
2025-11-03T16:51:28.206244Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Send 1 message(s) (9 left), first sequence number is 13
2025-11-03T16:51:28.206514Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write session: try to update token
2025-11-03T16:51:28.206547Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Send 1 message(s) (8 left), first sequence number is 14
2025-11-03T16:51:28.206742Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write session: try to update token
2025-11-03T16:51:28.206776Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Send 1 message(s) (7 left), first sequence number is 15
2025-11-03T16:51:28.206861Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write session: try to update token
2025-11-03T16:51:28.206890Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Send 1 message(s) (6 left), first sequence number is 16
2025-11-03T16:51:28.206992Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write session: try to update token
2025-11-03T16:51:28.207009Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Send 1 message(s) (5 left), first sequence number is 17
2025-11-03T16:51:28.207174Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write session: try to update token
2025-11-03T16:51:28.207204Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Send 1 message(s) (4 left), first sequence number is 18
2025-11-03T16:51:28.207239Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write session: try to update token
2025-11-03T16:51:28.207262Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Send 1 message(s) (3 left), first sequence number is 19
2025-11-03T16:51:28.207472Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write session: try to update token
2025-11-03T16:51:28.207507Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Send 1 message(s) (2 left), first sequence number is 20
2025-11-03T16:51:28.207584Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write session: try to update token
2025-11-03T16:51:28.207617Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Send 1 message(s) (1 left), first sequence number is 21
2025-11-03T16:51:28.207782Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write session: try to update token
2025-11-03T16:51:28.207812Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Send 1 message(s) (0 left), first sequence number is 22
2025-11-03T16:51:28.208255Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:51:28.208861Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write 1 messages with Id from 23 to 23
2025-11-03T16:51:28.208635Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:51:28.208965Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write 1 messages with Id from 24 to 24
2025-11-03T16:51:28.209023Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write 1 messages with Id from 25 to 25
2025-11-03T16:51:28.209076Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write 1 messages with Id from 26 to 26
2025-11-03T16:51:28.209128Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write 1 messages with Id from 27 to 27
2025-11-03T16:51:28.209161Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write 1 messages with Id from 28 to 28
2025-11-03T16:51:28.209202Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write 1 messages with Id from 29 to 29
2025-11-03T16:51:28.209256Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write session: try to update token
2025-11-03T16:51:28.209285Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Send 1 message(s) (6 left), first sequence number is 23
2025-11-03T16:51:28.209869Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write session: try to update token
2025-11-03T16:51:28.209900Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Send 2 message(s) (4 left), first sequence number is 24
2025-11-03T16:51:28.210276Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write session: try to update token
2025-11-03T16:51:28.210538Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Send 1 message(s) (3 left), first sequence number is 26
2025-11-03T16:51:28.211228Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write session: try to update token
2025-11-03T16:51:28.211265Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Send 1 message(s) (2 left), first sequence number is 27
2025-11-03T16:51:28.211170Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:51:28.211418Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:51:28.212127Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write 1 messages with Id from 30 to 30
2025-11-03T16:51:28.212237Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write 1 messages with Id from 31 to 31
2025-11-03T16:51:28.212067Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:28.212093Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:28.212103Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:28.212190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:28.212222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:28.212263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:28.212273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:28.212346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-11-03T16:51:28.212390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1  requestId: <none> cookie: 2
2025-11-03T16:51:28.212906Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:28.212981Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:28.212288Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write 1 messages with Id from 32 to 32
2025-11-03T16:51:28.213254Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write 1 messages with Id from 33 to 33
2025-11-03T16:51:28.213292Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write 1 messages with Id from 34 to 34
2025-11-03T16:51:28.213365Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write 1 messages with Id from 35 to 35
2025-11-03T16:51:28.213438Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write 1 messages with Id from 36 to 36
2025-11-03T16:51:28.213476Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write 1 messages with Id from 37 to 37
2025-11-03T16:51:28.213508Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write 1 messages with Id from 38 to 38
2025-11-03T16:51:28.213542Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write 1 messages with Id from 39 to 39
2025-11-03T16:51:28.213576Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write 1 messages with Id from 40 to 40
2025-11-03T16:51:28.213622Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write 1 messages with Id from 41 to 41
2025-11-03T16:51:28.213655Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write 1 messages with Id from 42 to 42
2025-11-03T16:51:28.213690Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write 1 messages with Id from 43 to 43
2025-11-03T16:51:28.213722Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write 1 messages with Id from 44 to 44
2025-11-03T16:51:28.213780Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write 1 messages with Id from 45 to 45
2025-11-03T16:51:28.213820Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write 1 messages with Id from 46 to 46
2025-11-03T16:51:28.213852Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write 1 messages with Id from 47 to 47
2025-11-03T16:51:28.213887Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write 1 messages with Id from 48 to 48
2025-11-03T16:51:28.213920Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write 1 messages with Id from 49 to 49
2025-11-03T16:51:28.213956Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write 1 messages with Id from 50 to 50
2025-11-03T16:51:28.214009Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write 1 messages with Id from 51 to 51
2025-11-03T16:51:28.214046Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write 1 messages with Id from 52 to 52
2025-11-03T16:51:28.214080Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write 1 messages with Id from 53 to 53
2025-11-03T16:51:28.214122Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write 1 messages with Id from 54 to 54
2025-11-03T16:51:28.214179Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write 1 messages with Id from 55 to 55
2025-11-03T16:51:28.214233Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write 1 messages with Id from 56 to 56
2025-11-03T16:51:28.214283Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write 1 messages with Id from 57 to 57
2025-11-03T16:51:28.214357Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write 1 messages with Id from 58 to 58
2025-11-03T16:51:28.214395Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write 1 messages with Id from 59 to 59
2025-11-03T16:51:28.214429Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write 1 messages with Id from 60 to 60
2025-11-03T16:51:28.214472Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write 1 messages with Id from 61 to 61
2025-11-03T16:51:28.214513Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write 1 messages with Id from 62 to 62
2025-11-03T16:51:28.214555Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write 1 messages with Id from 63 to 63
2025-11-03T16:51:28.213328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:28.214623Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write 1 messages with Id from 64 to 64
2025-11-03T16:51:28.213357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:28.213632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 1 partNo : 0 messageNo: 2 size 100 offset: -1
2025-11-03T16:51:28.213681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:28.214693Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write 1 messages with Id from 65 to 65
2025-11-03T16:51:28.213691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:28.213709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 2 partNo : 0 messageNo: 3 size 102 offset: -1
2025-11-03T16:51:28.214811Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write 1 messages with Id from 66 to 66
2025-11-03T16:51:28.213738Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:51:28.213784Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:28.214848Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write 1 messages with Id from 67 to 67
2025-11-03T16:51:28.213814Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:28.214883Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write 1 messages with Id from 68 to 68
2025-11-03T16:51:28.214930Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write 1 messages with Id from 69 to 69
2025-11-03T16:51:28.214981Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write 1 messages with Id from 70 to 70
2025-11-03T16:51:28.215017Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write 1 messages with Id from 71 to 71
2025-11-03T16:51:28.213828Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-03T16:51:28.219517Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write 1 messages with Id from 72 to 72
2025-11-03T16:51:28.219639Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write 1 messages with Id from 73 to 73
2025-11-03T16:51:28.219681Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write 1 messages with Id from 74 to 74
2025-11-03T16:51:28.219755Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write 1 messages with Id from 75 to 75
2025-11-03T16:51:28.219824Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write 1 messages with Id from 76 to 76
2025-11-03T16:51:28.219878Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write 1 messages with Id from 77 to 77
2025-11-03T16:51:28.219913Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write 1 messages with Id from 78 to 78
2025-11-03T16:51:28.219973Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write 1 messages with Id from 79 to 79
2025-11-03T16:51:28.220124Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write 1 messages with Id from 80 to 80
2025-11-03T16:51:28.220187Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write 1 messages with Id from 81 to 81
2025-11-03T16:51:28.220244Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write 1 messages with Id from 82 to 82
2025-11-03T16:51:28.220280Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write 1 messages with Id from 83 to 83
2025-11-03T16:51:28.220322Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write 1 messages with Id from 84 to 84
2025-11-03T16:51:28.220382Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write 1 messages with Id from 85 to 85
2025-11-03T16:51:28.220430Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write 1 messages with Id from 86 to 86
2025-11-03T16:51:28.220480Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write 1 messages with Id from 87 to 87
2025-11-03T16:51:28.220522Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write 1 messages with Id from 88 to 88
2025-11-03T16:51:28.220561Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write 1 messages with Id from 89 to 89
2025-11-03T16:51:28.220601Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write 1 messages with Id from 90 to 90
2025-11-03T16:51:28.220645Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write 1 messages with Id from 91 to 91
2025-11-03T16:51:28.220736Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write 1 messages with Id from 92 to 92
2025-11-03T16:51:28.220801Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write 1 messages with Id from 93 to 93
2025-11-03T16:51:28.220839Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write 1 messages with Id from 94 to 94
2025-11-03T16:51:28.220880Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write 1 messages with Id from 95 to 95
2025-11-03T16:51:28.220938Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write 1 messages with Id from 96 to 96
2025-11-03T16:51:28.221740Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write 1 messages with Id from 97 to 97
2025-11-03T16:51:28.221829Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write 1 messages with Id from 98 to 98
2025-11-03T16:51:28.221895Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write 1 messages with Id from 99 to 99
2025-11-03T16:51:28.221959Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write 1 messages with Id from 100 to 100
2025-11-03T16:51:28.222021Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write session: close. Timeout = 18446744073709551 ms
2025-11-03T16:51:28.213925Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 1 partNo 0
2025-11-03T16:51:28.222776Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 1 partNo 0 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 174 count 1 nextOffset 1 batches 1
2025-11-03T16:51:28.221712Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:51:28.222830Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:28.221990Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:51:28.223361Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 0,1 HeadOffset 0 endOffset 0 curOffset 1 d0000000000_00000000000000000000_00000_0000000001_00000? size 162 WTime 1762188688223
2025-11-03T16:51:28.223522Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:51:28.223565Z node 2 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:51:28.223613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:28.223629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:28.223654Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-03T16:51:28.223780Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 0 partNo 0 count 1 size 162
2025-11-03T16:51:28.223915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 4  requestId: <none> cookie: 3
2025-11-03T16:51:28.224367Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:51:28.224598Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:51:28.225604Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:28.225660Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:51:28.225896Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:51:28.226231Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:51:28.226384Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:51:28.226673Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:51:28.226815Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:51:28.227106Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:51:28.227222Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:51:28.227543Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:51:28.227810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:28.227839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:28.227887Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:51:28.230578Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:51:28.233322Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:51:28.233898Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:51:28.234000Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:28.230271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:28.230300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:28.230352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 3 partNo : 0 messageNo: 6 size 102 offset: -1
2025-11-03T16:51:28.230390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:28.230399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:28.232798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:28.232820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:28.233066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:28.233076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:28.233101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:28.233113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:28.233153Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:51:28.233188Z node 2 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:51:28.233381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 5  requestId: <none> cookie: 4
2025-11-03T16:51:28.233412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 7  requestId: <none> cookie: 5
2025-11-03T16:51:28.233425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 8  requestId: <none> cookie: 6
2025-11-03T16:51:28.233472Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 0 count 1 size 162 actorID [2:7568542780301270955:2382]
2025-11-03T16:51:28.233502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 9  requestId: <none> cookie: 7
2025-11-03T16:51:28.233515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 10  requestId: <none> cookie: 8
2025-11-03T16:51:28.233532Z node 2 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-03T16:51:28.233569Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 107 WriteNewSizeFromSupportivePartitions# 0
2025-11-03T16:51:28.233597Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:51:28.233632Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 1, partNo: 0, Offset: 0 is stored on disk
2025-11-03T16:51:28.233707Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 0 suffix '63' size 162
2025-11-03T16:51:28.234231Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:923: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-11-03T16:51:28.234267Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:965: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-11-03T16:51:28.234283Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:28.234307Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:28.234317Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (2)
2025-11-03T16:51:28.234411Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 2 partNo 0
2025-11-03T16:51:28.234101Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:28.234133Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:28.234156Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:28.234400Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:28.234650Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:51:28.234698Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:51:28.234743Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:51:28.234773Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:51:28.234800Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:51:28.235044Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:51:28.235189Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:51:28.235438Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:51:28.236728Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:51:28.237065Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:51:28.237329Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:51:28.237520Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:51:28.237679Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:51:28.237876Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:51:28.250103Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write session: try to update token
2025-11-03T16:51:28.250150Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Send 41 message(s) (32 left), first sequence number is 28
2025-11-03T16:51:28.238120Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:51:28.238447Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:51:28.250859Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write session: try to update token
2025-11-03T16:51:28.250895Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Send 1 message(s) (31 left), first sequence number is 69
2025-11-03T16:51:28.260209Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:51:28.264357Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write session: try to update token
2025-11-03T16:51:28.264413Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Send 15 message(s) (16 left), first sequence number is 70
2025-11-03T16:51:28.273706Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write session: try to update token
2025-11-03T16:51:28.273775Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Send 16 message(s) (0 left), first sequence number is 85
2025-11-03T16:51:28.272440Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:51:28.273406Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:51:28.280308Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:51:28.291809Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 2 partNo 0 FormedBlobsCount 0 NewHead: Offset 1 PartNo 0 PackedSize 176 count 1 nextOffset 2 batches 1
2025-11-03T16:51:28.291930Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 3 partNo 0
2025-11-03T16:51:28.291965Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 3 partNo 0 FormedBlobsCount 0 NewHead: Offset 1 PartNo 0 PackedSize 320 count 2 nextOffset 3 batches 1
2025-11-03T16:51:28.291999Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:28.292633Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 1,2 HeadOffset 1 endOffset 1 curOffset 3 d0000000000_00000000000000000001_00000_0000000002_00000? size 314 WTime 1762188688292
2025-11-03T16:51:28.292797Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:51:28.292899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 2  requestId: <none> cookie: 1
2025-11-03T16:51:28.293043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:28.293064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:28.293115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 4 partNo : 0 messageNo: 11 size 103 offset: -1
2025-11-03T16:51:28.293161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:28.293171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:28.293194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 5 partNo : 0 messageNo: 12 size 103 offset: -1
2025-11-03T16:51:28.293228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:28.293237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:28.293254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 6 partNo : 0 messageNo: 13 size 103 offset: -1
2025-11-03T16:51:28.293287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:28.293296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:28.293314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 7 partNo : 0 messageNo: 14 size 103 offset: -1
2025-11-03T16:51:28.293345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:28.293352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:28.293370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 8 partNo : 0 messageNo: 15 size 103 offset: -1
2025-11-03T16:51:28.293397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:28.293407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:28.293435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:28.293444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:28.293467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:28.293477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:28.293499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:28.293507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:28.293530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:28.293539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:28.293561Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-03T16:51:28.293664Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 1 partNo 0 count 2 size 314
2025-11-03T16:51:28.293746Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:51:28.293787Z node 2 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:51:28.293802Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:51:28.293818Z node 2 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:51:28.293829Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:51:28.293843Z node 2 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:51:28.293855Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:51:28.293872Z node 2 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:51:28.293886Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:51:28.293899Z node 2 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:51:28.294100Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:880: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 partno 0 count 1 size 1024000 endOffset 1 max time lag 0ms effective offset 0
2025-11-03T16:51:28.294332Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1105: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 162 count 1 last offset 0, current partition end offset: 1
2025-11-03T16:51:28.294372Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1121: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-11-03T16:51:28.294407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 16  requestId: <none> cookie: 9
2025-11-03T16:51:28.294446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 17  requestId: <none> cookie: 10
2025-11-03T16:51:28.294462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 18  requestId: <none> cookie: 11
2025-11-03T16:51:28.294479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 19  requestId: <none> cookie: 12
2025-11-03T16:51:28.294495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 20  requestId: <none> cookie: 13
2025-11-03T16:51:28.294575Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 0 partno 0 count 1 parts_count 0 source 1 size 162 accessed 0 times before, last time 2025-11-03T16:51:28.000000Z
2025-11-03T16:51:28.294613Z node 2 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 3. All 1 blobs are from cache.
2025-11-03T16:51:28.294692Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 0 suffix '63'
2025-11-03T16:51:28.295047Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:572: FormAnswer for 1 blobs
2025-11-03T16:51:28.295224Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 0 totakecount 1 count 1 size 142 from pos 0 cbcount 1
2025-11-03T16:51:28.295336Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1015: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1762188688212 queuesize 0 startOffset 0
2025-11-03T16:51:28.296229Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:28.296324Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:28.296368Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:28.296395Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:28.296420Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:28.296447Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:28.297052Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:51:28.297106Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:51:28.297138Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:51:28.297171Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:51:28.297206Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:51:28.298169Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write session got write response: sequence_numbers: 1 offsets: 0 already_written: false write_statistics { persist_duration_ms: 10 queued_in_partition_duration_ms: 9 }
2025-11-03T16:51:28.298228Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write session: acknoledged message 1
2025-11-03T16:51:28.298233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:28.298268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:28.298312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 9 partNo : 0 messageNo: 21 size 103 offset: -1
2025-11-03T16:51:28.298331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 10 partNo : 0 messageNo: 21 size 103 offset: -1
2025-11-03T16:51:28.298348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 11 partNo : 0 messageNo: 21 size 104 offset: -1
2025-11-03T16:51:28.298401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:28.298412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:28.298434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 12 partNo : 0 messageNo: 22 size 104 offset: -1
2025-11-03T16:51:28.298469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:28.298480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:28.298501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 13 partNo : 0 messageNo: 23 size 104 offset: -1
2025-11-03T16:51:28.298530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:28.298539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:28.298559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 14 partNo : 0 messageNo: 24 size 104 offset: -1
2025-11-03T16:51:28.298589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:28.298599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:28.298616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 15 partNo : 0 messageNo: 25 size 104 offset: -1
2025-11-03T16:51:28.298646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:28.298655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:28.298686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:28.298695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:28.298737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:28.298747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:28.298771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:28.298780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:28.298806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:28.298815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:28.298838Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:51:28.298895Z node 2 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:51:28.298910Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:51:28.298935Z node 2 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:51:28.298945Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:51:28.298959Z node 2 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:51:28.298970Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:51:28.298982Z node 2 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:51:28.298992Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:51:28.299006Z node 2 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:51:28.299073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 26  requestId: <none> cookie: 14
2025-11-03T16:51:28.299109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 27  requestId: <none> cookie: 15
2025-11-03T16:51:28.299124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 28  requestId: <none> cookie: 16
2025-11-03T16:51:28.299140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 29  requestId: <none> cookie: 17
2025-11-03T16:51:28.299153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 30  requestId: <none> cookie: 18
2025-11-03T16:51:28.300364Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:28.300432Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:28.300462Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:28.300490Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:28.300520Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:28.300737Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:51:28.300790Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:51:28.300821Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:51:28.300854Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:51:28.300888Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:51:28.301382Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 1 count 2 size 314 actorID [2:7568542780301270955:2382]
2025-11-03T16:51:28.301425Z node 2 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-03T16:51:28.301459Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 218 WriteNewSizeFromSupportivePartitions# 0
2025-11-03T16:51:28.301484Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:51:28.301506Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 2, partNo: 0, Offset: 1 is stored on disk
2025-11-03T16:51:28.301517Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:51:28.301529Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 3, partNo: 0, Offset: 2 is stored on disk
2025-11-03T16:51:28.301635Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:28.301641Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 1 partno 0 count 2 parts 0 suffix '63' size 314
2025-11-03T16:51:28.301680Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:28.301686Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (12)
2025-11-03T16:51:28.301747Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 4 partNo 0
2025-11-03T16:51:28.302729Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 4 partNo 0 FormedBlobsCount 0 NewHead: Offset 3 PartNo 0 PackedSize 177 count 1 nextOffset 4 batches 1
2025-11-03T16:51:28.302798Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 5 partNo 0
2025-11-03T16:51:28.302828Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 5 partNo 0 FormedBlobsCount 0 NewHead: Offset 3 PartNo 0 PackedSize 322 count 2 nextOffset 5 batches 1
2025-11-03T16:51:28.302845Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 6 partNo 0
2025-11-03T16:51:28.302867Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 6 partNo 0 FormedBlobsCount 0 NewHead: Offset 3 PartNo 0 PackedSize 467 count 3 nextOffset 6 batches 1
2025-11-03T16:51:28.302894Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 7 partNo 0
2025-11-03T16:51:28.302910Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 7 partNo 0 FormedBlobsCount 0 NewHead: Offset 3 PartNo 0 PackedSize 612 count 4 nextOffset 7 batches 1
2025-11-03T16:51:28.302927Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 8 partNo 0
2025-11-03T16:51:28.302949Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 8 partNo 0 FormedBlobsCount 0 NewHead: Offset 3 PartNo 0 PackedSize 757 count 5 nextOffset 8 batches 1
2025-11-03T16:51:28.302984Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 9 partNo 0
2025-11-03T16:51:28.303004Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 9 partNo 0 FormedBlobsCount 0 NewHead: Offset 3 PartNo 0 PackedSize 902 count 6 nextOffset 9 batches 1
2025-11-03T16:51:28.303022Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 10 partNo 0
2025-11-03T16:51:28.303039Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 10 partNo 0 FormedBlobsCount 0 NewHead: Offset 3 PartNo 0 PackedSize 1047 count 7 nextOffset 10 batches 1
2025-11-03T16:51:28.303060Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 11 partNo 0
2025-11-03T16:51:28.303078Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 11 partNo 0 FormedBlobsCount 0 NewHead: Offset 3 PartNo 0 PackedSize 1193 count 8 nextOffset 11 batches 1
2025-11-03T16:51:28.303099Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 12 partNo 0
2025-11-03T16:51:28.303124Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 12 partNo 0 FormedBlobsCount 0 NewHead: Offset 3 PartNo 0 PackedSize 1339 count 9 nextOffset 12 batches 1
2025-11-03T16:51:28.303145Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 13 partNo 0
2025-11-03T16:51:28.303166Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 13 partNo 0 FormedBlobsCount 0 NewHead: Offset 3 PartNo 0 PackedSize 1485 count 10 nextOffset 13 batches 1
2025-11-03T16:51:28.303185Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 14 partNo 0
2025-11-03T16:51:28.303208Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 14 partNo 0 FormedBlobsCount 0 NewHead: Offset 3 PartNo 0 PackedSize 1631 count 11 nextOffset 14 batches 1
2025-11-03T16:51:28.303230Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 15 partNo 0
2025-11-03T16:51:28.303252Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 15 partNo 0 FormedBlobsCount 0 NewHead: Offset 3 PartNo 0 PackedSize 1777 count 12 nextOffset 15 batches 1
2025-11-03T16:51:28.303269Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:28.303685Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 3,12 HeadOffset 3 endOffset 3 curOffset 15 d0000000000_00000000000000000003_00000_0000000012_00000? size 1441 WTime 1762188688303
2025-11-03T16:51:28.303803Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:51:28.303858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 3  requestId: <none> cookie: 2
2025-11-03T16:51:28.304123Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:28.304184Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:28.305106Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write session got write response: sequence_numbers: 2 offsets: 1 already_written: false write_statistics { persist_duration_ms: 8 queued_in_partition_duration_ms: 68 }
2025-11-03T16:51:28.305158Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write session: acknoledged message 2
2025-11-03T16:51:28.305559Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write session got write response: sequence_numbers: 3 offsets: 2 already_written: false write_statistics { persist_duration_ms: 8 queued_in_partition_duration_ms: 58 }
2025-11-03T16:51:28.305619Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write session: acknoledged message 3
2025-11-03T16:51:28.305945Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:28.306008Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:28.306037Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:28.306064Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:28.306091Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:28.306338Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:51:28.306387Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:51:28.306442Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:51:28.306473Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:51:28.306515Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:51:28.303908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 6  requestId: <none> cookie: 3
2025-11-03T16:51:28.303968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:28.304004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:28.304050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 16 partNo : 0 messageNo: 31 size 104 offset: -1
2025-11-03T16:51:28.304093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:28.304101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:28.304120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 17 partNo : 0 messageNo: 32 size 104 offset: -1
2025-11-03T16:51:28.304155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:28.304164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:28.304183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 33 size 104 offset: -1
2025-11-03T16:51:28.304210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:28.304218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:28.304234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 34 size 104 offset: -1
2025-11-03T16:51:28.304261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:28.304269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:28.304286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 35 size 104 offset: -1
2025-11-03T16:51:28.304312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:28.304321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:28.304348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:28.304359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:28.304384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:28.304400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:28.304423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:28.304431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:28.304461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:28.304470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:28.304494Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-03T16:51:28.304591Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 3 partNo 0 count 12 size 1441
2025-11-03T16:51:28.304623Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:51:28.304665Z node 2 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:51:28.304679Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:51:28.304694Z node 2 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:51:28.304706Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:51:28.304720Z node 2 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:51:28.304732Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:51:28.304751Z node 2 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:51:28.304762Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:51:28.304774Z node 2 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:51:28.304958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 36  requestId: <none> cookie: 19
2025-11-03T16:51:28.304997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 37  requestId: <none> cookie: 20
2025-11-03T16:51:28.305014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 38  requestId: <none> cookie: 21
2025-11-03T16:51:28.305029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 39  requestId: <none> cookie: 22
2025-11-03T16:51:28.305043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 40  requestId: <none> cookie: 23
2025-11-03T16:51:28.307553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:28.307580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:28.307635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 41 size 104 offset: -1
2025-11-03T16:51:28.307684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:28.307693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:28.307713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 42 size 104 offset: -1
2025-11-03T16:51:28.307756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:28.307765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:28.307781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 43 size 104 offset: -1
2025-11-03T16:51:28.307824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:28.307832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:28.307852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 44 size 104 offset: -1
2025-11-03T16:51:28.307869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 44 size 104 offset: -1
2025-11-03T16:51:28.307937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:28.307951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:28.307972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 45 size 104 offset: -1
2025-11-03T16:51:28.308015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:28.308023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:28.308053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:28.308062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:28.308085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:28.308097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:28.308133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:28.308142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:28.308165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:28.308175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:28.308206Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:51:28.308250Z node 2 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:51:28.308266Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:51:28.308278Z node 2 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:51:28.308289Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:51:28.308301Z node 2 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:51:28.308313Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:51:28.308332Z node 2 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:51:28.308343Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:51:28.308355Z node 2 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:51:28.308422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 46  requestId: <none> cookie: 24
2025-11-03T16:51:28.308445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 47  requestId: <none> cookie: 25
2025-11-03T16:51:28.308459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 48  requestId: <none> cookie: 26
2025-11-03T16:51:28.308473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 49  requestId: <none> cookie: 27
2025-11-03T16:51:28.308487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 50  requestId: <none> cookie: 28
2025-11-03T16:51:28.309791Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:28.309849Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:28.309878Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:28.309903Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:28.309934Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:28.310000Z node 2 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:51:28.310721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:28.310748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:28.310796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 51 size 104 offset: -1
2025-11-03T16:51:28.311097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:28.311126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:28.311150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 28 partNo : 0 messageNo: 52 size 104 offset: -1
2025-11-03T16:51:28.311171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 29 partNo : 0 messageNo: 52 size 104 offset: -1
2025-11-03T16:51:28.311195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 30 partNo : 0 messageNo: 52 size 104 offset: -1
2025-11-03T16:51:28.311210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 31 partNo : 0 messageNo: 52 size 104 offset: -1
2025-11-03T16:51:28.311227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 32 partNo : 0 messageNo: 52 size 104 offset: -1
2025-11-03T16:51:28.311242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 33 partNo : 0 messageNo: 52 size 104 offset: -1
2025-11-03T16:51:28.311256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 34 partNo : 0 messageNo: 52 size 105 offset: -1
2025-11-03T16:51:28.311270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 35 partNo : 0 messageNo: 52 size 105 offset: -1
2025-11-03T16:51:28.311288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 36 partNo : 0 messageNo: 52 size 105 offset: -1
2025-11-03T16:51:28.311302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 52 size 105 offset: -1
2025-11-03T16:51:28.311316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 52 size 105 offset: -1
2025-11-03T16:51:28.311330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 52 size 105 offset: -1
2025-11-03T16:51:28.311345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 52 size 105 offset: -1
2025-11-03T16:51:28.311361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 52 size 105 offset: -1
2025-11-03T16:51:28.311376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 52 size 106 offset: -1
2025-11-03T16:51:28.311392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 52 size 106 offset: -1
2025-11-03T16:51:28.311420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 52 size 106 offset: -1
2025-11-03T16:51:28.311441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 52 size 106 offset: -1
2025-11-03T16:51:28.311456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 52 size 106 offset: -1
2025-11-03T16:51:28.311471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 52 size 106 offset: -1
2025-11-03T16:51:28.311487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 52 size 106 offset: -1
2025-11-03T16:51:28.311504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 52 size 106 offset: -1
2025-11-03T16:51:28.311518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 52 size 106 offset: -1
2025-11-03T16:51:28.311533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 52 size 106 offset: -1
2025-11-03T16:51:28.311550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 52 size 106 offset: -1
2025-11-03T16:51:28.311566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 53 partNo : 0 messageNo: 52 size 106 offset: -1
2025-11-03T16:51:28.311580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 54 partNo : 0 messageNo: 52 size 106 offset: -1
2025-11-03T16:51:28.311595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 55 partNo : 0 messageNo: 52 size 106 offset: -1
2025-11-03T16:51:28.311608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 56 partNo : 0 messageNo: 52 size 106 offset: -1
2025-11-03T16:51:28.311622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 57 partNo : 0 messageNo: 52 size 106 offset: -1
2025-11-03T16:51:28.311636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 58 partNo : 0 messageNo: 52 size 106 offset: -1
2025-11-03T16:51:28.311653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 59 partNo : 0 messageNo: 52 size 106 offset: -1
2025-11-03T16:51:28.311675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 60 partNo : 0 messageNo: 52 size 106 offset: -1
2025-11-03T16:51:28.311689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 61 partNo : 0 messageNo: 52 size 106 offset: -1
2025-11-03T16:51:28.311704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 62 partNo : 0 messageNo: 52 size 106 offset: -1
2025-11-03T16:51:28.311722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 63 partNo : 0 messageNo: 52 size 106 offset: -1
2025-11-03T16:51:28.311738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 64 partNo : 0 messageNo: 52 size 106 offset: -1
2025-11-03T16:51:28.311758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 65 partNo : 0 messageNo: 52 size 106 offset: -1
2025-11-03T16:51:28.311774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 66 partNo : 0 messageNo: 52 size 107 offset: -1
2025-11-03T16:51:28.311790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 67 partNo : 0 messageNo: 52 size 107 offset: -1
2025-11-03T16:51:28.311810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 68 partNo : 0 messageNo: 52 size 107 offset: -1
2025-11-03T16:51:28.311896Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:51:28.311939Z node 2 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:51:28.311996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:28.312008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:28.312031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 69 partNo : 0 messageNo: 53 size 107 offset: -1
2025-11-03T16:51:28.312126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:28.312136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:28.312154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 70 partNo : 0 messageNo: 54 size 107 offset: -1
2025-11-03T16:51:28.312169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 71 partNo : 0 messageNo: 54 size 107 offset: -1
2025-11-03T16:51:28.312184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 72 partNo : 0 messageNo: 54 size 107 offset: -1
2025-11-03T16:51:28.312199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 73 partNo : 0 messageNo: 54 size 107 offset: -1
2025-11-03T16:51:28.312215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 74 partNo : 0 messageNo: 54 size 107 offset: -1
2025-11-03T16:51:28.312229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 75 partNo : 0 messageNo: 54 size 107 offset: -1
2025-11-03T16:51:28.312244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 76 partNo : 0 messageNo: 54 size 107 offset: -1
2025-11-03T16:51:28.312261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 77 partNo : 0 messageNo: 54 size 107 offset: -1
2025-11-03T16:51:28.312279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 78 partNo : 0 messageNo: 54 size 107 offset: -1
2025-11-03T16:51:28.312295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 79 partNo : 0 messageNo: 54 size 107 offset: -1
2025-11-03T16:51:28.312308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 80 partNo : 0 messageNo: 54 size 107 offset: -1
2025-11-03T16:51:28.312322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 81 partNo : 0 messageNo: 54 size 107 offset: -1
2025-11-03T16:51:28.312334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 82 partNo : 0 messageNo: 54 size 108 offset: -1
2025-11-03T16:51:28.312350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 83 partNo : 0 messageNo: 54 size 108 offset: -1
2025-11-03T16:51:28.312363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 84 partNo : 0 messageNo: 54 size 108 offset: -1
2025-11-03T16:51:28.312484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:28.312493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:28.312511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 85 partNo : 0 messageNo: 55 size 108 offset: -1
2025-11-03T16:51:28.312529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 86 partNo : 0 messageNo: 55 size 108 offset: -1
2025-11-03T16:51:28.312546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 87 partNo : 0 messageNo: 55 size 108 offset: -1
2025-11-03T16:51:28.312562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 88 partNo : 0 messageNo: 55 size 108 offset: -1
2025-11-03T16:51:28.312580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 89 partNo : 0 messageNo: 55 size 108 offset: -1
2025-11-03T16:51:28.312594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 90 partNo : 0 messageNo: 55 size 108 offset: -1
2025-11-03T16:51:28.312608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 91 partNo : 0 messageNo: 55 size 108 offset: -1
2025-11-03T16:51:28.312622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 92 partNo : 0 messageNo: 55 size 108 offset: -1
2025-11-03T16:51:28.312638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 93 partNo : 0 messageNo: 55 size 108 offset: -1
2025-11-03T16:51:28.312655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 94 partNo : 0 messageNo: 55 size 108 offset: -1
2025-11-03T16:51:28.312670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 95 partNo : 0 messageNo: 55 size 108 offset: -1
2025-11-03T16:51:28.312684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 96 partNo : 0 messageNo: 55 size 108 offset: -1
2025-11-03T16:51:28.312699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 97 partNo : 0 messageNo: 55 size 108 offset: -1
2025-11-03T16:51:28.312713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 98 partNo : 0 messageNo: 55 size 108 offset: -1
2025-11-03T16:51:28.312729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 99 partNo : 0 messageNo: 55 size 109 offset: -1
2025-11-03T16:51:28.312742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 100 partNo : 0 messageNo: 55 size 109 offset: -1
2025-11-03T16:51:28.312785Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:51:28.312954Z node 2 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:51:28.312979Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:51:28.312995Z node 2 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:51:28.313006Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:51:28.313061Z node 2 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:51:28.313224Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:51:28.313289Z node 2 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:51:28.313337Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 3 count 12 size 1441 actorID [2:7568542780301270955:2382]
2025-11-03T16:51:28.313386Z node 2 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-03T16:51:28.313429Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1325 WriteNewSizeFromSupportivePartitions# 0
2025-11-03T16:51:28.313442Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 3 partno 0 count 12 parts 0 suffix '63' size 1441
2025-11-03T16:51:28.313460Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:51:28.313499Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 4, partNo: 0, Offset: 3 is stored on disk
2025-11-03T16:51:28.313513Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:51:28.313529Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 5, partNo: 0, Offset: 4 is stored on disk
2025-11-03T16:51:28.313538Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:51:28.313553Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 6, partNo: 0, Offset: 5 is stored on disk
2025-11-03T16:51:28.313565Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:51:28.313581Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 7, partNo: 0, Offset: 6 is stored on disk
2025-11-03T16:51:28.313591Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:51:28.313616Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 8, partNo: 0, Offset: 7 is stored on disk
2025-11-03T16:51:28.313627Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:51:28.313642Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 9, partNo: 0, Offset: 8 is stored on disk
2025-11-03T16:51:28.313653Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:51:28.313669Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 10, partNo: 0, Offset: 9 is stored on disk
2025-11-03T16:51:28.313680Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:51:28.313696Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 11, partNo: 0, Offset: 10 is stored on disk
2025-11-03T16:51:28.313705Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:51:28.313719Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 12, partNo: 0, Offset: 11 is stored on disk
2025-11-03T16:51:28.313729Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:51:28.313760Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 13, partNo: 0, Offset: 12 is stored on disk
2025-11-03T16:51:28.313770Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:51:28.313786Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 14, partNo: 0, Offset: 13 is stored on disk
2025-11-03T16:51:28.313798Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:51:28.313813Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 15, partNo: 0, Offset: 14 is stored on disk
2025-11-03T16:51:28.313958Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:28.314164Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:28.314176Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (85)
2025-11-03T16:51:28.314267Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 16 partNo 0
2025-11-03T16:51:28.315069Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 16 partNo 0 FormedBlobsCount 0 NewHead: Offset 15 PartNo 0 PackedSize 178 count 1 nextOffset 16 batches 1
2025-11-03T16:51:28.315107Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 17 partNo 0
2025-11-03T16:51:28.315128Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 17 partNo 0 FormedBlobsCount 0 NewHead: Offset 15 PartNo 0 PackedSize 324 count 2 nextOffset 17 batches 1
2025-11-03T16:51:28.315142Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-11-03T16:51:28.315157Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 0 FormedBlobsCount 0 NewHead: Offset 15 PartNo 0 PackedSize 470 count 3 nextOffset 18 batches 1
2025-11-03T16:51:28.315173Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-11-03T16:51:28.315187Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 0 FormedBlobsCount 0 NewHead: Offset 15 PartNo 0 PackedSize 616 count 4 nextOffset 19 batches 1
2025-11-03T16:51:28.315198Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-11-03T16:51:28.315212Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 0 FormedBlobsCount 0 NewHead: Offset 15 PartNo 0 PackedSize 762 count 5 nextOffset 20 batches 1
2025-11-03T16:51:28.315225Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-11-03T16:51:28.315238Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 0 FormedBlobsCount 0 NewHead: Offset 15 PartNo 0 PackedSize 908 count 6 nextOffset 21 batches 1
2025-11-03T16:51:28.315249Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-11-03T16:51:28.315263Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 0 FormedBlobsCount 0 NewHead: Offset 15 PartNo 0 PackedSize 1054 count 7 nextOffset 22 batches 1
2025-11-03T16:51:28.315275Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-11-03T16:51:28.315288Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 0 FormedBlobsCount 0 NewHead: Offset 15 PartNo 0 PackedSize 1200 count 8 nextOffset 23 batches 1
2025-11-03T16:51:28.315301Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-11-03T16:51:28.315317Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 0 FormedBlobsCount 0 NewHead: Offset 15 PartNo 0 PackedSize 1346 count 9 nextOffset 24 batches 1
2025-11-03T16:51:28.315329Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-11-03T16:51:28.315341Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 0 FormedBlobsCount 0 NewHead: Offset 15 PartNo 0 PackedSize 1492 count 10 nextOffset 25 batches 1
2025-11-03T16:51:28.315352Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-11-03T16:51:28.315363Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 0 FormedBlobsCount 0 NewHead: Offset 15 PartNo 0 PackedSize 1638 count 11 nextOffset 26 batches 1
2025-11-03T16:51:28.315374Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-11-03T16:51:28.315386Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 0 FormedBlobsCount 0 NewHead: Offset 15 PartNo 0 PackedSize 1784 count 12 nextOffset 27 batches 1
2025-11-03T16:51:28.315397Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 28 partNo 0
2025-11-03T16:51:28.315408Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 28 partNo 0 FormedBlobsCount 0 NewHead: Offset 15 PartNo 0 PackedSize 1930 count 13 nextOffset 28 batches 1
2025-11-03T16:51:28.315419Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 29 partNo 0
2025-11-03T16:51:28.315430Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 29 partNo 0 FormedBlobsCount 0 NewHead: Offset 15 PartNo 0 PackedSize 2076 count 14 nextOffset 29 batches 1
2025-11-03T16:51:28.315440Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 30 partNo 0
2025-11-03T16:51:28.315452Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 30 partNo 0 FormedBlobsCount 0 NewHead: Offset 15 PartNo 0 PackedSize 2222 count 15 nextOffset 30 batches 1
2025-11-03T16:51:28.315465Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 31 partNo 0
2025-11-03T16:51:28.315477Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 31 partNo 0 FormedBlobsCount 0 NewHead: Offset 15 PartNo 0 PackedSize 2368 count 16 nextOffset 31 batches 1
2025-11-03T16:51:28.315489Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 32 partNo 0
2025-11-03T16:51:28.315502Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 32 partNo 0 FormedBlobsCount 0 NewHead: Offset 15 PartNo 0 PackedSize 2514 count 17 nextOffset 32 batches 1
2025-11-03T16:51:28.315513Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 33 partNo 0
2025-11-03T16:51:28.315525Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 33 partNo 0 FormedBlobsCount 0 NewHead: Offset 15 PartNo 0 PackedSize 2660 count 18 nextOffset 33 batches 1
2025-11-03T16:51:28.315535Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 34 partNo 0
2025-11-03T16:51:28.315546Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 34 partNo 0 FormedBlobsCount 0 NewHead: Offset 15 PartNo 0 PackedSize 2807 count 19 nextOffset 34 batches 1
2025-11-03T16:51:28.315558Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 35 partNo 0
2025-11-03T16:51:28.315569Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 35 partNo 0 FormedBlobsCount 0 NewHead: Offset 15 PartNo 0 PackedSize 2954 count 20 nextOffset 35 batches 1
2025-11-03T16:51:28.315580Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 36 partNo 0
2025-11-03T16:51:28.315592Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 36 partNo 0 FormedBlobsCount 0 NewHead: Offset 15 PartNo 0 PackedSize 3101 count 21 nextOffset 36 batches 1
2025-11-03T16:51:28.315603Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 37 partNo 0
2025-11-03T16:51:28.315613Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 37 partNo 0 FormedBlobsCount 0 NewHead: Offset 15 PartNo 0 PackedSize 3248 count 22 nextOffset 37 batches 1
2025-11-03T16:51:28.315622Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 38 partNo 0
2025-11-03T16:51:28.315632Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 38 partNo 0 FormedBlobsCount 0 NewHead: Offset 15 PartNo 0 PackedSize 3395 count 23 nextOffset 38 batches 1
2025-11-03T16:51:28.315643Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 39 partNo 0
2025-11-03T16:51:28.315689Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 39 partNo 0 FormedBlobsCount 0 NewHead: Offset 15 PartNo 0 PackedSize 3542 count 24 nextOffset 39 batches 1
2025-11-03T16:51:28.315701Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 40 partNo 0
2025-11-03T16:51:28.315712Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 40 partNo 0 FormedBlobsCount 0 NewHead: Offset 15 PartNo 0 PackedSize 3689 count 25 nextOffset 40 batches 1
2025-11-03T16:51:28.315722Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 41 partNo 0
2025-11-03T16:51:28.315734Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 41 partNo 0 FormedBlobsCount 0 NewHead: Offset 15 PartNo 0 PackedSize 3836 count 26 nextOffset 41 batches 1
2025-11-03T16:51:28.315742Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 42 partNo 0
2025-11-03T16:51:28.315753Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 42 partNo 0 FormedBlobsCount 0 NewHead: Offset 15 PartNo 0 PackedSize 3984 count 27 nextOffset 42 batches 1
2025-11-03T16:51:28.315762Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 43 partNo 0
2025-11-03T16:51:28.315772Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 43 partNo 0 FormedBlobsCount 0 NewHead: Offset 15 PartNo 0 PackedSize 4132 count 28 nextOffset 43 batches 1
2025-11-03T16:51:28.315782Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 44 partNo 0
2025-11-03T16:51:28.315794Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 44 partNo 0 FormedBlobsCount 0 NewHead: Offset 15 PartNo 0 PackedSize 4280 count 29 nextOffset 44 batches 1
2025-11-03T16:51:28.315805Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 45 partNo 0
2025-11-03T16:51:28.315816Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 45 partNo 0 FormedBlobsCount 0 NewHead: Offset 15 PartNo 0 PackedSize 4428 count 30 nextOffset 45 batches 1
2025-11-03T16:51:28.315825Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 0
2025-11-03T16:51:28.315836Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 46 partNo 0 FormedBlobsCount 0 NewHead: Offset 15 PartNo 0 PackedSize 4576 count 31 nextOffset 46 batches 1
2025-11-03T16:51:28.315848Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 0
2025-11-03T16:51:28.315859Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 47 partNo 0 FormedBlobsCount 0 NewHead: Offset 15 PartNo 0 PackedSize 4724 count 32 nextOffset 47 batches 1
2025-11-03T16:51:28.315869Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 0
2025-11-03T16:51:28.315920Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 48 partNo 0 FormedBlobsCount 0 NewHead: Offset 15 PartNo 0 PackedSize 4872 count 33 nextOffset 48 batches 1
2025-11-03T16:51:28.315937Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 49 partNo 0
2025-11-03T16:51:28.315949Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 49 partNo 0 FormedBlobsCount 0 NewHead: Offset 15 PartNo 0 PackedSize 5020 count 34 nextOffset 49 batches 1
2025-11-03T16:51:28.315959Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 50 partNo 0
2025-11-03T16:51:28.315971Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 50 partNo 0 FormedBlobsCount 0 NewHead: Offset 15 PartNo 0 PackedSize 5168 count 35 nextOffset 50 batches 1
2025-11-03T16:51:28.315993Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 51 partNo 0
2025-11-03T16:51:28.316007Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 51 partNo 0 FormedBlobsCount 0 NewHead: Offset 15 PartNo 0 PackedSize 5316 count 36 nextOffset 51 batches 1
2025-11-03T16:51:28.316017Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 52 partNo 0
2025-11-03T16:51:28.316029Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 52 partNo 0 FormedBlobsCount 0 NewHead: Offset 15 PartNo 0 PackedSize 5464 count 37 nextOffset 52 batches 1
2025-11-03T16:51:28.316041Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 53 partNo 0
2025-11-03T16:51:28.316058Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 53 partNo 0 FormedBlobsCount 0 NewHead: Offset 15 PartNo 0 PackedSize 5612 count 38 nextOffset 53 batches 1
2025-11-03T16:51:28.316073Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 54 partNo 0
2025-11-03T16:51:28.316084Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 54 partNo 0 FormedBlobsCount 0 NewHead: Offset 15 PartNo 0 PackedSize 5760 count 39 nextOffset 54 batches 1
2025-11-03T16:51:28.316096Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 55 partNo 0
2025-11-03T16:51:28.316107Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 55 partNo 0 FormedBlobsCount 0 NewHead: Offset 15 PartNo 0 PackedSize 5908 count 40 nextOffset 55 batches 1
2025-11-03T16:51:28.316118Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 56 partNo 0
2025-11-03T16:51:28.316129Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 56 partNo 0 FormedBlobsCount 0 NewHead: Offset 15 PartNo 0 PackedSize 6056 count 41 nextOffset 56 batches 1
2025-11-03T16:51:28.316147Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 57 partNo 0
2025-11-03T16:51:28.316160Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 57 partNo 0 FormedBlobsCount 0 NewHead: Offset 15 PartNo 0 PackedSize 6204 count 42 nextOffset 57 batches 1
2025-11-03T16:51:28.316169Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 58 partNo 0
2025-11-03T16:51:28.316180Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 58 partNo 0 FormedBlobsCount 0 NewHead: Offset 15 PartNo 0 PackedSize 6352 count 43 nextOffset 58 batches 1
2025-11-03T16:51:28.316190Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 59 partNo 0
2025-11-03T16:51:28.316201Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 59 partNo 0 FormedBlobsCount 0 NewHead: Offset 15 PartNo 0 PackedSize 6500 count 44 nextOffset 59 batches 1
2025-11-03T16:51:28.316210Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 60 partNo 0
2025-11-03T16:51:28.316221Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 60 partNo 0 FormedBlobsCount 0 NewHead: Offset 15 PartNo 0 PackedSize 6648 count 45 nextOffset 60 batches 1
2025-11-03T16:51:28.316235Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 61 partNo 0
2025-11-03T16:51:28.316250Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 61 partNo 0 FormedBlobsCount 0 NewHead: Offset 15 PartNo 0 PackedSize 6796 count 46 nextOffset 61 batches 1
2025-11-03T16:51:28.316260Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 62 partNo 0
2025-11-03T16:51:28.316272Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 62 partNo 0 FormedBlobsCount 0 NewHead: Offset 15 PartNo 0 PackedSize 6944 count 47 nextOffset 62 batches 1
2025-11-03T16:51:28.316284Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 63 partNo 0
2025-11-03T16:51:28.316294Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 63 partNo 0 FormedBlobsCount 0 NewHead: Offset 15 PartNo 0 PackedSize 7092 count 48 nextOffset 63 batches 1
2025-11-03T16:51:28.316305Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 64 partNo 0
2025-11-03T16:51:28.316316Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 64 partNo 0 FormedBlobsCount 0 NewHead: Offset 15 PartNo 0 PackedSize 7240 count 49 nextOffset 64 batches 1
2025-11-03T16:51:28.316326Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 65 partNo 0
2025-11-03T16:51:28.316337Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 65 partNo 0 FormedBlobsCount 0 NewHead: Offset 15 PartNo 0 PackedSize 7388 count 50 nextOffset 65 batches 1
2025-11-03T16:51:28.316347Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 66 partNo 0
2025-11-03T16:51:28.316358Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 66 partNo 0 FormedBlobsCount 0 NewHead: Offset 15 PartNo 0 PackedSize 7537 count 51 nextOffset 66 batches 1
2025-11-03T16:51:28.316368Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 67 partNo 0
2025-11-03T16:51:28.316379Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 67 partNo 0 FormedBlobsCount 0 NewHead: Offset 15 PartNo 0 PackedSize 7686 count 52 nextOffset 67 batches 1
2025-11-03T16:51:28.316389Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 68 partNo 0
2025-11-03T16:51:28.316401Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 68 partNo 0 FormedBlobsCount 0 NewHead: Offset 15 PartNo 0 PackedSize 7835 count 53 nextOffset 68 batches 1
2025-11-03T16:51:28.316412Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 69 partNo 0
2025-11-03T16:51:28.316423Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 69 partNo 0 FormedBlobsCount 0 NewHead: Offset 15 PartNo 0 PackedSize 7984 count 54 nextOffset 69 batches 1
2025-11-03T16:51:28.316433Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 70 partNo 0
2025-11-03T16:51:28.316444Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 70 partNo 0 FormedBlobsCount 0 NewHead: Offset 15 PartNo 0 PackedSize 8133 count 55 nextOffset 70 batches 1
2025-11-03T16:51:28.316455Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 71 partNo 0
2025-11-03T16:51:28.316468Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 71 partNo 0 FormedBlobsCount 0 NewHead: Offset 15 PartNo 0 PackedSize 8282 count 56 nextOffset 71 batches 1
2025-11-03T16:51:28.316478Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 72 partNo 0
2025-11-03T16:51:28.316489Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 72 partNo 0 FormedBlobsCount 0 NewHead: Offset 15 PartNo 0 PackedSize 8431 count 57 nextOffset 72 batches 1
2025-11-03T16:51:28.316500Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 73 partNo 0
2025-11-03T16:51:28.316520Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 73 partNo 0 FormedBlobsCount 0 NewHead: Offset 15 PartNo 0 PackedSize 8580 count 58 nextOffset 73 batches 1
2025-11-03T16:51:28.316531Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 74 partNo 0
2025-11-03T16:51:28.316542Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 74 partNo 0 FormedBlobsCount 0 NewHead: Offset 15 PartNo 0 PackedSize 8729 count 59 nextOffset 74 batches 1
2025-11-03T16:51:28.316552Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 75 partNo 0
2025-11-03T16:51:28.316565Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 75 partNo 0 FormedBlobsCount 0 NewHead: Offset 15 PartNo 0 PackedSize 8878 count 60 nextOffset 75 batches 1
2025-11-03T16:51:28.316576Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 76 partNo 0
2025-11-03T16:51:28.316588Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 76 partNo 0 FormedBlobsCount 0 NewHead: Offset 15 PartNo 0 PackedSize 9027 count 61 nextOffset 76 batches 1
2025-11-03T16:51:28.316600Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 77 partNo 0
2025-11-03T16:51:28.316612Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 77 partNo 0 FormedBlobsCount 0 NewHead: Offset 15 PartNo 0 PackedSize 9176 count 62 nextOffset 77 batches 1
2025-11-03T16:51:28.316622Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 78 partNo 0
2025-11-03T16:51:28.316634Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 78 partNo 0 FormedBlobsCount 0 NewHead: Offset 15 PartNo 0 PackedSize 9325 count 63 nextOffset 78 batches 1
2025-11-03T16:51:28.316648Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 79 partNo 0
2025-11-03T16:51:28.316664Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 79 partNo 0 FormedBlobsCount 0 NewHead: Offset 15 PartNo 0 PackedSize 9474 count 64 nextOffset 79 batches 1
2025-11-03T16:51:28.316683Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 80 partNo 0
2025-11-03T16:51:28.316712Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 80 partNo 0 FormedBlobsCount 0 NewHead: Offset 15 PartNo 0 PackedSize 9623 count 65 nextOffset 80 batches 1
2025-11-03T16:51:28.316731Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 81 partNo 0
2025-11-03T16:51:28.316751Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 81 partNo 0 FormedBlobsCount 0 NewHead: Offset 15 PartNo 0 PackedSize 9772 count 66 nextOffset 81 batches 1
2025-11-03T16:51:28.316768Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 82 partNo 0
2025-11-03T16:51:28.316786Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 82 partNo 0 FormedBlobsCount 0 NewHead: Offset 15 PartNo 0 PackedSize 9922 count 67 nextOffset 82 batches 1
2025-11-03T16:51:28.316805Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 83 partNo 0
2025-11-03T16:51:28.316823Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 83 partNo 0 FormedBlobsCount 0 NewHead: Offset 15 PartNo 0 PackedSize 10072 count 68 nextOffset 83 batches 1
2025-11-03T16:51:28.316843Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 84 partNo 0
2025-11-03T16:51:28.316863Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 84 partNo 0 FormedBlobsCount 0 NewHead: Offset 15 PartNo 0 PackedSize 10222 count 69 nextOffset 84 batches 1
2025-11-03T16:51:28.316881Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 85 partNo 0
2025-11-03T16:51:28.316901Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 85 partNo 0 FormedBlobsCount 0 NewHead: Offset 15 PartNo 0 PackedSize 10372 count 70 nextOffset 85 batches 1
2025-11-03T16:51:28.316933Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 86 partNo 0
2025-11-03T16:51:28.316951Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 86 partNo 0 FormedBlobsCount 0 NewHead: Offset 15 PartNo 0 PackedSize 10522 count 71 nextOffset 86 batches 1
2025-11-03T16:51:28.316970Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 87 partNo 0
2025-11-03T16:51:28.316987Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 87 partNo 0 FormedBlobsCount 0 NewHead: Offset 15 PartNo 0 PackedSize 10672 count 72 nextOffset 87 batches 1
2025-11-03T16:51:28.317006Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 88 partNo 0
2025-11-03T16:51:28.317027Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 88 partNo 0 FormedBlobsCount 0 NewHead: Offset 15 PartNo 0 PackedSize 10822 count 73 nextOffset 88 batches 1
2025-11-03T16:51:28.317046Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 89 partNo 0
2025-11-03T16:51:28.317065Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 89 partNo 0 FormedBlobsCount 0 NewHead: Offset 15 PartNo 0 PackedSize 10972 count 74 nextOffset 89 batches 1
2025-11-03T16:51:28.317081Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 90 partNo 0
2025-11-03T16:51:28.317097Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 90 partNo 0 FormedBlobsCount 0 NewHead: Offset 15 PartNo 0 PackedSize 11122 count 75 nextOffset 90 batches 1
2025-11-03T16:51:28.317116Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 91 partNo 0
2025-11-03T16:51:28.317134Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 91 partNo 0 FormedBlobsCount 0 NewHead: Offset 15 PartNo 0 PackedSize 11272 count 76 nextOffset 91 batches 1
2025-11-03T16:51:28.317152Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 92 partNo 0
2025-11-03T16:51:28.317169Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 92 partNo 0 FormedBlobsCount 0 NewHead: Offset 15 PartNo 0 PackedSize 11422 count 77 nextOffset 92 batches 1
2025-11-03T16:51:28.317189Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 93 partNo 0
2025-11-03T16:51:28.317207Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 93 partNo 0 FormedBlobsCount 0 NewHead: Offset 15 PartNo 0 PackedSize 11572 count 78 nextOffset 93 batches 1
2025-11-03T16:51:28.317223Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 94 partNo 0
2025-11-03T16:51:28.317240Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 94 partNo 0 FormedBlobsCount 0 NewHead: Offset 15 PartNo 0 PackedSize 11722 count 79 nextOffset 94 batches 1
2025-11-03T16:51:28.317258Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 95 partNo 0
2025-11-03T16:51:28.317288Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 95 partNo 0 FormedBlobsCount 0 NewHead: Offset 15 PartNo 0 PackedSize 11872 count 80 nextOffset 95 batches 1
2025-11-03T16:51:28.317305Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 96 partNo 0
2025-11-03T16:51:28.317324Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 96 partNo 0 FormedBlobsCount 0 NewHead: Offset 15 PartNo 0 PackedSize 12022 count 81 nextOffset 96 batches 1
2025-11-03T16:51:28.317341Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 97 partNo 0
2025-11-03T16:51:28.317360Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 97 partNo 0 FormedBlobsCount 0 NewHead: Offset 15 PartNo 0 PackedSize 12172 count 82 nextOffset 97 batches 1
2025-11-03T16:51:28.317377Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 98 partNo 0
2025-11-03T16:51:28.317396Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 98 partNo 0 FormedBlobsCount 0 NewHead: Offset 15 PartNo 0 PackedSize 12322 count 83 nextOffset 98 batches 1
2025-11-03T16:51:28.317416Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 99 partNo 0
2025-11-03T16:51:28.317434Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 99 partNo 0 FormedBlobsCount 0 NewHead: Offset 15 PartNo 0 PackedSize 12473 count 84 nextOffset 99 batches 1
2025-11-03T16:51:28.317452Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 100 partNo 0
2025-11-03T16:51:28.317472Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 100 partNo 0 FormedBlobsCount 0 NewHead: Offset 15 PartNo 0 PackedSize 12624 count 85 nextOffset 100 batches 1
2025-11-03T16:51:28.317488Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:28.318223Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 15,85 HeadOffset 15 endOffset 15 curOffset 100 d0000000000_00000000000000000015_00000_0000000085_00000? size 9964 WTime 1762188688317
2025-11-03T16:51:28.318350Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:51:28.318408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 11  requestId: <none> cookie: 4
2025-11-03T16:51:28.318477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 12  requestId: <none> cookie: 5
2025-11-03T16:51:28.318501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 13  requestId: <none> cookie: 6
2025-11-03T16:51:28.318520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 14  requestId: <none> cookie: 7
2025-11-03T16:51:28.318540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 15  requestId: <none> cookie: 8
2025-11-03T16:51:28.318575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 21  requestId: <none> cookie: 9
2025-11-03T16:51:28.318595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 22  requestId: <none> cookie: 10
2025-11-03T16:51:28.318614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 23  requestId: <none> cookie: 11
2025-11-03T16:51:28.318632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 24  requestId: <none> cookie: 12
2025-11-03T16:51:28.318652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 25  requestId: <none> cookie: 13
2025-11-03T16:51:28.318679Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-03T16:51:28.318806Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 15 partNo 0 count 85 size 9964
2025-11-03T16:51:28.323633Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:28.323700Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:28.323723Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:28.323746Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:28.323764Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:28.323784Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:28.323817Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:28.323841Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:28.323860Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:28.323879Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:28.325936Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write session got write response: sequence_numbers: 4 offsets: 3 already_written: false write_statistics { persist_duration_ms: 10 queued_in_partition_duration_ms: 8 }
2025-11-03T16:51:28.326004Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write session: acknoledged message 4
2025-11-03T16:51:28.326258Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write session got write response: sequence_numbers: 5 offsets: 4 already_written: false write_statistics { persist_duration_ms: 10 queued_in_partition_duration_ms: 8 }
2025-11-03T16:51:28.326293Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write session: acknoledged message 5
2025-11-03T16:51:28.326446Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write session got write response: sequence_numbers: 6 offsets: 5 already_written: false write_statistics { persist_duration_ms: 10 queued_in_partition_duration_ms: 8 }
2025-11-03T16:51:28.326474Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write session: acknoledged message 6
2025-11-03T16:51:28.326629Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write session got write response: sequence_numbers: 7 offsets: 6 already_written: false write_statistics { persist_duration_ms: 10 queued_in_partition_duration_ms: 8 }
2025-11-03T16:51:28.326675Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write session: acknoledged message 7
2025-11-03T16:51:28.326866Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write session got write response: sequence_numbers: 8 offsets: 7 already_written: false write_statistics { persist_duration_ms: 10 queued_in_partition_duration_ms: 8 }
2025-11-03T16:51:28.326896Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write session: acknoledged message 8
2025-11-03T16:51:28.327084Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write session got write response: sequence_numbers: 9 sequence_numbers: 10 sequence_numbers: 11 offsets: 8 offsets: 9 offsets: 10 already_written: false already_written: false already_written: false write_statistics { persist_duration_ms: 10 queued_in_partition_duration_ms: 3 }
2025-11-03T16:51:28.327120Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write session: acknoledged message 9
2025-11-03T16:51:28.327155Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write session: acknoledged message 10
2025-11-03T16:51:28.327182Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write session: acknoledged message 11
2025-11-03T16:51:28.327362Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write session got write response: sequence_numbers: 12 offsets: 11 already_written: false write_statistics { persist_duration_ms: 10 queued_in_partition_duration_ms: 3 }
2025-11-03T16:51:28.327389Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write session: acknoledged message 12
2025-11-03T16:51:28.327536Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write session got write response: sequence_numbers: 13 offsets: 12 already_written: false write_statistics { persist_duration_ms: 10 queued_in_partition_duration_ms: 3 }
2025-11-03T16:51:28.327570Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write session: acknoledged message 13
2025-11-03T16:51:28.327725Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write session got write response: sequence_numbers: 14 offsets: 13 already_written: false write_statistics { persist_duration_ms: 10 queued_in_partition_duration_ms: 3 }
2025-11-03T16:51:28.327747Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write session: acknoledged message 14
2025-11-03T16:51:28.327898Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write session got write response: sequence_numbers: 15 offsets: 14 already_written: false write_statistics { persist_duration_ms: 10 queued_in_partition_duration_ms: 3 }
2025-11-03T16:51:28.327928Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write session: acknoledged message 15
2025-11-03T16:51:28.330017Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 15 count 85 size 9964 actorID [2:7568542780301270955:2382]
2025-11-03T16:51:28.330117Z node 2 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-03T16:51:28.330163Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 9617 WriteNewSizeFromSupportivePartitions# 0
2025-11-03T16:51:28.330201Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:51:28.330232Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 16, partNo: 0, Offset: 15 is stored on disk
2025-11-03T16:51:28.330249Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:51:28.330265Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 17, partNo: 0, Offset: 16 is stored on disk
2025-11-03T16:51:28.330274Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:51:28.330289Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 18, partNo: 0, Offset: 17 is stored on disk
2025-11-03T16:51:28.330396Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:51:28.330421Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 19, partNo: 0, Offset: 18 is stored on disk
2025-11-03T16:51:28.330433Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:51:28.330450Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 20, partNo: 0, Offset: 19 is stored on disk
2025-11-03T16:51:28.330462Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:51:28.330479Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 21, partNo: 0, Offset: 20 is stored on disk
2025-11-03T16:51:28.330489Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:51:28.330505Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 22, partNo: 0, Offset: 21 is stored on disk
2025-11-03T16:51:28.330516Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:51:28.330530Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 23, partNo: 0, Offset: 22 is stored on disk
2025-11-03T16:51:28.330539Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:51:28.330558Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 24, partNo: 0, Offset: 23 is stored on disk
2025-11-03T16:51:28.330569Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:51:28.330584Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 25, partNo: 0, Offset: 24 is stored on disk
2025-11-03T16:51:28.330593Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:51:28.330611Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 26, partNo: 0, Offset: 25 is stored on disk
2025-11-03T16:51:28.330628Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:51:28.330643Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 27, partNo: 0, Offset: 26 is stored on disk
2025-11-03T16:51:28.330655Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:51:28.330678Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 28, partNo: 0, Offset: 27 is stored on disk
2025-11-03T16:51:28.330689Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:51:28.330723Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 29, partNo: 0, Offset: 28 is stored on disk
2025-11-03T16:51:28.330735Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:51:28.330751Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 30, partNo: 0, Offset: 29 is stored on disk
2025-11-03T16:51:28.330762Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:51:28.330776Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 31, partNo: 0, Offset: 30 is stored on disk
2025-11-03T16:51:28.330788Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:51:28.330803Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 32, partNo: 0, Offset: 31 is stored on disk
2025-11-03T16:51:28.330813Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:51:28.330832Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 33, partNo: 0, Offset: 32 is stored on disk
2025-11-03T16:51:28.330842Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:51:28.330857Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 34, partNo: 0, Offset: 33 is stored on disk
2025-11-03T16:51:28.330868Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:51:28.330882Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 35, partNo: 0, Offset: 34 is stored on disk
2025-11-03T16:51:28.330892Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:51:28.330908Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 36, partNo: 0, Offset: 35 is stored on disk
2025-11-03T16:51:28.330921Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:51:28.330943Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 37, partNo: 0, Offset: 36 is stored on disk
2025-11-03T16:51:28.330954Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:51:28.330969Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 38, partNo: 0, Offset: 37 is stored on disk
2025-11-03T16:51:28.330980Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:51:28.330995Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 39, partNo: 0, Offset: 38 is stored on disk
2025-11-03T16:51:28.331005Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:51:28.331019Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 40, partNo: 0, Offset: 39 is stored on disk
2025-11-03T16:51:28.331030Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:51:28.331044Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 41, partNo: 0, Offset: 40 is stored on disk
2025-11-03T16:51:28.331054Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:51:28.331074Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 42, partNo: 0, Offset: 41 is stored on disk
2025-11-03T16:51:28.331086Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:51:28.331101Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 43, partNo: 0, Offset: 42 is stored on disk
2025-11-03T16:51:28.331114Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:51:28.331130Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 44, partNo: 0, Offset: 43 is stored on disk
2025-11-03T16:51:28.331141Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:51:28.331156Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 45, partNo: 0, Offset: 44 is stored on disk
2025-11-03T16:51:28.331167Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:51:28.331186Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 46, partNo: 0, Offset: 45 is stored on disk
2025-11-03T16:51:28.331197Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:51:28.331239Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 47, partNo: 0, Offset: 46 is stored on disk
2025-11-03T16:51:28.331256Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:51:28.331270Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 48, partNo: 0, Offset: 47 is stored on disk
2025-11-03T16:51:28.331283Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:51:28.331297Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 49, partNo: 0, Offset: 48 is stored on disk
2025-11-03T16:51:28.331307Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:51:28.331325Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 50, partNo: 0, Offset: 49 is stored on disk
2025-11-03T16:51:28.331335Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:51:28.331356Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 51, partNo: 0, Offset: 50 is stored on disk
2025-11-03T16:51:28.331366Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:51:28.331380Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 52, partNo: 0, Offset: 51 is stored on disk
2025-11-03T16:51:28.331392Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:51:28.331407Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 53, partNo: 0, Offset: 52 is stored on disk
2025-11-03T16:51:28.331419Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:51:28.331436Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 54, partNo: 0, Offset: 53 is stored on disk
2025-11-03T16:51:28.331447Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:51:28.331466Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 55, partNo: 0, Offset: 54 is stored on disk
2025-11-03T16:51:28.331477Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:51:28.331497Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 56, partNo: 0, Offset: 55 is stored on disk
2025-11-03T16:51:28.331509Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:51:28.331524Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 57, partNo: 0, Offset: 56 is stored on disk
2025-11-03T16:51:28.331533Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:51:28.331550Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 58, partNo: 0, Offset: 57 is stored on disk
2025-11-03T16:51:28.331561Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:51:28.331576Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 59, partNo: 0, Offset: 58 is stored on disk
2025-11-03T16:51:28.331586Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:51:28.331607Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 60, partNo: 0, Offset: 59 is stored on disk
2025-11-03T16:51:28.331618Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:51:28.331633Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 61, partNo: 0, Offset: 60 is stored on disk
2025-11-03T16:51:28.331643Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:51:28.331658Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 62, partNo: 0, Offset: 61 is stored on disk
2025-11-03T16:51:28.331668Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:51:28.331683Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 63, partNo: 0, Offset: 62 is stored on disk
2025-11-03T16:51:28.331694Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:51:28.331708Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 64, partNo: 0, Offset: 63 is stored on disk
2025-11-03T16:51:28.331717Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:51:28.331736Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 65, partNo: 0, Offset: 64 is stored on disk
2025-11-03T16:51:28.331747Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:51:28.331760Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 66, partNo: 0, Offset: 65 is stored on disk
2025-11-03T16:51:28.331772Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:51:28.331787Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 67, partNo: 0, Offset: 66 is stored on disk
2025-11-03T16:51:28.331797Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:51:28.331812Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 68, partNo: 0, Offset: 67 is stored on disk
2025-11-03T16:51:28.331823Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:51:28.331843Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 69, partNo: 0, Offset: 68 is stored on disk
2025-11-03T16:51:28.331853Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:51:28.331867Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 70, partNo: 0, Offset: 69 is stored on disk
2025-11-03T16:51:28.331876Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:51:28.331891Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 71, partNo: 0, Offset: 70 is stored on disk
2025-11-03T16:51:28.331900Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:51:28.331913Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 72, partNo: 0, Offset: 71 is stored on disk
2025-11-03T16:51:28.331921Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:51:28.331935Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 73, partNo: 0, Offset: 72 is stored on disk
2025-11-03T16:51:28.331945Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:51:28.331964Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 74, partNo: 0, Offset: 73 is stored on disk
2025-11-03T16:51:28.331993Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:51:28.332009Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 75, partNo: 0, Offset: 74 is stored on disk
2025-11-03T16:51:28.332021Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:51:28.332036Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 76, partNo: 0, Offset: 75 is stored on disk
2025-11-03T16:51:28.332047Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:51:28.332062Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 77, partNo: 0, Offset: 76 is stored on disk
2025-11-03T16:51:28.332074Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:51:28.332090Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 78, partNo: 0, Offset: 77 is stored on disk
2025-11-03T16:51:28.332103Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:51:28.332157Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 79, partNo: 0, Offset: 78 is stored on disk
2025-11-03T16:51:28.332174Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:51:28.332191Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 80, partNo: 0, Offset: 79 is stored on disk
2025-11-03T16:51:28.332202Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:51:28.332217Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 81, partNo: 0, Offset: 80 is stored on disk
2025-11-03T16:51:28.332228Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:51:28.332243Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 82, partNo: 0, Offset: 81 is stored on disk
2025-11-03T16:51:28.332254Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:51:28.332279Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 83, partNo: 0, Offset: 82 is stored on disk
2025-11-03T16:51:28.332290Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:51:28.332306Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 84, partNo: 0, Offset: 83 is stored on disk
2025-11-03T16:51:28.332317Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:51:28.332334Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 85, partNo: 0, Offset: 84 is stored on disk
2025-11-03T16:51:28.332345Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:51:28.332360Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 86, partNo: 0, Offset: 85 is stored on disk
2025-11-03T16:51:28.332370Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:51:28.332375Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 15 partno 0 count 85 parts 0 suffix '63' size 9964
2025-11-03T16:51:28.332385Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 87, partNo: 0, Offset: 86 is stored on disk
2025-11-03T16:51:28.332395Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:51:28.332414Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 88, partNo: 0, Offset: 87 is stored on disk
2025-11-03T16:51:28.332425Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:51:28.332441Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 89, partNo: 0, Offset: 88 is stored on disk
2025-11-03T16:51:28.332450Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:51:28.333662Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:28.332465Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 90, partNo: 0, Offset: 89 is stored on disk
2025-11-03T16:51:28.332475Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:51:28.333744Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:28.332489Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 91, partNo: 0, Offset: 90 is stored on disk
2025-11-03T16:51:28.332499Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:51:28.333779Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:28.332517Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 92, partNo: 0, Offset: 91 is stored on disk
2025-11-03T16:51:28.333804Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:28.332527Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:51:28.332543Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 93, partNo: 0, Offset: 92 is stored on disk
2025-11-03T16:51:28.333849Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:28.332552Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:51:28.333875Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:28.332566Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 94, partNo: 0, Offset: 93 is stored on disk
2025-11-03T16:51:28.332576Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:51:28.333910Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:28.332590Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 95, partNo: 0, Offset: 94 is stored on disk
2025-11-03T16:51:28.332601Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:51:28.332615Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 96, partNo: 0, Offset: 95 is stored on disk
2025-11-03T16:51:28.332624Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:51:28.332643Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 97, partNo: 0, Offset: 96 is stored on disk
2025-11-03T16:51:28.332653Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:51:28.332667Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 98, partNo: 0, Offset: 97 is stored on disk
2025-11-03T16:51:28.332677Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:51:28.332690Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 99, partNo: 0, Offset: 98 is stored on disk
2025-11-03T16:51:28.332699Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:51:28.332713Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 100, partNo: 0, Offset: 99 is stored on disk
2025-11-03T16:51:28.332884Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:28.332897Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:28.332906Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:28.332942Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:51:28.333006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 31  requestId: <none> cookie: 14
2025-11-03T16:51:28.333069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 32  requestId: <none> cookie: 15
2025-11-03T16:51:28.333089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 33  requestId: <none> cookie: 16
2025-11-03T16:51:28.333109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 34  requestId: <none> cookie: 17
2025-11-03T16:51:28.333130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 35  requestId: <none> cookie: 18
2025-11-03T16:51:28.333151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 41  requestId: <none> cookie: 19
2025-11-03T16:51:28.333172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 42  requestId: <none> cookie: 20
2025-11-03T16:51:28.333192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 43  requestId: <none> cookie: 21
2025-11-03T16:51:28.333222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 44  requestId: <none> cookie: 22
2025-11-03T16:51:28.333250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 45  requestId: <none> cookie: 23
2025-11-03T16:51:28.333270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 51  requestId: <none> cookie: 24
2025-11-03T16:51:28.333623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 52  requestId: <none> cookie: 25
2025-11-03T16:51:28.333674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 53  requestId: <none> cookie: 26
2025-11-03T16:51:28.333787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 54  requestId: <none> cookie: 27
2025-11-03T16:51:28.333921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 55  requestId: <none> cookie: 28
2025-11-03T16:51:28.333942Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:28.333964Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:28.334007Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:28.334029Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:28.336527Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write session got write response: sequence_numbers: 16 offsets: 15 already_written: false write_statistics { persist_duration_ms: 15 queued_in_partition_duration_ms: 10 }
2025-11-03T16:51:28.336578Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write session: acknoledged message 16
2025-11-03T16:51:28.336809Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write session got write response: sequence_numbers: 17 offsets: 16 already_written: false write_statistics { persist_duration_ms: 15 queued_in_partition_duration_ms: 10 }
2025-11-03T16:51:28.336857Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write session: acknoledged message 17
2025-11-03T16:51:28.337443Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:28.337619Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write session got write response: sequence_numbers: 18 offsets: 17 already_written: false write_statistics { persist_duration_ms: 15 queued_in_partition_duration_ms: 10 }
2025-11-03T16:51:28.337658Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write session: acknoledged message 18
2025-11-03T16:51:28.337627Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:28.337662Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:28.337747Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:28.337851Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write session got write response: sequence_numbers: 19 offsets: 18 already_written: false write_statistics { persist_duration_ms: 15 queued_in_partition_duration_ms: 10 }
2025-11-03T16:51:28.337893Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write session: acknoledged message 19
2025-11-03T16:51:28.338049Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write session got write response: sequence_numbers: 20 offsets: 19 already_written: false write_statistics { persist_duration_ms: 15 queued_in_partition_duration_ms: 10 }
2025-11-03T16:51:28.338072Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write session: acknoledged message 20
2025-11-03T16:51:28.338200Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write session got write response: sequence_numbers: 21 offsets: 20 already_written: false write_statistics { persist_duration_ms: 15 queued_in_partition_duration_ms: 6 }
2025-11-03T16:51:28.338223Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write session: acknoledged message 21
2025-11-03T16:51:28.338355Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write session got write response: sequence_numbers: 22 offsets: 21 already_written: false write_statistics { persist_duration_ms: 15 queued_in_partition_duration_ms: 6 }
2025-11-03T16:51:28.338379Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write session: acknoledged message 22
2025-11-03T16:51:28.338575Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write session got write response: sequence_numbers: 23 offsets: 22 already_written: false write_statistics { persist_duration_ms: 15 queued_in_partition_duration_ms: 6 }
2025-11-03T16:51:28.338605Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write session: acknoledged message 23
2025-11-03T16:51:28.338789Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write session got write response: sequence_numbers: 24 sequence_numbers: 25 offsets: 23 offsets: 24 already_written: false already_written: false write_statistics { persist_duration_ms: 15 queued_in_partition_duration_ms: 6 }
2025-11-03T16:51:28.338814Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write session: acknoledged message 24
2025-11-03T16:51:28.338843Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write session: acknoledged message 25
2025-11-03T16:51:28.339027Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write session got write response: sequence_numbers: 26 offsets: 25 already_written: false write_statistics { persist_duration_ms: 15 queued_in_partition_duration_ms: 6 }
2025-11-03T16:51:28.339064Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write session: acknoledged message 26
2025-11-03T16:51:28.339219Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write session got write response: sequence_numbers: 27 offsets: 26 already_written: false write_statistics { persist_duration_ms: 15 queued_in_partition_duration_ms: 2 }
2025-11-03T16:51:28.339240Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write session: acknoledged message 27
2025-11-03T16:51:28.340153Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write session got write response: sequence_numbers: 28 sequence_numbers: 29 sequence_numbers: 30 sequence_numbers: 31 sequence_numbers: 32 sequence_numbers: 33 sequence_numbers: 34 sequence_numbers: 35 sequence_numbers: 36 sequence_numbers: 37 sequence_numbers: 38 sequence_numbers: 39 sequence_numbers: 40 sequence_numbers: 41 sequence_numbers: 42 sequence_numbers: 43 sequence_numbers: 44 sequence_numbers: 45 sequence_numbers: 46 sequence_numbers: 47 sequence_numbers: 48 sequence_numbers: 49 sequence_numbers: 50 sequence_numbers: 51 sequence_numbers: 52 sequence_numbers: 53 sequence_numbers: 54 sequence_numbers: 55 sequence_numbers: 56 sequence_numbers: 57 sequence_numbers: 58 sequence_numbers: 59 sequence_numbers: 60 sequence_numbers: 61 sequence_numbers: 62 sequence_numbers: 63 sequence_numbers: 64 sequence_numbers: 65 sequence_numbers: 66 sequence_numbers: 67 sequence_numbers: 68 offsets: 27 offsets: 28 offsets: 29 offsets: 30 offsets: 31 offsets: 32 offsets: 33 offsets: 34 offsets: 35 offsets: 36 offsets: 37 offsets: 38 offsets: 39 offsets: 40 offsets: 41 offsets: 42 offsets: 43 offsets: 44 offsets: 45 offsets: 46 offsets: 47 offsets: 48 offsets: 49 offsets: 50 offsets: 51 offsets: 52 offsets: 53 offsets: 54 offsets: 55 offsets: 56 offsets: 57 offsets: 58 offsets: 59 offsets: 60 offsets: 61 offsets: 62 offsets: 63 offsets: 64 offsets: 65 offsets: 66 offsets: 67 already_written: false already_written: false already_written: false already_written: false already_written: false already_written: false already_written: false already_written: false already_written: false already_written: false already_written: false already_written: false already_written: false already_written: false already_written: false already_written: false already_written: false already_written: false already_written: false already_written: false already_written: false already_written: false already_written: false already_written: false already_written: false already_written: false already_written: false already_written: false already_written: false already_written: false already_written: false already_written: false already_written: false already_written: false already_written: false already_written: false already_written: false already_written: false already_written: false already_written: false already_written: false write_statistics { persist_duration_ms: 15 queued_in_partition_duration_ms: 3 }
2025-11-03T16:51:28.340205Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write session: acknoledged message 28
2025-11-03T16:51:28.340233Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write session: acknoledged message 29
2025-11-03T16:51:28.340255Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write session: acknoledged message 30
2025-11-03T16:51:28.340279Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write session: acknoledged message 31
2025-11-03T16:51:28.340300Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write session: acknoledged message 32
2025-11-03T16:51:28.340323Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write session: acknoledged message 33
2025-11-03T16:51:28.340349Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write session: acknoledged message 34
2025-11-03T16:51:28.340370Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write session: acknoledged message 35
2025-11-03T16:51:28.340395Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write session: acknoledged message 36
2025-11-03T16:51:28.340417Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write session: acknoledged message 37
2025-11-03T16:51:28.340457Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write session: acknoledged message 38
2025-11-03T16:51:28.340481Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write session: acknoledged message 39
2025-11-03T16:51:28.340506Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write session: acknoledged message 40
2025-11-03T16:51:28.340525Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write session: acknoledged message 41
2025-11-03T16:51:28.340545Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write session: acknoledged message 42
2025-11-03T16:51:28.340571Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write session: acknoledged message 43
2025-11-03T16:51:28.340595Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write session: acknoledged message 44
2025-11-03T16:51:28.340639Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write session: acknoledged message 45
2025-11-03T16:51:28.340660Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write session: acknoledged message 46
2025-11-03T16:51:28.340682Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write session: acknoledged message 47
2025-11-03T16:51:28.340704Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write session: acknoledged message 48
2025-11-03T16:51:28.340726Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write session: acknoledged message 49
2025-11-03T16:51:28.340746Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write session: acknoledged message 50
2025-11-03T16:51:28.340764Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write session: acknoledged message 51
2025-11-03T16:51:28.340791Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write session: acknoledged message 52
2025-11-03T16:51:28.340813Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write session: acknoledged message 53
2025-11-03T16:51:28.340834Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write session: acknoledged message 54
2025-11-03T16:51:28.340859Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write session: acknoledged message 55
2025-11-03T16:51:28.340882Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write session: acknoledged message 56
2025-11-03T16:51:28.340930Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write session: acknoledged message 57
2025-11-03T16:51:28.340953Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write session: acknoledged message 58
2025-11-03T16:51:28.340975Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write session: acknoledged message 59
2025-11-03T16:51:28.341003Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write session: acknoledged message 60
2025-11-03T16:51:28.341029Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write session: acknoledged message 61
2025-11-03T16:51:28.341047Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write session: acknoledged message 62
2025-11-03T16:51:28.341077Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write session: acknoledged message 63
2025-11-03T16:51:28.341099Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write session: acknoledged message 64
2025-11-03T16:51:28.341124Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write session: acknoledged message 65
2025-11-03T16:51:28.341149Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write session: acknoledged message 66
2025-11-03T16:51:28.341168Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write session: acknoledged message 67
2025-11-03T16:51:28.341189Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write session: acknoledged message 68
2025-11-03T16:51:28.342340Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write session got write response: sequence_numbers: 69 offsets: 68 already_written: false write_statistics { persist_duration_ms: 13 queued_in_partition_duration_ms: 3 }
2025-11-03T16:51:28.342370Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write session: acknoledged message 69
2025-11-03T16:51:28.342701Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write session got write response: sequence_numbers: 70 sequence_numbers: 71 sequence_numbers: 72 sequence_numbers: 73 sequence_numbers: 74 sequence_numbers: 75 sequence_numbers: 76 sequence_numbers: 77 sequence_numbers: 78 sequence_numbers: 79 sequence_numbers: 80 sequence_numbers: 81 sequence_numbers: 82 sequence_numbers: 83 sequence_numbers: 84 offsets: 69 offsets: 70 offsets: 71 offsets: 72 offsets: 73 offsets: 74 offsets: 75 offsets: 76 offsets: 77 offsets: 78 offsets: 79 offsets: 80 offsets: 81 offsets: 82 offsets: 83 already_written: false already_written: false already_written: false already_written: false already_written: false already_written: false already_written: false already_written: false already_written: false already_written: false already_written: false already_written: false already_written: false already_written: false already_written: false write_statistics { persist_duration_ms: 13 queued_in_partition_duration_ms: 3 }
2025-11-03T16:51:28.342752Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write session: acknoledged message 70
2025-11-03T16:51:28.342779Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write session: acknoledged message 71
2025-11-03T16:51:28.342800Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write session: acknoledged message 72
2025-11-03T16:51:28.342826Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write session: acknoledged message 73
2025-11-03T16:51:28.342845Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write session: acknoledged message 74
2025-11-03T16:51:28.342872Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write session: acknoledged message 75
2025-11-03T16:51:28.342896Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write session: acknoledged message 76
2025-11-03T16:51:28.342922Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write session: acknoledged message 77
2025-11-03T16:51:28.342955Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write session: acknoledged message 78
2025-11-03T16:51:28.342991Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write session: acknoledged message 79
2025-11-03T16:51:28.343020Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write session: acknoledged message 80
2025-11-03T16:51:28.343050Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write session: acknoledged message 81
2025-11-03T16:51:28.343070Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write session: acknoledged message 82
2025-11-03T16:51:28.343094Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write session: acknoledged message 83
2025-11-03T16:51:28.343112Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write session: acknoledged message 84
2025-11-03T16:51:28.343383Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write session got write response: sequence_numbers: 85 sequence_numbers: 86 sequence_numbers: 87 sequence_numbers: 88 sequence_numbers: 89 sequence_numbers: 90 sequence_numbers: 91 sequence_numbers: 92 sequence_numbers: 93 sequence_numbers: 94 sequence_numbers: 95 sequence_numbers: 96 sequence_numbers: 97 sequence_numbers: 98 sequence_numbers: 99 sequence_numbers: 100 offsets: 84 offsets: 85 offsets: 86 offsets: 87 offsets: 88 offsets: 89 offsets: 90 offsets: 91 offsets: 92 offsets: 93 offsets: 94 offsets: 95 offsets: 96 offsets: 97 offsets: 98 offsets: 99 already_written: false already_written: false already_written: false already_written: false already_written: false already_written: false already_written: false already_written: false already_written: false already_written: false already_written: false already_written: false already_written: false already_written: false already_written: false already_written: false write_statistics { persist_duration_ms: 13 queued_in_partition_duration_ms: 4 }
2025-11-03T16:51:28.343443Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write session: acknoledged message 85
2025-11-03T16:51:28.343470Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write session: acknoledged message 86
2025-11-03T16:51:28.343493Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write session: acknoledged message 87
2025-11-03T16:51:28.343516Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write session: acknoledged message 88
2025-11-03T16:51:28.343542Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write session: acknoledged message 89
2025-11-03T16:51:28.343587Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write session: acknoledged message 90
2025-11-03T16:51:28.343606Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write session: acknoledged message 91
2025-11-03T16:51:28.343631Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write session: acknoledged message 92
2025-11-03T16:51:28.343656Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write session: acknoledged message 93
2025-11-03T16:51:28.343676Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write session: acknoledged message 94
2025-11-03T16:51:28.343703Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write session: acknoledged message 95
2025-11-03T16:51:28.343721Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write session: acknoledged message 96
2025-11-03T16:51:28.343745Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write session: acknoledged message 97
2025-11-03T16:51:28.343767Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write session: acknoledged message 98
2025-11-03T16:51:28.343790Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write session: acknoledged message 99
2025-11-03T16:51:28.343810Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write session: acknoledged message 100
2025-11-03T16:51:28.410358Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:28.410386Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:28.410393Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:28.423920Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write session will now close
2025-11-03T16:51:28.424015Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write session: aborting
2025-11-03T16:51:28.424526Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write session: gracefully shut down, all writes complete
2025-11-03T16:51:28.424748Z :INFO: [/Root] [/Root] [c703675f-9f49d555-92cc9056-5fdd0866] Starting read session
2025-11-03T16:51:28.424790Z :DEBUG: [/Root] [/Root] [c703675f-9f49d555-92cc9056-5fdd0866] Starting cluster discovery
2025-11-03T16:51:28.426887Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0 grpc read done: success: 0 data: 
2025-11-03T16:51:28.426926Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 2 sessionId: src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0 grpc read failed
2025-11-03T16:51:28.426955Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 2 sessionId: src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0 grpc closed
2025-11-03T16:51:28.426970Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2 sessionId: src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0 is DEAD
2025-11-03T16:51:28.427718Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-11-03T16:51:28.428762Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write session is aborting and will not restart
2025-11-03T16:51:28.432254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [1:7568542784992990788:2473] destroyed
2025-11-03T16:51:28.432310Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-11-03T16:51:28.432362Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:28.432374Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:28.432383Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:28.434475Z :DEBUG: [/Root] [/Root] [c703675f-9f49d555-92cc9056-5fdd0866] Cluster discovery request succeeded
2025-11-03T16:51:28.434560Z :DEBUG: [/Root] [/Root] [c703675f-9f49d555-92cc9056-5fdd0866] Starting session to cluster dc1 (localhost:15392)
2025-11-03T16:51:28.434771Z :DEBUG: [/Root] [/Root] [c703675f-9f49d555-92cc9056-5fdd0866] [dc1] In Reconnect, ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:51:28.434825Z :DEBUG: [/Root] [/Root] [c703675f-9f49d555-92cc9056-5fdd0866] [dc1] New values: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:51:28.434870Z :DEBUG: [/Root] [/Root] [c703675f-9f49d555-92cc9056-5fdd0866] [dc1] Reconnecting session to cluster dc1 in 0.000000s
2025-11-03T16:51:28.437842Z :DEBUG: [/Root] [/Root] [c703675f-9f49d555-92cc9056-5fdd0866] [dc1] Successfully connected. Initializing session
2025-11-03T16:51:28.438512Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:109: new grpc connection
2025-11-03T16:51:28.438539Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:131: new session created cookie 1
2025-11-03T16:51:28.439175Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { topic: "test-topic" } read_only_original: true consumer: "shared/user" read_params { max_read_size: 104857600 } } }
2025-11-03T16:51:28.439421Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 1 consumer shared/user session shared/user_1_1_18093459630474583920_v1 read init: from# ipv6:[::1]:39084, request# { init_request { topics_read_settings { topic: "test-topic" } read_only_original: true consumer: "shared/user" read_params { max_read_size: 104857600 } } }
2025-11-03T16:51:28.439828Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 1 consumer shared/user session shared/user_1_1_18093459630474583920_v1 auth for : user
2025-11-03T16:51:28.440641Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 1 consumer shared/user session shared/user_1_1_18093459630474583920_v1 Handle describe topics response
2025-11-03T16:51:28.440763Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 1 consumer shared/user session shared/user_1_1_18093459630474583920_v1 auth is DEAD
2025-11-03T16:51:28.440820Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 1 consumer shared/user session shared/user_1_1_18093459630474583920_v1 auth ok: topics# 1, initDone# 0
2025-11-03T16:51:28.441936Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 1 consumer shared/user session shared/user_1_1_18093459630474583920_v1 register session: topic# rt3.dc1--test-topic
2025-11-03T16:51:28.442249Z :INFO: [/Root] [/Root] [c703675f-9f49d555-92cc9056-5fdd0866] [dc1] Server session id: shared/user_1_1_18093459630474583920_v1
2025-11-03T16:51:28.442497Z :DEBUG: [/Root] [/Root] [c703675f-9f49d555-92cc9056-5fdd0866] [dc1] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:51:28.442522Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1655: [72075186224037893][rt3.dc1--test-topic] pipe [1:7568542784992990815:2485] connected; active server actors: 1
2025-11-03T16:51:28.442750Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_1_1_18093459630474583920_v1 grpc read done: success# 1, data# { read { } }
2025-11-03T16:51:28.442876Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_1_1_18093459630474583920_v1 got read request: guid# 94d8ba98-78f13af2-f460e873-ec375e39
2025-11-03T16:51:28.442914Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1706: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [1:7568542784992990815:2485] session shared/user_1_1_18093459630474583920_v1
2025-11-03T16:51:28.442972Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:639: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-11-03T16:51:28.443025Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:669: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-11-03T16:51:28.443060Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:871: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_1_1_18093459630474583920_v1" (Sender=[1:7568542784992990812:2485], Pipe=[1:7568542784992990815:2485], Partitions=[], ActiveFamilyCount=0)
2025-11-03T16:51:28.443094Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1186: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-11-03T16:51:28.443149Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1258: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-11-03T16:51:28.443192Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1305: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_1_18093459630474583920_v1" (Sender=[1:7568542784992990812:2485], Pipe=[1:7568542784992990815:2485], Partitions=[], ActiveFamilyCount=0)
2025-11-03T16:51:28.443265Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:549: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_1_1_18093459630474583920_v1" sender [1:7568542784992990812:2485] lock partition 0 for ReadingSession "shared/user_1_1_18093459630474583920_v1" (Sender=[1:7568542784992990812:2485], Pipe=[1:7568542784992990815:2485], Partitions=[], ActiveFamilyCount=1) generation 1 step 1
2025-11-03T16:51:28.443319Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1325: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-11-03T16:51:28.443347Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1402: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000174s
2025-11-03T16:51:28.444183Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 1 consumer shared/user session shared/user_1_1_18093459630474583920_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 1 Session: "shared/user_1_1_18093459630474583920_v1" ClientId: "user" PipeClient { RawX1: 7568542784992990815 RawX2: 4503603922340277 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-11-03T16:51:28.444244Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 1 consumer shared/user session shared/user_1_1_18093459630474583920_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-11-03T16:51:28.445587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [1:7568542784992990818:2488], now have 1 active actors on pipe
2025-11-03T16:51:28.445705Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_18093459630474583920_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 1, pipe: [1:7568542784992990818:2488]
2025-11-03T16:51:28.445998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:28.446036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:28.446081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1748: [PQ: 72075186224037892] Created session shared/user_1_1_18093459630474583920_v1 on pipe: [1:7568542784992990818:2488]
2025-11-03T16:51:28.446154Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:28.446181Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:28.446193Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-03T16:51:28.446285Z node 2 :PERSQUEUE DEBUG: partition.cpp:3666: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_1_1_18093459630474583920_v1
2025-11-03T16:51:28.446301Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:28.446461Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-03T16:51:28.447063Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_1_18093459630474583920_v1:1 with generation 1
2025-11-03T16:51:28.452113Z node 2 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-03T16:51:28.452175Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-11-03T16:51:28.452198Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:28.452206Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:28.452227Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:28.452255Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:51:28.452286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-11-03T16:51:28.452787Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_1_1_18093459630474583920_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 100 WriteTimestampMS: 1762188688212 CreateTimestampMS: 1762188688200 SizeLag: 2079 WriteTimestampEstimateMS: 1762188688431 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-11-03T16:51:28.452829Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 1 consumer shared/user session shared/user_1_1_18093459630474583920_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 100 readOffset 0 committedOffset 0
2025-11-03T16:51:28.452868Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 1 consumer shared/user session shared/user_1_1_18093459630474583920_v1 sending to client partition status
2025-11-03T16:51:28.453904Z :INFO: [/Root] [/Root] [c703675f-9f49d555-92cc9056-5fdd0866] [dc1] Confirm partition stream create. Partition stream id: 1. Cluster: "dc1". Topic: "test-topic". Partition: 0. Read offset: (NULL)
2025-11-03T16:51:28.454773Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_1_1_18093459630474583920_v1 grpc read done: success# 1, data# { start_read { topic { path: "test-topic" } cluster: "dc1" assign_id: 1 } }
2025-11-03T16:51:28.454868Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:539: session cookie 1 consumer shared/user session shared/user_1_1_18093459630474583920_v1 got StartRead from client: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 0, commitOffset# 0
2025-11-03T16:51:28.454929Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1023: session cookie 1 consumer shared/user session shared/user_1_1_18093459630474583920_v1 Start reading TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 100 readOffset 0 committedOffset 0 clientCommitOffset 0 clientReadOffset 0
2025-11-03T16:51:28.454956Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_1_1_18093459630474583920_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 0 endOffset 100
2025-11-03T16:51:28.455010Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_1_1_18093459630474583920_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 0, endOffset# 100, WTime# 1762188688212, sizeLag# 2079
2025-11-03T16:51:28.455029Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_1_1_18093459630474583920_v1TEvPartitionReady. Aval parts: 1
2025-11-03T16:51:28.455065Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_1_1_18093459630474583920_v1 performing read request: guid# 94d8ba98-78f13af2-f460e873-ec375e39, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 120, size# 2494, partitionsAsked# 1, maxTimeLag# 0ms
2025-11-03T16:51:28.455147Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_1_1_18093459630474583920_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 120 maxSize 2494 maxTimeLagMs 0 readTimestampMs 0 readOffset 0 EndOffset 100 ClientCommitOffset 0 committedOffset 0 Guid 94d8ba98-78f13af2-f460e873-ec375e39
2025-11-03T16:51:28.455585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:28.455613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:28.455729Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:880: [72075186224037892][Partition][0][StateIdle] read cookie 4 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 partno 0 count 120 size 2494 endOffset 100 max time lag 0ms effective offset 0
2025-11-03T16:51:28.456330Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1105: [72075186224037892][Partition][0][StateIdle] read cookie 4 added 4 blobs, size 11881 count 100 last offset 15, current partition end offset: 100
2025-11-03T16:51:28.456345Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1121: [72075186224037892][Partition][0][StateIdle] Reading cookie 4. Send blob request.
2025-11-03T16:51:28.456409Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 0 partno 0 count 1 parts_count 0 source 1 size 162 accessed 1 times before, last time 2025-11-03T16:51:28.000000Z
2025-11-03T16:51:28.456434Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 1 partno 0 count 2 parts_count 0 source 1 size 314 accessed 0 times before, last time 2025-11-03T16:51:28.000000Z
2025-11-03T16:51:28.456452Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 3 partno 0 count 12 parts_count 0 source 1 size 1441 accessed 0 times before, last time 2025-11-03T16:51:28.000000Z
2025-11-03T16:51:28.456469Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 15 partno 0 count 85 parts_count 0 source 1 size 9964 accessed 0 times before, last time 2025-11-03T16:51:28.000000Z
2025-11-03T16:51:28.456503Z node 2 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 4. All 4 blobs are from cache.
2025-11-03T16:51:28.456554Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:572: FormAnswer for 4 blobs
2025-11-03T16:51:28.456700Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 0 totakecount 1 count 1 size 142 from pos 0 cbcount 1
2025-11-03T16:51:28.457089Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 1 totakecount 2 count 2 size 294 from pos 0 cbcount 2
2025-11-03T16:51:28.457235Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 3 totakecount 12 count 12 size 1421 from pos 0 cbcount 12
2025-11-03T16:51:28.457537Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 15 totakecount 85 count 85 size 9944 from pos 0 cbcount 85
2025-11-03T16:51:28.457612Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 0 suffix '63'
2025-11-03T16:51:28.457632Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 1 partno 0 count 2 parts 0 suffix '63'
2025-11-03T16:51:28.457648Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 3 partno 0 count 12 parts 0 suffix '63'
2025-11-03T16:51:28.457666Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 15 partno 0 count 85 parts 0 suffix '63'
2025-11-03T16:51:28.458008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-03T16:51:28.462541Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_1_1_18093459630474583920_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 100 Result { Offset: 0 Data: "... 100 bytes ..." SourceId: "\000src_id" SeqNo: 1 WriteTimestampMS: 1762188688212 CreateTimestampMS: 1762188688200 UncompressedSize: 9 PartitionKey: "" ExplicitHash: "" } Result { Offset: 1 Data: "... 102 bytes ..." SourceId: "\000src_id" SeqNo: 2 WriteTimestampMS: 1762188688234 CreateTimestampMS: 1762188688200 UncompressedSize: 17 PartitionKey: "" ExplicitHash: "" } Result { Offset: 2 Data: "... 102 bytes ..." SourceId: "\000src_id" SeqNo: 3 WriteTimestampMS: 1762188688291 CreateTimestampMS: 1762188688200 UncompressedSize: 25 PartitionKey: "" ExplicitHash: "" } Result { Offset: 3 Data: "... 103 bytes ..." SourceId: "\000src_id" SeqNo: 4 WriteTimestampMS: 1762188688299 CreateTimestampMS: 1762188688200 UncompressedSize: 33 PartitionKey: "" ExplicitHash: "" } Result { Offset: 4 Data: "... 103 bytes ..." SourceId: "\000src_id" SeqNo: 5 WriteTimestampMS: 1762188688302 CreateTimestampMS: 1762188688200 UncompressedSize: 41 PartitionKey: "" ExplicitHash: "" } Result { Offset: 5 Data: "... 103 bytes ..." SourceId: "\000src_id" SeqNo: 6 WriteTimestampMS: 1762188688302 CreateTimestampMS: 1762188688200 UncompressedSize: 49 PartitionKey: "" ExplicitHash: "" } Result { Offset: 6 Data: "... 103 bytes ..." SourceId: "\000src_id" SeqNo: 7 WriteTimestampMS: 1762188688302 CreateTimestampMS: 1762188688200 UncompressedSize: 57 PartitionKey: "" ExplicitHash: "" } Result { Offset: 7 Data: "... 103 bytes ..." SourceId: "\000src_id" SeqNo: 8 WriteTimestampMS: 1762188688302 CreateTimestampMS: 1762188688200 UncompressedSize: 65 PartitionKey: "" ExplicitHash: "" } Result { Offset: 8 Data: "... 103 bytes ..." SourceId: "\000src_id" SeqNo: 9 WriteTimestampMS: 1762188688302 CreateTimestampMS: 1762188688200 UncompressedSize: 73 PartitionKey: "" ExplicitHash: "" } Result { Offset: 9 Data: "... 103 bytes ..." SourceId: "\000src_id" SeqNo: 10 WriteTimestampMS: 1762188688302 CreateTimestampMS: 1762188688201 UncompressedSize: 81 PartitionKey: "" ExplicitHash: "" } Result { Offset: 10 Data: "... 104 bytes ..." SourceId: "\000src_id" SeqNo: 11 WriteTimestampMS: 1762188688302 CreateTimestampMS: 1762188688201 UncompressedSize: 90 PartitionKey: "" ExplicitHash: "" } Result { Offset: 11 Data: "... 104 bytes ..." SourceId: "\000src_id" SeqNo: 12 WriteTimestampMS: 1762188688302 CreateTimestampMS: 1762188688201 UncompressedSize: 98 PartitionKey: "" ExplicitHash: "" } Result { Offset: 12 Data: "... 104 bytes ..." SourceId: "\000src_id" SeqNo: 13 WriteTimestampMS: 1762188688302 CreateTimestampMS: 1762188688201 UncompressedSize: 106 PartitionKey: "" ExplicitHash: "" } Result { Offset: 13 Data: "... 104 bytes ..." SourceId: "\000src_id" SeqNo: 14 WriteTimestampMS: 1762188688302 CreateTimestampMS: 1762188688205 UncompressedSize: 114 PartitionKey: "" ExplicitHash: "" } Result { Offset: 14 Data: "... 104 bytes ..." SourceId: "\000src_id" SeqNo: 15 WriteTimestampMS: 1762188688302 CreateTimestampMS: 1762188688205 UncompressedSize: 122 PartitionKey: "" ExplicitHash: "" } Result { Offset: 15 Data: "... 104 bytes ..." SourceId: "\000src_id" SeqNo: 16 WriteTimestampMS: 1762188688314 CreateTimestampMS: 1762188688205 UncompressedSize: 130 PartitionKey: "" ExplicitHash: "" } Result { Offset: 16 Data: "... 104 bytes ..." SourceId: "\000src_id" SeqNo: 17 WriteTimestampMS: 1762188688314 CreateTimestampMS: 1762188688205 UncompressedSize: 138 PartitionKey: "" ExplicitHash: "" } Result { Offset: 17 Data: "... 104 bytes ..." SourceId: "\000src_id" SeqNo: 18 WriteTimestampMS: 1762188688314 CreateTimestampMS: 1762188688205 UncompressedSize: 146 PartitionKey: "" ExplicitHash: "" } Result { Offset: 18 Data: "... 104 bytes ..." SourceId: "\000src_id" SeqNo: 19 WriteTimestampMS: 1762188688314 CreateTimestampMS: 1762188688205 UncompressedSize: 154 PartitionKey: "" ExplicitHash: "" } Result { Offset: 19 Data: "... 104 bytes ..." SourceId: "\000src_id" SeqNo: 20 WriteTimestampMS: 1762188688314 CreateTimestampMS: 1762188688206 UncompressedSize: 162 PartitionKey: "" ExplicitHash: "" } Result { Offset: 20 Data: "... 104 bytes ..." SourceId: "\000src_id" SeqNo: 21 WriteTimestampMS: 1762188688314 CreateTimestampMS: 1762188688206 UncompressedSize: 170 PartitionKey: "" ExplicitHash: "" } Result { Offset: 21 Data: "... 104 bytes ..." SourceId: "\000src_id" SeqNo: 22 WriteTimestampMS: 1762188688314 CreateTimestampMS: 1762188688206 UncompressedSize: 178 PartitionKey: "" ExplicitHash: "" } Result { Offset: 22 Data: "... 104 bytes ..." SourceId: "\000src_id" SeqNo: 23 WriteTimestampMS: 1762188688314 CreateTimestampMS: 1762188688206 UncompressedSize: 186 PartitionKey: "" ExplicitHash: "" } Result { Offset: 23 Data: "... 104 bytes ..." SourceId: "\000src_id" SeqNo: 24 WriteTimestampMS: 1762188688314 CreateTimestampMS: 1762188688208 UncompressedSize: 194 PartitionKey: "" ExplicitHash: "" } Result { Offset: 24 Data: "... 104 bytes ..." SourceId: "\000src_id" SeqNo: 25 WriteTimestampMS: 1762188688314 CreateTimestampMS: 1762188688209 UncompressedSize: 202 PartitionKey: "" ExplicitHash: "" } Result { Offset: 25 Data: "... 104 bytes ..." SourceId: "\000src_id" SeqNo: 26 WriteTimestampMS: 1762188688314 CreateTimestampMS: 1762188688209 UncompressedSize: 210 PartitionKey: "" ExplicitHash: "" } Result { Offset: 26 Data: "... 104 bytes ..." SourceId: "\000src_id" SeqNo: 27 WriteTimestampMS: 1762188688314 CreateTimestampMS: 1762188688209 UncompressedSize: 218 PartitionKey: "" ExplicitHash: "" } Result { Offset: 27 Data: "... 104 bytes ..." SourceId: "\000src_id" SeqNo: 28 WriteTimestampMS: 1762188688314 CreateTimestampMS: 1762188688209 UncompressedSize: 226 PartitionKey: "" ExplicitHash: "" } Result { Offset: 28 Data: "... 104 bytes ..." SourceId: "\000src_id" SeqNo: 29 WriteTimestampMS: 1762188688314 CreateTimestampMS: 1762188688209 UncompressedSize: 234 PartitionKey: "" ExplicitHash: "" } Result { Offset: 29 Data: "... 104 bytes ..." SourceId: "\000src_id" SeqNo: 30 WriteTimestampMS: 1762188688314 CreateTimestampMS: 1762188688209 UncompressedSize: 242 PartitionKey: "" ExplicitHash: "" } Result { Offset: 30 Data: "... 104 bytes ..." SourceId: "\000src_id" SeqNo: 31 WriteTimestampMS: 1762188688314 CreateTimestampMS: 1762188688212 UncompressedSize: 250 PartitionKey: "" ExplicitHash: "" } Result { Offset: 31 Data: "... 104 bytes ..." SourceId: "\000src_id" SeqNo: 32 WriteTimestampMS: 1762188688314 CreateTimestampMS: 1762188688212 UncompressedSize: 258 PartitionKey: "" ExplicitHash: "" } Result { Offset: 32 Data: "... 104 bytes ..." SourceId: "\000src_id" SeqNo: 33 WriteTimestampMS: 1762188688314 CreateTimestampMS: 1762188688213 UncompressedSize: 266 PartitionKey: "" ExplicitHash: "" } Result { Offset: 33 Data: "... 105 bytes ..." SourceId: "\000src_id" SeqNo: 34 WriteTimestampMS: 1762188688314 CreateTimestampMS: 1762188688213 UncompressedSize: 274 PartitionKey: "" ExplicitHash: "" } Result { Offset: 34 Data: "... 105 bytes ..." SourceId: "\000src_id" SeqNo: 35 WriteTimestampMS: 1762188688314 CreateTimestampMS: 1762188688213 UncompressedSize: 282 PartitionKey: "" ExplicitHash: "" } Result { Offset: 35 Data: "... 105 bytes ..." SourceId: "\000src_id" SeqNo: 36 WriteTimestampMS: 1762188688314 CreateTimestampMS: 1762188688213 UncompressedSize: 290 PartitionKey: "" ExplicitHash: "" } Result { Offset: 36 Data: "... 105 bytes ..." SourceId: "\000src_id" SeqNo: 37 WriteTimestampMS: 1762188688314 CreateTimestampMS: 1762188688213 UncompressedSize: 298 PartitionKey: "" ExplicitHash: "" } Result { Offset: 37 Data: "... 105 bytes ..." SourceId: "\000src_id" SeqNo: 38 WriteTimestampMS: 1762188688314 CreateTimestampMS: 1762188688213 UncompressedSize: 306 PartitionKey: "" ExplicitHash: "" } Result { Offset: 38 Data: "... 105 bytes ..." SourceId: "\000src_id" SeqNo: 39 WriteTimestampMS: 1762188688314 CreateTimestampMS: 1762188688213 UncompressedSize: 314 PartitionKey: "" ExplicitHash: "" } Result { Offset: 39 Data: "... 105 bytes ..." SourceId: "\000src_id" SeqNo: 40 WriteTimestampMS: 1762188688314 CreateTimestampMS: 1762188688213 UncompressedSize: 322 PartitionKey: "" ExplicitHash: "" } Result { Offset: 40 Data: "... 105 bytes ..." SourceId: "\000src_id" SeqNo: 41 WriteTimestampMS: 1762188688314 CreateTimestampMS: 1762188688213 UncompressedSize: 330 PartitionKey: "" ExplicitHash: "" } Result { Offset: 41 Data: "... 106 bytes ..." SourceId: "\000src_id" SeqNo: 42 WriteTimestampMS: 1762188688314 CreateTimestampMS: 1762188688213 UncompressedSize: 338 PartitionKey: "" ExplicitHash: "" } Result { Offset: 42 Data: "... 106 bytes ..." SourceId: "\000src_id" SeqNo: 43 WriteTimestampMS: 1762188688314 CreateTimestampMS: 1762188688213 UncompressedSize: 346 PartitionKey: "" ExplicitHash: "" } Result { Offset: 43 Data: "... 106 bytes ..." SourceId: "\000src_id" SeqNo: 44 WriteTimestampMS: 1762188688314 CreateTimestampMS: 1762188688213 UncompressedSize: 354 PartitionKey: "" ExplicitHash: "" } Result { Offset: 44 Data: "... 106 bytes ..." SourceId: "\000src_id" SeqNo: 45 WriteTimestampMS: 1762188688314 CreateTimestampMS: 1762188688213 UncompressedSize: 362 PartitionKey: "" ExplicitHash: "" } Result { Offset: 45 Data: "... 106 bytes ..." SourceId: "\000src_id" SeqNo: 46 WriteTimestampMS: 1762188688314 CreateTimestampMS: 1762188688213 UncompressedSize: 370 PartitionKey: "" ExplicitHash: "" } Result { Offset: 46 Data: "... 106 bytes ..." SourceId: "\000src_id" SeqNo: 47 WriteTimestampMS: 1762188688314 CreateTimestampMS: 1762188688213 UncompressedSize: 378 PartitionKey: "" ExplicitHash: "" } Result { Offset: 47 Data: "... 106 bytes ..." SourceId: "\000src_id" SeqNo: 48 WriteTimestampMS: 1762188688314 CreateTimestampMS: 1762188688213 UncompressedSize: 386 PartitionKey: "" ExplicitHash: "" } Result { Offset: 48 Data: "... 106 bytes ..." SourceId: "\000src_id" SeqNo: 49 WriteTimestampMS: 1762188688314 CreateTimestampMS: 1762188688213 UncompressedSize: 394 PartitionKey: "" ExplicitHash: "" } Result { Offset: 49 Data: "... 106 bytes ..." SourceId: "\000src_id" SeqNo: 50 WriteTimestampMS: 1762188688314 CreateTimestampMS: 1762188688213 UncompressedSize: 402 PartitionKey: "" ExplicitHash: "" } Result { Offset: 50 Data: "... 106 bytes ..." SourceId: "\000src_id" SeqNo: 51 WriteTimestampMS: 1762188688314 CreateTimestampMS: 1762188688213 UncompressedSize: 410 PartitionKey: "" ExplicitHash: "" } Result { Offset: 51 Data: "... 106 bytes ..." SourceId: "\000src_id" SeqNo: 52 WriteTimestampMS: 1762188688314 CreateTimestampMS: 1762188688214 UncompressedSize: 418 PartitionKey: "" ExplicitHash: "" } Result { Offset: 52 Data: "... 106 bytes ..." SourceId: "\000src_id" SeqNo: 53 WriteTimestampMS: 1762188688314 CreateTimestampMS: 1762188688214 UncompressedSize: 426 PartitionKey: "" ExplicitHash: "" } Result { Offset: 53 Data: "... 106 bytes ..." SourceId: "\000src_id" SeqNo: 54 WriteTimestampMS: 1762188688316 CreateTimestampMS: 1762188688214 UncompressedSize: 434 PartitionKey: "" ExplicitHash: "" } Result { Offset: 54 Data: "... 106 bytes ..." SourceId: "\000src_id" SeqNo: 55 WriteTimestampMS: 1762188688316 CreateTimestampMS: 1762188688214 UncompressedSize: 442 PartitionKey: "" ExplicitHash: "" } Result { Offset: 55 Data: "... 106 bytes ..." SourceId: "\000src_id" SeqNo: 56 WriteTimestampMS: 1762188688316 CreateTimestampMS: 1762188688214 UncompressedSize: 450 PartitionKey: "" ExplicitHash: "" } Result { Offset: 56 Data: "... 106 bytes ..." SourceId: "\000src_id" SeqNo: 57 WriteTimestampMS: 1762188688316 CreateTimestampMS: 1762188688214 UncompressedSize: 458 PartitionKey: "" ExplicitHash: "" } Result { Offset: 57 Data: "... 106 bytes ..." SourceId: "\000src_id" SeqNo: 58 WriteTimestampMS: 1762188688316 CreateTimestampMS: 1762188688214 UncompressedSize: 466 PartitionKey: "" ExplicitHash: "" } Result { Offset: 58 Data: "... 106 bytes ..." SourceId: "\000src_id" SeqNo: 59 WriteTimestampMS: 1762188688316 CreateTimestampMS: 1762188688214 UncompressedSize: 474 PartitionKey: "" ExplicitHash: "" } Result { Offset: 59 Data: "... 106 bytes ..." SourceId: "\000src_id" SeqNo: 60 WriteTimestampMS: 1762188688316 CreateTimestampMS: 1762188688214 UncompressedSize: 482 PartitionKey: "" ExplicitHash: "" } Result { Offset: 60 Data: "... 106 bytes ..." SourceId: "\000src_id" SeqNo: 61 WriteTimestampMS: 1762188688316 CreateTimestampMS: 1762188688214 UncompressedSize: 490 PartitionKey: "" ExplicitHash: "" } Result { Offset: 61 Data: "... 106 bytes ..." SourceId: "\000src_id" SeqNo: 62 WriteTimestampMS: 1762188688316 CreateTimestampMS: 1762188688214 UncompressedSize: 498 PartitionKey: "" ExplicitHash: "" } Result { Offset: 62 Data: "... 106 bytes ..." SourceId: "\000src_id" SeqNo: 63 WriteTimestampMS: 1762188688316 CreateTimestampMS: 1762188688214 UncompressedSize: 506 PartitionKey: "" ExplicitHash: "" } Result { Offset: 63 Data: "... 106 bytes ..." SourceId: "\000src_id" SeqNo: 64 WriteTimestampMS: 1762188688316 CreateTimestampMS: 1762188688214 UncompressedSize: 514 PartitionKey: "" ExplicitHash: "" } Result { Offset: 64 Data: "... 106 bytes ..." SourceId: "\000src_id" SeqNo: 65 WriteTimestampMS: 1762188688316 CreateTimestampMS: 1762188688214 UncompressedSize: 522 PartitionKey: "" ExplicitHash: "" } Result { Offset: 65 Data: "... 107 bytes ..." SourceId: "\000src_id" SeqNo: 66 WriteTimestampMS: 1762188688316 CreateTimestampMS: 1762188688214 UncompressedSize: 530 PartitionKey: "" ExplicitHash: "" } Result { Offset: 66 Data: "... 107 bytes ..." SourceId: "\000src_id" SeqNo: 67 WriteTimestampMS: 1762188688316 CreateTimestampMS: 1762188688214 UncompressedSize: 538 PartitionKey: "" ExplicitHash: "" } Result { Offset: 67 Data: "... 107 bytes ..." SourceId: "\000src_id" SeqNo: 68 WriteTimestampMS: 1762188688316 CreateTimestampMS: 1762188688214 UncompressedSize: 546 PartitionKey: "" ExplicitHash: "" } Result { Offset: 68 Data: "... 107 bytes ..." SourceId: "\000src_id" SeqNo: 69 WriteTimestampMS: 1762188688316 CreateTimestampMS: 1762188688214 UncompressedSize: 554 PartitionKey: "" ExplicitHash: "" } Result { Offset: 69 Data: "... 107 bytes ..." SourceId: "\000src_id" SeqNo: 70 WriteTimestampMS: 1762188688316 CreateTimestampMS: 1762188688214 UncompressedSize: 562 PartitionKey: "" ExplicitHash: "" } Result { Offset: 70 Data: "... 107 bytes ..." SourceId: "\000src_id" SeqNo: 71 WriteTimestampMS: 1762188688316 CreateTimestampMS: 1762188688215 UncompressedSize: 570 PartitionKey: "" ExplicitHash: "" } Result { Offset: 71 Data: "... 107 bytes ..." SourceId: "\000src_id" SeqNo: 72 WriteTimestampMS: 1762188688316 CreateTimestampMS: 1762188688215 UncompressedSize: 578 PartitionKey: "" ExplicitHash: "" } Result { Offset: 72 Data: "... 107 bytes ..." SourceId: "\000src_id" SeqNo: 73 WriteTimestampMS: 1762188688316 CreateTimestampMS: 1762188688219 UncompressedSize: 586 PartitionKey: "" ExplicitHash: "" } Result { Offset: 73 Data: "... 107 bytes ..." SourceId: "\000src_id" SeqNo: 74 WriteTimestampMS: 1762188688316 CreateTimestampMS: 1762188688219 UncompressedSize: 594 PartitionKey: "" ExplicitHash: "" } Result { Offset: 74 Data: "... 107 bytes ..." SourceId: "\000src_id" SeqNo: 75 WriteTimestampMS: 1762188688316 CreateTimestampMS: 1762188688219 UncompressedSize: 602 PartitionKey: "" ExplicitHash: "" } Result { Offset: 75 Data: "... 107 bytes ..." SourceId: "\000src_id" SeqNo: 76 WriteTimestampMS: 1762188688316 CreateTimestampMS: 1762188688219 UncompressedSize: 610 PartitionKey: "" ExplicitHash: "" } Result { Offset: 76 Data: "... 107 bytes ..." SourceId: "\000src_id" SeqNo: 77 WriteTimestampMS: 1762188688316 CreateTimestampMS: 1762188688219 UncompressedSize: 618 PartitionKey: "" ExplicitHash: "" } Result { Offset: 77 Data: "... 107 bytes ..." SourceId: "\000src_id" SeqNo: 78 WriteTimestampMS: 1762188688316 CreateTimestampMS: 1762188688219 UncompressedSize: 626 PartitionKey: "" ExplicitHash: "" } Result { Offset: 78 Data: "... 107 bytes ..." SourceId: "\000src_id" SeqNo: 79 WriteTimestampMS: 1762188688316 CreateTimestampMS: 1762188688219 UncompressedSize: 634 PartitionKey: "" ExplicitHash: "" } Result { Offset: 79 Data: "... 107 bytes ..." SourceId: "\000src_id" SeqNo: 80 WriteTimestampMS: 1762188688316 CreateTimestampMS: 1762188688220 UncompressedSize: 642 PartitionKey: "" ExplicitHash: "" } Result { Offset: 80 Data: "... 107 bytes ..." SourceId: "\000src_id" SeqNo: 81 WriteTimestampMS: 1762188688316 CreateTimestampMS: 1762188688220 UncompressedSize: 650 PartitionKey: "" ExplicitHash: "" } Result { Offset: 81 Data: "... 108 bytes ..." SourceId: "\000src_id" SeqNo: 82 WriteTimestampMS: 1762188688316 CreateTimestampMS: 1762188688220 UncompressedSize: 658 PartitionKey: "" ExplicitHash: "" } Result { Offset: 82 Data: "... 108 bytes ..." SourceId: "\000src_id" SeqNo: 83 WriteTimestampMS: 1762188688316 CreateTimestampMS: 1762188688220 UncompressedSize: 666 PartitionKey: "" ExplicitHash: "" } Result { Offset: 83 Data: "... 108 bytes ..." SourceId: "\000src_id" SeqNo: 84 WriteTimestampMS: 1762188688316 CreateTimestampMS: 1762188688220 UncompressedSize: 674 PartitionKey: "" ExplicitHash: "" } Result { Offset: 84 Data: "... 108 bytes ..." SourceId: "\000src_id" SeqNo: 85 WriteTimestampMS: 1762188688316 CreateTimestampMS: 1762188688220 UncompressedSize: 682 PartitionKey: "" ExplicitHash: "" } Result { Offset: 85 Data: "... 108 bytes ..." SourceId: "\000src_id" SeqNo: 86 WriteTimestampMS: 1762188688316 CreateTimestampMS: 1762188688220 UncompressedSize: 690 PartitionKey: "" ExplicitHash: "" } Result { Offset: 86 Data: "... 108 bytes ..." SourceId: "\000src_id" SeqNo: 87 WriteTimestampMS: 1762188688316 CreateTimestampMS: 1762188688220 UncompressedSize: 698 PartitionKey: "" ExplicitHash: "" } Result { Offset: 87 Data: "... 108 bytes ..." SourceId: "\000src_id" SeqNo: 88 WriteTimestampMS: 1762188688316 CreateTimestampMS: 1762188688220 UncompressedSize: 706 PartitionKey: "" ExplicitHash: "" } Result { Offset: 88 Data: "... 108 bytes ..." SourceId: "\000src_id" SeqNo: 89 WriteTimestampMS: 1762188688316 CreateTimestampMS: 1762188688220 UncompressedSize: 714 PartitionKey: "" ExplicitHash: "" } Result { Offset: 89 Data: "... 108 bytes ..." SourceId: "\000src_id" SeqNo: 90 WriteTimestampMS: 1762188688316 CreateTimestampMS: 1762188688220 UncompressedSize: 722 PartitionKey: "" ExplicitHash: "" } Result { Offset: 90 Data: "... 108 bytes ..." SourceId: "\000src_id" SeqNo: 91 WriteTimestampMS: 1762188688316 CreateTimestampMS: 1762188688220 UncompressedSize: 730 PartitionKey: "" ExplicitHash: "" } Result { Offset: 91 Data: "... 108 bytes ..." SourceId: "\000src_id" SeqNo: 92 WriteTimestampMS: 1762188688316 CreateTimestampMS: 1762188688220 UncompressedSize: 738 PartitionKey: "" ExplicitHash: "" } Result { Offset: 92 Data: "... 108 bytes ..." SourceId: "\000src_id" SeqNo: 93 WriteTimestampMS: 1762188688316 CreateTimestampMS: 1762188688220 UncompressedSize: 746 PartitionKey: "" ExplicitHash: "" } Result { Offset: 93 Data: "... 108 bytes ..." SourceId: "\000src_id" SeqNo: 94 WriteTimestampMS: 1762188688316 CreateTimestampMS: 1762188688220 UncompressedSize: 754 PartitionKey: "" ExplicitHash: "" } Result { Offset: 94 Data: "... 108 bytes ..." SourceId: "\000src_id" SeqNo: 95 WriteTimestampMS: 1762188688316 CreateTimestampMS: 1762188688220 UncompressedSize: 762 PartitionKey: "" ExplicitHash: "" } Result { Offset: 95 Data: "... 108 bytes ..." SourceId: "\000src_id" SeqNo: 96 WriteTimestampMS: 1762188688316 CreateTimestampMS: 1762188688220 UncompressedSize: 770 PartitionKey: "" ExplicitHash: "" } Result { Offset: 96 Data: "... 108 bytes ..." SourceId: "\000src_id" SeqNo: 97 WriteTimestampMS: 1762188688316 CreateTimestampMS: 1762188688220 UncompressedSize: 778 PartitionKey: "" ExplicitHash: "" } Result { Offset: 97 Data: "... 108 bytes ..." SourceId: "\000src_id" SeqNo: 98 WriteTimestampMS: 1762188688316 CreateTimestampMS: 1762188688221 UncompressedSize: 786 PartitionKey: "" ExplicitHash: "" } Result { Offset: 98 Data: "... 109 bytes ..." SourceId: "\000src_id" SeqNo: 99 WriteTimestampMS: 1762188688316 CreateTimestampMS: 1762188688221 UncompressedSize: 794 PartitionKey: "" ExplicitHash: "" } Result { Offset: 99 Data: "... 109 bytes ..." SourceId: "\000src_id" SeqNo: 100 WriteTimestampMS: 1762188688317 CreateTimestampMS: 1762188688221 UncompressedSize: 802 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 4 SizeLag: 18446744073709538928 RealReadOffset: 99 WaitQuotaTimeMs: 0 EndOffset: 100 StartOffset: 0 } Cookie: 0 }
2025-11-03T16:51:28.463884Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_1_1_18093459630474583920_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 1 from offset 100
2025-11-03T16:51:28.463943Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_1_1_18093459630474583920_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 100 ReadOffset 100 ReadGuid 94d8ba98-78f13af2-f460e873-ec375e39 has messages 1
2025-11-03T16:51:28.464621Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_1_1_18093459630474583920_v1 read done: guid# 94d8ba98-78f13af2-f460e873-ec375e39, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 6322
2025-11-03T16:51:28.464670Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_1_1_18093459630474583920_v1 response to read: guid# 94d8ba98-78f13af2-f460e873-ec375e39
2025-11-03T16:51:28.469738Z :DEBUG: [/Root] [/Root] [c703675f-9f49d555-92cc9056-5fdd0866] [dc1] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:51:28.464993Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_1_1_18093459630474583920_v1 Process answer. Aval parts: 0
2025-11-03T16:51:28.470492Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_1_1_18093459630474583920_v1 grpc read done: success# 1, data# { read { } }
2025-11-03T16:51:28.470552Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_1_1_18093459630474583920_v1 got read request: guid# 77e285f7-70bcb970-744faae3-e8c1b548
2025-11-03T16:51:28.471735Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 0 (0-99)
2025-11-03T16:51:28.471841Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (0-0)
2025-11-03T16:51:28.471881Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 0} (1-1)
2025-11-03T16:51:28.471957Z :DEBUG: [/Root] Take Data. Partition 0. Read: {2, 0} (2-2)
2025-11-03T16:51:28.472008Z :DEBUG: [/Root] Take Data. Partition 0. Read: {3, 0} (3-3)
2025-11-03T16:51:28.472044Z :DEBUG: [/Root] Take Data. Partition 0. Read: {4, 0} (4-4)
2025-11-03T16:51:28.472072Z :DEBUG: [/Root] Take Data. Partition 0. Read: {4, 1} (5-5)
2025-11-03T16:51:28.472102Z :DEBUG: [/Root] Take Data. Partition 0. Read: {4, 2} (6-6)
2025-11-03T16:51:28.472135Z :DEBUG: [/Root] Take Data. Partition 0. Read: {4, 3} (7-7)
2025-11-03T16:51:28.472175Z :DEBUG: [/Root] Take Data. Partition 0. Read: {4, 4} (8-8)
2025-11-03T16:51:28.472196Z :DEBUG: [/Root] Take Data. Partition 0. Read: {4, 5} (9-9)
2025-11-03T16:51:28.472223Z :DEBUG: [/Root] Take Data. Partition 0. Read: {4, 6} (10-10)
2025-11-03T16:51:28.472250Z :DEBUG: [/Root] Take Data. Partition 0. Read: {4, 7} (11-11)
2025-11-03T16:51:28.472278Z :DEBUG: [/Root] Take Data. Partition 0. Read: {4, 8} (12-12)
2025-11-03T16:51:28.472301Z :DEBUG: [/Root] Take Data. Partition 0. Read: {4, 9} (13-13)
2025-11-03T16:51:28.472328Z :DEBUG: [/Root] Take Data. Partition 0. Read: {4, 10} (14-14)
2025-11-03T16:51:28.472351Z :DEBUG: [/Root] Take Data. Partition 0. Read: {5, 0} (15-15)
2025-11-03T16:51:28.472435Z :DEBUG: [/Root] Take Data. Partition 0. Read: {5, 1} (16-16)
2025-11-03T16:51:28.472467Z :DEBUG: [/Root] Take Data. Partition 0. Read: {5, 2} (17-17)
2025-11-03T16:51:28.472496Z :DEBUG: [/Root] Take Data. Partition 0. Read: {5, 3} (18-18)
2025-11-03T16:51:28.472519Z :DEBUG: [/Root] Take Data. Partition 0. Read: {5, 4} (19-19)
2025-11-03T16:51:28.472543Z :DEBUG: [/Root] Take Data. Partition 0. Read: {5, 5} (20-20)
2025-11-03T16:51:28.472570Z :DEBUG: [/Root] Take Data. Partition 0. Read: {5, 6} (21-21)
2025-11-03T16:51:28.472594Z :DEBUG: [/Root] Take Data. Partition 0. Read: {5, 7} (22-22)
2025-11-03T16:51:28.472618Z :DEBUG: [/Root] Take Data. Partition 0. Read: {5, 8} (23-23)
2025-11-03T16:51:28.472646Z :DEBUG: [/Root] Take Data. Partition 0. Read: {5, 9} (24-24)
2025-11-03T16:51:28.472673Z :DEBUG: [/Root] Take Data. Partition 0. Read: {5, 10} (25-25)
2025-11-03T16:51:28.472697Z :DEBUG: [/Root] Take Data. Partition 0. Read: {5, 11} (26-26)
2025-11-03T16:51:28.472724Z :DEBUG: [/Root] Take Data. Partition 0. Read: {5, 12} (27-27)
2025-11-03T16:51:28.472751Z :DEBUG: [/Root] Take Data. Partition 0. Read: {5, 13} (28-28)
2025-11-03T16:51:28.472778Z :DEBUG: [/Root] Take Data. Partition 0. Read: {5, 14} (29-29)
2025-11-03T16:51:28.472804Z :DEBUG: [/Root] Take Data. Partition 0. Read: {5, 15} (30-30)
2025-11-03T16:51:28.472828Z :DEBUG: [/Root] Take Data. Partition 0. Read: {5, 16} (31-31)
2025-11-03T16:51:28.472897Z :DEBUG: [/Root] Take Data. Partition 0. Read: {5, 17} (32-32)
2025-11-03T16:51:28.472918Z :DEBUG: [/Root] Take Data. Partition 0. Read: {5, 18} (33-33)
2025-11-03T16:51:28.472947Z :DEBUG: [/Root] Take Data. Partition 0. Read: {5, 19} (34-34)
2025-11-03T16:51:28.472972Z :DEBUG: [/Root] Take Data. Partition 0. Read: {5, 20} (35-35)
2025-11-03T16:51:28.472998Z :DEBUG: [/Root] Take Data. Partition 0. Read: {5, 21} (36-36)
2025-11-03T16:51:28.473024Z :DEBUG: [/Root] Take Data. Partition 0. Read: {5, 22} (37-37)
2025-11-03T16:51:28.473046Z :DEBUG: [/Root] Take Data. Partition 0. Read: {5, 23} (38-38)
2025-11-03T16:51:28.473070Z :DEBUG: [/Root] Take Data. Partition 0. Read: {5, 24} (39-39)
2025-11-03T16:51:28.473095Z :DEBUG: [/Root] Take Data. Partition 0. Read: {5, 25} (40-40)
2025-11-03T16:51:28.473117Z :DEBUG: [/Root] Take Data. Partition 0. Read: {5, 26} (41-41)
2025-11-03T16:51:28.473147Z :DEBUG: [/Root] Take Data. Partition 0. Read: {5, 27} (42-42)
2025-11-03T16:51:28.473174Z :DEBUG: [/Root] Take Data. Partition 0. Read: {5, 28} (43-43)
2025-11-03T16:51:28.473199Z :DEBUG: [/Root] Take Data. Partition 0. Read: {5, 29} (44-44)
2025-11-03T16:51:28.473222Z :DEBUG: [/Root] Take Data. Partition 0. Read: {5, 30} (45-45)
2025-11-03T16:51:28.473251Z :DEBUG: [/Root] Take Data. Partition 0. Read: {5, 31} (46-46)
2025-11-03T16:51:28.473275Z :DEBUG: [/Root] Take Data. Partition 0. Read: {5, 32} (47-47)
2025-11-03T16:51:28.473298Z :DEBUG: [/Root] Take Data. Partition 0. Read: {5, 33} (48-48)
2025-11-03T16:51:28.473318Z :DEBUG: [/Root] Take Data. Partition 0. Read: {5, 34} (49-49)
2025-11-03T16:51:28.473351Z :DEBUG: [/Root] Take Data. Partition 0. Read: {5, 35} (50-50)
2025-11-03T16:51:28.473375Z :DEBUG: [/Root] Take Data. Partition 0. Read: {5, 36} (51-51)
2025-11-03T16:51:28.473409Z :DEBUG: [/Root] Take Data. Partition 0. Read: {5, 37} (52-52)
2025-11-03T16:51:28.473441Z :DEBUG: [/Root] Take Data. Partition 0. Read: {6, 0} (53-53)
2025-11-03T16:51:28.473470Z :DEBUG: [/Root] Take Data. Partition 0. Read: {6, 1} (54-54)
2025-11-03T16:51:28.473503Z :DEBUG: [/Root] Take Data. Partition 0. Read: {6, 2} (55-55)
2025-11-03T16:51:28.473535Z :DEBUG: [/Root] Take Data. Partition 0. Read: {6, 3} (56-56)
2025-11-03T16:51:28.473556Z :DEBUG: [/Root] Take Data. Partition 0. Read: {6, 4} (57-57)
2025-11-03T16:51:28.473578Z :DEBUG: [/Root] Take Data. Partition 0. Read: {6, 5} (58-58)
2025-11-03T16:51:28.473602Z :DEBUG: [/Root] Take Data. Partition 0. Read: {6, 6} (59-59)
2025-11-03T16:51:28.473628Z :DEBUG: [/Root] Take Data. Partition 0. Read: {6, 7} (60-60)
2025-11-03T16:51:28.473655Z :DEBUG: [/Root] Take Data. Partition 0. Read: {6, 8} (61-61)
2025-11-03T16:51:28.473700Z :DEBUG: [/Root] Take Data. Partition 0. Read: {6, 9} (62-62)
2025-11-03T16:51:28.473725Z :DEBUG: [/Root] Take Data. Partition 0. Read: {6, 10} (63-63)
2025-11-03T16:51:28.473903Z :DEBUG: [/Root] Take Data. Partition 0. Read: {6, 11} (64-64)
2025-11-03T16:51:28.473930Z :DEBUG: [/Root] Take Data. Partition 0. Read: {6, 12} (65-65)
2025-11-03T16:51:28.473966Z :DEBUG: [/Root] Take Data. Partition 0. Read: {6, 13} (66-66)
2025-11-03T16:51:28.473991Z :DEBUG: [/Root] Take Data. Partition 0. Read: {6, 14} (67-67)
2025-11-03T16:51:28.474016Z :DEBUG: [/Root] Take Data. Partition 0. Read: {6, 15} (68-68)
2025-11-03T16:51:28.474042Z :DEBUG: [/Root] Take Data. Partition 0. Read: {6, 16} (69-69)
2025-11-03T16:51:28.474079Z :DEBUG: [/Root] Take Data. Partition 0. Read: {6, 17} (70-70)
2025-11-03T16:51:28.474109Z :DEBUG: [/Root] Take Data. Partition 0. Read: {6, 18} (71-71)
2025-11-03T16:51:28.474137Z :DEBUG: [/Root] Take Data. Partition 0. Read: {6, 19} (72-72)
2025-11-03T16:51:28.474162Z :DEBUG: [/Root] Take Data. Partition 0. Read: {6, 20} (73-73)
2025-11-03T16:51:28.474187Z :DEBUG: [/Root] Take Data. Partition 0. Read: {6, 21} (74-74)
2025-11-03T16:51:28.474215Z :DEBUG: [/Root] Take Data. Partition 0. Read: {6, 22} (75-75)
2025-11-03T16:51:28.474263Z :DEBUG: [/Root] Take Data. Partition 0. Read: {6, 23} (76-76)
2025-11-03T16:51:28.474287Z :DEBUG: [/Root] Take Data. Partition 0. Read: {6, 24} (77-77)
2025-11-03T16:51:28.474313Z :DEBUG: [/Root] Take Data. Partition 0. Read: {6, 25} (78-78)
2025-11-03T16:51:28.474336Z :DEBUG: [/Root] Take Data. Partition 0. Read: {6, 26} (79-79)
2025-11-03T16:51:28.474361Z :DEBUG: [/Root] Take Data. Partition 0. Read: {6, 27} (80-80)
2025-11-03T16:51:28.474388Z :DEBUG: [/Root] Take Data. Partition 0. Read: {6, 28} (81-81)
2025-11-03T16:51:28.474418Z :DEBUG: [/Root] Take Data. Partition 0. Read: {6, 29} (82-82)
2025-11-03T16:51:28.474464Z :DEBUG: [/Root] Take Data. Partition 0. Read: {6, 30} (83-83)
2025-11-03T16:51:28.474497Z :DEBUG: [/Root] Take Data. Partition 0. Read: {6, 31} (84-84)
2025-11-03T16:51:28.474537Z :DEBUG: [/Root] Take Data. Partition 0. Read: {6, 32} (85-85)
2025-11-03T16:51:28.474570Z :DEBUG: [/Root] Take Data. Partition 0. Read: {6, 33} (86-86)
2025-11-03T16:51:28.474600Z :DEBUG: [/Root] Take Data. Partition 0. Read: {6, 34} (87-87)
2025-11-03T16:51:28.474627Z :DEBUG: [/Root] Take Data. Partition 0. Read: {6, 35} (88-88)
2025-11-03T16:51:28.474652Z :DEBUG: [/Root] Take Data. Partition 0. Read: {6, 36} (89-89)
2025-11-03T16:51:28.474746Z :DEBUG: [/Root] Take Data. Partition 0. Read: {6, 37} (90-90)
2025-11-03T16:51:28.474774Z :DEBUG: [/Root] Take Data. Partition 0. Read: {6, 38} (91-91)
2025-11-03T16:51:28.474802Z :DEBUG: [/Root] Take Data. Partition 0. Read: {6, 39} (92-92)
2025-11-03T16:51:28.474823Z :DEBUG: [/Root] Take Data. Partition 0. Read: {6, 40} (93-93)
2025-11-03T16:51:28.474849Z :DEBUG: [/Root] Take Data. Partition 0. Read: {6, 41} (94-94)
2025-11-03T16:51:28.474870Z :DEBUG: [/Root] Take Data. Partition 0. Read: {6, 42} (95-95)
2025-11-03T16:51:28.474897Z :DEBUG: [/Root] Take Data. Partition 0. Read: {6, 43} (96-96)
2025-11-03T16:51:28.474918Z :DEBUG: [/Root] Take Data. Partition 0. Read: {6, 44} (97-97)
2025-11-03T16:51:28.474956Z :DEBUG: [/Root] Take Data. Partition 0. Read: {6, 45} (98-98)
2025-11-03T16:51:28.474978Z :DEBUG: [/Root] Take Data. Partition 0. Read: {7, 0} (99-99)
2025-11-03T16:51:28.475235Z :DEBUG: [/Root] [/Root] [c703675f-9f49d555-92cc9056-5fdd0866] [dc1] The application data is transferred to the client. Number of messages 100, size 40590 bytes
2025-11-03T16:51:28.475571Z :INFO: [/Root] [/Root] [c703675f-9f49d555-92cc9056-5fdd0866] Closing read session. Close timeout: 0.010000s
2025-11-03T16:51:28.475604Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): dc1:test-topic:0:1:99:0
2025-11-03T16:51:28.475634Z :INFO: [/Root] [/Root] [c703675f-9f49d555-92cc9056-5fdd0866] Counters: { Errors: 0 CurrentSessionLifetimeMs: 50 BytesRead: 40590 MessagesRead: 100 BytesReadCompressed: 3467 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-11-03T16:51:28.476186Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be96265-2c8fefb1-36bce8dc-7f5920b4_0] Write session: destroy
2025-11-03T16:51:28.476809Z :INFO: [/Root] [/Root] [c703675f-9f49d555-92cc9056-5fdd0866] Closing read session. Close timeout: 0.000000s
2025-11-03T16:51:28.476840Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): dc1:test-topic:0:1:99:0
2025-11-03T16:51:28.476866Z :INFO: [/Root] [/Root] [c703675f-9f49d555-92cc9056-5fdd0866] Counters: { Errors: 0 CurrentSessionLifetimeMs: 52 BytesRead: 40590 MessagesRead: 100 BytesReadCompressed: 3467 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-11-03T16:51:28.476953Z :NOTICE: [/Root] [/Root] [c703675f-9f49d555-92cc9056-5fdd0866] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
2025-11-03T16:51:28.480233Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_1_1_18093459630474583920_v1 grpc read done: success# 0, data# {  }
2025-11-03T16:51:28.480266Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:125: session cookie 1 consumer shared/user session shared/user_1_1_18093459630474583920_v1 grpc read failed
2025-11-03T16:51:28.480298Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:92: session cookie 1 consumer shared/user session shared/user_1_1_18093459630474583920_v1 grpc closed
2025-11-03T16:51:28.480335Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 1 consumer shared/user session shared/user_1_1_18093459630474583920_v1 is DEAD
2025-11-03T16:51:28.481202Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1659: [72075186224037893][rt3.dc1--test-topic] pipe [1:7568542784992990815:2485] disconnected.
2025-11-03T16:51:28.481220Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1670: [72075186224037893][rt3.dc1--test-topic] pipe [1:7568542784992990815:2485] disconnected; active server actors: 1
2025-11-03T16:51:28.481242Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1679: [72075186224037893][rt3.dc1--test-topic] pipe [1:7568542784992990815:2485] client user disconnected session shared/user_1_1_18093459630474583920_v1
2025-11-03T16:51:28.484745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2258: [PQ: 72075186224037892] Destroy direct read session shared/user_1_1_18093459630474583920_v1
2025-11-03T16:51:28.484784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [1:7568542784992990818:2488] destroyed
2025-11-03T16:51:28.484837Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_1_18093459630474583920_v1
2025-11-03T16:51:28.510468Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:28.510502Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:28.510513Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:28.611123Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:28.611153Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:28.611164Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:28.711235Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:28.711264Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:28.711273Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:29.976052Z :WriteAndReadSomeMessagesWithSyncCompression INFO: Random seed for debugging is 1762188689976037
2025-11-03T16:51:30.604820Z node 3 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[3:7568542793833505344:2153];send_to=[0:7307199536658146131:7762515];
2025-11-03T16:51:30.606436Z node 3 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
test_client.cpp: SetPath # /home/runner/.ya/build/build_root/7jz3/001974/r3tmp/tmpGnJJ2V/pdisk_1.dat
2025-11-03T16:51:30.658451Z node 3 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-11-03T16:51:30.658914Z node 3 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-11-03T16:51:30.682083Z node 4 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-11-03T16:51:30.683499Z node 4 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-11-03T16:51:30.683763Z node 4 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=incorrect path status: LookupError;
2025-11-03T16:51:30.792713Z node 3 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
2025-11-03T16:51:30.819219Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(3, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-11-03T16:51:30.819306Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(3, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-11-03T16:51:30.821227Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(4, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-11-03T16:51:30.821300Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(4, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-11-03T16:51:30.830252Z node 3 :HIVE WARN: hive_impl.cpp:811: HIVE#72057594037968897 Handle TEvInterconnect::TEvNodeConnected, NodeId 4 Cookie 4
2025-11-03T16:51:30.830409Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(3, (0,0,0,0)) VolatileState: Connecting -> Connected
2025-11-03T16:51:30.831455Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(4, (0,0,0,0)) VolatileState: Connecting -> Connected
TServer::EnableGrpc on GrpcPort 21474, node 3
2025-11-03T16:51:30.893403Z node 4 :BS_NODE WARN: {NWDC01@distconf.cpp:397} StateFunc too long Type# 268639239 Duration# 0.007384s
2025-11-03T16:51:30.927830Z node 3 :NET_CLASSIFIER WARN: net_classifier.cpp:190: distributable config is empty, broken or outdated, will use file: /home/runner/.ya/build/build_root/7jz3/001974/r3tmp/yandexlTPHq7.tmp
2025-11-03T16:51:30.927861Z node 3 :NET_CLASSIFIER WARN: net_classifier.cpp:196: will try to initialize from file: /home/runner/.ya/build/build_root/7jz3/001974/r3tmp/yandexlTPHq7.tmp
2025-11-03T16:51:30.928054Z node 3 :NET_CLASSIFIER WARN: net_classifier.cpp:202: successfully initialized from file: /home/runner/.ya/build/build_root/7jz3/001974/r3tmp/yandexlTPHq7.tmp
2025-11-03T16:51:30.928222Z node 3 :NET_CLASSIFIER ERROR: net_classifier.cpp:228: got bad distributable configuration
2025-11-03T16:51:30.956064Z node 3 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-11-03T16:51:30.973802Z node 4 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-11-03T16:51:30.975560Z INFO: TTestServer started on Port 12531 GrpcPort 21474
TClient is connected to server localhost:12531
PQClient connected to localhost:21474
WaitRootIsUp 'Root'...
TClient::Ls request: Root
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "Root"
    PathId: 1
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 1
    CreateStep: 0
    ParentPathId: 1
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 1
      SubDomainVersion: 0
      SecurityStateVersion: 0
    }
    ChildrenExist: false
  }
  Children {
    Name: ".sys"
    PathId: 18446744073709551615
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 0
    CreateStep: 0
    ParentPathId: 18446744073709551615
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 0
      Pl...
(TRUNCATED)
WaitRootIsUp 'Root' success.
2025-11-03T16:51:31.234179Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpAlterSubDomain, opId: 281474976710657:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_alter_subdomain.cpp:311)
waiting...
waiting...
waiting...
waiting...
2025-11-03T16:51:31.611383Z node 3 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-11-03T16:51:31.665252Z node 4 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-11-03T16:51:34.659901Z node 4 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [4:7568542812863337427:2299], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-03T16:51:34.660025Z node 4 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-03T16:51:34.660040Z node 4 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [4:7568542812863337438:2302], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-03T16:51:34.661326Z node 4 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [4:7568542812863337443:2303], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-03T16:51:34.661448Z node 4 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-03T16:51:34.669774Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateResourcePool, opId: 281474976720657:3, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_resource_pool.cpp:179)
2025-11-03T16:51:34.716331Z node 4 :KQP_WORKLOAD_SERVICE WARN: helpers.h:73: [WorkloadService] [TPoolCreatorActor] ActorId: [4:7568542812863337444:2304], DatabaseId: /Root, PoolId: default, Scheduled retry for error: { <main>: Error: Transaction 281474976720657 completed, doublechecking }
2025-11-03T16:51:34.735154Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710661:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:690)
2025-11-03T16:51:34.738618Z node 3 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:570: Compilation failed, self: [3:7568542811013375457:2335], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-11-03T16:51:34.742542Z node 3 :KQP_SESSION WARN: kqp_session_actor.cpp:2506: SessionId: ydb://session/3?node_id=3&id=Mzk4ZDlmNmUtMjdiODNhYzYtNTZhYjY4MDMtNzMwMGVjYzE=, ActorId: [3:7568542811013375391:2325], ActorState: ExecuteState, TraceId: 01k95a354z5jtkg51vq918zavf, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-11-03T16:51:34.742935Z node 3 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-11-03T16:51:34.797890Z node 4 :TX_PROXY ERROR: schemereq.cpp:593: Actor# [4:7568542812863337527:2173] txid# 281474976720658, issues: { message: "Check failed: path: \'/Root/.metadata/workload_manager/pools/default\', error: path exist, request accepts it (id: [OwnerId: 72057594046644480, LocalPathId: 8], type: EPathTypeResourcePool, state: EPathStateNoChanges)" severity: 1 }
2025-11-03T16:51:34.815275Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710662:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:690)
2025-11-03T16:51:34.845973Z node 4 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:570: Compilation failed, self: [4:7568542812863337549:2312], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:5:17: Error: At function: KiReadTable!
        <main>:5:17: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Versions]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-11-03T16:51:34.846206Z node 4 :KQP_SESSION WARN: kqp_session_actor.cpp:2506: SessionId: ydb://session/3?node_id=4&id=ZWMzMTg3NDctZGNjNmYyMTItOGZjNTc1N2QtY2JiNzQwMzQ=, ActorId: [4:7568542812863337417:2298], ActorState: ExecuteState, TraceId: 01k95a353tddz8z74xdm6ydw44, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-11-03T16:51:34.846714Z node 4 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 5 column: 17 } message: "At function: KiReadTable!" end_position { row: 5 column: 17 } severity: 1 issues { position { row: 5 column: 17 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Versions]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 5 column: 17 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-11-03T16:51:34.980861Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710663:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:690)
=== Init DC: UPSERT INTO `/Root/PQ/Config/V2/Cluster` (name, balancer, local, enabled, weight) VALUES ("dc1", "localhost:21474", true, true, 1000);
2025-11-03T16:51:35.265914Z node 3 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976710664. Ctx: { TraceId: 01k95a35j2eeawxxngrxr82hg5, Database: , SessionId: ydb://session/3?node_id=3&id=NGQ4MWRiMi05ODY1ODhlYS03NDQyMTU4MS1mNDZhNzI3Mw==, PoolId: default, DatabaseId: /Root}. Database not set, use /Root
=== CheckClustersList. Subcribe to ClusterTracker from [3:7568542815308343185:2963] 
2025-11-03T16:51:35.606797Z node 3 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[3:7568542793833505344:2153];send_to=[0:7307199536658146131:7762515];
2025-11-03T16:51:35.606863Z node 3 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
=== CheckClustersList. Ok
2025-11-03T16:51:42.826186Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710669:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:690)
waiting...
PQ Client: create topic: rt3.dc1--test-topic with 1 partitions
CallPersQueueGRPC request to localhost:21474
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-11-03T16:51:42.959462Z node 3 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
CallPersQueueGRPC request to localhost:21474
MetaRequest {
  CmdCreateTopic {
    Topic: "rt3.dc1--test-topic"
    NumPartitions: 1
    Config {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
  }
}
CallPersQueueGRPC response:
Status: 129
ProxyErrorCode: 53
SchemeStatus: 1
FlatTxId {
  TxId: 281474976710670
  SchemeShardTabletId: 72057594046644480
  PathId: 13
}
ErrorCode: OK
AddTopic: rt3.dc1--test-topic
===Run query:``DECLARE $version as Int64; DECLARE $path AS Utf8; DECLARE $cluster as Utf8; UPSERT INTO `/Root/PQ/Config/V2/Topics` (path, dc) VALUES ($path, $cluster); UPSERT INTO `/Root/PQ/Config/V2/Versions` (name, version) VALUES ("Topics", $version);`` with topic = test-topic, dc = dc1
2025-11-03T16:51:43.038238Z node 3 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1655: [72075186224037893][] pipe [3:7568542849668082001:3250] connected; active server actors: 1
2025-11-03T16:51:43.038394Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1519: [72075186224037893][rt3.dc1--test-topic] updating configuration. Deleted partitions []. Added partitions [0]
2025-11-03T16:51:43.040468Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:971: [72075186224037893][rt3.dc1--test-topic] Discovered subdomain [OwnerId: 72057594046644480, LocalPathId: 1] state, outOfSpace = 0 at RB 72075186224037893
2025-11-03T16:51:43.043079Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:140: [72075186224037893][rt3.dc1--test-topic] BALANCER INIT DONE for rt3.dc1--test-topic: (0, 72075186224037892) 
2025-11-03T16:51:43.048095Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2960: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-11-03T16:51:43.051689Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2992: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-11-03T16:51:43.051900Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:787: [PQ: 72075186224037892] no config, start with empty partitions and default config
2025-11-03T16:51:43.051923Z node 4 :PERSQUEUE NOTICE: pq_impl.cpp:913: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-11-03T16:51:43.051955Z node 4 :PERSQUEUE INFO: pq_impl.cpp:612: [PQ: 72075186224037892] doesn't have tx writes info
2025-11-03T16:51:43.052431Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [3:7568542849668082025:2437], now have 1 active actors on pipe
2025-11-03T16:51:43.052458Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [3:7568542849668081993:3245], now have 1 active actors on pipe
2025-11-03T16:51:43.053819Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:404: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 4, Generation 1
2025-11-03T16:51:43.055065Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-03T16:51:43.059044Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-03T16:51:43.066677Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [3:7568542849668082047:3288], now have 1 active actors on pipe
2025-11-03T16:51:43.067856Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-03T16:51:43.072193Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-03T16:51:43.073211Z node 4 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-11-03T16:51:43.073260Z node 4 :PERSQUEUE DEBUG: partition.cpp:1312: [72075186224037892][Partition][0][StateInit] HandleOnInit TEvPQ::TEvProposePartitionConfig
2025-11-03T16:51:43.073549Z node 4 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-11-03T16:51:43.073782Z node 4 :PERSQUEUE INFO: partition_init.cpp:1101: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [4:7568542851518043601:2385]
2025-11-03T16:51:43.080204Z node 4 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-11-03T16:51:43.080237Z node 4 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-11-03T16:51:43.080262Z node 4 :PERSQUEUE INFO: partition.cpp:707: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1 [4:7568542851518043601:2385]
2025-11-03T16:51:43.080286Z node 4 :PERSQUEUE DEBUG: partition.cpp:727: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 0 Head Offset 0 PartNo 0 PackedSize 0 count 0 nextOffset 0 batches 0
2025-11-03T16:51:43.080320Z node 4 :PERSQUEUE DEBUG: partition_mlp.cpp:83: [72075186224037892][Partition][0][StateIdle] Initializing MLP Consumers: 0
2025-11-03T16:51:43.081621Z node 4 :PERSQUEUE DEBUG: partition.cpp:4273: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 1
2025-11-03T16:51:43.081653Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:43.081718Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:43.081730Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-03T16:51:43.081747Z node 4 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-11-03T16:51:43.081759Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:43.081770Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:43.081779Z node 4 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-11-03T16:51:43.081806Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:923: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-11-03T16:51:43.081841Z node 4 :PERSQUEUE DEBUG: partition_mlp.cpp:60: [72075186224037892][Partition][0][StateIdle] Process MLP pending events. Count 0
2025-11-03T16:51:43.082353Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-03T16:51:43.082499Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:183: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:51:43.108777Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-03T16:51:43.108928Z node 4 :PERSQUEUE DEBUG: partition.cpp:1416: [72075186224037892][Partition][0][StateIdle] Handle TEvPQ::TEvTxCommit Step 1762188703107, TxId 281474976710670
2025-11-03T16:51:43.108950Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:43.108963Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:43.109059Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:43.109224Z node 4 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-03T16:51:43.124526Z node 4 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-03T16:51:43.126046Z node 4 :PERSQUEUE DEBUG: partition_mlp.cpp:83: [72075186224037892][Partition][0][StateIdle] Initializing MLP Consumers: 0
2025-11-03T16:51:43.126176Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-11-03T16:51:43.126198Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:43.126210Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:43.126220Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:43.126248Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:183: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:51:43.126558Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:398: [PQ: 72075186224037892] Apply new config PartitionConfig { LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 } PartitionIds: 0 TopicName: "rt3.dc1--test-topic" Version: 0 LocalDC: true Codecs { Ids: 0 Ids: 1 Ids: 2 Codecs: "raw" Codecs: "gzip" Codecs: "lzop" } TopicPath: "/Root/PQ/rt3.dc1--test-topic" YcCloudId: "" YcFolderId: "" YdbDatabaseId: "" YdbDatabasePath: "/Root" Partitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } AllPartitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } Consumers { Name: "user" ReadFromTimestampsMs: 0 FormatVersion: 0 Version: 0 Generation: 0 } MonitoringProjectId: ""
2025-11-03T16:51:43.126628Z node 4 :PERSQUEUE NOTICE: pq_impl.cpp:913: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-11-03T16:51:43.126882Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-03T16:51:43.137656Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-03T16:51:43.137740Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-03T16:51:43.140679Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-03T16:51:43.183544Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:43.183577Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:43.183588Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:43.197482Z node 3 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976710671. Ctx: { TraceId: 01k95a3d9t0zcnjgj45qycczet, Database: , SessionId: ydb://session/3?node_id=3&id=ZWFiOTg0NWMtMmZkZmZkMjEtOGQwNGQ3NTEtODI4OTBjMjY=, PoolId: default, DatabaseId: /Root}. Database not set, use /Root
===Query complete
TClient::Ls request: /Root/PQ/rt3.dc1--test-topic
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976710670
    CreateStep: 1762188703107
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts...
(TRUNCATED)
GetTopicVersionFromPath:  record Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976710670
    CreateStep: 1762188703107
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      YdbDatabasePath: "/Root"
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
    Partitions {
      PartitionId: 0
      TabletId: 72075186224037892
      Status: Active
    }
    AlterVersion: 1
    BalancerTabletID: 72075186224037893
    NextPartitionId: 1
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 1
      PlanResolution: 7
      Coordinators: 72057594046316545
      TimeCastBucketsPerMediator: 2
      Mediators: 72057594046382081
    }
    DomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    PathsInside: 12
    PathsLimit: 10000
    ShardsInside: 6
    ShardsLimit: 200000
    ResourcesDomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    DiskSpaceUsage {
      Tables {
        TotalSize: 0
        DataSize: 0
        IndexSize: 0
      }
      Topics {
        ReserveSize: 0
        AccountSize: 0
        DataSize: 0
        UsedReserveSize: 0
      }
    }
    PQPartitionsInside: 1
    PQPartitionsLimit: 1000000
    SchemeLimits {
      MaxDepth: 32
      MaxPaths: 10000
      MaxChildrenInDir: 100000
      MaxAclBytesSize: 10240
      MaxTableColumns: 200
      MaxTableColumnNameLength: 255
      MaxTableKeyColumns: 30
      MaxTableIndices: 20
      MaxShards: 200000
      MaxShardsInPath: 35000
      MaxConsistentCopyTargets: 10000
      MaxPathElementLength: 255
      ExtraPathSymbolsAllowed: "!\"#$%&\'()*+,-.:;<=>?@[\\]^_`{|}~"
      MaxPQPartitions: 1000000
      MaxTableCdcStreams: 5
      MaxExports: 10
      MaxImports: 10
      MaxColumnTableColumns: 10000
    }
  }
}
Path: "/Root/PQ/rt3.dc1--test-topic"
 name rt3.dc1--test-topic version1
CallPersQueueGRPC request to localhost:21474
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
MetaResponse {
  CmdGetTopicMetadataResult {
    TopicInfo {
      Topic: "rt3.dc1--test-topic"
      NumPartitions: 1
      Config {
        PartitionConfig {
          LifetimeSeconds: 86400
          LowWatermark: 8388608
          SourceIdLifetimeSeconds: 86400
          WriteSpeedInBytesPerSecond: 20000000
          BurstSize: 20000000
          SourceIdMaxCounts: 6000000
        }
        Version: 1
        LocalDC: true
        Codecs {
          Ids: 0
          Ids: 1
          Ids: 2
          Codecs: "raw"
          Codecs: "gzip"
          Codecs: "lzop"
        }
        TopicPath: "/Root/PQ/rt3.dc1--test-topic"
        YdbDatabasePath: "/Root"
        Consumers {
          Name: "user"
          ReadFromTimestampsMs: 0
          FormatVersion: 0
          Version: 0
        }
      }
      ErrorCode: OK
    }
  }
}
=== Topic created, have version: 1
2025-11-03T16:51:43.247511Z node 3 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
2025-11-03T16:51:43.264487Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: try to update token
2025-11-03T16:51:43.264888Z :INFO: [] MessageGroupId [src] SessionId [] Write session: Do CDS request
2025-11-03T16:51:43.264922Z :INFO: [] MessageGroupId [src] SessionId [] Start write session. Will connect to endpoint: localhost:21474
2025-11-03T16:51:43.277017Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src" }
2025-11-03T16:51:43.281236Z node 3 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-11-03T16:51:43.281274Z node 3 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1
2025-11-03T16:51:43.282322Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src" }
2025-11-03T16:51:43.282417Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1 topic: "test-topic" message_group_id: "src" from ipv6:[::1]:37448
2025-11-03T16:51:43.282433Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37448 proto=v1  topic=test-topic durationSec=0
2025-11-03T16:51:43.282443Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-11-03T16:51:43.283849Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1 sessionId:  describe result for acl check
2025-11-03T16:51:43.283940Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-11-03T16:51:43.283949Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-11-03T16:51:43.283958Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-11-03T16:51:43.283973Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [3:7568542849668082131:2453] (SourceId=src, PreferedPartition=(NULL)) StartKqpSession
2025-11-03T16:51:43.286487Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [3:7568542849668082131:2453] (SourceId=src, PreferedPartition=(NULL)) Select from the table
2025-11-03T16:51:43.289494Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:43.289525Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:43.289537Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:43.389808Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:43.389840Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:43.389854Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:43.492884Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:43.492912Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:43.492923Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:43.538113Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [3:7568542849668082131:2453] (SourceId=src, PreferedPartition=(NULL)) RequestPQRB
2025-11-03T16:51:43.538720Z node 3 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1655: [72075186224037893][rt3.dc1--test-topic] pipe [3:7568542849668082168:2453] connected; active server actors: 1
2025-11-03T16:51:43.538866Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [3:7568542849668082131:2453] (SourceId=src, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=src
2025-11-03T16:51:43.538883Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [3:7568542849668082131:2453] (SourceId=src, PreferedPartition=(NULL)) Update the table
2025-11-03T16:51:43.539366Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1659: [72075186224037893][rt3.dc1--test-topic] pipe [3:7568542849668082168:2453] disconnected.
2025-11-03T16:51:43.539384Z node 3 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1670: [72075186224037893][rt3.dc1--test-topic] pipe [3:7568542849668082168:2453] disconnected; active server actors: 1
2025-11-03T16:51:43.539400Z node 3 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1695: [72075186224037893][rt3.dc1--test-topic] pipe [3:7568542849668082168:2453] disconnected no session
2025-11-03T16:51:43.594622Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:43.594668Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:43.594683Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:43.654143Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [3:7568542849668082131:2453] (SourceId=src, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-11-03T16:51:43.654183Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [3:7568542849668082131:2453] (SourceId=src, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-11-03T16:51:43.654200Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [3:7568542849668082131:2453] (SourceId=src, PreferedPartition=(NULL)) Start idle
2025-11-03T16:51:43.654230Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-11-03T16:51:43.660688Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 4, Generation: 1
2025-11-03T16:51:43.661068Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [3:7568542849668082197:2453], now have 1 active actors on pipe
2025-11-03T16:51:43.661509Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:43.661552Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:43.661647Z node 4 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src|eb7fa7f-65291e5a-f8123aa3-5002e323_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src
2025-11-03T16:51:43.661709Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:43.661734Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:43.661748Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-03T16:51:43.661804Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:43.661864Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-03T16:51:43.661933Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-03T16:51:43.663341Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:43.663385Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:43.663475Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-03T16:51:43.665713Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1 partition: 0 MaxSeqNo: 0 sessionId: src|eb7fa7f-65291e5a-f8123aa3-5002e323_0
2025-11-03T16:51:43.668573Z :INFO: [] MessageGroupId [src] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1762188703668 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-11-03T16:51:43.669010Z :INFO: [] MessageGroupId [src] SessionId [] Write session established. Init response: session_id: "src|eb7fa7f-65291e5a-f8123aa3-5002e323_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-11-03T16:51:43.669189Z :INFO: [] MessageGroupId [src] SessionId [src|eb7fa7f-65291e5a-f8123aa3-5002e323_0] Write session: close. Timeout = 0 ms
2025-11-03T16:51:43.669228Z :INFO: [] MessageGroupId [src] SessionId [src|eb7fa7f-65291e5a-f8123aa3-5002e323_0] Write session will now close
2025-11-03T16:51:43.669268Z :DEBUG: [] MessageGroupId [src] SessionId [src|eb7fa7f-65291e5a-f8123aa3-5002e323_0] Write session: aborting
2025-11-03T16:51:43.669630Z :INFO: [] MessageGroupId [src] SessionId [src|eb7fa7f-65291e5a-f8123aa3-5002e323_0] Write session: gracefully shut down, all writes complete
2025-11-03T16:51:43.669664Z :DEBUG: [] MessageGroupId [src] SessionId [src|eb7fa7f-65291e5a-f8123aa3-5002e323_0] Write session: destroy
2025-11-03T16:51:43.679237Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId: src|eb7fa7f-65291e5a-f8123aa3-5002e323_0 grpc read done: success: 0 data: 
2025-11-03T16:51:43.679264Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 1 sessionId: src|eb7fa7f-65291e5a-f8123aa3-5002e323_0 grpc read failed
2025-11-03T16:51:43.679292Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 1 sessionId: src|eb7fa7f-65291e5a-f8123aa3-5002e323_0 grpc closed
2025-11-03T16:51:43.679305Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1 sessionId: src|eb7fa7f-65291e5a-f8123aa3-5002e323_0 is DEAD
2025-11-03T16:51:43.679888Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-11-03T16:51:43.682719Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [3:7568542849668082197:2453] destroyed
2025-11-03T16:51:43.682768Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-11-03T16:51:43.682800Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:43.682817Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:43.682833Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:43.694083Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [] Write session: try to update token
2025-11-03T16:51:43.694612Z :INFO: [/Root] MessageGroupId [src_id] SessionId [] Write session: Do CDS request
2025-11-03T16:51:43.694678Z :INFO: [/Root] MessageGroupId [src_id] SessionId [] Start write session. Will connect to endpoint: localhost:21474
2025-11-03T16:51:43.696264Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:43.696292Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:43.696305Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:43.718532Z node 3 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-11-03T16:51:43.718559Z node 3 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2
2025-11-03T16:51:43.718957Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-11-03T16:51:43.720566Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-11-03T16:51:43.720687Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37476
2025-11-03T16:51:43.720703Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37476 proto=v1  topic=test-topic durationSec=0
2025-11-03T16:51:43.720715Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-11-03T16:51:43.722083Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2 sessionId:  describe result for acl check
2025-11-03T16:51:43.722185Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-11-03T16:51:43.722195Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-11-03T16:51:43.722205Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-11-03T16:51:43.722218Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [3:7568542849668082214:2472] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-11-03T16:51:43.724800Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [3:7568542849668082214:2472] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-11-03T16:51:43.737592Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [3:7568542849668082214:2472] (SourceId=src_id, PreferedPartition=(NULL)) RequestPQRB
2025-11-03T16:51:43.738484Z node 3 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1655: [72075186224037893][rt3.dc1--test-topic] pipe [3:7568542849668082233:2472] connected; active server actors: 1
2025-11-03T16:51:43.738665Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [3:7568542849668082214:2472] (SourceId=src_id, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=src_id
2025-11-03T16:51:43.738685Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [3:7568542849668082214:2472] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-11-03T16:51:43.739626Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1659: [72075186224037893][rt3.dc1--test-topic] pipe [3:7568542849668082233:2472] disconnected.
2025-11-03T16:51:43.739648Z node 3 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1670: [72075186224037893][rt3.dc1--test-topic] pipe [3:7568542849668082233:2472] disconnected; active server actors: 1
2025-11-03T16:51:43.739666Z node 3 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1695: [72075186224037893][rt3.dc1--test-topic] pipe [3:7568542849668082233:2472] disconnected no session
2025-11-03T16:51:43.757769Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [3:7568542849668082214:2472] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-11-03T16:51:43.757804Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [3:7568542849668082214:2472] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-11-03T16:51:43.757819Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [3:7568542849668082214:2472] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-11-03T16:51:43.757848Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-11-03T16:51:43.760539Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [3:7568542849668082250:2472], now have 1 active actors on pipe
2025-11-03T16:51:43.760863Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 4, Generation: 1
2025-11-03T16:51:43.761174Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:43.761203Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:43.761281Z node 4 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b66b860-179da72d-bba19cac-67d10518_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-11-03T16:51:43.761322Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:43.761342Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:43.761354Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-03T16:51:43.761399Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:43.761444Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-03T16:51:43.761492Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-03T16:51:43.762292Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:43.762313Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:43.762368Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-03T16:51:43.762736Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2 partition: 0 MaxSeqNo: 0 sessionId: src_id|b66b860-179da72d-bba19cac-67d10518_0
2025-11-03T16:51:43.763655Z :INFO: [/Root] MessageGroupId [src_id] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1762188703763 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-11-03T16:51:43.763781Z :INFO: [/Root] MessageGroupId [src_id] SessionId [] Write session established. Init response: session_id: "src_id|b66b860-179da72d-bba19cac-67d10518_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-11-03T16:51:43.764071Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write 1 messages with Id from 1 to 1
2025-11-03T16:51:43.790238Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session: try to update token
2025-11-03T16:51:43.790311Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Send 1 message(s) (0 left), first sequence number is 1
2025-11-03T16:51:43.790690Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write 1 messages with Id from 2 to 2
2025-11-03T16:51:43.790958Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session: try to update token
2025-11-03T16:51:43.790979Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Send 1 message(s) (0 left), first sequence number is 2
2025-11-03T16:51:43.791027Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write 1 messages with Id from 3 to 3
2025-11-03T16:51:43.791245Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session: try to update token
2025-11-03T16:51:43.791265Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Send 1 message(s) (0 left), first sequence number is 3
2025-11-03T16:51:43.791297Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write 1 messages with Id from 4 to 4
2025-11-03T16:51:43.791514Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session: try to update token
2025-11-03T16:51:43.791532Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Send 1 message(s) (0 left), first sequence number is 4
2025-11-03T16:51:43.791565Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write 1 messages with Id from 5 to 5
2025-11-03T16:51:43.791784Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session: try to update token
2025-11-03T16:51:43.791801Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Send 1 message(s) (0 left), first sequence number is 5
2025-11-03T16:51:43.791829Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write 1 messages with Id from 6 to 6
2025-11-03T16:51:43.793104Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|b66b860-179da72d-bba19cac-67d10518_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:51:43.793351Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:51:43.793926Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:43.793961Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:43.794039Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-11-03T16:51:43.794373Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:43.794810Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:43.794832Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:43.795117Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 1 partNo : 0 messageNo: 1 size 100 offset: -1
2025-11-03T16:51:43.795155Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:51:43.795192Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:43.795215Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:43.795226Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-03T16:51:43.796121Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session: try to update token
2025-11-03T16:51:43.796162Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Send 1 message(s) (0 left), first sequence number is 6
2025-11-03T16:51:43.796418Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write 1 messages with Id from 7 to 7
2025-11-03T16:51:43.796711Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session: try to update token
2025-11-03T16:51:43.796736Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Send 1 message(s) (0 left), first sequence number is 7
2025-11-03T16:51:43.796779Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write 1 messages with Id from 8 to 8
2025-11-03T16:51:43.796581Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|b66b860-179da72d-bba19cac-67d10518_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:51:43.797011Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session: try to update token
2025-11-03T16:51:43.797032Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Send 1 message(s) (0 left), first sequence number is 8
2025-11-03T16:51:43.796830Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:51:43.797077Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write 1 messages with Id from 9 to 9
2025-11-03T16:51:43.797296Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session: try to update token
2025-11-03T16:51:43.797316Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Send 1 message(s) (0 left), first sequence number is 9
2025-11-03T16:51:43.797141Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|b66b860-179da72d-bba19cac-67d10518_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:51:43.797352Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write 1 messages with Id from 10 to 10
2025-11-03T16:51:43.797242Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:51:43.797569Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session: try to update token
2025-11-03T16:51:43.797586Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Send 1 message(s) (0 left), first sequence number is 10
2025-11-03T16:51:43.797400Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|b66b860-179da72d-bba19cac-67d10518_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:51:43.797483Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:51:43.797619Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write 1 messages with Id from 11 to 11
2025-11-03T16:51:43.797634Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|b66b860-179da72d-bba19cac-67d10518_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:51:43.797927Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session: try to update token
2025-11-03T16:51:43.797814Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:51:43.797949Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Send 1 message(s) (0 left), first sequence number is 11
2025-11-03T16:51:43.797988Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write 1 messages with Id from 12 to 12
2025-11-03T16:51:43.798218Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session: try to update token
2025-11-03T16:51:43.798238Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Send 1 message(s) (0 left), first sequence number is 12
2025-11-03T16:51:43.798274Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write 1 messages with Id from 13 to 13
2025-11-03T16:51:43.798763Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session: try to update token
2025-11-03T16:51:43.798785Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Send 1 message(s) (0 left), first sequence number is 13
2025-11-03T16:51:43.798820Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write 1 messages with Id from 14 to 14
2025-11-03T16:51:43.799129Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session: try to update token
2025-11-03T16:51:43.799151Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Send 1 message(s) (0 left), first sequence number is 14
2025-11-03T16:51:43.799188Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write 1 messages with Id from 15 to 15
2025-11-03T16:51:43.799455Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session: try to update token
2025-11-03T16:51:43.799475Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Send 1 message(s) (0 left), first sequence number is 15
2025-11-03T16:51:43.799516Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write 1 messages with Id from 16 to 16
2025-11-03T16:51:43.799944Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session: try to update token
2025-11-03T16:51:43.799967Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Send 1 message(s) (0 left), first sequence number is 16
2025-11-03T16:51:43.795310Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 1 partNo 0
2025-11-03T16:51:43.796292Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 1 partNo 0 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 174 count 1 nextOffset 1 batches 1
2025-11-03T16:51:43.796327Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:43.796748Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 0,1 HeadOffset 0 endOffset 0 curOffset 1 d0000000000_00000000000000000000_00000_0000000001_00000? size 162 WTime 1762188703796
2025-11-03T16:51:43.796878Z node 4 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:51:43.796896Z node 4 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-03T16:51:43.797005Z node 4 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 0 partNo 0 count 1 size 162
2025-11-03T16:51:43.801011Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write 1 messages with Id from 17 to 17
2025-11-03T16:51:43.801356Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session: try to update token
2025-11-03T16:51:43.801381Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Send 1 message(s) (0 left), first sequence number is 17
2025-11-03T16:51:43.801638Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write 1 messages with Id from 18 to 18
2025-11-03T16:51:43.801920Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session: try to update token
2025-11-03T16:51:43.801944Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Send 1 message(s) (0 left), first sequence number is 18
2025-11-03T16:51:43.802163Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write 1 messages with Id from 19 to 19
2025-11-03T16:51:43.802489Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session: try to update token
2025-11-03T16:51:43.802514Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Send 1 message(s) (0 left), first sequence number is 19
2025-11-03T16:51:43.802702Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write 1 messages with Id from 20 to 20
2025-11-03T16:51:43.802901Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session: try to update token
2025-11-03T16:51:43.802923Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Send 1 message(s) (0 left), first sequence number is 20
2025-11-03T16:51:43.803074Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write 1 messages with Id from 21 to 21
2025-11-03T16:51:43.803294Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session: try to update token
2025-11-03T16:51:43.803317Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Send 1 message(s) (0 left), first sequence number is 21
2025-11-03T16:51:43.801994Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:43.802028Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:43.803649Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write 1 messages with Id from 22 to 22
2025-11-03T16:51:43.802075Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:43.802085Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:43.802109Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:43.802119Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:43.802142Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:43.802150Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:43.802404Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 0 count 1 size 162 actorID [4:7568542851518043584:2385]
2025-11-03T16:51:43.802452Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 2  requestId: <none> cookie: 2
2025-11-03T16:51:43.802480Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 3  requestId: <none> cookie: 3
2025-11-03T16:51:43.802493Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 4  requestId: <none> cookie: 4
2025-11-03T16:51:43.803921Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session: try to update token
2025-11-03T16:51:43.802506Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 5  requestId: <none> cookie: 5
2025-11-03T16:51:43.803943Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Send 1 message(s) (0 left), first sequence number is 22
2025-11-03T16:51:43.802530Z node 4 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-03T16:51:43.802580Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 107 WriteNewSizeFromSupportivePartitions# 0
2025-11-03T16:51:43.802609Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:51:43.802661Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 1, partNo: 0, Offset: 0 is stored on disk
2025-11-03T16:51:43.802843Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:923: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-11-03T16:51:43.802861Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:965: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-11-03T16:51:43.804104Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write 1 messages with Id from 23 to 23
2025-11-03T16:51:43.802881Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:43.802892Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:43.802902Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:43.802931Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:51:43.802958Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1  requestId: <none> cookie: 1
2025-11-03T16:51:43.803045Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:880: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 partno 0 count 1 size 1024000 endOffset 1 max time lag 0ms effective offset 0
2025-11-03T16:51:43.803229Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:1105: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 162 count 1 last offset 0, current partition end offset: 1
2025-11-03T16:51:43.803244Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:1121: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-11-03T16:51:43.803281Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 0 partno 0 count 1 parts_count 0 source 1 size 162 accessed 0 times before, last time 2025-11-03T16:51:43.000000Z
2025-11-03T16:51:43.803302Z node 4 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 3. All 1 blobs are from cache.
2025-11-03T16:51:43.804404Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session: try to update token
2025-11-03T16:51:43.804441Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Send 1 message(s) (0 left), first sequence number is 23
2025-11-03T16:51:43.803966Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|b66b860-179da72d-bba19cac-67d10518_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:51:43.804298Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:51:43.804602Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write 1 messages with Id from 24 to 24
2025-11-03T16:51:43.804642Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|b66b860-179da72d-bba19cac-67d10518_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:51:43.804905Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session: try to update token
2025-11-03T16:51:43.804934Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Send 1 message(s) (0 left), first sequence number is 24
2025-11-03T16:51:43.805109Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write 1 messages with Id from 25 to 25
2025-11-03T16:51:43.803340Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:572: FormAnswer for 1 blobs
2025-11-03T16:51:43.803430Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 0 totakecount 1 count 1 size 142 from pos 0 cbcount 1
2025-11-03T16:51:43.803483Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:1015: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1762188703795 queuesize 0 startOffset 0
2025-11-03T16:51:43.804571Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 0 suffix '63' size 162
2025-11-03T16:51:43.804622Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 0 suffix '63'
2025-11-03T16:51:43.805412Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session: try to update token
2025-11-03T16:51:43.805437Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Send 1 message(s) (0 left), first sequence number is 25
2025-11-03T16:51:43.805609Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write 1 messages with Id from 26 to 26
2025-11-03T16:51:43.805884Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session: try to update token
2025-11-03T16:51:43.804892Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|b66b860-179da72d-bba19cac-67d10518_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:51:43.805903Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Send 1 message(s) (0 left), first sequence number is 26
2025-11-03T16:51:43.804944Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:43.805104Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:43.805134Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:43.805164Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:43.805207Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:43.805407Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:51:43.805459Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:51:43.806084Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write 1 messages with Id from 27 to 27
2025-11-03T16:51:43.806115Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|b66b860-179da72d-bba19cac-67d10518_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:51:43.806266Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:51:43.805685Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:43.805711Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:43.805767Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:43.805777Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:43.805825Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 2 partNo : 0 messageNo: 7 size 102 offset: -1
2025-11-03T16:51:43.806492Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|b66b860-179da72d-bba19cac-67d10518_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:51:43.805857Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:43.806584Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:51:43.805866Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:43.805885Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 3 partNo : 0 messageNo: 8 size 102 offset: -1
2025-11-03T16:51:43.805948Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:43.805960Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:43.807028Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|b66b860-179da72d-bba19cac-67d10518_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:51:43.805979Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 4 partNo : 0 messageNo: 9 size 103 offset: -1
2025-11-03T16:51:43.807275Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|b66b860-179da72d-bba19cac-67d10518_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:51:43.807415Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|b66b860-179da72d-bba19cac-67d10518_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:51:43.806008Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:43.806017Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:43.806056Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 5 partNo : 0 messageNo: 10 size 103 offset: -1
2025-11-03T16:51:43.806103Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:51:43.806143Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:43.806167Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:43.806178Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-03T16:51:43.806937Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 2 partNo 0
2025-11-03T16:51:43.809306Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|b66b860-179da72d-bba19cac-67d10518_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:51:43.809453Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 2 partNo 0 FormedBlobsCount 0 NewHead: Offset 1 PartNo 0 PackedSize 176 count 1 nextOffset 2 batches 1
2025-11-03T16:51:43.809510Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:43.809548Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|b66b860-179da72d-bba19cac-67d10518_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:51:43.809717Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|b66b860-179da72d-bba19cac-67d10518_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:51:43.809886Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|b66b860-179da72d-bba19cac-67d10518_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:51:43.809929Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 1,1 HeadOffset 1 endOffset 1 curOffset 2 d0000000000_00000000000000000001_00000_0000000001_00000? size 164 WTime 1762188703808
2025-11-03T16:51:43.810051Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:51:43.810086Z node 4 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:51:43.810108Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:51:43.810121Z node 4 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:51:43.810134Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:51:43.810154Z node 4 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:51:43.810176Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 6  requestId: <none> cookie: 6
2025-11-03T16:51:43.810245Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:43.810263Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:43.810301Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:43.810312Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:43.810334Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:43.810345Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:43.810367Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:43.810380Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:43.810400Z node 4 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-03T16:51:43.810497Z node 4 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 1 partNo 0 count 1 size 164
2025-11-03T16:51:43.810105Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|b66b860-179da72d-bba19cac-67d10518_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:51:43.810649Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|b66b860-179da72d-bba19cac-67d10518_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:51:43.810663Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 11  requestId: <none> cookie: 7
2025-11-03T16:51:43.810691Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 12  requestId: <none> cookie: 8
2025-11-03T16:51:43.810706Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 13  requestId: <none> cookie: 9
2025-11-03T16:51:43.810719Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 14  requestId: <none> cookie: 10
2025-11-03T16:51:43.810939Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|b66b860-179da72d-bba19cac-67d10518_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:51:43.811156Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|b66b860-179da72d-bba19cac-67d10518_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:51:43.811339Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|b66b860-179da72d-bba19cac-67d10518_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:51:43.811518Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|b66b860-179da72d-bba19cac-67d10518_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:51:43.811692Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|b66b860-179da72d-bba19cac-67d10518_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:51:43.812344Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session: try to update token
2025-11-03T16:51:43.811874Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:43.812395Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Send 1 message(s) (0 left), first sequence number is 27
2025-11-03T16:51:43.811945Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:43.811971Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:43.812015Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|b66b860-179da72d-bba19cac-67d10518_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:51:43.812059Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:43.812094Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:43.812487Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:51:43.812548Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:51:43.812616Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:51:43.812653Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:51:43.812803Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write 1 messages with Id from 28 to 28
2025-11-03T16:51:43.812695Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:51:43.812664Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:43.813145Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session: try to update token
2025-11-03T16:51:43.813167Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Send 1 message(s) (0 left), first sequence number is 28
2025-11-03T16:51:43.812693Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:43.812739Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 6 partNo : 0 messageNo: 15 size 103 offset: -1
2025-11-03T16:51:43.813210Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write 1 messages with Id from 29 to 29
2025-11-03T16:51:43.812781Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:43.812796Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:43.812822Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 7 partNo : 0 messageNo: 16 size 103 offset: -1
2025-11-03T16:51:43.812880Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:43.812898Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:43.812921Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 8 partNo : 0 messageNo: 17 size 103 offset: -1
2025-11-03T16:51:43.812945Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:51:43.812978Z node 4 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:51:43.812992Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:51:43.813029Z node 4 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:51:43.813045Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:51:43.813059Z node 4 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:51:43.813541Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session: try to update token
2025-11-03T16:51:43.813562Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Send 1 message(s) (0 left), first sequence number is 29
2025-11-03T16:51:43.813599Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write 1 messages with Id from 30 to 30
2025-11-03T16:51:43.813836Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session: try to update token
2025-11-03T16:51:43.813857Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Send 1 message(s) (0 left), first sequence number is 30
2025-11-03T16:51:43.814573Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|b66b860-179da72d-bba19cac-67d10518_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:51:43.814035Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:43.814063Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:43.814103Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 9 partNo : 0 messageNo: 18 size 103 offset: -1
2025-11-03T16:51:43.814149Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:43.814159Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:43.814178Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 10 partNo : 0 messageNo: 19 size 103 offset: -1
2025-11-03T16:51:43.814205Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:43.814214Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:43.814247Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:43.814258Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:43.814280Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:43.814293Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:43.814315Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:43.814325Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:43.814348Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:43.814358Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:43.814377Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:51:43.814406Z node 4 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:51:43.814418Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:51:43.814444Z node 4 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:51:43.814515Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 20  requestId: <none> cookie: 11
2025-11-03T16:51:43.814702Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 21  requestId: <none> cookie: 12
2025-11-03T16:51:43.814719Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 22  requestId: <none> cookie: 13
2025-11-03T16:51:43.814735Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 23  requestId: <none> cookie: 14
2025-11-03T16:51:43.814750Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 24  requestId: <none> cookie: 15
2025-11-03T16:51:43.814790Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 1 count 1 size 164 actorID [4:7568542851518043584:2385]
2025-11-03T16:51:43.815622Z node 4 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-03T16:51:43.815013Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|b66b860-179da72d-bba19cac-67d10518_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:51:43.815046Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:43.815930Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write 1 messages with Id from 31 to 31
2025-11-03T16:51:43.815088Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:43.815110Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:43.815133Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:43.815153Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:43.815512Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:51:43.815558Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:51:43.815591Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:51:43.815621Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:51:43.815651Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:51:43.816273Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session: try to update token
2025-11-03T16:51:43.816296Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Send 1 message(s) (0 left), first sequence number is 31
2025-11-03T16:51:43.816341Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write 1 messages with Id from 32 to 32
2025-11-03T16:51:43.816664Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session: try to update token
2025-11-03T16:51:43.816690Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Send 1 message(s) (0 left), first sequence number is 32
2025-11-03T16:51:43.816732Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write 1 messages with Id from 33 to 33
2025-11-03T16:51:43.816987Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session: try to update token
2025-11-03T16:51:43.817007Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Send 1 message(s) (0 left), first sequence number is 33
2025-11-03T16:51:43.817044Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write 1 messages with Id from 34 to 34
2025-11-03T16:51:43.817319Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session: try to update token
2025-11-03T16:51:43.817342Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Send 1 message(s) (0 left), first sequence number is 34
2025-11-03T16:51:43.817494Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session got write response: sequence_numbers: 1 offsets: 0 already_written: false write_statistics { persist_duration_ms: 6 queued_in_partition_duration_ms: 3 }
2025-11-03T16:51:43.817563Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session: acknoledged message 1
2025-11-03T16:51:43.818914Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write 1 messages with Id from 35 to 35
2025-11-03T16:51:43.819358Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session: try to update token
2025-11-03T16:51:43.819386Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Send 1 message(s) (0 left), first sequence number is 35
2025-11-03T16:51:43.819600Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write 1 messages with Id from 36 to 36
2025-11-03T16:51:43.819906Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session: try to update token
2025-11-03T16:51:43.819931Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Send 1 message(s) (0 left), first sequence number is 36
2025-11-03T16:51:43.819993Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write 1 messages with Id from 37 to 37
2025-11-03T16:51:43.816383Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 1 partno 0 count 1 parts 0 suffix '63' size 164
2025-11-03T16:51:43.820282Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session: try to update token
2025-11-03T16:51:43.820307Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Send 1 message(s) (0 left), first sequence number is 37
2025-11-03T16:51:43.817164Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:490: [72075186224037892][Partition][0][StateIdle] Received TPartition::Handle TEvHandleWriteResponse.
2025-11-03T16:51:43.817238Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 109 WriteNewSizeFromSupportivePartitions# 0
2025-11-03T16:51:43.820350Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write 1 messages with Id from 38 to 38
2025-11-03T16:51:43.820540Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session: try to update token
2025-11-03T16:51:43.820569Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Send 1 message(s) (0 left), first sequence number is 38
2025-11-03T16:51:43.817278Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:51:43.817332Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 2, partNo: 0, Offset: 1 is stored on disk
2025-11-03T16:51:43.820606Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write 1 messages with Id from 39 to 39
2025-11-03T16:51:43.817594Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:43.817678Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:43.817694Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (8)
2025-11-03T16:51:43.817821Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 3 partNo 0
2025-11-03T16:51:43.820779Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session: try to update token
2025-11-03T16:51:43.820802Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Send 1 message(s) (0 left), first sequence number is 39
2025-11-03T16:51:43.820839Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write 1 messages with Id from 40 to 40
2025-11-03T16:51:43.820745Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|b66b860-179da72d-bba19cac-67d10518_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:51:43.821034Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session: try to update token
2025-11-03T16:51:43.821056Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Send 1 message(s) (0 left), first sequence number is 40
2025-11-03T16:51:43.821096Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write 1 messages with Id from 41 to 41
2025-11-03T16:51:43.821109Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|b66b860-179da72d-bba19cac-67d10518_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:51:43.821281Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session: try to update token
2025-11-03T16:51:43.821303Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Send 1 message(s) (0 left), first sequence number is 41
2025-11-03T16:51:43.821339Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write 1 messages with Id from 42 to 42
2025-11-03T16:51:43.821308Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|b66b860-179da72d-bba19cac-67d10518_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:51:43.821589Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session: try to update token
2025-11-03T16:51:43.821480Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|b66b860-179da72d-bba19cac-67d10518_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:51:43.821620Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Send 1 message(s) (0 left), first sequence number is 42
2025-11-03T16:51:43.821663Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write 1 messages with Id from 43 to 43
2025-11-03T16:51:43.821665Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|b66b860-179da72d-bba19cac-67d10518_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:51:43.821941Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session: try to update token
2025-11-03T16:51:43.821854Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|b66b860-179da72d-bba19cac-67d10518_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:51:43.821965Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Send 1 message(s) (0 left), first sequence number is 43
2025-11-03T16:51:43.822004Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write 1 messages with Id from 44 to 44
2025-11-03T16:51:43.822000Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|b66b860-179da72d-bba19cac-67d10518_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:51:43.822290Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session: try to update token
2025-11-03T16:51:43.822313Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Send 1 message(s) (0 left), first sequence number is 44
2025-11-03T16:51:43.822188Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|b66b860-179da72d-bba19cac-67d10518_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:51:43.822366Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write 1 messages with Id from 45 to 45
2025-11-03T16:51:43.822655Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session: try to update token
2025-11-03T16:51:43.822678Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Send 1 message(s) (0 left), first sequence number is 45
2025-11-03T16:51:43.822718Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write 1 messages with Id from 46 to 46
2025-11-03T16:51:43.823076Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session: try to update token
2025-11-03T16:51:43.823098Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Send 1 message(s) (0 left), first sequence number is 46
2025-11-03T16:51:43.823138Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write 1 messages with Id from 47 to 47
2025-11-03T16:51:43.823407Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session: try to update token
2025-11-03T16:51:43.823427Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Send 1 message(s) (0 left), first sequence number is 47
2025-11-03T16:51:43.823468Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write 1 messages with Id from 48 to 48
2025-11-03T16:51:43.826832Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session: try to update token
2025-11-03T16:51:43.826867Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Send 1 message(s) (0 left), first sequence number is 48
2025-11-03T16:51:43.829773Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write 1 messages with Id from 49 to 49
2025-11-03T16:51:43.830180Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session: try to update token
2025-11-03T16:51:43.830209Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Send 1 message(s) (0 left), first sequence number is 49
2025-11-03T16:51:43.830256Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write 1 messages with Id from 50 to 50
2025-11-03T16:51:43.830513Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session: try to update token
2025-11-03T16:51:43.830533Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Send 1 message(s) (0 left), first sequence number is 50
2025-11-03T16:51:43.830566Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write 1 messages with Id from 51 to 51
2025-11-03T16:51:43.830853Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session: try to update token
2025-11-03T16:51:43.830873Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Send 1 message(s) (0 left), first sequence number is 51
2025-11-03T16:51:43.830909Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write 1 messages with Id from 52 to 52
2025-11-03T16:51:43.831176Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session: try to update token
2025-11-03T16:51:43.831194Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Send 1 message(s) (0 left), first sequence number is 52
2025-11-03T16:51:43.831230Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write 1 messages with Id from 53 to 53
2025-11-03T16:51:43.831635Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session: try to update token
2025-11-03T16:51:43.831653Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Send 1 message(s) (0 left), first sequence number is 53
2025-11-03T16:51:43.831687Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write 1 messages with Id from 54 to 54
2025-11-03T16:51:43.831958Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session: try to update token
2025-11-03T16:51:43.831999Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Send 1 message(s) (0 left), first sequence number is 54
2025-11-03T16:51:43.832041Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write 1 messages with Id from 55 to 55
2025-11-03T16:51:43.832226Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session: try to update token
2025-11-03T16:51:43.832247Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Send 1 message(s) (0 left), first sequence number is 55
2025-11-03T16:51:43.832284Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write 1 messages with Id from 56 to 56
2025-11-03T16:51:43.832472Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session: try to update token
2025-11-03T16:51:43.832491Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Send 1 message(s) (0 left), first sequence number is 56
2025-11-03T16:51:43.832524Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write 1 messages with Id from 57 to 57
2025-11-03T16:51:43.832691Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session: try to update token
2025-11-03T16:51:43.832709Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Send 1 message(s) (0 left), first sequence number is 57
2025-11-03T16:51:43.832745Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write 1 messages with Id from 58 to 58
2025-11-03T16:51:43.832921Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session: try to update token
2025-11-03T16:51:43.832940Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Send 1 message(s) (0 left), first sequence number is 58
2025-11-03T16:51:43.832973Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write 1 messages with Id from 59 to 59
2025-11-03T16:51:43.833140Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session: try to update token
2025-11-03T16:51:43.833158Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Send 1 message(s) (0 left), first sequence number is 59
2025-11-03T16:51:43.833193Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write 1 messages with Id from 60 to 60
2025-11-03T16:51:43.833361Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session: try to update token
2025-11-03T16:51:43.833379Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Send 1 message(s) (0 left), first sequence number is 60
2025-11-03T16:51:43.833413Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write 1 messages with Id from 61 to 61
2025-11-03T16:51:43.833605Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session: try to update token
2025-11-03T16:51:43.833623Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Send 1 message(s) (0 left), first sequence number is 61
2025-11-03T16:51:43.833656Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write 1 messages with Id from 62 to 62
2025-11-03T16:51:43.833827Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session: try to update token
2025-11-03T16:51:43.833849Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Send 1 message(s) (0 left), first sequence number is 62
2025-11-03T16:51:43.833885Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write 1 messages with Id from 63 to 63
2025-11-03T16:51:43.834064Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session: try to update token
2025-11-03T16:51:43.834084Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Send 1 message(s) (0 left), first sequence number is 63
2025-11-03T16:51:43.834127Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write 1 messages with Id from 64 to 64
2025-11-03T16:51:43.834296Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session: try to update token
2025-11-03T16:51:43.834316Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Send 1 message(s) (0 left), first sequence number is 64
2025-11-03T16:51:43.834357Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write 1 messages with Id from 65 to 65
2025-11-03T16:51:43.834618Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session: try to update token
2025-11-03T16:51:43.834651Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Send 1 message(s) (0 left), first sequence number is 65
2025-11-03T16:51:43.834688Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write 1 messages with Id from 66 to 66
2025-11-03T16:51:43.834948Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session: try to update token
2025-11-03T16:51:43.834967Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Send 1 message(s) (0 left), first sequence number is 66
2025-11-03T16:51:43.835006Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write 1 messages with Id from 67 to 67
2025-11-03T16:51:43.835290Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session: try to update token
2025-11-03T16:51:43.835309Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Send 1 message(s) (0 left), first sequence number is 67
2025-11-03T16:51:43.835345Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write 1 messages with Id from 68 to 68
2025-11-03T16:51:43.835617Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session: try to update token
2025-11-03T16:51:43.835635Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Send 1 message(s) (0 left), first sequence number is 68
2025-11-03T16:51:43.835670Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write 1 messages with Id from 69 to 69
2025-11-03T16:51:43.836121Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session: try to update token
2025-11-03T16:51:43.836147Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Send 1 message(s) (0 left), first sequence number is 69
2025-11-03T16:51:43.843667Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|b66b860-179da72d-bba19cac-67d10518_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:51:43.844080Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|b66b860-179da72d-bba19cac-67d10518_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:51:43.844274Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|b66b860-179da72d-bba19cac-67d10518_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:51:43.844446Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|b66b860-179da72d-bba19cac-67d10518_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:51:43.844640Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|b66b860-179da72d-bba19cac-67d10518_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:51:43.844787Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|b66b860-179da72d-bba19cac-67d10518_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:51:43.844923Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|b66b860-179da72d-bba19cac-67d10518_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:51:43.845073Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|b66b860-179da72d-bba19cac-67d10518_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:51:43.845270Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|b66b860-179da72d-bba19cac-67d10518_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:51:43.846838Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|b66b860-179da72d-bba19cac-67d10518_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:51:43.847201Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|b66b860-179da72d-bba19cac-67d10518_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:51:43.847507Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write 1 messages with Id from 70 to 70
2025-11-03T16:51:43.847420Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|b66b860-179da72d-bba19cac-67d10518_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:51:43.847627Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|b66b860-179da72d-bba19cac-67d10518_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:51:43.847857Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|b66b860-179da72d-bba19cac-67d10518_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:51:43.848047Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session: try to update token
2025-11-03T16:51:43.848085Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Send 1 message(s) (0 left), first sequence number is 70
2025-11-03T16:51:43.848068Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|b66b860-179da72d-bba19cac-67d10518_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:51:43.848286Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write 1 messages with Id from 71 to 71
2025-11-03T16:51:43.848269Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|b66b860-179da72d-bba19cac-67d10518_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:51:43.848647Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session: try to update token
2025-11-03T16:51:43.848499Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|b66b860-179da72d-bba19cac-67d10518_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:51:43.848670Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Send 1 message(s) (0 left), first sequence number is 71
2025-11-03T16:51:43.848724Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write 1 messages with Id from 72 to 72
2025-11-03T16:51:43.848738Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|b66b860-179da72d-bba19cac-67d10518_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:51:43.848984Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|b66b860-179da72d-bba19cac-67d10518_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:51:43.849143Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session: try to update token
2025-11-03T16:51:43.849173Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Send 1 message(s) (0 left), first sequence number is 72
2025-11-03T16:51:43.849226Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write 1 messages with Id from 73 to 73
2025-11-03T16:51:43.849211Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|b66b860-179da72d-bba19cac-67d10518_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:51:43.849449Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|b66b860-179da72d-bba19cac-67d10518_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:51:43.849633Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session: try to update token
2025-11-03T16:51:43.849663Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Send 1 message(s) (0 left), first sequence number is 73
2025-11-03T16:51:43.849818Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write 1 messages with Id from 74 to 74
2025-11-03T16:51:43.849932Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|b66b860-179da72d-bba19cac-67d10518_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:51:43.850202Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session: try to update token
2025-11-03T16:51:43.850231Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Send 1 message(s) (0 left), first sequence number is 74
2025-11-03T16:51:43.850284Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write 1 messages with Id from 75 to 75
2025-11-03T16:51:43.850206Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|b66b860-179da72d-bba19cac-67d10518_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:51:43.850438Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|b66b860-179da72d-bba19cac-67d10518_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:51:43.850665Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session: try to update token
2025-11-03T16:51:43.850694Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Send 1 message(s) (0 left), first sequence number is 75
2025-11-03T16:51:43.850742Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write 1 messages with Id from 76 to 76
2025-11-03T16:51:43.850677Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|b66b860-179da72d-bba19cac-67d10518_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:51:43.850937Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|b66b860-179da72d-bba19cac-67d10518_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:51:43.851125Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session: try to update token
2025-11-03T16:51:43.851155Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Send 1 message(s) (0 left), first sequence number is 76
2025-11-03T16:51:43.851205Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write 1 messages with Id from 77 to 77
2025-11-03T16:51:43.851175Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|b66b860-179da72d-bba19cac-67d10518_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:51:43.851536Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session: try to update token
2025-11-03T16:51:43.851554Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Send 1 message(s) (0 left), first sequence number is 77
2025-11-03T16:51:43.851589Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write 1 messages with Id from 78 to 78
2025-11-03T16:51:43.851422Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|b66b860-179da72d-bba19cac-67d10518_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:51:43.851696Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|b66b860-179da72d-bba19cac-67d10518_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:51:43.851942Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session: try to update token
2025-11-03T16:51:43.851966Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Send 1 message(s) (0 left), first sequence number is 78
2025-11-03T16:51:43.852025Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write 1 messages with Id from 79 to 79
2025-11-03T16:51:43.852009Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|b66b860-179da72d-bba19cac-67d10518_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:51:43.852395Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session: try to update token
2025-11-03T16:51:43.852417Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Send 1 message(s) (0 left), first sequence number is 79
2025-11-03T16:51:43.852463Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write 1 messages with Id from 80 to 80
2025-11-03T16:51:43.852356Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|b66b860-179da72d-bba19cac-67d10518_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:51:43.852630Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|b66b860-179da72d-bba19cac-67d10518_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:51:43.852900Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|b66b860-179da72d-bba19cac-67d10518_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:51:43.853210Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|b66b860-179da72d-bba19cac-67d10518_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:51:43.853570Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|b66b860-179da72d-bba19cac-67d10518_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:51:43.853743Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|b66b860-179da72d-bba19cac-67d10518_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:51:43.856337Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|b66b860-179da72d-bba19cac-67d10518_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:51:43.856588Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|b66b860-179da72d-bba19cac-67d10518_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:51:43.856737Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|b66b860-179da72d-bba19cac-67d10518_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:51:43.856892Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|b66b860-179da72d-bba19cac-67d10518_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:51:43.857041Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|b66b860-179da72d-bba19cac-67d10518_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:51:43.857196Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|b66b860-179da72d-bba19cac-67d10518_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:51:43.857350Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|b66b860-179da72d-bba19cac-67d10518_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:51:43.857507Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|b66b860-179da72d-bba19cac-67d10518_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:51:43.852812Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session: try to update token
2025-11-03T16:51:43.858888Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Send 1 message(s) (0 left), first sequence number is 80
2025-11-03T16:51:43.859205Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write 1 messages with Id from 81 to 81
2025-11-03T16:51:43.859664Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session: try to update token
2025-11-03T16:51:43.859689Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Send 1 message(s) (0 left), first sequence number is 81
2025-11-03T16:51:43.859740Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write 1 messages with Id from 82 to 82
2025-11-03T16:51:43.860117Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session: try to update token
2025-11-03T16:51:43.860144Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Send 1 message(s) (0 left), first sequence number is 82
2025-11-03T16:51:43.860197Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write 1 messages with Id from 83 to 83
2025-11-03T16:51:43.860600Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session: try to update token
2025-11-03T16:51:43.860622Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Send 1 message(s) (0 left), first sequence number is 83
2025-11-03T16:51:43.860666Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write 1 messages with Id from 84 to 84
2025-11-03T16:51:43.861021Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session: try to update token
2025-11-03T16:51:43.861044Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Send 1 message(s) (0 left), first sequence number is 84
2025-11-03T16:51:43.861084Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write 1 messages with Id from 85 to 85
2025-11-03T16:51:43.861625Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session: try to update token
2025-11-03T16:51:43.861656Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Send 1 message(s) (0 left), first sequence number is 85
2025-11-03T16:51:43.861709Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write 1 messages with Id from 86 to 86
2025-11-03T16:51:43.862084Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session: try to update token
2025-11-03T16:51:43.862105Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Send 1 message(s) (0 left), first sequence number is 86
2025-11-03T16:51:43.862164Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write 1 messages with Id from 87 to 87
2025-11-03T16:51:43.862762Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session: try to update token
2025-11-03T16:51:43.862784Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Send 1 message(s) (0 left), first sequence number is 87
2025-11-03T16:51:43.862826Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write 1 messages with Id from 88 to 88
2025-11-03T16:51:43.863203Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session: try to update token
2025-11-03T16:51:43.863222Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Send 1 message(s) (0 left), first sequence number is 88
2025-11-03T16:51:43.863260Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write 1 messages with Id from 89 to 89
2025-11-03T16:51:43.863677Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session: try to update token
2025-11-03T16:51:43.863699Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Send 1 message(s) (0 left), first sequence number is 89
2025-11-03T16:51:43.863738Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write 1 messages with Id from 90 to 90
2025-11-03T16:51:43.864970Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session: try to update token
2025-11-03T16:51:43.864601Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|b66b860-179da72d-bba19cac-67d10518_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:51:43.864998Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Send 1 message(s) (0 left), first sequence number is 90
2025-11-03T16:51:43.865104Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|b66b860-179da72d-bba19cac-67d10518_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:51:43.865652Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write 1 messages with Id from 91 to 91
2025-11-03T16:51:43.866101Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session: try to update token
2025-11-03T16:51:43.866123Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Send 1 message(s) (0 left), first sequence number is 91
2025-11-03T16:51:43.866166Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write 1 messages with Id from 92 to 92
2025-11-03T16:51:43.866570Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session: try to update token
2025-11-03T16:51:43.866592Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Send 1 message(s) (0 left), first sequence number is 92
2025-11-03T16:51:43.866685Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write 1 messages with Id from 93 to 93
2025-11-03T16:51:43.867345Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session: try to update token
2025-11-03T16:51:43.867385Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Send 1 message(s) (0 left), first sequence number is 93
2025-11-03T16:51:43.867464Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write 1 messages with Id from 94 to 94
2025-11-03T16:51:43.867909Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session: try to update token
2025-11-03T16:51:43.867941Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Send 1 message(s) (0 left), first sequence number is 94
2025-11-03T16:51:43.868006Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write 1 messages with Id from 95 to 95
2025-11-03T16:51:43.868393Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session: try to update token
2025-11-03T16:51:43.868424Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Send 1 message(s) (0 left), first sequence number is 95
2025-11-03T16:51:43.868472Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write 1 messages with Id from 96 to 96
2025-11-03T16:51:43.868861Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session: try to update token
2025-11-03T16:51:43.868886Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Send 1 message(s) (0 left), first sequence number is 96
2025-11-03T16:51:43.871346Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write 1 messages with Id from 97 to 97
2025-11-03T16:51:43.872115Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session: try to update token
2025-11-03T16:51:43.872148Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Send 1 message(s) (0 left), first sequence number is 97
2025-11-03T16:51:43.872207Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write 1 messages with Id from 98 to 98
2025-11-03T16:51:43.872690Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session: try to update token
2025-11-03T16:51:43.872716Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Send 1 message(s) (0 left), first sequence number is 98
2025-11-03T16:51:43.872768Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write 1 messages with Id from 99 to 99
2025-11-03T16:51:43.872440Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|b66b860-179da72d-bba19cac-67d10518_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:51:43.873186Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session: try to update token
2025-11-03T16:51:43.873212Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Send 1 message(s) (0 left), first sequence number is 99
2025-11-03T16:51:43.873261Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write 1 messages with Id from 100 to 100
2025-11-03T16:51:43.873125Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|b66b860-179da72d-bba19cac-67d10518_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:51:43.873368Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|b66b860-179da72d-bba19cac-67d10518_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:51:43.873676Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session: try to update token
2025-11-03T16:51:43.873702Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Send 1 message(s) (0 left), first sequence number is 100
2025-11-03T16:51:43.873593Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|b66b860-179da72d-bba19cac-67d10518_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:51:43.873766Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session: close. Timeout = 18446744073709551 ms
2025-11-03T16:51:43.873765Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|b66b860-179da72d-bba19cac-67d10518_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:51:43.873979Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|b66b860-179da72d-bba19cac-67d10518_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:51:43.874140Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|b66b860-179da72d-bba19cac-67d10518_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:51:43.874911Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|b66b860-179da72d-bba19cac-67d10518_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:51:43.875102Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|b66b860-179da72d-bba19cac-67d10518_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:51:43.875284Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|b66b860-179da72d-bba19cac-67d10518_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:51:43.875459Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|b66b860-179da72d-bba19cac-67d10518_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:51:43.875620Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|b66b860-179da72d-bba19cac-67d10518_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:51:43.875770Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|b66b860-179da72d-bba19cac-67d10518_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:51:43.875919Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|b66b860-179da72d-bba19cac-67d10518_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:51:43.876151Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|b66b860-179da72d-bba19cac-67d10518_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:51:43.877094Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|b66b860-179da72d-bba19cac-67d10518_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:51:43.881411Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 3 partNo 0 FormedBlobsCount 0 NewHead: Offset 2 PartNo 0 PackedSize 176 count 1 nextOffset 3 batches 1
2025-11-03T16:51:43.881497Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 4 partNo 0
2025-11-03T16:51:43.881535Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 4 partNo 0 FormedBlobsCount 0 NewHead: Offset 2 PartNo 0 PackedSize 321 count 2 nextOffset 4 batches 1
2025-11-03T16:51:43.881557Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 5 partNo 0
2025-11-03T16:51:43.881574Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 5 partNo 0 FormedBlobsCount 0 NewHead: Offset 2 PartNo 0 PackedSize 466 count 3 nextOffset 5 batches 1
2025-11-03T16:51:43.881591Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 6 partNo 0
2025-11-03T16:51:43.881606Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 6 partNo 0 FormedBlobsCount 0 NewHead: Offset 2 PartNo 0 PackedSize 611 count 4 nextOffset 6 batches 1
2025-11-03T16:51:43.881628Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 7 partNo 0
2025-11-03T16:51:43.881647Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 7 partNo 0 FormedBlobsCount 0 NewHead: Offset 2 PartNo 0 PackedSize 756 count 5 nextOffset 7 batches 1
2025-11-03T16:51:43.881662Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 8 partNo 0
2025-11-03T16:51:43.881678Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 8 partNo 0 FormedBlobsCount 0 NewHead: Offset 2 PartNo 0 PackedSize 901 count 6 nextOffset 8 batches 1
2025-11-03T16:51:43.881690Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 9 partNo 0
2025-11-03T16:51:43.881701Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 9 partNo 0 FormedBlobsCount 0 NewHead: Offset 2 PartNo 0 PackedSize 1046 count 7 nextOffset 9 batches 1
2025-11-03T16:51:43.881711Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 10 partNo 0
2025-11-03T16:51:43.881722Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 10 partNo 0 FormedBlobsCount 0 NewHead: Offset 2 PartNo 0 PackedSize 1191 count 8 nextOffset 10 batches 1
2025-11-03T16:51:43.881740Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:43.882308Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 2,8 HeadOffset 2 endOffset 2 curOffset 10 d0000000000_00000000000000000002_00000_0000000008_00000? size 987 WTime 1762188703879
2025-11-03T16:51:43.882436Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:51:43.882545Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:43.882562Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:43.882605Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 11 partNo : 0 messageNo: 25 size 104 offset: -1
2025-11-03T16:51:43.882659Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:43.882666Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:43.882680Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 12 partNo : 0 messageNo: 26 size 104 offset: -1
2025-11-03T16:51:43.882704Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:43.882711Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:43.882722Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 13 partNo : 0 messageNo: 27 size 104 offset: -1
2025-11-03T16:51:43.882743Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:43.882748Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:43.882762Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 14 partNo : 0 messageNo: 28 size 104 offset: -1
2025-11-03T16:51:43.882785Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:43.882791Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:43.882803Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 15 partNo : 0 messageNo: 29 size 104 offset: -1
2025-11-03T16:51:43.882823Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:43.882829Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:43.882854Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:43.882862Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:43.882890Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:43.882897Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:43.882920Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:43.882931Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:43.882957Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:43.882966Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:43.883005Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 7  requestId: <none> cookie: 2
2025-11-03T16:51:43.883080Z node 4 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-03T16:51:43.883177Z node 4 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 2 partNo 0 count 8 size 987
2025-11-03T16:51:43.883207Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:51:43.883241Z node 4 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:51:43.883252Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:51:43.883262Z node 4 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:51:43.883270Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:51:43.883280Z node 4 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:51:43.883288Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:51:43.883298Z node 4 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:51:43.883306Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:51:43.883315Z node 4 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:51:43.883440Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 30  requestId: <none> cookie: 16
2025-11-03T16:51:43.883454Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 31  requestId: <none> cookie: 17
2025-11-03T16:51:43.883464Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 32  requestId: <none> cookie: 18
2025-11-03T16:51:43.883475Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 33  requestId: <none> cookie: 19
2025-11-03T16:51:43.883487Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 34  requestId: <none> cookie: 20
2025-11-03T16:51:43.885611Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|b66b860-179da72d-bba19cac-67d10518_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:51:43.885674Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:43.885734Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:43.885776Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:43.885829Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:43.885857Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:43.885881Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:43.886617Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:51:43.886684Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:51:43.886716Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:51:43.886760Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:51:43.886800Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:51:43.887666Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|b66b860-179da72d-bba19cac-67d10518_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:51:43.887906Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|b66b860-179da72d-bba19cac-67d10518_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:51:43.888210Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session got write response: sequence_numbers: 2 offsets: 1 already_written: false write_statistics { persist_duration_ms: 8 queued_in_partition_duration_ms: 3 }
2025-11-03T16:51:43.888260Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session: acknoledged message 2
2025-11-03T16:51:43.889450Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:43.889495Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:43.889561Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 16 partNo : 0 messageNo: 35 size 104 offset: -1
2025-11-03T16:51:43.889626Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:43.889640Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:43.889663Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 17 partNo : 0 messageNo: 36 size 104 offset: -1
2025-11-03T16:51:43.889705Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:43.889716Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:43.889736Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 37 size 104 offset: -1
2025-11-03T16:51:43.889772Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:43.889784Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:43.889802Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 38 size 104 offset: -1
2025-11-03T16:51:43.889840Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:43.889851Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:43.889870Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 39 size 104 offset: -1
2025-11-03T16:51:43.889900Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:43.889910Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:43.889941Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:43.889952Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:43.889977Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:43.889985Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:43.890011Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:43.890020Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:43.890050Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:43.890060Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:43.890093Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:51:43.890141Z node 4 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:51:43.890160Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:51:43.890177Z node 4 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:51:43.890193Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:51:43.890208Z node 4 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:51:43.890220Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:51:43.890236Z node 4 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:51:43.890251Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:51:43.890264Z node 4 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:51:43.890341Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 40  requestId: <none> cookie: 21
2025-11-03T16:51:43.890395Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 41  requestId: <none> cookie: 22
2025-11-03T16:51:43.890413Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 42  requestId: <none> cookie: 23
2025-11-03T16:51:43.890428Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 43  requestId: <none> cookie: 24
2025-11-03T16:51:43.890444Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 44  requestId: <none> cookie: 25
2025-11-03T16:51:43.892779Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:43.892850Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:43.892877Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:43.892906Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:43.892932Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:43.893157Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:51:43.893221Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:51:43.893259Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:51:43.893293Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:51:43.893324Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:51:43.894413Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 2 count 8 size 987 actorID [4:7568542851518043584:2385]
2025-11-03T16:51:43.894480Z node 4 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-03T16:51:43.894525Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 879 WriteNewSizeFromSupportivePartitions# 0
2025-11-03T16:51:43.894559Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:51:43.894591Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 3, partNo: 0, Offset: 2 is stored on disk
2025-11-03T16:51:43.894608Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:51:43.894643Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 4, partNo: 0, Offset: 3 is stored on disk
2025-11-03T16:51:43.894656Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:51:43.894677Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 5, partNo: 0, Offset: 4 is stored on disk
2025-11-03T16:51:43.894688Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:51:43.894708Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 6, partNo: 0, Offset: 5 is stored on disk
2025-11-03T16:51:43.894722Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:51:43.894743Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 7, partNo: 0, Offset: 6 is stored on disk
2025-11-03T16:51:43.894754Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:51:43.894771Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 8, partNo: 0, Offset: 7 is stored on disk
2025-11-03T16:51:43.894783Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:51:43.894803Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 9, partNo: 0, Offset: 8 is stored on disk
2025-11-03T16:51:43.894814Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:51:43.894833Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 10, partNo: 0, Offset: 9 is stored on disk
2025-11-03T16:51:43.895003Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:43.895057Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:43.895068Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (10)
2025-11-03T16:51:43.895266Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 2 partno 0 count 8 parts 0 suffix '63' size 987
2025-11-03T16:51:43.895781Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 11 partNo 0
2025-11-03T16:51:43.921315Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 11 partNo 0 FormedBlobsCount 0 NewHead: Offset 10 PartNo 0 PackedSize 178 count 1 nextOffset 11 batches 1
2025-11-03T16:51:43.921407Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 12 partNo 0
2025-11-03T16:51:43.921446Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 12 partNo 0 FormedBlobsCount 0 NewHead: Offset 10 PartNo 0 PackedSize 324 count 2 nextOffset 12 batches 1
2025-11-03T16:51:43.921467Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 13 partNo 0
2025-11-03T16:51:43.921487Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 13 partNo 0 FormedBlobsCount 0 NewHead: Offset 10 PartNo 0 PackedSize 470 count 3 nextOffset 13 batches 1
2025-11-03T16:51:43.921507Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 14 partNo 0
2025-11-03T16:51:43.921526Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 14 partNo 0 FormedBlobsCount 0 NewHead: Offset 10 PartNo 0 PackedSize 616 count 4 nextOffset 14 batches 1
2025-11-03T16:51:43.921547Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 15 partNo 0
2025-11-03T16:51:43.921569Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 15 partNo 0 FormedBlobsCount 0 NewHead: Offset 10 PartNo 0 PackedSize 762 count 5 nextOffset 15 batches 1
2025-11-03T16:51:43.921586Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 16 partNo 0
2025-11-03T16:51:43.921606Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 16 partNo 0 FormedBlobsCount 0 NewHead: Offset 10 PartNo 0 PackedSize 908 count 6 nextOffset 16 batches 1
2025-11-03T16:51:43.921627Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 17 partNo 0
2025-11-03T16:51:43.921648Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 17 partNo 0 FormedBlobsCount 0 NewHead: Offset 10 PartNo 0 PackedSize 1054 count 7 nextOffset 17 batches 1
2025-11-03T16:51:43.921667Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-11-03T16:51:43.921685Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 0 FormedBlobsCount 0 NewHead: Offset 10 PartNo 0 PackedSize 1200 count 8 nextOffset 18 batches 1
2025-11-03T16:51:43.921707Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-11-03T16:51:43.921727Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 0 FormedBlobsCount 0 NewHead: Offset 10 PartNo 0 PackedSize 1346 count 9 nextOffset 19 batches 1
2025-11-03T16:51:43.921747Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-11-03T16:51:43.921766Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 0 FormedBlobsCount 0 NewHead: Offset 10 PartNo 0 PackedSize 1492 count 10 nextOffset 20 batches 1
2025-11-03T16:51:43.921783Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:43.922233Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 10,10 HeadOffset 10 endOffset 10 curOffset 20 d0000000000_00000000000000000010_00000_0000000010_00000? size 1227 WTime 1762188703922
2025-11-03T16:51:43.922347Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:51:43.922428Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 8  requestId: <none> cookie: 3
2025-11-03T16:51:43.922490Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 9  requestId: <none> cookie: 4
2025-11-03T16:51:43.922511Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 10  requestId: <none> cookie: 5
2025-11-03T16:51:43.922531Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 15  requestId: <none> cookie: 6
2025-11-03T16:51:43.922553Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 16  requestId: <none> cookie: 7
2025-11-03T16:51:43.922573Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 17  requestId: <none> cookie: 8
2025-11-03T16:51:43.922592Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 18  requestId: <none> cookie: 9
2025-11-03T16:51:43.922610Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 19  requestId: <none> cookie: 10
2025-11-03T16:51:43.922694Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:43.922715Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:43.922762Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 45 size 104 offset: -1
2025-11-03T16:51:43.922806Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:43.922818Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:43.922841Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 46 size 104 offset: -1
2025-11-03T16:51:43.922875Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:43.922885Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:43.922906Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 47 size 104 offset: -1
2025-11-03T16:51:43.922939Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:43.922949Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:43.922967Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 48 size 104 offset: -1
2025-11-03T16:51:43.922998Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:43.923007Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:43.923024Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 49 size 104 offset: -1
2025-11-03T16:51:43.923053Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:43.923061Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:43.923090Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:43.923099Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:43.923122Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:43.923131Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:43.923155Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:43.923166Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:43.923192Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:43.923202Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:43.923236Z node 4 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:51:43.923256Z node 4 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-03T16:51:43.923361Z node 4 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 10 partNo 0 count 10 size 1227
2025-11-03T16:51:43.923393Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:51:43.923426Z node 4 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:51:43.923438Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:51:43.923451Z node 4 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:51:43.923461Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:51:43.923476Z node 4 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:51:43.923487Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:51:43.923508Z node 4 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:51:43.923520Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:51:43.923534Z node 4 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:51:43.923696Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 50  requestId: <none> cookie: 26
2025-11-03T16:51:43.923730Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 51  requestId: <none> cookie: 27
2025-11-03T16:51:43.923745Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 52  requestId: <none> cookie: 28
2025-11-03T16:51:43.923759Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 53  requestId: <none> cookie: 29
2025-11-03T16:51:43.923773Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 54  requestId: <none> cookie: 30
2025-11-03T16:51:43.928092Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:43.928188Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:43.928218Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:43.928281Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:43.928307Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:43.928346Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:43.928379Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:43.928408Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:43.928437Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:43.928475Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:43.928505Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:43.928534Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:43.928561Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:43.929299Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:51:43.929363Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:51:43.929399Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:51:43.929433Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:51:43.929464Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:51:43.930999Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:43.931035Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:43.931082Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 55 size 104 offset: -1
2025-11-03T16:51:43.931127Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:43.931138Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:43.931155Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 56 size 104 offset: -1
2025-11-03T16:51:43.931187Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:43.931197Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:43.931214Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 28 partNo : 0 messageNo: 57 size 104 offset: -1
2025-11-03T16:51:43.931252Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:43.931264Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:43.931286Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 29 partNo : 0 messageNo: 58 size 104 offset: -1
2025-11-03T16:51:43.931327Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:43.931338Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:43.931362Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 30 partNo : 0 messageNo: 59 size 104 offset: -1
2025-11-03T16:51:43.931396Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:43.931405Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:43.931437Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:43.931448Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:43.931477Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:43.931486Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:43.931511Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:43.931520Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:43.931544Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:43.931553Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:43.931580Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:51:43.931621Z node 4 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:51:43.932425Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session got write response: sequence_numbers: 3 offsets: 2 already_written: false write_statistics { persist_duration_ms: 14 queued_in_partition_duration_ms: 70 }
2025-11-03T16:51:43.932485Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session: acknoledged message 3
2025-11-03T16:51:43.931636Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:51:43.931652Z node 4 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:51:43.931666Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:51:43.931679Z node 4 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:51:43.931690Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:51:43.931706Z node 4 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:51:43.931719Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:51:43.931732Z node 4 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:51:43.931800Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 60  requestId: <none> cookie: 31
2025-11-03T16:51:43.931842Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 61  requestId: <none> cookie: 32
2025-11-03T16:51:43.931857Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 62  requestId: <none> cookie: 33
2025-11-03T16:51:43.931871Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 63  requestId: <none> cookie: 34
2025-11-03T16:51:43.931887Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 64  requestId: <none> cookie: 35
2025-11-03T16:51:43.933828Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session got write response: sequence_numbers: 4 offsets: 3 already_written: false write_statistics { persist_duration_ms: 14 queued_in_partition_duration_ms: 70 }
2025-11-03T16:51:43.933896Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session: acknoledged message 4
2025-11-03T16:51:43.934176Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session got write response: sequence_numbers: 5 offsets: 4 already_written: false write_statistics { persist_duration_ms: 14 queued_in_partition_duration_ms: 70 }
2025-11-03T16:51:43.934220Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session: acknoledged message 5
2025-11-03T16:51:43.934467Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session got write response: sequence_numbers: 6 offsets: 5 already_written: false write_statistics { persist_duration_ms: 14 queued_in_partition_duration_ms: 70 }
2025-11-03T16:51:43.934495Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session: acknoledged message 6
2025-11-03T16:51:43.933718Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 10 count 10 size 1227 actorID [4:7568542851518043584:2385]
2025-11-03T16:51:43.933773Z node 4 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-03T16:51:43.933816Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1110 WriteNewSizeFromSupportivePartitions# 0
2025-11-03T16:51:43.933847Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:51:43.933877Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 11, partNo: 0, Offset: 10 is stored on disk
2025-11-03T16:51:43.933894Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:51:43.934845Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session got write response: sequence_numbers: 7 offsets: 6 already_written: false write_statistics { persist_duration_ms: 14 queued_in_partition_duration_ms: 70 }
2025-11-03T16:51:43.933911Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 12, partNo: 0, Offset: 11 is stored on disk
2025-11-03T16:51:43.933922Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:51:43.933942Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 13, partNo: 0, Offset: 12 is stored on disk
2025-11-03T16:51:43.933955Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:51:43.933974Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 14, partNo: 0, Offset: 13 is stored on disk
2025-11-03T16:51:43.933988Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:51:43.934010Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 15, partNo: 0, Offset: 14 is stored on disk
2025-11-03T16:51:43.934026Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:51:43.934048Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 16, partNo: 0, Offset: 15 is stored on disk
2025-11-03T16:51:43.934061Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:51:43.934085Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 17, partNo: 0, Offset: 16 is stored on disk
2025-11-03T16:51:43.934100Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:51:43.934122Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 18, partNo: 0, Offset: 17 is stored on disk
2025-11-03T16:51:43.934138Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:51:43.934160Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 19, partNo: 0, Offset: 18 is stored on disk
2025-11-03T16:51:43.934172Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:51:43.934189Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 20, partNo: 0, Offset: 19 is stored on disk
2025-11-03T16:51:43.934347Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:43.934397Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:43.934407Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (10)
2025-11-03T16:51:43.934489Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-11-03T16:51:43.935466Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 10 partno 0 count 10 parts 0 suffix '63' size 1227
2025-11-03T16:51:43.934750Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:43.934815Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:43.934841Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:43.934864Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:43.934888Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:43.935106Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:51:43.935158Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:51:43.935190Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:51:43.935223Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:51:43.935255Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:51:43.934881Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session: acknoledged message 7
2025-11-03T16:51:43.936751Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session got write response: sequence_numbers: 8 offsets: 7 already_written: false write_statistics { persist_duration_ms: 14 queued_in_partition_duration_ms: 70 }
2025-11-03T16:51:43.936796Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session: acknoledged message 8
2025-11-03T16:51:43.936990Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session got write response: sequence_numbers: 9 offsets: 8 already_written: false write_statistics { persist_duration_ms: 14 queued_in_partition_duration_ms: 70 }
2025-11-03T16:51:43.937030Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session: acknoledged message 9
2025-11-03T16:51:43.937291Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session got write response: sequence_numbers: 10 offsets: 9 already_written: false write_statistics { persist_duration_ms: 14 queued_in_partition_duration_ms: 70 }
2025-11-03T16:51:43.937325Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session: acknoledged message 10
2025-11-03T16:51:43.937401Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 0 FormedBlobsCount 0 NewHead: Offset 20 PartNo 0 PackedSize 178 count 1 nextOffset 21 batches 1
2025-11-03T16:51:43.937462Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-11-03T16:51:43.937496Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 0 FormedBlobsCount 0 NewHead: Offset 20 PartNo 0 PackedSize 324 count 2 nextOffset 22 batches 1
2025-11-03T16:51:43.937518Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-11-03T16:51:43.937540Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 0 FormedBlobsCount 0 NewHead: Offset 20 PartNo 0 PackedSize 470 count 3 nextOffset 23 batches 1
2025-11-03T16:51:43.937561Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-11-03T16:51:43.937581Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 0 FormedBlobsCount 0 NewHead: Offset 20 PartNo 0 PackedSize 616 count 4 nextOffset 24 batches 1
2025-11-03T16:51:43.937603Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-11-03T16:51:43.937626Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 0 FormedBlobsCount 0 NewHead: Offset 20 PartNo 0 PackedSize 762 count 5 nextOffset 25 batches 1
2025-11-03T16:51:43.937645Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-11-03T16:51:43.937665Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 0 FormedBlobsCount 0 NewHead: Offset 20 PartNo 0 PackedSize 908 count 6 nextOffset 26 batches 1
2025-11-03T16:51:43.937686Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-11-03T16:51:43.937707Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 0 FormedBlobsCount 0 NewHead: Offset 20 PartNo 0 PackedSize 1054 count 7 nextOffset 27 batches 1
2025-11-03T16:51:43.937726Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 28 partNo 0
2025-11-03T16:51:43.937746Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 28 partNo 0 FormedBlobsCount 0 NewHead: Offset 20 PartNo 0 PackedSize 1200 count 8 nextOffset 28 batches 1
2025-11-03T16:51:43.937766Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 29 partNo 0
2025-11-03T16:51:43.937787Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 29 partNo 0 FormedBlobsCount 0 NewHead: Offset 20 PartNo 0 PackedSize 1346 count 9 nextOffset 29 batches 1
2025-11-03T16:51:43.937806Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 30 partNo 0
2025-11-03T16:51:43.937825Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 30 partNo 0 FormedBlobsCount 0 NewHead: Offset 20 PartNo 0 PackedSize 1492 count 10 nextOffset 30 batches 1
2025-11-03T16:51:43.937843Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:43.938286Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 20,10 HeadOffset 20 endOffset 20 curOffset 30 d0000000000_00000000000000000020_00000_0000000010_00000? size 1232 WTime 1762188703937
2025-11-03T16:51:43.938398Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:51:43.938452Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 25  requestId: <none> cookie: 11
2025-11-03T16:51:43.938507Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 26  requestId: <none> cookie: 12
2025-11-03T16:51:43.938528Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 27  requestId: <none> cookie: 13
2025-11-03T16:51:43.938549Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 28  requestId: <none> cookie: 14
2025-11-03T16:51:43.938570Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 29  requestId: <none> cookie: 15
2025-11-03T16:51:43.938591Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 35  requestId: <none> cookie: 16
2025-11-03T16:51:43.938610Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 36  requestId: <none> cookie: 17
2025-11-03T16:51:43.938645Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 37  requestId: <none> cookie: 18
2025-11-03T16:51:43.938664Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 38  requestId: <none> cookie: 19
2025-11-03T16:51:43.938684Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 39  requestId: <none> cookie: 20
2025-11-03T16:51:43.938744Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:43.938761Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:43.938804Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 31 partNo : 0 messageNo: 65 size 104 offset: -1
2025-11-03T16:51:43.938851Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:43.938861Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:43.938882Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 32 partNo : 0 messageNo: 66 size 104 offset: -1
2025-11-03T16:51:43.938918Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:43.938927Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:43.938946Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 33 partNo : 0 messageNo: 67 size 104 offset: -1
2025-11-03T16:51:43.938980Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:43.938990Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:43.939009Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 34 partNo : 0 messageNo: 68 size 105 offset: -1
2025-11-03T16:51:43.939042Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:43.939051Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:43.939070Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 35 partNo : 0 messageNo: 69 size 105 offset: -1
2025-11-03T16:51:43.939098Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:43.939107Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:43.939136Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:43.939146Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:43.939170Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:43.939179Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:43.939202Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:43.939211Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:43.939235Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:43.939244Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:43.939265Z node 4 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-03T16:51:43.939372Z node 4 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 0 count 10 size 1232
2025-11-03T16:51:43.939403Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:51:43.939440Z node 4 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:51:43.939454Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:51:43.939468Z node 4 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:51:43.939480Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:51:43.939497Z node 4 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:51:43.939507Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:51:43.939521Z node 4 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:51:43.939532Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:51:43.939546Z node 4 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:51:43.939706Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 70  requestId: <none> cookie: 36
2025-11-03T16:51:43.939725Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 71  requestId: <none> cookie: 37
2025-11-03T16:51:43.939740Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 72  requestId: <none> cookie: 38
2025-11-03T16:51:43.939755Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 73  requestId: <none> cookie: 39
2025-11-03T16:51:43.939769Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 74  requestId: <none> cookie: 40
2025-11-03T16:51:43.942241Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:43.942304Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:43.942341Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:43.942365Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:43.942394Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:43.942420Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:43.942450Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:43.942476Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:43.942502Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:43.942529Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:43.942554Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:43.942589Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:43.942615Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:43.942656Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:43.942680Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:43.943806Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session got write response: sequence_numbers: 11 offsets: 10 already_written: false write_statistics { persist_duration_ms: 12 queued_in_partition_duration_ms: 41 }
2025-11-03T16:51:43.943460Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:51:43.943520Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:51:43.943867Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session: acknoledged message 11
2025-11-03T16:51:43.943555Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:51:43.943589Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:51:43.943624Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:51:43.945180Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session got write response: sequence_numbers: 12 offsets: 11 already_written: false write_statistics { persist_duration_ms: 12 queued_in_partition_duration_ms: 41 }
2025-11-03T16:51:43.945239Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session: acknoledged message 12
2025-11-03T16:51:43.945327Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:43.945379Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:43.945433Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 36 partNo : 0 messageNo: 75 size 105 offset: -1
2025-11-03T16:51:43.945488Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:43.945499Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:43.945518Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 76 size 105 offset: -1
2025-11-03T16:51:43.945549Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:43.945560Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:43.945578Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 77 size 105 offset: -1
2025-11-03T16:51:43.945506Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session got write response: sequence_numbers: 13 offsets: 12 already_written: false write_statistics { persist_duration_ms: 12 queued_in_partition_duration_ms: 41 }
2025-11-03T16:51:43.945607Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:43.945617Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:43.945633Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 78 size 105 offset: -1
2025-11-03T16:51:43.945644Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session: acknoledged message 13
2025-11-03T16:51:43.945663Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:43.945679Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:43.945697Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 79 size 105 offset: -1
2025-11-03T16:51:43.945725Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:43.945734Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:43.945762Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:43.945772Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:43.945796Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:43.945809Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:43.945836Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:43.945865Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session got write response: sequence_numbers: 14 offsets: 13 already_written: false write_statistics { persist_duration_ms: 12 queued_in_partition_duration_ms: 41 }
2025-11-03T16:51:43.945846Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:43.945883Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:43.945896Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:43.945903Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session: acknoledged message 14
2025-11-03T16:51:43.945958Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:51:43.946003Z node 4 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:51:43.946018Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:51:43.946034Z node 4 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:51:43.946045Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:51:43.946058Z node 4 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:51:43.946070Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:51:43.946084Z node 4 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:51:43.946095Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:51:43.946164Z node 4 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:51:43.946496Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 80  requestId: <none> cookie: 41
2025-11-03T16:51:43.946532Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 81  requestId: <none> cookie: 42
2025-11-03T16:51:43.946548Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 82  requestId: <none> cookie: 43
2025-11-03T16:51:43.946564Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 83  requestId: <none> cookie: 44
2025-11-03T16:51:43.946581Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 84  requestId: <none> cookie: 45
2025-11-03T16:51:43.946919Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session got write response: sequence_numbers: 15 offsets: 14 already_written: false write_statistics { persist_duration_ms: 11 queued_in_partition_duration_ms: 41 }
2025-11-03T16:51:43.946982Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session: acknoledged message 15
2025-11-03T16:51:43.947220Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session got write response: sequence_numbers: 16 offsets: 15 already_written: false write_statistics { persist_duration_ms: 11 queued_in_partition_duration_ms: 31 }
2025-11-03T16:51:43.947262Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session: acknoledged message 16
2025-11-03T16:51:43.946884Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:43.946977Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:43.947017Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:43.947045Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:43.947069Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:43.947454Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session got write response: sequence_numbers: 17 offsets: 16 already_written: false write_statistics { persist_duration_ms: 11 queued_in_partition_duration_ms: 31 }
2025-11-03T16:51:43.947272Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:51:43.947497Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session: acknoledged message 17
2025-11-03T16:51:43.947327Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:51:43.947357Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:51:43.947389Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:51:43.947422Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:51:43.947656Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session got write response: sequence_numbers: 18 offsets: 17 already_written: false write_statistics { persist_duration_ms: 11 queued_in_partition_duration_ms: 31 }
2025-11-03T16:51:43.947698Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session: acknoledged message 18
2025-11-03T16:51:43.947858Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session got write response: sequence_numbers: 19 offsets: 18 already_written: false write_statistics { persist_duration_ms: 11 queued_in_partition_duration_ms: 31 }
2025-11-03T16:51:43.947882Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session: acknoledged message 19
2025-11-03T16:51:43.948108Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session got write response: sequence_numbers: 20 offsets: 19 already_written: false write_statistics { persist_duration_ms: 11 queued_in_partition_duration_ms: 31 }
2025-11-03T16:51:43.948148Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session: acknoledged message 20
2025-11-03T16:51:43.948295Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:43.948328Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:43.948375Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 85 size 105 offset: -1
2025-11-03T16:51:43.948420Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:43.948434Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:43.948457Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 86 size 106 offset: -1
2025-11-03T16:51:43.948502Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:43.948523Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:43.948549Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 87 size 106 offset: -1
2025-11-03T16:51:43.948607Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:43.948626Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:43.948649Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 88 size 106 offset: -1
2025-11-03T16:51:43.948686Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:43.948703Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:43.948732Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 89 size 106 offset: -1
2025-11-03T16:51:43.948784Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:43.948800Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:43.948829Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:43.948842Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:43.948868Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:43.948882Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:43.948906Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:43.948918Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:43.948945Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:43.948966Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:43.948993Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:51:43.949042Z node 4 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:51:43.949066Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:51:43.949081Z node 4 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:51:43.949093Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:51:43.949108Z node 4 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:51:43.949121Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:51:43.949138Z node 4 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:51:43.949149Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:51:43.949168Z node 4 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:51:43.949379Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 90  requestId: <none> cookie: 46
2025-11-03T16:51:43.949419Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 91  requestId: <none> cookie: 47
2025-11-03T16:51:43.949436Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 92  requestId: <none> cookie: 48
2025-11-03T16:51:43.949452Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 93  requestId: <none> cookie: 49
2025-11-03T16:51:43.949713Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:43.949766Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:43.949791Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:43.949821Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:43.950009Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:51:43.950063Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:51:43.950095Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:51:43.950127Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:51:43.950160Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:43.950290Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:51:43.949504Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 20 count 10 size 1232 actorID [4:7568542851518043584:2385]
2025-11-03T16:51:43.949546Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 94  requestId: <none> cookie: 50
2025-11-03T16:51:43.949566Z node 4 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-03T16:51:43.949607Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1110 WriteNewSizeFromSupportivePartitions# 0
2025-11-03T16:51:43.949634Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:51:43.949662Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 21, partNo: 0, Offset: 20 is stored on disk
2025-11-03T16:51:43.949677Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:51:43.949690Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 20 partno 0 count 10 parts 0 suffix '63' size 1232
2025-11-03T16:51:43.949694Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 22, partNo: 0, Offset: 21 is stored on disk
2025-11-03T16:51:43.949706Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:51:43.949724Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 23, partNo: 0, Offset: 22 is stored on disk
2025-11-03T16:51:43.949736Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:51:43.949753Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 24, partNo: 0, Offset: 23 is stored on disk
2025-11-03T16:51:43.949766Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:51:43.949782Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 25, partNo: 0, Offset: 24 is stored on disk
2025-11-03T16:51:43.949794Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:51:43.949810Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 26, partNo: 0, Offset: 25 is stored on disk
2025-11-03T16:51:43.949822Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:51:43.949839Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 27, partNo: 0, Offset: 26 is stored on disk
2025-11-03T16:51:43.949850Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:51:43.949865Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 28, partNo: 0, Offset: 27 is stored on disk
2025-11-03T16:51:43.949876Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:51:43.949895Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 29, partNo: 0, Offset: 28 is stored on disk
2025-11-03T16:51:43.949906Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:51:43.949922Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 30, partNo: 0, Offset: 29 is stored on disk
2025-11-03T16:51:43.950075Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:43.950137Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:43.950147Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (15)
2025-11-03T16:51:43.950234Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 31 partNo 0
2025-11-03T16:51:43.951392Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 31 partNo 0 FormedBlobsCount 0 NewHead: Offset 30 PartNo 0 PackedSize 178 count 1 nextOffset 31 batches 1
2025-11-03T16:51:43.951445Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 32 partNo 0
2025-11-03T16:51:43.951476Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 32 partNo 0 FormedBlobsCount 0 NewHead: Offset 30 PartNo 0 PackedSize 324 count 2 nextOffset 32 batches 1
2025-11-03T16:51:43.951497Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 33 partNo 0
2025-11-03T16:51:43.951521Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 33 partNo 0 FormedBlobsCount 0 NewHead: Offset 30 PartNo 0 PackedSize 470 count 3 nextOffset 33 batches 1
2025-11-03T16:51:43.951540Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 34 partNo 0
2025-11-03T16:51:43.951562Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 34 partNo 0 FormedBlobsCount 0 NewHead: Offset 30 PartNo 0 PackedSize 617 count 4 nextOffset 34 batches 1
2025-11-03T16:51:43.951586Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 35 partNo 0
2025-11-03T16:51:43.951610Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 35 partNo 0 FormedBlobsCount 0 NewHead: Offset 30 PartNo 0 PackedSize 764 count 5 nextOffset 35 batches 1
2025-11-03T16:51:43.951628Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 36 partNo 0
2025-11-03T16:51:43.951646Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 36 partNo 0 FormedBlobsCount 0 NewHead: Offset 30 PartNo 0 PackedSize 911 count 6 nextOffset 36 batches 1
2025-11-03T16:51:43.951669Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 37 partNo 0
2025-11-03T16:51:43.951692Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 37 partNo 0 FormedBlobsCount 0 NewHead: Offset 30 PartNo 0 PackedSize 1058 count 7 nextOffset 37 batches 1
2025-11-03T16:51:43.951709Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 38 partNo 0
2025-11-03T16:51:43.951730Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 38 partNo 0 FormedBlobsCount 0 NewHead: Offset 30 PartNo 0 PackedSize 1205 count 8 nextOffset 38 batches 1
2025-11-03T16:51:43.951750Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 39 partNo 0
2025-11-03T16:51:43.951788Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 39 partNo 0 FormedBlobsCount 0 NewHead: Offset 30 PartNo 0 PackedSize 1352 count 9 nextOffset 39 batches 1
2025-11-03T16:51:43.951818Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 40 partNo 0
2025-11-03T16:51:43.951840Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 40 partNo 0 FormedBlobsCount 0 NewHead: Offset 30 PartNo 0 PackedSize 1499 count 10 nextOffset 40 batches 1
2025-11-03T16:51:43.951860Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 41 partNo 0
2025-11-03T16:51:43.951880Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 41 partNo 0 FormedBlobsCount 0 NewHead: Offset 30 PartNo 0 PackedSize 1646 count 11 nextOffset 41 batches 1
2025-11-03T16:51:43.951899Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 42 partNo 0
2025-11-03T16:51:43.951920Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 42 partNo 0 FormedBlobsCount 0 NewHead: Offset 30 PartNo 0 PackedSize 1794 count 12 nextOffset 42 batches 1
2025-11-03T16:51:43.951941Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 43 partNo 0
2025-11-03T16:51:43.951963Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 43 partNo 0 FormedBlobsCount 0 NewHead: Offset 30 PartNo 0 PackedSize 1942 count 13 nextOffset 43 batches 1
2025-11-03T16:51:43.956506Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 44 partNo 0
2025-11-03T16:51:43.956576Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 44 partNo 0 FormedBlobsCount 0 NewHead: Offset 30 PartNo 0 PackedSize 2090 count 14 nextOffset 44 batches 1
2025-11-03T16:51:43.956631Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 45 partNo 0
2025-11-03T16:51:43.956655Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 45 partNo 0 FormedBlobsCount 0 NewHead: Offset 30 PartNo 0 PackedSize 2238 count 15 nextOffset 45 batches 1
2025-11-03T16:51:43.956672Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:43.957166Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 30,15 HeadOffset 30 endOffset 30 curOffset 45 d0000000000_00000000000000000030_00000_0000000015_00000? size 1818 WTime 1762188703955
2025-11-03T16:51:43.957291Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:51:43.957368Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 45  requestId: <none> cookie: 21
2025-11-03T16:51:43.957426Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 46  requestId: <none> cookie: 22
2025-11-03T16:51:43.957446Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 47  requestId: <none> cookie: 23
2025-11-03T16:51:43.957468Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 48  requestId: <none> cookie: 24
2025-11-03T16:51:43.957503Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 49  requestId: <none> cookie: 25
2025-11-03T16:51:43.957526Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 55  requestId: <none> cookie: 26
2025-11-03T16:51:43.957548Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 56  requestId: <none> cookie: 27
2025-11-03T16:51:43.957569Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 57  requestId: <none> cookie: 28
2025-11-03T16:51:43.957590Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 58  requestId: <none> cookie: 29
2025-11-03T16:51:43.957610Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 59  requestId: <none> cookie: 30
2025-11-03T16:51:43.957681Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:43.957699Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:43.957747Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 95 size 106 offset: -1
2025-11-03T16:51:43.957809Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:43.957820Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:43.957841Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 96 size 106 offset: -1
2025-11-03T16:51:43.957875Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:43.957884Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:43.957906Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 97 size 106 offset: -1
2025-11-03T16:51:43.957939Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:43.957947Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:43.957965Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 98 size 106 offset: -1
2025-11-03T16:51:43.957994Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:43.958003Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:43.958033Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:43.958042Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:43.958071Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:43.958080Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:43.958105Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:43.958115Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:43.958148Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:43.958158Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:43.958184Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 103 size 106 offset: -1
2025-11-03T16:51:43.958210Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:43.958220Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:43.958244Z node 4 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-03T16:51:43.958348Z node 4 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 30 partNo 0 count 15 size 1818
2025-11-03T16:51:43.958392Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:51:43.958427Z node 4 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:51:43.958441Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:51:43.958455Z node 4 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:51:43.958467Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:51:43.958484Z node 4 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:51:43.958496Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:51:43.958511Z node 4 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:51:43.958565Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:51:43.958577Z node 4 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:51:43.958728Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 99  requestId: <none> cookie: 51
2025-11-03T16:51:43.958753Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 100  requestId: <none> cookie: 52
2025-11-03T16:51:43.958769Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 101  requestId: <none> cookie: 53
2025-11-03T16:51:43.958787Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 102  requestId: <none> cookie: 54
2025-11-03T16:51:43.958803Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 104  requestId: <none> cookie: 55
2025-11-03T16:51:43.960653Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:43.960724Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:43.960754Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:43.960782Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:43.960809Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:43.960835Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:43.960859Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:43.960885Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:43.960910Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:43.960936Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:43.960964Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:43.960998Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:43.961024Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:43.961070Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:43.961099Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:43.961901Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:51:43.961957Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:51:43.962004Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:51:43.962036Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:51:43.962069Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:51:43.962941Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:43.962974Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:43.963020Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 105 size 106 offset: -1
2025-11-03T16:51:43.963065Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:43.963074Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:43.963095Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 106 size 106 offset: -1
2025-11-03T16:51:43.963129Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:43.963138Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:43.963157Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 53 partNo : 0 messageNo: 107 size 106 offset: -1
2025-11-03T16:51:43.963188Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:43.963197Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:43.963216Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 54 partNo : 0 messageNo: 108 size 106 offset: -1
2025-11-03T16:51:43.963249Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:43.963258Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:43.963276Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 55 partNo : 0 messageNo: 109 size 106 offset: -1
2025-11-03T16:51:43.963305Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:43.963315Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:43.963343Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:43.963352Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:43.963375Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:43.963385Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:43.963409Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:43.963419Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:43.963445Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:43.963454Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:43.963478Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:51:43.963520Z node 4 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:51:43.963536Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:51:43.963550Z node 4 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:51:43.963561Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:51:43.963575Z node 4 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:51:43.963587Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:51:43.963599Z node 4 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:51:43.963610Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:51:43.963624Z node 4 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:51:43.963751Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 110  requestId: <none> cookie: 56
2025-11-03T16:51:43.963795Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 111  requestId: <none> cookie: 57
2025-11-03T16:51:43.963813Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 112  requestId: <none> cookie: 58
2025-11-03T16:51:43.963831Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 113  requestId: <none> cookie: 59
2025-11-03T16:51:43.963849Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 114  requestId: <none> cookie: 60
2025-11-03T16:51:43.965138Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:43.964558Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session got write response: sequence_numbers: 21 offsets: 20 already_written: false write_statistics { persist_duration_ms: 11 queued_in_partition_duration_ms: 14 }
2025-11-03T16:51:43.965191Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:43.965225Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:43.965250Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:43.965276Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:43.965920Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session: acknoledged message 21
2025-11-03T16:51:43.965500Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:51:43.965547Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:51:43.965577Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:51:43.965606Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:51:43.965638Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:51:43.966293Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session got write response: sequence_numbers: 22 offsets: 21 already_written: false write_statistics { persist_duration_ms: 11 queued_in_partition_duration_ms: 14 }
2025-11-03T16:51:43.966352Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session: acknoledged message 22
2025-11-03T16:51:43.966606Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session got write response: sequence_numbers: 23 offsets: 22 already_written: false write_statistics { persist_duration_ms: 11 queued_in_partition_duration_ms: 14 }
2025-11-03T16:51:43.966652Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session: acknoledged message 23
2025-11-03T16:51:43.966854Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session got write response: sequence_numbers: 24 offsets: 23 already_written: false write_statistics { persist_duration_ms: 11 queued_in_partition_duration_ms: 14 }
2025-11-03T16:51:43.966886Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session: acknoledged message 24
2025-11-03T16:51:43.967128Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session got write response: sequence_numbers: 25 offsets: 24 already_written: false write_statistics { persist_duration_ms: 11 queued_in_partition_duration_ms: 14 }
2025-11-03T16:51:43.967167Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session: acknoledged message 25
2025-11-03T16:51:43.967311Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session got write response: sequence_numbers: 26 offsets: 25 already_written: false write_statistics { persist_duration_ms: 11 queued_in_partition_duration_ms: 6 }
2025-11-03T16:51:43.967340Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session: acknoledged message 26
2025-11-03T16:51:43.967486Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session got write response: sequence_numbers: 27 offsets: 26 already_written: false write_statistics { persist_duration_ms: 11 queued_in_partition_duration_ms: 6 }
2025-11-03T16:51:43.967516Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session: acknoledged message 27
2025-11-03T16:51:43.967656Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session got write response: sequence_numbers: 28 offsets: 27 already_written: false write_statistics { persist_duration_ms: 11 queued_in_partition_duration_ms: 6 }
2025-11-03T16:51:43.967718Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session: acknoledged message 28
2025-11-03T16:51:43.967871Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session got write response: sequence_numbers: 29 offsets: 28 already_written: false write_statistics { persist_duration_ms: 11 queued_in_partition_duration_ms: 6 }
2025-11-03T16:51:43.967892Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session: acknoledged message 29
2025-11-03T16:51:43.968027Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session got write response: sequence_numbers: 30 offsets: 29 already_written: false write_statistics { persist_duration_ms: 11 queued_in_partition_duration_ms: 6 }
2025-11-03T16:51:43.968087Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session: acknoledged message 30
2025-11-03T16:51:43.967966Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:43.968030Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:43.968064Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:43.968104Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:43.968136Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:43.968349Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:51:43.968396Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:51:43.968428Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:51:43.968455Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:51:43.968487Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:51:43.966566Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:43.966592Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:43.966653Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 56 partNo : 0 messageNo: 115 size 106 offset: -1
2025-11-03T16:51:43.966702Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:43.966711Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:43.966732Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 57 partNo : 0 messageNo: 116 size 106 offset: -1
2025-11-03T16:51:43.966765Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:43.966776Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:43.966795Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 58 partNo : 0 messageNo: 117 size 106 offset: -1
2025-11-03T16:51:43.966824Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:43.966835Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:43.966855Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 59 partNo : 0 messageNo: 118 size 106 offset: -1
2025-11-03T16:51:43.966889Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:43.966898Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:43.966916Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 60 partNo : 0 messageNo: 119 size 106 offset: -1
2025-11-03T16:51:43.966944Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:43.966954Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:43.966981Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:43.966991Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:43.967040Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:43.967054Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:43.967082Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:43.967091Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:43.967115Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:43.967124Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:43.967150Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:51:43.967186Z node 4 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:51:43.967201Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:51:43.967218Z node 4 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:51:43.967229Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:51:43.967243Z node 4 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:51:43.967254Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:51:43.967269Z node 4 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:51:43.967280Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:51:43.967296Z node 4 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:51:43.967377Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 120  requestId: <none> cookie: 61
2025-11-03T16:51:43.967403Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 121  requestId: <none> cookie: 62
2025-11-03T16:51:43.967419Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 122  requestId: <none> cookie: 63
2025-11-03T16:51:43.967434Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 123  requestId: <none> cookie: 64
2025-11-03T16:51:43.967450Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 124  requestId: <none> cookie: 65
2025-11-03T16:51:43.973086Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:43.973116Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:43.973169Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 61 partNo : 0 messageNo: 125 size 106 offset: -1
2025-11-03T16:51:43.973216Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:43.973240Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:43.973261Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 62 partNo : 0 messageNo: 126 size 106 offset: -1
2025-11-03T16:51:43.973295Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:43.973305Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:43.973337Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 63 partNo : 0 messageNo: 127 size 106 offset: -1
2025-11-03T16:51:43.973373Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:43.973383Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:43.973403Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 64 partNo : 0 messageNo: 128 size 106 offset: -1
2025-11-03T16:51:43.973439Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:43.973450Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:43.973468Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 65 partNo : 0 messageNo: 129 size 106 offset: -1
2025-11-03T16:51:43.973497Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:43.973509Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:43.973541Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:43.973550Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:43.973575Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:43.973586Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:43.973614Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:43.973624Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:43.973657Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:43.973665Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:43.973716Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 30 count 15 size 1818 actorID [4:7568542851518043584:2385]
2025-11-03T16:51:43.973770Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:51:43.973815Z node 4 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:51:43.973829Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:51:43.973843Z node 4 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:51:43.973858Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:51:43.973872Z node 4 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:51:43.973883Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:51:43.973895Z node 4 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:51:43.973906Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:51:43.973920Z node 4 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:51:43.974028Z node 4 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-03T16:51:43.974073Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1681 WriteNewSizeFromSupportivePartitions# 0
2025-11-03T16:51:43.974102Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:51:43.974131Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 31, partNo: 0, Offset: 30 is stored on disk
2025-11-03T16:51:43.974145Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:51:43.974163Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 32, partNo: 0, Offset: 31 is stored on disk
2025-11-03T16:51:43.974175Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:51:43.974198Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 33, partNo: 0, Offset: 32 is stored on disk
2025-11-03T16:51:43.974209Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:51:43.974228Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 34, partNo: 0, Offset: 33 is stored on disk
2025-11-03T16:51:43.974240Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:51:43.974258Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 35, partNo: 0, Offset: 34 is stored on disk
2025-11-03T16:51:43.974269Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:51:43.974286Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 36, partNo: 0, Offset: 35 is stored on disk
2025-11-03T16:51:43.974298Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:51:43.974314Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 37, partNo: 0, Offset: 36 is stored on disk
2025-11-03T16:51:43.974325Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:51:43.974345Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 38, partNo: 0, Offset: 37 is stored on disk
2025-11-03T16:51:43.974355Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:51:43.974374Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 39, partNo: 0, Offset: 38 is stored on disk
2025-11-03T16:51:43.974386Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:51:43.974405Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 40, partNo: 0, Offset: 39 is stored on disk
2025-11-03T16:51:43.974417Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:51:43.974435Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 41, partNo: 0, Offset: 40 is stored on disk
2025-11-03T16:51:43.974446Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:51:43.974500Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 42, partNo: 0, Offset: 41 is stored on disk
2025-11-03T16:51:43.974510Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:51:43.974527Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 43, partNo: 0, Offset: 42 is stored on disk
2025-11-03T16:51:43.974538Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:51:43.974555Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 44, partNo: 0, Offset: 43 is stored on disk
2025-11-03T16:51:43.974566Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:51:43.974581Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 45, partNo: 0, Offset: 44 is stored on disk
2025-11-03T16:51:43.974758Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:43.974824Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:43.974834Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (20)
2025-11-03T16:51:43.974915Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 0
2025-11-03T16:51:43.975778Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 15 parts 0 suffix '63' size 1818
2025-11-03T16:51:44.031116Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 46 partNo 0 FormedBlobsCount 0 NewHead: Offset 45 PartNo 0 PackedSize 180 count 1 nextOffset 46 batches 1
2025-11-03T16:51:44.031207Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 0
2025-11-03T16:51:44.031246Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 47 partNo 0 FormedBlobsCount 0 NewHead: Offset 45 PartNo 0 PackedSize 328 count 2 nextOffset 47 batches 1
2025-11-03T16:51:44.031265Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 0
2025-11-03T16:51:44.031284Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 48 partNo 0 FormedBlobsCount 0 NewHead: Offset 45 PartNo 0 PackedSize 476 count 3 nextOffset 48 batches 1
2025-11-03T16:51:44.031304Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 49 partNo 0
2025-11-03T16:51:44.031323Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 49 partNo 0 FormedBlobsCount 0 NewHead: Offset 45 PartNo 0 PackedSize 624 count 4 nextOffset 49 batches 1
2025-11-03T16:51:44.031342Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 50 partNo 0
2025-11-03T16:51:44.031364Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 50 partNo 0 FormedBlobsCount 0 NewHead: Offset 45 PartNo 0 PackedSize 772 count 5 nextOffset 50 batches 1
2025-11-03T16:51:44.031390Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 51 partNo 0
2025-11-03T16:51:44.031410Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 51 partNo 0 FormedBlobsCount 0 NewHead: Offset 45 PartNo 0 PackedSize 920 count 6 nextOffset 51 batches 1
2025-11-03T16:51:44.031429Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 52 partNo 0
2025-11-03T16:51:44.031448Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 52 partNo 0 FormedBlobsCount 0 NewHead: Offset 45 PartNo 0 PackedSize 1068 count 7 nextOffset 52 batches 1
2025-11-03T16:51:44.031468Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 53 partNo 0
2025-11-03T16:51:44.031490Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 53 partNo 0 FormedBlobsCount 0 NewHead: Offset 45 PartNo 0 PackedSize 1216 count 8 nextOffset 53 batches 1
2025-11-03T16:51:44.031508Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 54 partNo 0
2025-11-03T16:51:44.031530Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 54 partNo 0 FormedBlobsCount 0 NewHead: Offset 45 PartNo 0 PackedSize 1364 count 9 nextOffset 54 batches 1
2025-11-03T16:51:44.031551Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 55 partNo 0
2025-11-03T16:51:44.031576Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 55 partNo 0 FormedBlobsCount 0 NewHead: Offset 45 PartNo 0 PackedSize 1512 count 10 nextOffset 55 batches 1
2025-11-03T16:51:44.031594Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 56 partNo 0
2025-11-03T16:51:44.031614Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 56 partNo 0 FormedBlobsCount 0 NewHead: Offset 45 PartNo 0 PackedSize 1660 count 11 nextOffset 56 batches 1
2025-11-03T16:51:44.031636Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 57 partNo 0
2025-11-03T16:51:44.031655Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 57 partNo 0 FormedBlobsCount 0 NewHead: Offset 45 PartNo 0 PackedSize 1808 count 12 nextOffset 57 batches 1
2025-11-03T16:51:44.031675Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 58 partNo 0
2025-11-03T16:51:44.031696Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 58 partNo 0 FormedBlobsCount 0 NewHead: Offset 45 PartNo 0 PackedSize 1956 count 13 nextOffset 58 batches 1
2025-11-03T16:51:44.031716Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 59 partNo 0
2025-11-03T16:51:44.031737Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 59 partNo 0 FormedBlobsCount 0 NewHead: Offset 45 PartNo 0 PackedSize 2104 count 14 nextOffset 59 batches 1
2025-11-03T16:51:44.031757Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 60 partNo 0
2025-11-03T16:51:44.031777Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 60 partNo 0 FormedBlobsCount 0 NewHead: Offset 45 PartNo 0 PackedSize 2252 count 15 nextOffset 60 batches 1
2025-11-03T16:51:44.031799Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 61 partNo 0
2025-11-03T16:51:44.031817Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 61 partNo 0 FormedBlobsCount 0 NewHead: Offset 45 PartNo 0 PackedSize 2400 count 16 nextOffset 61 batches 1
2025-11-03T16:51:44.031836Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 62 partNo 0
2025-11-03T16:51:44.031857Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 62 partNo 0 FormedBlobsCount 0 NewHead: Offset 45 PartNo 0 PackedSize 2548 count 17 nextOffset 62 batches 1
2025-11-03T16:51:44.031873Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 63 partNo 0
2025-11-03T16:51:44.031891Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 63 partNo 0 FormedBlobsCount 0 NewHead: Offset 45 PartNo 0 PackedSize 2696 count 18 nextOffset 63 batches 1
2025-11-03T16:51:44.031909Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 64 partNo 0
2025-11-03T16:51:44.031927Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 64 partNo 0 FormedBlobsCount 0 NewHead: Offset 45 PartNo 0 PackedSize 2844 count 19 nextOffset 64 batches 1
2025-11-03T16:51:44.031948Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 65 partNo 0
2025-11-03T16:51:44.031966Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 65 partNo 0 FormedBlobsCount 0 NewHead: Offset 45 PartNo 0 PackedSize 2992 count 20 nextOffset 65 batches 1
2025-11-03T16:51:44.032001Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:44.032597Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 45,20 HeadOffset 45 endOffset 45 curOffset 65 d0000000000_00000000000000000045_00000_0000000020_00000? size 2412 WTime 1762188704032
2025-11-03T16:51:44.032724Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:51:44.032825Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 130  requestId: <none> cookie: 66
2025-11-03T16:51:44.032876Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 131  requestId: <none> cookie: 67
2025-11-03T16:51:44.032893Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 132  requestId: <none> cookie: 68
2025-11-03T16:51:44.032918Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 133  requestId: <none> cookie: 69
2025-11-03T16:51:44.032932Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 134  requestId: <none> cookie: 70
2025-11-03T16:51:44.032959Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 65  requestId: <none> cookie: 31
2025-11-03T16:51:44.032984Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 66  requestId: <none> cookie: 32
2025-11-03T16:51:44.033003Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 67  requestId: <none> cookie: 33
2025-11-03T16:51:44.033023Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 68  requestId: <none> cookie: 34
2025-11-03T16:51:44.033044Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 69  requestId: <none> cookie: 35
2025-11-03T16:51:44.033065Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 75  requestId: <none> cookie: 36
2025-11-03T16:51:44.033085Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 76  requestId: <none> cookie: 37
2025-11-03T16:51:44.033111Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 77  requestId: <none> cookie: 38
2025-11-03T16:51:44.033130Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 78  requestId: <none> cookie: 39
2025-11-03T16:51:44.033147Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 79  requestId: <none> cookie: 40
2025-11-03T16:51:44.033171Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 85  requestId: <none> cookie: 41
2025-11-03T16:51:44.033190Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 86  requestId: <none> cookie: 42
2025-11-03T16:51:44.033208Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 87  requestId: <none> cookie: 43
2025-11-03T16:51:44.033232Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 88  requestId: <none> cookie: 44
2025-11-03T16:51:44.033252Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 89  requestId: <none> cookie: 45
2025-11-03T16:51:44.033291Z node 4 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:51:44.033314Z node 4 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-03T16:51:44.033414Z node 4 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 45 partNo 0 count 20 size 2412
2025-11-03T16:51:44.037232Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:44.037299Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:44.037325Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:44.037352Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:44.037391Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:44.037417Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:44.037455Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:44.037485Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:44.037514Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:44.037542Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:44.037567Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:44.037590Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:44.037615Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:44.037642Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:44.037667Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:44.037694Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:44.037721Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:44.037786Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:44.037815Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:44.037862Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:44.038138Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:51:44.038196Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:51:44.038228Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:51:44.038257Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:51:44.038288Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:51:44.040121Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:44.040166Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:44.040228Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 66 partNo : 0 messageNo: 135 size 107 offset: -1
2025-11-03T16:51:44.040282Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:44.040293Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:44.040315Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 67 partNo : 0 messageNo: 136 size 107 offset: -1
2025-11-03T16:51:44.040347Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:44.040355Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:44.040375Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 68 partNo : 0 messageNo: 137 size 107 offset: -1
2025-11-03T16:51:44.040421Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:44.040430Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:44.040448Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 69 partNo : 0 messageNo: 138 size 107 offset: -1
2025-11-03T16:51:44.040479Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:44.040489Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:44.040509Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 70 partNo : 0 messageNo: 139 size 107 offset: -1
2025-11-03T16:51:44.040536Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:44.040545Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:44.040573Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:44.040582Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:44.040608Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:44.040616Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:44.040643Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:44.040651Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:44.040676Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:44.040686Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:44.040717Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:51:44.040765Z node 4 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:51:44.040780Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:51:44.040795Z node 4 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:51:44.040806Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:51:44.040820Z node 4 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:51:44.040832Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:51:44.040847Z node 4 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:51:44.040860Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:51:44.040870Z node 4 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:51:44.040945Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 140  requestId: <none> cookie: 71
2025-11-03T16:51:44.040978Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 141  requestId: <none> cookie: 72
2025-11-03T16:51:44.040993Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 142  requestId: <none> cookie: 73
2025-11-03T16:51:44.041007Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 143  requestId: <none> cookie: 74
2025-11-03T16:51:44.041021Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 144  requestId: <none> cookie: 75
2025-11-03T16:51:44.042145Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:44.042210Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:44.042256Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:44.042280Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:44.042314Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:44.042525Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:51:44.042575Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:51:44.042606Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:51:44.042653Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:51:44.042685Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:51:44.044628Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session got write response: sequence_numbers: 31 offsets: 30 already_written: false write_statistics { persist_duration_ms: 23 queued_in_partition_duration_ms: 11 }
2025-11-03T16:51:44.043665Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:44.044679Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session: acknoledged message 31
2025-11-03T16:51:44.043696Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:44.043745Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 71 partNo : 0 messageNo: 145 size 107 offset: -1
2025-11-03T16:51:44.043788Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:44.043798Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:44.043816Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 72 partNo : 0 messageNo: 146 size 107 offset: -1
2025-11-03T16:51:44.043848Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:44.043856Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:44.043875Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 73 partNo : 0 messageNo: 147 size 107 offset: -1
2025-11-03T16:51:44.043907Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:44.043917Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:44.043934Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 74 partNo : 0 messageNo: 148 size 107 offset: -1
2025-11-03T16:51:44.043965Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:44.043974Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:44.044014Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 75 partNo : 0 messageNo: 149 size 107 offset: -1
2025-11-03T16:51:44.044045Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:44.044953Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session got write response: sequence_numbers: 32 offsets: 31 already_written: false write_statistics { persist_duration_ms: 23 queued_in_partition_duration_ms: 11 }
2025-11-03T16:51:44.044055Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:44.044104Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:44.044990Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session: acknoledged message 32
2025-11-03T16:51:44.044115Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:44.044143Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:44.044150Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:44.044172Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:44.044180Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:44.044202Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:44.044210Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:44.044236Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:51:44.044277Z node 4 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:51:44.044292Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:51:44.045151Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session got write response: sequence_numbers: 33 offsets: 32 already_written: false write_statistics { persist_duration_ms: 23 queued_in_partition_duration_ms: 11 }
2025-11-03T16:51:44.044306Z node 4 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:51:44.045177Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session: acknoledged message 33
2025-11-03T16:51:44.044316Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:51:44.044329Z node 4 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:51:44.044342Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:51:44.044353Z node 4 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:51:44.044363Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:51:44.044375Z node 4 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:51:44.044444Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 150  requestId: <none> cookie: 76
2025-11-03T16:51:44.044504Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 151  requestId: <none> cookie: 77
2025-11-03T16:51:44.044520Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 152  requestId: <none> cookie: 78
2025-11-03T16:51:44.045308Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session got write response: sequence_numbers: 34 offsets: 33 already_written: false write_statistics { persist_duration_ms: 23 queued_in_partition_duration_ms: 10 }
2025-11-03T16:51:44.044536Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 153  requestId: <none> cookie: 79
2025-11-03T16:51:44.045331Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session: acknoledged message 34
2025-11-03T16:51:44.044550Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 154  requestId: <none> cookie: 80
2025-11-03T16:51:44.045480Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session got write response: sequence_numbers: 35 offsets: 34 already_written: false write_statistics { persist_duration_ms: 23 queued_in_partition_duration_ms: 10 }
2025-11-03T16:51:44.045524Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session: acknoledged message 35
2025-11-03T16:51:44.045691Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session got write response: sequence_numbers: 36 offsets: 35 already_written: false write_statistics { persist_duration_ms: 23 queued_in_partition_duration_ms: 4 }
2025-11-03T16:51:44.045713Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session: acknoledged message 36
2025-11-03T16:51:44.045832Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session got write response: sequence_numbers: 37 offsets: 36 already_written: false write_statistics { persist_duration_ms: 23 queued_in_partition_duration_ms: 4 }
2025-11-03T16:51:44.045849Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session: acknoledged message 37
2025-11-03T16:51:44.045986Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session got write response: sequence_numbers: 38 offsets: 37 already_written: false write_statistics { persist_duration_ms: 23 queued_in_partition_duration_ms: 4 }
2025-11-03T16:51:44.046019Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session: acknoledged message 38
2025-11-03T16:51:44.046174Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session got write response: sequence_numbers: 39 offsets: 38 already_written: false write_statistics { persist_duration_ms: 23 queued_in_partition_duration_ms: 4 }
2025-11-03T16:51:44.046203Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session: acknoledged message 39
2025-11-03T16:51:44.045152Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:44.045219Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:44.045248Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:44.045273Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:44.045297Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:44.045515Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:51:44.046322Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session got write response: sequence_numbers: 40 offsets: 39 already_written: false write_statistics { persist_duration_ms: 23 queued_in_partition_duration_ms: 4 }
2025-11-03T16:51:44.045569Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:51:44.046341Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session: acknoledged message 40
2025-11-03T16:51:44.045572Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 45 count 20 size 2412 actorID [4:7568542851518043584:2385]
2025-11-03T16:51:44.045639Z node 4 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-03T16:51:44.045684Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 2260 WriteNewSizeFromSupportivePartitions# 0
2025-11-03T16:51:44.045722Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:51:44.045752Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 46, partNo: 0, Offset: 45 is stored on disk
2025-11-03T16:51:44.046438Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session got write response: sequence_numbers: 41 offsets: 40 already_written: false write_statistics { persist_duration_ms: 23 queued_in_partition_duration_ms: 1 }
2025-11-03T16:51:44.045767Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:51:44.046458Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session: acknoledged message 41
2025-11-03T16:51:44.046566Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session got write response: sequence_numbers: 42 offsets: 41 already_written: false write_statistics { persist_duration_ms: 23 queued_in_partition_duration_ms: 1 }
2025-11-03T16:51:44.046582Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session: acknoledged message 42
2025-11-03T16:51:44.046742Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session got write response: sequence_numbers: 43 offsets: 42 already_written: false write_statistics { persist_duration_ms: 23 queued_in_partition_duration_ms: 1 }
2025-11-03T16:51:44.046772Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session: acknoledged message 43
2025-11-03T16:51:44.046884Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session got write response: sequence_numbers: 44 offsets: 43 already_written: false write_statistics { persist_duration_ms: 17 queued_in_partition_duration_ms: 7 }
2025-11-03T16:51:44.045609Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:51:44.046903Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session: acknoledged message 44
2025-11-03T16:51:44.045640Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:51:44.045670Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:51:44.045784Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 47, partNo: 0, Offset: 46 is stored on disk
2025-11-03T16:51:44.045795Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:51:44.045812Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 48, partNo: 0, Offset: 47 is stored on disk
2025-11-03T16:51:44.045824Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:51:44.045838Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 49, partNo: 0, Offset: 48 is stored on disk
2025-11-03T16:51:44.047293Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session got write response: sequence_numbers: 45 offsets: 44 already_written: false write_statistics { persist_duration_ms: 17 queued_in_partition_duration_ms: 7 }
2025-11-03T16:51:44.047335Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session: acknoledged message 45
2025-11-03T16:51:44.045850Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:51:44.045865Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 50, partNo: 0, Offset: 49 is stored on disk
2025-11-03T16:51:44.045875Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:51:44.045893Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 51, partNo: 0, Offset: 50 is stored on disk
2025-11-03T16:51:44.045904Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:51:44.045920Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 52, partNo: 0, Offset: 51 is stored on disk
2025-11-03T16:51:44.045932Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:51:44.045950Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 53, partNo: 0, Offset: 52 is stored on disk
2025-11-03T16:51:44.045960Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:51:44.045975Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 54, partNo: 0, Offset: 53 is stored on disk
2025-11-03T16:51:44.045995Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:51:44.046014Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 55, partNo: 0, Offset: 54 is stored on disk
2025-11-03T16:51:44.046029Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:51:44.046046Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 56, partNo: 0, Offset: 55 is stored on disk
2025-11-03T16:51:44.046056Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:51:44.046108Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 57, partNo: 0, Offset: 56 is stored on disk
2025-11-03T16:51:44.046121Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:51:44.046138Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 58, partNo: 0, Offset: 57 is stored on disk
2025-11-03T16:51:44.046149Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:51:44.046167Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 59, partNo: 0, Offset: 58 is stored on disk
2025-11-03T16:51:44.046179Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:51:44.046201Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 60, partNo: 0, Offset: 59 is stored on disk
2025-11-03T16:51:44.046213Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:51:44.046228Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 61, partNo: 0, Offset: 60 is stored on disk
2025-11-03T16:51:44.046238Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:51:44.046252Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 62, partNo: 0, Offset: 61 is stored on disk
2025-11-03T16:51:44.046263Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:51:44.046280Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 63, partNo: 0, Offset: 62 is stored on disk
2025-11-03T16:51:44.046477Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 45 partno 0 count 20 parts 0 suffix '63' size 2412
2025-11-03T16:51:44.046485Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:51:44.046507Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 64, partNo: 0, Offset: 63 is stored on disk
2025-11-03T16:51:44.046529Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:51:44.046548Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 65, partNo: 0, Offset: 64 is stored on disk
2025-11-03T16:51:44.046741Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:44.046793Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:44.046805Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (10)
2025-11-03T16:51:44.046906Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 66 partNo 0
2025-11-03T16:51:44.056983Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 66 partNo 0 FormedBlobsCount 0 NewHead: Offset 65 PartNo 0 PackedSize 181 count 1 nextOffset 66 batches 1
2025-11-03T16:51:44.057075Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 67 partNo 0
2025-11-03T16:51:44.057118Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 67 partNo 0 FormedBlobsCount 0 NewHead: Offset 65 PartNo 0 PackedSize 330 count 2 nextOffset 67 batches 1
2025-11-03T16:51:44.057138Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 68 partNo 0
2025-11-03T16:51:44.057159Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 68 partNo 0 FormedBlobsCount 0 NewHead: Offset 65 PartNo 0 PackedSize 479 count 3 nextOffset 68 batches 1
2025-11-03T16:51:44.057180Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 69 partNo 0
2025-11-03T16:51:44.057200Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 69 partNo 0 FormedBlobsCount 0 NewHead: Offset 65 PartNo 0 PackedSize 628 count 4 nextOffset 69 batches 1
2025-11-03T16:51:44.057219Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 70 partNo 0
2025-11-03T16:51:44.057241Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 70 partNo 0 FormedBlobsCount 0 NewHead: Offset 65 PartNo 0 PackedSize 777 count 5 nextOffset 70 batches 1
2025-11-03T16:51:44.057260Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 71 partNo 0
2025-11-03T16:51:44.057276Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 71 partNo 0 FormedBlobsCount 0 NewHead: Offset 65 PartNo 0 PackedSize 926 count 6 nextOffset 71 batches 1
2025-11-03T16:51:44.057294Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 72 partNo 0
2025-11-03T16:51:44.057313Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 72 partNo 0 FormedBlobsCount 0 NewHead: Offset 65 PartNo 0 PackedSize 1075 count 7 nextOffset 72 batches 1
2025-11-03T16:51:44.057332Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 73 partNo 0
2025-11-03T16:51:44.057349Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 73 partNo 0 FormedBlobsCount 0 NewHead: Offset 65 PartNo 0 PackedSize 1224 count 8 nextOffset 73 batches 1
2025-11-03T16:51:44.057365Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 74 partNo 0
2025-11-03T16:51:44.057386Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 74 partNo 0 FormedBlobsCount 0 NewHead: Offset 65 PartNo 0 PackedSize 1373 count 9 nextOffset 74 batches 1
2025-11-03T16:51:44.057403Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 75 partNo 0
2025-11-03T16:51:44.057420Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 75 partNo 0 FormedBlobsCount 0 NewHead: Offset 65 PartNo 0 PackedSize 1522 count 10 nextOffset 75 batches 1
2025-11-03T16:51:44.057437Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:44.057931Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 65,10 HeadOffset 65 endOffset 65 curOffset 75 d0000000000_00000000000000000065_00000_0000000010_00000? size 1262 WTime 1762188704057
2025-11-03T16:51:44.058063Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:51:44.058148Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 95  requestId: <none> cookie: 46
2025-11-03T16:51:44.058209Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 96  requestId: <none> cookie: 47
2025-11-03T16:51:44.058233Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 97  requestId: <none> cookie: 48
2025-11-03T16:51:44.058257Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 98  requestId: <none> cookie: 49
2025-11-03T16:51:44.058282Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 103  requestId: <none> cookie: 50
2025-11-03T16:51:44.058305Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 105  requestId: <none> cookie: 51
2025-11-03T16:51:44.058328Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 106  requestId: <none> cookie: 52
2025-11-03T16:51:44.058351Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 107  requestId: <none> cookie: 53
2025-11-03T16:51:44.058374Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 108  requestId: <none> cookie: 54
2025-11-03T16:51:44.058396Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 109  requestId: <none> cookie: 55
2025-11-03T16:51:44.058418Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 115  requestId: <none> cookie: 56
2025-11-03T16:51:44.058439Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 116  requestId: <none> cookie: 57
2025-11-03T16:51:44.058461Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 117  requestId: <none> cookie: 58
2025-11-03T16:51:44.058484Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 118  requestId: <none> cookie: 59
2025-11-03T16:51:44.058510Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 119  requestId: <none> cookie: 60
2025-11-03T16:51:44.058533Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 125  requestId: <none> cookie: 61
2025-11-03T16:51:44.058555Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 126  requestId: <none> cookie: 62
2025-11-03T16:51:44.058575Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 127  requestId: <none> cookie: 63
2025-11-03T16:51:44.058600Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 128  requestId: <none> cookie: 64
2025-11-03T16:51:44.058622Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 129  requestId: <none> cookie: 65
2025-11-03T16:51:44.058725Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:44.058747Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:44.058802Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 76 partNo : 0 messageNo: 155 size 107 offset: -1
2025-11-03T16:51:44.058853Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:44.058867Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:44.058888Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 77 partNo : 0 messageNo: 156 size 107 offset: -1
2025-11-03T16:51:44.058928Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:44.058940Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:44.058961Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 78 partNo : 0 messageNo: 157 size 107 offset: -1
2025-11-03T16:51:44.059018Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:44.059029Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:44.059051Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 79 partNo : 0 messageNo: 158 size 107 offset: -1
2025-11-03T16:51:44.059084Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:44.059097Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:44.059117Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 80 partNo : 0 messageNo: 159 size 107 offset: -1
2025-11-03T16:51:44.059148Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:44.059159Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:44.059191Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:44.059200Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:44.059226Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:44.059238Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:44.059294Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:44.059309Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:44.059344Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:44.059356Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:44.059380Z node 4 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-03T16:51:44.059499Z node 4 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 65 partNo 0 count 10 size 1262
2025-11-03T16:51:44.059538Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:51:44.059584Z node 4 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:51:44.059598Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:51:44.059614Z node 4 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:51:44.059626Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:51:44.059640Z node 4 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:51:44.059652Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:51:44.059666Z node 4 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:51:44.059677Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:51:44.059691Z node 4 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:51:44.059879Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 160  requestId: <none> cookie: 81
2025-11-03T16:51:44.059920Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 161  requestId: <none> cookie: 82
2025-11-03T16:51:44.059937Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 162  requestId: <none> cookie: 83
2025-11-03T16:51:44.059954Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 163  requestId: <none> cookie: 84
2025-11-03T16:51:44.059971Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 164  requestId: <none> cookie: 85
2025-11-03T16:51:44.062323Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session got write response: sequence_numbers: 46 offsets: 45 already_written: false write_statistics { persist_duration_ms: 12 queued_in_partition_duration_ms: 72 }
2025-11-03T16:51:44.062385Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session: acknoledged message 46
2025-11-03T16:51:44.060610Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:44.060690Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:44.060722Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:44.060752Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:44.060777Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:44.060804Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:44.060828Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:44.060853Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:44.060878Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:44.060902Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:44.060973Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:44.061001Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:44.061030Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:44.061055Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:44.061097Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:44.061127Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:44.061151Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:44.061178Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:44.061204Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:44.061252Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:44.061278Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:44.061314Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:44.061364Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:44.061390Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:44.061415Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:44.062417Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:51:44.062469Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:51:44.062502Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:51:44.062533Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:51:44.062566Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:51:44.063912Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session got write response: sequence_numbers: 47 offsets: 46 already_written: false write_statistics { persist_duration_ms: 12 queued_in_partition_duration_ms: 72 }
2025-11-03T16:51:44.063948Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session: acknoledged message 47
2025-11-03T16:51:44.064115Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session got write response: sequence_numbers: 48 offsets: 47 already_written: false write_statistics { persist_duration_ms: 12 queued_in_partition_duration_ms: 72 }
2025-11-03T16:51:44.064136Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session: acknoledged message 48
2025-11-03T16:51:44.064601Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session got write response: sequence_numbers: 49 offsets: 48 already_written: false write_statistics { persist_duration_ms: 12 queued_in_partition_duration_ms: 72 }
2025-11-03T16:51:44.064633Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session: acknoledged message 49
2025-11-03T16:51:44.064820Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session got write response: sequence_numbers: 50 offsets: 49 already_written: false write_statistics { persist_duration_ms: 12 queued_in_partition_duration_ms: 72 }
2025-11-03T16:51:44.064839Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session: acknoledged message 50
2025-11-03T16:51:44.064952Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session got write response: sequence_numbers: 51 offsets: 50 already_written: false write_statistics { persist_duration_ms: 12 queued_in_partition_duration_ms: 68 }
2025-11-03T16:51:44.064976Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session: acknoledged message 51
2025-11-03T16:51:44.065070Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session got write response: sequence_numbers: 52 offsets: 51 already_written: false write_statistics { persist_duration_ms: 12 queued_in_partition_duration_ms: 68 }
2025-11-03T16:51:44.065095Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session: acknoledged message 52
2025-11-03T16:51:44.065203Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session got write response: sequence_numbers: 53 offsets: 52 already_written: false write_statistics { persist_duration_ms: 12 queued_in_partition_duration_ms: 67 }
2025-11-03T16:51:44.065225Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session: acknoledged message 53
2025-11-03T16:51:44.065377Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session got write response: sequence_numbers: 54 offsets: 53 already_written: false write_statistics { persist_duration_ms: 12 queued_in_partition_duration_ms: 67 }
2025-11-03T16:51:44.065401Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session: acknoledged message 54
2025-11-03T16:51:44.065906Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session got write response: sequence_numbers: 55 offsets: 54 already_written: false write_statistics { persist_duration_ms: 12 queued_in_partition_duration_ms: 67 }
2025-11-03T16:51:44.065945Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session: acknoledged message 55
2025-11-03T16:51:44.066073Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session got write response: sequence_numbers: 56 offsets: 55 already_written: false write_statistics { persist_duration_ms: 12 queued_in_partition_duration_ms: 63 }
2025-11-03T16:51:44.066095Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session: acknoledged message 56
2025-11-03T16:51:44.066214Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session got write response: sequence_numbers: 57 offsets: 56 already_written: false write_statistics { persist_duration_ms: 12 queued_in_partition_duration_ms: 63 }
2025-11-03T16:51:44.066234Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session: acknoledged message 57
2025-11-03T16:51:44.066352Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session got write response: sequence_numbers: 58 offsets: 57 already_written: false write_statistics { persist_duration_ms: 12 queued_in_partition_duration_ms: 63 }
2025-11-03T16:51:44.066378Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session: acknoledged message 58
2025-11-03T16:51:44.066478Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session got write response: sequence_numbers: 59 offsets: 58 already_written: false write_statistics { persist_duration_ms: 12 queued_in_partition_duration_ms: 63 }
2025-11-03T16:51:44.066497Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session: acknoledged message 59
2025-11-03T16:51:44.066621Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session got write response: sequence_numbers: 60 offsets: 59 already_written: false write_statistics { persist_duration_ms: 12 queued_in_partition_duration_ms: 63 }
2025-11-03T16:51:44.066659Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session: acknoledged message 60
2025-11-03T16:51:44.066763Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session got write response: sequence_numbers: 61 offsets: 60 already_written: false write_statistics { persist_duration_ms: 12 queued_in_partition_duration_ms: 57 }
2025-11-03T16:51:44.066785Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session: acknoledged message 61
2025-11-03T16:51:44.066899Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session got write response: sequence_numbers: 62 offsets: 61 already_written: false write_statistics { persist_duration_ms: 12 queued_in_partition_duration_ms: 57 }
2025-11-03T16:51:44.066926Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session: acknoledged message 62
2025-11-03T16:51:44.067043Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session got write response: sequence_numbers: 63 offsets: 62 already_written: false write_statistics { persist_duration_ms: 12 queued_in_partition_duration_ms: 57 }
2025-11-03T16:51:44.067061Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session: acknoledged message 63
2025-11-03T16:51:44.067161Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session got write response: sequence_numbers: 64 offsets: 63 already_written: false write_statistics { persist_duration_ms: 12 queued_in_partition_duration_ms: 57 }
2025-11-03T16:51:44.067181Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session: acknoledged message 64
2025-11-03T16:51:44.067273Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session got write response: sequence_numbers: 65 offsets: 64 already_written: false write_statistics { persist_duration_ms: 12 queued_in_partition_duration_ms: 57 }
2025-11-03T16:51:44.067295Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session: acknoledged message 65
2025-11-03T16:51:44.068128Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:44.068177Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:44.068242Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 81 partNo : 0 messageNo: 165 size 107 offset: -1
2025-11-03T16:51:44.068317Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:44.068329Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:44.068353Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 82 partNo : 0 messageNo: 166 size 108 offset: -1
2025-11-03T16:51:44.068394Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:44.068405Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:44.068425Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 83 partNo : 0 messageNo: 167 size 108 offset: -1
2025-11-03T16:51:44.068460Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:44.068469Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:44.068490Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 84 partNo : 0 messageNo: 168 size 108 offset: -1
2025-11-03T16:51:44.068528Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:44.068542Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:44.068563Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 85 partNo : 0 messageNo: 169 size 108 offset: -1
2025-11-03T16:51:44.068611Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:44.068622Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:44.068655Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:44.068664Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:44.068689Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:44.068699Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:44.068722Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:44.068732Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:44.068759Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:44.068767Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:44.068842Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:51:44.068891Z node 4 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:51:44.068905Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:51:44.068918Z node 4 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:51:44.068928Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:51:44.068942Z node 4 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:51:44.068954Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:51:44.068968Z node 4 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:51:44.068981Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:51:44.068996Z node 4 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:51:44.069439Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 170  requestId: <none> cookie: 86
2025-11-03T16:51:44.069481Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 171  requestId: <none> cookie: 87
2025-11-03T16:51:44.069498Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 172  requestId: <none> cookie: 88
2025-11-03T16:51:44.069512Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 173  requestId: <none> cookie: 89
2025-11-03T16:51:44.069528Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 174  requestId: <none> cookie: 90
2025-11-03T16:51:44.073272Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:44.073339Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:44.073368Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:44.073393Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:44.073417Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:44.073631Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:51:44.073686Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:51:44.073719Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:51:44.073750Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:51:44.073779Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:51:44.076141Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:44.076181Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:44.076238Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 86 partNo : 0 messageNo: 175 size 108 offset: -1
2025-11-03T16:51:44.076293Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:44.076304Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:44.076321Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 87 partNo : 0 messageNo: 176 size 108 offset: -1
2025-11-03T16:51:44.076349Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:44.076358Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:44.076377Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 88 partNo : 0 messageNo: 177 size 108 offset: -1
2025-11-03T16:51:44.076408Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:44.076417Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:44.076438Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 89 partNo : 0 messageNo: 178 size 108 offset: -1
2025-11-03T16:51:44.076472Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:44.076481Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:44.076498Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 90 partNo : 0 messageNo: 179 size 108 offset: -1
2025-11-03T16:51:44.076557Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:44.076571Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:44.076606Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:44.076618Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:44.076640Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:44.076649Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:44.076672Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:44.076681Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:44.076707Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:44.076715Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:44.076905Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:51:44.076952Z node 4 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:51:44.076966Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:51:44.076982Z node 4 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:51:44.076995Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:51:44.077007Z node 4 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:51:44.077017Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:51:44.077030Z node 4 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:51:44.077039Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:51:44.077052Z node 4 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:51:44.077156Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 65 count 10 size 1262 actorID [4:7568542851518043584:2385]
2025-11-03T16:51:44.077215Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 180  requestId: <none> cookie: 91
2025-11-03T16:51:44.077253Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 181  requestId: <none> cookie: 92
2025-11-03T16:51:44.077267Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 182  requestId: <none> cookie: 93
2025-11-03T16:51:44.077282Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 183  requestId: <none> cookie: 94
2025-11-03T16:51:44.077297Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 184  requestId: <none> cookie: 95
2025-11-03T16:51:44.077315Z node 4 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-03T16:51:44.077362Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1140 WriteNewSizeFromSupportivePartitions# 0
2025-11-03T16:51:44.077394Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:51:44.077423Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 66, partNo: 0, Offset: 65 is stored on disk
2025-11-03T16:51:44.077439Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:51:44.077463Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 67, partNo: 0, Offset: 66 is stored on disk
2025-11-03T16:51:44.077473Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:51:44.077488Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 68, partNo: 0, Offset: 67 is stored on disk
2025-11-03T16:51:44.077499Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:51:44.077515Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 69, partNo: 0, Offset: 68 is stored on disk
2025-11-03T16:51:44.077526Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:51:44.077542Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 70, partNo: 0, Offset: 69 is stored on disk
2025-11-03T16:51:44.077554Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:51:44.077570Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 71, partNo: 0, Offset: 70 is stored on disk
2025-11-03T16:51:44.077579Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:51:44.077597Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 72, partNo: 0, Offset: 71 is stored on disk
2025-11-03T16:51:44.077607Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:51:44.077622Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 73, partNo: 0, Offset: 72 is stored on disk
2025-11-03T16:51:44.077633Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:51:44.077648Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 74, partNo: 0, Offset: 73 is stored on disk
2025-11-03T16:51:44.077658Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:51:44.077674Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 75, partNo: 0, Offset: 74 is stored on disk
2025-11-03T16:51:44.077849Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:44.077906Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:44.077917Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (15)
2025-11-03T16:51:44.078009Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 76 partNo 0
2025-11-03T16:51:44.078390Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 65 partno 0 count 10 parts 0 suffix '63' size 1262
2025-11-03T16:51:44.078897Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 76 partNo 0 FormedBlobsCount 0 NewHead: Offset 75 PartNo 0 PackedSize 181 count 1 nextOffset 76 batches 1
2025-11-03T16:51:44.078944Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 77 partNo 0
2025-11-03T16:51:44.078974Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 77 partNo 0 FormedBlobsCount 0 NewHead: Offset 75 PartNo 0 PackedSize 330 count 2 nextOffset 77 batches 1
2025-11-03T16:51:44.078995Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 78 partNo 0
2025-11-03T16:51:44.079015Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 78 partNo 0 FormedBlobsCount 0 NewHead: Offset 75 PartNo 0 PackedSize 479 count 3 nextOffset 78 batches 1
2025-11-03T16:51:44.079035Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 79 partNo 0
2025-11-03T16:51:44.079053Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 79 partNo 0 FormedBlobsCount 0 NewHead: Offset 75 PartNo 0 PackedSize 628 count 4 nextOffset 79 batches 1
2025-11-03T16:51:44.079069Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 80 partNo 0
2025-11-03T16:51:44.079090Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 80 partNo 0 FormedBlobsCount 0 NewHead: Offset 75 PartNo 0 PackedSize 777 count 5 nextOffset 80 batches 1
2025-11-03T16:51:44.079109Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 81 partNo 0
2025-11-03T16:51:44.079127Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 81 partNo 0 FormedBlobsCount 0 NewHead: Offset 75 PartNo 0 PackedSize 926 count 6 nextOffset 81 batches 1
2025-11-03T16:51:44.079143Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 82 partNo 0
2025-11-03T16:51:44.079161Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 82 partNo 0 FormedBlobsCount 0 NewHead: Offset 75 PartNo 0 PackedSize 1076 count 7 nextOffset 82 batches 1
2025-11-03T16:51:44.079178Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 83 partNo 0
2025-11-03T16:51:44.079195Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 83 partNo 0 FormedBlobsCount 0 NewHead: Offset 75 PartNo 0 PackedSize 1226 count 8 nextOffset 83 batches 1
2025-11-03T16:51:44.079212Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 84 partNo 0
2025-11-03T16:51:44.079230Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 84 partNo 0 FormedBlobsCount 0 NewHead: Offset 75 PartNo 0 PackedSize 1376 count 9 nextOffset 84 batches 1
2025-11-03T16:51:44.079248Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 85 partNo 0
2025-11-03T16:51:44.079264Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 85 partNo 0 FormedBlobsCount 0 NewHead: Offset 75 PartNo 0 PackedSize 1526 count 10 nextOffset 85 batches 1
2025-11-03T16:51:44.079283Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 86 partNo 0
2025-11-03T16:51:44.079300Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 86 partNo 0 FormedBlobsCount 0 NewHead: Offset 75 PartNo 0 PackedSize 1676 count 11 nextOffset 86 batches 1
2025-11-03T16:51:44.079317Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 87 partNo 0
2025-11-03T16:51:44.079334Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 87 partNo 0 FormedBlobsCount 0 NewHead: Offset 75 PartNo 0 PackedSize 1826 count 12 nextOffset 87 batches 1
2025-11-03T16:51:44.079350Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 88 partNo 0
2025-11-03T16:51:44.079366Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 88 partNo 0 FormedBlobsCount 0 NewHead: Offset 75 PartNo 0 PackedSize 1976 count 13 nextOffset 88 batches 1
2025-11-03T16:51:44.079383Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 89 partNo 0
2025-11-03T16:51:44.079400Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 89 partNo 0 FormedBlobsCount 0 NewHead: Offset 75 PartNo 0 PackedSize 2126 count 14 nextOffset 89 batches 1
2025-11-03T16:51:44.079416Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 90 partNo 0
2025-11-03T16:51:44.079432Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 90 partNo 0 FormedBlobsCount 0 NewHead: Offset 75 PartNo 0 PackedSize 2276 count 15 nextOffset 90 batches 1
2025-11-03T16:51:44.079449Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:44.079921Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 75,15 HeadOffset 75 endOffset 75 curOffset 90 d0000000000_00000000000000000075_00000_0000000015_00000? size 1856 WTime 1762188704076
2025-11-03T16:51:44.080362Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:44.080432Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:44.080458Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:44.080483Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:44.080507Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:44.080734Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:51:44.080788Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:51:44.080821Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:51:44.080854Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:51:44.080886Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:51:44.080678Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:51:44.080739Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 135  requestId: <none> cookie: 66
2025-11-03T16:51:44.080789Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 136  requestId: <none> cookie: 67
2025-11-03T16:51:44.080811Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 137  requestId: <none> cookie: 68
2025-11-03T16:51:44.080831Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 138  requestId: <none> cookie: 69
2025-11-03T16:51:44.080853Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 139  requestId: <none> cookie: 70
2025-11-03T16:51:44.080873Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 145  requestId: <none> cookie: 71
2025-11-03T16:51:44.080897Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 146  requestId: <none> cookie: 72
2025-11-03T16:51:44.080920Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 147  requestId: <none> cookie: 73
2025-11-03T16:51:44.080944Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 148  requestId: <none> cookie: 74
2025-11-03T16:51:44.080967Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 149  requestId: <none> cookie: 75
2025-11-03T16:51:44.080997Z node 4 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-03T16:51:44.081102Z node 4 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 75 partNo 0 count 15 size 1856
2025-11-03T16:51:44.082849Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session got write response: sequence_numbers: 66 offsets: 65 already_written: false write_statistics { persist_duration_ms: 20 queued_in_partition_duration_ms: 16 }
2025-11-03T16:51:44.082900Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session: acknoledged message 66
2025-11-03T16:51:44.083479Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session got write response: sequence_numbers: 67 offsets: 66 already_written: false write_statistics { persist_duration_ms: 19 queued_in_partition_duration_ms: 17 }
2025-11-03T16:51:44.082571Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:44.083510Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session: acknoledged message 67
2025-11-03T16:51:44.082599Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:44.082664Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 91 partNo : 0 messageNo: 185 size 108 offset: -1
2025-11-03T16:51:44.082712Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:44.082721Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:44.082740Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 92 partNo : 0 messageNo: 186 size 108 offset: -1
2025-11-03T16:51:44.082771Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:44.082779Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:44.082798Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 93 partNo : 0 messageNo: 187 size 108 offset: -1
2025-11-03T16:51:44.082828Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:44.082837Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:44.082856Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 94 partNo : 0 messageNo: 188 size 108 offset: -1
2025-11-03T16:51:44.083709Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session got write response: sequence_numbers: 68 offsets: 67 already_written: false write_statistics { persist_duration_ms: 19 queued_in_partition_duration_ms: 17 }
2025-11-03T16:51:44.082891Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:44.081845Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:44.083739Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session: acknoledged message 68
2025-11-03T16:51:44.082900Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:44.081934Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:44.082919Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 95 partNo : 0 messageNo: 189 size 108 offset: -1
2025-11-03T16:51:44.081961Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:44.082987Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:44.082014Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:44.083002Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:44.083036Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:44.082044Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:44.083047Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:44.082074Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:44.083071Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:44.083854Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session got write response: sequence_numbers: 69 offsets: 68 already_written: false write_statistics { persist_duration_ms: 19 queued_in_partition_duration_ms: 17 }
2025-11-03T16:51:44.083081Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:44.082099Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:44.083105Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:44.082125Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:44.083114Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:44.083137Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:44.083145Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:44.083168Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:51:44.083210Z node 4 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:51:44.083223Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:51:44.083237Z node 4 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:51:44.083249Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:51:44.083263Z node 4 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:51:44.083273Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:51:44.083285Z node 4 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:51:44.083878Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session: acknoledged message 69
2025-11-03T16:51:44.083296Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:51:44.083309Z node 4 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:51:44.083371Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 190  requestId: <none> cookie: 96
2025-11-03T16:51:44.083407Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 191  requestId: <none> cookie: 97
2025-11-03T16:51:44.083422Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 192  requestId: <none> cookie: 98
2025-11-03T16:51:44.083437Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 193  requestId: <none> cookie: 99
2025-11-03T16:51:44.083452Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 194  requestId: <none> cookie: 100
2025-11-03T16:51:44.084231Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session got write response: sequence_numbers: 70 offsets: 69 already_written: false write_statistics { persist_duration_ms: 19 queued_in_partition_duration_ms: 17 }
2025-11-03T16:51:44.084265Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session: acknoledged message 70
2025-11-03T16:51:44.084391Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session got write response: sequence_numbers: 71 offsets: 70 already_written: false write_statistics { persist_duration_ms: 19 queued_in_partition_duration_ms: 13 }
2025-11-03T16:51:44.084414Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session: acknoledged message 71
2025-11-03T16:51:44.084505Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session got write response: sequence_numbers: 72 offsets: 71 already_written: false write_statistics { persist_duration_ms: 19 queued_in_partition_duration_ms: 13 }
2025-11-03T16:51:44.084525Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session: acknoledged message 72
2025-11-03T16:51:44.084635Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session got write response: sequence_numbers: 73 offsets: 72 already_written: false write_statistics { persist_duration_ms: 19 queued_in_partition_duration_ms: 13 }
2025-11-03T16:51:44.084661Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session: acknoledged message 73
2025-11-03T16:51:44.084753Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session got write response: sequence_numbers: 74 offsets: 73 already_written: false write_statistics { persist_duration_ms: 19 queued_in_partition_duration_ms: 13 }
2025-11-03T16:51:44.084774Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session: acknoledged message 74
2025-11-03T16:51:44.084870Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session got write response: sequence_numbers: 75 offsets: 74 already_written: false write_statistics { persist_duration_ms: 19 queued_in_partition_duration_ms: 13 }
2025-11-03T16:51:44.084892Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session: acknoledged message 75
2025-11-03T16:51:44.082150Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:44.082176Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:44.087686Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:44.087745Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:44.087775Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:44.087804Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:44.087835Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:44.088796Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:44.088831Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:44.088885Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 96 partNo : 0 messageNo: 195 size 108 offset: -1
2025-11-03T16:51:44.088945Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:44.088957Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:44.088979Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 97 partNo : 0 messageNo: 196 size 108 offset: -1
2025-11-03T16:51:44.089012Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:44.089030Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:44.089050Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 98 partNo : 0 messageNo: 197 size 108 offset: -1
2025-11-03T16:51:44.089092Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:44.089105Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:44.089126Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 99 partNo : 0 messageNo: 198 size 109 offset: -1
2025-11-03T16:51:44.089168Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:44.089180Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:44.089200Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 100 partNo : 0 messageNo: 199 size 109 offset: -1
2025-11-03T16:51:44.089253Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 75 count 15 size 1856 actorID [4:7568542851518043584:2385]
2025-11-03T16:51:44.089301Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:51:44.089342Z node 4 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:51:44.089357Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:51:44.089377Z node 4 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:51:44.089389Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:51:44.089404Z node 4 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:51:44.089415Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:51:44.089432Z node 4 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:51:44.089444Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:51:44.089456Z node 4 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:51:44.089472Z node 4 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-03T16:51:44.089512Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1719 WriteNewSizeFromSupportivePartitions# 0
2025-11-03T16:51:44.089541Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:51:44.089574Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 76, partNo: 0, Offset: 75 is stored on disk
2025-11-03T16:51:44.089589Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:51:44.089607Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 77, partNo: 0, Offset: 76 is stored on disk
2025-11-03T16:51:44.089619Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:51:44.089654Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 78, partNo: 0, Offset: 77 is stored on disk
2025-11-03T16:51:44.089666Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:51:44.089686Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 79, partNo: 0, Offset: 78 is stored on disk
2025-11-03T16:51:44.089697Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:51:44.089715Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 80, partNo: 0, Offset: 79 is stored on disk
2025-11-03T16:51:44.089729Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:51:44.089747Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 81, partNo: 0, Offset: 80 is stored on disk
2025-11-03T16:51:44.089760Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:51:44.089782Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 82, partNo: 0, Offset: 81 is stored on disk
2025-11-03T16:51:44.089796Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:51:44.089814Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 83, partNo: 0, Offset: 82 is stored on disk
2025-11-03T16:51:44.089827Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:51:44.089848Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 84, partNo: 0, Offset: 83 is stored on disk
2025-11-03T16:51:44.089861Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:51:44.089879Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 85, partNo: 0, Offset: 84 is stored on disk
2025-11-03T16:51:44.089890Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:51:44.089906Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 86, partNo: 0, Offset: 85 is stored on disk
2025-11-03T16:51:44.089919Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:51:44.089938Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 87, partNo: 0, Offset: 86 is stored on disk
2025-11-03T16:51:44.089953Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:51:44.089971Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 88, partNo: 0, Offset: 87 is stored on disk
2025-11-03T16:51:44.089984Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:51:44.090000Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 89, partNo: 0, Offset: 88 is stored on disk
2025-11-03T16:51:44.090012Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:51:44.090031Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 90, partNo: 0, Offset: 89 is stored on disk
2025-11-03T16:51:44.090187Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:44.090232Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:44.090243Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (10)
2025-11-03T16:51:44.090324Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 91 partNo 0
2025-11-03T16:51:44.092089Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 75 partno 0 count 15 parts 0 suffix '63' size 1856
2025-11-03T16:51:44.114418Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 91 partNo 0 FormedBlobsCount 0 NewHead: Offset 90 PartNo 0 PackedSize 182 count 1 nextOffset 91 batches 1
2025-11-03T16:51:44.114505Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 92 partNo 0
2025-11-03T16:51:44.114540Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 92 partNo 0 FormedBlobsCount 0 NewHead: Offset 90 PartNo 0 PackedSize 332 count 2 nextOffset 92 batches 1
2025-11-03T16:51:44.114563Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 93 partNo 0
2025-11-03T16:51:44.114582Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 93 partNo 0 FormedBlobsCount 0 NewHead: Offset 90 PartNo 0 PackedSize 482 count 3 nextOffset 93 batches 1
2025-11-03T16:51:44.114601Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 94 partNo 0
2025-11-03T16:51:44.114618Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 94 partNo 0 FormedBlobsCount 0 NewHead: Offset 90 PartNo 0 PackedSize 632 count 4 nextOffset 94 batches 1
2025-11-03T16:51:44.114654Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 95 partNo 0
2025-11-03T16:51:44.114674Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 95 partNo 0 FormedBlobsCount 0 NewHead: Offset 90 PartNo 0 PackedSize 782 count 5 nextOffset 95 batches 1
2025-11-03T16:51:44.114693Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 96 partNo 0
2025-11-03T16:51:44.114710Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 96 partNo 0 FormedBlobsCount 0 NewHead: Offset 90 PartNo 0 PackedSize 932 count 6 nextOffset 96 batches 1
2025-11-03T16:51:44.114729Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 97 partNo 0
2025-11-03T16:51:44.114750Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 97 partNo 0 FormedBlobsCount 0 NewHead: Offset 90 PartNo 0 PackedSize 1082 count 7 nextOffset 97 batches 1
2025-11-03T16:51:44.114770Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 98 partNo 0
2025-11-03T16:51:44.114790Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 98 partNo 0 FormedBlobsCount 0 NewHead: Offset 90 PartNo 0 PackedSize 1232 count 8 nextOffset 98 batches 1
2025-11-03T16:51:44.114810Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 99 partNo 0
2025-11-03T16:51:44.114831Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 99 partNo 0 FormedBlobsCount 0 NewHead: Offset 90 PartNo 0 PackedSize 1383 count 9 nextOffset 99 batches 1
2025-11-03T16:51:44.114851Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 100 partNo 0
2025-11-03T16:51:44.114870Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 100 partNo 0 FormedBlobsCount 0 NewHead: Offset 90 PartNo 0 PackedSize 1534 count 10 nextOffset 100 batches 1
2025-11-03T16:51:44.114886Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:44.115327Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 90,10 HeadOffset 90 endOffset 90 curOffset 100 d0000000000_00000000000000000090_00000_0000000010_00000? size 1274 WTime 1762188704115
2025-11-03T16:51:44.115469Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:51:44.115555Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 155  requestId: <none> cookie: 76
2025-11-03T16:51:44.115623Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 156  requestId: <none> cookie: 77
2025-11-03T16:51:44.115647Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 157  requestId: <none> cookie: 78
2025-11-03T16:51:44.115669Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 158  requestId: <none> cookie: 79
2025-11-03T16:51:44.115690Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 159  requestId: <none> cookie: 80
2025-11-03T16:51:44.115714Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 165  requestId: <none> cookie: 81
2025-11-03T16:51:44.115749Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 166  requestId: <none> cookie: 82
2025-11-03T16:51:44.115779Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 167  requestId: <none> cookie: 83
2025-11-03T16:51:44.115799Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 168  requestId: <none> cookie: 84
2025-11-03T16:51:44.115822Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 169  requestId: <none> cookie: 85
2025-11-03T16:51:44.115843Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 175  requestId: <none> cookie: 86
2025-11-03T16:51:44.115865Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 176  requestId: <none> cookie: 87
2025-11-03T16:51:44.115886Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 177  requestId: <none> cookie: 88
2025-11-03T16:51:44.115906Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 178  requestId: <none> cookie: 89
2025-11-03T16:51:44.115927Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 179  requestId: <none> cookie: 90
2025-11-03T16:51:44.115970Z node 4 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-03T16:51:44.116788Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:44.116860Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:44.116896Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:44.116923Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:44.116952Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:44.116976Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:44.117985Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session got write response: sequence_numbers: 76 offsets: 75 already_written: false write_statistics { persist_duration_ms: 13 queued_in_partition_duration_ms: 17 }
2025-11-03T16:51:44.118027Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session: acknoledged message 76
2025-11-03T16:51:44.118300Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:44.118355Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:44.118381Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:44.118412Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:44.118438Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:44.118464Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:44.118493Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:44.118516Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:44.118574Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:44.120245Z node 4 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 90 partNo 0 count 10 size 1274
2025-11-03T16:51:44.120680Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session got write response: sequence_numbers: 77 offsets: 76 already_written: false write_statistics { persist_duration_ms: 13 queued_in_partition_duration_ms: 17 }
2025-11-03T16:51:44.120734Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session: acknoledged message 77
2025-11-03T16:51:44.120951Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session got write response: sequence_numbers: 78 offsets: 77 already_written: false write_statistics { persist_duration_ms: 13 queued_in_partition_duration_ms: 17 }
2025-11-03T16:51:44.120976Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session: acknoledged message 78
2025-11-03T16:51:44.121098Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session got write response: sequence_numbers: 79 offsets: 78 already_written: false write_statistics { persist_duration_ms: 13 queued_in_partition_duration_ms: 17 }
2025-11-03T16:51:44.121124Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session: acknoledged message 79
2025-11-03T16:51:44.121267Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session got write response: sequence_numbers: 80 offsets: 79 already_written: false write_statistics { persist_duration_ms: 13 queued_in_partition_duration_ms: 17 }
2025-11-03T16:51:44.121294Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session: acknoledged message 80
2025-11-03T16:51:44.121392Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session got write response: sequence_numbers: 81 offsets: 80 already_written: false write_statistics { persist_duration_ms: 13 queued_in_partition_duration_ms: 9 }
2025-11-03T16:51:44.121411Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session: acknoledged message 81
2025-11-03T16:51:44.121501Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session got write response: sequence_numbers: 82 offsets: 81 already_written: false write_statistics { persist_duration_ms: 13 queued_in_partition_duration_ms: 9 }
2025-11-03T16:51:44.121522Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session: acknoledged message 82
2025-11-03T16:51:44.121620Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session got write response: sequence_numbers: 83 offsets: 82 already_written: false write_statistics { persist_duration_ms: 13 queued_in_partition_duration_ms: 9 }
2025-11-03T16:51:44.121641Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session: acknoledged message 83
2025-11-03T16:51:44.121727Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session got write response: sequence_numbers: 84 offsets: 83 already_written: false write_statistics { persist_duration_ms: 13 queued_in_partition_duration_ms: 9 }
2025-11-03T16:51:44.121745Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session: acknoledged message 84
2025-11-03T16:51:44.121846Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session got write response: sequence_numbers: 85 offsets: 84 already_written: false write_statistics { persist_duration_ms: 13 queued_in_partition_duration_ms: 9 }
2025-11-03T16:51:44.121867Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session: acknoledged message 85
2025-11-03T16:51:44.121964Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session got write response: sequence_numbers: 86 offsets: 85 already_written: false write_statistics { persist_duration_ms: 13 }
2025-11-03T16:51:44.121984Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session: acknoledged message 86
2025-11-03T16:51:44.122067Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session got write response: sequence_numbers: 87 offsets: 86 already_written: false write_statistics { persist_duration_ms: 13 }
2025-11-03T16:51:44.122085Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session: acknoledged message 87
2025-11-03T16:51:44.122178Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session got write response: sequence_numbers: 88 offsets: 87 already_written: false write_statistics { persist_duration_ms: 13 }
2025-11-03T16:51:44.122197Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session: acknoledged message 88
2025-11-03T16:51:44.122292Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session got write response: sequence_numbers: 89 offsets: 88 already_written: false write_statistics { persist_duration_ms: 13 }
2025-11-03T16:51:44.122310Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session: acknoledged message 89
2025-11-03T16:51:44.122402Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session got write response: sequence_numbers: 90 offsets: 89 already_written: false write_statistics { persist_duration_ms: 13 }
2025-11-03T16:51:44.122421Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session: acknoledged message 90
2025-11-03T16:51:44.134406Z node 4 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:51:44.140280Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 90 count 10 size 1274 actorID [4:7568542851518043584:2385]
2025-11-03T16:51:44.140350Z node 4 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-03T16:51:44.140395Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1152 WriteNewSizeFromSupportivePartitions# 0
2025-11-03T16:51:44.140427Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:51:44.140462Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 91, partNo: 0, Offset: 90 is stored on disk
2025-11-03T16:51:44.140479Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:51:44.140502Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 92, partNo: 0, Offset: 91 is stored on disk
2025-11-03T16:51:44.140515Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:51:44.140533Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 93, partNo: 0, Offset: 92 is stored on disk
2025-11-03T16:51:44.140546Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:51:44.140564Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 94, partNo: 0, Offset: 93 is stored on disk
2025-11-03T16:51:44.140577Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:51:44.140595Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 95, partNo: 0, Offset: 94 is stored on disk
2025-11-03T16:51:44.140607Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:51:44.140625Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 96, partNo: 0, Offset: 95 is stored on disk
2025-11-03T16:51:44.140637Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:51:44.140658Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 97, partNo: 0, Offset: 96 is stored on disk
2025-11-03T16:51:44.140671Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:51:44.140689Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 98, partNo: 0, Offset: 97 is stored on disk
2025-11-03T16:51:44.140701Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:51:44.140719Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 99, partNo: 0, Offset: 98 is stored on disk
2025-11-03T16:51:44.140732Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:51:44.140750Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 100, partNo: 0, Offset: 99 is stored on disk
2025-11-03T16:51:44.140913Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:44.140925Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:44.140936Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:44.140966Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:51:44.141009Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 185  requestId: <none> cookie: 91
2025-11-03T16:51:44.141061Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 186  requestId: <none> cookie: 92
2025-11-03T16:51:44.141084Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 187  requestId: <none> cookie: 93
2025-11-03T16:51:44.141105Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 188  requestId: <none> cookie: 94
2025-11-03T16:51:44.141127Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 189  requestId: <none> cookie: 95
2025-11-03T16:51:44.141150Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 195  requestId: <none> cookie: 96
2025-11-03T16:51:44.141173Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 196  requestId: <none> cookie: 97
2025-11-03T16:51:44.141192Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 197  requestId: <none> cookie: 98
2025-11-03T16:51:44.141213Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 198  requestId: <none> cookie: 99
2025-11-03T16:51:44.141235Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 199  requestId: <none> cookie: 100
2025-11-03T16:51:44.142148Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 90 partno 0 count 10 parts 0 suffix '63' size 1274
2025-11-03T16:51:44.144081Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:44.144176Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:44.144204Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:44.144229Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:44.144257Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:44.144279Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:44.144304Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:44.144328Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:44.144351Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:44.144371Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:44.148205Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session got write response: sequence_numbers: 91 offsets: 90 already_written: false write_statistics { persist_duration_ms: 26 queued_in_partition_duration_ms: 33 }
2025-11-03T16:51:44.148257Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session: acknoledged message 91
2025-11-03T16:51:44.148456Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session got write response: sequence_numbers: 92 offsets: 91 already_written: false write_statistics { persist_duration_ms: 25 queued_in_partition_duration_ms: 34 }
2025-11-03T16:51:44.148479Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session: acknoledged message 92
2025-11-03T16:51:44.148581Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session got write response: sequence_numbers: 93 offsets: 92 already_written: false write_statistics { persist_duration_ms: 25 queued_in_partition_duration_ms: 34 }
2025-11-03T16:51:44.148605Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session: acknoledged message 93
2025-11-03T16:51:44.148697Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session got write response: sequence_numbers: 94 offsets: 93 already_written: false write_statistics { persist_duration_ms: 25 queued_in_partition_duration_ms: 34 }
2025-11-03T16:51:44.148714Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session: acknoledged message 94
2025-11-03T16:51:44.148794Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session got write response: sequence_numbers: 95 offsets: 94 already_written: false write_statistics { persist_duration_ms: 25 queued_in_partition_duration_ms: 34 }
2025-11-03T16:51:44.148811Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session: acknoledged message 95
2025-11-03T16:51:44.148885Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session got write response: sequence_numbers: 96 offsets: 95 already_written: false write_statistics { persist_duration_ms: 25 queued_in_partition_duration_ms: 25 }
2025-11-03T16:51:44.148904Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session: acknoledged message 96
2025-11-03T16:51:44.148997Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session got write response: sequence_numbers: 97 offsets: 96 already_written: false write_statistics { persist_duration_ms: 25 queued_in_partition_duration_ms: 25 }
2025-11-03T16:51:44.149016Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session: acknoledged message 97
2025-11-03T16:51:44.149120Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session got write response: sequence_numbers: 98 offsets: 97 already_written: false write_statistics { persist_duration_ms: 25 queued_in_partition_duration_ms: 25 }
2025-11-03T16:51:44.149139Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session: acknoledged message 98
2025-11-03T16:51:44.149229Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session got write response: sequence_numbers: 99 offsets: 98 already_written: false write_statistics { persist_duration_ms: 25 queued_in_partition_duration_ms: 25 }
2025-11-03T16:51:44.149246Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session: acknoledged message 99
2025-11-03T16:51:44.149343Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session got write response: sequence_numbers: 100 offsets: 99 already_written: false write_statistics { persist_duration_ms: 25 queued_in_partition_duration_ms: 25 }
2025-11-03T16:51:44.149364Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session: acknoledged message 100
2025-11-03T16:51:44.184061Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session will now close
2025-11-03T16:51:44.184134Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session: aborting
2025-11-03T16:51:44.184645Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session: gracefully shut down, all writes complete
2025-11-03T16:51:44.184813Z :INFO: [/Root] [/Root] [ce990dbc-c45414da-34e49130-a1d2dffa] Starting read session
2025-11-03T16:51:44.184842Z :DEBUG: [/Root] [/Root] [ce990dbc-c45414da-34e49130-a1d2dffa] Starting cluster discovery
2025-11-03T16:51:44.192207Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|b66b860-179da72d-bba19cac-67d10518_0 grpc read done: success: 0 data: 
2025-11-03T16:51:44.192241Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 2 sessionId: src_id|b66b860-179da72d-bba19cac-67d10518_0 grpc read failed
2025-11-03T16:51:44.192272Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 2 sessionId: src_id|b66b860-179da72d-bba19cac-67d10518_0 grpc closed
2025-11-03T16:51:44.192287Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2 sessionId: src_id|b66b860-179da72d-bba19cac-67d10518_0 is DEAD
2025-11-03T16:51:44.193040Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-11-03T16:51:44.196121Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session is aborting and will not restart
2025-11-03T16:51:44.196082Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [3:7568542849668082250:2472] destroyed
2025-11-03T16:51:44.196128Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-11-03T16:51:44.196158Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:44.196173Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:44.196184Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:44.204602Z :DEBUG: [/Root] [/Root] [ce990dbc-c45414da-34e49130-a1d2dffa] Cluster discovery request succeeded
2025-11-03T16:51:44.204677Z :DEBUG: [/Root] [/Root] [ce990dbc-c45414da-34e49130-a1d2dffa] Starting session to cluster dc1 (localhost:21474)
2025-11-03T16:51:44.205075Z :DEBUG: [/Root] [/Root] [ce990dbc-c45414da-34e49130-a1d2dffa] [dc1] In Reconnect, ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:51:44.205104Z :DEBUG: [/Root] [/Root] [ce990dbc-c45414da-34e49130-a1d2dffa] [dc1] New values: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:51:44.205134Z :DEBUG: [/Root] [/Root] [ce990dbc-c45414da-34e49130-a1d2dffa] [dc1] Reconnecting session to cluster dc1 in 0.000000s
2025-11-03T16:51:44.236421Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:44.236458Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:44.236472Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:44.248943Z :DEBUG: [/Root] [/Root] [ce990dbc-c45414da-34e49130-a1d2dffa] [dc1] Successfully connected. Initializing session
2025-11-03T16:51:44.252892Z node 3 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:109: new grpc connection
2025-11-03T16:51:44.252915Z node 3 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:131: new session created cookie 1
2025-11-03T16:51:44.253333Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { topic: "test-topic" } read_only_original: true consumer: "shared/user" read_params { max_read_size: 104857600 } } }
2025-11-03T16:51:44.253521Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 1 consumer shared/user session shared/user_3_1_15183163835495095129_v1 read init: from# ipv6:[::1]:37476, request# { init_request { topics_read_settings { topic: "test-topic" } read_only_original: true consumer: "shared/user" read_params { max_read_size: 104857600 } } }
2025-11-03T16:51:44.253890Z node 3 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 1 consumer shared/user session shared/user_3_1_15183163835495095129_v1 auth for : user
2025-11-03T16:51:44.254735Z node 3 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 1 consumer shared/user session shared/user_3_1_15183163835495095129_v1 Handle describe topics response
2025-11-03T16:51:44.254833Z node 3 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 1 consumer shared/user session shared/user_3_1_15183163835495095129_v1 auth is DEAD
2025-11-03T16:51:44.254891Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 1 consumer shared/user session shared/user_3_1_15183163835495095129_v1 auth ok: topics# 1, initDone# 0
2025-11-03T16:51:44.255893Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 1 consumer shared/user session shared/user_3_1_15183163835495095129_v1 register session: topic# rt3.dc1--test-topic
2025-11-03T16:51:44.260088Z :INFO: [/Root] [/Root] [ce990dbc-c45414da-34e49130-a1d2dffa] [dc1] Server session id: shared/user_3_1_15183163835495095129_v1
2025-11-03T16:51:44.260381Z :DEBUG: [/Root] [/Root] [ce990dbc-c45414da-34e49130-a1d2dffa] [dc1] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:51:44.260339Z node 3 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1655: [72075186224037893][rt3.dc1--test-topic] pipe [3:7568542853963049601:2484] connected; active server actors: 1
2025-11-03T16:51:44.260480Z node 3 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1706: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [3:7568542853963049601:2484] session shared/user_3_1_15183163835495095129_v1
2025-11-03T16:51:44.260525Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:639: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-11-03T16:51:44.260574Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:669: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-11-03T16:51:44.260611Z node 3 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:871: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_3_1_15183163835495095129_v1" (Sender=[3:7568542853963049598:2484], Pipe=[3:7568542853963049601:2484], Partitions=[], ActiveFamilyCount=0)
2025-11-03T16:51:44.260655Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1186: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-11-03T16:51:44.260707Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1258: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-11-03T16:51:44.260756Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1305: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_3_1_15183163835495095129_v1" (Sender=[3:7568542853963049598:2484], Pipe=[3:7568542853963049601:2484], Partitions=[], ActiveFamilyCount=0)
2025-11-03T16:51:44.264071Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [3:7568542853963049604:2487], now have 1 active actors on pipe
2025-11-03T16:51:44.264158Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:44.264176Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:44.264206Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:1748: [PQ: 72075186224037892] Created session shared/user_3_1_15183163835495095129_v1 on pipe: [3:7568542853963049604:2487]
2025-11-03T16:51:44.264272Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:44.264312Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:44.264323Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-03T16:51:44.264388Z node 4 :PERSQUEUE DEBUG: partition.cpp:3666: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_3_1_15183163835495095129_v1
2025-11-03T16:51:44.264403Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:44.264528Z node 4 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-03T16:51:44.264970Z node 4 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_3_1_15183163835495095129_v1:1 with generation 1
2025-11-03T16:51:44.260808Z node 3 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:549: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_3_1_15183163835495095129_v1" sender [3:7568542853963049598:2484] lock partition 0 for ReadingSession "shared/user_3_1_15183163835495095129_v1" (Sender=[3:7568542853963049598:2484], Pipe=[3:7568542853963049601:2484], Partitions=[], ActiveFamilyCount=1) generation 1 step 1
2025-11-03T16:51:44.260849Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1325: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-11-03T16:51:44.260873Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1402: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000148s
2025-11-03T16:51:44.260937Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_3_1_15183163835495095129_v1 grpc read done: success# 1, data# { read { } }
2025-11-03T16:51:44.261756Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 1 consumer shared/user session shared/user_3_1_15183163835495095129_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 1 Session: "shared/user_3_1_15183163835495095129_v1" ClientId: "user" PipeClient { RawX1: 7568542853963049601 RawX2: 4503612512274868 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-11-03T16:51:44.261883Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_3_1_15183163835495095129_v1 got read request: guid# e16cdf9a-64aa2610-92091866-1f109114
2025-11-03T16:51:44.261980Z node 3 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 1 consumer shared/user session shared/user_3_1_15183163835495095129_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-11-03T16:51:44.263065Z node 3 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_3_1_15183163835495095129_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 1, pipe: [3:7568542853963049604:2487]
2025-11-03T16:51:44.288343Z node 4 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-03T16:51:44.288424Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-11-03T16:51:44.288451Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:44.288464Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:44.288475Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:44.288506Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:51:44.288540Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-11-03T16:51:44.294145Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_3_1_15183163835495095129_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 100 WriteTimestampMS: 1762188703795 CreateTimestampMS: 1762188703764 SizeLag: 11282 WriteTimestampEstimateMS: 1762188704236 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-11-03T16:51:44.294216Z node 3 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 1 consumer shared/user session shared/user_3_1_15183163835495095129_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 100 readOffset 0 committedOffset 0
2025-11-03T16:51:44.294301Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 1 consumer shared/user session shared/user_3_1_15183163835495095129_v1 sending to client partition status
2025-11-03T16:51:44.300133Z :INFO: [/Root] [/Root] [ce990dbc-c45414da-34e49130-a1d2dffa] [dc1] Confirm partition stream create. Partition stream id: 1. Cluster: "dc1". Topic: "test-topic". Partition: 0. Read offset: (NULL)
2025-11-03T16:51:44.300973Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_3_1_15183163835495095129_v1 grpc read done: success# 1, data# { start_read { topic { path: "test-topic" } cluster: "dc1" assign_id: 1 } }
2025-11-03T16:51:44.301133Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:539: session cookie 1 consumer shared/user session shared/user_3_1_15183163835495095129_v1 got StartRead from client: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 0, commitOffset# 0
2025-11-03T16:51:44.301188Z node 3 :PQ_READ_PROXY INFO: partition_actor.cpp:1023: session cookie 1 consumer shared/user session shared/user_3_1_15183163835495095129_v1 Start reading TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 100 readOffset 0 committedOffset 0 clientCommitOffset 0 clientReadOffset 0
2025-11-03T16:51:44.301213Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_3_1_15183163835495095129_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 0 endOffset 100
2025-11-03T16:51:44.301267Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_3_1_15183163835495095129_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 0, endOffset# 100, WTime# 1762188703795, sizeLag# 11282
2025-11-03T16:51:44.301281Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_3_1_15183163835495095129_v1TEvPartitionReady. Aval parts: 1
2025-11-03T16:51:44.301321Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_3_1_15183163835495095129_v1 performing read request: guid# e16cdf9a-64aa2610-92091866-1f109114, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 120, size# 13538, partitionsAsked# 1, maxTimeLag# 0ms
2025-11-03T16:51:44.301390Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_3_1_15183163835495095129_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 120 maxSize 13538 maxTimeLagMs 0 readTimestampMs 0 readOffset 0 EndOffset 100 ClientCommitOffset 0 committedOffset 0 Guid e16cdf9a-64aa2610-92091866-1f109114
2025-11-03T16:51:44.306426Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:44.306469Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:44.306600Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:880: [72075186224037892][Partition][0][StateIdle] read cookie 4 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 partno 0 count 120 size 13538 endOffset 100 max time lag 0ms effective offset 0
2025-11-03T16:51:44.308345Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:1105: [72075186224037892][Partition][0][StateIdle] read cookie 4 added 10 blobs, size 12394 count 100 last offset 90, current partition end offset: 100
2025-11-03T16:51:44.308374Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:1121: [72075186224037892][Partition][0][StateIdle] Reading cookie 4. Send blob request.
2025-11-03T16:51:44.308426Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 0 partno 0 count 1 parts_count 0 source 1 size 162 accessed 1 times before, last time 2025-11-03T16:51:43.000000Z
2025-11-03T16:51:44.308443Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 1 partno 0 count 1 parts_count 0 source 1 size 164 accessed 0 times before, last time 2025-11-03T16:51:43.000000Z
2025-11-03T16:51:44.308458Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 2 partno 0 count 8 parts_count 0 source 1 size 987 accessed 0 times before, last time 2025-11-03T16:51:43.000000Z
2025-11-03T16:51:44.308472Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 10 partno 0 count 10 parts_count 0 source 1 size 1227 accessed 0 times before, last time 2025-11-03T16:51:43.000000Z
2025-11-03T16:51:44.308487Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 20 partno 0 count 10 parts_count 0 source 1 size 1232 accessed 0 times before, last time 2025-11-03T16:51:43.000000Z
2025-11-03T16:51:44.308501Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 30 partno 0 count 15 parts_count 0 source 1 size 1818 accessed 0 times before, last time 2025-11-03T16:51:43.000000Z
2025-11-03T16:51:44.308523Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 45 partno 0 count 20 parts_count 0 source 1 size 2412 accessed 0 times before, last time 2025-11-03T16:51:44.000000Z
2025-11-03T16:51:44.308539Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 65 partno 0 count 10 parts_count 0 source 1 size 1262 accessed 0 times before, last time 2025-11-03T16:51:44.000000Z
2025-11-03T16:51:44.308555Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 75 partno 0 count 15 parts_count 0 source 1 size 1856 accessed 0 times before, last time 2025-11-03T16:51:44.000000Z
2025-11-03T16:51:44.308572Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 90 partno 0 count 10 parts_count 0 source 1 size 1274 accessed 0 times before, last time 2025-11-03T16:51:44.000000Z
2025-11-03T16:51:44.308620Z node 4 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 4. All 10 blobs are from cache.
2025-11-03T16:51:44.308700Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:572: FormAnswer for 10 blobs
2025-11-03T16:51:44.308993Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 0 totakecount 1 count 1 size 142 from pos 0 cbcount 1
2025-11-03T16:51:44.309075Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 1 totakecount 1 count 1 size 144 from pos 0 cbcount 1
2025-11-03T16:51:44.309374Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 2 totakecount 8 count 8 size 967 from pos 0 cbcount 8
2025-11-03T16:51:44.309528Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 10 totakecount 10 count 10 size 1207 from pos 0 cbcount 10
2025-11-03T16:51:44.309647Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 20 totakecount 10 count 10 size 1212 from pos 0 cbcount 10
2025-11-03T16:51:44.309785Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 30 totakecount 15 count 15 size 1798 from pos 0 cbcount 15
2025-11-03T16:51:44.309967Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 45 totakecount 20 count 20 size 2392 from pos 0 cbcount 20
2025-11-03T16:51:44.310124Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 65 totakecount 10 count 10 size 1242 from pos 0 cbcount 10
2025-11-03T16:51:44.310253Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 75 totakecount 15 count 15 size 1836 from pos 0 cbcount 15
2025-11-03T16:51:44.310382Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 90 totakecount 10 count 10 size 1254 from pos 0 cbcount 10
2025-11-03T16:51:44.310774Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-03T16:51:44.311425Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 0 suffix '63'
2025-11-03T16:51:44.311444Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 1 partno 0 count 1 parts 0 suffix '63'
2025-11-03T16:51:44.311463Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 2 partno 0 count 8 parts 0 suffix '63'
2025-11-03T16:51:44.311483Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 10 partno 0 count 10 parts 0 suffix '63'
2025-11-03T16:51:44.311500Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 20 partno 0 count 10 parts 0 suffix '63'
2025-11-03T16:51:44.311517Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 15 parts 0 suffix '63'
2025-11-03T16:51:44.311536Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 45 partno 0 count 20 parts 0 suffix '63'
2025-11-03T16:51:44.311556Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 65 partno 0 count 10 parts 0 suffix '63'
2025-11-03T16:51:44.311580Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 75 partno 0 count 15 parts 0 suffix '63'
2025-11-03T16:51:44.311601Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 90 partno 0 count 10 parts 0 suffix '63'
2025-11-03T16:51:44.316128Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_3_1_15183163835495095129_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 100 Result { Offset: 0 Data: "... 100 bytes ..." SourceId: "\000src_id" SeqNo: 1 WriteTimestampMS: 1762188703795 CreateTimestampMS: 1762188703764 UncompressedSize: 9 PartitionKey: "" ExplicitHash: "" } Result { Offset: 1 Data: "... 102 bytes ..." SourceId: "\000src_id" SeqNo: 2 WriteTimestampMS: 1762188703806 CreateTimestampMS: 1762188703790 UncompressedSize: 17 PartitionKey: "" ExplicitHash: "" } Result { Offset: 2 Data: "... 102 bytes ..." SourceId: "\000src_id" SeqNo: 3 WriteTimestampMS: 1762188703817 CreateTimestampMS: 1762188703791 UncompressedSize: 25 PartitionKey: "" ExplicitHash: "" } Result { Offset: 3 Data: "... 103 bytes ..." SourceId: "\000src_id" SeqNo: 4 WriteTimestampMS: 1762188703879 CreateTimestampMS: 1762188703791 UncompressedSize: 33 PartitionKey: "" ExplicitHash: "" } Result { Offset: 4 Data: "... 103 bytes ..." SourceId: "\000src_id" SeqNo: 5 WriteTimestampMS: 1762188703879 CreateTimestampMS: 1762188703791 UncompressedSize: 41 PartitionKey: "" ExplicitHash: "" } Result { Offset: 5 Data: "... 103 bytes ..." SourceId: "\000src_id" SeqNo: 6 WriteTimestampMS: 1762188703879 CreateTimestampMS: 1762188703791 UncompressedSize: 49 PartitionKey: "" ExplicitHash: "" } Result { Offset: 6 Data: "... 103 bytes ..." SourceId: "\000src_id" SeqNo: 7 WriteTimestampMS: 1762188703879 CreateTimestampMS: 1762188703796 UncompressedSize: 57 PartitionKey: "" ExplicitHash: "" } Result { Offset: 7 Data: "... 103 bytes ..." SourceId: "\000src_id" SeqNo: 8 WriteTimestampMS: 1762188703879 CreateTimestampMS: 1762188703796 UncompressedSize: 65 PartitionKey: "" ExplicitHash: "" } Result { Offset: 8 Data: "... 103 bytes ..." SourceId: "\000src_id" SeqNo: 9 WriteTimestampMS: 1762188703879 CreateTimestampMS: 1762188703797 UncompressedSize: 73 PartitionKey: "" ExplicitHash: "" } Result { Offset: 9 Data: "... 103 bytes ..." SourceId: "\000src_id" SeqNo: 10 WriteTimestampMS: 1762188703879 CreateTimestampMS: 1762188703797 UncompressedSize: 81 PartitionKey: "" ExplicitHash: "" } Result { Offset: 10 Data: "... 104 bytes ..." SourceId: "\000src_id" SeqNo: 11 WriteTimestampMS: 1762188703895 CreateTimestampMS: 1762188703797 UncompressedSize: 90 PartitionKey: "" ExplicitHash: "" } Result { Offset: 11 Data: "... 104 bytes ..." SourceId: "\000src_id" SeqNo: 12 WriteTimestampMS: 1762188703921 CreateTimestampMS: 1762188703797 UncompressedSize: 98 PartitionKey: "" ExplicitHash: "" } Result { Offset: 12 Data: "... 104 bytes ..." SourceId: "\000src_id" SeqNo: 13 WriteTimestampMS: 1762188703921 CreateTimestampMS: 1762188703798 UncompressedSize: 106 PartitionKey: "" ExplicitHash: "" } Result { Offset: 13 Data: "... 104 bytes ..." SourceId: "\000src_id" SeqNo: 14 WriteTimestampMS: 1762188703921 CreateTimestampMS: 1762188703798 UncompressedSize: 114 PartitionKey: "" ExplicitHash: "" } Result { Offset: 14 Data: "... 104 bytes ..." SourceId: "\000src_id" SeqNo: 15 WriteTimestampMS: 1762188703921 CreateTimestampMS: 1762188703799 UncompressedSize: 122 PartitionKey: "" ExplicitHash: "" } Result { Offset: 15 Data: "... 104 bytes ..." SourceId: "\000src_id" SeqNo: 16 WriteTimestampMS: 1762188703921 CreateTimestampMS: 1762188703799 UncompressedSize: 130 PartitionKey: "" ExplicitHash: "" } Result { Offset: 16 Data: "... 104 bytes ..." SourceId: "\000src_id" SeqNo: 17 WriteTimestampMS: 1762188703921 CreateTimestampMS: 1762188703800 UncompressedSize: 138 PartitionKey: "" ExplicitHash: "" } Result { Offset: 17 Data: "... 104 bytes ..." SourceId: "\000src_id" SeqNo: 18 WriteTimestampMS: 1762188703921 CreateTimestampMS: 1762188703801 UncompressedSize: 146 PartitionKey: "" ExplicitHash: "" } Result { Offset: 18 Data: "... 104 bytes ..." SourceId: "\000src_id" SeqNo: 19 WriteTimestampMS: 1762188703921 CreateTimestampMS: 1762188703802 UncompressedSize: 154 PartitionKey: "" ExplicitHash: "" } Result { Offset: 19 Data: "... 104 bytes ..." SourceId: "\000src_id" SeqNo: 20 WriteTimestampMS: 1762188703921 CreateTimestampMS: 1762188703802 UncompressedSize: 162 PartitionKey: "" ExplicitHash: "" } Result { Offset: 20 Data: "... 104 bytes ..." SourceId: "\000src_id" SeqNo: 21 WriteTimestampMS: 1762188703934 CreateTimestampMS: 1762188703803 UncompressedSize: 170 PartitionKey: "" ExplicitHash: "" } Result { Offset: 21 Data: "... 104 bytes ..." SourceId: "\000src_id" SeqNo: 22 WriteTimestampMS: 1762188703937 CreateTimestampMS: 1762188703803 UncompressedSize: 178 PartitionKey: "" ExplicitHash: "" } Result { Offset: 22 Data: "... 104 bytes ..." SourceId: "\000src_id" SeqNo: 23 WriteTimestampMS: 1762188703937 CreateTimestampMS: 1762188703804 UncompressedSize: 186 PartitionKey: "" ExplicitHash: "" } Result { Offset: 23 Data: "... 104 bytes ..." SourceId: "\000src_id" SeqNo: 24 WriteTimestampMS: 1762188703937 CreateTimestampMS: 1762188703804 UncompressedSize: 194 PartitionKey: "" ExplicitHash: "" } Result { Offset: 24 Data: "... 104 bytes ..." SourceId: "\000src_id" SeqNo: 25 WriteTimestampMS: 1762188703937 CreateTimestampMS: 1762188703805 UncompressedSize: 202 PartitionKey: "" ExplicitHash: "" } Result { Offset: 25 Data: "... 104 bytes ..." SourceId: "\000src_id" SeqNo: 26 WriteTimestampMS: 1762188703937 CreateTimestampMS: 1762188703805 UncompressedSize: 210 PartitionKey: "" ExplicitHash: "" } Result { Offset: 26 Data: "... 104 bytes ..." SourceId: "\000src_id" SeqNo: 27 WriteTimestampMS: 1762188703937 CreateTimestampMS: 1762188703806 UncompressedSize: 218 PartitionKey: "" ExplicitHash: "" } Result { Offset: 27 Data: "... 104 bytes ..." SourceId: "\000src_id" SeqNo: 28 WriteTimestampMS: 1762188703937 CreateTimestampMS: 1762188703812 UncompressedSize: 226 PartitionKey: "" ExplicitHash: "" } Result { Offset: 28 Data: "... 104 bytes ..." SourceId: "\000src_id" SeqNo: 29 WriteTimestampMS: 1762188703937 CreateTimestampMS: 1762188703813 UncompressedSize: 234 PartitionKey: "" ExplicitHash: "" } Result { Offset: 29 Data: "... 104 bytes ..." SourceId: "\000src_id" SeqNo: 30 WriteTimestampMS: 1762188703937 CreateTimestampMS: 1762188703813 UncompressedSize: 242 PartitionKey: "" ExplicitHash: "" } Result { Offset: 30 Data: "... 104 bytes ..." SourceId: "\000src_id" SeqNo: 31 WriteTimestampMS: 1762188703950 CreateTimestampMS: 1762188703815 UncompressedSize: 250 PartitionKey: "" ExplicitHash: "" } Result { Offset: 31 Data: "... 104 bytes ..." SourceId: "\000src_id" SeqNo: 32 WriteTimestampMS: 1762188703950 CreateTimestampMS: 1762188703816 UncompressedSize: 258 PartitionKey: "" ExplicitHash: "" } Result { Offset: 32 Data: "... 104 bytes ..." SourceId: "\000src_id" SeqNo: 33 WriteTimestampMS: 1762188703950 CreateTimestampMS: 1762188703816 UncompressedSize: 266 PartitionKey: "" ExplicitHash: "" } Result { Offset: 33 Data: "... 105 bytes ..." SourceId: "\000src_id" SeqNo: 34 WriteTimestampMS: 1762188703950 CreateTimestampMS: 1762188703817 UncompressedSize: 274 PartitionKey: "" ExplicitHash: "" } Result { Offset: 34 Data: "... 105 bytes ..." SourceId: "\000src_id" SeqNo: 35 WriteTimestampMS: 1762188703950 CreateTimestampMS: 1762188703817 UncompressedSize: 282 PartitionKey: "" ExplicitHash: "" } Result { Offset: 35 Data: "... 105 bytes ..." SourceId: "\000src_id" SeqNo: 36 WriteTimestampMS: 1762188703950 CreateTimestampMS: 1762188703819 UncompressedSize: 290 PartitionKey: "" ExplicitHash: "" } Result { Offset: 36 Data: "... 105 bytes ..." SourceId: "\000src_id" SeqNo: 37 WriteTimestampMS: 1762188703950 CreateTimestampMS: 1762188703819 UncompressedSize: 298 PartitionKey: "" ExplicitHash: "" } Result { Offset: 37 Data: "... 105 bytes ..." SourceId: "\000src_id" SeqNo: 38 WriteTimestampMS: 1762188703950 CreateTimestampMS: 1762188703820 UncompressedSize: 306 PartitionKey: "" ExplicitHash: "" } Result { Offset: 38 Data: "... 105 bytes ..." SourceId: "\000src_id" SeqNo: 39 WriteTimestampMS: 1762188703950 CreateTimestampMS: 1762188703820 UncompressedSize: 314 PartitionKey: "" ExplicitHash: "" } Result { Offset: 39 Data: "... 105 bytes ..." SourceId: "\000src_id" SeqNo: 40 WriteTimestampMS: 1762188703950 CreateTimestampMS: 1762188703820 UncompressedSize: 322 PartitionKey: "" ExplicitHash: "" } Result { Offset: 40 Data: "... 105 bytes ..." SourceId: "\000src_id" SeqNo: 41 WriteTimestampMS: 1762188703950 CreateTimestampMS: 1762188703821 UncompressedSize: 330 PartitionKey: "" ExplicitHash: "" } Result { Offset: 41 Data: "... 106 bytes ..." SourceId: "\000src_id" SeqNo: 42 WriteTimestampMS: 1762188703950 CreateTimestampMS: 1762188703821 UncompressedSize: 338 PartitionKey: "" ExplicitHash: "" } Result { Offset: 42 Data: "... 106 bytes ..." SourceId: "\000src_id" SeqNo: 43 WriteTimestampMS: 1762188703950 CreateTimestampMS: 1762188703821 UncompressedSize: 346 PartitionKey: "" ExplicitHash: "" } Result { Offset: 43 Data: "... 106 bytes ..." SourceId: "\000src_id" SeqNo: 44 WriteTimestampMS: 1762188703955 CreateTimestampMS: 1762188703821 UncompressedSize: 354 PartitionKey: "" ExplicitHash: "" } Result { Offset: 44 Data: "... 106 bytes ..." SourceId: "\000src_id" SeqNo: 45 WriteTimestampMS: 1762188703955 CreateTimestampMS: 1762188703822 UncompressedSize: 362 PartitionKey: "" ExplicitHash: "" } Result { Offset: 45 Data: "... 106 bytes ..." SourceId: "\000src_id" SeqNo: 46 WriteTimestampMS: 1762188703974 CreateTimestampMS: 1762188703822 UncompressedSize: 370 PartitionKey: "" ExplicitHash: "" } Result { Offset: 46 Data: "... 106 bytes ..." SourceId: "\000src_id" SeqNo: 47 WriteTimestampMS: 1762188704031 CreateTimestampMS: 1762188703823 UncompressedSize: 378 PartitionKey: "" ExplicitHash: "" } Result { Offset: 47 Data: "... 106 bytes ..." SourceId: "\000src_id" SeqNo: 48 WriteTimestampMS: 1762188704031 CreateTimestampMS: 1762188703823 UncompressedSize: 386 PartitionKey: "" ExplicitHash: "" } Result { Offset: 48 Data: "... 106 bytes ..." SourceId: "\000src_id" SeqNo: 49 WriteTimestampMS: 1762188704031 CreateTimestampMS: 1762188703829 UncompressedSize: 394 PartitionKey: "" ExplicitHash: "" } Result { Offset: 49 Data: "... 106 bytes ..." SourceId: "\000src_id" SeqNo: 50 WriteTimestampMS: 1762188704031 CreateTimestampMS: 1762188703830 UncompressedSize: 402 PartitionKey: "" ExplicitHash: "" } Result { Offset: 50 Data: "... 106 bytes ..." SourceId: "\000src_id" SeqNo: 51 WriteTimestampMS: 1762188704031 CreateTimestampMS: 1762188703830 UncompressedSize: 410 PartitionKey: "" ExplicitHash: "" } Result { Offset: 51 Data: "... 106 bytes ..." SourceId: "\000src_id" SeqNo: 52 WriteTimestampMS: 1762188704031 CreateTimestampMS: 1762188703830 UncompressedSize: 418 PartitionKey: "" ExplicitHash: "" } Result { Offset: 52 Data: "... 106 bytes ..." SourceId: "\000src_id" SeqNo: 53 WriteTimestampMS: 1762188704031 CreateTimestampMS: 1762188703831 UncompressedSize: 426 PartitionKey: "" ExplicitHash: "" } Result { Offset: 53 Data: "... 106 bytes ..." SourceId: "\000src_id" SeqNo: 54 WriteTimestampMS: 1762188704031 CreateTimestampMS: 1762188703831 UncompressedSize: 434 PartitionKey: "" ExplicitHash: "" } Result { Offset: 54 Data: "... 106 bytes ..." SourceId: "\000src_id" SeqNo: 55 WriteTimestampMS: 1762188704031 CreateTimestampMS: 1762188703832 UncompressedSize: 442 PartitionKey: "" ExplicitHash: "" } Result { Offset: 55 Data: "... 106 bytes ..." SourceId: "\000src_id" SeqNo: 56 WriteTimestampMS: 1762188704031 CreateTimestampMS: 1762188703832 UncompressedSize: 450 PartitionKey: "" ExplicitHash: "" } Result { Offset: 56 Data: "... 106 bytes ..." SourceId: "\000src_id" SeqNo: 57 WriteTimestampMS: 1762188704031 CreateTimestampMS: 1762188703832 UncompressedSize: 458 PartitionKey: "" ExplicitHash: "" } Result { Offset: 57 Data: "... 106 bytes ..." SourceId: "\000src_id" SeqNo: 58 WriteTimestampMS: 1762188704031 CreateTimestampMS: 1762188703832 UncompressedSize: 466 PartitionKey: "" ExplicitHash: "" } Result { Offset: 58 Data: "... 106 bytes ..." SourceId: "\000src_id" SeqNo: 59 WriteTimestampMS: 1762188704031 CreateTimestampMS: 1762188703832 UncompressedSize: 474 PartitionKey: "" ExplicitHash: "" } Result { Offset: 59 Data: "... 106 bytes ..." SourceId: "\000src_id" SeqNo: 60 WriteTimestampMS: 1762188704031 CreateTimestampMS: 1762188703833 UncompressedSize: 482 PartitionKey: "" ExplicitHash: "" } Result { Offset: 60 Data: "... 106 bytes ..." SourceId: "\000src_id" SeqNo: 61 WriteTimestampMS: 1762188704031 CreateTimestampMS: 1762188703833 UncompressedSize: 490 PartitionKey: "" ExplicitHash: "" } Result { Offset: 61 Data: "... 106 bytes ..." SourceId: "\000src_id" SeqNo: 62 WriteTimestampMS: 1762188704031 CreateTimestampMS: 1762188703833 UncompressedSize: 498 PartitionKey: "" ExplicitHash: "" } Result { Offset: 62 Data: "... 106 bytes ..." SourceId: "\000src_id" SeqNo: 63 WriteTimestampMS: 1762188704031 CreateTimestampMS: 1762188703833 UncompressedSize: 506 PartitionKey: "" ExplicitHash: "" } Result { Offset: 63 Data: "... 106 bytes ..." SourceId: "\000src_id" SeqNo: 64 WriteTimestampMS: 1762188704031 CreateTimestampMS: 1762188703834 UncompressedSize: 514 PartitionKey: "" ExplicitHash: "" } Result { Offset: 64 Data: "... 106 bytes ..." SourceId: "\000src_id" SeqNo: 65 WriteTimestampMS: 1762188704031 CreateTimestampMS: 1762188703834 UncompressedSize: 522 PartitionKey: "" ExplicitHash: "" } Result { Offset: 65 Data: "... 107 bytes ..." SourceId: "\000src_id" SeqNo: 66 WriteTimestampMS: 1762188704046 CreateTimestampMS: 1762188703834 UncompressedSize: 530 PartitionKey: "" ExplicitHash: "" } Result { Offset: 66 Data: "... 107 bytes ..." SourceId: "\000src_id" SeqNo: 67 WriteTimestampMS: 1762188704056 CreateTimestampMS: 1762188703834 UncompressedSize: 538 PartitionKey: "" ExplicitHash: "" } Result { Offset: 67 Data: "... 107 bytes ..." SourceId: "\000src_id" SeqNo: 68 WriteTimestampMS: 1762188704057 CreateTimestampMS: 1762188703835 UncompressedSize: 546 PartitionKey: "" ExplicitHash: "" } Result { Offset: 68 Data: "... 107 bytes ..." SourceId: "\000src_id" SeqNo: 69 WriteTimestampMS: 1762188704057 CreateTimestampMS: 1762188703835 UncompressedSize: 554 PartitionKey: "" ExplicitHash: "" } Result { Offset: 69 Data: "... 107 bytes ..." SourceId: "\000src_id" SeqNo: 70 WriteTimestampMS: 1762188704057 CreateTimestampMS: 1762188703847 UncompressedSize: 562 PartitionKey: "" ExplicitHash: "" } Result { Offset: 70 Data: "... 107 bytes ..." SourceId: "\000src_id" SeqNo: 71 WriteTimestampMS: 1762188704057 CreateTimestampMS: 1762188703848 UncompressedSize: 570 PartitionKey: "" ExplicitHash: "" } Result { Offset: 71 Data: "... 107 bytes ..." SourceId: "\000src_id" SeqNo: 72 WriteTimestampMS: 1762188704057 CreateTimestampMS: 1762188703848 UncompressedSize: 578 PartitionKey: "" ExplicitHash: "" } Result { Offset: 72 Data: "... 107 bytes ..." SourceId: "\000src_id" SeqNo: 73 WriteTimestampMS: 1762188704057 CreateTimestampMS: 1762188703849 UncompressedSize: 586 PartitionKey: "" ExplicitHash: "" } Result { Offset: 73 Data: "... 107 bytes ..." SourceId: "\000src_id" SeqNo: 74 WriteTimestampMS: 1762188704057 CreateTimestampMS: 1762188703849 UncompressedSize: 594 PartitionKey: "" ExplicitHash: "" } Result { Offset: 74 Data: "... 107 bytes ..." SourceId: "\000src_id" SeqNo: 75 WriteTimestampMS: 1762188704057 CreateTimestampMS: 1762188703850 UncompressedSize: 602 PartitionKey: "" ExplicitHash: "" } Result { Offset: 75 Data: "... 107 bytes ..." SourceId: "\000src_id" SeqNo: 76 WriteTimestampMS: 1762188704076 CreateTimestampMS: 1762188703850 UncompressedSize: 610 PartitionKey: "" ExplicitHash: "" } Result { Offset: 76 Data: "... 107 bytes ..." SourceId: "\000src_id" SeqNo: 77 WriteTimestampMS: 1762188704076 CreateTimestampMS: 1762188703851 UncompressedSize: 618 PartitionKey: "" ExplicitHash: "" } Result { Offset: 77 Data: "... 107 bytes ..." SourceId: "\000src_id" SeqNo: 78 WriteTimestampMS: 1762188704076 CreateTimestampMS: 1762188703851 UncompressedSize: 626 PartitionKey: "" ExplicitHash: "" } Result { Offset: 78 Data: "... 107 bytes ..." SourceId: "\000src_id" SeqNo: 79 WriteTimestampMS: 1762188704076 CreateTimestampMS: 1762188703852 UncompressedSize: 634 PartitionKey: "" ExplicitHash: "" } Result { Offset: 79 Data: "... 107 bytes ..." SourceId: "\000src_id" SeqNo: 80 WriteTimestampMS: 1762188704076 CreateTimestampMS: 1762188703852 UncompressedSize: 642 PartitionKey: "" ExplicitHash: "" } Result { Offset: 80 Data: "... 107 bytes ..." SourceId: "\000src_id" SeqNo: 81 WriteTimestampMS: 1762188704076 CreateTimestampMS: 1762188703859 UncompressedSize: 650 PartitionKey: "" ExplicitHash: "" } Result { Offset: 81 Data: "... 108 bytes ..." SourceId: "\000src_id" SeqNo: 82 WriteTimestampMS: 1762188704076 CreateTimestampMS: 1762188703859 UncompressedSize: 658 PartitionKey: "" ExplicitHash: "" } Result { Offset: 82 Data: "... 108 bytes ..." SourceId: "\000src_id" SeqNo: 83 WriteTimestampMS: 1762188704076 CreateTimestampMS: 1762188703860 UncompressedSize: 666 PartitionKey: "" ExplicitHash: "" } Result { Offset: 83 Data: "... 108 bytes ..." SourceId: "\000src_id" SeqNo: 84 WriteTimestampMS: 1762188704076 CreateTimestampMS: 1762188703860 UncompressedSize: 674 PartitionKey: "" ExplicitHash: "" } Result { Offset: 84 Data: "... 108 bytes ..." SourceId: "\000src_id" SeqNo: 85 WriteTimestampMS: 1762188704076 CreateTimestampMS: 1762188703861 UncompressedSize: 682 PartitionKey: "" ExplicitHash: "" } Result { Offset: 85 Data: "... 108 bytes ..." SourceId: "\000src_id" SeqNo: 86 WriteTimestampMS: 1762188704076 CreateTimestampMS: 1762188703861 UncompressedSize: 690 PartitionKey: "" ExplicitHash: "" } Result { Offset: 86 Data: "... 108 bytes ..." SourceId: "\000src_id" SeqNo: 87 WriteTimestampMS: 1762188704076 CreateTimestampMS: 1762188703862 UncompressedSize: 698 PartitionKey: "" ExplicitHash: "" } Result { Offset: 87 Data: "... 108 bytes ..." SourceId: "\000src_id" SeqNo: 88 WriteTimestampMS: 1762188704076 CreateTimestampMS: 1762188703862 UncompressedSize: 706 PartitionKey: "" ExplicitHash: "" } Result { Offset: 88 Data: "... 108 bytes ..." SourceId: "\000src_id" SeqNo: 89 WriteTimestampMS: 1762188704076 CreateTimestampMS: 1762188703863 UncompressedSize: 714 PartitionKey: "" ExplicitHash: "" } Result { Offset: 89 Data: "... 108 bytes ..." SourceId: "\000src_id" SeqNo: 90 WriteTimestampMS: 1762188704076 CreateTimestampMS: 1762188703863 UncompressedSize: 722 PartitionKey: "" ExplicitHash: "" } Result { Offset: 90 Data: "... 108 bytes ..." SourceId: "\000src_id" SeqNo: 91 WriteTimestampMS: 1762188704089 CreateTimestampMS: 1762188703865 UncompressedSize: 730 PartitionKey: "" ExplicitHash: "" } Result { Offset: 91 Data: "... 108 bytes ..." SourceId: "\000src_id" SeqNo: 92 WriteTimestampMS: 1762188704114 CreateTimestampMS: 1762188703866 UncompressedSize: 738 PartitionKey: "" ExplicitHash: "" } Result { Offset: 92 Data: "... 108 bytes ..." SourceId: "\000src_id" SeqNo: 93 WriteTimestampMS: 1762188704114 CreateTimestampMS: 1762188703866 UncompressedSize: 746 PartitionKey: "" ExplicitHash: "" } Result { Offset: 93 Data: "... 108 bytes ..." SourceId: "\000src_id" SeqNo: 94 WriteTimestampMS: 1762188704114 CreateTimestampMS: 1762188703867 UncompressedSize: 754 PartitionKey: "" ExplicitHash: "" } Result { Offset: 94 Data: "... 108 bytes ..." SourceId: "\000src_id" SeqNo: 95 WriteTimestampMS: 1762188704114 CreateTimestampMS: 1762188703867 UncompressedSize: 762 PartitionKey: "" ExplicitHash: "" } Result { Offset: 95 Data: "... 108 bytes ..." SourceId: "\000src_id" SeqNo: 96 WriteTimestampMS: 1762188704114 CreateTimestampMS: 1762188703868 UncompressedSize: 770 PartitionKey: "" ExplicitHash: "" } Result { Offset: 96 Data: "... 108 bytes ..." SourceId: "\000src_id" SeqNo: 97 WriteTimestampMS: 1762188704114 CreateTimestampMS: 1762188703871 UncompressedSize: 778 PartitionKey: "" ExplicitHash: "" } Result { Offset: 97 Data: "... 108 bytes ..." SourceId: "\000src_id" SeqNo: 98 WriteTimestampMS: 1762188704114 CreateTimestampMS: 1762188703872 UncompressedSize: 786 PartitionKey: "" ExplicitHash: "" } Result { Offset: 98 Data: "... 109 bytes ..." SourceId: "\000src_id" SeqNo: 99 WriteTimestampMS: 1762188704114 CreateTimestampMS: 1762188703872 UncompressedSize: 794 PartitionKey: "" ExplicitHash: "" } Result { Offset: 99 Data: "... 109 bytes ..." SourceId: "\000src_id" SeqNo: 100 WriteTimestampMS: 1762188704114 CreateTimestampMS: 1762188703873 UncompressedSize: 802 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 10 SizeLag: 18446744073709548131 RealReadOffset: 99 WaitQuotaTimeMs: 0 EndOffset: 100 StartOffset: 0 } Cookie: 0 }
2025-11-03T16:51:44.317680Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_3_1_15183163835495095129_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 1 from offset 100
2025-11-03T16:51:44.317728Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_3_1_15183163835495095129_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 100 ReadOffset 100 ReadGuid e16cdf9a-64aa2610-92091866-1f109114 has messages 1
2025-11-03T16:51:44.318214Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_3_1_15183163835495095129_v1 read done: guid# e16cdf9a-64aa2610-92091866-1f109114, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 7342
2025-11-03T16:51:44.318268Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_3_1_15183163835495095129_v1 response to read: guid# e16cdf9a-64aa2610-92091866-1f109114
2025-11-03T16:51:44.318663Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_3_1_15183163835495095129_v1 Process answer. Aval parts: 0
2025-11-03T16:51:44.321459Z :DEBUG: [/Root] [/Root] [ce990dbc-c45414da-34e49130-a1d2dffa] [dc1] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:51:44.323457Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 0 (0-99)
2025-11-03T16:51:44.323559Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (0-0)
2025-11-03T16:51:44.323598Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 0} (1-1)
2025-11-03T16:51:44.323638Z :DEBUG: [/Root] Take Data. Partition 0. Read: {2, 0} (2-2)
2025-11-03T16:51:44.323660Z :DEBUG: [/Root] Take Data. Partition 0. Read: {3, 0} (3-3)
2025-11-03T16:51:44.323695Z :DEBUG: [/Root] Take Data. Partition 0. Read: {3, 1} (4-4)
2025-11-03T16:51:44.323736Z :DEBUG: [/Root] Take Data. Partition 0. Read: {3, 2} (5-5)
2025-11-03T16:51:44.323759Z :DEBUG: [/Root] Take Data. Partition 0. Read: {3, 3} (6-6)
2025-11-03T16:51:44.323785Z :DEBUG: [/Root] Take Data. Partition 0. Read: {3, 4} (7-7)
2025-11-03T16:51:44.323836Z :DEBUG: [/Root] Take Data. Partition 0. Read: {3, 5} (8-8)
2025-11-03T16:51:44.323860Z :DEBUG: [/Root] Take Data. Partition 0. Read: {3, 6} (9-9)
2025-11-03T16:51:44.323893Z :DEBUG: [/Root] Take Data. Partition 0. Read: {4, 0} (10-10)
2025-11-03T16:51:44.323920Z :DEBUG: [/Root] Take Data. Partition 0. Read: {5, 0} (11-11)
2025-11-03T16:51:44.323947Z :DEBUG: [/Root] Take Data. Partition 0. Read: {5, 1} (12-12)
2025-11-03T16:51:44.323995Z :DEBUG: [/Root] Take Data. Partition 0. Read: {5, 2} (13-13)
2025-11-03T16:51:44.324024Z :DEBUG: [/Root] Take Data. Partition 0. Read: {5, 3} (14-14)
2025-11-03T16:51:44.324054Z :DEBUG: [/Root] Take Data. Partition 0. Read: {5, 4} (15-15)
2025-11-03T16:51:44.324111Z :DEBUG: [/Root] Take Data. Partition 0. Read: {5, 5} (16-16)
2025-11-03T16:51:44.324142Z :DEBUG: [/Root] Take Data. Partition 0. Read: {5, 6} (17-17)
2025-11-03T16:51:44.324177Z :DEBUG: [/Root] Take Data. Partition 0. Read: {5, 7} (18-18)
2025-11-03T16:51:44.324204Z :DEBUG: [/Root] Take Data. Partition 0. Read: {5, 8} (19-19)
2025-11-03T16:51:44.324233Z :DEBUG: [/Root] Take Data. Partition 0. Read: {6, 0} (20-20)
2025-11-03T16:51:44.324262Z :DEBUG: [/Root] Take Data. Partition 0. Read: {7, 0} (21-21)
2025-11-03T16:51:44.324285Z :DEBUG: [/Root] Take Data. Partition 0. Read: {7, 1} (22-22)
2025-11-03T16:51:44.324318Z :DEBUG: [/Root] Take Data. Partition 0. Read: {7, 2} (23-23)
2025-11-03T16:51:44.324347Z :DEBUG: [/Root] Take Data. Partition 0. Read: {7, 3} (24-24)
2025-11-03T16:51:44.324364Z :DEBUG: [/Root] Take Data. Partition 0. Read: {7, 4} (25-25)
2025-11-03T16:51:44.324390Z :DEBUG: [/Root] Take Data. Partition 0. Read: {7, 5} (26-26)
2025-11-03T16:51:44.324415Z :DEBUG: [/Root] Take Data. Partition 0. Read: {7, 6} (27-27)
2025-11-03T16:51:44.324435Z :DEBUG: [/Root] Take Data. Partition 0. Read: {7, 7} (28-28)
2025-11-03T16:51:44.324465Z :DEBUG: [/Root] Take Data. Partition 0. Read: {7, 8} (29-29)
2025-11-03T16:51:44.324495Z :DEBUG: [/Root] Take Data. Partition 0. Read: {8, 0} (30-30)
2025-11-03T16:51:44.324534Z :DEBUG: [/Root] Take Data. Partition 0. Read: {8, 1} (31-31)
2025-11-03T16:51:44.324612Z :DEBUG: [/Root] Take Data. Partition 0. Read: {8, 2} (32-32)
2025-11-03T16:51:44.324638Z :DEBUG: [/Root] Take Data. Partition 0. Read: {8, 3} (33-33)
2025-11-03T16:51:44.324674Z :DEBUG: [/Root] Take Data. Partition 0. Read: {8, 4} (34-34)
2025-11-03T16:51:44.324695Z :DEBUG: [/Root] Take Data. Partition 0. Read: {8, 5} (35-35)
2025-11-03T16:51:44.324717Z :DEBUG: [/Root] Take Data. Partition 0. Read: {8, 6} (36-36)
2025-11-03T16:51:44.324742Z :DEBUG: [/Root] Take Data. Partition 0. Read: {8, 7} (37-37)
2025-11-03T16:51:44.324765Z :DEBUG: [/Root] Take Data. Partition 0. Read: {8, 8} (38-38)
2025-11-03T16:51:44.324808Z :DEBUG: [/Root] Take Data. Partition 0. Read: {8, 9} (39-39)
2025-11-03T16:51:44.324833Z :DEBUG: [/Root] Take Data. Partition 0. Read: {8, 10} (40-40)
2025-11-03T16:51:44.324853Z :DEBUG: [/Root] Take Data. Partition 0. Read: {8, 11} (41-41)
2025-11-03T16:51:44.324883Z :DEBUG: [/Root] Take Data. Partition 0. Read: {8, 12} (42-42)
2025-11-03T16:51:44.324911Z :DEBUG: [/Root] Take Data. Partition 0. Read: {9, 0} (43-43)
2025-11-03T16:51:44.324934Z :DEBUG: [/Root] Take Data. Partition 0. Read: {9, 1} (44-44)
2025-11-03T16:51:44.324962Z :DEBUG: [/Root] Take Data. Partition 0. Read: {10, 0} (45-45)
2025-11-03T16:51:44.324985Z :DEBUG: [/Root] Take Data. Partition 0. Read: {11, 0} (46-46)
2025-11-03T16:51:44.325011Z :DEBUG: [/Root] Take Data. Partition 0. Read: {11, 1} (47-47)
2025-11-03T16:51:44.325036Z :DEBUG: [/Root] Take Data. Partition 0. Read: {11, 2} (48-48)
2025-11-03T16:51:44.325060Z :DEBUG: [/Root] Take Data. Partition 0. Read: {11, 3} (49-49)
2025-11-03T16:51:44.325090Z :DEBUG: [/Root] Take Data. Partition 0. Read: {11, 4} (50-50)
2025-11-03T16:51:44.325111Z :DEBUG: [/Root] Take Data. Partition 0. Read: {11, 5} (51-51)
2025-11-03T16:51:44.325137Z :DEBUG: [/Root] Take Data. Partition 0. Read: {11, 6} (52-52)
2025-11-03T16:51:44.325163Z :DEBUG: [/Root] Take Data. Partition 0. Read: {11, 7} (53-53)
2025-11-03T16:51:44.325200Z :DEBUG: [/Root] Take Data. Partition 0. Read: {11, 8} (54-54)
2025-11-03T16:51:44.325229Z :DEBUG: [/Root] Take Data. Partition 0. Read: {11, 9} (55-55)
2025-11-03T16:51:44.325259Z :DEBUG: [/Root] Take Data. Partition 0. Read: {11, 10} (56-56)
2025-11-03T16:51:44.325281Z :DEBUG: [/Root] Take Data. Partition 0. Read: {11, 11} (57-57)
2025-11-03T16:51:44.325310Z :DEBUG: [/Root] Take Data. Partition 0. Read: {11, 12} (58-58)
2025-11-03T16:51:44.325340Z :DEBUG: [/Root] Take Data. Partition 0. Read: {11, 13} (59-59)
2025-11-03T16:51:44.325365Z :DEBUG: [/Root] Take Data. Partition 0. Read: {11, 14} (60-60)
2025-11-03T16:51:44.325392Z :DEBUG: [/Root] Take Data. Partition 0. Read: {11, 15} (61-61)
2025-11-03T16:51:44.325416Z :DEBUG: [/Root] Take Data. Partition 0. Read: {11, 16} (62-62)
2025-11-03T16:51:44.325446Z :DEBUG: [/Root] Take Data. Partition 0. Read: {11, 17} (63-63)
2025-11-03T16:51:44.325588Z :DEBUG: [/Root] Take Data. Partition 0. Read: {11, 18} (64-64)
2025-11-03T16:51:44.325616Z :DEBUG: [/Root] Take Data. Partition 0. Read: {12, 0} (65-65)
2025-11-03T16:51:44.325655Z :DEBUG: [/Root] Take Data. Partition 0. Read: {13, 0} (66-66)
2025-11-03T16:51:44.325678Z :DEBUG: [/Root] Take Data. Partition 0. Read: {14, 0} (67-67)
2025-11-03T16:51:44.325715Z :DEBUG: [/Root] Take Data. Partition 0. Read: {14, 1} (68-68)
2025-11-03T16:51:44.325742Z :DEBUG: [/Root] Take Data. Partition 0. Read: {14, 2} (69-69)
2025-11-03T16:51:44.325767Z :DEBUG: [/Root] Take Data. Partition 0. Read: {14, 3} (70-70)
2025-11-03T16:51:44.325797Z :DEBUG: [/Root] Take Data. Partition 0. Read: {14, 4} (71-71)
2025-11-03T16:51:44.325832Z :DEBUG: [/Root] Take Data. Partition 0. Read: {14, 5} (72-72)
2025-11-03T16:51:44.325854Z :DEBUG: [/Root] Take Data. Partition 0. Read: {14, 6} (73-73)
2025-11-03T16:51:44.325887Z :DEBUG: [/Root] Take Data. Partition 0. Read: {14, 7} (74-74)
2025-11-03T16:51:44.325911Z :DEBUG: [/Root] Take Data. Partition 0. Read: {15, 0} (75-75)
2025-11-03T16:51:44.325936Z :DEBUG: [/Root] Take Data. Partition 0. Read: {15, 1} (76-76)
2025-11-03T16:51:44.325961Z :DEBUG: [/Root] Take Data. Partition 0. Read: {15, 2} (77-77)
2025-11-03T16:51:44.325992Z :DEBUG: [/Root] Take Data. Partition 0. Read: {15, 3} (78-78)
2025-11-03T16:51:44.326021Z :DEBUG: [/Root] Take Data. Partition 0. Read: {15, 4} (79-79)
2025-11-03T16:51:44.326046Z :DEBUG: [/Root] Take Data. Partition 0. Read: {15, 5} (80-80)
2025-11-03T16:51:44.326075Z :DEBUG: [/Root] Take Data. Partition 0. Read: {15, 6} (81-81)
2025-11-03T16:51:44.326102Z :DEBUG: [/Root] Take Data. Partition 0. Read: {15, 7} (82-82)
2025-11-03T16:51:44.326139Z :DEBUG: [/Root] Take Data. Partition 0. Read: {15, 8} (83-83)
2025-11-03T16:51:44.326170Z :DEBUG: [/Root] Take Data. Partition 0. Read: {15, 9} (84-84)
2025-11-03T16:51:44.326197Z :DEBUG: [/Root] Take Data. Partition 0. Read: {15, 10} (85-85)
2025-11-03T16:51:44.326222Z :DEBUG: [/Root] Take Data. Partition 0. Read: {15, 11} (86-86)
2025-11-03T16:51:44.326246Z :DEBUG: [/Root] Take Data. Partition 0. Read: {15, 12} (87-87)
2025-11-03T16:51:44.326293Z :DEBUG: [/Root] Take Data. Partition 0. Read: {15, 13} (88-88)
2025-11-03T16:51:44.326311Z :DEBUG: [/Root] Take Data. Partition 0. Read: {15, 14} (89-89)
2025-11-03T16:51:44.326342Z :DEBUG: [/Root] Take Data. Partition 0. Read: {16, 0} (90-90)
2025-11-03T16:51:44.326367Z :DEBUG: [/Root] Take Data. Partition 0. Read: {17, 0} (91-91)
2025-11-03T16:51:44.326389Z :DEBUG: [/Root] Take Data. Partition 0. Read: {17, 1} (92-92)
2025-11-03T16:51:44.326416Z :DEBUG: [/Root] Take Data. Partition 0. Read: {17, 2} (93-93)
2025-11-03T16:51:44.326441Z :DEBUG: [/Root] Take Data. Partition 0. Read: {17, 3} (94-94)
2025-11-03T16:51:44.326472Z :DEBUG: [/Root] Take Data. Partition 0. Read: {17, 4} (95-95)
2025-11-03T16:51:44.326497Z :DEBUG: [/Root] Take Data. Partition 0. Read: {17, 5} (96-96)
2025-11-03T16:51:44.326517Z :DEBUG: [/Root] Take Data. Partition 0. Read: {17, 6} (97-97)
2025-11-03T16:51:44.326618Z :DEBUG: [/Root] Take Data. Partition 0. Read: {17, 7} (98-98)
2025-11-03T16:51:44.326652Z :DEBUG: [/Root] Take Data. Partition 0. Read: {17, 8} (99-99)
2025-11-03T16:51:44.326931Z :DEBUG: [/Root] [/Root] [ce990dbc-c45414da-34e49130-a1d2dffa] [dc1] The application data is transferred to the client. Number of messages 100, size 40590 bytes
2025-11-03T16:51:44.327269Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_3_1_15183163835495095129_v1 grpc read done: success# 1, data# { read { } }
2025-11-03T16:51:44.327474Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_3_1_15183163835495095129_v1 got read request: guid# 4bdd88e0-8402d54f-236e446e-cd9bc941
2025-11-03T16:51:44.331827Z :INFO: [/Root] [/Root] [ce990dbc-c45414da-34e49130-a1d2dffa] Closing read session. Close timeout: 0.010000s
2025-11-03T16:51:44.331904Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): dc1:test-topic:0:1:99:0
2025-11-03T16:51:44.331951Z :INFO: [/Root] [/Root] [ce990dbc-c45414da-34e49130-a1d2dffa] Counters: { Errors: 0 CurrentSessionLifetimeMs: 147 BytesRead: 40590 MessagesRead: 100 BytesReadCompressed: 3467 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-11-03T16:51:44.332773Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66b860-179da72d-bba19cac-67d10518_0] Write session: destroy
2025-11-03T16:51:44.333646Z :INFO: [/Root] [/Root] [ce990dbc-c45414da-34e49130-a1d2dffa] Closing read session. Close timeout: 0.000000s
2025-11-03T16:51:44.333697Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): dc1:test-topic:0:1:99:0
2025-11-03T16:51:44.333735Z :INFO: [/Root] [/Root] [ce990dbc-c45414da-34e49130-a1d2dffa] Counters: { Errors: 0 CurrentSessionLifetimeMs: 148 BytesRead: 40590 MessagesRead: 100 BytesReadCompressed: 3467 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-11-03T16:51:44.333832Z :NOTICE: [/Root] [/Root] [ce990dbc-c45414da-34e49130-a1d2dffa] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
2025-11-03T16:51:44.338162Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_3_1_15183163835495095129_v1 grpc read done: success# 0, data# {  }
2025-11-03T16:51:44.338193Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:125: session cookie 1 consumer shared/user session shared/user_3_1_15183163835495095129_v1 grpc read failed
2025-11-03T16:51:44.338218Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:92: session cookie 1 consumer shared/user session shared/user_3_1_15183163835495095129_v1 grpc closed
2025-11-03T16:51:44.338254Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 1 consumer shared/user session shared/user_3_1_15183163835495095129_v1 is DEAD
2025-11-03T16:51:44.339525Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2258: [PQ: 72075186224037892] Destroy direct read session shared/user_3_1_15183163835495095129_v1
2025-11-03T16:51:44.339569Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [3:7568542853963049604:2487] destroyed
2025-11-03T16:51:44.339618Z node 4 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_3_1_15183163835495095129_v1
2025-11-03T16:51:44.340492Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:44.340515Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:44.340527Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:44.340700Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1659: [72075186224037893][rt3.dc1--test-topic] pipe [3:7568542853963049601:2484] disconnected.
2025-11-03T16:51:44.340728Z node 3 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1670: [72075186224037893][rt3.dc1--test-topic] pipe [3:7568542853963049601:2484] disconnected; active server actors: 1
2025-11-03T16:51:44.340744Z node 3 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1679: [72075186224037893][rt3.dc1--test-topic] pipe [3:7568542853963049601:2484] client user disconnected session shared/user_3_1_15183163835495095129_v1
2025-11-03T16:51:44.444098Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:44.444137Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:44.444148Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:44.544646Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:44.544671Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:44.544684Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:46.020112Z :WriteAndReadSomeMessagesWithNoCompression INFO: Random seed for debugging is 1762188706020087
2025-11-03T16:51:46.728518Z node 5 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[5:7568542863661305000:2152];send_to=[0:7307199536658146131:7762515];
2025-11-03T16:51:46.729343Z node 5 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
test_client.cpp: SetPath # /home/runner/.ya/build/build_root/7jz3/001974/r3tmp/tmpiAi5x3/pdisk_1.dat
2025-11-03T16:51:46.802872Z node 5 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-11-03T16:51:46.817921Z node 6 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-11-03T16:51:46.821122Z node 5 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-11-03T16:51:46.822049Z node 6 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-11-03T16:51:46.822182Z node 6 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=incorrect path status: LookupError;
2025-11-03T16:51:46.977362Z node 5 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
2025-11-03T16:51:47.004727Z node 5 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-11-03T16:51:47.005055Z node 5 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(5, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-11-03T16:51:47.005162Z node 5 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(5, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-11-03T16:51:47.006185Z node 5 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(6, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-11-03T16:51:47.006246Z node 5 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(6, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-11-03T16:51:47.043078Z node 5 :HIVE WARN: hive_impl.cpp:811: HIVE#72057594037968897 Handle TEvInterconnect::TEvNodeConnected, NodeId 6 Cookie 6
2025-11-03T16:51:47.043246Z node 5 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(5, (0,0,0,0)) VolatileState: Connecting -> Connected
2025-11-03T16:51:47.046215Z node 5 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(6, (0,0,0,0)) VolatileState: Connecting -> Connected
2025-11-03T16:51:47.065561Z node 6 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
TServer::EnableGrpc on GrpcPort 62067, node 5
2025-11-03T16:51:47.207238Z node 5 :NET_CLASSIFIER WARN: net_classifier.cpp:190: distributable config is empty, broken or outdated, will use file: /home/runner/.ya/build/build_root/7jz3/001974/r3tmp/yandexRaddjK.tmp
2025-11-03T16:51:47.207289Z node 5 :NET_CLASSIFIER WARN: net_classifier.cpp:196: will try to initialize from file: /home/runner/.ya/build/build_root/7jz3/001974/r3tmp/yandexRaddjK.tmp
2025-11-03T16:51:47.207526Z node 5 :NET_CLASSIFIER WARN: net_classifier.cpp:202: successfully initialized from file: /home/runner/.ya/build/build_root/7jz3/001974/r3tmp/yandexRaddjK.tmp
2025-11-03T16:51:47.207800Z node 5 :NET_CLASSIFIER ERROR: net_classifier.cpp:228: got bad distributable configuration
2025-11-03T16:51:47.251935Z INFO: TTestServer started on Port 28984 GrpcPort 62067
2025-11-03T16:51:47.390648Z node 5 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
TClient is connected to server localhost:28984
PQClient connected to localhost:62067
WaitRootIsUp 'Root'...
TClient::Ls request: Root
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "Root"
    PathId: 1
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 1
    CreateStep: 0
    ParentPathId: 1
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 1
      SubDomainVersion: 0
      SecurityStateVersion: 0
    }
    ChildrenExist: false
  }
  Children {
    Name: ".sys"
    PathId: 18446744073709551615
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 0
    CreateStep: 0
    ParentPathId: 18446744073709551615
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 0
      Pl...
(TRUNCATED)
WaitRootIsUp 'Root' success.
2025-11-03T16:51:47.531224Z node 5 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpAlterSubDomain, opId: 281474976710657:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_alter_subdomain.cpp:311)
waiting...
waiting...
waiting...
waiting...
2025-11-03T16:51:47.791558Z node 5 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-11-03T16:51:47.817301Z node 6 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-11-03T16:51:51.673103Z node 5 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [5:7568542885136142351:2328], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-03T16:51:51.673252Z node 5 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-03T16:51:51.674141Z node 5 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [5:7568542885136142387:2332], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-03T16:51:51.674216Z node 5 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [5:7568542885136142388:2333], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-03T16:51:51.674522Z node 5 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-03T16:51:51.679600Z node 5 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateResourcePool, opId: 281474976710661:3, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_resource_pool.cpp:179)
2025-11-03T16:51:51.719589Z node 5 :KQP_WORKLOAD_SERVICE WARN: helpers.h:73: [WorkloadService] [TPoolCreatorActor] ActorId: [5:7568542885136142391:2334], DatabaseId: /Root, PoolId: default, Scheduled retry for error: { <main>: Error: Transaction 281474976710661 completed, doublechecking }
2025-11-03T16:51:51.728872Z node 5 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[5:7568542863661305000:2152];send_to=[0:7307199536658146131:7762515];
2025-11-03T16:51:51.728930Z node 5 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
2025-11-03T16:51:51.795378Z node 5 :TX_PROXY ERROR: schemereq.cpp:593: Actor# [5:7568542885136142503:2691] txid# 281474976710662, issues: { message: "Check failed: path: \'/Root/.metadata/workload_manager/pools/default\', error: path exist, request accepts it (id: [OwnerId: 72057594046644480, LocalPathId: 8], type: EPathTypeResourcePool, state: EPathStateNoChanges)" severity: 1 }
2025-11-03T16:51:51.800353Z node 5 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710663:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:690)
2025-11-03T16:51:51.844608Z node 6 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:570: Compilation failed, self: [6:7568542886800631978:2305], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-11-03T16:51:51.845441Z node 6 :KQP_SESSION WARN: kqp_session_actor.cpp:2506: SessionId: ydb://session/3?node_id=6&id=NDkwOTM4NDYtMTUxOThiN2MtNGMzNWEzODYtY2ViMGFiY2M=, ActorId: [6:7568542886800631928:2297], ActorState: ExecuteState, TraceId: 01k95a3nt688c71ycwrva3zegs, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-11-03T16:51:51.845831Z node 6 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-11-03T16:51:51.855883Z node 5 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:570: Compilation failed, self: [5:7568542885136142527:2345], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-11-03T16:51:51.857684Z node 5 :KQP_SESSION WARN: kqp_session_actor.cpp:2506: SessionId: ydb://session/3?node_id=5&id=YmY4NzUzNzQtNmE1YWQxZmUtYjU4OWVmYmMtMTBmZGY5NDg=, ActorId: [5:7568542885136142347:2325], ActorState: ExecuteState, TraceId: 01k95a3nqe80qh9hk2a4btd3fe, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-11-03T16:51:51.858172Z node 5 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-11-03T16:51:51.975783Z node 5 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710664:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:690)
2025-11-03T16:51:52.286989Z node 5 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710665:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:690)
=== Init DC: UPSERT INTO `/Root/PQ/Config/V2/Cluster` (name, balancer, local, enabled, weight) VALUES ("dc1", "localhost:62067", true, true, 1000);
2025-11-03T16:51:52.683259Z node 5 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976710666. Ctx: { TraceId: 01k95a3pgk1z8jf1ypgqas0s6t, Database: , SessionId: ydb://session/3?node_id=5&id=MTg3NDliOGEtNmFiYmI1MWYtN2NkN2Y1YWMtMWM5MWQzZjc=, PoolId: default, DatabaseId: /Root}. Database not set, use /Root
=== CheckClustersList. Subcribe to ClusterTracker from [5:7568542889431110203:2989] 
=== CheckClustersList. Ok
2025-11-03T16:52:01.866924Z node 5 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710671:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:690)
waiting...
2025-11-03T16:52:01.929127Z node 5 :FLAT_TX_SCHEMESHARD WARN: schemeshard_impl.cpp:7727: Cannot get console configs
2025-11-03T16:52:01.929163Z node 5 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
PQ Client: create topic: rt3.dc1--test-topic with 1 partitions
CallPersQueueGRPC request to localhost:62067
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-11-03T16:52:01.965388Z node 5 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
CallPersQueueGRPC request to localhost:62067
MetaRequest {
  CmdCreateTopic {
    Topic: "rt3.dc1--test-topic"
    NumPartitions: 1
    Config {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
  }
}
CallPersQueueGRPC response:
Status: 129
ProxyErrorCode: 53
SchemeStatus: 1
FlatTxId {
  TxId: 281474976710672
  SchemeShardTabletId: 72057594046644480
  PathId: 13
}
ErrorCode: OK
AddTopic: rt3.dc1--test-topic
===Run query:``DECLARE $version as Int64; DECLARE $path AS Utf8; DECLARE $cluster as Utf8; UPSERT INTO `/Root/PQ/Config/V2/Topics` (path, dc) VALUES ($path, $cluster); UPSERT INTO `/Root/PQ/Config/V2/Versions` (name, version) VALUES ("Topics", $version);`` with topic = test-topic, dc = dc1
2025-11-03T16:52:02.029509Z node 5 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1655: [72075186224037893][] pipe [5:7568542932380783614:3273] connected; active server actors: 1
2025-11-03T16:52:02.030880Z node 5 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1519: [72075186224037893][rt3.dc1--test-topic] updating configuration. Deleted partitions []. Added partitions [0]
2025-11-03T16:52:02.032485Z node 5 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:971: [72075186224037893][rt3.dc1--test-topic] Discovered subdomain [OwnerId: 72057594046644480, LocalPathId: 1] state, outOfSpace = 0 at RB 72075186224037893
2025-11-03T16:52:02.037902Z node 5 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:140: [72075186224037893][rt3.dc1--test-topic] BALANCER INIT DONE for rt3.dc1--test-topic: (0, 72075186224037892) 
2025-11-03T16:52:02.064063Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2960: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-11-03T16:52:02.070919Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2992: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-11-03T16:52:02.071256Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:787: [PQ: 72075186224037892] no config, start with empty partitions and default config
2025-11-03T16:52:02.071292Z node 6 :PERSQUEUE NOTICE: pq_impl.cpp:913: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-11-03T16:52:02.071328Z node 6 :PERSQUEUE INFO: pq_impl.cpp:612: [PQ: 72075186224037892] doesn't have tx writes info
2025-11-03T16:52:02.072159Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [5:7568542932380783656:2450], now have 1 active actors on pipe
2025-11-03T16:52:02.072198Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [5:7568542932380783613:3272], now have 1 active actors on pipe
2025-11-03T16:52:02.072308Z node 5 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:404: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 6, Generation 1
2025-11-03T16:52:02.076580Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-03T16:52:02.091464Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-03T16:52:02.111588Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [5:7568542932380783689:3330], now have 1 active actors on pipe
2025-11-03T16:52:02.111928Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-03T16:52:02.136950Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-03T16:52:02.138136Z node 6 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-11-03T16:52:02.138195Z node 6 :PERSQUEUE DEBUG: partition.cpp:1312: [72075186224037892][Partition][0][StateInit] HandleOnInit TEvPQ::TEvProposePartitionConfig
2025-11-03T16:52:02.138575Z node 6 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-11-03T16:52:02.138847Z node 6 :PERSQUEUE INFO: partition_init.cpp:1101: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [6:7568542934045272677:2380]
2025-11-03T16:52:02.146050Z node 6 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-11-03T16:52:02.146101Z node 6 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-11-03T16:52:02.146132Z node 6 :PERSQUEUE INFO: partition.cpp:707: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1 [6:7568542934045272677:2380]
2025-11-03T16:52:02.146166Z node 6 :PERSQUEUE DEBUG: partition.cpp:727: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 0 Head Offset 0 PartNo 0 PackedSize 0 count 0 nextOffset 0 batches 0
2025-11-03T16:52:02.146211Z node 6 :PERSQUEUE DEBUG: partition_mlp.cpp:83: [72075186224037892][Partition][0][StateIdle] Initializing MLP Consumers: 0
2025-11-03T16:52:02.147904Z node 6 :PERSQUEUE DEBUG: partition.cpp:4273: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 1
2025-11-03T16:52:02.147950Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:02.148080Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:02.148095Z node 6 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-03T16:52:02.148119Z node 6 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-11-03T16:52:02.148136Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:02.148152Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:02.148164Z node 6 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-11-03T16:52:02.148200Z node 6 :PERSQUEUE DEBUG: partition_read.cpp:923: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-11-03T16:52:02.148242Z node 6 :PERSQUEUE DEBUG: partition_mlp.cpp:60: [72075186224037892][Partition][0][StateIdle] Process MLP pending events. Count 0
2025-11-03T16:52:02.156183Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-03T16:52:02.156449Z node 6 :PERSQUEUE DEBUG: partition_compaction.cpp:183: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:52:02.177057Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-03T16:52:02.177255Z node 6 :PERSQUEUE DEBUG: partition.cpp:1416: [72075186224037892][Partition][0][StateIdle] Handle TEvPQ::TEvTxCommit Step 1762188722140, TxId 281474976710672
2025-11-03T16:52:02.177290Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:02.177312Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:02.177492Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:02.177775Z node 6 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-03T16:52:02.190385Z node 6 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-03T16:52:02.190643Z node 6 :PERSQUEUE DEBUG: partition_mlp.cpp:83: [72075186224037892][Partition][0][StateIdle] Initializing MLP Consumers: 0
2025-11-03T16:52:02.190804Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-11-03T16:52:02.190837Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:02.190852Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:02.190872Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:02.190912Z node 6 :PERSQUEUE DEBUG: partition_compaction.cpp:183: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:52:02.191359Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:398: [PQ: 72075186224037892] Apply new config PartitionConfig { LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 } PartitionIds: 0 TopicName: "rt3.dc1--test-topic" Version: 0 LocalDC: true Codecs { Ids: 0 Ids: 1 Ids: 2 Codecs: "raw" Codecs: "gzip" Codecs: "lzop" } TopicPath: "/Root/PQ/rt3.dc1--test-topic" YcCloudId: "" YcFolderId: "" YdbDatabaseId: "" YdbDatabasePath: "/Root" Partitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } AllPartitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } Consumers { Name: "user" ReadFromTimestampsMs: 0 FormatVersion: 0 Version: 0 Generation: 0 } MonitoringProjectId: ""
2025-11-03T16:52:02.191473Z node 6 :PERSQUEUE NOTICE: pq_impl.cpp:913: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-11-03T16:52:02.200535Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-03T16:52:02.233633Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-03T16:52:02.233751Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-03T16:52:02.248740Z node 5 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976710673. Ctx: { TraceId: 01k95a3zvd02t678gva4x4yqtd, Database: , SessionId: ydb://session/3?node_id=5&id=NzUxM2M4NmMtOWZlYTFkNjQtZjkxNzk3ZS03NWQyZTVjYw==, PoolId: default, DatabaseId: /Root}. Database not set, use /Root
2025-11-03T16:52:02.249116Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-03T16:52:02.252318Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:02.252353Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:02.252371Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
===Query complete
TClient::Ls request: /Root/PQ/rt3.dc1--test-topic
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976710672
    CreateStep: 1762188722140
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts...
(TRUNCATED)
GetTopicVersionFromPath:  record Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976710672
    CreateStep: 1762188722140
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      YdbDatabasePath: "/Root"
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
    Partitions {
      PartitionId: 0
      TabletId: 72075186224037892
      Status: Active
    }
    AlterVersion: 1
    BalancerTabletID: 72075186224037893
    NextPartitionId: 1
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 1
      PlanResolution: 7
      Coordinators: 72057594046316545
      TimeCastBucketsPerMediator: 2
      Mediators: 72057594046382081
    }
    DomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    PathsInside: 12
    PathsLimit: 10000
    ShardsInside: 6
    ShardsLimit: 200000
    ResourcesDomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    DiskSpaceUsage {
      Tables {
        TotalSize: 672
        DataSize: 672
        IndexSize: 0
      }
      Topics {
        ReserveSize: 0
        AccountSize: 0
        DataSize: 0
        UsedReserveSize: 0
      }
    }
    PQPartitionsInside: 1
    PQPartitionsLimit: 1000000
    SchemeLimits {
      MaxDepth: 32
      MaxPaths: 10000
      MaxChildrenInDir: 100000
      MaxAclBytesSize: 10240
      MaxTableColumns: 200
      MaxTableColumnNameLength: 255
      MaxTableKeyColumns: 30
      MaxTableIndices: 20
      MaxShards: 200000
      MaxShardsInPath: 35000
      MaxConsistentCopyTargets: 10000
      MaxPathElementLength: 255
      ExtraPathSymbolsAllowed: "!\"#$%&\'()*+,-.:;<=>?@[\\]^_`{|}~"
      MaxPQPartitions: 1000000
      MaxTableCdcStreams: 5
      MaxExports: 10
      MaxImports: 10
      MaxColumnTableColumns: 10000
    }
  }
}
Path: "/Root/PQ/rt3.dc1--test-topic"
 name rt3.dc1--test-topic version1
CallPersQueueGRPC request to localhost:62067
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-11-03T16:52:02.301980Z node 5 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
MetaResponse {
  CmdGetTopicMetadataResult {
    TopicInfo {
      Topic: "rt3.dc1--test-topic"
      NumPartitions: 1
      Config {
        PartitionConfig {
          LifetimeSeconds: 86400
          LowWatermark: 8388608
          SourceIdLifetimeSeconds: 86400
          WriteSpeedInBytesPerSecond: 20000000
          BurstSize: 20000000
          SourceIdMaxCounts: 6000000
        }
        Version: 1
        LocalDC: true
        Codecs {
          Ids: 0
          Ids: 1
          Ids: 2
          Codecs: "raw"
          Codecs: "gzip"
          Codecs: "lzop"
        }
        TopicPath: "/Root/PQ/rt3.dc1--test-topic"
        YdbDatabasePath: "/Root"
        Consumers {
          Name: "user"
          ReadFromTimestampsMs: 0
          FormatVersion: 0
          Version: 0
        }
      }
      ErrorCode: OK
    }
  }
}
=== Topic created, have version: 1
2025-11-03T16:52:02.318470Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: try to update token
2025-11-03T16:52:02.328187Z :INFO: [] MessageGroupId [src] SessionId [] Write session: Do CDS request
2025-11-03T16:52:02.328255Z :INFO: [] MessageGroupId [src] SessionId [] Start write session. Will connect to endpoint: localhost:62067
2025-11-03T16:52:02.354903Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src" }
2025-11-03T16:52:02.356449Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:02.356497Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:02.356518Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:02.356827Z node 5 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-11-03T16:52:02.356866Z node 5 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1
2025-11-03T16:52:02.357263Z node 5 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src" }
2025-11-03T16:52:02.357384Z node 5 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1 topic: "test-topic" message_group_id: "src" from ipv6:[::1]:60392
2025-11-03T16:52:02.357403Z node 5 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:60392 proto=v1  topic=test-topic durationSec=0
2025-11-03T16:52:02.357414Z node 5 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-11-03T16:52:02.359262Z node 5 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1 sessionId:  describe result for acl check
2025-11-03T16:52:02.359409Z node 5 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-11-03T16:52:02.359420Z node 5 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-11-03T16:52:02.359431Z node 5 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-11-03T16:52:02.359452Z node 5 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [5:7568542932380783773:2466] (SourceId=src, PreferedPartition=(NULL)) StartKqpSession
2025-11-03T16:52:02.362830Z node 5 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [5:7568542932380783773:2466] (SourceId=src, PreferedPartition=(NULL)) Select from the table
2025-11-03T16:52:02.464194Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:02.464242Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:02.464260Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:02.568115Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:02.568155Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:02.568176Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:02.579061Z node 5 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [5:7568542932380783773:2466] (SourceId=src, PreferedPartition=(NULL)) RequestPQRB
2025-11-03T16:52:02.580270Z node 5 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1655: [72075186224037893][rt3.dc1--test-topic] pipe [5:7568542932380783811:2466] connected; active server actors: 1
2025-11-03T16:52:02.580412Z node 5 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [5:7568542932380783773:2466] (SourceId=src, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=src
2025-11-03T16:52:02.580435Z node 5 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [5:7568542932380783773:2466] (SourceId=src, PreferedPartition=(NULL)) Update the table
2025-11-03T16:52:02.584200Z node 5 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1659: [72075186224037893][rt3.dc1--test-topic] pipe [5:7568542932380783811:2466] disconnected.
2025-11-03T16:52:02.584227Z node 5 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1670: [72075186224037893][rt3.dc1--test-topic] pipe [5:7568542932380783811:2466] disconnected; active server actors: 1
2025-11-03T16:52:02.584251Z node 5 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1695: [72075186224037893][rt3.dc1--test-topic] pipe [5:7568542932380783811:2466] disconnected no session
2025-11-03T16:52:02.668408Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:02.668450Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:02.668470Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:02.742151Z node 5 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [5:7568542932380783773:2466] (SourceId=src, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-11-03T16:52:02.742196Z node 5 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [5:7568542932380783773:2466] (SourceId=src, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-11-03T16:52:02.742216Z node 5 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [5:7568542932380783773:2466] (SourceId=src, PreferedPartition=(NULL)) Start idle
2025-11-03T16:52:02.742253Z node 5 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-11-03T16:52:02.744965Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [5:7568542932380783841:2466], now have 1 active actors on pipe
2025-11-03T16:52:02.745179Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 6, Generation: 1
2025-11-03T16:52:02.749038Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:02.749106Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:02.749222Z node 6 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src|99aefa2c-c9048ad3-df684b28-538d5153_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src
2025-11-03T16:52:02.749274Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:02.749305Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:02.749323Z node 6 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-03T16:52:02.749374Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:02.749426Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-03T16:52:02.749484Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-03T16:52:02.751081Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:02.751113Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:02.751202Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-03T16:52:02.752425Z :INFO: [] MessageGroupId [src] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1762188722752 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-11-03T16:52:02.752559Z :INFO: [] MessageGroupId [src] SessionId [] Write session established. Init response: session_id: "src|99aefa2c-c9048ad3-df684b28-538d5153_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-11-03T16:52:02.751572Z node 5 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1 partition: 0 MaxSeqNo: 0 sessionId: src|99aefa2c-c9048ad3-df684b28-538d5153_0
2025-11-03T16:52:02.754716Z :INFO: [] MessageGroupId [src] SessionId [src|99aefa2c-c9048ad3-df684b28-538d5153_0] Write session: close. Timeout = 0 ms
2025-11-03T16:52:02.754778Z :INFO: [] MessageGroupId [src] SessionId [src|99aefa2c-c9048ad3-df684b28-538d5153_0] Write session will now close
2025-11-03T16:52:02.754836Z :DEBUG: [] MessageGroupId [src] SessionId [src|99aefa2c-c9048ad3-df684b28-538d5153_0] Write session: aborting
2025-11-03T16:52:02.755686Z :INFO: [] MessageGroupId [src] SessionId [src|99aefa2c-c9048ad3-df684b28-538d5153_0] Write session: gracefully shut down, all writes complete
2025-11-03T16:52:02.755732Z :DEBUG: [] MessageGroupId [src] SessionId [src|99aefa2c-c9048ad3-df684b28-538d5153_0] Write session is aborting and will not restart
2025-11-03T16:52:02.755785Z :DEBUG: [] MessageGroupId [src] SessionId [src|99aefa2c-c9048ad3-df684b28-538d5153_0] Write session: destroy
2025-11-03T16:52:02.759712Z node 5 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId: src|99aefa2c-c9048ad3-df684b28-538d5153_0 grpc read done: success: 0 data: 
2025-11-03T16:52:02.759734Z node 5 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 1 sessionId: src|99aefa2c-c9048ad3-df684b28-538d5153_0 grpc read failed
2025-11-03T16:52:02.759763Z node 5 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 1 sessionId: src|99aefa2c-c9048ad3-df684b28-538d5153_0 grpc closed
2025-11-03T16:52:02.759782Z node 5 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1 sessionId: src|99aefa2c-c9048ad3-df684b28-538d5153_0 is DEAD
2025-11-03T16:52:02.760552Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-11-03T16:52:02.761285Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [5:7568542932380783841:2466] destroyed
2025-11-03T16:52:02.761344Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-11-03T16:52:02.761384Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:02.761401Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:02.761418Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:02.776111Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:02.776135Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:02.776154Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:02.860409Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [] Write session: try to update token
2025-11-03T16:52:02.866414Z :INFO: [/Root] MessageGroupId [src_id] SessionId [] Write session: Do CDS request
2025-11-03T16:52:02.866481Z :INFO: [/Root] MessageGroupId [src_id] SessionId [] Start write session. Will connect to endpoint: localhost:62067
2025-11-03T16:52:02.875248Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:02.875285Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:02.875304Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:02.917097Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-11-03T16:52:02.917829Z node 5 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-11-03T16:52:02.917865Z node 5 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2
2025-11-03T16:52:02.918387Z node 5 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-11-03T16:52:02.918490Z node 5 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:60422
2025-11-03T16:52:02.918504Z node 5 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:60422 proto=v1  topic=test-topic durationSec=0
2025-11-03T16:52:02.918514Z node 5 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-11-03T16:52:02.919781Z node 5 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2 sessionId:  describe result for acl check
2025-11-03T16:52:02.919899Z node 5 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-11-03T16:52:02.919912Z node 5 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-11-03T16:52:02.919924Z node 5 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-11-03T16:52:02.919944Z node 5 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [5:7568542932380783874:2490] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-11-03T16:52:02.923050Z node 5 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [5:7568542932380783874:2490] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-11-03T16:52:02.934001Z node 5 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [5:7568542932380783874:2490] (SourceId=src_id, PreferedPartition=(NULL)) RequestPQRB
2025-11-03T16:52:02.936274Z node 5 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1655: [72075186224037893][rt3.dc1--test-topic] pipe [5:7568542932380783894:2490] connected; active server actors: 1
2025-11-03T16:52:02.936380Z node 5 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [5:7568542932380783874:2490] (SourceId=src_id, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=src_id
2025-11-03T16:52:02.936399Z node 5 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [5:7568542932380783874:2490] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-11-03T16:52:02.937800Z node 5 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1659: [72075186224037893][rt3.dc1--test-topic] pipe [5:7568542932380783894:2490] disconnected.
2025-11-03T16:52:02.937824Z node 5 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1670: [72075186224037893][rt3.dc1--test-topic] pipe [5:7568542932380783894:2490] disconnected; active server actors: 1
2025-11-03T16:52:02.937845Z node 5 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1695: [72075186224037893][rt3.dc1--test-topic] pipe [5:7568542932380783894:2490] disconnected no session
2025-11-03T16:52:02.958922Z node 5 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [5:7568542932380783874:2490] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-11-03T16:52:02.958966Z node 5 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [5:7568542932380783874:2490] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-11-03T16:52:02.958985Z node 5 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [5:7568542932380783874:2490] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-11-03T16:52:02.959020Z node 5 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-11-03T16:52:02.964679Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 6, Generation: 1
2025-11-03T16:52:02.964567Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [5:7568542932380783911:2490], now have 1 active actors on pipe
2025-11-03T16:52:02.968425Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:02.968481Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:02.968577Z node 6 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|66942439-cc3799b0-f098c35b-1958637c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-11-03T16:52:02.968617Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:02.968635Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:02.968649Z node 6 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-03T16:52:02.968696Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:02.968739Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-03T16:52:02.968792Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-03T16:52:02.972393Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:02.972425Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:02.972504Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-03T16:52:02.974056Z :INFO: [/Root] MessageGroupId [src_id] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1762188722974 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-11-03T16:52:02.974183Z :INFO: [/Root] MessageGroupId [src_id] SessionId [] Write session established. Init response: session_id: "src_id|66942439-cc3799b0-f098c35b-1958637c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-11-03T16:52:02.972942Z node 5 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2 partition: 0 MaxSeqNo: 0 sessionId: src_id|66942439-cc3799b0-f098c35b-1958637c_0
2025-11-03T16:52:02.975699Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:02.975729Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:02.975746Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:02.976554Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write 1 messages with Id from 1 to 1
2025-11-03T16:52:02.976713Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session: try to update token
2025-11-03T16:52:02.976765Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Send 1 message(s) (0 left), first sequence number is 1
2025-11-03T16:52:02.977101Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write 1 messages with Id from 2 to 2
2025-11-03T16:52:02.977151Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session: try to update token
2025-11-03T16:52:02.977176Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Send 1 message(s) (0 left), first sequence number is 2
2025-11-03T16:52:02.977224Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write 1 messages with Id from 3 to 3
2025-11-03T16:52:02.977261Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session: try to update token
2025-11-03T16:52:02.977280Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Send 1 message(s) (0 left), first sequence number is 3
2025-11-03T16:52:02.977315Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write 1 messages with Id from 4 to 4
2025-11-03T16:52:02.977354Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session: try to update token
2025-11-03T16:52:02.977372Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Send 1 message(s) (0 left), first sequence number is 4
2025-11-03T16:52:02.977406Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write 1 messages with Id from 5 to 5
2025-11-03T16:52:02.977435Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session: try to update token
2025-11-03T16:52:02.977456Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Send 1 message(s) (0 left), first sequence number is 5
2025-11-03T16:52:02.977490Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write 1 messages with Id from 6 to 6
2025-11-03T16:52:02.977534Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session: try to update token
2025-11-03T16:52:02.977555Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Send 1 message(s) (0 left), first sequence number is 6
2025-11-03T16:52:02.977590Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write 1 messages with Id from 7 to 7
2025-11-03T16:52:02.977623Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session: try to update token
2025-11-03T16:52:02.977645Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Send 1 message(s) (0 left), first sequence number is 7
2025-11-03T16:52:02.977685Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write 1 messages with Id from 8 to 8
2025-11-03T16:52:02.977716Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session: try to update token
2025-11-03T16:52:02.977733Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Send 1 message(s) (0 left), first sequence number is 8
2025-11-03T16:52:02.977769Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write 1 messages with Id from 9 to 9
2025-11-03T16:52:02.977799Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session: try to update token
2025-11-03T16:52:02.977819Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Send 1 message(s) (0 left), first sequence number is 9
2025-11-03T16:52:02.977853Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write 1 messages with Id from 10 to 10
2025-11-03T16:52:02.977886Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session: try to update token
2025-11-03T16:52:02.977903Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Send 1 message(s) (0 left), first sequence number is 10
2025-11-03T16:52:02.977938Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write 1 messages with Id from 11 to 11
2025-11-03T16:52:02.977967Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session: try to update token
2025-11-03T16:52:02.977986Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Send 1 message(s) (0 left), first sequence number is 11
2025-11-03T16:52:02.978018Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write 1 messages with Id from 12 to 12
2025-11-03T16:52:02.978052Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session: try to update token
2025-11-03T16:52:02.978069Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Send 1 message(s) (0 left), first sequence number is 12
2025-11-03T16:52:02.978103Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write 1 messages with Id from 13 to 13
2025-11-03T16:52:02.978142Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session: try to update token
2025-11-03T16:52:02.978162Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Send 1 message(s) (0 left), first sequence number is 13
2025-11-03T16:52:02.978195Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write 1 messages with Id from 14 to 14
2025-11-03T16:52:02.978227Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session: try to update token
2025-11-03T16:52:02.978247Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Send 1 message(s) (0 left), first sequence number is 14
2025-11-03T16:52:02.978282Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write 1 messages with Id from 15 to 15
2025-11-03T16:52:02.978312Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session: try to update token
2025-11-03T16:52:02.978332Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Send 1 message(s) (0 left), first sequence number is 15
2025-11-03T16:52:02.978375Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write 1 messages with Id from 16 to 16
2025-11-03T16:52:02.978410Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session: try to update token
2025-11-03T16:52:02.978430Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Send 1 message(s) (0 left), first sequence number is 16
2025-11-03T16:52:02.978466Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write 1 messages with Id from 17 to 17
2025-11-03T16:52:02.978505Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session: try to update token
2025-11-03T16:52:02.978526Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Send 1 message(s) (0 left), first sequence number is 17
2025-11-03T16:52:02.978585Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write 1 messages with Id from 18 to 18
2025-11-03T16:52:02.978621Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session: try to update token
2025-11-03T16:52:02.978641Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Send 1 message(s) (0 left), first sequence number is 18
2025-11-03T16:52:02.978686Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write 1 messages with Id from 19 to 19
2025-11-03T16:52:02.978724Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session: try to update token
2025-11-03T16:52:02.978743Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Send 1 message(s) (0 left), first sequence number is 19
2025-11-03T16:52:02.978781Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write 1 messages with Id from 20 to 20
2025-11-03T16:52:02.978816Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session: try to update token
2025-11-03T16:52:02.978834Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Send 1 message(s) (0 left), first sequence number is 20
2025-11-03T16:52:02.978865Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write 1 messages with Id from 21 to 21
2025-11-03T16:52:02.978907Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session: try to update token
2025-11-03T16:52:02.978925Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Send 1 message(s) (0 left), first sequence number is 21
2025-11-03T16:52:02.978957Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write 1 messages with Id from 22 to 22
2025-11-03T16:52:02.978989Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session: try to update token
2025-11-03T16:52:02.979010Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Send 1 message(s) (0 left), first sequence number is 22
2025-11-03T16:52:02.979046Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write 1 messages with Id from 23 to 23
2025-11-03T16:52:02.979077Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session: try to update token
2025-11-03T16:52:02.979097Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Send 1 message(s) (0 left), first sequence number is 23
2025-11-03T16:52:02.979130Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write 1 messages with Id from 24 to 24
2025-11-03T16:52:02.979167Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session: try to update token
2025-11-03T16:52:02.979189Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Send 1 message(s) (0 left), first sequence number is 24
2025-11-03T16:52:02.979230Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write 1 messages with Id from 25 to 25
2025-11-03T16:52:02.979262Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session: try to update token
2025-11-03T16:52:02.979281Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Send 1 message(s) (0 left), first sequence number is 25
2025-11-03T16:52:02.979321Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write 1 messages with Id from 26 to 26
2025-11-03T16:52:02.979359Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session: try to update token
2025-11-03T16:52:02.979381Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Send 1 message(s) (0 left), first sequence number is 26
2025-11-03T16:52:02.979424Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write 1 messages with Id from 27 to 27
2025-11-03T16:52:02.979460Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session: try to update token
2025-11-03T16:52:02.979480Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Send 1 message(s) (0 left), first sequence number is 27
2025-11-03T16:52:02.982469Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write 1 messages with Id from 28 to 28
2025-11-03T16:52:02.982564Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session: try to update token
2025-11-03T16:52:02.982590Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Send 1 message(s) (0 left), first sequence number is 28
2025-11-03T16:52:02.982970Z node 5 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|66942439-cc3799b0-f098c35b-1958637c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:52:02.983290Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:52:02.984104Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:02.984153Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:02.984282Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-11-03T16:52:02.984637Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write 1 messages with Id from 29 to 29
2025-11-03T16:52:02.984708Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session: try to update token
2025-11-03T16:52:02.984734Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Send 1 message(s) (0 left), first sequence number is 29
2025-11-03T16:52:02.984776Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write 1 messages with Id from 30 to 30
2025-11-03T16:52:02.984818Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session: try to update token
2025-11-03T16:52:02.984840Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Send 1 message(s) (0 left), first sequence number is 30
2025-11-03T16:52:02.984879Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write 1 messages with Id from 31 to 31
2025-11-03T16:52:02.984916Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session: try to update token
2025-11-03T16:52:02.984937Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Send 1 message(s) (0 left), first sequence number is 31
2025-11-03T16:52:02.984976Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write 1 messages with Id from 32 to 32
2025-11-03T16:52:02.985017Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session: try to update token
2025-11-03T16:52:02.985042Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Send 1 message(s) (0 left), first sequence number is 32
2025-11-03T16:52:02.985081Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write 1 messages with Id from 33 to 33
2025-11-03T16:52:02.985122Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session: try to update token
2025-11-03T16:52:02.985188Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Send 1 message(s) (0 left), first sequence number is 33
2025-11-03T16:52:02.985229Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write 1 messages with Id from 34 to 34
2025-11-03T16:52:02.984685Z node 5 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|66942439-cc3799b0-f098c35b-1958637c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:52:02.984747Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:02.985288Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session: try to update token
2025-11-03T16:52:02.985089Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:52:02.985312Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Send 1 message(s) (0 left), first sequence number is 34
2025-11-03T16:52:02.985353Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write 1 messages with Id from 35 to 35
2025-11-03T16:52:02.985389Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session: try to update token
2025-11-03T16:52:02.985409Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Send 1 message(s) (0 left), first sequence number is 35
2025-11-03T16:52:02.985470Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write 1 messages with Id from 36 to 36
2025-11-03T16:52:02.985508Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session: try to update token
2025-11-03T16:52:02.985528Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Send 1 message(s) (0 left), first sequence number is 36
2025-11-03T16:52:02.985562Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write 1 messages with Id from 37 to 37
2025-11-03T16:52:02.985601Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session: try to update token
2025-11-03T16:52:02.985620Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Send 1 message(s) (0 left), first sequence number is 37
2025-11-03T16:52:02.985676Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write 1 messages with Id from 38 to 38
2025-11-03T16:52:02.985712Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session: try to update token
2025-11-03T16:52:02.985732Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Send 1 message(s) (0 left), first sequence number is 38
2025-11-03T16:52:02.985765Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write 1 messages with Id from 39 to 39
2025-11-03T16:52:02.985798Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session: try to update token
2025-11-03T16:52:02.985819Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Send 1 message(s) (0 left), first sequence number is 39
2025-11-03T16:52:02.985857Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write 1 messages with Id from 40 to 40
2025-11-03T16:52:02.985897Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session: try to update token
2025-11-03T16:52:02.985917Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Send 1 message(s) (0 left), first sequence number is 40
2025-11-03T16:52:02.985949Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write 1 messages with Id from 41 to 41
2025-11-03T16:52:02.986008Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session: try to update token
2025-11-03T16:52:02.986028Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Send 1 message(s) (0 left), first sequence number is 41
2025-11-03T16:52:02.986064Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write 1 messages with Id from 42 to 42
2025-11-03T16:52:02.986138Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session: try to update token
2025-11-03T16:52:02.986159Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Send 1 message(s) (0 left), first sequence number is 42
2025-11-03T16:52:02.986192Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write 1 messages with Id from 43 to 43
2025-11-03T16:52:02.986268Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session: try to update token
2025-11-03T16:52:02.986287Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Send 1 message(s) (0 left), first sequence number is 43
2025-11-03T16:52:02.986325Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write 1 messages with Id from 44 to 44
2025-11-03T16:52:02.986384Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session: try to update token
2025-11-03T16:52:02.986406Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Send 1 message(s) (0 left), first sequence number is 44
2025-11-03T16:52:02.986460Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write 1 messages with Id from 45 to 45
2025-11-03T16:52:02.986498Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session: try to update token
2025-11-03T16:52:02.986537Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Send 1 message(s) (0 left), first sequence number is 45
2025-11-03T16:52:02.986594Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write 1 messages with Id from 46 to 46
2025-11-03T16:52:02.986633Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session: try to update token
2025-11-03T16:52:02.986651Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Send 1 message(s) (0 left), first sequence number is 46
2025-11-03T16:52:02.986686Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write 1 messages with Id from 47 to 47
2025-11-03T16:52:02.986740Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session: try to update token
2025-11-03T16:52:02.986762Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Send 1 message(s) (0 left), first sequence number is 47
2025-11-03T16:52:02.986806Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write 1 messages with Id from 48 to 48
2025-11-03T16:52:02.986847Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session: try to update token
2025-11-03T16:52:02.986866Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Send 1 message(s) (0 left), first sequence number is 48
2025-11-03T16:52:02.986899Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write 1 messages with Id from 49 to 49
2025-11-03T16:52:02.986934Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session: try to update token
2025-11-03T16:52:02.986955Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Send 1 message(s) (0 left), first sequence number is 49
2025-11-03T16:52:02.986995Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write 1 messages with Id from 50 to 50
2025-11-03T16:52:02.987030Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session: try to update token
2025-11-03T16:52:02.987051Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Send 1 message(s) (0 left), first sequence number is 50
2025-11-03T16:52:02.987083Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write 1 messages with Id from 51 to 51
2025-11-03T16:52:02.987115Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session: try to update token
2025-11-03T16:52:02.987134Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Send 1 message(s) (0 left), first sequence number is 51
2025-11-03T16:52:02.987170Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write 1 messages with Id from 52 to 52
2025-11-03T16:52:02.987205Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session: try to update token
2025-11-03T16:52:02.987231Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Send 1 message(s) (0 left), first sequence number is 52
2025-11-03T16:52:02.987276Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write 1 messages with Id from 53 to 53
2025-11-03T16:52:02.987314Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session: try to update token
2025-11-03T16:52:02.987335Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Send 1 message(s) (0 left), first sequence number is 53
2025-11-03T16:52:02.987371Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write 1 messages with Id from 54 to 54
2025-11-03T16:52:02.987407Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session: try to update token
2025-11-03T16:52:02.987428Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Send 1 message(s) (0 left), first sequence number is 54
2025-11-03T16:52:02.987466Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write 1 messages with Id from 55 to 55
2025-11-03T16:52:02.987501Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session: try to update token
2025-11-03T16:52:02.987522Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Send 1 message(s) (0 left), first sequence number is 55
2025-11-03T16:52:02.987696Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write 1 messages with Id from 56 to 56
2025-11-03T16:52:02.987739Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session: try to update token
2025-11-03T16:52:02.987763Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Send 1 message(s) (0 left), first sequence number is 56
2025-11-03T16:52:02.987803Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write 1 messages with Id from 57 to 57
2025-11-03T16:52:02.987840Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session: try to update token
2025-11-03T16:52:02.987861Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Send 1 message(s) (0 left), first sequence number is 57
2025-11-03T16:52:02.987896Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write 1 messages with Id from 58 to 58
2025-11-03T16:52:02.987936Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session: try to update token
2025-11-03T16:52:02.987955Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Send 1 message(s) (0 left), first sequence number is 58
2025-11-03T16:52:02.988013Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write 1 messages with Id from 59 to 59
2025-11-03T16:52:02.988063Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session: try to update token
2025-11-03T16:52:02.988088Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Send 1 message(s) (0 left), first sequence number is 59
2025-11-03T16:52:02.988129Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write 1 messages with Id from 60 to 60
2025-11-03T16:52:02.988167Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session: try to update token
2025-11-03T16:52:02.988203Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Send 1 message(s) (0 left), first sequence number is 60
2025-11-03T16:52:02.988245Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write 1 messages with Id from 61 to 61
2025-11-03T16:52:02.988293Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session: try to update token
2025-11-03T16:52:02.988318Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Send 1 message(s) (0 left), first sequence number is 61
2025-11-03T16:52:02.988358Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write 1 messages with Id from 62 to 62
2025-11-03T16:52:02.988392Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session: try to update token
2025-11-03T16:52:02.988410Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Send 1 message(s) (0 left), first sequence number is 62
2025-11-03T16:52:02.988447Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write 1 messages with Id from 63 to 63
2025-11-03T16:52:02.988484Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session: try to update token
2025-11-03T16:52:02.988504Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Send 1 message(s) (0 left), first sequence number is 63
2025-11-03T16:52:02.988544Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write 1 messages with Id from 64 to 64
2025-11-03T16:52:02.988581Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session: try to update token
2025-11-03T16:52:02.988600Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Send 1 message(s) (0 left), first sequence number is 64
2025-11-03T16:52:02.988636Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write 1 messages with Id from 65 to 65
2025-11-03T16:52:02.988707Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session: try to update token
2025-11-03T16:52:02.988745Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Send 1 message(s) (0 left), first sequence number is 65
2025-11-03T16:52:02.988788Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write 1 messages with Id from 66 to 66
2025-11-03T16:52:02.988822Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session: try to update token
2025-11-03T16:52:02.988841Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Send 1 message(s) (0 left), first sequence number is 66
2025-11-03T16:52:02.988876Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write 1 messages with Id from 67 to 67
2025-11-03T16:52:02.988904Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session: try to update token
2025-11-03T16:52:02.988923Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Send 1 message(s) (0 left), first sequence number is 67
2025-11-03T16:52:02.988966Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write 1 messages with Id from 68 to 68
2025-11-03T16:52:02.989001Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session: try to update token
2025-11-03T16:52:02.989021Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Send 1 message(s) (0 left), first sequence number is 68
2025-11-03T16:52:02.989058Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write 1 messages with Id from 69 to 69
2025-11-03T16:52:02.989088Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session: try to update token
2025-11-03T16:52:02.989106Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Send 1 message(s) (0 left), first sequence number is 69
2025-11-03T16:52:02.989161Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write 1 messages with Id from 70 to 70
2025-11-03T16:52:02.989213Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session: try to update token
2025-11-03T16:52:02.989232Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Send 1 message(s) (0 left), first sequence number is 70
2025-11-03T16:52:02.989266Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write 1 messages with Id from 71 to 71
2025-11-03T16:52:02.989297Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session: try to update token
2025-11-03T16:52:02.989314Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Send 1 message(s) (0 left), first sequence number is 71
2025-11-03T16:52:02.989347Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write 1 messages with Id from 72 to 72
2025-11-03T16:52:02.989379Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session: try to update token
2025-11-03T16:52:02.989398Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Send 1 message(s) (0 left), first sequence number is 72
2025-11-03T16:52:02.989431Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write 1 messages with Id from 73 to 73
2025-11-03T16:52:02.989490Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session: try to update token
2025-11-03T16:52:02.989533Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Send 1 message(s) (0 left), first sequence number is 73
2025-11-03T16:52:02.989594Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write 1 messages with Id from 74 to 74
2025-11-03T16:52:02.989635Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session: try to update token
2025-11-03T16:52:02.989655Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Send 1 message(s) (0 left), first sequence number is 74
2025-11-03T16:52:02.989696Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write 1 messages with Id from 75 to 75
2025-11-03T16:52:02.989933Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session: try to update token
2025-11-03T16:52:02.989957Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Send 1 message(s) (0 left), first sequence number is 75
2025-11-03T16:52:02.990015Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write 1 messages with Id from 76 to 76
2025-11-03T16:52:02.990079Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session: try to update token
2025-11-03T16:52:02.990101Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Send 1 message(s) (0 left), first sequence number is 76
2025-11-03T16:52:02.990149Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write 1 messages with Id from 77 to 77
2025-11-03T16:52:02.990203Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session: try to update token
2025-11-03T16:52:02.990223Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Send 1 message(s) (0 left), first sequence number is 77
2025-11-03T16:52:02.990257Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write 1 messages with Id from 78 to 78
2025-11-03T16:52:02.990309Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session: try to update token
2025-11-03T16:52:02.990331Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Send 1 message(s) (0 left), first sequence number is 78
2025-11-03T16:52:02.990364Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write 1 messages with Id from 79 to 79
2025-11-03T16:52:02.990414Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session: try to update token
2025-11-03T16:52:02.988688Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:02.990434Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Send 1 message(s) (0 left), first sequence number is 79
2025-11-03T16:52:02.988743Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:02.990473Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write 1 messages with Id from 80 to 80
2025-11-03T16:52:02.989103Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 1 partNo : 0 messageNo: 1 size 80 offset: -1
2025-11-03T16:52:02.990506Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session: try to update token
2025-11-03T16:52:02.989175Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:02.990524Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Send 1 message(s) (0 left), first sequence number is 80
2025-11-03T16:52:02.989191Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:02.990579Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write 1 messages with Id from 81 to 81
2025-11-03T16:52:02.989239Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:52:02.990609Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session: try to update token
2025-11-03T16:52:02.989288Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:02.990653Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Send 1 message(s) (0 left), first sequence number is 81
2025-11-03T16:52:02.989317Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:02.989329Z node 6 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-03T16:52:02.990717Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write 1 messages with Id from 82 to 82
2025-11-03T16:52:02.989433Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 1 partNo 0
2025-11-03T16:52:02.990753Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session: try to update token
2025-11-03T16:52:02.990815Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Send 1 message(s) (0 left), first sequence number is 82
2025-11-03T16:52:02.990860Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write 1 messages with Id from 83 to 83
2025-11-03T16:52:02.990891Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session: try to update token
2025-11-03T16:52:02.990278Z node 5 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|66942439-cc3799b0-f098c35b-1958637c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:52:02.990613Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:52:02.991106Z node 5 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|66942439-cc3799b0-f098c35b-1958637c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:52:02.991270Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:52:02.991583Z node 5 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|66942439-cc3799b0-f098c35b-1958637c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:52:02.991719Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:52:02.992015Z node 5 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|66942439-cc3799b0-f098c35b-1958637c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:52:02.992161Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:52:02.992456Z node 5 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|66942439-cc3799b0-f098c35b-1958637c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:52:02.992669Z node 5 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|66942439-cc3799b0-f098c35b-1958637c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:52:02.991282Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 1 partNo 0 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 154 count 1 nextOffset 1 batches 1
2025-11-03T16:52:02.991341Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:02.991856Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 0,1 HeadOffset 0 endOffset 0 curOffset 1 d0000000000_00000000000000000000_00000_0000000001_00000? size 140 WTime 1762188722988
2025-11-03T16:52:02.992053Z node 6 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-03T16:52:02.992170Z node 6 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 0 partNo 0 count 1 size 140
2025-11-03T16:52:02.992222Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 2  requestId: <none> cookie: 2
2025-11-03T16:52:02.994256Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:02.994290Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:02.994343Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:02.994354Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:02.994380Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:02.994391Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:02.994415Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:02.994425Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:02.994500Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 3  requestId: <none> cookie: 3
2025-11-03T16:52:02.994536Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 4  requestId: <none> cookie: 4
2025-11-03T16:52:02.994567Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 5  requestId: <none> cookie: 5
2025-11-03T16:52:02.994582Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 6  requestId: <none> cookie: 6
2025-11-03T16:52:02.997251Z node 5 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|66942439-cc3799b0-f098c35b-1958637c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:52:02.997336Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:02.997404Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:02.997435Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:02.997464Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:02.997560Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:02.998248Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:52:02.998321Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:52:02.998371Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:52:02.999734Z node 5 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|66942439-cc3799b0-f098c35b-1958637c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:52:02.999969Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:52:03.000480Z node 5 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|66942439-cc3799b0-f098c35b-1958637c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:52:03.000648Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:52:03.001076Z node 5 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|66942439-cc3799b0-f098c35b-1958637c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:52:03.001331Z node 5 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|66942439-cc3799b0-f098c35b-1958637c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:52:03.001520Z node 5 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|66942439-cc3799b0-f098c35b-1958637c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:52:03.000788Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:03.000824Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:03.000880Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 2 partNo : 0 messageNo: 7 size 88 offset: -1
2025-11-03T16:52:03.000934Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:03.000947Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:03.000968Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 3 partNo : 0 messageNo: 8 size 96 offset: -1
2025-11-03T16:52:03.001030Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:03.001043Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:03.001067Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 4 partNo : 0 messageNo: 9 size 104 offset: -1
2025-11-03T16:52:03.001124Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:03.001140Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:03.001160Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 5 partNo : 0 messageNo: 10 size 112 offset: -1
2025-11-03T16:52:03.001199Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:03.001208Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:03.001227Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 6 partNo : 0 messageNo: 11 size 120 offset: -1
2025-11-03T16:52:03.001252Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:03.001262Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:03.001290Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:03.001303Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:03.001326Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:03.001335Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:03.001358Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:03.001365Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:03.001392Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:52:03.001444Z node 6 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:52:03.001459Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:52:03.001475Z node 6 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:52:03.001497Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:03.001505Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:03.001519Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:52:03.001533Z node 6 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:52:03.001543Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:52:03.001561Z node 6 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:52:03.001573Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:52:03.001974Z node 5 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|66942439-cc3799b0-f098c35b-1958637c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:52:03.002017Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:03.002067Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:03.002094Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:03.002120Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:03.002145Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:03.002536Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:52:03.002603Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:52:03.002635Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:52:03.002673Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:52:03.003714Z node 5 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|66942439-cc3799b0-f098c35b-1958637c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:52:03.003872Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:52:03.004579Z node 5 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|66942439-cc3799b0-f098c35b-1958637c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:52:03.004945Z node 5 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|66942439-cc3799b0-f098c35b-1958637c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:52:03.005374Z node 5 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|66942439-cc3799b0-f098c35b-1958637c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:52:03.005730Z node 5 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|66942439-cc3799b0-f098c35b-1958637c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:52:03.001586Z node 6 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:52:03.001666Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 12  requestId: <none> cookie: 7
2025-11-03T16:52:03.001712Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 13  requestId: <none> cookie: 8
2025-11-03T16:52:03.001728Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 14  requestId: <none> cookie: 9
2025-11-03T16:52:03.001744Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 15  requestId: <none> cookie: 10
2025-11-03T16:52:03.001759Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 16  requestId: <none> cookie: 11
2025-11-03T16:52:03.007080Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:03.007115Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:03.007174Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 7 partNo : 0 messageNo: 17 size 128 offset: -1
2025-11-03T16:52:03.007231Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:03.007241Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:03.007276Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 8 partNo : 0 messageNo: 18 size 136 offset: -1
2025-11-03T16:52:03.007323Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:03.007349Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:03.007375Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 9 partNo : 0 messageNo: 19 size 144 offset: -1
2025-11-03T16:52:03.007418Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:03.007427Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:03.007454Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 10 partNo : 0 messageNo: 20 size 152 offset: -1
2025-11-03T16:52:03.007499Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:03.007510Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:03.007531Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 11 partNo : 0 messageNo: 21 size 161 offset: -1
2025-11-03T16:52:03.007564Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:03.007575Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:03.007609Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:03.007619Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:03.007647Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:03.007658Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:03.007684Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:03.007696Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:03.007723Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:03.007733Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:03.007769Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:52:03.007830Z node 6 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:52:03.007852Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:52:03.007871Z node 6 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:52:03.007886Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:52:03.007907Z node 6 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:52:03.007920Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:52:03.007934Z node 6 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:52:03.007947Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:52:03.007995Z node 6 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:52:03.008086Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 22  requestId: <none> cookie: 12
2025-11-03T16:52:03.008136Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 23  requestId: <none> cookie: 13
2025-11-03T16:52:03.008151Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 24  requestId: <none> cookie: 14
2025-11-03T16:52:03.008168Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 25  requestId: <none> cookie: 15
2025-11-03T16:52:03.008185Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 26  requestId: <none> cookie: 16
2025-11-03T16:52:03.011282Z node 5 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|66942439-cc3799b0-f098c35b-1958637c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:52:03.011383Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:03.011452Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:03.011506Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:03.011541Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:03.011570Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:03.012198Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:52:03.012259Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:52:03.012290Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:52:03.012321Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:52:03.012362Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:52:03.013420Z node 5 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|66942439-cc3799b0-f098c35b-1958637c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:52:03.013813Z node 5 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|66942439-cc3799b0-f098c35b-1958637c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:52:03.014072Z node 5 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|66942439-cc3799b0-f098c35b-1958637c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:52:03.014331Z node 5 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|66942439-cc3799b0-f098c35b-1958637c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:52:03.014535Z node 5 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|66942439-cc3799b0-f098c35b-1958637c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:52:03.014798Z node 5 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|66942439-cc3799b0-f098c35b-1958637c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:52:03.014990Z node 5 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|66942439-cc3799b0-f098c35b-1958637c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:52:03.015175Z node 5 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|66942439-cc3799b0-f098c35b-1958637c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:52:03.015454Z node 5 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|66942439-cc3799b0-f098c35b-1958637c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:52:03.015684Z node 5 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|66942439-cc3799b0-f098c35b-1958637c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:52:03.015945Z node 5 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|66942439-cc3799b0-f098c35b-1958637c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:52:03.016224Z node 5 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|66942439-cc3799b0-f098c35b-1958637c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:52:03.010431Z node 6 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 0 count 1 size 140 actorID [6:7568542934045272658:2380]
2025-11-03T16:52:03.010497Z node 6 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-03T16:52:03.010575Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 87 WriteNewSizeFromSupportivePartitions# 0
2025-11-03T16:52:03.010616Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:52:03.016492Z node 5 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|66942439-cc3799b0-f098c35b-1958637c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:52:03.010657Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 1, partNo: 0, Offset: 0 is stored on disk
2025-11-03T16:52:03.010865Z node 6 :PERSQUEUE DEBUG: partition_read.cpp:923: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-11-03T16:52:03.010887Z node 6 :PERSQUEUE DEBUG: partition_read.cpp:965: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-11-03T16:52:03.010911Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:03.010968Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:03.010979Z node 6 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (10)
2025-11-03T16:52:03.011079Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 2 partNo 0
2025-11-03T16:52:03.015878Z node 6 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 0 suffix '63' size 140
2025-11-03T16:52:03.016718Z node 5 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|66942439-cc3799b0-f098c35b-1958637c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:52:03.016964Z node 5 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|66942439-cc3799b0-f098c35b-1958637c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:52:03.023160Z node 5 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|66942439-cc3799b0-f098c35b-1958637c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:52:03.023691Z node 5 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|66942439-cc3799b0-f098c35b-1958637c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:52:03.023926Z node 5 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|66942439-cc3799b0-f098c35b-1958637c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:52:03.024184Z node 5 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|66942439-cc3799b0-f098c35b-1958637c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:52:03.024389Z node 5 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|66942439-cc3799b0-f098c35b-1958637c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:52:03.024611Z node 5 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|66942439-cc3799b0-f098c35b-1958637c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:52:03.024905Z node 5 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|66942439-cc3799b0-f098c35b-1958637c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:52:03.025185Z node 5 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|66942439-cc3799b0-f098c35b-1958637c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:52:02.990910Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Send 1 message(s) (0 left), first sequence number is 83
2025-11-03T16:52:03.031395Z node 5 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|66942439-cc3799b0-f098c35b-1958637c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:52:03.032008Z node 5 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|66942439-cc3799b0-f098c35b-1958637c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:52:03.032348Z node 5 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|66942439-cc3799b0-f098c35b-1958637c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:52:03.032576Z node 5 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|66942439-cc3799b0-f098c35b-1958637c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:52:03.033191Z node 5 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|66942439-cc3799b0-f098c35b-1958637c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:52:03.033497Z node 5 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|66942439-cc3799b0-f098c35b-1958637c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:52:03.033850Z node 5 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|66942439-cc3799b0-f098c35b-1958637c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:52:03.034164Z node 5 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|66942439-cc3799b0-f098c35b-1958637c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:52:03.034538Z node 5 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|66942439-cc3799b0-f098c35b-1958637c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:52:03.034820Z node 5 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|66942439-cc3799b0-f098c35b-1958637c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:52:03.035080Z node 5 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|66942439-cc3799b0-f098c35b-1958637c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:52:03.035360Z node 5 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|66942439-cc3799b0-f098c35b-1958637c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:52:03.035610Z node 5 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|66942439-cc3799b0-f098c35b-1958637c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:52:03.035863Z node 5 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|66942439-cc3799b0-f098c35b-1958637c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:52:03.036090Z node 5 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|66942439-cc3799b0-f098c35b-1958637c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:52:03.036374Z node 5 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|66942439-cc3799b0-f098c35b-1958637c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:52:03.036583Z node 5 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|66942439-cc3799b0-f098c35b-1958637c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:52:03.036777Z node 5 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|66942439-cc3799b0-f098c35b-1958637c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:52:03.037034Z node 5 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|66942439-cc3799b0-f098c35b-1958637c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:52:03.037224Z node 5 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|66942439-cc3799b0-f098c35b-1958637c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:52:03.037477Z node 5 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|66942439-cc3799b0-f098c35b-1958637c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:52:03.037687Z node 5 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|66942439-cc3799b0-f098c35b-1958637c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:52:03.038033Z node 5 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|66942439-cc3799b0-f098c35b-1958637c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:52:03.038253Z node 5 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|66942439-cc3799b0-f098c35b-1958637c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:52:03.061319Z node 5 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|66942439-cc3799b0-f098c35b-1958637c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:52:03.061908Z node 5 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|66942439-cc3799b0-f098c35b-1958637c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:52:03.062430Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write 1 messages with Id from 84 to 84
2025-11-03T16:52:03.062515Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session: try to update token
2025-11-03T16:52:03.062571Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Send 1 message(s) (0 left), first sequence number is 84
2025-11-03T16:52:03.062624Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write 1 messages with Id from 85 to 85
2025-11-03T16:52:03.062690Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session: try to update token
2025-11-03T16:52:03.062713Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Send 1 message(s) (0 left), first sequence number is 85
2025-11-03T16:52:03.062752Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write 1 messages with Id from 86 to 86
2025-11-03T16:52:03.062510Z node 5 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|66942439-cc3799b0-f098c35b-1958637c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:52:03.062806Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session: try to update token
2025-11-03T16:52:03.062826Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Send 1 message(s) (0 left), first sequence number is 86
2025-11-03T16:52:03.062885Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write 1 messages with Id from 87 to 87
2025-11-03T16:52:03.062954Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session: try to update token
2025-11-03T16:52:03.062973Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Send 1 message(s) (0 left), first sequence number is 87
2025-11-03T16:52:03.063008Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write 1 messages with Id from 88 to 88
2025-11-03T16:52:03.063061Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session: try to update token
2025-11-03T16:52:03.063081Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Send 1 message(s) (0 left), first sequence number is 88
2025-11-03T16:52:03.062870Z node 5 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|66942439-cc3799b0-f098c35b-1958637c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:52:03.063118Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write 1 messages with Id from 89 to 89
2025-11-03T16:52:03.063153Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session: try to update token
2025-11-03T16:52:03.063172Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Send 1 message(s) (0 left), first sequence number is 89
2025-11-03T16:52:03.063205Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write 1 messages with Id from 90 to 90
2025-11-03T16:52:03.063249Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session: try to update token
2025-11-03T16:52:03.063270Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Send 1 message(s) (0 left), first sequence number is 90
2025-11-03T16:52:03.063305Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write 1 messages with Id from 91 to 91
2025-11-03T16:52:03.063351Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session: try to update token
2025-11-03T16:52:03.063187Z node 5 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|66942439-cc3799b0-f098c35b-1958637c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:52:03.063393Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Send 1 message(s) (0 left), first sequence number is 91
2025-11-03T16:52:03.063451Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write 1 messages with Id from 92 to 92
2025-11-03T16:52:03.063503Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session: try to update token
2025-11-03T16:52:03.063523Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Send 1 message(s) (0 left), first sequence number is 92
2025-11-03T16:52:03.063561Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write 1 messages with Id from 93 to 93
2025-11-03T16:52:03.063593Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session: try to update token
2025-11-03T16:52:03.063610Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Send 1 message(s) (0 left), first sequence number is 93
2025-11-03T16:52:03.063644Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write 1 messages with Id from 94 to 94
2025-11-03T16:52:03.063515Z node 5 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|66942439-cc3799b0-f098c35b-1958637c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:52:03.063678Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session: try to update token
2025-11-03T16:52:03.063696Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Send 1 message(s) (0 left), first sequence number is 94
2025-11-03T16:52:03.063748Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write 1 messages with Id from 95 to 95
2025-11-03T16:52:03.063782Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session: try to update token
2025-11-03T16:52:03.063800Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Send 1 message(s) (0 left), first sequence number is 95
2025-11-03T16:52:03.063838Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write 1 messages with Id from 96 to 96
2025-11-03T16:52:03.063870Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session: try to update token
2025-11-03T16:52:03.063889Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Send 1 message(s) (0 left), first sequence number is 96
2025-11-03T16:52:03.063927Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write 1 messages with Id from 97 to 97
2025-11-03T16:52:03.063783Z node 5 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|66942439-cc3799b0-f098c35b-1958637c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:52:03.063959Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session: try to update token
2025-11-03T16:52:03.063995Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Send 1 message(s) (0 left), first sequence number is 97
2025-11-03T16:52:03.064053Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write 1 messages with Id from 98 to 98
2025-11-03T16:52:03.064124Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session: try to update token
2025-11-03T16:52:03.064145Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Send 1 message(s) (0 left), first sequence number is 98
2025-11-03T16:52:03.064189Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write 1 messages with Id from 99 to 99
2025-11-03T16:52:03.064245Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session: try to update token
2025-11-03T16:52:03.064264Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Send 1 message(s) (0 left), first sequence number is 99
2025-11-03T16:52:03.064300Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write 1 messages with Id from 100 to 100
2025-11-03T16:52:03.064053Z node 5 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|66942439-cc3799b0-f098c35b-1958637c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:52:03.064334Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session: try to update token
2025-11-03T16:52:03.064352Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Send 1 message(s) (0 left), first sequence number is 100
2025-11-03T16:52:03.064407Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session: close. Timeout = 18446744073709551 ms
2025-11-03T16:52:03.079858Z node 5 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|66942439-cc3799b0-f098c35b-1958637c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:52:03.080413Z node 5 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|66942439-cc3799b0-f098c35b-1958637c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:52:03.080622Z node 5 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|66942439-cc3799b0-f098c35b-1958637c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:52:03.080771Z node 5 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|66942439-cc3799b0-f098c35b-1958637c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:52:03.080969Z node 5 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|66942439-cc3799b0-f098c35b-1958637c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:52:03.081152Z node 5 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|66942439-cc3799b0-f098c35b-1958637c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:52:03.081418Z node 5 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|66942439-cc3799b0-f098c35b-1958637c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:52:03.081589Z node 5 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|66942439-cc3799b0-f098c35b-1958637c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:52:03.081736Z node 5 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|66942439-cc3799b0-f098c35b-1958637c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:52:03.081902Z node 5 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|66942439-cc3799b0-f098c35b-1958637c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:52:03.082068Z node 5 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|66942439-cc3799b0-f098c35b-1958637c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:52:03.082215Z node 5 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|66942439-cc3799b0-f098c35b-1958637c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:52:03.082407Z node 5 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|66942439-cc3799b0-f098c35b-1958637c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:52:03.082582Z node 5 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|66942439-cc3799b0-f098c35b-1958637c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:52:03.082742Z node 5 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|66942439-cc3799b0-f098c35b-1958637c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:52:03.082932Z node 5 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|66942439-cc3799b0-f098c35b-1958637c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:52:03.083105Z node 5 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|66942439-cc3799b0-f098c35b-1958637c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:52:03.083261Z node 5 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|66942439-cc3799b0-f098c35b-1958637c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:52:03.083454Z node 5 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|66942439-cc3799b0-f098c35b-1958637c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:52:03.083669Z node 5 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|66942439-cc3799b0-f098c35b-1958637c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:52:03.083831Z node 5 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|66942439-cc3799b0-f098c35b-1958637c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:52:03.084047Z node 5 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|66942439-cc3799b0-f098c35b-1958637c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:52:03.095997Z node 5 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|66942439-cc3799b0-f098c35b-1958637c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:52:03.096549Z node 5 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|66942439-cc3799b0-f098c35b-1958637c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:52:03.121158Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 2 partNo 0 FormedBlobsCount 0 NewHead: Offset 1 PartNo 0 PackedSize 162 count 1 nextOffset 2 batches 1
2025-11-03T16:52:03.129026Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 3 partNo 0
2025-11-03T16:52:03.129111Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 3 partNo 0 FormedBlobsCount 0 NewHead: Offset 1 PartNo 0 PackedSize 300 count 2 nextOffset 3 batches 1
2025-11-03T16:52:03.129135Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 4 partNo 0
2025-11-03T16:52:03.129160Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 4 partNo 0 FormedBlobsCount 0 NewHead: Offset 1 PartNo 0 PackedSize 446 count 3 nextOffset 4 batches 1
2025-11-03T16:52:03.129188Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 5 partNo 0
2025-11-03T16:52:03.129207Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 5 partNo 0 FormedBlobsCount 0 NewHead: Offset 1 PartNo 0 PackedSize 600 count 4 nextOffset 5 batches 1
2025-11-03T16:52:03.129226Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 6 partNo 0
2025-11-03T16:52:03.129248Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 6 partNo 0 FormedBlobsCount 0 NewHead: Offset 1 PartNo 0 PackedSize 762 count 5 nextOffset 6 batches 1
2025-11-03T16:52:03.129269Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 7 partNo 0
2025-11-03T16:52:03.129289Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 7 partNo 0 FormedBlobsCount 0 NewHead: Offset 1 PartNo 0 PackedSize 932 count 6 nextOffset 7 batches 1
2025-11-03T16:52:03.129309Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 8 partNo 0
2025-11-03T16:52:03.129330Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 8 partNo 0 FormedBlobsCount 0 NewHead: Offset 1 PartNo 0 PackedSize 1110 count 7 nextOffset 8 batches 1
2025-11-03T16:52:03.129351Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 9 partNo 0
2025-11-03T16:52:03.129372Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 9 partNo 0 FormedBlobsCount 0 NewHead: Offset 1 PartNo 0 PackedSize 1296 count 8 nextOffset 9 batches 1
2025-11-03T16:52:03.129392Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 10 partNo 0
2025-11-03T16:52:03.129416Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 10 partNo 0 FormedBlobsCount 0 NewHead: Offset 1 PartNo 0 PackedSize 1490 count 9 nextOffset 10 batches 1
2025-11-03T16:52:03.129439Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 11 partNo 0
2025-11-03T16:52:03.129462Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 11 partNo 0 FormedBlobsCount 0 NewHead: Offset 1 PartNo 0 PackedSize 1693 count 10 nextOffset 11 batches 1
2025-11-03T16:52:03.129482Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:03.130017Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 1,10 HeadOffset 1 endOffset 1 curOffset 11 d0000000000_00000000000000000001_00000_0000000010_00000? size 1423 WTime 1762188723128
2025-11-03T16:52:03.130165Z node 6 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:52:03.130312Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1  requestId: <none> cookie: 1
2025-11-03T16:52:03.130469Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:03.130492Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:03.130571Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 12 partNo : 0 messageNo: 27 size 169 offset: -1
2025-11-03T16:52:03.130628Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:03.130641Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:03.130663Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 13 partNo : 0 messageNo: 28 size 177 offset: -1
2025-11-03T16:52:03.130700Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:03.130713Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:03.130734Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 14 partNo : 0 messageNo: 29 size 185 offset: -1
2025-11-03T16:52:03.130771Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:03.130785Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:03.130806Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 15 partNo : 0 messageNo: 30 size 193 offset: -1
2025-11-03T16:52:03.130843Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:03.130854Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:03.130875Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 16 partNo : 0 messageNo: 31 size 202 offset: -1
2025-11-03T16:52:03.130908Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:03.130920Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:03.130955Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:03.130967Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:03.130995Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:03.131009Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:03.131042Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:03.131054Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:03.131084Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:03.131095Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:03.131138Z node 6 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:52:03.131161Z node 6 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-03T16:52:03.131297Z node 6 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 1 partNo 0 count 10 size 1423
2025-11-03T16:52:03.131382Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:52:03.131428Z node 6 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:52:03.131445Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:52:03.131464Z node 6 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:52:03.131479Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:52:03.131494Z node 6 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:52:03.131506Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:52:03.131525Z node 6 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:52:03.131537Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:52:03.131553Z node 6 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:52:03.131781Z node 6 :PERSQUEUE DEBUG: partition_read.cpp:880: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 partno 0 count 1 size 1024000 endOffset 1 max time lag 0ms effective offset 0
2025-11-03T16:52:03.134257Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:03.135506Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session got write response: sequence_numbers: 1 offsets: 0 already_written: false write_statistics { persist_duration_ms: 20 }
2025-11-03T16:52:03.135565Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session: acknoledged message 1
2025-11-03T16:52:03.136044Z node 6 :PERSQUEUE DEBUG: partition_read.cpp:1105: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 140 count 1 last offset 0, current partition end offset: 1
2025-11-03T16:52:03.136086Z node 6 :PERSQUEUE DEBUG: partition_read.cpp:1121: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-11-03T16:52:03.136145Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 32  requestId: <none> cookie: 17
2025-11-03T16:52:03.136190Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 33  requestId: <none> cookie: 18
2025-11-03T16:52:03.136207Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 34  requestId: <none> cookie: 19
2025-11-03T16:52:03.136230Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 35  requestId: <none> cookie: 20
2025-11-03T16:52:03.136249Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 36  requestId: <none> cookie: 21
2025-11-03T16:52:03.136347Z node 6 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 0 partno 0 count 1 parts_count 0 source 1 size 140 accessed 0 times before, last time 2025-11-03T16:52:03.000000Z
2025-11-03T16:52:03.136373Z node 6 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 3. All 1 blobs are from cache.
2025-11-03T16:52:03.136435Z node 6 :PERSQUEUE DEBUG: partition_read.cpp:572: FormAnswer for 1 blobs
2025-11-03T16:52:03.136934Z node 6 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 0 suffix '63'
2025-11-03T16:52:03.137456Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:03.137534Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:03.137561Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:03.137585Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:03.137613Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:03.137935Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:52:03.138008Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:52:03.138040Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:52:03.138106Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:52:03.138144Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:52:03.144237Z node 6 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 0 totakecount 1 count 1 size 122 from pos 0 cbcount 1
2025-11-03T16:52:03.144466Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:03.144495Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:03.144555Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 17 partNo : 0 messageNo: 37 size 210 offset: -1
2025-11-03T16:52:03.144609Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:03.144622Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:03.144642Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 38 size 218 offset: -1
2025-11-03T16:52:03.144683Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:03.144694Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:03.144715Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 39 size 226 offset: -1
2025-11-03T16:52:03.144754Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:03.144766Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:03.144787Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 40 size 234 offset: -1
2025-11-03T16:52:03.144827Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:03.144838Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:03.144862Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 41 size 242 offset: -1
2025-11-03T16:52:03.144896Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:03.144906Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:03.144940Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:03.144950Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:03.144977Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:03.144987Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:03.145013Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:03.145023Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:03.145053Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:03.145063Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:03.145098Z node 6 :PERSQUEUE DEBUG: partition_read.cpp:1015: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1762188722988 queuesize 0 startOffset 0
2025-11-03T16:52:03.145203Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:52:03.145259Z node 6 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:52:03.145277Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:52:03.145291Z node 6 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:52:03.145304Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:52:03.145324Z node 6 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:52:03.145339Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:52:03.145355Z node 6 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:52:03.145370Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:52:03.145387Z node 6 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:52:03.145852Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 42  requestId: <none> cookie: 22
2025-11-03T16:52:03.145889Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 43  requestId: <none> cookie: 23
2025-11-03T16:52:03.145906Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 44  requestId: <none> cookie: 24
2025-11-03T16:52:03.145924Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 45  requestId: <none> cookie: 25
2025-11-03T16:52:03.145942Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 46  requestId: <none> cookie: 26
2025-11-03T16:52:03.148530Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:03.148609Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:03.148638Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:03.148674Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:03.148701Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:03.148950Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:52:03.149014Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:52:03.149052Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:52:03.149087Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:52:03.149124Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:52:03.150220Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:03.150261Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:03.150317Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 47 size 250 offset: -1
2025-11-03T16:52:03.150370Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:03.150382Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:03.150403Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 48 size 258 offset: -1
2025-11-03T16:52:03.150443Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:03.150454Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:03.150473Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 49 size 266 offset: -1
2025-11-03T16:52:03.150507Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:03.150519Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:03.150537Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 50 size 274 offset: -1
2025-11-03T16:52:03.150590Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:03.150600Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:03.150618Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 51 size 282 offset: -1
2025-11-03T16:52:03.150648Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:03.150659Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:03.150690Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:03.150700Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:03.150726Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:03.150737Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:03.150763Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:03.150772Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:03.150798Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:03.150814Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:03.150852Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:52:03.150904Z node 6 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:52:03.150920Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:52:03.150938Z node 6 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:52:03.150950Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:52:03.150964Z node 6 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:52:03.150976Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:52:03.150991Z node 6 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:52:03.151004Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:52:03.151017Z node 6 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:52:03.151088Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 52  requestId: <none> cookie: 27
2025-11-03T16:52:03.151126Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 53  requestId: <none> cookie: 28
2025-11-03T16:52:03.151143Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 54  requestId: <none> cookie: 29
2025-11-03T16:52:03.151157Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 55  requestId: <none> cookie: 30
2025-11-03T16:52:03.151171Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 56  requestId: <none> cookie: 31
2025-11-03T16:52:03.152319Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:03.152390Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:03.152419Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:03.152455Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:03.152481Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:03.152731Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:52:03.152795Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:52:03.152831Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:52:03.152871Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:52:03.152908Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:52:03.154465Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:03.154505Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:03.154585Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 57 size 290 offset: -1
2025-11-03T16:52:03.154645Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:03.154657Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:03.154678Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 28 partNo : 0 messageNo: 58 size 298 offset: -1
2025-11-03T16:52:03.154711Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:03.154722Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:03.154740Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 29 partNo : 0 messageNo: 59 size 306 offset: -1
2025-11-03T16:52:03.154775Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:03.154787Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:03.154807Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 30 partNo : 0 messageNo: 60 size 314 offset: -1
2025-11-03T16:52:03.154848Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:03.154861Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:03.154881Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 31 partNo : 0 messageNo: 61 size 322 offset: -1
2025-11-03T16:52:03.155151Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:03.155169Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:03.155212Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:03.155224Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:03.155275Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:03.155289Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:03.155320Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:03.155328Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:03.155356Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:03.155365Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:03.155397Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:52:03.155458Z node 6 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:52:03.155479Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:52:03.155496Z node 6 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:52:03.155510Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:52:03.155527Z node 6 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:52:03.155541Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:52:03.155557Z node 6 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:52:03.155568Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:52:03.155582Z node 6 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:52:03.155631Z node 6 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 1 count 10 size 1423 actorID [6:7568542934045272658:2380]
2025-11-03T16:52:03.155786Z node 6 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-03T16:52:03.155840Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1311 WriteNewSizeFromSupportivePartitions# 0
2025-11-03T16:52:03.155876Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:52:03.155912Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 2, partNo: 0, Offset: 1 is stored on disk
2025-11-03T16:52:03.155930Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:52:03.155949Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 3, partNo: 0, Offset: 2 is stored on disk
2025-11-03T16:52:03.155962Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:52:03.156004Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 4, partNo: 0, Offset: 3 is stored on disk
2025-11-03T16:52:03.156019Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:52:03.156039Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 5, partNo: 0, Offset: 4 is stored on disk
2025-11-03T16:52:03.156054Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:52:03.156071Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 6, partNo: 0, Offset: 5 is stored on disk
2025-11-03T16:52:03.156084Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:52:03.156102Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 7, partNo: 0, Offset: 6 is stored on disk
2025-11-03T16:52:03.156115Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:52:03.156137Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 8, partNo: 0, Offset: 7 is stored on disk
2025-11-03T16:52:03.156149Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:52:03.156166Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 9, partNo: 0, Offset: 8 is stored on disk
2025-11-03T16:52:03.156176Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:52:03.156195Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 10, partNo: 0, Offset: 9 is stored on disk
2025-11-03T16:52:03.156206Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:52:03.156226Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 11, partNo: 0, Offset: 10 is stored on disk
2025-11-03T16:52:03.156417Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:03.156497Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:03.156510Z node 6 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (20)
2025-11-03T16:52:03.157878Z node 6 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 1 partno 0 count 10 parts 0 suffix '63' size 1423
2025-11-03T16:52:03.163912Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 12 partNo 0
2025-11-03T16:52:03.164913Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 12 partNo 0 FormedBlobsCount 0 NewHead: Offset 11 PartNo 0 PackedSize 243 count 1 nextOffset 12 batches 1
2025-11-03T16:52:03.164979Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 13 partNo 0
2025-11-03T16:52:03.165013Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 13 partNo 0 FormedBlobsCount 0 NewHead: Offset 11 PartNo 0 PackedSize 462 count 2 nextOffset 13 batches 1
2025-11-03T16:52:03.165034Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 14 partNo 0
2025-11-03T16:52:03.165058Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 14 partNo 0 FormedBlobsCount 0 NewHead: Offset 11 PartNo 0 PackedSize 689 count 3 nextOffset 14 batches 1
2025-11-03T16:52:03.165084Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 15 partNo 0
2025-11-03T16:52:03.165106Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 15 partNo 0 FormedBlobsCount 0 NewHead: Offset 11 PartNo 0 PackedSize 924 count 4 nextOffset 15 batches 1
2025-11-03T16:52:03.165125Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 16 partNo 0
2025-11-03T16:52:03.165149Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 16 partNo 0 FormedBlobsCount 0 NewHead: Offset 11 PartNo 0 PackedSize 1168 count 5 nextOffset 16 batches 1
2025-11-03T16:52:03.165169Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 17 partNo 0
2025-11-03T16:52:03.165191Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 17 partNo 0 FormedBlobsCount 0 NewHead: Offset 11 PartNo 0 PackedSize 1420 count 6 nextOffset 17 batches 1
2025-11-03T16:52:03.165211Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-11-03T16:52:03.165230Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 0 FormedBlobsCount 0 NewHead: Offset 11 PartNo 0 PackedSize 1680 count 7 nextOffset 18 batches 1
2025-11-03T16:52:03.165253Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-11-03T16:52:03.165275Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 0 FormedBlobsCount 0 NewHead: Offset 11 PartNo 0 PackedSize 1948 count 8 nextOffset 19 batches 1
2025-11-03T16:52:03.165296Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-11-03T16:52:03.165319Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 0 FormedBlobsCount 0 NewHead: Offset 11 PartNo 0 PackedSize 2224 count 9 nextOffset 20 batches 1
2025-11-03T16:52:03.165340Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-11-03T16:52:03.165359Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 0 FormedBlobsCount 0 NewHead: Offset 11 PartNo 0 PackedSize 2508 count 10 nextOffset 21 batches 1
2025-11-03T16:52:03.165380Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-11-03T16:52:03.165401Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 0 FormedBlobsCount 0 NewHead: Offset 11 PartNo 0 PackedSize 2800 count 11 nextOffset 22 batches 1
2025-11-03T16:52:03.165425Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-11-03T16:52:03.165443Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 0 FormedBlobsCount 0 NewHead: Offset 11 PartNo 0 PackedSize 3100 count 12 nextOffset 23 batches 1
2025-11-03T16:52:03.165462Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-11-03T16:52:03.165480Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 0 FormedBlobsCount 0 NewHead: Offset 11 PartNo 0 PackedSize 3408 count 13 nextOffset 24 batches 1
2025-11-03T16:52:03.165502Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-11-03T16:52:03.165520Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 0 FormedBlobsCount 0 NewHead: Offset 11 PartNo 0 PackedSize 3724 count 14 nextOffset 25 batches 1
2025-11-03T16:52:03.165539Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-11-03T16:52:03.165556Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 0 FormedBlobsCount 0 NewHead: Offset 11 PartNo 0 PackedSize 4048 count 15 nextOffset 26 batches 1
2025-11-03T16:52:03.165580Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-11-03T16:52:03.165600Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 0 FormedBlobsCount 0 NewHead: Offset 11 PartNo 0 PackedSize 4380 count 16 nextOffset 27 batches 1
2025-11-03T16:52:03.165620Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 28 partNo 0
2025-11-03T16:52:03.165642Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 28 partNo 0 FormedBlobsCount 0 NewHead: Offset 11 PartNo 0 PackedSize 4720 count 17 nextOffset 28 batches 1
2025-11-03T16:52:03.165661Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 29 partNo 0
2025-11-03T16:52:03.165679Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 29 partNo 0 FormedBlobsCount 0 NewHead: Offset 11 PartNo 0 PackedSize 5068 count 18 nextOffset 29 batches 1
2025-11-03T16:52:03.165700Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 30 partNo 0
2025-11-03T16:52:03.165718Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 30 partNo 0 FormedBlobsCount 0 NewHead: Offset 11 PartNo 0 PackedSize 5424 count 19 nextOffset 30 batches 1
2025-11-03T16:52:03.165743Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 31 partNo 0
2025-11-03T16:52:03.165761Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 31 partNo 0 FormedBlobsCount 0 NewHead: Offset 11 PartNo 0 PackedSize 5788 count 20 nextOffset 31 batches 1
2025-11-03T16:52:03.165783Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:03.166480Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 11,20 HeadOffset 11 endOffset 11 curOffset 31 d0000000000_00000000000000000011_00000_0000000020_00000? size 5204 WTime 1762188723164
2025-11-03T16:52:03.166651Z node 6 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:52:03.166730Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 62  requestId: <none> cookie: 32
2025-11-03T16:52:03.168059Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:03.168251Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:52:03.168741Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 63  requestId: <none> cookie: 33
2025-11-03T16:52:03.168782Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 64  requestId: <none> cookie: 34
2025-11-03T16:52:03.168811Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 65  requestId: <none> cookie: 35
2025-11-03T16:52:03.168832Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 66  requestId: <none> cookie: 36
2025-11-03T16:52:03.168859Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 7  requestId: <none> cookie: 2
2025-11-03T16:52:03.168887Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 8  requestId: <none> cookie: 3
2025-11-03T16:52:03.168912Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 9  requestId: <none> cookie: 4
2025-11-03T16:52:03.168935Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 10  requestId: <none> cookie: 5
2025-11-03T16:52:03.168959Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 11  requestId: <none> cookie: 6
2025-11-03T16:52:03.168985Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 17  requestId: <none> cookie: 7
2025-11-03T16:52:03.169008Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 18  requestId: <none> cookie: 8
2025-11-03T16:52:03.169030Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 19  requestId: <none> cookie: 9
2025-11-03T16:52:03.169051Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 20  requestId: <none> cookie: 10
2025-11-03T16:52:03.169073Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 21  requestId: <none> cookie: 11
2025-11-03T16:52:03.169109Z node 6 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-03T16:52:03.169251Z node 6 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 11 partNo 0 count 20 size 5204
2025-11-03T16:52:03.169347Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:03.169371Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:03.169427Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 32 partNo : 0 messageNo: 67 size 330 offset: -1
2025-11-03T16:52:03.169488Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:03.169499Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:03.169652Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:52:03.169702Z node 6 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:52:03.169788Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 68  requestId: <none> cookie: 37
2025-11-03T16:52:03.171680Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:03.171754Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:03.171823Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:03.171880Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:03.171908Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:03.171958Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:03.172003Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:03.172027Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:03.172058Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:03.172081Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:03.172109Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:03.172131Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:03.172159Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:03.172182Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:03.172211Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:03.172505Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:52:03.172567Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:52:03.172599Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:52:03.172630Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:52:03.173198Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:52:03.176228Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session got write response: sequence_numbers: 2 offsets: 1 already_written: false write_statistics { persist_duration_ms: 23 queued_in_partition_duration_ms: 127 }
2025-11-03T16:52:03.176293Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session: acknoledged message 2
2025-11-03T16:52:03.176679Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session got write response: sequence_numbers: 3 offsets: 2 already_written: false write_statistics { persist_duration_ms: 23 queued_in_partition_duration_ms: 127 }
2025-11-03T16:52:03.176722Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session: acknoledged message 3
2025-11-03T16:52:03.176892Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session got write response: sequence_numbers: 4 offsets: 3 already_written: false write_statistics { persist_duration_ms: 23 queued_in_partition_duration_ms: 127 }
2025-11-03T16:52:03.176925Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session: acknoledged message 4
2025-11-03T16:52:03.177064Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session got write response: sequence_numbers: 5 offsets: 4 already_written: false write_statistics { persist_duration_ms: 23 queued_in_partition_duration_ms: 127 }
2025-11-03T16:52:03.177095Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session: acknoledged message 5
2025-11-03T16:52:03.177254Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session got write response: sequence_numbers: 6 offsets: 5 already_written: false write_statistics { persist_duration_ms: 23 queued_in_partition_duration_ms: 127 }
2025-11-03T16:52:03.177279Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session: acknoledged message 6
2025-11-03T16:52:03.177427Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session got write response: sequence_numbers: 7 offsets: 6 already_written: false write_statistics { persist_duration_ms: 23 queued_in_partition_duration_ms: 124 }
2025-11-03T16:52:03.177454Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session: acknoledged message 7
2025-11-03T16:52:03.177622Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session got write response: sequence_numbers: 8 offsets: 7 already_written: false write_statistics { persist_duration_ms: 23 queued_in_partition_duration_ms: 124 }
2025-11-03T16:52:03.177659Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session: acknoledged message 8
2025-11-03T16:52:03.177823Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session got write response: sequence_numbers: 9 offsets: 8 already_written: false write_statistics { persist_duration_ms: 23 queued_in_partition_duration_ms: 124 }
2025-11-03T16:52:03.177850Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session: acknoledged message 9
2025-11-03T16:52:03.178099Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session got write response: sequence_numbers: 10 offsets: 9 already_written: false write_statistics { persist_duration_ms: 23 queued_in_partition_duration_ms: 124 }
2025-11-03T16:52:03.178127Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session: acknoledged message 10
2025-11-03T16:52:03.178258Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session got write response: sequence_numbers: 11 offsets: 10 already_written: false write_statistics { persist_duration_ms: 23 queued_in_partition_duration_ms: 124 }
2025-11-03T16:52:03.178501Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session: acknoledged message 11
2025-11-03T16:52:03.176367Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:03.176408Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:03.176472Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 33 partNo : 0 messageNo: 69 size 338 offset: -1
2025-11-03T16:52:03.176527Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:03.176541Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:03.176561Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 34 partNo : 0 messageNo: 70 size 346 offset: -1
2025-11-03T16:52:03.180179Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:03.180226Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:03.180292Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 35 partNo : 0 messageNo: 71 size 354 offset: -1
2025-11-03T16:52:03.180381Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:03.180394Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:03.180417Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 36 partNo : 0 messageNo: 72 size 362 offset: -1
2025-11-03T16:52:03.180455Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:03.180467Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:03.180487Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 73 size 370 offset: -1
2025-11-03T16:52:03.180520Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:03.180529Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:03.180570Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:03.180580Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:03.180610Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:03.180619Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:03.180648Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:03.180660Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:03.180692Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:03.180703Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:03.180735Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:52:03.180790Z node 6 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:52:03.180811Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:52:03.180826Z node 6 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:52:03.180839Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:52:03.180855Z node 6 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:52:03.180868Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:52:03.180883Z node 6 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:52:03.180895Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:52:03.180913Z node 6 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:52:03.181037Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 74  requestId: <none> cookie: 38
2025-11-03T16:52:03.181083Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 75  requestId: <none> cookie: 39
2025-11-03T16:52:03.181099Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 76  requestId: <none> cookie: 40
2025-11-03T16:52:03.181114Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 77  requestId: <none> cookie: 41
2025-11-03T16:52:03.181130Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 78  requestId: <none> cookie: 42
2025-11-03T16:52:03.184700Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:03.184773Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:03.184800Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:03.184823Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:03.184858Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:03.185094Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:52:03.185159Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:52:03.185193Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:52:03.185225Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:52:03.185258Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:52:03.186284Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:03.186326Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:03.186387Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 79 size 378 offset: -1
2025-11-03T16:52:03.186439Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:03.186453Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:03.186476Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 80 size 386 offset: -1
2025-11-03T16:52:03.186513Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:03.186525Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:03.186594Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 81 size 394 offset: -1
2025-11-03T16:52:03.186645Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:03.186660Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:03.186682Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 82 size 402 offset: -1
2025-11-03T16:52:03.186713Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:03.186723Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:03.186741Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 83 size 410 offset: -1
2025-11-03T16:52:03.186777Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:03.186789Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:03.186820Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:03.186830Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:03.186858Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:03.186869Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:03.186895Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:03.186907Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:03.186934Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:03.186946Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:03.186981Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:52:03.187033Z node 6 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:52:03.187052Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:52:03.187072Z node 6 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:52:03.187086Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:52:03.187100Z node 6 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:52:03.187111Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:52:03.187128Z node 6 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:52:03.187143Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:52:03.187158Z node 6 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:52:03.187279Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 84  requestId: <none> cookie: 43
2025-11-03T16:52:03.187329Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 85  requestId: <none> cookie: 44
2025-11-03T16:52:03.187347Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 86  requestId: <none> cookie: 45
2025-11-03T16:52:03.187364Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 87  requestId: <none> cookie: 46
2025-11-03T16:52:03.187381Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 88  requestId: <none> cookie: 47
2025-11-03T16:52:03.189243Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:03.189313Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:03.189339Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:03.189367Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:03.189424Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:03.189751Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:52:03.189823Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:52:03.189885Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:52:03.189920Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:52:03.189953Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:52:03.191649Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:03.191687Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:03.191749Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 89 size 418 offset: -1
2025-11-03T16:52:03.191802Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:03.191816Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:03.191839Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 90 size 426 offset: -1
2025-11-03T16:52:03.191879Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:03.191890Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:03.191911Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 91 size 434 offset: -1
2025-11-03T16:52:03.191963Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:03.191995Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:03.192019Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 92 size 442 offset: -1
2025-11-03T16:52:03.192059Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:03.192072Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:03.192096Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 93 size 450 offset: -1
2025-11-03T16:52:03.192123Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:03.192134Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:03.192164Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:03.192175Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:03.192207Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:03.192218Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:03.192246Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:03.192257Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:03.192285Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:03.192298Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:03.192361Z node 6 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 11 count 20 size 5204 actorID [6:7568542934045272658:2380]
2025-11-03T16:52:03.192422Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:52:03.192478Z node 6 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:52:03.192494Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:52:03.192512Z node 6 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:52:03.192524Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:52:03.192541Z node 6 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:52:03.192552Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:52:03.192567Z node 6 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:52:03.192579Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:52:03.192595Z node 6 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:52:03.192673Z node 6 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-03T16:52:03.192720Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 5056 WriteNewSizeFromSupportivePartitions# 0
2025-11-03T16:52:03.192755Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:52:03.192794Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 12, partNo: 0, Offset: 11 is stored on disk
2025-11-03T16:52:03.192813Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:52:03.192832Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 13, partNo: 0, Offset: 12 is stored on disk
2025-11-03T16:52:03.192844Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:52:03.192861Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 14, partNo: 0, Offset: 13 is stored on disk
2025-11-03T16:52:03.192875Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:52:03.192895Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 15, partNo: 0, Offset: 14 is stored on disk
2025-11-03T16:52:03.192907Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:52:03.192925Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 16, partNo: 0, Offset: 15 is stored on disk
2025-11-03T16:52:03.192937Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:52:03.192964Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 17, partNo: 0, Offset: 16 is stored on disk
2025-11-03T16:52:03.192975Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:52:03.192993Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 18, partNo: 0, Offset: 17 is stored on disk
2025-11-03T16:52:03.193005Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:52:03.193023Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 19, partNo: 0, Offset: 18 is stored on disk
2025-11-03T16:52:03.193034Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:52:03.193051Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 20, partNo: 0, Offset: 19 is stored on disk
2025-11-03T16:52:03.193065Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:52:03.193084Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 21, partNo: 0, Offset: 20 is stored on disk
2025-11-03T16:52:03.193097Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:52:03.193147Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 22, partNo: 0, Offset: 21 is stored on disk
2025-11-03T16:52:03.193166Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:52:03.193183Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 23, partNo: 0, Offset: 22 is stored on disk
2025-11-03T16:52:03.193193Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:52:03.193208Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 24, partNo: 0, Offset: 23 is stored on disk
2025-11-03T16:52:03.193222Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:52:03.193239Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 25, partNo: 0, Offset: 24 is stored on disk
2025-11-03T16:52:03.193249Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:52:03.193289Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 26, partNo: 0, Offset: 25 is stored on disk
2025-11-03T16:52:03.193306Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:52:03.193327Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 27, partNo: 0, Offset: 26 is stored on disk
2025-11-03T16:52:03.193340Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:52:03.193357Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 28, partNo: 0, Offset: 27 is stored on disk
2025-11-03T16:52:03.193369Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:52:03.193410Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 29, partNo: 0, Offset: 28 is stored on disk
2025-11-03T16:52:03.193424Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:52:03.193445Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 30, partNo: 0, Offset: 29 is stored on disk
2025-11-03T16:52:03.193459Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:52:03.193477Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 31, partNo: 0, Offset: 30 is stored on disk
2025-11-03T16:52:03.193792Z node 6 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 11 partno 0 count 20 parts 0 suffix '63' size 5204
2025-11-03T16:52:03.195930Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:03.196037Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:03.196051Z node 6 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (16)
2025-11-03T16:52:03.196168Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 32 partNo 0
2025-11-03T16:52:03.200801Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 32 partNo 0 FormedBlobsCount 0 NewHead: Offset 31 PartNo 0 PackedSize 404 count 1 nextOffset 32 batches 1
2025-11-03T16:52:03.200898Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 33 partNo 0
2025-11-03T16:52:03.200940Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 33 partNo 0 FormedBlobsCount 0 NewHead: Offset 31 PartNo 0 PackedSize 784 count 2 nextOffset 33 batches 1
2025-11-03T16:52:03.200991Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 34 partNo 0
2025-11-03T16:52:03.201022Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 34 partNo 0 FormedBlobsCount 0 NewHead: Offset 31 PartNo 0 PackedSize 1172 count 3 nextOffset 34 batches 1
2025-11-03T16:52:03.201047Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 35 partNo 0
2025-11-03T16:52:03.201069Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 35 partNo 0 FormedBlobsCount 0 NewHead: Offset 31 PartNo 0 PackedSize 1568 count 4 nextOffset 35 batches 1
2025-11-03T16:52:03.201089Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 36 partNo 0
2025-11-03T16:52:03.201114Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 36 partNo 0 FormedBlobsCount 0 NewHead: Offset 31 PartNo 0 PackedSize 1972 count 5 nextOffset 36 batches 1
2025-11-03T16:52:03.201138Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 37 partNo 0
2025-11-03T16:52:03.201157Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 37 partNo 0 FormedBlobsCount 0 NewHead: Offset 31 PartNo 0 PackedSize 2384 count 6 nextOffset 37 batches 1
2025-11-03T16:52:03.201178Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 38 partNo 0
2025-11-03T16:52:03.201199Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 38 partNo 0 FormedBlobsCount 0 NewHead: Offset 31 PartNo 0 PackedSize 2804 count 7 nextOffset 38 batches 1
2025-11-03T16:52:03.201220Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 39 partNo 0
2025-11-03T16:52:03.201258Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 39 partNo 0 FormedBlobsCount 0 NewHead: Offset 31 PartNo 0 PackedSize 3232 count 8 nextOffset 39 batches 1
2025-11-03T16:52:03.201284Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 40 partNo 0
2025-11-03T16:52:03.201310Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 40 partNo 0 FormedBlobsCount 0 NewHead: Offset 31 PartNo 0 PackedSize 3668 count 9 nextOffset 40 batches 1
2025-11-03T16:52:03.201334Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 41 partNo 0
2025-11-03T16:52:03.201355Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 41 partNo 0 FormedBlobsCount 0 NewHead: Offset 31 PartNo 0 PackedSize 4112 count 10 nextOffset 41 batches 1
2025-11-03T16:52:03.201377Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 42 partNo 0
2025-11-03T16:52:03.201403Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 42 partNo 0 FormedBlobsCount 0 NewHead: Offset 31 PartNo 0 PackedSize 4564 count 11 nextOffset 42 batches 1
2025-11-03T16:52:03.201427Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 43 partNo 0
2025-11-03T16:52:03.201451Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 43 partNo 0 FormedBlobsCount 0 NewHead: Offset 31 PartNo 0 PackedSize 5024 count 12 nextOffset 43 batches 1
2025-11-03T16:52:03.201476Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 44 partNo 0
2025-11-03T16:52:03.201497Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 44 partNo 0 FormedBlobsCount 0 NewHead: Offset 31 PartNo 0 PackedSize 5492 count 13 nextOffset 44 batches 1
2025-11-03T16:52:03.201519Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 45 partNo 0
2025-11-03T16:52:03.201538Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 45 partNo 0 FormedBlobsCount 0 NewHead: Offset 31 PartNo 0 PackedSize 5968 count 14 nextOffset 45 batches 1
2025-11-03T16:52:03.201559Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 0
2025-11-03T16:52:03.201580Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 46 partNo 0 FormedBlobsCount 0 NewHead: Offset 31 PartNo 0 PackedSize 6452 count 15 nextOffset 46 batches 1
2025-11-03T16:52:03.201602Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 0
2025-11-03T16:52:03.201621Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 47 partNo 0 FormedBlobsCount 0 NewHead: Offset 31 PartNo 0 PackedSize 6944 count 16 nextOffset 47 batches 1
2025-11-03T16:52:03.201639Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:03.202325Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 31,16 HeadOffset 31 endOffset 31 curOffset 47 d0000000000_00000000000000000031_00000_0000000016_00000? size 6492 WTime 1762188723196
2025-11-03T16:52:03.202487Z node 6 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:52:03.202608Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 94  requestId: <none> cookie: 48
2025-11-03T16:52:03.202679Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 95  requestId: <none> cookie: 49
2025-11-03T16:52:03.202699Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 96  requestId: <none> cookie: 50
2025-11-03T16:52:03.202729Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 97  requestId: <none> cookie: 51
2025-11-03T16:52:03.202751Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 98  requestId: <none> cookie: 52
2025-11-03T16:52:03.202780Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 27  requestId: <none> cookie: 12
2025-11-03T16:52:03.202811Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 28  requestId: <none> cookie: 13
2025-11-03T16:52:03.202835Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 29  requestId: <none> cookie: 14
2025-11-03T16:52:03.202860Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 30  requestId: <none> cookie: 15
2025-11-03T16:52:03.202882Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 31  requestId: <none> cookie: 16
2025-11-03T16:52:03.202907Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 37  requestId: <none> cookie: 17
2025-11-03T16:52:03.202932Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 38  requestId: <none> cookie: 18
2025-11-03T16:52:03.202957Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 39  requestId: <none> cookie: 19
2025-11-03T16:52:03.202981Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 40  requestId: <none> cookie: 20
2025-11-03T16:52:03.203003Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 41  requestId: <none> cookie: 21
2025-11-03T16:52:03.203027Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 47  requestId: <none> cookie: 22
2025-11-03T16:52:03.203051Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 48  requestId: <none> cookie: 23
2025-11-03T16:52:03.203074Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 49  requestId: <none> cookie: 24
2025-11-03T16:52:03.203096Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 50  requestId: <none> cookie: 25
2025-11-03T16:52:03.203120Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 51  requestId: <none> cookie: 26
2025-11-03T16:52:03.203144Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 57  requestId: <none> cookie: 27
2025-11-03T16:52:03.203167Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 58  requestId: <none> cookie: 28
2025-11-03T16:52:03.203187Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 59  requestId: <none> cookie: 29
2025-11-03T16:52:03.203209Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 60  requestId: <none> cookie: 30
2025-11-03T16:52:03.203233Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 61  requestId: <none> cookie: 31
2025-11-03T16:52:03.203268Z node 6 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-03T16:52:03.203397Z node 6 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 31 partNo 0 count 16 size 6492
2025-11-03T16:52:03.207159Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:03.207245Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:03.207275Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:03.207318Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:03.207346Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:03.207373Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:03.207412Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:03.207441Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:03.207469Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:03.207529Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:03.207561Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:03.207587Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:03.207613Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:03.207662Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:03.207714Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:03.207743Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:03.207772Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:03.207796Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:03.207823Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:03.207852Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:03.207903Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:03.207929Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:03.207956Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:03.208002Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:03.208042Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:03.208551Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:52:03.208619Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:52:03.208654Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:52:03.208688Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:52:03.208720Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:52:03.213024Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session got write response: sequence_numbers: 12 offsets: 11 already_written: false write_statistics { persist_duration_ms: 26 queued_in_partition_duration_ms: 36 }
2025-11-03T16:52:03.213096Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session: acknoledged message 12
2025-11-03T16:52:03.213345Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session got write response: sequence_numbers: 13 offsets: 12 already_written: false write_statistics { persist_duration_ms: 26 queued_in_partition_duration_ms: 36 }
2025-11-03T16:52:03.213380Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session: acknoledged message 13
2025-11-03T16:52:03.213678Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session got write response: sequence_numbers: 14 offsets: 13 already_written: false write_statistics { persist_duration_ms: 26 queued_in_partition_duration_ms: 36 }
2025-11-03T16:52:03.213710Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session: acknoledged message 14
2025-11-03T16:52:03.213858Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session got write response: sequence_numbers: 15 offsets: 14 already_written: false write_statistics { persist_duration_ms: 26 queued_in_partition_duration_ms: 36 }
2025-11-03T16:52:03.213883Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session: acknoledged message 15
2025-11-03T16:52:03.213982Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session got write response: sequence_numbers: 16 offsets: 15 already_written: false write_statistics { persist_duration_ms: 26 queued_in_partition_duration_ms: 36 }
2025-11-03T16:52:03.214005Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session: acknoledged message 16
2025-11-03T16:52:03.214108Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session got write response: sequence_numbers: 17 offsets: 16 already_written: false write_statistics { persist_duration_ms: 26 queued_in_partition_duration_ms: 20 }
2025-11-03T16:52:03.214128Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session: acknoledged message 17
2025-11-03T16:52:03.214253Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session got write response: sequence_numbers: 18 offsets: 17 already_written: false write_statistics { persist_duration_ms: 26 queued_in_partition_duration_ms: 20 }
2025-11-03T16:52:03.214289Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session: acknoledged message 18
2025-11-03T16:52:03.214416Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session got write response: sequence_numbers: 19 offsets: 18 already_written: false write_statistics { persist_duration_ms: 26 queued_in_partition_duration_ms: 20 }
2025-11-03T16:52:03.214439Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session: acknoledged message 19
2025-11-03T16:52:03.214572Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session got write response: sequence_numbers: 20 offsets: 19 already_written: false write_statistics { persist_duration_ms: 26 queued_in_partition_duration_ms: 20 }
2025-11-03T16:52:03.214593Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session: acknoledged message 20
2025-11-03T16:52:03.214703Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session got write response: sequence_numbers: 21 offsets: 20 already_written: false write_statistics { persist_duration_ms: 26 queued_in_partition_duration_ms: 20 }
2025-11-03T16:52:03.214728Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session: acknoledged message 21
2025-11-03T16:52:03.214829Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session got write response: sequence_numbers: 22 offsets: 21 already_written: false write_statistics { persist_duration_ms: 26 queued_in_partition_duration_ms: 16 }
2025-11-03T16:52:03.214852Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session: acknoledged message 22
2025-11-03T16:52:03.214959Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session got write response: sequence_numbers: 23 offsets: 22 already_written: false write_statistics { persist_duration_ms: 26 queued_in_partition_duration_ms: 16 }
2025-11-03T16:52:03.214979Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session: acknoledged message 23
2025-11-03T16:52:03.215090Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session got write response: sequence_numbers: 24 offsets: 23 already_written: false write_statistics { persist_duration_ms: 26 queued_in_partition_duration_ms: 16 }
2025-11-03T16:52:03.215117Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session: acknoledged message 24
2025-11-03T16:52:03.215221Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session got write response: sequence_numbers: 25 offsets: 24 already_written: false write_statistics { persist_duration_ms: 26 queued_in_partition_duration_ms: 16 }
2025-11-03T16:52:03.215243Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session: acknoledged message 25
2025-11-03T16:52:03.215368Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session got write response: sequence_numbers: 26 offsets: 25 already_written: false write_statistics { persist_duration_ms: 26 queued_in_partition_duration_ms: 16 }
2025-11-03T16:52:03.215395Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session: acknoledged message 26
2025-11-03T16:52:03.215509Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session got write response: sequence_numbers: 27 offsets: 26 already_written: false write_statistics { persist_duration_ms: 26 queued_in_partition_duration_ms: 13 }
2025-11-03T16:52:03.215531Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session: acknoledged message 27
2025-11-03T16:52:03.215649Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session got write response: sequence_numbers: 28 offsets: 27 already_written: false write_statistics { persist_duration_ms: 26 queued_in_partition_duration_ms: 13 }
2025-11-03T16:52:03.215674Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session: acknoledged message 28
2025-11-03T16:52:03.215781Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session got write response: sequence_numbers: 29 offsets: 28 already_written: false write_statistics { persist_duration_ms: 26 queued_in_partition_duration_ms: 13 }
2025-11-03T16:52:03.215800Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session: acknoledged message 29
2025-11-03T16:52:03.215902Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session got write response: sequence_numbers: 30 offsets: 29 already_written: false write_statistics { persist_duration_ms: 26 queued_in_partition_duration_ms: 13 }
2025-11-03T16:52:03.215925Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session: acknoledged message 30
2025-11-03T16:52:03.216402Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:03.216899Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session got write response: sequence_numbers: 31 offsets: 30 already_written: false write_statistics { persist_duration_ms: 26 queued_in_partition_duration_ms: 13 }
2025-11-03T16:52:03.216992Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session: acknoledged message 31
2025-11-03T16:52:03.216443Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:03.216503Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 99 size 458 offset: -1
2025-11-03T16:52:03.216558Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:03.216570Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:03.216592Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 100 size 466 offset: -1
2025-11-03T16:52:03.216629Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:03.216640Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:03.216660Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 101 size 474 offset: -1
2025-11-03T16:52:03.216698Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:03.216708Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:03.216728Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 102 size 482 offset: -1
2025-11-03T16:52:03.216792Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:03.216806Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:03.216831Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 103 size 490 offset: -1
2025-11-03T16:52:03.216999Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:03.217011Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:03.217047Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:03.217058Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:03.217086Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:03.217098Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:03.217124Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:03.217134Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:03.217161Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:03.217172Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:03.217248Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:52:03.217302Z node 6 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:52:03.217321Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:52:03.217337Z node 6 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:52:03.217350Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:52:03.217365Z node 6 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:52:03.217379Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:52:03.217395Z node 6 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:52:03.217407Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:52:03.217422Z node 6 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:52:03.219783Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:03.219863Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:03.219899Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:03.219924Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:03.219952Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:03.220286Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:52:03.220351Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:52:03.220382Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:52:03.220419Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:52:03.220451Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:52:03.217963Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 104  requestId: <none> cookie: 53
2025-11-03T16:52:03.218016Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 105  requestId: <none> cookie: 54
2025-11-03T16:52:03.218035Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 106  requestId: <none> cookie: 55
2025-11-03T16:52:03.218055Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 107  requestId: <none> cookie: 56
2025-11-03T16:52:03.218074Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 108  requestId: <none> cookie: 57
2025-11-03T16:52:03.221890Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:03.221918Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:03.221986Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 53 partNo : 0 messageNo: 109 size 498 offset: -1
2025-11-03T16:52:03.222037Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:03.223234Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:03.222051Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:03.222071Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 54 partNo : 0 messageNo: 110 size 506 offset: -1
2025-11-03T16:52:03.223308Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:03.222109Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:03.223333Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:03.222121Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:03.223361Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:03.222141Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 55 partNo : 0 messageNo: 111 size 514 offset: -1
2025-11-03T16:52:03.223387Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:03.222171Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:03.223695Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:52:03.222181Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:03.223764Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:52:03.223796Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:52:03.223831Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:52:03.223865Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:52:03.222199Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 56 partNo : 0 messageNo: 112 size 522 offset: -1
2025-11-03T16:52:03.222237Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:03.222247Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:03.222266Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 57 partNo : 0 messageNo: 113 size 530 offset: -1
2025-11-03T16:52:03.222295Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:03.222306Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:03.222341Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:03.222350Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:03.222375Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:03.222385Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:03.222410Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:03.222419Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:03.222442Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:03.222453Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:03.222483Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:52:03.222541Z node 6 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:52:03.222575Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:52:03.222590Z node 6 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:52:03.222603Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:52:03.222618Z node 6 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:52:03.222630Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:52:03.222642Z node 6 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:52:03.222654Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:52:03.222670Z node 6 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:52:03.222752Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 114  requestId: <none> cookie: 58
2025-11-03T16:52:03.222801Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 115  requestId: <none> cookie: 59
2025-11-03T16:52:03.222820Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 116  requestId: <none> cookie: 60
2025-11-03T16:52:03.222837Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 117  requestId: <none> cookie: 61
2025-11-03T16:52:03.222855Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 118  requestId: <none> cookie: 62
2025-11-03T16:52:03.225969Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:03.226002Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:03.226061Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 58 partNo : 0 messageNo: 119 size 538 offset: -1
2025-11-03T16:52:03.226119Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:03.226131Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:03.226154Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 59 partNo : 0 messageNo: 120 size 546 offset: -1
2025-11-03T16:52:03.226188Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:03.226198Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:03.226219Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 60 partNo : 0 messageNo: 121 size 554 offset: -1
2025-11-03T16:52:03.226255Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:03.226266Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:03.226287Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 61 partNo : 0 messageNo: 122 size 562 offset: -1
2025-11-03T16:52:03.226321Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:03.226334Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:03.226376Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 62 partNo : 0 messageNo: 123 size 570 offset: -1
2025-11-03T16:52:03.226425Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:03.226438Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:03.226472Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:03.226486Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:03.226518Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:03.226531Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:03.226583Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:03.226593Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:03.226623Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:03.226634Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:03.226835Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:52:03.226884Z node 6 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:52:03.226904Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:52:03.226925Z node 6 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:52:03.226939Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:52:03.226956Z node 6 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:52:03.226969Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:52:03.226988Z node 6 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:52:03.227003Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:52:03.227019Z node 6 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:52:03.227147Z node 6 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 31 count 16 size 6492 actorID [6:7568542934045272658:2380]
2025-11-03T16:52:03.227216Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 124  requestId: <none> cookie: 63
2025-11-03T16:52:03.227248Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 125  requestId: <none> cookie: 64
2025-11-03T16:52:03.227267Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 126  requestId: <none> cookie: 65
2025-11-03T16:52:03.227286Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 127  requestId: <none> cookie: 66
2025-11-03T16:52:03.227304Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 128  requestId: <none> cookie: 67
2025-11-03T16:52:03.227326Z node 6 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-03T16:52:03.227380Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 6352 WriteNewSizeFromSupportivePartitions# 0
2025-11-03T16:52:03.227417Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:52:03.227453Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 32, partNo: 0, Offset: 31 is stored on disk
2025-11-03T16:52:03.227472Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:52:03.227497Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 33, partNo: 0, Offset: 32 is stored on disk
2025-11-03T16:52:03.227512Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:52:03.227532Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 34, partNo: 0, Offset: 33 is stored on disk
2025-11-03T16:52:03.227546Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:52:03.227567Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 35, partNo: 0, Offset: 34 is stored on disk
2025-11-03T16:52:03.227581Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:52:03.227599Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 36, partNo: 0, Offset: 35 is stored on disk
2025-11-03T16:52:03.227612Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:52:03.227673Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 37, partNo: 0, Offset: 36 is stored on disk
2025-11-03T16:52:03.227691Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:52:03.227709Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 38, partNo: 0, Offset: 37 is stored on disk
2025-11-03T16:52:03.227722Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:52:03.227743Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 39, partNo: 0, Offset: 38 is stored on disk
2025-11-03T16:52:03.227756Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:52:03.227773Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 40, partNo: 0, Offset: 39 is stored on disk
2025-11-03T16:52:03.227785Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:52:03.227802Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 41, partNo: 0, Offset: 40 is stored on disk
2025-11-03T16:52:03.227817Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:52:03.227860Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 42, partNo: 0, Offset: 41 is stored on disk
2025-11-03T16:52:03.227877Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:52:03.227893Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 43, partNo: 0, Offset: 42 is stored on disk
2025-11-03T16:52:03.227905Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:52:03.227923Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 44, partNo: 0, Offset: 43 is stored on disk
2025-11-03T16:52:03.227936Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:52:03.227953Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 45, partNo: 0, Offset: 44 is stored on disk
2025-11-03T16:52:03.227966Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:52:03.228025Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 46, partNo: 0, Offset: 45 is stored on disk
2025-11-03T16:52:03.228043Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:52:03.228060Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 47, partNo: 0, Offset: 46 is stored on disk
2025-11-03T16:52:03.228273Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:03.228345Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:03.228358Z node 6 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (15)
2025-11-03T16:52:03.228468Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 0
2025-11-03T16:52:03.231152Z node 6 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 31 partno 0 count 16 parts 0 suffix '63' size 6492
2025-11-03T16:52:03.231897Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:03.231992Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:03.232025Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:03.232053Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:03.232080Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:03.232380Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:52:03.232448Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:52:03.232490Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:52:03.232525Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:52:03.232557Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:52:03.284877Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 48 partNo 0 FormedBlobsCount 0 NewHead: Offset 47 PartNo 0 PackedSize 532 count 1 nextOffset 48 batches 1
2025-11-03T16:52:03.284976Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 49 partNo 0
2025-11-03T16:52:03.285019Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 49 partNo 0 FormedBlobsCount 0 NewHead: Offset 47 PartNo 0 PackedSize 1040 count 2 nextOffset 49 batches 1
2025-11-03T16:52:03.285040Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 50 partNo 0
2025-11-03T16:52:03.285061Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 50 partNo 0 FormedBlobsCount 0 NewHead: Offset 47 PartNo 0 PackedSize 1556 count 3 nextOffset 50 batches 1
2025-11-03T16:52:03.285082Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 51 partNo 0
2025-11-03T16:52:03.285103Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 51 partNo 0 FormedBlobsCount 0 NewHead: Offset 47 PartNo 0 PackedSize 2080 count 4 nextOffset 51 batches 1
2025-11-03T16:52:03.285125Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 52 partNo 0
2025-11-03T16:52:03.285148Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 52 partNo 0 FormedBlobsCount 0 NewHead: Offset 47 PartNo 0 PackedSize 2612 count 5 nextOffset 52 batches 1
2025-11-03T16:52:03.285169Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 53 partNo 0
2025-11-03T16:52:03.285190Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 53 partNo 0 FormedBlobsCount 0 NewHead: Offset 47 PartNo 0 PackedSize 3152 count 6 nextOffset 53 batches 1
2025-11-03T16:52:03.285208Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 54 partNo 0
2025-11-03T16:52:03.285225Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 54 partNo 0 FormedBlobsCount 0 NewHead: Offset 47 PartNo 0 PackedSize 3700 count 7 nextOffset 54 batches 1
2025-11-03T16:52:03.285243Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 55 partNo 0
2025-11-03T16:52:03.285262Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 55 partNo 0 FormedBlobsCount 0 NewHead: Offset 47 PartNo 0 PackedSize 4256 count 8 nextOffset 55 batches 1
2025-11-03T16:52:03.285283Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 56 partNo 0
2025-11-03T16:52:03.285307Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 56 partNo 0 FormedBlobsCount 0 NewHead: Offset 47 PartNo 0 PackedSize 4820 count 9 nextOffset 56 batches 1
2025-11-03T16:52:03.285329Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 57 partNo 0
2025-11-03T16:52:03.285349Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 57 partNo 0 FormedBlobsCount 0 NewHead: Offset 47 PartNo 0 PackedSize 5392 count 10 nextOffset 57 batches 1
2025-11-03T16:52:03.285370Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 58 partNo 0
2025-11-03T16:52:03.285390Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 58 partNo 0 FormedBlobsCount 0 NewHead: Offset 47 PartNo 0 PackedSize 5972 count 11 nextOffset 58 batches 1
2025-11-03T16:52:03.285410Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 59 partNo 0
2025-11-03T16:52:03.285431Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 59 partNo 0 FormedBlobsCount 0 NewHead: Offset 47 PartNo 0 PackedSize 6560 count 12 nextOffset 59 batches 1
2025-11-03T16:52:03.285451Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 60 partNo 0
2025-11-03T16:52:03.285470Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 60 partNo 0 FormedBlobsCount 0 NewHead: Offset 47 PartNo 0 PackedSize 7156 count 13 nextOffset 60 batches 1
2025-11-03T16:52:03.285489Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 61 partNo 0
2025-11-03T16:52:03.285508Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 61 partNo 0 FormedBlobsCount 0 NewHead: Offset 47 PartNo 0 PackedSize 7760 count 14 nextOffset 61 batches 1
2025-11-03T16:52:03.285528Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 62 partNo 0
2025-11-03T16:52:03.285548Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 62 partNo 0 FormedBlobsCount 0 NewHead: Offset 47 PartNo 0 PackedSize 8372 count 15 nextOffset 62 batches 1
2025-11-03T16:52:03.285569Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:03.286246Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 47,15 HeadOffset 47 endOffset 47 curOffset 62 d0000000000_00000000000000000047_00000_0000000015_00000? size 7952 WTime 1762188723283
2025-11-03T16:52:03.286395Z node 6 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:52:03.286628Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 67  requestId: <none> cookie: 32
2025-11-03T16:52:03.286699Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 69  requestId: <none> cookie: 33
2025-11-03T16:52:03.286724Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 70  requestId: <none> cookie: 34
2025-11-03T16:52:03.286748Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 71  requestId: <none> cookie: 35
2025-11-03T16:52:03.286770Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 72  requestId: <none> cookie: 36
2025-11-03T16:52:03.286795Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 73  requestId: <none> cookie: 37
2025-11-03T16:52:03.286820Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 79  requestId: <none> cookie: 38
2025-11-03T16:52:03.286841Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 80  requestId: <none> cookie: 39
2025-11-03T16:52:03.286861Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 81  requestId: <none> cookie: 40
2025-11-03T16:52:03.286882Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 82  requestId: <none> cookie: 41
2025-11-03T16:52:03.286903Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 83  requestId: <none> cookie: 42
2025-11-03T16:52:03.286927Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 89  requestId: <none> cookie: 43
2025-11-03T16:52:03.286951Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 90  requestId: <none> cookie: 44
2025-11-03T16:52:03.286974Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 91  requestId: <none> cookie: 45
2025-11-03T16:52:03.286997Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 92  requestId: <none> cookie: 46
2025-11-03T16:52:03.287020Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 93  requestId: <none> cookie: 47
2025-11-03T16:52:03.287066Z node 6 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:52:03.287144Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:03.287166Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:03.287225Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 63 partNo : 0 messageNo: 129 size 578 offset: -1
2025-11-03T16:52:03.287285Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:03.287296Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:03.287321Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 64 partNo : 0 messageNo: 130 size 586 offset: -1
2025-11-03T16:52:03.287362Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:03.287375Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:03.287393Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 65 partNo : 0 messageNo: 131 size 594 offset: -1
2025-11-03T16:52:03.287428Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:03.287438Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:03.287458Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 66 partNo : 0 messageNo: 132 size 602 offset: -1
2025-11-03T16:52:03.287493Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:03.287505Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:03.287528Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 67 partNo : 0 messageNo: 133 size 610 offset: -1
2025-11-03T16:52:03.287562Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:03.287573Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:03.287607Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:03.287617Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:03.287642Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:03.287653Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:03.287681Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:03.287691Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:03.287723Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:03.287733Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:03.287761Z node 6 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-03T16:52:03.287896Z node 6 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 47 partNo 0 count 15 size 7952
2025-11-03T16:52:03.287940Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:52:03.288516Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:03.288598Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:03.288627Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:03.288699Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:03.288729Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:03.288756Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:03.288807Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:03.288836Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:03.288862Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:03.288887Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:03.288915Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:03.288940Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:03.288969Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:03.288993Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:03.289020Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:03.289046Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:03.292238Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session got write response: sequence_numbers: 32 offsets: 31 already_written: false write_statistics { persist_duration_ms: 27 queued_in_partition_duration_ms: 28 }
2025-11-03T16:52:03.292300Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session: acknoledged message 32
2025-11-03T16:52:03.292551Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session got write response: sequence_numbers: 33 offsets: 32 already_written: false write_statistics { persist_duration_ms: 27 queued_in_partition_duration_ms: 16 }
2025-11-03T16:52:03.292582Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session: acknoledged message 33
2025-11-03T16:52:03.292733Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session got write response: sequence_numbers: 34 offsets: 33 already_written: false write_statistics { persist_duration_ms: 27 queued_in_partition_duration_ms: 16 }
2025-11-03T16:52:03.292085Z node 6 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:52:03.292145Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:52:03.292192Z node 6 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:52:03.292208Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:52:03.292228Z node 6 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:52:03.292242Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:52:03.292259Z node 6 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:52:03.292271Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:52:03.292290Z node 6 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:52:03.292765Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session: acknoledged message 34
2025-11-03T16:52:03.292521Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 134  requestId: <none> cookie: 68
2025-11-03T16:52:03.292568Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 135  requestId: <none> cookie: 69
2025-11-03T16:52:03.292585Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 136  requestId: <none> cookie: 70
2025-11-03T16:52:03.292603Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 137  requestId: <none> cookie: 71
2025-11-03T16:52:03.292622Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 138  requestId: <none> cookie: 72
2025-11-03T16:52:03.293032Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session got write response: sequence_numbers: 35 offsets: 34 already_written: false write_statistics { persist_duration_ms: 27 queued_in_partition_duration_ms: 16 }
2025-11-03T16:52:03.293066Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session: acknoledged message 35
2025-11-03T16:52:03.293228Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session got write response: sequence_numbers: 36 offsets: 35 already_written: false write_statistics { persist_duration_ms: 27 queued_in_partition_duration_ms: 16 }
2025-11-03T16:52:03.293259Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session: acknoledged message 36
2025-11-03T16:52:03.293392Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session got write response: sequence_numbers: 37 offsets: 36 already_written: false write_statistics { persist_duration_ms: 27 queued_in_partition_duration_ms: 16 }
2025-11-03T16:52:03.293427Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session: acknoledged message 37
2025-11-03T16:52:03.293572Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session got write response: sequence_numbers: 38 offsets: 37 already_written: false write_statistics { persist_duration_ms: 27 queued_in_partition_duration_ms: 12 }
2025-11-03T16:52:03.293602Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session: acknoledged message 38
2025-11-03T16:52:03.293742Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session got write response: sequence_numbers: 39 offsets: 38 already_written: false write_statistics { persist_duration_ms: 27 queued_in_partition_duration_ms: 12 }
2025-11-03T16:52:03.293783Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session: acknoledged message 39
2025-11-03T16:52:03.293932Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session got write response: sequence_numbers: 40 offsets: 39 already_written: false write_statistics { persist_duration_ms: 27 queued_in_partition_duration_ms: 12 }
2025-11-03T16:52:03.293960Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session: acknoledged message 40
2025-11-03T16:52:03.294100Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session got write response: sequence_numbers: 41 offsets: 40 already_written: false write_statistics { persist_duration_ms: 27 queued_in_partition_duration_ms: 12 }
2025-11-03T16:52:03.294128Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session: acknoledged message 41
2025-11-03T16:52:03.294255Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session got write response: sequence_numbers: 42 offsets: 41 already_written: false write_statistics { persist_duration_ms: 27 queued_in_partition_duration_ms: 12 }
2025-11-03T16:52:03.294288Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session: acknoledged message 42
2025-11-03T16:52:03.294434Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session got write response: sequence_numbers: 43 offsets: 42 already_written: false write_statistics { persist_duration_ms: 27 queued_in_partition_duration_ms: 5 }
2025-11-03T16:52:03.294463Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session: acknoledged message 43
2025-11-03T16:52:03.294616Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session got write response: sequence_numbers: 44 offsets: 43 already_written: false write_statistics { persist_duration_ms: 27 queued_in_partition_duration_ms: 5 }
2025-11-03T16:52:03.294639Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session: acknoledged message 44
2025-11-03T16:52:03.294781Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session got write response: sequence_numbers: 45 offsets: 44 already_written: false write_statistics { persist_duration_ms: 27 queued_in_partition_duration_ms: 5 }
2025-11-03T16:52:03.294808Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session: acknoledged message 45
2025-11-03T16:52:03.294927Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session got write response: sequence_numbers: 46 offsets: 45 already_written: false write_statistics { persist_duration_ms: 27 queued_in_partition_duration_ms: 5 }
2025-11-03T16:52:03.294947Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session: acknoledged message 46
2025-11-03T16:52:03.295120Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session got write response: sequence_numbers: 47 offsets: 46 already_written: false write_statistics { persist_duration_ms: 27 queued_in_partition_duration_ms: 5 }
2025-11-03T16:52:03.295179Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session: acknoledged message 47
2025-11-03T16:52:03.294488Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:03.294579Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:03.294605Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:03.294635Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:03.294660Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:03.294927Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:52:03.294995Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:52:03.295031Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:52:03.295065Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:52:03.295100Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:52:03.296217Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:03.296258Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:03.296321Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 68 partNo : 0 messageNo: 139 size 618 offset: -1
2025-11-03T16:52:03.296376Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:03.296387Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:03.296409Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 69 partNo : 0 messageNo: 140 size 626 offset: -1
2025-11-03T16:52:03.296448Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:03.296461Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:03.297360Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 70 partNo : 0 messageNo: 141 size 634 offset: -1
2025-11-03T16:52:03.297441Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:03.297459Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:03.297494Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 71 partNo : 0 messageNo: 142 size 642 offset: -1
2025-11-03T16:52:03.297538Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:03.297549Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:03.297571Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 72 partNo : 0 messageNo: 143 size 650 offset: -1
2025-11-03T16:52:03.297603Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:03.297613Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:03.297654Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:03.297919Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:03.297964Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:03.297975Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:03.298008Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:03.298021Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:03.298051Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:03.298063Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:03.298096Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:52:03.298152Z node 6 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:52:03.298174Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:52:03.298194Z node 6 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:52:03.298254Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:52:03.298271Z node 6 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:52:03.298283Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:52:03.298299Z node 6 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:52:03.298313Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:52:03.298328Z node 6 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:52:03.298842Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 144  requestId: <none> cookie: 73
2025-11-03T16:52:03.298881Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 145  requestId: <none> cookie: 74
2025-11-03T16:52:03.298899Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 146  requestId: <none> cookie: 75
2025-11-03T16:52:03.298918Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 147  requestId: <none> cookie: 76
2025-11-03T16:52:03.298936Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 148  requestId: <none> cookie: 77
2025-11-03T16:52:03.300707Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:03.300770Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:03.300828Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:03.300859Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:03.300884Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:03.301121Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:52:03.301184Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:52:03.301218Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:52:03.301257Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:52:03.301292Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:52:03.303419Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:03.303460Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:03.303521Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 73 partNo : 0 messageNo: 149 size 658 offset: -1
2025-11-03T16:52:03.303575Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:03.303585Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:03.303610Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 74 partNo : 0 messageNo: 150 size 666 offset: -1
2025-11-03T16:52:03.303649Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:03.303660Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:03.303682Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 75 partNo : 0 messageNo: 151 size 674 offset: -1
2025-11-03T16:52:03.303723Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:03.303735Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:03.303756Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 76 partNo : 0 messageNo: 152 size 682 offset: -1
2025-11-03T16:52:03.303792Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:03.303806Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:03.303828Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 77 partNo : 0 messageNo: 153 size 690 offset: -1
2025-11-03T16:52:03.303858Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:03.303870Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:03.303902Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:03.303913Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:03.303940Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:03.303953Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:03.303997Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:03.304008Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:03.304037Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:03.304049Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:03.304262Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:52:03.304317Z node 6 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:52:03.304350Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:52:03.304367Z node 6 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:52:03.304380Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:52:03.304399Z node 6 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:52:03.304410Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:52:03.304426Z node 6 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:52:03.304439Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:52:03.304454Z node 6 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:52:03.304561Z node 6 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 47 count 15 size 7952 actorID [6:7568542934045272658:2380]
2025-11-03T16:52:03.304620Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 154  requestId: <none> cookie: 78
2025-11-03T16:52:03.304651Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 155  requestId: <none> cookie: 79
2025-11-03T16:52:03.304669Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 156  requestId: <none> cookie: 80
2025-11-03T16:52:03.304686Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 157  requestId: <none> cookie: 81
2025-11-03T16:52:03.304703Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 158  requestId: <none> cookie: 82
2025-11-03T16:52:03.304724Z node 6 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-03T16:52:03.304776Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 7815 WriteNewSizeFromSupportivePartitions# 0
2025-11-03T16:52:03.304814Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:52:03.304847Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 48, partNo: 0, Offset: 47 is stored on disk
2025-11-03T16:52:03.304864Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:52:03.304882Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 49, partNo: 0, Offset: 48 is stored on disk
2025-11-03T16:52:03.304895Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:52:03.304915Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 50, partNo: 0, Offset: 49 is stored on disk
2025-11-03T16:52:03.304930Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:52:03.304951Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 51, partNo: 0, Offset: 50 is stored on disk
2025-11-03T16:52:03.304966Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:52:03.304987Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 52, partNo: 0, Offset: 51 is stored on disk
2025-11-03T16:52:03.305001Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:52:03.305023Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 53, partNo: 0, Offset: 52 is stored on disk
2025-11-03T16:52:03.305036Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:52:03.305060Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 54, partNo: 0, Offset: 53 is stored on disk
2025-11-03T16:52:03.305072Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:52:03.305090Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 55, partNo: 0, Offset: 54 is stored on disk
2025-11-03T16:52:03.305103Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:52:03.305122Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 56, partNo: 0, Offset: 55 is stored on disk
2025-11-03T16:52:03.305135Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:52:03.305155Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 57, partNo: 0, Offset: 56 is stored on disk
2025-11-03T16:52:03.305165Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:52:03.305186Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 58, partNo: 0, Offset: 57 is stored on disk
2025-11-03T16:52:03.305198Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:52:03.305217Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 59, partNo: 0, Offset: 58 is stored on disk
2025-11-03T16:52:03.305230Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:52:03.305249Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 60, partNo: 0, Offset: 59 is stored on disk
2025-11-03T16:52:03.305261Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:52:03.305280Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 61, partNo: 0, Offset: 60 is stored on disk
2025-11-03T16:52:03.305293Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:52:03.305312Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 62, partNo: 0, Offset: 61 is stored on disk
2025-11-03T16:52:03.305497Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:03.305562Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:03.305576Z node 6 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (15)
2025-11-03T16:52:03.305681Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 63 partNo 0
2025-11-03T16:52:03.306623Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 63 partNo 0 FormedBlobsCount 0 NewHead: Offset 62 PartNo 0 PackedSize 652 count 1 nextOffset 63 batches 1
2025-11-03T16:52:03.306681Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 64 partNo 0
2025-11-03T16:52:03.306716Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 64 partNo 0 FormedBlobsCount 0 NewHead: Offset 62 PartNo 0 PackedSize 1280 count 2 nextOffset 64 batches 1
2025-11-03T16:52:03.306741Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 65 partNo 0
2025-11-03T16:52:03.306767Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 65 partNo 0 FormedBlobsCount 0 NewHead: Offset 62 PartNo 0 PackedSize 1916 count 3 nextOffset 65 batches 1
2025-11-03T16:52:03.306790Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 66 partNo 0
2025-11-03T16:52:03.306812Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 66 partNo 0 FormedBlobsCount 0 NewHead: Offset 62 PartNo 0 PackedSize 2560 count 4 nextOffset 66 batches 1
2025-11-03T16:52:03.306836Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 67 partNo 0
2025-11-03T16:52:03.306860Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 67 partNo 0 FormedBlobsCount 0 NewHead: Offset 62 PartNo 0 PackedSize 3212 count 5 nextOffset 67 batches 1
2025-11-03T16:52:03.306882Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 68 partNo 0
2025-11-03T16:52:03.306903Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 68 partNo 0 FormedBlobsCount 0 NewHead: Offset 62 PartNo 0 PackedSize 3872 count 6 nextOffset 68 batches 1
2025-11-03T16:52:03.306927Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 69 partNo 0
2025-11-03T16:52:03.306948Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 69 partNo 0 FormedBlobsCount 0 NewHead: Offset 62 PartNo 0 PackedSize 4540 count 7 nextOffset 69 batches 1
2025-11-03T16:52:03.306970Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 70 partNo 0
2025-11-03T16:52:03.306990Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 70 partNo 0 FormedBlobsCount 0 NewHead: Offset 62 PartNo 0 PackedSize 5216 count 8 nextOffset 70 batches 1
2025-11-03T16:52:03.307012Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 71 partNo 0
2025-11-03T16:52:03.307036Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 71 partNo 0 FormedBlobsCount 0 NewHead: Offset 62 PartNo 0 PackedSize 5900 count 9 nextOffset 71 batches 1
2025-11-03T16:52:03.307056Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 72 partNo 0
2025-11-03T16:52:03.307076Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 72 partNo 0 FormedBlobsCount 0 NewHead: Offset 62 PartNo 0 PackedSize 6592 count 10 nextOffset 72 batches 1
2025-11-03T16:52:03.307098Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 73 partNo 0
2025-11-03T16:52:03.307117Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 73 partNo 0 FormedBlobsCount 0 NewHead: Offset 62 PartNo 0 PackedSize 7292 count 11 nextOffset 73 batches 1
2025-11-03T16:52:03.307138Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 74 partNo 0
2025-11-03T16:52:03.307160Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 74 partNo 0 FormedBlobsCount 0 NewHead: Offset 62 PartNo 0 PackedSize 8000 count 12 nextOffset 74 batches 1
2025-11-03T16:52:03.307183Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 75 partNo 0
2025-11-03T16:52:03.307203Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 75 partNo 0 FormedBlobsCount 0 NewHead: Offset 62 PartNo 0 PackedSize 8716 count 13 nextOffset 75 batches 1
2025-11-03T16:52:03.307223Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 76 partNo 0
2025-11-03T16:52:03.307243Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 76 partNo 0 FormedBlobsCount 0 NewHead: Offset 62 PartNo 0 PackedSize 9440 count 14 nextOffset 76 batches 1
2025-11-03T16:52:03.307264Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 77 partNo 0
2025-11-03T16:52:03.307285Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 77 partNo 0 FormedBlobsCount 0 NewHead: Offset 62 PartNo 0 PackedSize 10172 count 15 nextOffset 77 batches 1
2025-11-03T16:52:03.307302Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:03.310473Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:03.310572Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:03.310606Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:03.310639Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:03.310667Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:03.310933Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:52:03.311007Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:52:03.311060Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:52:03.311099Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:52:03.311136Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:52:03.310110Z node 6 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 47 partno 0 count 15 parts 0 suffix '63' size 7952
2025-11-03T16:52:03.312290Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 62,15 HeadOffset 62 endOffset 62 curOffset 77 d0000000000_00000000000000000062_00000_0000000015_00000? size 9752 WTime 1762188723310
2025-11-03T16:52:03.312467Z node 6 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:52:03.312537Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 99  requestId: <none> cookie: 48
2025-11-03T16:52:03.312609Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 100  requestId: <none> cookie: 49
2025-11-03T16:52:03.312639Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 101  requestId: <none> cookie: 50
2025-11-03T16:52:03.312669Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 102  requestId: <none> cookie: 51
2025-11-03T16:52:03.312696Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 103  requestId: <none> cookie: 52
2025-11-03T16:52:03.312720Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 109  requestId: <none> cookie: 53
2025-11-03T16:52:03.312746Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 110  requestId: <none> cookie: 54
2025-11-03T16:52:03.312769Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 111  requestId: <none> cookie: 55
2025-11-03T16:52:03.312796Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 112  requestId: <none> cookie: 56
2025-11-03T16:52:03.312819Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 113  requestId: <none> cookie: 57
2025-11-03T16:52:03.312842Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 119  requestId: <none> cookie: 58
2025-11-03T16:52:03.312867Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 120  requestId: <none> cookie: 59
2025-11-03T16:52:03.312887Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 121  requestId: <none> cookie: 60
2025-11-03T16:52:03.312912Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 122  requestId: <none> cookie: 61
2025-11-03T16:52:03.312937Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 123  requestId: <none> cookie: 62
2025-11-03T16:52:03.313019Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:03.313043Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:03.313108Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 78 partNo : 0 messageNo: 159 size 698 offset: -1
2025-11-03T16:52:03.313164Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:03.313177Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:03.313200Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 79 partNo : 0 messageNo: 160 size 706 offset: -1
2025-11-03T16:52:03.313238Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:03.313251Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:03.313275Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 80 partNo : 0 messageNo: 161 size 714 offset: -1
2025-11-03T16:52:03.313313Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:03.313325Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:03.313347Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 81 partNo : 0 messageNo: 162 size 722 offset: -1
2025-11-03T16:52:03.313401Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:03.313413Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:03.313436Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 82 partNo : 0 messageNo: 163 size 730 offset: -1
2025-11-03T16:52:03.313469Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:03.313480Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:03.313516Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:03.313527Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:03.313559Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:03.313569Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:03.313602Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:03.313614Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:03.313644Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:03.313653Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:03.313679Z node 6 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-03T16:52:03.313820Z node 6 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 62 partNo 0 count 15 size 9752
2025-11-03T16:52:03.313865Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:52:03.313916Z node 6 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:52:03.313933Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:52:03.313950Z node 6 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:52:03.313963Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:52:03.313982Z node 6 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:52:03.313994Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:52:03.314012Z node 6 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:52:03.314025Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:52:03.314040Z node 6 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:52:03.314240Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 164  requestId: <none> cookie: 83
2025-11-03T16:52:03.314267Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 165  requestId: <none> cookie: 84
2025-11-03T16:52:03.314284Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 166  requestId: <none> cookie: 85
2025-11-03T16:52:03.314301Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 167  requestId: <none> cookie: 86
2025-11-03T16:52:03.314318Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 168  requestId: <none> cookie: 87
2025-11-03T16:52:03.316837Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:03.316918Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:03.316948Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:03.316976Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:03.317006Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:03.317037Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:03.317072Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:03.317102Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:03.317134Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:03.317166Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:03.317206Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:03.317255Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:03.317289Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:03.317330Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:03.317361Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:03.317413Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:03.317469Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:03.317499Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:03.317528Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:03.317558Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:03.320794Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:52:03.320882Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:52:03.320959Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:52:03.320997Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:52:03.321030Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:52:03.324321Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session got write response: sequence_numbers: 48 offsets: 47 already_written: false write_statistics { persist_duration_ms: 19 queued_in_partition_duration_ms: 67 }
2025-11-03T16:52:03.324378Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session: acknoledged message 48
2025-11-03T16:52:03.324610Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session got write response: sequence_numbers: 49 offsets: 48 already_written: false write_statistics { persist_duration_ms: 19 queued_in_partition_duration_ms: 67 }
2025-11-03T16:52:03.324634Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session: acknoledged message 49
2025-11-03T16:52:03.324739Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session got write response: sequence_numbers: 50 offsets: 49 already_written: false write_statistics { persist_duration_ms: 19 queued_in_partition_duration_ms: 67 }
2025-11-03T16:52:03.324762Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session: acknoledged message 50
2025-11-03T16:52:03.324853Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session got write response: sequence_numbers: 51 offsets: 50 already_written: false write_statistics { persist_duration_ms: 19 queued_in_partition_duration_ms: 67 }
2025-11-03T16:52:03.324876Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session: acknoledged message 51
2025-11-03T16:52:03.324971Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session got write response: sequence_numbers: 52 offsets: 51 already_written: false write_statistics { persist_duration_ms: 19 queued_in_partition_duration_ms: 67 }
2025-11-03T16:52:03.324990Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session: acknoledged message 52
2025-11-03T16:52:03.325088Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session got write response: sequence_numbers: 53 offsets: 52 already_written: false write_statistics { persist_duration_ms: 19 queued_in_partition_duration_ms: 63 }
2025-11-03T16:52:03.325108Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session: acknoledged message 53
2025-11-03T16:52:03.325222Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session got write response: sequence_numbers: 54 offsets: 53 already_written: false write_statistics { persist_duration_ms: 19 queued_in_partition_duration_ms: 63 }
2025-11-03T16:52:03.325242Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session: acknoledged message 54
2025-11-03T16:52:03.325400Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session got write response: sequence_numbers: 55 offsets: 54 already_written: false write_statistics { persist_duration_ms: 19 queued_in_partition_duration_ms: 63 }
2025-11-03T16:52:03.325431Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session: acknoledged message 55
2025-11-03T16:52:03.325522Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session got write response: sequence_numbers: 56 offsets: 55 already_written: false write_statistics { persist_duration_ms: 19 queued_in_partition_duration_ms: 63 }
2025-11-03T16:52:03.325542Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session: acknoledged message 56
2025-11-03T16:52:03.325639Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session got write response: sequence_numbers: 57 offsets: 56 already_written: false write_statistics { persist_duration_ms: 19 queued_in_partition_duration_ms: 63 }
2025-11-03T16:52:03.325661Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session: acknoledged message 57
2025-11-03T16:52:03.325757Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session got write response: sequence_numbers: 58 offsets: 57 already_written: false write_statistics { persist_duration_ms: 19 queued_in_partition_duration_ms: 59 }
2025-11-03T16:52:03.325777Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session: acknoledged message 58
2025-11-03T16:52:03.325881Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session got write response: sequence_numbers: 59 offsets: 58 already_written: false write_statistics { persist_duration_ms: 19 queued_in_partition_duration_ms: 59 }
2025-11-03T16:52:03.325905Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session: acknoledged message 59
2025-11-03T16:52:03.326000Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session got write response: sequence_numbers: 60 offsets: 59 already_written: false write_statistics { persist_duration_ms: 19 queued_in_partition_duration_ms: 59 }
2025-11-03T16:52:03.326025Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session: acknoledged message 60
2025-11-03T16:52:03.326119Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session got write response: sequence_numbers: 61 offsets: 60 already_written: false write_statistics { persist_duration_ms: 19 queued_in_partition_duration_ms: 59 }
2025-11-03T16:52:03.326139Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session: acknoledged message 61
2025-11-03T16:52:03.326236Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session got write response: sequence_numbers: 62 offsets: 61 already_written: false write_statistics { persist_duration_ms: 19 queued_in_partition_duration_ms: 59 }
2025-11-03T16:52:03.326261Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session: acknoledged message 62
2025-11-03T16:52:03.327052Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:03.327099Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:03.327161Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 83 partNo : 0 messageNo: 169 size 738 offset: -1
2025-11-03T16:52:03.327226Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:03.327241Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:03.327265Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 84 partNo : 0 messageNo: 170 size 746 offset: -1
2025-11-03T16:52:03.327304Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:03.327316Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:03.327339Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 85 partNo : 0 messageNo: 171 size 754 offset: -1
2025-11-03T16:52:03.327434Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:03.327445Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:03.327469Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 86 partNo : 0 messageNo: 172 size 762 offset: -1
2025-11-03T16:52:03.327509Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:03.327519Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:03.327541Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 87 partNo : 0 messageNo: 173 size 770 offset: -1
2025-11-03T16:52:03.327576Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:03.327587Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:03.327622Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:03.327634Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:03.327661Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:03.327673Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:03.327703Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:03.327714Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:03.327745Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:03.327756Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:03.327785Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:52:03.327838Z node 6 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:52:03.327854Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:52:03.327871Z node 6 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:52:03.327885Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:52:03.327901Z node 6 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:52:03.328349Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:52:03.328374Z node 6 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:52:03.328388Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:52:03.328404Z node 6 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:52:03.328503Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 174  requestId: <none> cookie: 88
2025-11-03T16:52:03.328547Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 175  requestId: <none> cookie: 89
2025-11-03T16:52:03.328564Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 176  requestId: <none> cookie: 90
2025-11-03T16:52:03.328583Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 177  requestId: <none> cookie: 91
2025-11-03T16:52:03.328602Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 178  requestId: <none> cookie: 92
2025-11-03T16:52:03.330236Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:03.330343Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:03.330371Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:03.330403Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:03.330432Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:03.330724Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:52:03.330791Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:52:03.330830Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:52:03.330865Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:52:03.330903Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:52:03.332804Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:03.332844Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:03.332903Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 88 partNo : 0 messageNo: 179 size 778 offset: -1
2025-11-03T16:52:03.332959Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:03.332972Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:03.332996Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 89 partNo : 0 messageNo: 180 size 786 offset: -1
2025-11-03T16:52:03.333035Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:03.333045Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:03.333067Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 90 partNo : 0 messageNo: 181 size 794 offset: -1
2025-11-03T16:52:03.333105Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:03.333117Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:03.333138Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 91 partNo : 0 messageNo: 182 size 802 offset: -1
2025-11-03T16:52:03.333174Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:03.333185Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:03.333206Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 92 partNo : 0 messageNo: 183 size 810 offset: -1
2025-11-03T16:52:03.333236Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:03.333247Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:03.333309Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:03.333330Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:03.333371Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:03.333382Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:03.333411Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:03.333436Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:03.333477Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:03.333492Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:03.333684Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:52:03.333731Z node 6 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:52:03.333749Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:52:03.333768Z node 6 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:52:03.333781Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:52:03.333794Z node 6 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:52:03.333805Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:52:03.333819Z node 6 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:52:03.333831Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:52:03.333845Z node 6 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:52:03.333980Z node 6 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 62 count 15 size 9752 actorID [6:7568542934045272658:2380]
2025-11-03T16:52:03.334040Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 184  requestId: <none> cookie: 93
2025-11-03T16:52:03.334068Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 185  requestId: <none> cookie: 94
2025-11-03T16:52:03.334083Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 186  requestId: <none> cookie: 95
2025-11-03T16:52:03.334100Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 187  requestId: <none> cookie: 96
2025-11-03T16:52:03.334115Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 188  requestId: <none> cookie: 97
2025-11-03T16:52:03.334157Z node 6 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-03T16:52:03.334207Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 9615 WriteNewSizeFromSupportivePartitions# 0
2025-11-03T16:52:03.334244Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:52:03.334278Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 63, partNo: 0, Offset: 62 is stored on disk
2025-11-03T16:52:03.334296Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:52:03.334335Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 64, partNo: 0, Offset: 63 is stored on disk
2025-11-03T16:52:03.334349Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:52:03.334364Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 65, partNo: 0, Offset: 64 is stored on disk
2025-11-03T16:52:03.334378Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:52:03.334394Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 66, partNo: 0, Offset: 65 is stored on disk
2025-11-03T16:52:03.334407Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:52:03.334429Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 67, partNo: 0, Offset: 66 is stored on disk
2025-11-03T16:52:03.334441Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:52:03.334457Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 68, partNo: 0, Offset: 67 is stored on disk
2025-11-03T16:52:03.334470Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:52:03.334485Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 69, partNo: 0, Offset: 68 is stored on disk
2025-11-03T16:52:03.334495Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:52:03.334511Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 70, partNo: 0, Offset: 69 is stored on disk
2025-11-03T16:52:03.334524Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:52:03.334545Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 71, partNo: 0, Offset: 70 is stored on disk
2025-11-03T16:52:03.334575Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:52:03.334597Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 72, partNo: 0, Offset: 71 is stored on disk
2025-11-03T16:52:03.334608Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:52:03.334632Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 73, partNo: 0, Offset: 72 is stored on disk
2025-11-03T16:52:03.334642Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:52:03.334661Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 74, partNo: 0, Offset: 73 is stored on disk
2025-11-03T16:52:03.334674Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:52:03.334690Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 75, partNo: 0, Offset: 74 is stored on disk
2025-11-03T16:52:03.334702Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:52:03.334720Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 76, partNo: 0, Offset: 75 is stored on disk
2025-11-03T16:52:03.334732Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:52:03.334751Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 77, partNo: 0, Offset: 76 is stored on disk
2025-11-03T16:52:03.334948Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:03.335014Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:03.335027Z node 6 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (15)
2025-11-03T16:52:03.335139Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 78 partNo 0
2025-11-03T16:52:03.337968Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:03.338048Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:03.338079Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:03.338106Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:03.338137Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:03.338387Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:52:03.338455Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:52:03.338499Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:52:03.337624Z node 6 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 62 partno 0 count 15 parts 0 suffix '63' size 9752
2025-11-03T16:52:03.339522Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 78 partNo 0 FormedBlobsCount 0 NewHead: Offset 77 PartNo 0 PackedSize 772 count 1 nextOffset 78 batches 1
2025-11-03T16:52:03.339601Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 79 partNo 0
2025-11-03T16:52:03.339642Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 79 partNo 0 FormedBlobsCount 0 NewHead: Offset 77 PartNo 0 PackedSize 1520 count 2 nextOffset 79 batches 1
2025-11-03T16:52:03.339665Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 80 partNo 0
2025-11-03T16:52:03.339689Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 80 partNo 0 FormedBlobsCount 0 NewHead: Offset 77 PartNo 0 PackedSize 2276 count 3 nextOffset 80 batches 1
2025-11-03T16:52:03.339727Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 81 partNo 0
2025-11-03T16:52:03.339748Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 81 partNo 0 FormedBlobsCount 0 NewHead: Offset 77 PartNo 0 PackedSize 3040 count 4 nextOffset 81 batches 1
2025-11-03T16:52:03.339773Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 82 partNo 0
2025-11-03T16:52:03.339798Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 82 partNo 0 FormedBlobsCount 0 NewHead: Offset 77 PartNo 0 PackedSize 3812 count 5 nextOffset 82 batches 1
2025-11-03T16:52:03.339822Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 83 partNo 0
2025-11-03T16:52:03.339844Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 83 partNo 0 FormedBlobsCount 0 NewHead: Offset 77 PartNo 0 PackedSize 4592 count 6 nextOffset 83 batches 1
2025-11-03T16:52:03.339862Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 84 partNo 0
2025-11-03T16:52:03.339882Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 84 partNo 0 FormedBlobsCount 0 NewHead: Offset 77 PartNo 0 PackedSize 5380 count 7 nextOffset 84 batches 1
2025-11-03T16:52:03.339903Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 85 partNo 0
2025-11-03T16:52:03.339922Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 85 partNo 0 FormedBlobsCount 0 NewHead: Offset 77 PartNo 0 PackedSize 6176 count 8 nextOffset 85 batches 1
2025-11-03T16:52:03.339951Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 86 partNo 0
2025-11-03T16:52:03.339991Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 86 partNo 0 FormedBlobsCount 0 NewHead: Offset 77 PartNo 0 PackedSize 6980 count 9 nextOffset 86 batches 1
2025-11-03T16:52:03.340027Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 87 partNo 0
2025-11-03T16:52:03.340050Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 87 partNo 0 FormedBlobsCount 0 NewHead: Offset 77 PartNo 0 PackedSize 7792 count 10 nextOffset 87 batches 1
2025-11-03T16:52:03.340070Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 88 partNo 0
2025-11-03T16:52:03.340091Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 88 partNo 0 FormedBlobsCount 0 NewHead: Offset 77 PartNo 0 PackedSize 8612 count 11 nextOffset 88 batches 1
2025-11-03T16:52:03.340113Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 89 partNo 0
2025-11-03T16:52:03.340132Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 89 partNo 0 FormedBlobsCount 0 NewHead: Offset 77 PartNo 0 PackedSize 9440 count 12 nextOffset 89 batches 1
2025-11-03T16:52:03.340154Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 90 partNo 0
2025-11-03T16:52:03.340175Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 90 partNo 0 FormedBlobsCount 0 NewHead: Offset 77 PartNo 0 PackedSize 10276 count 13 nextOffset 90 batches 1
2025-11-03T16:52:03.340197Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 91 partNo 0
2025-11-03T16:52:03.340228Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 91 partNo 0 FormedBlobsCount 0 NewHead: Offset 77 PartNo 0 PackedSize 11120 count 14 nextOffset 91 batches 1
2025-11-03T16:52:03.340250Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 92 partNo 0
2025-11-03T16:52:03.340270Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 92 partNo 0 FormedBlobsCount 0 NewHead: Offset 77 PartNo 0 PackedSize 11972 count 15 nextOffset 92 batches 1
2025-11-03T16:52:03.340290Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:03.340960Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 77,15 HeadOffset 77 endOffset 77 curOffset 92 d0000000000_00000000000000000077_00000_0000000015_00000? size 11552 WTime 1762188723340
2025-11-03T16:52:03.341103Z node 6 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:52:03.341170Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 129  requestId: <none> cookie: 63
2025-11-03T16:52:03.341253Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 130  requestId: <none> cookie: 64
2025-11-03T16:52:03.341277Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 131  requestId: <none> cookie: 65
2025-11-03T16:52:03.341298Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 132  requestId: <none> cookie: 66
2025-11-03T16:52:03.341336Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 133  requestId: <none> cookie: 67
2025-11-03T16:52:03.341368Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 139  requestId: <none> cookie: 68
2025-11-03T16:52:03.341393Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 140  requestId: <none> cookie: 69
2025-11-03T16:52:03.341414Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 141  requestId: <none> cookie: 70
2025-11-03T16:52:03.341434Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 142  requestId: <none> cookie: 71
2025-11-03T16:52:03.341455Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 143  requestId: <none> cookie: 72
2025-11-03T16:52:03.341476Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 149  requestId: <none> cookie: 73
2025-11-03T16:52:03.341498Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 150  requestId: <none> cookie: 74
2025-11-03T16:52:03.341519Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 151  requestId: <none> cookie: 75
2025-11-03T16:52:03.341565Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 152  requestId: <none> cookie: 76
2025-11-03T16:52:03.341586Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 153  requestId: <none> cookie: 77
2025-11-03T16:52:03.341682Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:03.341706Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:03.341760Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 93 partNo : 0 messageNo: 189 size 818 offset: -1
2025-11-03T16:52:03.341812Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:03.341821Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:03.341843Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 94 partNo : 0 messageNo: 190 size 826 offset: -1
2025-11-03T16:52:03.341877Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:03.341888Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:03.341909Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 95 partNo : 0 messageNo: 191 size 834 offset: -1
2025-11-03T16:52:03.341961Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:03.341977Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:03.342002Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 96 partNo : 0 messageNo: 192 size 842 offset: -1
2025-11-03T16:52:03.342046Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:03.342057Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:03.342077Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 97 partNo : 0 messageNo: 193 size 850 offset: -1
2025-11-03T16:52:03.342110Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:03.342120Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:03.342153Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:03.342163Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:03.342188Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:03.342199Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:03.342226Z node 6 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-03T16:52:03.342349Z node 6 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 77 partNo 0 count 15 size 11552
2025-11-03T16:52:03.342391Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:52:03.342442Z node 6 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:52:03.342456Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:52:03.342472Z node 6 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:52:03.342483Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:52:03.342499Z node 6 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:52:03.342510Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:52:03.342525Z node 6 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:52:03.342536Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:52:03.342568Z node 6 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:52:03.342786Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 194  requestId: <none> cookie: 98
2025-11-03T16:52:03.342811Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 195  requestId: <none> cookie: 99
2025-11-03T16:52:03.342826Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 196  requestId: <none> cookie: 100
2025-11-03T16:52:03.345948Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:03.346025Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:03.346058Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:03.346089Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:03.346119Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:03.346147Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:03.346177Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:03.346206Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:03.346258Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:03.346288Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:03.346344Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:03.346371Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:03.346396Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:03.346424Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:03.346451Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:03.346480Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:03.346515Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:03.346541Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:03.348258Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session got write response: sequence_numbers: 63 offsets: 62 already_written: false write_statistics { persist_duration_ms: 29 queued_in_partition_duration_ms: 19 }
2025-11-03T16:52:03.348319Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session: acknoledged message 63
2025-11-03T16:52:03.349946Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session got write response: sequence_numbers: 64 offsets: 63 already_written: false write_statistics { persist_duration_ms: 29 queued_in_partition_duration_ms: 10 }
2025-11-03T16:52:03.349994Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session: acknoledged message 64
2025-11-03T16:52:03.350192Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session got write response: sequence_numbers: 65 offsets: 64 already_written: false write_statistics { persist_duration_ms: 29 queued_in_partition_duration_ms: 10 }
2025-11-03T16:52:03.350217Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session: acknoledged message 65
2025-11-03T16:52:03.350334Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session got write response: sequence_numbers: 66 offsets: 65 already_written: false write_statistics { persist_duration_ms: 29 queued_in_partition_duration_ms: 10 }
2025-11-03T16:52:03.350357Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session: acknoledged message 66
2025-11-03T16:52:03.350472Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session got write response: sequence_numbers: 67 offsets: 66 already_written: false write_statistics { persist_duration_ms: 29 queued_in_partition_duration_ms: 10 }
2025-11-03T16:52:03.350496Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session: acknoledged message 67
2025-11-03T16:52:03.350630Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session got write response: sequence_numbers: 68 offsets: 67 already_written: false write_statistics { persist_duration_ms: 29 queued_in_partition_duration_ms: 5 }
2025-11-03T16:52:03.350665Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session: acknoledged message 68
2025-11-03T16:52:03.350779Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session got write response: sequence_numbers: 69 offsets: 68 already_written: false write_statistics { persist_duration_ms: 29 queued_in_partition_duration_ms: 5 }
2025-11-03T16:52:03.350803Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session: acknoledged message 69
2025-11-03T16:52:03.350913Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session got write response: sequence_numbers: 70 offsets: 69 already_written: false write_statistics { persist_duration_ms: 29 queued_in_partition_duration_ms: 5 }
2025-11-03T16:52:03.350938Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session: acknoledged message 70
2025-11-03T16:52:03.351047Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session got write response: sequence_numbers: 71 offsets: 70 already_written: false write_statistics { persist_duration_ms: 29 queued_in_partition_duration_ms: 5 }
2025-11-03T16:52:03.351073Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session: acknoledged message 71
2025-11-03T16:52:03.351182Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session got write response: sequence_numbers: 72 offsets: 71 already_written: false write_statistics { persist_duration_ms: 29 queued_in_partition_duration_ms: 5 }
2025-11-03T16:52:03.351201Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session: acknoledged message 72
2025-11-03T16:52:03.351301Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session got write response: sequence_numbers: 73 offsets: 72 already_written: false write_statistics { persist_duration_ms: 29 }
2025-11-03T16:52:03.351324Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session: acknoledged message 73
2025-11-03T16:52:03.351466Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session got write response: sequence_numbers: 74 offsets: 73 already_written: false write_statistics { persist_duration_ms: 29 }
2025-11-03T16:52:03.351500Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session: acknoledged message 74
2025-11-03T16:52:03.351609Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session got write response: sequence_numbers: 75 offsets: 74 already_written: false write_statistics { persist_duration_ms: 29 }
2025-11-03T16:52:03.351634Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session: acknoledged message 75
2025-11-03T16:52:03.351731Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session got write response: sequence_numbers: 76 offsets: 75 already_written: false write_statistics { persist_duration_ms: 29 }
2025-11-03T16:52:03.351751Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session: acknoledged message 76
2025-11-03T16:52:03.351850Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session got write response: sequence_numbers: 77 offsets: 76 already_written: false write_statistics { persist_duration_ms: 29 }
2025-11-03T16:52:03.351876Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session: acknoledged message 77
2025-11-03T16:52:03.351169Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:03.351222Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:03.351286Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 98 partNo : 0 messageNo: 197 size 858 offset: -1
2025-11-03T16:52:03.351371Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:03.351386Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:03.351413Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 99 partNo : 0 messageNo: 198 size 866 offset: -1
2025-11-03T16:52:03.351455Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:03.351469Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:03.351493Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 100 partNo : 0 messageNo: 199 size 874 offset: -1
2025-11-03T16:52:03.351567Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:52:03.351618Z node 6 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:52:03.351632Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:52:03.351651Z node 6 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:52:03.351663Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:52:03.351675Z node 6 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:52:03.355135Z node 6 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 77 count 15 size 11552 actorID [6:7568542934045272658:2380]
2025-11-03T16:52:03.355210Z node 6 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-03T16:52:03.355267Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 11415 WriteNewSizeFromSupportivePartitions# 0
2025-11-03T16:52:03.355307Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:52:03.355343Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 78, partNo: 0, Offset: 77 is stored on disk
2025-11-03T16:52:03.355364Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:52:03.355417Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 79, partNo: 0, Offset: 78 is stored on disk
2025-11-03T16:52:03.355433Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:52:03.355449Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 80, partNo: 0, Offset: 79 is stored on disk
2025-11-03T16:52:03.355463Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:52:03.355484Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 81, partNo: 0, Offset: 80 is stored on disk
2025-11-03T16:52:03.355497Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:52:03.355513Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 82, partNo: 0, Offset: 81 is stored on disk
2025-11-03T16:52:03.355527Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:52:03.355643Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 83, partNo: 0, Offset: 82 is stored on disk
2025-11-03T16:52:03.355659Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:52:03.355679Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 84, partNo: 0, Offset: 83 is stored on disk
2025-11-03T16:52:03.355693Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:52:03.355711Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 85, partNo: 0, Offset: 84 is stored on disk
2025-11-03T16:52:03.355721Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:52:03.355736Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 86, partNo: 0, Offset: 85 is stored on disk
2025-11-03T16:52:03.355748Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:52:03.355766Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 87, partNo: 0, Offset: 86 is stored on disk
2025-11-03T16:52:03.355777Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:52:03.355818Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 88, partNo: 0, Offset: 87 is stored on disk
2025-11-03T16:52:03.355846Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:52:03.355871Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 89, partNo: 0, Offset: 88 is stored on disk
2025-11-03T16:52:03.355885Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:52:03.355904Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 90, partNo: 0, Offset: 89 is stored on disk
2025-11-03T16:52:03.355918Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:52:03.355935Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 91, partNo: 0, Offset: 90 is stored on disk
2025-11-03T16:52:03.355947Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:52:03.355998Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 92, partNo: 0, Offset: 91 is stored on disk
2025-11-03T16:52:03.356196Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:03.356250Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:03.356263Z node 6 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (8)
2025-11-03T16:52:03.356363Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 93 partNo 0
2025-11-03T16:52:03.358984Z node 6 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 77 partno 0 count 15 parts 0 suffix '63' size 11552
2025-11-03T16:52:03.407399Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 93 partNo 0 FormedBlobsCount 0 NewHead: Offset 92 PartNo 0 PackedSize 892 count 1 nextOffset 93 batches 1
2025-11-03T16:52:03.407770Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 94 partNo 0
2025-11-03T16:52:03.407825Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 94 partNo 0 FormedBlobsCount 0 NewHead: Offset 92 PartNo 0 PackedSize 1760 count 2 nextOffset 94 batches 1
2025-11-03T16:52:03.407853Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 95 partNo 0
2025-11-03T16:52:03.407875Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 95 partNo 0 FormedBlobsCount 0 NewHead: Offset 92 PartNo 0 PackedSize 2636 count 3 nextOffset 95 batches 1
2025-11-03T16:52:03.407899Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 96 partNo 0
2025-11-03T16:52:03.407924Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 96 partNo 0 FormedBlobsCount 0 NewHead: Offset 92 PartNo 0 PackedSize 3520 count 4 nextOffset 96 batches 1
2025-11-03T16:52:03.407947Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 97 partNo 0
2025-11-03T16:52:03.407971Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 97 partNo 0 FormedBlobsCount 0 NewHead: Offset 92 PartNo 0 PackedSize 4412 count 5 nextOffset 97 batches 1
2025-11-03T16:52:03.408016Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 98 partNo 0
2025-11-03T16:52:03.408035Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 98 partNo 0 FormedBlobsCount 0 NewHead: Offset 92 PartNo 0 PackedSize 5312 count 6 nextOffset 98 batches 1
2025-11-03T16:52:03.408059Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 99 partNo 0
2025-11-03T16:52:03.408079Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 99 partNo 0 FormedBlobsCount 0 NewHead: Offset 92 PartNo 0 PackedSize 6220 count 7 nextOffset 99 batches 1
2025-11-03T16:52:03.408100Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 100 partNo 0
2025-11-03T16:52:03.408119Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 100 partNo 0 FormedBlobsCount 0 NewHead: Offset 92 PartNo 0 PackedSize 7136 count 8 nextOffset 100 batches 1
2025-11-03T16:52:03.408142Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:03.408779Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 92,8 HeadOffset 92 endOffset 92 curOffset 100 d0000000000_00000000000000000092_00000_0000000008_00000? size 6940 WTime 1762188723408
2025-11-03T16:52:03.408922Z node 6 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:52:03.409012Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 159  requestId: <none> cookie: 78
2025-11-03T16:52:03.409080Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 160  requestId: <none> cookie: 79
2025-11-03T16:52:03.409106Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 161  requestId: <none> cookie: 80
2025-11-03T16:52:03.409132Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 162  requestId: <none> cookie: 81
2025-11-03T16:52:03.409155Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 163  requestId: <none> cookie: 82
2025-11-03T16:52:03.409183Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 169  requestId: <none> cookie: 83
2025-11-03T16:52:03.409208Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 170  requestId: <none> cookie: 84
2025-11-03T16:52:03.409231Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 171  requestId: <none> cookie: 85
2025-11-03T16:52:03.409254Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 172  requestId: <none> cookie: 86
2025-11-03T16:52:03.409278Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 173  requestId: <none> cookie: 87
2025-11-03T16:52:03.409302Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 179  requestId: <none> cookie: 88
2025-11-03T16:52:03.409329Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 180  requestId: <none> cookie: 89
2025-11-03T16:52:03.409354Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 181  requestId: <none> cookie: 90
2025-11-03T16:52:03.409380Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 182  requestId: <none> cookie: 91
2025-11-03T16:52:03.409404Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 183  requestId: <none> cookie: 92
2025-11-03T16:52:03.409459Z node 6 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:52:03.409481Z node 6 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-03T16:52:03.409617Z node 6 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 92 partNo 0 count 8 size 6940
2025-11-03T16:52:03.411918Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:03.412018Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:03.412055Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:03.412087Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:03.412111Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:03.412166Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:03.412196Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:03.412225Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:03.412249Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:03.412274Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:03.412305Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:03.412337Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:03.412367Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:03.412392Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:03.412422Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:03.416623Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session got write response: sequence_numbers: 78 offsets: 77 already_written: false write_statistics { persist_duration_ms: 16 queued_in_partition_duration_ms: 25 }
2025-11-03T16:52:03.416687Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session: acknoledged message 78
2025-11-03T16:52:03.416889Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session got write response: sequence_numbers: 79 offsets: 78 already_written: false write_statistics { persist_duration_ms: 16 queued_in_partition_duration_ms: 25 }
2025-11-03T16:52:03.416918Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session: acknoledged message 79
2025-11-03T16:52:03.417033Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session got write response: sequence_numbers: 80 offsets: 79 already_written: false write_statistics { persist_duration_ms: 16 queued_in_partition_duration_ms: 25 }
2025-11-03T16:52:03.417055Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session: acknoledged message 80
2025-11-03T16:52:03.417166Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session got write response: sequence_numbers: 81 offsets: 80 already_written: false write_statistics { persist_duration_ms: 16 queued_in_partition_duration_ms: 25 }
2025-11-03T16:52:03.417192Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session: acknoledged message 81
2025-11-03T16:52:03.417294Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session got write response: sequence_numbers: 82 offsets: 81 already_written: false write_statistics { persist_duration_ms: 16 queued_in_partition_duration_ms: 25 }
2025-11-03T16:52:03.417317Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session: acknoledged message 82
2025-11-03T16:52:03.417426Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session got write response: sequence_numbers: 83 offsets: 82 already_written: false write_statistics { persist_duration_ms: 16 queued_in_partition_duration_ms: 11 }
2025-11-03T16:52:03.417452Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session: acknoledged message 83
2025-11-03T16:52:03.417562Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session got write response: sequence_numbers: 84 offsets: 83 already_written: false write_statistics { persist_duration_ms: 16 queued_in_partition_duration_ms: 11 }
2025-11-03T16:52:03.417588Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session: acknoledged message 84
2025-11-03T16:52:03.417786Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session got write response: sequence_numbers: 85 offsets: 84 already_written: false write_statistics { persist_duration_ms: 16 queued_in_partition_duration_ms: 11 }
2025-11-03T16:52:03.417819Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session: acknoledged message 85
2025-11-03T16:52:03.417934Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session got write response: sequence_numbers: 86 offsets: 85 already_written: false write_statistics { persist_duration_ms: 12 queued_in_partition_duration_ms: 11 }
2025-11-03T16:52:03.417957Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session: acknoledged message 86
2025-11-03T16:52:03.418060Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session got write response: sequence_numbers: 87 offsets: 86 already_written: false write_statistics { persist_duration_ms: 11 queued_in_partition_duration_ms: 11 }
2025-11-03T16:52:03.418083Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session: acknoledged message 87
2025-11-03T16:52:03.418185Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session got write response: sequence_numbers: 88 offsets: 87 already_written: false write_statistics { persist_duration_ms: 11 queued_in_partition_duration_ms: 8 }
2025-11-03T16:52:03.418213Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session: acknoledged message 88
2025-11-03T16:52:03.418318Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session got write response: sequence_numbers: 89 offsets: 88 already_written: false write_statistics { persist_duration_ms: 11 queued_in_partition_duration_ms: 8 }
2025-11-03T16:52:03.418339Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session: acknoledged message 89
2025-11-03T16:52:03.418438Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session got write response: sequence_numbers: 90 offsets: 89 already_written: false write_statistics { persist_duration_ms: 11 queued_in_partition_duration_ms: 8 }
2025-11-03T16:52:03.418460Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session: acknoledged message 90
2025-11-03T16:52:03.418575Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session got write response: sequence_numbers: 91 offsets: 90 already_written: false write_statistics { persist_duration_ms: 11 queued_in_partition_duration_ms: 8 }
2025-11-03T16:52:03.418605Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session: acknoledged message 91
2025-11-03T16:52:03.418731Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session got write response: sequence_numbers: 92 offsets: 91 already_written: false write_statistics { persist_duration_ms: 11 queued_in_partition_duration_ms: 8 }
2025-11-03T16:52:03.418756Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session: acknoledged message 92
2025-11-03T16:52:03.419459Z node 6 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 92 count 8 size 6940 actorID [6:7568542934045272658:2380]
2025-11-03T16:52:03.419528Z node 6 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-03T16:52:03.419593Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 6824 WriteNewSizeFromSupportivePartitions# 0
2025-11-03T16:52:03.419635Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:52:03.419672Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 93, partNo: 0, Offset: 92 is stored on disk
2025-11-03T16:52:03.419692Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:52:03.419711Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 94, partNo: 0, Offset: 93 is stored on disk
2025-11-03T16:52:03.419725Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:52:03.419745Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 95, partNo: 0, Offset: 94 is stored on disk
2025-11-03T16:52:03.419758Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:52:03.419779Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 96, partNo: 0, Offset: 95 is stored on disk
2025-11-03T16:52:03.419793Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:52:03.419810Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 97, partNo: 0, Offset: 96 is stored on disk
2025-11-03T16:52:03.419822Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:52:03.419847Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 98, partNo: 0, Offset: 97 is stored on disk
2025-11-03T16:52:03.419860Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:52:03.419879Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 99, partNo: 0, Offset: 98 is stored on disk
2025-11-03T16:52:03.419891Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:52:03.419910Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 100, partNo: 0, Offset: 99 is stored on disk
2025-11-03T16:52:03.420136Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:03.420153Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:03.420171Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:03.420213Z node 6 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:52:03.420267Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 189  requestId: <none> cookie: 93
2025-11-03T16:52:03.420317Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 190  requestId: <none> cookie: 94
2025-11-03T16:52:03.420340Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 191  requestId: <none> cookie: 95
2025-11-03T16:52:03.420371Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 192  requestId: <none> cookie: 96
2025-11-03T16:52:03.420393Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 193  requestId: <none> cookie: 97
2025-11-03T16:52:03.420415Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 197  requestId: <none> cookie: 98
2025-11-03T16:52:03.420438Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 198  requestId: <none> cookie: 99
2025-11-03T16:52:03.420462Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 199  requestId: <none> cookie: 100
2025-11-03T16:52:03.422036Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:03.422112Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:03.422140Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:03.422165Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:03.422191Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:03.422217Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:03.422270Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:03.422297Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:03.421635Z node 6 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 92 partno 0 count 8 parts 0 suffix '63' size 6940
2025-11-03T16:52:03.424565Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session got write response: sequence_numbers: 93 offsets: 92 already_written: false write_statistics { persist_duration_ms: 13 queued_in_partition_duration_ms: 63 }
2025-11-03T16:52:03.424627Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session: acknoledged message 93
2025-11-03T16:52:03.424835Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session got write response: sequence_numbers: 94 offsets: 93 already_written: false write_statistics { persist_duration_ms: 13 queued_in_partition_duration_ms: 63 }
2025-11-03T16:52:03.424863Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session: acknoledged message 94
2025-11-03T16:52:03.424990Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session got write response: sequence_numbers: 95 offsets: 94 already_written: false write_statistics { persist_duration_ms: 13 queued_in_partition_duration_ms: 63 }
2025-11-03T16:52:03.425019Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session: acknoledged message 95
2025-11-03T16:52:03.425135Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session got write response: sequence_numbers: 96 offsets: 95 already_written: false write_statistics { persist_duration_ms: 13 queued_in_partition_duration_ms: 63 }
2025-11-03T16:52:03.425160Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session: acknoledged message 96
2025-11-03T16:52:03.425266Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session got write response: sequence_numbers: 97 offsets: 96 already_written: false write_statistics { persist_duration_ms: 13 queued_in_partition_duration_ms: 63 }
2025-11-03T16:52:03.425285Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session: acknoledged message 97
2025-11-03T16:52:03.425394Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session got write response: sequence_numbers: 98 offsets: 97 already_written: false write_statistics { persist_duration_ms: 8 queued_in_partition_duration_ms: 59 }
2025-11-03T16:52:03.425417Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session: acknoledged message 98
2025-11-03T16:52:03.425509Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session got write response: sequence_numbers: 99 offsets: 98 already_written: false write_statistics { persist_duration_ms: 8 queued_in_partition_duration_ms: 59 }
2025-11-03T16:52:03.425529Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session: acknoledged message 99
2025-11-03T16:52:03.425632Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session got write response: sequence_numbers: 100 offsets: 99 already_written: false write_statistics { persist_duration_ms: 8 queued_in_partition_duration_ms: 59 }
2025-11-03T16:52:03.425654Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session: acknoledged message 100
2025-11-03T16:52:03.472184Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session will now close
2025-11-03T16:52:03.472281Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session: aborting
2025-11-03T16:52:03.472943Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session: gracefully shut down, all writes complete
2025-11-03T16:52:03.473172Z :INFO: [/Root] [/Root] [4eb5b9e1-3b2b514b-2cc25f18-3783ec1c] Starting read session
2025-11-03T16:52:03.473213Z :DEBUG: [/Root] [/Root] [4eb5b9e1-3b2b514b-2cc25f18-3783ec1c] Starting cluster discovery
2025-11-03T16:52:03.476332Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session is aborting and will not restart
2025-11-03T16:52:03.477722Z node 5 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|66942439-cc3799b0-f098c35b-1958637c_0 grpc read done: success: 0 data: 
2025-11-03T16:52:03.477755Z node 5 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 2 sessionId: src_id|66942439-cc3799b0-f098c35b-1958637c_0 grpc read failed
2025-11-03T16:52:03.477807Z node 5 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 2 sessionId: src_id|66942439-cc3799b0-f098c35b-1958637c_0 grpc closed
2025-11-03T16:52:03.477827Z node 5 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2 sessionId: src_id|66942439-cc3799b0-f098c35b-1958637c_0 is DEAD
2025-11-03T16:52:03.479052Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-11-03T16:52:03.479645Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [5:7568542932380783911:2490] destroyed
2025-11-03T16:52:03.479702Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-11-03T16:52:03.479744Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:03.479763Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:03.479778Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:03.488244Z :DEBUG: [/Root] [/Root] [4eb5b9e1-3b2b514b-2cc25f18-3783ec1c] Cluster discovery request succeeded
2025-11-03T16:52:03.488362Z :DEBUG: [/Root] [/Root] [4eb5b9e1-3b2b514b-2cc25f18-3783ec1c] Starting session to cluster dc1 (localhost:62067)
2025-11-03T16:52:03.488561Z :DEBUG: [/Root] [/Root] [4eb5b9e1-3b2b514b-2cc25f18-3783ec1c] [dc1] In Reconnect, ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:52:03.488602Z :DEBUG: [/Root] [/Root] [4eb5b9e1-3b2b514b-2cc25f18-3783ec1c] [dc1] New values: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:52:03.488651Z :DEBUG: [/Root] [/Root] [4eb5b9e1-3b2b514b-2cc25f18-3783ec1c] [dc1] Reconnecting session to cluster dc1 in 0.000000s
2025-11-03T16:52:03.493066Z :DEBUG: [/Root] [/Root] [4eb5b9e1-3b2b514b-2cc25f18-3783ec1c] [dc1] Successfully connected. Initializing session
2025-11-03T16:52:03.496868Z node 5 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:109: new grpc connection
2025-11-03T16:52:03.496897Z node 5 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:131: new session created cookie 1
2025-11-03T16:52:03.498217Z node 5 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { topic: "test-topic" } read_only_original: true consumer: "shared/user" read_params { max_read_size: 104857600 } } }
2025-11-03T16:52:03.498478Z node 5 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 1 consumer shared/user session shared/user_5_1_13114544046380980386_v1 read init: from# ipv6:[::1]:60422, request# { init_request { topics_read_settings { topic: "test-topic" } read_only_original: true consumer: "shared/user" read_params { max_read_size: 104857600 } } }
2025-11-03T16:52:03.498994Z node 5 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 1 consumer shared/user session shared/user_5_1_13114544046380980386_v1 auth for : user
2025-11-03T16:52:03.499966Z node 5 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 1 consumer shared/user session shared/user_5_1_13114544046380980386_v1 Handle describe topics response
2025-11-03T16:52:03.500139Z node 5 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 1 consumer shared/user session shared/user_5_1_13114544046380980386_v1 auth is DEAD
2025-11-03T16:52:03.500221Z node 5 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 1 consumer shared/user session shared/user_5_1_13114544046380980386_v1 auth ok: topics# 1, initDone# 0
2025-11-03T16:52:03.501597Z node 5 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 1 consumer shared/user session shared/user_5_1_13114544046380980386_v1 register session: topic# rt3.dc1--test-topic
2025-11-03T16:52:03.503513Z :INFO: [/Root] [/Root] [4eb5b9e1-3b2b514b-2cc25f18-3783ec1c] [dc1] Server session id: shared/user_5_1_13114544046380980386_v1
2025-11-03T16:52:03.503778Z :DEBUG: [/Root] [/Root] [4eb5b9e1-3b2b514b-2cc25f18-3783ec1c] [dc1] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:52:03.507276Z node 5 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_5_1_13114544046380980386_v1 grpc read done: success# 1, data# { read { } }
2025-11-03T16:52:03.507496Z node 5 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_5_1_13114544046380980386_v1 got read request: guid# 54b4a606-1d471631-ebd89796-1fc57670
2025-11-03T16:52:03.508233Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:03.508267Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:03.508284Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:03.512611Z node 5 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1655: [72075186224037893][rt3.dc1--test-topic] pipe [5:7568542936675751234:2495] connected; active server actors: 1
2025-11-03T16:52:03.512990Z node 5 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1706: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [5:7568542936675751234:2495] session shared/user_5_1_13114544046380980386_v1
2025-11-03T16:52:03.513058Z node 5 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:639: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-11-03T16:52:03.513125Z node 5 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:669: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-11-03T16:52:03.513177Z node 5 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:871: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_5_1_13114544046380980386_v1" (Sender=[5:7568542936675751231:2495], Pipe=[5:7568542936675751234:2495], Partitions=[], ActiveFamilyCount=0)
2025-11-03T16:52:03.513226Z node 5 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1186: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-11-03T16:52:03.513295Z node 5 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1258: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-11-03T16:52:03.513359Z node 5 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1305: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_5_1_13114544046380980386_v1" (Sender=[5:7568542936675751231:2495], Pipe=[5:7568542936675751234:2495], Partitions=[], ActiveFamilyCount=0)
2025-11-03T16:52:03.513441Z node 5 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:549: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_5_1_13114544046380980386_v1" sender [5:7568542936675751231:2495] lock partition 0 for ReadingSession "shared/user_5_1_13114544046380980386_v1" (Sender=[5:7568542936675751231:2495], Pipe=[5:7568542936675751234:2495], Partitions=[], ActiveFamilyCount=1) generation 1 step 1
2025-11-03T16:52:03.513501Z node 5 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1325: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-11-03T16:52:03.513534Z node 5 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1402: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000213s
2025-11-03T16:52:03.514606Z node 5 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 1 consumer shared/user session shared/user_5_1_13114544046380980386_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 1 Session: "shared/user_5_1_13114544046380980386_v1" ClientId: "user" PipeClient { RawX1: 7568542936675751234 RawX2: 4503621102209471 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-11-03T16:52:03.514700Z node 5 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 1 consumer shared/user session shared/user_5_1_13114544046380980386_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-11-03T16:52:03.516348Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [5:7568542936675751237:2498], now have 1 active actors on pipe
2025-11-03T16:52:03.516340Z node 5 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_5_1_13114544046380980386_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 1, pipe: [5:7568542936675751237:2498]
2025-11-03T16:52:03.520212Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:03.520260Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:03.520298Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:1748: [PQ: 72075186224037892] Created session shared/user_5_1_13114544046380980386_v1 on pipe: [5:7568542936675751237:2498]
2025-11-03T16:52:03.520378Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:03.520404Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:03.520418Z node 6 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-03T16:52:03.520486Z node 6 :PERSQUEUE DEBUG: partition.cpp:3666: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_5_1_13114544046380980386_v1
2025-11-03T16:52:03.520502Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:03.520610Z node 6 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_5_1_13114544046380980386_v1:1 with generation 1
2025-11-03T16:52:03.520643Z node 6 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-03T16:52:03.525595Z node 6 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-03T16:52:03.525678Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-11-03T16:52:03.525705Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:03.525719Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:03.525735Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:03.525768Z node 6 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:52:03.525804Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-11-03T16:52:03.526391Z node 5 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_5_1_13114544046380980386_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 100 WriteTimestampMS: 1762188722988 CreateTimestampMS: 1762188722976 SizeLag: 42655 WriteTimestampEstimateMS: 1762188723508 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-11-03T16:52:03.526438Z node 5 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 1 consumer shared/user session shared/user_5_1_13114544046380980386_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 100 readOffset 0 committedOffset 0
2025-11-03T16:52:03.526486Z node 5 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 1 consumer shared/user session shared/user_5_1_13114544046380980386_v1 sending to client partition status
2025-11-03T16:52:03.527514Z :INFO: [/Root] [/Root] [4eb5b9e1-3b2b514b-2cc25f18-3783ec1c] [dc1] Confirm partition stream create. Partition stream id: 1. Cluster: "dc1". Topic: "test-topic". Partition: 0. Read offset: (NULL)
2025-11-03T16:52:03.528766Z node 5 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_5_1_13114544046380980386_v1 grpc read done: success# 1, data# { start_read { topic { path: "test-topic" } cluster: "dc1" assign_id: 1 } }
2025-11-03T16:52:03.528922Z node 5 :PQ_READ_PROXY INFO: read_session_actor.cpp:539: session cookie 1 consumer shared/user session shared/user_5_1_13114544046380980386_v1 got StartRead from client: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 0, commitOffset# 0
2025-11-03T16:52:03.528975Z node 5 :PQ_READ_PROXY INFO: partition_actor.cpp:1023: session cookie 1 consumer shared/user session shared/user_5_1_13114544046380980386_v1 Start reading TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 100 readOffset 0 committedOffset 0 clientCommitOffset 0 clientReadOffset 0
2025-11-03T16:52:03.529009Z node 5 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_5_1_13114544046380980386_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 0 endOffset 100
2025-11-03T16:52:03.529076Z node 5 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_5_1_13114544046380980386_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 0, endOffset# 100, WTime# 1762188722988, sizeLag# 42655
2025-11-03T16:52:03.529095Z node 5 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_5_1_13114544046380980386_v1TEvPartitionReady. Aval parts: 1
2025-11-03T16:52:03.529144Z node 5 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_5_1_13114544046380980386_v1 performing read request: guid# 54b4a606-1d471631-ebd89796-1fc57670, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 120, size# 51186, partitionsAsked# 1, maxTimeLag# 0ms
2025-11-03T16:52:03.529243Z node 5 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_5_1_13114544046380980386_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 120 maxSize 51186 maxTimeLagMs 0 readTimestampMs 0 readOffset 0 EndOffset 100 ClientCommitOffset 0 committedOffset 0 Guid 54b4a606-1d471631-ebd89796-1fc57670
2025-11-03T16:52:03.532357Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:03.532395Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:03.532509Z node 6 :PERSQUEUE DEBUG: partition_read.cpp:880: [72075186224037892][Partition][0][StateIdle] read cookie 4 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 partno 0 count 120 size 51186 endOffset 100 max time lag 0ms effective offset 0
2025-11-03T16:52:03.533779Z node 6 :PERSQUEUE DEBUG: partition_read.cpp:1105: [72075186224037892][Partition][0][StateIdle] read cookie 4 added 8 blobs, size 49455 count 100 last offset 92, current partition end offset: 100
2025-11-03T16:52:03.533801Z node 6 :PERSQUEUE DEBUG: partition_read.cpp:1121: [72075186224037892][Partition][0][StateIdle] Reading cookie 4. Send blob request.
2025-11-03T16:52:03.533855Z node 6 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 0 partno 0 count 1 parts_count 0 source 1 size 140 accessed 1 times before, last time 2025-11-03T16:52:03.000000Z
2025-11-03T16:52:03.533873Z node 6 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 1 partno 0 count 10 parts_count 0 source 1 size 1423 accessed 0 times before, last time 2025-11-03T16:52:03.000000Z
2025-11-03T16:52:03.533889Z node 6 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 11 partno 0 count 20 parts_count 0 source 1 size 5204 accessed 0 times before, last time 2025-11-03T16:52:03.000000Z
2025-11-03T16:52:03.533908Z node 6 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 31 partno 0 count 16 parts_count 0 source 1 size 6492 accessed 0 times before, last time 2025-11-03T16:52:03.000000Z
2025-11-03T16:52:03.533924Z node 6 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 47 partno 0 count 15 parts_count 0 source 1 size 7952 accessed 0 times before, last time 2025-11-03T16:52:03.000000Z
2025-11-03T16:52:03.533939Z node 6 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 62 partno 0 count 15 parts_count 0 source 1 size 9752 accessed 0 times before, last time 2025-11-03T16:52:03.000000Z
2025-11-03T16:52:03.533955Z node 6 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 77 partno 0 count 15 parts_count 0 source 1 size 11552 accessed 0 times before, last time 2025-11-03T16:52:03.000000Z
2025-11-03T16:52:03.533975Z node 6 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 92 partno 0 count 8 parts_count 0 source 1 size 6940 accessed 0 times before, last time 2025-11-03T16:52:03.000000Z
2025-11-03T16:52:03.534018Z node 6 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 4. All 8 blobs are from cache.
2025-11-03T16:52:03.534083Z node 6 :PERSQUEUE DEBUG: partition_read.cpp:572: FormAnswer for 8 blobs
2025-11-03T16:52:03.534330Z node 6 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 0 totakecount 1 count 1 size 122 from pos 0 cbcount 1
2025-11-03T16:52:03.534514Z node 6 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 1 totakecount 10 count 10 size 1403 from pos 0 cbcount 10
2025-11-03T16:52:03.534700Z node 6 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 11 totakecount 20 count 20 size 5184 from pos 0 cbcount 20
2025-11-03T16:52:03.534885Z node 6 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 31 totakecount 16 count 16 size 6472 from pos 0 cbcount 16
2025-11-03T16:52:03.535052Z node 6 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 47 totakecount 15 count 15 size 7932 from pos 0 cbcount 15
2025-11-03T16:52:03.535248Z node 6 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 62 totakecount 15 count 15 size 9732 from pos 0 cbcount 15
2025-11-03T16:52:03.535434Z node 6 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 77 totakecount 15 count 15 size 11532 from pos 0 cbcount 15
2025-11-03T16:52:03.535581Z node 6 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 92 totakecount 8 count 8 size 6920 from pos 0 cbcount 8
2025-11-03T16:52:03.535960Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-03T16:52:03.536072Z node 6 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 0 suffix '63'
2025-11-03T16:52:03.536097Z node 6 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 1 partno 0 count 10 parts 0 suffix '63'
2025-11-03T16:52:03.536115Z node 6 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 11 partno 0 count 20 parts 0 suffix '63'
2025-11-03T16:52:03.536136Z node 6 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 31 partno 0 count 16 parts 0 suffix '63'
2025-11-03T16:52:03.536168Z node 6 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 47 partno 0 count 15 parts 0 suffix '63'
2025-11-03T16:52:03.536188Z node 6 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 62 partno 0 count 15 parts 0 suffix '63'
2025-11-03T16:52:03.536206Z node 6 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 77 partno 0 count 15 parts 0 suffix '63'
2025-11-03T16:52:03.536224Z node 6 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 92 partno 0 count 8 parts 0 suffix '63'
2025-11-03T16:52:03.549188Z node 5 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_5_1_13114544046380980386_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 100 Result { Offset: 0 Data: "... 80 bytes ..." SourceId: "\000src_id" SeqNo: 1 WriteTimestampMS: 1762188722988 CreateTimestampMS: 1762188722976 UncompressedSize: 9 PartitionKey: "" ExplicitHash: "" } Result { Offset: 1 Data: "... 88 bytes ..." SourceId: "\000src_id" SeqNo: 2 WriteTimestampMS: 1762188723008 CreateTimestampMS: 1762188722977 UncompressedSize: 17 PartitionKey: "" ExplicitHash: "" } Result { Offset: 2 Data: "... 96 bytes ..." SourceId: "\000src_id" SeqNo: 3 WriteTimestampMS: 1762188723128 CreateTimestampMS: 1762188722977 UncompressedSize: 25 PartitionKey: "" ExplicitHash: "" } Result { Offset: 3 Data: "... 104 bytes ..." SourceId: "\000src_id" SeqNo: 4 WriteTimestampMS: 1762188723128 CreateTimestampMS: 1762188722977 UncompressedSize: 33 PartitionKey: "" ExplicitHash: "" } Result { Offset: 4 Data: "... 112 bytes ..." SourceId: "\000src_id" SeqNo: 5 WriteTimestampMS: 1762188723128 CreateTimestampMS: 1762188722977 UncompressedSize: 41 PartitionKey: "" ExplicitHash: "" } Result { Offset: 5 Data: "... 120 bytes ..." SourceId: "\000src_id" SeqNo: 6 WriteTimestampMS: 1762188723128 CreateTimestampMS: 1762188722977 UncompressedSize: 49 PartitionKey: "" ExplicitHash: "" } Result { Offset: 6 Data: "... 128 bytes ..." SourceId: "\000src_id" SeqNo: 7 WriteTimestampMS: 1762188723128 CreateTimestampMS: 1762188722977 UncompressedSize: 57 PartitionKey: "" ExplicitHash: "" } Result { Offset: 7 Data: "... 136 bytes ..." SourceId: "\000src_id" SeqNo: 8 WriteTimestampMS: 1762188723128 CreateTimestampMS: 1762188722977 UncompressedSize: 65 PartitionKey: "" ExplicitHash: "" } Result { Offset: 8 Data: "... 144 bytes ..." SourceId: "\000src_id" SeqNo: 9 WriteTimestampMS: 1762188723128 CreateTimestampMS: 1762188722977 UncompressedSize: 73 PartitionKey: "" ExplicitHash: "" } Result { Offset: 9 Data: "... 152 bytes ..." SourceId: "\000src_id" SeqNo: 10 WriteTimestampMS: 1762188723128 CreateTimestampMS: 1762188722977 UncompressedSize: 81 PartitionKey: "" ExplicitHash: "" } Result { Offset: 10 Data: "... 161 bytes ..." SourceId: "\000src_id" SeqNo: 11 WriteTimestampMS: 1762188723128 CreateTimestampMS: 1762188722977 UncompressedSize: 90 PartitionKey: "" ExplicitHash: "" } Result { Offset: 11 Data: "... 169 bytes ..." SourceId: "\000src_id" SeqNo: 12 WriteTimestampMS: 1762188723160 CreateTimestampMS: 1762188722978 UncompressedSize: 98 PartitionKey: "" ExplicitHash: "" } Result { Offset: 12 Data: "... 177 bytes ..." SourceId: "\000src_id" SeqNo: 13 WriteTimestampMS: 1762188723164 CreateTimestampMS: 1762188722978 UncompressedSize: 106 PartitionKey: "" ExplicitHash: "" } Result { Offset: 13 Data: "... 185 bytes ..." SourceId: "\000src_id" SeqNo: 14 WriteTimestampMS: 1762188723164 CreateTimestampMS: 1762188722978 UncompressedSize: 114 PartitionKey: "" ExplicitHash: "" } Result { Offset: 14 Data: "... 193 bytes ..." SourceId: "\000src_id" SeqNo: 15 WriteTimestampMS: 1762188723164 CreateTimestampMS: 1762188722978 UncompressedSize: 122 PartitionKey: "" ExplicitHash: "" } Result { Offset: 15 Data: "... 202 bytes ..." SourceId: "\000src_id" SeqNo: 16 WriteTimestampMS: 1762188723164 CreateTimestampMS: 1762188722978 UncompressedSize: 130 PartitionKey: "" ExplicitHash: "" } Result { Offset: 16 Data: "... 210 bytes ..." SourceId: "\000src_id" SeqNo: 17 WriteTimestampMS: 1762188723164 CreateTimestampMS: 1762188722978 UncompressedSize: 138 PartitionKey: "" ExplicitHash: "" } Result { Offset: 17 Data: "... 218 bytes ..." SourceId: "\000src_id" SeqNo: 18 WriteTimestampMS: 1762188723164 CreateTimestampMS: 1762188722978 UncompressedSize: 146 PartitionKey: "" ExplicitHash: "" } Result { Offset: 18 Data: "... 226 bytes ..." SourceId: "\000src_id" SeqNo: 19 WriteTimestampMS: 1762188723164 CreateTimestampMS: 1762188722978 UncompressedSize: 154 PartitionKey: "" ExplicitHash: "" } Result { Offset: 19 Data: "... 234 bytes ..." SourceId: "\000src_id" SeqNo: 20 WriteTimestampMS: 1762188723164 CreateTimestampMS: 1762188722978 UncompressedSize: 162 PartitionKey: "" ExplicitHash: "" } Result { Offset: 20 Data: "... 242 bytes ..." SourceId: "\000src_id" SeqNo: 21 WriteTimestampMS: 1762188723164 CreateTimestampMS: 1762188722978 UncompressedSize: 170 PartitionKey: "" ExplicitHash: "" } Result { Offset: 21 Data: "... 250 bytes ..." SourceId: "\000src_id" SeqNo: 22 WriteTimestampMS: 1762188723164 CreateTimestampMS: 1762188722978 UncompressedSize: 178 PartitionKey: "" ExplicitHash: "" } Result { Offset: 22 Data: "... 258 bytes ..." SourceId: "\000src_id" SeqNo: 23 WriteTimestampMS: 1762188723164 CreateTimestampMS: 1762188722979 UncompressedSize: 186 PartitionKey: "" ExplicitHash: "" } Result { Offset: 23 Data: "... 266 bytes ..." SourceId: "\000src_id" SeqNo: 24 WriteTimestampMS: 1762188723164 CreateTimestampMS: 1762188722979 UncompressedSize: 194 PartitionKey: "" ExplicitHash: "" } Result { Offset: 24 Data: "... 274 bytes ..." SourceId: "\000src_id" SeqNo: 25 WriteTimestampMS: 1762188723164 CreateTimestampMS: 1762188722979 UncompressedSize: 202 PartitionKey: "" ExplicitHash: "" } Result { Offset: 25 Data: "... 282 bytes ..." SourceId: "\000src_id" SeqNo: 26 WriteTimestampMS: 1762188723164 CreateTimestampMS: 1762188722979 UncompressedSize: 210 PartitionKey: "" ExplicitHash: "" } Result { Offset: 26 Data: "... 290 bytes ..." SourceId: "\000src_id" SeqNo: 27 WriteTimestampMS: 1762188723164 CreateTimestampMS: 1762188722979 UncompressedSize: 218 PartitionKey: "" ExplicitHash: "" } Result { Offset: 27 Data: "... 298 bytes ..." SourceId: "\000src_id" SeqNo: 28 WriteTimestampMS: 1762188723164 CreateTimestampMS: 1762188722982 UncompressedSize: 226 PartitionKey: "" ExplicitHash: "" } Result { Offset: 28 Data: "... 306 bytes ..." SourceId: "\000src_id" SeqNo: 29 WriteTimestampMS: 1762188723164 CreateTimestampMS: 1762188722984 UncompressedSize: 234 PartitionKey: "" ExplicitHash: "" } Result { Offset: 29 Data: "... 314 bytes ..." SourceId: "\000src_id" SeqNo: 30 WriteTimestampMS: 1762188723164 CreateTimestampMS: 1762188722984 UncompressedSize: 242 PartitionKey: "" ExplicitHash: "" } Result { Offset: 30 Data: "... 322 bytes ..." SourceId: "\000src_id" SeqNo: 31 WriteTimestampMS: 1762188723164 CreateTimestampMS: 1762188722984 UncompressedSize: 250 PartitionKey: "" ExplicitHash: "" } Result { Offset: 31 Data: "... 330 bytes ..." SourceId: "\000src_id" SeqNo: 32 WriteTimestampMS: 1762188723194 CreateTimestampMS: 1762188722984 UncompressedSize: 258 PartitionKey: "" ExplicitHash: "" } Result { Offset: 32 Data: "... 338 bytes ..." SourceId: "\000src_id" SeqNo: 33 WriteTimestampMS: 1762188723196 CreateTimestampMS: 1762188722985 UncompressedSize: 266 PartitionKey: "" ExplicitHash: "" } Result { Offset: 33 Data: "... 346 bytes ..." SourceId: "\000src_id" SeqNo: 34 WriteTimestampMS: 1762188723196 CreateTimestampMS: 1762188722985 UncompressedSize: 274 PartitionKey: "" ExplicitHash: "" } Result { Offset: 34 Data: "... 354 bytes ..." SourceId: "\000src_id" SeqNo: 35 WriteTimestampMS: 1762188723196 CreateTimestampMS: 1762188722985 UncompressedSize: 282 PartitionKey: "" ExplicitHash: "" } Result { Offset: 35 Data: "... 362 bytes ..." SourceId: "\000src_id" SeqNo: 36 WriteTimestampMS: 1762188723196 CreateTimestampMS: 1762188722985 UncompressedSize: 290 PartitionKey: "" ExplicitHash: "" } Result { Offset: 36 Data: "... 370 bytes ..." SourceId: "\000src_id" SeqNo: 37 WriteTimestampMS: 1762188723196 CreateTimestampMS: 1762188722985 UncompressedSize: 298 PartitionKey: "" ExplicitHash: "" } Result { Offset: 37 Data: "... 378 bytes ..." SourceId: "\000src_id" SeqNo: 38 WriteTimestampMS: 1762188723196 CreateTimestampMS: 1762188722985 UncompressedSize: 306 PartitionKey: "" ExplicitHash: "" } Result { Offset: 38 Data: "... 386 bytes ..." SourceId: "\000src_id" SeqNo: 39 WriteTimestampMS: 1762188723196 CreateTimestampMS: 1762188722985 UncompressedSize: 314 PartitionKey: "" ExplicitHash: "" } Result { Offset: 39 Data: "... 394 bytes ..." SourceId: "\000src_id" SeqNo: 40 WriteTimestampMS: 1762188723196 CreateTimestampMS: 1762188722985 UncompressedSize: 322 PartitionKey: "" ExplicitHash: "" } Result { Offset: 40 Data: "... 402 bytes ..." SourceId: "\000src_id" SeqNo: 41 WriteTimestampMS: 1762188723196 CreateTimestampMS: 1762188722985 UncompressedSize: 330 PartitionKey: "" ExplicitHash: "" } Result { Offset: 41 Data: "... 410 bytes ..." SourceId: "\000src_id" SeqNo: 42 WriteTimestampMS: 1762188723196 CreateTimestampMS: 1762188722986 UncompressedSize: 338 PartitionKey: "" ExplicitHash: "" } Result { Offset: 42 Data: "... 418 bytes ..." SourceId: "\000src_id" SeqNo: 43 WriteTimestampMS: 1762188723196 CreateTimestampMS: 1762188722986 UncompressedSize: 346 PartitionKey: "" ExplicitHash: "" } Result { Offset: 43 Data: "... 426 bytes ..." SourceId: "\000src_id" SeqNo: 44 WriteTimestampMS: 1762188723196 CreateTimestampMS: 1762188722986 UncompressedSize: 354 PartitionKey: "" ExplicitHash: "" } Result { Offset: 44 Data: "... 434 bytes ..." SourceId: "\000src_id" SeqNo: 45 WriteTimestampMS: 1762188723196 CreateTimestampMS: 1762188722986 UncompressedSize: 362 PartitionKey: "" ExplicitHash: "" } Result { Offset: 45 Data: "... 442 bytes ..." SourceId: "\000src_id" SeqNo: 46 WriteTimestampMS: 1762188723196 CreateTimestampMS: 1762188722986 UncompressedSize: 370 PartitionKey: "" ExplicitHash: "" } Result { Offset: 46 Data: "... 450 bytes ..." SourceId: "\000src_id" SeqNo: 47 WriteTimestampMS: 1762188723196 CreateTimestampMS: 1762188722986 UncompressedSize: 378 PartitionKey: "" ExplicitHash: "" } Result { Offset: 47 Data: "... 458 bytes ..." SourceId: "\000src_id" SeqNo: 48 WriteTimestampMS: 1762188723228 CreateTimestampMS: 1762188722986 UncompressedSize: 386 PartitionKey: "" ExplicitHash: "" } Result { Offset: 48 Data: "... 466 bytes ..." SourceId: "\000src_id" SeqNo: 49 WriteTimestampMS: 1762188723283 CreateTimestampMS: 1762188722986 UncompressedSize: 394 PartitionKey: "" ExplicitHash: "" } Result { Offset: 49 Data: "... 474 bytes ..." SourceId: "\000src_id" SeqNo: 50 WriteTimestampMS: 1762188723283 CreateTimestampMS: 1762188722986 UncompressedSize: 402 PartitionKey: "" ExplicitHash: "" } Result { Offset: 50 Data: "... 482 bytes ..." SourceId: "\000src_id" SeqNo: 51 WriteTimestampMS: 1762188723283 CreateTimestampMS: 1762188722987 UncompressedSize: 410 PartitionKey: "" ExplicitHash: "" } Result { Offset: 51 Data: "... 490 bytes ..." SourceId: "\000src_id" SeqNo: 52 WriteTimestampMS: 1762188723283 CreateTimestampMS: 1762188722987 UncompressedSize: 418 PartitionKey: "" ExplicitHash: "" } Result { Offset: 52 Data: "... 498 bytes ..." SourceId: "\000src_id" SeqNo: 53 WriteTimestampMS: 1762188723283 CreateTimestampMS: 1762188722987 UncompressedSize: 426 PartitionKey: "" ExplicitHash: "" } Result { Offset: 53 Data: "... 506 bytes ..." SourceId: "\000src_id" SeqNo: 54 WriteTimestampMS: 1762188723283 CreateTimestampMS: 1762188722987 UncompressedSize: 434 PartitionKey: "" ExplicitHash: "" } Result { Offset: 54 Data: "... 514 bytes ..." SourceId: "\000src_id" SeqNo: 55 WriteTimestampMS: 1762188723283 CreateTimestampMS: 1762188722987 UncompressedSize: 442 PartitionKey: "" ExplicitHash: "" } Result { Offset: 55 Data: "... 522 bytes ..." SourceId: "\000src_id" SeqNo: 56 WriteTimestampMS: 1762188723283 CreateTimestampMS: 1762188722987 UncompressedSize: 450 PartitionKey: "" ExplicitHash: "" } Result { Offset: 56 Data: "... 530 bytes ..." SourceId: "\000src_id" SeqNo: 57 WriteTimestampMS: 1762188723283 CreateTimestampMS: 1762188722987 UncompressedSize: 458 PartitionKey: "" ExplicitHash: "" } Result { Offset: 57 Data: "... 538 bytes ..." SourceId: "\000src_id" SeqNo: 58 WriteTimestampMS: 1762188723283 CreateTimestampMS: 1762188722987 UncompressedSize: 466 PartitionKey: "" ExplicitHash: "" } Result { Offset: 58 Data: "... 546 bytes ..." SourceId: "\000src_id" SeqNo: 59 WriteTimestampMS: 1762188723283 CreateTimestampMS: 1762188722988 UncompressedSize: 474 PartitionKey: "" ExplicitHash: "" } Result { Offset: 59 Data: "... 554 bytes ..." SourceId: "\000src_id" SeqNo: 60 WriteTimestampMS: 1762188723283 CreateTimestampMS: 1762188722988 UncompressedSize: 482 PartitionKey: "" ExplicitHash: "" } Result { Offset: 60 Data: "... 562 bytes ..." SourceId: "\000src_id" SeqNo: 61 WriteTimestampMS: 1762188723283 CreateTimestampMS: 1762188722988 UncompressedSize: 490 PartitionKey: "" ExplicitHash: "" } Result { Offset: 61 Data: "... 570 bytes ..." SourceId: "\000src_id" SeqNo: 62 WriteTimestampMS: 1762188723283 CreateTimestampMS: 1762188722988 UncompressedSize: 498 PartitionKey: "" ExplicitHash: "" } Result { Offset: 62 Data: "... 578 bytes ..." SourceId: "\000src_id" SeqNo: 63 WriteTimestampMS: 1762188723302 CreateTimestampMS: 1762188722988 UncompressedSize: 506 PartitionKey: "" ExplicitHash: "" } Result { Offset: 63 Data: "... 586 bytes ..." SourceId: "\000src_id" SeqNo: 64 WriteTimestampMS: 1762188723302 CreateTimestampMS: 1762188722988 UncompressedSize: 514 PartitionKey: "" ExplicitHash: "" } Result { Offset: 64 Data: "... 594 bytes ..." SourceId: "\000src_id" SeqNo: 65 WriteTimestampMS: 1762188723302 CreateTimestampMS: 1762188722988 UncompressedSize: 522 PartitionKey: "" ExplicitHash: "" } Result { Offset: 65 Data: "... 602 bytes ..." SourceId: "\000src_id" SeqNo: 66 WriteTimestampMS: 1762188723302 CreateTimestampMS: 1762188722988 UncompressedSize: 530 PartitionKey: "" ExplicitHash: "" } Result { Offset: 66 Data: "... 610 bytes ..." SourceId: "\000src_id" SeqNo: 67 WriteTimestampMS: 1762188723302 CreateTimestampMS: 1762188722988 UncompressedSize: 538 PartitionKey: "" ExplicitHash: "" } Result { Offset: 67 Data: "... 618 bytes ..." SourceId: "\000src_id" SeqNo: 68 WriteTimestampMS: 1762188723302 CreateTimestampMS: 1762188722988 UncompressedSize: 546 PartitionKey: "" ExplicitHash: "" } Result { Offset: 68 Data: "... 626 bytes ..." SourceId: "\000src_id" SeqNo: 69 WriteTimestampMS: 1762188723302 CreateTimestampMS: 1762188722989 UncompressedSize: 554 PartitionKey: "" ExplicitHash: "" } Result { Offset: 69 Data: "... 634 bytes ..." SourceId: "\000src_id" SeqNo: 70 WriteTimestampMS: 1762188723302 CreateTimestampMS: 1762188722989 UncompressedSize: 562 PartitionKey: "" ExplicitHash: "" } Result { Offset: 70 Data: "... 642 bytes ..." SourceId: "\000src_id" SeqNo: 71 WriteTimestampMS: 1762188723302 CreateTimestampMS: 1762188722989 UncompressedSize: 570 PartitionKey: "" ExplicitHash: "" } Result { Offset: 71 Data: "... 650 bytes ..." SourceId: "\000src_id" SeqNo: 72 WriteTimestampMS: 1762188723302 CreateTimestampMS: 1762188722989 UncompressedSize: 578 PartitionKey: "" ExplicitHash: "" } Result { Offset: 72 Data: "... 658 bytes ..." SourceId: "\000src_id" SeqNo: 73 WriteTimestampMS: 1762188723302 CreateTimestampMS: 1762188722989 UncompressedSize: 586 PartitionKey: "" ExplicitHash: "" } Result { Offset: 73 Data: "... 666 bytes ..." SourceId: "\000src_id" SeqNo: 74 WriteTimestampMS: 1762188723302 CreateTimestampMS: 1762188722989 UncompressedSize: 594 PartitionKey: "" ExplicitHash: "" } Result { Offset: 74 Data: "... 674 bytes ..." SourceId: "\000src_id" SeqNo: 75 WriteTimestampMS: 1762188723302 CreateTimestampMS: 1762188722989 UncompressedSize: 602 PartitionKey: "" ExplicitHash: "" } Result { Offset: 75 Data: "... 682 bytes ..." SourceId: "\000src_id" SeqNo: 76 WriteTimestampMS: 1762188723302 CreateTimestampMS: 1762188722989 UncompressedSize: 610 PartitionKey: "" ExplicitHash: "" } Result { Offset: 76 Data: "... 690 bytes ..." SourceId: "\000src_id" SeqNo: 77 WriteTimestampMS: 1762188723302 CreateTimestampMS: 1762188722990 UncompressedSize: 618 PartitionKey: "" ExplicitHash: "" } Result { Offset: 77 Data: "... 698 bytes ..." SourceId: "\000src_id" SeqNo: 78 WriteTimestampMS: 1762188723332 CreateTimestampMS: 1762188722990 UncompressedSize: 626 PartitionKey: "" ExplicitHash: "" } Result { Offset: 78 Data: "... 706 bytes ..." SourceId: "\000src_id" SeqNo: 79 WriteTimestampMS: 1762188723336 CreateTimestampMS: 1762188722990 UncompressedSize: 634 PartitionKey: "" ExplicitHash: "" } Result { Offset: 79 Data: "... 714 bytes ..." SourceId: "\000src_id" SeqNo: 80 WriteTimestampMS: 1762188723336 CreateTimestampMS: 1762188722990 UncompressedSize: 642 PartitionKey: "" ExplicitHash: "" } Result { Offset: 80 Data: "... 722 bytes ..." SourceId: "\000src_id" SeqNo: 81 WriteTimestampMS: 1762188723336 CreateTimestampMS: 1762188722990 UncompressedSize: 650 PartitionKey: "" ExplicitHash: "" } Result { Offset: 81 Data: "... 730 bytes ..." SourceId: "\000src_id" SeqNo: 82 WriteTimestampMS: 1762188723336 CreateTimestampMS: 1762188722990 UncompressedSize: 658 PartitionKey: "" ExplicitHash: "" } Result { Offset: 82 Data: "... 738 bytes ..." SourceId: "\000src_id" SeqNo: 83 WriteTimestampMS: 1762188723336 CreateTimestampMS: 1762188722990 UncompressedSize: 666 PartitionKey: "" ExplicitHash: "" } Result { Offset: 83 Data: "... 746 bytes ..." SourceId: "\000src_id" SeqNo: 84 WriteTimestampMS: 1762188723336 CreateTimestampMS: 1762188723062 UncompressedSize: 674 PartitionKey: "" ExplicitHash: "" } Result { Offset: 84 Data: "... 754 bytes ..." SourceId: "\000src_id" SeqNo: 85 WriteTimestampMS: 1762188723336 CreateTimestampMS: 1762188723062 UncompressedSize: 682 PartitionKey: "" ExplicitHash: "" } Result { Offset: 85 Data: "... 762 bytes ..." SourceId: "\000src_id" SeqNo: 86 WriteTimestampMS: 1762188723336 CreateTimestampMS: 1762188723062 UncompressedSize: 690 PartitionKey: "" ExplicitHash: "" } Result { Offset: 86 Data: "... 770 bytes ..." SourceId: "\000src_id" SeqNo: 87 WriteTimestampMS: 1762188723339 CreateTimestampMS: 1762188723062 UncompressedSize: 698 PartitionKey: "" ExplicitHash: "" } Result { Offset: 87 Data: "... 778 bytes ..." SourceId: "\000src_id" SeqNo: 88 WriteTimestampMS: 1762188723340 CreateTimestampMS: 1762188723062 UncompressedSize: 706 PartitionKey: "" ExplicitHash: "" } Result { Offset: 88 Data: "... 786 bytes ..." SourceId: "\000src_id" SeqNo: 89 WriteTimestampMS: 1762188723340 CreateTimestampMS: 1762188723063 UncompressedSize: 714 PartitionKey: "" ExplicitHash: "" } Result { Offset: 89 Data: "... 794 bytes ..." SourceId: "\000src_id" SeqNo: 90 WriteTimestampMS: 1762188723340 CreateTimestampMS: 1762188723063 UncompressedSize: 722 PartitionKey: "" ExplicitHash: "" } Result { Offset: 90 Data: "... 802 bytes ..." SourceId: "\000src_id" SeqNo: 91 WriteTimestampMS: 1762188723340 CreateTimestampMS: 1762188723063 UncompressedSize: 730 PartitionKey: "" ExplicitHash: "" } Result { Offset: 91 Data: "... 810 bytes ..." SourceId: "\000src_id" SeqNo: 92 WriteTimestampMS: 1762188723340 CreateTimestampMS: 1762188723063 UncompressedSize: 738 PartitionKey: "" ExplicitHash: "" } Result { Offset: 92 Data: "... 818 bytes ..." SourceId: "\000src_id" SeqNo: 93 WriteTimestampMS: 1762188723356 CreateTimestampMS: 1762188723063 UncompressedSize: 746 PartitionKey: "" ExplicitHash: "" } Result { Offset: 93 Data: "... 826 bytes ..." SourceId: "\000src_id" SeqNo: 94 WriteTimestampMS: 1762188723403 CreateTimestampMS: 1762188723063 UncompressedSize: 754 PartitionKey: "" ExplicitHash: "" } Result { Offset: 94 Data: "... 834 bytes ..." SourceId: "\000src_id" SeqNo: 95 WriteTimestampMS: 1762188723403 CreateTimestampMS: 1762188723063 UncompressedSize: 762 PartitionKey: "" ExplicitHash: "" } Result { Offset: 95 Data: "... 842 bytes ..." SourceId: "\000src_id" SeqNo: 96 WriteTimestampMS: 1762188723403 CreateTimestampMS: 1762188723063 UncompressedSize: 770 PartitionKey: "" ExplicitHash: "" } Result { Offset: 96 Data: "... 850 bytes ..." SourceId: "\000src_id" SeqNo: 97 WriteTimestampMS: 1762188723403 CreateTimestampMS: 1762188723063 UncompressedSize: 778 PartitionKey: "" ExplicitHash: "" } Result { Offset: 97 Data: "... 858 bytes ..." SourceId: "\000src_id" SeqNo: 98 WriteTimestampMS: 1762188723403 CreateTimestampMS: 1762188723064 UncompressedSize: 786 PartitionKey: "" ExplicitHash: "" } Result { Offset: 98 Data: "... 866 bytes ..." SourceId: "\000src_id" SeqNo: 99 WriteTimestampMS: 1762188723408 CreateTimestampMS: 1762188723064 UncompressedSize: 794 PartitionKey: "" ExplicitHash: "" } Result { Offset: 99 Data: "... 874 bytes ..." SourceId: "\000src_id" SeqNo: 100 WriteTimestampMS: 1762188723408 CreateTimestampMS: 1762188723064 UncompressedSize: 802 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 8 SizeLag: 18446744073709542296 RealReadOffset: 99 WaitQuotaTimeMs: 0 EndOffset: 100 StartOffset: 0 } Cookie: 0 }
2025-11-03T16:52:03.551183Z node 5 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_5_1_13114544046380980386_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 1 from offset 100
2025-11-03T16:52:03.551236Z node 5 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_5_1_13114544046380980386_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 100 ReadOffset 100 ReadGuid 54b4a606-1d471631-ebd89796-1fc57670 has messages 1
2025-11-03T16:52:03.551712Z node 5 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_5_1_13114544046380980386_v1 read done: guid# 54b4a606-1d471631-ebd89796-1fc57670, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 44536
2025-11-03T16:52:03.551786Z node 5 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_5_1_13114544046380980386_v1 response to read: guid# 54b4a606-1d471631-ebd89796-1fc57670
2025-11-03T16:52:03.552553Z node 5 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_5_1_13114544046380980386_v1 Process answer. Aval parts: 0
2025-11-03T16:52:03.561510Z :DEBUG: [/Root] [/Root] [4eb5b9e1-3b2b514b-2cc25f18-3783ec1c] [dc1] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:52:03.562347Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 0 (0-99)
2025-11-03T16:52:03.562470Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (0-0)
2025-11-03T16:52:03.562522Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 0} (1-1)
2025-11-03T16:52:03.562648Z :DEBUG: [/Root] Take Data. Partition 0. Read: {2, 0} (2-2)
2025-11-03T16:52:03.562710Z :DEBUG: [/Root] Take Data. Partition 0. Read: {2, 1} (3-3)
2025-11-03T16:52:03.562746Z :DEBUG: [/Root] Take Data. Partition 0. Read: {2, 2} (4-4)
2025-11-03T16:52:03.562779Z :DEBUG: [/Root] Take Data. Partition 0. Read: {2, 3} (5-5)
2025-11-03T16:52:03.562811Z :DEBUG: [/Root] Take Data. Partition 0. Read: {2, 4} (6-6)
2025-11-03T16:52:03.562880Z :DEBUG: [/Root] Take Data. Partition 0. Read: {2, 5} (7-7)
2025-11-03T16:52:03.562935Z :DEBUG: [/Root] Take Data. Partition 0. Read: {2, 6} (8-8)
2025-11-03T16:52:03.562961Z :DEBUG: [/Root] Take Data. Partition 0. Read: {2, 7} (9-9)
2025-11-03T16:52:03.562992Z :DEBUG: [/Root] Take Data. Partition 0. Read: {2, 8} (10-10)
2025-11-03T16:52:03.563026Z :DEBUG: [/Root] Take Data. Partition 0. Read: {3, 0} (11-11)
2025-11-03T16:52:03.563060Z :DEBUG: [/Root] Take Data. Partition 0. Read: {4, 0} (12-12)
2025-11-03T16:52:03.563092Z :DEBUG: [/Root] Take Data. Partition 0. Read: {4, 1} (13-13)
2025-11-03T16:52:03.563124Z :DEBUG: [/Root] Take Data. Partition 0. Read: {4, 2} (14-14)
2025-11-03T16:52:03.563154Z :DEBUG: [/Root] Take Data. Partition 0. Read: {4, 3} (15-15)
2025-11-03T16:52:03.563222Z :DEBUG: [/Root] Take Data. Partition 0. Read: {4, 4} (16-16)
2025-11-03T16:52:03.563253Z :DEBUG: [/Root] Take Data. Partition 0. Read: {4, 5} (17-17)
2025-11-03T16:52:03.563304Z :DEBUG: [/Root] Take Data. Partition 0. Read: {4, 6} (18-18)
2025-11-03T16:52:03.563340Z :DEBUG: [/Root] Take Data. Partition 0. Read: {4, 7} (19-19)
2025-11-03T16:52:03.563374Z :DEBUG: [/Root] Take Data. Partition 0. Read: {4, 8} (20-20)
2025-11-03T16:52:03.563421Z :DEBUG: [/Root] Take Data. Partition 0. Read: {4, 9} (21-21)
2025-11-03T16:52:03.563453Z :DEBUG: [/Root] Take Data. Partition 0. Read: {4, 10} (22-22)
2025-11-03T16:52:03.563482Z :DEBUG: [/Root] Take Data. Partition 0. Read: {4, 11} (23-23)
2025-11-03T16:52:03.563516Z :DEBUG: [/Root] Take Data. Partition 0. Read: {4, 12} (24-24)
2025-11-03T16:52:03.563543Z :DEBUG: [/Root] Take Data. Partition 0. Read: {4, 13} (25-25)
2025-11-03T16:52:03.563570Z :DEBUG: [/Root] Take Data. Partition 0. Read: {4, 14} (26-26)
2025-11-03T16:52:03.563607Z :DEBUG: [/Root] Take Data. Partition 0. Read: {4, 15} (27-27)
2025-11-03T16:52:03.563645Z :DEBUG: [/Root] Take Data. Partition 0. Read: {4, 16} (28-28)
2025-11-03T16:52:03.563670Z :DEBUG: [/Root] Take Data. Partition 0. Read: {4, 17} (29-29)
2025-11-03T16:52:03.563701Z :DEBUG: [/Root] Take Data. Partition 0. Read: {4, 18} (30-30)
2025-11-03T16:52:03.563737Z :DEBUG: [/Root] Take Data. Partition 0. Read: {5, 0} (31-31)
2025-11-03T16:52:03.563842Z :DEBUG: [/Root] Take Data. Partition 0. Read: {6, 0} (32-32)
2025-11-03T16:52:03.563994Z :DEBUG: [/Root] Take Data. Partition 0. Read: {6, 1} (33-33)
2025-11-03T16:52:03.564026Z :DEBUG: [/Root] Take Data. Partition 0. Read: {6, 2} (34-34)
2025-11-03T16:52:03.564070Z :DEBUG: [/Root] Take Data. Partition 0. Read: {6, 3} (35-35)
2025-11-03T16:52:03.564103Z :DEBUG: [/Root] Take Data. Partition 0. Read: {6, 4} (36-36)
2025-11-03T16:52:03.564139Z :DEBUG: [/Root] Take Data. Partition 0. Read: {6, 5} (37-37)
2025-11-03T16:52:03.564170Z :DEBUG: [/Root] Take Data. Partition 0. Read: {6, 6} (38-38)
2025-11-03T16:52:03.564219Z :DEBUG: [/Root] Take Data. Partition 0. Read: {6, 7} (39-39)
2025-11-03T16:52:03.564255Z :DEBUG: [/Root] Take Data. Partition 0. Read: {6, 8} (40-40)
2025-11-03T16:52:03.564286Z :DEBUG: [/Root] Take Data. Partition 0. Read: {6, 9} (41-41)
2025-11-03T16:52:03.564321Z :DEBUG: [/Root] Take Data. Partition 0. Read: {6, 10} (42-42)
2025-11-03T16:52:03.564379Z :DEBUG: [/Root] Take Data. Partition 0. Read: {6, 11} (43-43)
2025-11-03T16:52:03.564411Z :DEBUG: [/Root] Take Data. Partition 0. Read: {6, 12} (44-44)
2025-11-03T16:52:03.564437Z :DEBUG: [/Root] Take Data. Partition 0. Read: {6, 13} (45-45)
2025-11-03T16:52:03.564467Z :DEBUG: [/Root] Take Data. Partition 0. Read: {6, 14} (46-46)
2025-11-03T16:52:03.564500Z :DEBUG: [/Root] Take Data. Partition 0. Read: {7, 0} (47-47)
2025-11-03T16:52:03.564689Z :DEBUG: [/Root] Take Data. Partition 0. Read: {8, 0} (48-48)
2025-11-03T16:52:03.564716Z :DEBUG: [/Root] Take Data. Partition 0. Read: {8, 1} (49-49)
2025-11-03T16:52:03.564758Z :DEBUG: [/Root] Take Data. Partition 0. Read: {8, 2} (50-50)
2025-11-03T16:52:03.564795Z :DEBUG: [/Root] Take Data. Partition 0. Read: {8, 3} (51-51)
2025-11-03T16:52:03.564826Z :DEBUG: [/Root] Take Data. Partition 0. Read: {8, 4} (52-52)
2025-11-03T16:52:03.564861Z :DEBUG: [/Root] Take Data. Partition 0. Read: {8, 5} (53-53)
2025-11-03T16:52:03.564896Z :DEBUG: [/Root] Take Data. Partition 0. Read: {8, 6} (54-54)
2025-11-03T16:52:03.564927Z :DEBUG: [/Root] Take Data. Partition 0. Read: {8, 7} (55-55)
2025-11-03T16:52:03.564966Z :DEBUG: [/Root] Take Data. Partition 0. Read: {8, 8} (56-56)
2025-11-03T16:52:03.565003Z :DEBUG: [/Root] Take Data. Partition 0. Read: {8, 9} (57-57)
2025-11-03T16:52:03.565038Z :DEBUG: [/Root] Take Data. Partition 0. Read: {8, 10} (58-58)
2025-11-03T16:52:03.565075Z :DEBUG: [/Root] Take Data. Partition 0. Read: {8, 11} (59-59)
2025-11-03T16:52:03.565114Z :DEBUG: [/Root] Take Data. Partition 0. Read: {8, 12} (60-60)
2025-11-03T16:52:03.565146Z :DEBUG: [/Root] Take Data. Partition 0. Read: {8, 13} (61-61)
2025-11-03T16:52:03.565181Z :DEBUG: [/Root] Take Data. Partition 0. Read: {9, 0} (62-62)
2025-11-03T16:52:03.565231Z :DEBUG: [/Root] Take Data. Partition 0. Read: {9, 1} (63-63)
2025-11-03T16:52:03.565443Z :DEBUG: [/Root] Take Data. Partition 0. Read: {9, 2} (64-64)
2025-11-03T16:52:03.565487Z :DEBUG: [/Root] Take Data. Partition 0. Read: {9, 3} (65-65)
2025-11-03T16:52:03.565523Z :DEBUG: [/Root] Take Data. Partition 0. Read: {9, 4} (66-66)
2025-11-03T16:52:03.565561Z :DEBUG: [/Root] Take Data. Partition 0. Read: {9, 5} (67-67)
2025-11-03T16:52:03.565591Z :DEBUG: [/Root] Take Data. Partition 0. Read: {9, 6} (68-68)
2025-11-03T16:52:03.565621Z :DEBUG: [/Root] Take Data. Partition 0. Read: {9, 7} (69-69)
2025-11-03T16:52:03.565656Z :DEBUG: [/Root] Take Data. Partition 0. Read: {9, 8} (70-70)
2025-11-03T16:52:03.565683Z :DEBUG: [/Root] Take Data. Partition 0. Read: {9, 9} (71-71)
2025-11-03T16:52:03.565720Z :DEBUG: [/Root] Take Data. Partition 0. Read: {9, 10} (72-72)
2025-11-03T16:52:03.565746Z :DEBUG: [/Root] Take Data. Partition 0. Read: {9, 11} (73-73)
2025-11-03T16:52:03.565781Z :DEBUG: [/Root] Take Data. Partition 0. Read: {9, 12} (74-74)
2025-11-03T16:52:03.565812Z :DEBUG: [/Root] Take Data. Partition 0. Read: {9, 13} (75-75)
2025-11-03T16:52:03.565839Z :DEBUG: [/Root] Take Data. Partition 0. Read: {9, 14} (76-76)
2025-11-03T16:52:03.565882Z :DEBUG: [/Root] Take Data. Partition 0. Read: {10, 0} (77-77)
2025-11-03T16:52:03.565915Z :DEBUG: [/Root] Take Data. Partition 0. Read: {11, 0} (78-78)
2025-11-03T16:52:03.565950Z :DEBUG: [/Root] Take Data. Partition 0. Read: {11, 1} (79-79)
2025-11-03T16:52:03.565979Z :DEBUG: [/Root] Take Data. Partition 0. Read: {11, 2} (80-80)
2025-11-03T16:52:03.566006Z :DEBUG: [/Root] Take Data. Partition 0. Read: {11, 3} (81-81)
2025-11-03T16:52:03.566044Z :DEBUG: [/Root] Take Data. Partition 0. Read: {11, 4} (82-82)
2025-11-03T16:52:03.566108Z :DEBUG: [/Root] Take Data. Partition 0. Read: {11, 5} (83-83)
2025-11-03T16:52:03.566148Z :DEBUG: [/Root] Take Data. Partition 0. Read: {11, 6} (84-84)
2025-11-03T16:52:03.566182Z :DEBUG: [/Root] Take Data. Partition 0. Read: {11, 7} (85-85)
2025-11-03T16:52:03.566212Z :DEBUG: [/Root] Take Data. Partition 0. Read: {12, 0} (86-86)
2025-11-03T16:52:03.566243Z :DEBUG: [/Root] Take Data. Partition 0. Read: {13, 0} (87-87)
2025-11-03T16:52:03.566276Z :DEBUG: [/Root] Take Data. Partition 0. Read: {13, 1} (88-88)
2025-11-03T16:52:03.566306Z :DEBUG: [/Root] Take Data. Partition 0. Read: {13, 2} (89-89)
2025-11-03T16:52:03.566335Z :DEBUG: [/Root] Take Data. Partition 0. Read: {13, 3} (90-90)
2025-11-03T16:52:03.566376Z :DEBUG: [/Root] Take Data. Partition 0. Read: {13, 4} (91-91)
2025-11-03T16:52:03.566423Z :DEBUG: [/Root] Take Data. Partition 0. Read: {14, 0} (92-92)
2025-11-03T16:52:03.566450Z :DEBUG: [/Root] Take Data. Partition 0. Read: {15, 0} (93-93)
2025-11-03T16:52:03.566479Z :DEBUG: [/Root] Take Data. Partition 0. Read: {15, 1} (94-94)
2025-11-03T16:52:03.566513Z :DEBUG: [/Root] Take Data. Partition 0. Read: {15, 2} (95-95)
2025-11-03T16:52:03.566561Z :DEBUG: [/Root] Take Data. Partition 0. Read: {15, 3} (96-96)
2025-11-03T16:52:03.566589Z :DEBUG: [/Root] Take Data. Partition 0. Read: {15, 4} (97-97)
2025-11-03T16:52:03.566623Z :DEBUG: [/Root] Take Data. Partition 0. Read: {16, 0} (98-98)
2025-11-03T16:52:03.566653Z :DEBUG: [/Root] Take Data. Partition 0. Read: {16, 1} (99-99)
2025-11-03T16:52:03.568166Z node 5 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_5_1_13114544046380980386_v1 grpc read done: success# 1, data# { read { } }
2025-11-03T16:52:03.568385Z node 5 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_5_1_13114544046380980386_v1 got read request: guid# b379da21-7320a54-3fd1cd36-c750c5c1
2025-11-03T16:52:03.572158Z :DEBUG: [/Root] [/Root] [4eb5b9e1-3b2b514b-2cc25f18-3783ec1c] [dc1] The application data is transferred to the client. Number of messages 100, size 40590 bytes
2025-11-03T16:52:03.572973Z :INFO: [/Root] [/Root] [4eb5b9e1-3b2b514b-2cc25f18-3783ec1c] Closing read session. Close timeout: 0.010000s
2025-11-03T16:52:03.573036Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): dc1:test-topic:0:1:99:0
2025-11-03T16:52:03.573107Z :INFO: [/Root] [/Root] [4eb5b9e1-3b2b514b-2cc25f18-3783ec1c] Counters: { Errors: 0 CurrentSessionLifetimeMs: 99 BytesRead: 40590 MessagesRead: 100 BytesReadCompressed: 40590 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-11-03T16:52:03.574613Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66942439-cc3799b0-f098c35b-1958637c_0] Write session: destroy
2025-11-03T16:52:03.575728Z :INFO: [/Root] [/Root] [4eb5b9e1-3b2b514b-2cc25f18-3783ec1c] Closing read session. Close timeout: 0.000000s
2025-11-03T16:52:03.575797Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): dc1:test-topic:0:1:99:0
2025-11-03T16:52:03.575871Z :INFO: [/Root] [/Root] [4eb5b9e1-3b2b514b-2cc25f18-3783ec1c] Counters: { Errors: 0 CurrentSessionLifetimeMs: 102 BytesRead: 40590 MessagesRead: 100 BytesReadCompressed: 40590 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-11-03T16:52:03.576034Z :NOTICE: [/Root] [/Root] [4eb5b9e1-3b2b514b-2cc25f18-3783ec1c] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
2025-11-03T16:52:03.580704Z node 5 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_5_1_13114544046380980386_v1 grpc read done: success# 0, data# {  }
2025-11-03T16:52:03.580736Z node 5 :PQ_READ_PROXY INFO: read_session_actor.cpp:125: session cookie 1 consumer shared/user session shared/user_5_1_13114544046380980386_v1 grpc read failed
2025-11-03T16:52:03.580766Z node 5 :PQ_READ_PROXY INFO: read_session_actor.cpp:92: session cookie 1 consumer shared/user session shared/user_5_1_13114544046380980386_v1 grpc closed
2025-11-03T16:52:03.580806Z node 5 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 1 consumer shared/user session shared/user_5_1_13114544046380980386_v1 is DEAD
2025-11-03T16:52:03.582985Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2258: [PQ: 72075186224037892] Destroy direct read session shared/user_5_1_13114544046380980386_v1
2025-11-03T16:52:03.583040Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [5:7568542936675751237:2498] destroyed
2025-11-03T16:52:03.583089Z node 6 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_5_1_13114544046380980386_v1
2025-11-03T16:52:03.583262Z node 5 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1659: [72075186224037893][rt3.dc1--test-topic] pipe [5:7568542936675751234:2495] disconnected.
2025-11-03T16:52:03.583289Z node 5 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1670: [72075186224037893][rt3.dc1--test-topic] pipe [5:7568542936675751234:2495] disconnected; active server actors: 1
2025-11-03T16:52:03.583310Z node 5 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1679: [72075186224037893][rt3.dc1--test-topic] pipe [5:7568542936675751234:2495] client user disconnected session shared/user_5_1_13114544046380980386_v1
2025-11-03T16:52:03.612083Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:03.612139Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:03.612158Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:03.724097Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:03.724131Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:03.724159Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:06.216181Z :TWriteSession_WriteAndReadAndCommitRandomMessages INFO: Random seed for debugging is 1762188726216154
2025-11-03T16:52:06.852994Z node 7 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[7:7568542948936427357:2081];send_to=[0:7307199536658146131:7762515];
2025-11-03T16:52:06.868889Z node 7 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
2025-11-03T16:52:06.893423Z node 7 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-11-03T16:52:06.902273Z node 8 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[8:7568542951198792880:2152];send_to=[0:7307199536658146131:7762515];
2025-11-03T16:52:06.902366Z node 8 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
test_client.cpp: SetPath # /home/runner/.ya/build/build_root/7jz3/001974/r3tmp/tmpDoOINb/pdisk_1.dat
2025-11-03T16:52:06.945254Z node 7 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-11-03T16:52:06.977802Z node 8 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-11-03T16:52:06.980173Z node 8 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-11-03T16:52:07.188963Z node 7 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
2025-11-03T16:52:07.200469Z node 8 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-11-03T16:52:07.221686Z node 7 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-11-03T16:52:07.228915Z node 7 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(7, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-11-03T16:52:07.229034Z node 7 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(7, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-11-03T16:52:07.230508Z node 7 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(8, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-11-03T16:52:07.230666Z node 7 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(8, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-11-03T16:52:07.244811Z node 7 :HIVE WARN: hive_impl.cpp:811: HIVE#72057594037968897 Handle TEvInterconnect::TEvNodeConnected, NodeId 8 Cookie 8
2025-11-03T16:52:07.245052Z node 7 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(7, (0,0,0,0)) VolatileState: Connecting -> Connected
2025-11-03T16:52:07.250260Z node 7 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(8, (0,0,0,0)) VolatileState: Connecting -> Connected
TServer::EnableGrpc on GrpcPort 3923, node 7
2025-11-03T16:52:07.324483Z node 8 :BS_NODE WARN: {NWDC01@distconf.cpp:397} StateFunc too long Type# 268639238 Duration# 0.007458s
2025-11-03T16:52:07.567390Z node 7 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-11-03T16:52:07.624715Z node 7 :NET_CLASSIFIER WARN: net_classifier.cpp:190: distributable config is empty, broken or outdated, will use file: /home/runner/.ya/build/build_root/7jz3/001974/r3tmp/yandexQ4QvQ5.tmp
2025-11-03T16:52:07.624749Z node 7 :NET_CLASSIFIER WARN: net_classifier.cpp:196: will try to initialize from file: /home/runner/.ya/build/build_root/7jz3/001974/r3tmp/yandexQ4QvQ5.tmp
2025-11-03T16:52:07.624866Z node 7 :NET_CLASSIFIER WARN: net_classifier.cpp:202: successfully initialized from file: /home/runner/.ya/build/build_root/7jz3/001974/r3tmp/yandexQ4QvQ5.tmp
2025-11-03T16:52:07.625052Z node 7 :NET_CLASSIFIER ERROR: net_classifier.cpp:228: got bad distributable configuration
2025-11-03T16:52:07.711539Z INFO: TTestServer started on Port 14530 GrpcPort 3923
2025-11-03T16:52:07.808099Z node 8 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-11-03T16:52:07.871381Z node 7 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-11-03T16:52:07.957856Z node 8 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
TClient is connected to server localhost:14530
PQClient connected to localhost:3923
WaitRootIsUp 'Root'...
TClient::Ls request: Root
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "Root"
    PathId: 1
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 1
    CreateStep: 0
    ParentPathId: 1
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 1
      SubDomainVersion: 0
      SecurityStateVersion: 0
    }
    ChildrenExist: false
  }
  Children {
    Name: ".sys"
    PathId: 18446744073709551615
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 0
    CreateStep: 0
    ParentPathId: 18446744073709551615
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 0
      Pl...
(TRUNCATED)
WaitRootIsUp 'Root' success.
2025-11-03T16:52:08.134464Z node 7 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpAlterSubDomain, opId: 281474976710657:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_alter_subdomain.cpp:311)
waiting...
waiting...
waiting...
waiting...
2025-11-03T16:52:11.850843Z node 7 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[7:7568542948936427357:2081];send_to=[0:7307199536658146131:7762515];
2025-11-03T16:52:11.850923Z node 7 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
2025-11-03T16:52:11.902008Z node 8 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[8:7568542951198792880:2152];send_to=[0:7307199536658146131:7762515];
2025-11-03T16:52:11.902100Z node 8 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
2025-11-03T16:52:12.016842Z node 7 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [7:7568542974706232103:2332], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-03T16:52:12.016932Z node 7 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [7:7568542974706232086:2329], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-03T16:52:12.021051Z node 7 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-03T16:52:12.022568Z node 7 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [7:7568542974706232124:2334], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-03T16:52:12.022675Z node 7 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-03T16:52:12.027345Z node 7 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateResourcePool, opId: 281474976710661:3, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_resource_pool.cpp:179)
2025-11-03T16:52:12.064747Z node 7 :KQP_WORKLOAD_SERVICE WARN: helpers.h:73: [WorkloadService] [TPoolCreatorActor] ActorId: [7:7568542974706232123:2333], DatabaseId: /Root, PoolId: default, Scheduled retry for error: { <main>: Error: Transaction 281474976710661 completed, doublechecking }
2025-11-03T16:52:12.084599Z node 7 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710662:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:690)
2025-11-03T16:52:12.139815Z node 7 :TX_PROXY ERROR: schemereq.cpp:593: Actor# [7:7568542974706232274:2723] txid# 281474976710663, issues: { message: "Check failed: path: \'/Root/.metadata/workload_manager/pools/default\', error: path exist, request accepts it (id: [OwnerId: 72057594046644480, LocalPathId: 8], type: EPathTypeResourcePool, state: EPathStateNoChanges)" severity: 1 }
2025-11-03T16:52:12.153531Z node 8 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:570: Compilation failed, self: [8:7568542976968596943:2307], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-11-03T16:52:12.156939Z node 8 :KQP_SESSION WARN: kqp_session_actor.cpp:2506: SessionId: ydb://session/3?node_id=8&id=NzRiNmM5ZTUtODViYmRmMzQtMzlhY2RlM2UtNTljOTEzODc=, ActorId: [8:7568542976968596888:2299], ActorState: ExecuteState, TraceId: 01k95a49paet8smpt19et7kh3s, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-11-03T16:52:12.157476Z node 8 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-11-03T16:52:12.196753Z node 7 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:570: Compilation failed, self: [7:7568542974706232285:2346], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-11-03T16:52:12.197801Z node 7 :KQP_SESSION WARN: kqp_session_actor.cpp:2506: SessionId: ydb://session/3?node_id=7&id=OTMxMDc5Y2UtOTVhYWY1MTgtOTI5NzljYjYtY2E3NTY3NGI=, ActorId: [7:7568542970411264786:2326], ActorState: ExecuteState, TraceId: 01k95a49kc67zme9yncrnt1dpx, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-11-03T16:52:12.198311Z node 7 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-11-03T16:52:12.237721Z node 7 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710664:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:690)
2025-11-03T16:52:12.448317Z node 7 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710665:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:690)
=== Init DC: UPSERT INTO `/Root/PQ/Config/V2/Cluster` (name, balancer, local, enabled, weight) VALUES ("dc1", "localhost:3923", true, true, 1000);
2025-11-03T16:52:12.786589Z node 7 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976710666. Ctx: { TraceId: 01k95a4a644jpk0y4xse941xxx, Database: , SessionId: ydb://session/3?node_id=7&id=Yzc0ODE2YTAtZDU0ZDllYTMtN2EzN2U0N2UtYTExZjY2NWE=, PoolId: default, DatabaseId: /Root}. Database not set, use /Root
=== CheckClustersList. Subcribe to ClusterTracker from [7:7568542974706232623:2981] 
=== CheckClustersList. Ok
2025-11-03T16:52:20.420632Z node 7 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710671:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:690)
waiting...
PQ Client: create topic: rt3.dc1--test-topic with 1 partitions
CallPersQueueGRPC request to localhost:3923
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-11-03T16:52:20.569751Z node 7 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
CallPersQueueGRPC request to localhost:3923
MetaRequest {
  CmdCreateTopic {
    Topic: "rt3.dc1--test-topic"
    NumPartitions: 1
    Config {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
  }
}
CallPersQueueGRPC response:
Status: 129
ProxyErrorCode: 53
SchemeStatus: 1
FlatTxId {
  TxId: 281474976710672
  SchemeShardTabletId: 72057594046644480
  PathId: 13
}
ErrorCode: OK
AddTopic: rt3.dc1--test-topic
===Run query:``DECLARE $version as Int64; DECLARE $path AS Utf8; DECLARE $cluster as Utf8; UPSERT INTO `/Root/PQ/Config/V2/Topics` (path, dc) VALUES ($path, $cluster); UPSERT INTO `/Root/PQ/Config/V2/Versions` (name, version) VALUES ("Topics", $version);`` with topic = test-topic, dc = dc1
2025-11-03T16:52:20.611003Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1655: [72075186224037893][] pipe [7:7568543009065971420:3254] connected; active server actors: 1
2025-11-03T16:52:20.611218Z node 7 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1519: [72075186224037893][rt3.dc1--test-topic] updating configuration. Deleted partitions []. Added partitions [0]
2025-11-03T16:52:20.613038Z node 7 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:971: [72075186224037893][rt3.dc1--test-topic] Discovered subdomain [OwnerId: 72057594046644480, LocalPathId: 1] state, outOfSpace = 0 at RB 72075186224037893
2025-11-03T16:52:20.614934Z node 7 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:140: [72075186224037893][rt3.dc1--test-topic] BALANCER INIT DONE for rt3.dc1--test-topic: (0, 72075186224037892) 
2025-11-03T16:52:20.643022Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2960: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-11-03T16:52:20.649514Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2992: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-11-03T16:52:20.649868Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:787: [PQ: 72075186224037892] no config, start with empty partitions and default config
2025-11-03T16:52:20.649908Z node 8 :PERSQUEUE NOTICE: pq_impl.cpp:913: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-11-03T16:52:20.649952Z node 8 :PERSQUEUE INFO: pq_impl.cpp:612: [PQ: 72075186224037892] doesn't have tx writes info
2025-11-03T16:52:20.651500Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [7:7568543009065971419:3253], now have 1 active actors on pipe
2025-11-03T16:52:20.651535Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [7:7568543009065971447:2442], now have 1 active actors on pipe
2025-11-03T16:52:20.652245Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-03T16:52:20.652551Z node 7 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:404: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 8, Generation 1
2025-11-03T16:52:20.669922Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-03T16:52:20.680198Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [7:7568543009065971490:3304], now have 1 active actors on pipe
2025-11-03T16:52:20.680957Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-03T16:52:20.686607Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-03T16:52:20.687465Z node 8 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-11-03T16:52:20.687521Z node 8 :PERSQUEUE DEBUG: partition.cpp:1312: [72075186224037892][Partition][0][StateInit] HandleOnInit TEvPQ::TEvProposePartitionConfig
2025-11-03T16:52:20.687849Z node 8 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-11-03T16:52:20.690106Z node 8 :PERSQUEUE INFO: partition_init.cpp:1101: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [8:7568543011328335750:2384]
2025-11-03T16:52:20.693386Z node 8 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-11-03T16:52:20.693427Z node 8 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-11-03T16:52:20.694596Z node 8 :PERSQUEUE INFO: partition.cpp:707: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1 [8:7568543011328335750:2384]
2025-11-03T16:52:20.694652Z node 8 :PERSQUEUE DEBUG: partition.cpp:727: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 0 Head Offset 0 PartNo 0 PackedSize 0 count 0 nextOffset 0 batches 0
2025-11-03T16:52:20.694699Z node 8 :PERSQUEUE DEBUG: partition_mlp.cpp:83: [72075186224037892][Partition][0][StateIdle] Initializing MLP Consumers: 0
2025-11-03T16:52:20.696306Z node 8 :PERSQUEUE DEBUG: partition.cpp:4273: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 1
2025-11-03T16:52:20.696356Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:20.696458Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:20.696472Z node 8 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-03T16:52:20.696497Z node 8 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-11-03T16:52:20.696512Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:20.696527Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:20.696539Z node 8 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-11-03T16:52:20.696574Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:923: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-11-03T16:52:20.696618Z node 8 :PERSQUEUE DEBUG: partition_mlp.cpp:60: [72075186224037892][Partition][0][StateIdle] Process MLP pending events. Count 0
2025-11-03T16:52:20.697374Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-03T16:52:20.697510Z node 8 :PERSQUEUE DEBUG: partition_compaction.cpp:183: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:52:20.709473Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-03T16:52:20.709656Z node 8 :PERSQUEUE DEBUG: partition.cpp:1416: [72075186224037892][Partition][0][StateIdle] Handle TEvPQ::TEvTxCommit Step 1762188740725, TxId 281474976710672
2025-11-03T16:52:20.709685Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:20.709700Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:20.709849Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:20.710099Z node 8 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-03T16:52:20.714644Z node 8 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-03T16:52:20.714832Z node 8 :PERSQUEUE DEBUG: partition_mlp.cpp:83: [72075186224037892][Partition][0][StateIdle] Initializing MLP Consumers: 0
2025-11-03T16:52:20.714983Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-11-03T16:52:20.715011Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:20.715025Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:20.715043Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:20.715080Z node 8 :PERSQUEUE DEBUG: partition_compaction.cpp:183: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:52:20.715461Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:398: [PQ: 72075186224037892] Apply new config PartitionConfig { LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 } PartitionIds: 0 TopicName: "rt3.dc1--test-topic" Version: 0 LocalDC: true Codecs { Ids: 0 Ids: 1 Ids: 2 Codecs: "raw" Codecs: "gzip" Codecs: "lzop" } TopicPath: "/Root/PQ/rt3.dc1--test-topic" YcCloudId: "" YcFolderId: "" YdbDatabaseId: "" YdbDatabasePath: "/Root" Partitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } AllPartitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } Consumers { Name: "user" ReadFromTimestampsMs: 0 FormatVersion: 0 Version: 0 Generation: 0 } MonitoringProjectId: ""
2025-11-03T16:52:20.715561Z node 8 :PERSQUEUE NOTICE: pq_impl.cpp:913: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-11-03T16:52:20.715856Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-03T16:52:20.730381Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-03T16:52:20.730537Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-03T16:52:20.740185Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-03T16:52:20.790797Z node 7 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976710673. Ctx: { TraceId: 01k95a4j0v216dvcqqkyysjzew, Database: , SessionId: ydb://session/3?node_id=7&id=MTQwMDNlMWYtMWMxMTY3ZjMtODVmOGRmMmEtNTBjMTU1ZWY=, PoolId: default, DatabaseId: /Root}. Database not set, use /Root
2025-11-03T16:52:20.796611Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:20.796646Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:20.796666Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
===Query complete
TClient::Ls request: /Root/PQ/rt3.dc1--test-topic
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976710672
    CreateStep: 1762188740725
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts...
(TRUNCATED)
GetTopicVersionFromPath:  record Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976710672
    CreateStep: 1762188740725
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      YdbDatabasePath: "/Root"
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
    Partitions {
      PartitionId: 0
      TabletId: 72075186224037892
      Status: Active
    }
    AlterVersion: 1
    BalancerTabletID: 72075186224037893
    NextPartitionId: 1
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 1
      PlanResolution: 7
      Coordinators: 72057594046316545
      TimeCastBucketsPerMediator: 2
      Mediators: 72057594046382081
    }
    DomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    PathsInside: 12
    PathsLimit: 10000
    ShardsInside: 6
    ShardsLimit: 200000
    ResourcesDomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    DiskSpaceUsage {
      Tables {
        TotalSize: 0
        DataSize: 0
        IndexSize: 0
      }
      Topics {
        ReserveSize: 0
        AccountSize: 0
        DataSize: 0
        UsedReserveSize: 0
      }
    }
    PQPartitionsInside: 1
    PQPartitionsLimit: 1000000
    SchemeLimits {
      MaxDepth: 32
      MaxPaths: 10000
      MaxChildrenInDir: 100000
      MaxAclBytesSize: 10240
      MaxTableColumns: 200
      MaxTableColumnNameLength: 255
      MaxTableKeyColumns: 30
      MaxTableIndices: 20
      MaxShards: 200000
      MaxShardsInPath: 35000
      MaxConsistentCopyTargets: 10000
      MaxPathElementLength: 255
      ExtraPathSymbolsAllowed: "!\"#$%&\'()*+,-.:;<=>?@[\\]^_`{|}~"
      MaxPQPartitions: 1000000
      MaxTableCdcStreams: 5
      MaxExports: 10
      MaxImports: 10
      MaxColumnTableColumns: 10000
    }
  }
}
Path: "/Root/PQ/rt3.dc1--test-topic"
 name rt3.dc1--test-topic version1
CallPersQueueGRPC request to localhost:3923
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
MetaResponse {
  CmdGetTopicMetadataResult {
    TopicInfo {
      Topic: "rt3.dc1--test-topic"
      NumPartitions: 1
      Config {
        PartitionConfig {
          LifetimeSeconds: 86400
          LowWatermark: 8388608
          SourceIdLifetimeSeconds: 86400
          WriteSpeedInBytesPerSecond: 20000000
          BurstSize: 20000000
          SourceIdMaxCounts: 6000000
        }
        Version: 1
        LocalDC: true
        Codecs {
          Ids: 0
          Ids: 1
          Ids: 2
          Codecs: "raw"
          Codecs: "gzip"
          Codecs: "lzop"
        }
        TopicPath: "/Root/PQ/rt3.dc1--test-topic"
        YdbDatabasePath: "/Root"
        Consumers {
          Name: "user"
          ReadFromTimestampsMs: 0
          FormatVersion: 0
          Version: 0
        }
      }
      ErrorCode: OK
    }
  }
}
=== Topic created, have version: 1
2025-11-03T16:52:20.862880Z node 7 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
2025-11-03T16:52:20.890148Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: try to update token
2025-11-03T16:52:20.890578Z :INFO: [] MessageGroupId [src] SessionId [] Write session: Do CDS request
2025-11-03T16:52:20.890625Z :INFO: [] MessageGroupId [src] SessionId [] Start write session. Will connect to endpoint: localhost:3923
2025-11-03T16:52:20.898564Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:20.898601Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:20.898623Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:20.909496Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src" }
2025-11-03T16:52:20.910773Z node 7 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-11-03T16:52:20.910812Z node 7 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1
2025-11-03T16:52:20.911943Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src" }
2025-11-03T16:52:20.912115Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1 topic: "test-topic" message_group_id: "src" from ipv6:[::1]:51106
2025-11-03T16:52:20.912134Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51106 proto=v1  topic=test-topic durationSec=0
2025-11-03T16:52:20.912146Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-11-03T16:52:20.913965Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1 sessionId:  describe result for acl check
2025-11-03T16:52:20.914104Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-11-03T16:52:20.914140Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-11-03T16:52:20.914155Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-11-03T16:52:20.914177Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [7:7568543009065971570:2460] (SourceId=src, PreferedPartition=(NULL)) StartKqpSession
2025-11-03T16:52:20.922258Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [7:7568543009065971570:2460] (SourceId=src, PreferedPartition=(NULL)) Select from the table
2025-11-03T16:52:21.004113Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:21.004154Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:21.004174Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:21.107852Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:21.107894Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:21.107916Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:21.154759Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [7:7568543009065971570:2460] (SourceId=src, PreferedPartition=(NULL)) RequestPQRB
2025-11-03T16:52:21.155711Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1655: [72075186224037893][rt3.dc1--test-topic] pipe [7:7568543013360938910:2460] connected; active server actors: 1
2025-11-03T16:52:21.155769Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [7:7568543009065971570:2460] (SourceId=src, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=src
2025-11-03T16:52:21.155794Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [7:7568543009065971570:2460] (SourceId=src, PreferedPartition=(NULL)) Update the table
2025-11-03T16:52:21.161702Z node 7 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1659: [72075186224037893][rt3.dc1--test-topic] pipe [7:7568543013360938910:2460] disconnected.
2025-11-03T16:52:21.161749Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1670: [72075186224037893][rt3.dc1--test-topic] pipe [7:7568543013360938910:2460] disconnected; active server actors: 1
2025-11-03T16:52:21.161774Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1695: [72075186224037893][rt3.dc1--test-topic] pipe [7:7568543013360938910:2460] disconnected no session
2025-11-03T16:52:21.209457Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:21.209493Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:21.209516Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:21.312099Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:21.312135Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:21.312152Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:21.335636Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [7:7568543009065971570:2460] (SourceId=src, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-11-03T16:52:21.335688Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [7:7568543009065971570:2460] (SourceId=src, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-11-03T16:52:21.335712Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [7:7568543009065971570:2460] (SourceId=src, PreferedPartition=(NULL)) Start idle
2025-11-03T16:52:21.335749Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-11-03T16:52:21.338120Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [7:7568543013360938936:2460], now have 1 active actors on pipe
2025-11-03T16:52:21.338433Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 8, Generation: 1
2025-11-03T16:52:21.338827Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:21.338868Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:21.338966Z node 8 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src|c663d2b-e562c9f4-50848456-1bb6e379_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src
2025-11-03T16:52:21.339014Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:21.339042Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:21.339056Z node 8 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-03T16:52:21.339109Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:21.339156Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-03T16:52:21.339213Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-03T16:52:21.340102Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:21.340131Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:21.340206Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-03T16:52:21.340662Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1 partition: 0 MaxSeqNo: 0 sessionId: src|c663d2b-e562c9f4-50848456-1bb6e379_0
2025-11-03T16:52:21.348216Z :INFO: [] MessageGroupId [src] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1762188741348 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-11-03T16:52:21.348357Z :INFO: [] MessageGroupId [src] SessionId [] Write session established. Init response: session_id: "src|c663d2b-e562c9f4-50848456-1bb6e379_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-11-03T16:52:21.348773Z :INFO: [] MessageGroupId [src] SessionId [src|c663d2b-e562c9f4-50848456-1bb6e379_0] Write session: close. Timeout = 0 ms
2025-11-03T16:52:21.348829Z :INFO: [] MessageGroupId [src] SessionId [src|c663d2b-e562c9f4-50848456-1bb6e379_0] Write session will now close
2025-11-03T16:52:21.348883Z :DEBUG: [] MessageGroupId [src] SessionId [src|c663d2b-e562c9f4-50848456-1bb6e379_0] Write session: aborting
2025-11-03T16:52:21.349391Z :INFO: [] MessageGroupId [src] SessionId [src|c663d2b-e562c9f4-50848456-1bb6e379_0] Write session: gracefully shut down, all writes complete
2025-11-03T16:52:21.349445Z :DEBUG: [] MessageGroupId [src] SessionId [src|c663d2b-e562c9f4-50848456-1bb6e379_0] Write session: destroy
2025-11-03T16:52:21.353893Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId: src|c663d2b-e562c9f4-50848456-1bb6e379_0 grpc read done: success: 0 data: 
2025-11-03T16:52:21.353921Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 1 sessionId: src|c663d2b-e562c9f4-50848456-1bb6e379_0 grpc read failed
2025-11-03T16:52:21.354137Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:824: session v1 closed cookie: 1 sessionId: src|c663d2b-e562c9f4-50848456-1bb6e379_0
2025-11-03T16:52:21.354161Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1 sessionId: src|c663d2b-e562c9f4-50848456-1bb6e379_0 is DEAD
2025-11-03T16:52:21.355613Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-11-03T16:52:21.356170Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [7:7568543013360938936:2460] destroyed
2025-11-03T16:52:21.356230Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-11-03T16:52:21.356264Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:21.356283Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:21.356312Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:21.389598Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [] Write session: try to update token
2025-11-03T16:52:21.389993Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [] Write session: Do CDS request
2025-11-03T16:52:21.390055Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [] Do schedule cds request after 0 ms
2025-11-03T16:52:21.390143Z :TWriteSession_WriteAndReadAndCommitRandomMessages INFO: Wait for writer event
2025-11-03T16:52:21.390307Z :INFO: [/Root] MessageGroupId [test-message-group-id] Running cds request ms
2025-11-03T16:52:21.405174Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [] Got CDS response: 
write_sessions_clusters { clusters { endpoint: "localhost:3923" name: "dc1" available: true } primary_cluster_selection_reason: CLIENT_LOCATION } version: 1
2025-11-03T16:52:21.405251Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [] Start write session. Will connect to endpoint: localhost:3923
2025-11-03T16:52:21.416083Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:21.416121Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:21.416139Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:21.437303Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [] Write session: send init request: init_request { topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" }
2025-11-03T16:52:21.439869Z node 7 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-11-03T16:52:21.439904Z node 7 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2
2025-11-03T16:52:21.440502Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" }
2025-11-03T16:52:21.440684Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2 topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" from ipv6:[::1]:51128
2025-11-03T16:52:21.440706Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51128 proto=v1  topic=test-topic durationSec=0
2025-11-03T16:52:21.440720Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-11-03T16:52:21.442925Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2 sessionId:  describe result for acl check
2025-11-03T16:52:21.443225Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-11-03T16:52:21.443242Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-11-03T16:52:21.443253Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-11-03T16:52:21.443275Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [7:7568543013360938953:2480] (SourceId=test-message-group-id, PreferedPartition=(NULL)) StartKqpSession
2025-11-03T16:52:21.452090Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [7:7568543013360938953:2480] (SourceId=test-message-group-id, PreferedPartition=(NULL)) Select from the table
2025-11-03T16:52:21.470445Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [7:7568543013360938953:2480] (SourceId=test-message-group-id, PreferedPartition=(NULL)) RequestPQRB
2025-11-03T16:52:21.472139Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1655: [72075186224037893][rt3.dc1--test-topic] pipe [7:7568543013360938972:2480] connected; active server actors: 1
2025-11-03T16:52:21.476674Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [7:7568543013360938953:2480] (SourceId=test-message-group-id, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=test-message-group-id
2025-11-03T16:52:21.476714Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [7:7568543013360938953:2480] (SourceId=test-message-group-id, PreferedPartition=(NULL)) Update the table
2025-11-03T16:52:21.478103Z node 7 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1659: [72075186224037893][rt3.dc1--test-topic] pipe [7:7568543013360938972:2480] disconnected.
2025-11-03T16:52:21.478151Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1670: [72075186224037893][rt3.dc1--test-topic] pipe [7:7568543013360938972:2480] disconnected; active server actors: 1
2025-11-03T16:52:21.478175Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1695: [72075186224037893][rt3.dc1--test-topic] pipe [7:7568543013360938972:2480] disconnected no session
2025-11-03T16:52:21.502759Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [7:7568543013360938953:2480] (SourceId=test-message-group-id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-11-03T16:52:21.502807Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [7:7568543013360938953:2480] (SourceId=test-message-group-id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-11-03T16:52:21.502836Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [7:7568543013360938953:2480] (SourceId=test-message-group-id, PreferedPartition=(NULL)) Start idle
2025-11-03T16:52:21.502878Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-11-03T16:52:21.506881Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 8, Generation: 1
2025-11-03T16:52:21.509842Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [7:7568543013360938998:2480], now have 1 active actors on pipe
2025-11-03T16:52:21.509952Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:21.509984Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:21.510087Z node 8 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie test-message-group-id|b9280e20-3862e277-1fa41d05-f3a954e3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner test-message-group-id
2025-11-03T16:52:21.510133Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:21.510158Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:21.510173Z node 8 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-03T16:52:21.510229Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:21.510274Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-03T16:52:21.510332Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-03T16:52:21.516501Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:21.516549Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:21.516653Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-03T16:52:21.520291Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2 partition: 0 MaxSeqNo: 0 sessionId: test-message-group-id|b9280e20-3862e277-1fa41d05-f3a954e3_0
2025-11-03T16:52:21.524626Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1762188741524 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-11-03T16:52:21.524777Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [] Write session established. Init response: session_id: "test-message-group-id|b9280e20-3862e277-1fa41d05-f3a954e3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-11-03T16:52:21.524098Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:21.524133Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:21.524153Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:21.528097Z :TWriteSession_WriteAndReadAndCommitRandomMessages INFO: Got new continue token
2025-11-03T16:52:21.528194Z :TWriteSession_WriteAndReadAndCommitRandomMessages INFO: [] Write messages with sequence numbers 1
2025-11-03T16:52:21.528330Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|b9280e20-3862e277-1fa41d05-f3a954e3_0] Write 1 messages with Id from 1 to 1
2025-11-03T16:52:21.528478Z :TWriteSession_WriteAndReadAndCommitRandomMessages INFO: Wait for writer event
2025-11-03T16:52:21.528597Z :TWriteSession_WriteAndReadAndCommitRandomMessages INFO: Got new continue token
2025-11-03T16:52:21.528642Z :TWriteSession_WriteAndReadAndCommitRandomMessages INFO: [] Write messages with sequence numbers 2
2025-11-03T16:52:21.528688Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|b9280e20-3862e277-1fa41d05-f3a954e3_0] Write 1 messages with Id from 2 to 2
2025-11-03T16:52:21.528751Z :TWriteSession_WriteAndReadAndCommitRandomMessages INFO: Wait for writer event
2025-11-03T16:52:21.528797Z :TWriteSession_WriteAndReadAndCommitRandomMessages INFO: Got new continue token
2025-11-03T16:52:21.528831Z :TWriteSession_WriteAndReadAndCommitRandomMessages INFO: [] Write messages with sequence numbers 3
2025-11-03T16:52:21.528902Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|b9280e20-3862e277-1fa41d05-f3a954e3_0] Write 1 messages with Id from 3 to 3
2025-11-03T16:52:21.528972Z :TWriteSession_WriteAndReadAndCommitRandomMessages INFO: Wait for writer event
2025-11-03T16:52:21.529039Z :TWriteSession_WriteAndReadAndCommitRandomMessages INFO: Got new continue token
2025-11-03T16:52:21.529110Z :TWriteSession_WriteAndReadAndCommitRandomMessages INFO: [] Write messages with sequence numbers 4
2025-11-03T16:52:21.529162Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|b9280e20-3862e277-1fa41d05-f3a954e3_0] Write session: try to update token
2025-11-03T16:52:21.529218Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|b9280e20-3862e277-1fa41d05-f3a954e3_0] Send 1 message(s) (2 left), first sequence number is 1
2025-11-03T16:52:21.530074Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|b9280e20-3862e277-1fa41d05-f3a954e3_0] Write 1 messages with Id from 4 to 4
2025-11-03T16:52:21.530149Z :TWriteSession_WriteAndReadAndCommitRandomMessages INFO: Wait for writer event
2025-11-03T16:52:21.530202Z :TWriteSession_WriteAndReadAndCommitRandomMessages INFO: Got new continue token
2025-11-03T16:52:21.530204Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|b9280e20-3862e277-1fa41d05-f3a954e3_0] Write session: try to update token
2025-11-03T16:52:21.530230Z :TWriteSession_WriteAndReadAndCommitRandomMessages INFO: [] Write messages with sequence numbers 5
2025-11-03T16:52:21.530253Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|b9280e20-3862e277-1fa41d05-f3a954e3_0] Send 1 message(s) (2 left), first sequence number is 2
2025-11-03T16:52:21.530325Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|b9280e20-3862e277-1fa41d05-f3a954e3_0] Write 1 messages with Id from 5 to 5
2025-11-03T16:52:21.530367Z :TWriteSession_WriteAndReadAndCommitRandomMessages INFO: Wait for writer event
2025-11-03T16:52:21.530404Z :TWriteSession_WriteAndReadAndCommitRandomMessages INFO: Got new continue token
2025-11-03T16:52:21.530912Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|b9280e20-3862e277-1fa41d05-f3a954e3_0] Write session: try to update token
2025-11-03T16:52:21.530950Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|b9280e20-3862e277-1fa41d05-f3a954e3_0] Send 1 message(s) (2 left), first sequence number is 3
2025-11-03T16:52:21.531616Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|b9280e20-3862e277-1fa41d05-f3a954e3_0] Write session: try to update token
2025-11-03T16:52:21.531655Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|b9280e20-3862e277-1fa41d05-f3a954e3_0] Send 1 message(s) (1 left), first sequence number is 4
2025-11-03T16:52:21.532901Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|b9280e20-3862e277-1fa41d05-f3a954e3_0] Write session: try to update token
2025-11-03T16:52:21.532942Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|b9280e20-3862e277-1fa41d05-f3a954e3_0] Send 1 message(s) (0 left), first sequence number is 5
2025-11-03T16:52:21.536250Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: test-message-group-id|b9280e20-3862e277-1fa41d05-f3a954e3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:52:21.536623Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:52:21.537022Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: test-message-group-id|b9280e20-3862e277-1fa41d05-f3a954e3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:52:21.537192Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:52:21.537546Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: test-message-group-id|b9280e20-3862e277-1fa41d05-f3a954e3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:52:21.537721Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:52:21.537986Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: test-message-group-id|b9280e20-3862e277-1fa41d05-f3a954e3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:52:21.538126Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:52:21.538368Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: test-message-group-id|b9280e20-3862e277-1fa41d05-f3a954e3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:52:21.538601Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:52:21.541057Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:21.541100Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:21.541149Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:21.541163Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:21.541197Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:21.541209Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:21.541241Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:21.541254Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:21.541291Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:21.541301Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:21.541398Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-11-03T16:52:21.541439Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1  requestId: <none> cookie: 2
2025-11-03T16:52:21.541455Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 2  requestId: <none> cookie: 3
2025-11-03T16:52:21.541471Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 3  requestId: <none> cookie: 4
2025-11-03T16:52:21.541487Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 4  requestId: <none> cookie: 5
2025-11-03T16:52:21.542565Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:21.542649Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:21.542681Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:21.542734Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:21.542790Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:21.543727Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:21.543763Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:21.544182Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0test-message-group-id' SeqNo: 1 partNo : 0 messageNo: 5 size 1905 offset: -1
2025-11-03T16:52:21.544265Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:21.544283Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:21.544315Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0test-message-group-id' SeqNo: 2 partNo : 0 messageNo: 6 size 2801 offset: -1
2025-11-03T16:52:21.544391Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:21.544409Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:21.544439Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0test-message-group-id' SeqNo: 3 partNo : 0 messageNo: 7 size 3696 offset: -1
2025-11-03T16:52:21.544494Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:21.544506Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:21.544529Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0test-message-group-id' SeqNo: 4 partNo : 0 messageNo: 8 size 4589 offset: -1
2025-11-03T16:52:21.544611Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:21.544627Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:21.544677Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0test-message-group-id' SeqNo: 5 partNo : 0 messageNo: 9 size 5485 offset: -1
2025-11-03T16:52:21.544717Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:52:21.544769Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:21.544799Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:21.544815Z node 8 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-03T16:52:21.544936Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0test-message-group-id' seqNo 1 partNo 0
2025-11-03T16:52:21.545879Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0test-message-group-id' seqNo 1 partNo 0 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 1994 count 1 nextOffset 1 batches 1
2025-11-03T16:52:21.545919Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:21.546526Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 0,1 HeadOffset 0 endOffset 0 curOffset 1 d0000000000_00000000000000000000_00000_0000000001_00000? size 1982 WTime 1762188741546
2025-11-03T16:52:21.546705Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:52:21.546747Z node 8 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:52:21.546761Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:52:21.546783Z node 8 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:52:21.546799Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:52:21.546815Z node 8 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:52:21.546831Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:52:21.546854Z node 8 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:52:21.546881Z node 8 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-03T16:52:21.547019Z node 8 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 0 partNo 0 count 1 size 1982
2025-11-03T16:52:21.577377Z node 8 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 0 count 1 size 1982 actorID [8:7568543011328335732:2384]
2025-11-03T16:52:21.577451Z node 8 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-03T16:52:21.577508Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1927 WriteNewSizeFromSupportivePartitions# 0
2025-11-03T16:52:21.577549Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:52:21.577600Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0test-message-group-id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 1, partNo: 0, Offset: 0 is stored on disk
2025-11-03T16:52:21.577818Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:923: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-11-03T16:52:21.577841Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:965: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-11-03T16:52:21.577863Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:21.577904Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:21.577917Z node 8 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (4)
2025-11-03T16:52:21.578025Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0test-message-group-id' seqNo 2 partNo 0
2025-11-03T16:52:21.582407Z node 8 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 0 suffix '63' size 1982
2025-11-03T16:52:21.735836Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0test-message-group-id' seqNo 2 partNo 0 FormedBlobsCount 0 NewHead: Offset 1 PartNo 0 PackedSize 2890 count 1 nextOffset 2 batches 1
2025-11-03T16:52:21.744637Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0test-message-group-id' seqNo 3 partNo 0
2025-11-03T16:52:21.744731Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0test-message-group-id' seqNo 3 partNo 0 FormedBlobsCount 0 NewHead: Offset 1 PartNo 0 PackedSize 6643 count 2 nextOffset 3 batches 1
2025-11-03T16:52:21.744760Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0test-message-group-id' seqNo 4 partNo 0
2025-11-03T16:52:21.744787Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0test-message-group-id' seqNo 4 partNo 0 FormedBlobsCount 0 NewHead: Offset 1 PartNo 0 PackedSize 11289 count 3 nextOffset 4 batches 1
2025-11-03T16:52:21.744814Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0test-message-group-id' seqNo 5 partNo 0
2025-11-03T16:52:21.744840Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0test-message-group-id' seqNo 5 partNo 0 FormedBlobsCount 0 NewHead: Offset 1 PartNo 0 PackedSize 16831 count 4 nextOffset 5 batches 1
2025-11-03T16:52:21.744860Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:21.745631Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 1,4 HeadOffset 1 endOffset 1 curOffset 5 d0000000000_00000000000000000001_00000_0000000004_00000? size 16716 WTime 1762188741745
2025-11-03T16:52:21.745796Z node 8 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:52:21.745926Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 5  requestId: <none> cookie: 1
2025-11-03T16:52:21.746037Z node 8 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:52:21.746075Z node 8 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-03T16:52:21.746213Z node 8 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 1 partNo 0 count 4 size 16716
2025-11-03T16:52:21.746444Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:880: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 partno 0 count 1 size 1024000 endOffset 1 max time lag 0ms effective offset 0
2025-11-03T16:52:21.746692Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:1105: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 1982 count 1 last offset 0, current partition end offset: 1
2025-11-03T16:52:21.746714Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:1121: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-11-03T16:52:21.746798Z node 8 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 0 partno 0 count 1 parts_count 0 source 1 size 1982 accessed 0 times before, last time 2025-11-03T16:52:21.000000Z
2025-11-03T16:52:21.746824Z node 8 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 3. All 1 blobs are from cache.
2025-11-03T16:52:21.746871Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:572: FormAnswer for 1 blobs
2025-11-03T16:52:21.747000Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 0 totakecount 1 count 1 size 1962 from pos 0 cbcount 1
2025-11-03T16:52:21.747070Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:1015: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1762188741544 queuesize 0 startOffset 0
2025-11-03T16:52:21.748151Z node 8 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 0 suffix '63'
2025-11-03T16:52:21.752275Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:21.757800Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|b9280e20-3862e277-1fa41d05-f3a954e3_0] Write session got write response: sequence_numbers: 1 offsets: 0 already_written: false write_statistics { persist_duration_ms: 26 queued_in_partition_duration_ms: 1 }
2025-11-03T16:52:21.757861Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|b9280e20-3862e277-1fa41d05-f3a954e3_0] Write session: acknoledged message 1
2025-11-03T16:52:21.788321Z node 8 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 1 count 4 size 16716 actorID [8:7568543011328335732:2384]
2025-11-03T16:52:21.788404Z node 8 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-03T16:52:21.788465Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 16659 WriteNewSizeFromSupportivePartitions# 0
2025-11-03T16:52:21.788505Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:52:21.788550Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0test-message-group-id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 2, partNo: 0, Offset: 1 is stored on disk
2025-11-03T16:52:21.788569Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:52:21.788592Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0test-message-group-id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 3, partNo: 0, Offset: 2 is stored on disk
2025-11-03T16:52:21.788605Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:52:21.788630Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0test-message-group-id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 4, partNo: 0, Offset: 3 is stored on disk
2025-11-03T16:52:21.788643Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:52:21.788667Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0test-message-group-id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 5, partNo: 0, Offset: 4 is stored on disk
2025-11-03T16:52:21.788877Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:21.788892Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:21.788907Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:21.788946Z node 8 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:52:21.788992Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 6  requestId: <none> cookie: 2
2025-11-03T16:52:21.789043Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 7  requestId: <none> cookie: 3
2025-11-03T16:52:21.789065Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 8  requestId: <none> cookie: 4
2025-11-03T16:52:21.789084Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 9  requestId: <none> cookie: 5
2025-11-03T16:52:21.789747Z node 8 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 1 partno 0 count 4 parts 0 suffix '63' size 16716
2025-11-03T16:52:21.792118Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:21.792238Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:21.792295Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:21.792346Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:21.796219Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|b9280e20-3862e277-1fa41d05-f3a954e3_0] Write session got write response: sequence_numbers: 2 offsets: 1 already_written: false write_statistics { persist_duration_ms: 44 queued_in_partition_duration_ms: 197 }
2025-11-03T16:52:21.796279Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|b9280e20-3862e277-1fa41d05-f3a954e3_0] Write session: acknoledged message 2
2025-11-03T16:52:21.796556Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|b9280e20-3862e277-1fa41d05-f3a954e3_0] Write session got write response: sequence_numbers: 3 offsets: 2 already_written: false write_statistics { persist_duration_ms: 44 queued_in_partition_duration_ms: 197 }
2025-11-03T16:52:21.796584Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|b9280e20-3862e277-1fa41d05-f3a954e3_0] Write session: acknoledged message 3
2025-11-03T16:52:21.796741Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|b9280e20-3862e277-1fa41d05-f3a954e3_0] Write session got write response: sequence_numbers: 4 offsets: 3 already_written: false write_statistics { persist_duration_ms: 44 queued_in_partition_duration_ms: 197 }
2025-11-03T16:52:21.796769Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|b9280e20-3862e277-1fa41d05-f3a954e3_0] Write session: acknoledged message 4
2025-11-03T16:52:21.796926Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|b9280e20-3862e277-1fa41d05-f3a954e3_0] Write session got write response: sequence_numbers: 5 offsets: 4 already_written: false write_statistics { persist_duration_ms: 44 queued_in_partition_duration_ms: 197 }
2025-11-03T16:52:21.796949Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|b9280e20-3862e277-1fa41d05-f3a954e3_0] Write session: acknoledged message 5
2025-11-03T16:52:21.808024Z :TWriteSession_WriteAndReadAndCommitRandomMessages INFO: All messages are written
2025-11-03T16:52:21.808272Z :INFO: [/Root] [/Root] [f383850c-b6aac90d-91539553-5e93999f] Starting read session
2025-11-03T16:52:21.808313Z :DEBUG: [/Root] [/Root] [f383850c-b6aac90d-91539553-5e93999f] Starting cluster discovery
Get event on client
2025-11-03T16:52:21.814297Z :DEBUG: [/Root] [/Root] [f383850c-b6aac90d-91539553-5e93999f] Cluster discovery request succeeded
2025-11-03T16:52:21.814379Z :DEBUG: [/Root] [/Root] [f383850c-b6aac90d-91539553-5e93999f] Starting session to cluster dc1 (localhost:3923)
2025-11-03T16:52:21.814574Z :DEBUG: [/Root] [/Root] [f383850c-b6aac90d-91539553-5e93999f] [dc1] In Reconnect, ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:52:21.814617Z :DEBUG: [/Root] [/Root] [f383850c-b6aac90d-91539553-5e93999f] [dc1] New values: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:52:21.814663Z :DEBUG: [/Root] [/Root] [f383850c-b6aac90d-91539553-5e93999f] [dc1] Reconnecting session to cluster dc1 in 0.000000s
2025-11-03T16:52:21.818740Z :DEBUG: [/Root] [/Root] [f383850c-b6aac90d-91539553-5e93999f] [dc1] Successfully connected. Initializing session
2025-11-03T16:52:21.820036Z node 7 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:109: new grpc connection
2025-11-03T16:52:21.820061Z node 7 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:131: new session created cookie 1
2025-11-03T16:52:21.825126Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { topic: "test-topic" } read_only_original: true consumer: "shared/user" read_params { max_read_size: 104857600 } } }
2025-11-03T16:52:21.825410Z node 7 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 1 consumer shared/user session shared/user_7_1_798936181586527143_v1 read init: from# ipv6:[::1]:51128, request# { init_request { topics_read_settings { topic: "test-topic" } read_only_original: true consumer: "shared/user" read_params { max_read_size: 104857600 } } }
2025-11-03T16:52:21.825916Z node 7 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 1 consumer shared/user session shared/user_7_1_798936181586527143_v1 auth for : user
2025-11-03T16:52:21.827189Z node 7 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 1 consumer shared/user session shared/user_7_1_798936181586527143_v1 Handle describe topics response
2025-11-03T16:52:21.827335Z node 7 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 1 consumer shared/user session shared/user_7_1_798936181586527143_v1 auth is DEAD
2025-11-03T16:52:21.827414Z node 7 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 1 consumer shared/user session shared/user_7_1_798936181586527143_v1 auth ok: topics# 1, initDone# 0
2025-11-03T16:52:21.834452Z node 7 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 1 consumer shared/user session shared/user_7_1_798936181586527143_v1 register session: topic# rt3.dc1--test-topic
2025-11-03T16:52:21.836119Z :INFO: [/Root] [/Root] [f383850c-b6aac90d-91539553-5e93999f] [dc1] Server session id: shared/user_7_1_798936181586527143_v1
2025-11-03T16:52:21.836452Z :DEBUG: [/Root] [/Root] [f383850c-b6aac90d-91539553-5e93999f] [dc1] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:52:21.836361Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1655: [72075186224037893][rt3.dc1--test-topic] pipe [7:7568543013360939015:2489] connected; active server actors: 1
2025-11-03T16:52:21.836536Z node 7 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1706: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [7:7568543013360939015:2489] session shared/user_7_1_798936181586527143_v1
2025-11-03T16:52:21.836591Z node 7 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:639: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-11-03T16:52:21.836650Z node 7 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:669: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-11-03T16:52:21.836696Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:871: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_7_1_798936181586527143_v1" (Sender=[7:7568543013360939012:2489], Pipe=[7:7568543013360939015:2489], Partitions=[], ActiveFamilyCount=0)
2025-11-03T16:52:21.836724Z node 7 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1186: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-11-03T16:52:21.836781Z node 7 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1258: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-11-03T16:52:21.836840Z node 7 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1305: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_7_1_798936181586527143_v1" (Sender=[7:7568543013360939012:2489], Pipe=[7:7568543013360939015:2489], Partitions=[], ActiveFamilyCount=0)
2025-11-03T16:52:21.836905Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:549: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_7_1_798936181586527143_v1" sender [7:7568543013360939012:2489] lock partition 0 for ReadingSession "shared/user_7_1_798936181586527143_v1" (Sender=[7:7568543013360939012:2489], Pipe=[7:7568543013360939015:2489], Partitions=[], ActiveFamilyCount=1) generation 1 step 1
2025-11-03T16:52:21.836958Z node 7 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1325: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-11-03T16:52:21.836989Z node 7 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1402: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000183s
2025-11-03T16:52:21.837068Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_7_1_798936181586527143_v1 grpc read done: success# 1, data# { read { } }
2025-11-03T16:52:21.838903Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [7:7568543013360939018:2492], now have 1 active actors on pipe
2025-11-03T16:52:21.839520Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:21.839552Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:21.839590Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:1748: [PQ: 72075186224037892] Created session shared/user_7_1_798936181586527143_v1 on pipe: [7:7568543013360939018:2492]
2025-11-03T16:52:21.839655Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:21.839684Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:21.839697Z node 8 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-03T16:52:21.839763Z node 8 :PERSQUEUE DEBUG: partition.cpp:3666: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_7_1_798936181586527143_v1
2025-11-03T16:52:21.839781Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:21.839931Z node 8 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-03T16:52:21.840497Z node 8 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_7_1_798936181586527143_v1:1 with generation 1
2025-11-03T16:52:21.838034Z node 7 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 1 consumer shared/user session shared/user_7_1_798936181586527143_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 1 Session: "shared/user_7_1_798936181586527143_v1" ClientId: "user" PipeClient { RawX1: 7568543013360939015 RawX2: 4503629692144057 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-11-03T16:52:21.838186Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_7_1_798936181586527143_v1 got read request: guid# 75c5d913-c8406f30-ddc140da-92c4ea16
2025-11-03T16:52:21.838268Z node 7 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 1 consumer shared/user session shared/user_7_1_798936181586527143_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-11-03T16:52:21.839251Z node 7 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_7_1_798936181586527143_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 1, pipe: [7:7568543013360939018:2492]
2025-11-03T16:52:21.853214Z node 8 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:52:21.853452Z node 8 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-03T16:52:21.853527Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-11-03T16:52:21.853558Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:21.853574Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:21.853590Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:21.853628Z node 8 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:52:21.853668Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-11-03T16:52:21.854385Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_7_1_798936181586527143_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 5 WriteTimestampMS: 1762188741544 CreateTimestampMS: 1 SizeLag: 3964 WriteTimestampEstimateMS: 1762188741788 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-11-03T16:52:21.854444Z node 7 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 1 consumer shared/user session shared/user_7_1_798936181586527143_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 5 readOffset 0 committedOffset 0
2025-11-03T16:52:21.854520Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 1 consumer shared/user session shared/user_7_1_798936181586527143_v1 sending to client partition status
2025-11-03T16:52:21.856755Z :INFO: [/Root] [/Root] [f383850c-b6aac90d-91539553-5e93999f] [dc1] Confirm partition stream create. Partition stream id: 1. Cluster: "dc1". Topic: "test-topic". Partition: 0. Read offset: (NULL)
2025-11-03T16:52:21.856991Z :TWriteSession_WriteAndReadAndCommitRandomMessages INFO: Read message count is 0 (from 5 in total), committed offset count is 0 (maximum offset: 0)
Get event on client
2025-11-03T16:52:21.864207Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_7_1_798936181586527143_v1 grpc read done: success# 1, data# { start_read { topic { path: "test-topic" } cluster: "dc1" assign_id: 1 } }
2025-11-03T16:52:21.864400Z node 7 :PQ_READ_PROXY INFO: read_session_actor.cpp:539: session cookie 1 consumer shared/user session shared/user_7_1_798936181586527143_v1 got StartRead from client: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 0, commitOffset# 0
2025-11-03T16:52:21.864448Z node 7 :PQ_READ_PROXY INFO: partition_actor.cpp:1023: session cookie 1 consumer shared/user session shared/user_7_1_798936181586527143_v1 Start reading TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 5 readOffset 0 committedOffset 0 clientCommitOffset 0 clientReadOffset 0
2025-11-03T16:52:21.864476Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_7_1_798936181586527143_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 0 endOffset 5
2025-11-03T16:52:21.864534Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_7_1_798936181586527143_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 0, endOffset# 5, WTime# 1762188741544, sizeLag# 3964
2025-11-03T16:52:21.864549Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_7_1_798936181586527143_v1TEvPartitionReady. Aval parts: 1
2025-11-03T16:52:21.864594Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_7_1_798936181586527143_v1 performing read request: guid# 75c5d913-c8406f30-ddc140da-92c4ea16, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 6, size# 4756, partitionsAsked# 1, maxTimeLag# 0ms
2025-11-03T16:52:21.864675Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_7_1_798936181586527143_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 6 maxSize 4756 maxTimeLagMs 0 readTimestampMs 0 readOffset 0 EndOffset 5 ClientCommitOffset 0 committedOffset 0 Guid 75c5d913-c8406f30-ddc140da-92c4ea16
2025-11-03T16:52:21.870121Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:21.870180Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:21.870319Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:880: [72075186224037892][Partition][0][StateIdle] read cookie 4 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 partno 0 count 6 size 4756 endOffset 5 max time lag 0ms effective offset 0
2025-11-03T16:52:21.870813Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:1105: [72075186224037892][Partition][0][StateIdle] read cookie 4 added 2 blobs, size 18698 count 5 last offset 1, current partition end offset: 5
2025-11-03T16:52:21.870835Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:1121: [72075186224037892][Partition][0][StateIdle] Reading cookie 4. Send blob request.
2025-11-03T16:52:21.870889Z node 8 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 0 partno 0 count 1 parts_count 0 source 1 size 1982 accessed 1 times before, last time 2025-11-03T16:52:21.000000Z
2025-11-03T16:52:21.870911Z node 8 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 1 partno 0 count 4 parts_count 0 source 1 size 16716 accessed 0 times before, last time 2025-11-03T16:52:21.000000Z
2025-11-03T16:52:21.870950Z node 8 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 4. All 2 blobs are from cache.
2025-11-03T16:52:21.871004Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:572: FormAnswer for 2 blobs
2025-11-03T16:52:21.871173Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 0 totakecount 1 count 1 size 1962 from pos 0 cbcount 1
2025-11-03T16:52:21.871489Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 1 totakecount 4 count 4 size 16694 from pos 0 cbcount 4
2025-11-03T16:52:21.871638Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-03T16:52:21.872412Z node 8 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 0 suffix '63'
2025-11-03T16:52:21.872454Z node 8 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 1 partno 0 count 4 parts 0 suffix '63'
2025-11-03T16:52:21.875803Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_7_1_798936181586527143_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 5 Result { Offset: 0 Data: "... 1905 bytes ..." SourceId: "\000test-message-group-id" SeqNo: 1 WriteTimestampMS: 1762188741544 CreateTimestampMS: 1 UncompressedSize: 2048 PartitionKey: "" ExplicitHash: "" } Result { Offset: 1 Data: "... 2801 bytes ..." SourceId: "\000test-message-group-id" SeqNo: 2 WriteTimestampMS: 1762188741577 CreateTimestampMS: 2 UncompressedSize: 3072 PartitionKey: "" ExplicitHash: "" } Result { Offset: 2 Data: "... 3696 bytes ..." SourceId: "\000test-message-group-id" SeqNo: 3 WriteTimestampMS: 1762188741744 CreateTimestampMS: 3 UncompressedSize: 4096 PartitionKey: "" ExplicitHash: "" } Result { Offset: 3 Data: "... 4589 bytes ..." SourceId: "\000test-message-group-id" SeqNo: 4 WriteTimestampMS: 1762188741744 CreateTimestampMS: 4 UncompressedSize: 5120 PartitionKey: "" ExplicitHash: "" } Result { Offset: 4 Data: "... 5485 bytes ..." SourceId: "\000test-message-group-id" SeqNo: 5 WriteTimestampMS: 1762188741744 CreateTimestampMS: 5 UncompressedSize: 6144 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 2 SizeLag: 18446744073709536819 RealReadOffset: 4 WaitQuotaTimeMs: 0 EndOffset: 5 StartOffset: 0 } Cookie: 0 }
2025-11-03T16:52:21.876211Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_7_1_798936181586527143_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 1 from offset 5
2025-11-03T16:52:21.876261Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_7_1_798936181586527143_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 5 ReadOffset 5 ReadGuid 75c5d913-c8406f30-ddc140da-92c4ea16 has messages 1
2025-11-03T16:52:21.876542Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_7_1_798936181586527143_v1 read done: guid# 75c5d913-c8406f30-ddc140da-92c4ea16, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 18633
2025-11-03T16:52:21.876572Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_7_1_798936181586527143_v1 response to read: guid# 75c5d913-c8406f30-ddc140da-92c4ea16
2025-11-03T16:52:21.876874Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_7_1_798936181586527143_v1 Process answer. Aval parts: 0
2025-11-03T16:52:21.884823Z :DEBUG: [/Root] [/Root] [f383850c-b6aac90d-91539553-5e93999f] [dc1] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:52:21.885915Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_7_1_798936181586527143_v1 grpc read done: success# 1, data# { read { } }
2025-11-03T16:52:21.886064Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_7_1_798936181586527143_v1 got read request: guid# 3e01e0ba-2746cd0-148e4b8a-55bf3bb0
2025-11-03T16:52:21.888782Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 0 (0-4)
2025-11-03T16:52:21.889072Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (0-0)
2025-11-03T16:52:21.889155Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 0} (1-1)
2025-11-03T16:52:21.889243Z :DEBUG: [/Root] Take Data. Partition 0. Read: {2, 0} (2-2)
2025-11-03T16:52:21.889284Z :DEBUG: [/Root] Take Data. Partition 0. Read: {2, 1} (3-3)
2025-11-03T16:52:21.889406Z :DEBUG: [/Root] Take Data. Partition 0. Read: {2, 2} (4-4)
2025-11-03T16:52:21.889477Z :DEBUG: [/Root] [/Root] [f383850c-b6aac90d-91539553-5e93999f] [dc1] The application data is transferred to the client. Number of messages 5, size 20480 bytes
2025-11-03T16:52:21.889713Z :DEBUG: [/Root] [/Root] [f383850c-b6aac90d-91539553-5e93999f] [dc1] Commit offsets [0, 1). Partition stream id: 1
2025-11-03T16:52:21.889787Z :DEBUG: [/Root] [/Root] [f383850c-b6aac90d-91539553-5e93999f] [dc1] Commit offsets [1, 2). Partition stream id: 1
2025-11-03T16:52:21.889825Z :DEBUG: [/Root] [/Root] [f383850c-b6aac90d-91539553-5e93999f] [dc1] Commit offsets [2, 3). Partition stream id: 1
2025-11-03T16:52:21.889862Z :DEBUG: [/Root] [/Root] [f383850c-b6aac90d-91539553-5e93999f] [dc1] Commit offsets [3, 4). Partition stream id: 1
2025-11-03T16:52:21.889895Z :DEBUG: [/Root] [/Root] [f383850c-b6aac90d-91539553-5e93999f] [dc1] Commit offsets [4, 5). Partition stream id: 1
2025-11-03T16:52:21.890233Z :TWriteSession_WriteAndReadAndCommitRandomMessages INFO: Read message count is 5 (from 5 in total), committed offset count is 0 (maximum offset: 4)
Get event on client
2025-11-03T16:52:21.890850Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_7_1_798936181586527143_v1 grpc read done: success# 1, data# { commit { cookies { assign_id: 1 partition_cookie: 1 } } }
2025-11-03T16:52:21.891086Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1449: session cookie 1 consumer shared/user session shared/user_7_1_798936181586527143_v1 commit request from client for 1 in TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-11-03T16:52:21.891134Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:129: session cookie 1 consumer shared/user session shared/user_7_1_798936181586527143_v1 commit request from 1 to 1 in TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-11-03T16:52:21.891217Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:203: session cookie 1 consumer shared/user session shared/user_7_1_798936181586527143_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) committing to position 5 prev 0 end 5 by cookie 1
2025-11-03T16:52:21.905207Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:21.905256Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:21.905334Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:21.905366Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:21.905379Z node 8 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-03T16:52:21.905449Z node 8 :PERSQUEUE DEBUG: partition.cpp:3666: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user offset is set to 5 (startOffset 0) session shared/user_7_1_798936181586527143_v1
2025-11-03T16:52:21.905471Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:21.905626Z node 8 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-03T16:52:21.918048Z node 8 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-03T16:52:21.918132Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:923: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 5 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-11-03T16:52:21.918187Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-11-03T16:52:21.918218Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:21.918232Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:21.918246Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:21.918285Z node 8 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:52:21.918318Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-11-03T16:52:21.919402Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_7_1_798936181586527143_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { Cookie: 1 }
2025-11-03T16:52:21.919477Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:961: session cookie 1 consumer shared/user session shared/user_7_1_798936181586527143_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) commit done to position 5 endOffset 5 with cookie 1
2025-11-03T16:52:21.919527Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:707: session cookie 1 consumer shared/user session shared/user_7_1_798936181586527143_v1 replying for commits: assignId# 1, from# 1, to# 1, offset# 5
2025-11-03T16:52:21.923553Z :DEBUG: [/Root] [/Root] [f383850c-b6aac90d-91539553-5e93999f] [dc1] Committed response: cookies { assign_id: 1 partition_cookie: 1 }
2025-11-03T16:52:21.923835Z :TWriteSession_WriteAndReadAndCommitRandomMessages INFO: Got commit ack with offset 5
2025-11-03T16:52:21.923885Z :TWriteSession_WriteAndReadAndCommitRandomMessages INFO: Read message count is 5 (from 5 in total), committed offset count is 5 (maximum offset: 4)
2025-11-03T16:52:21.923940Z :TWriteSession_WriteAndReadAndCommitRandomMessages INFO: Time took to write and read 5 messages, 0 [MiB] in total is 0 [s]
2025-11-03T16:52:21.924005Z :INFO: [/Root] [/Root] [f383850c-b6aac90d-91539553-5e93999f] Closing read session. Close timeout: 0.000000s
2025-11-03T16:52:21.924061Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): dc1:test-topic:0:1:4:5
2025-11-03T16:52:21.924116Z :INFO: [/Root] [/Root] [f383850c-b6aac90d-91539553-5e93999f] Counters: { Errors: 0 CurrentSessionLifetimeMs: 115 BytesRead: 20480 MessagesRead: 5 BytesReadCompressed: 18141 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-11-03T16:52:21.924235Z :NOTICE: [/Root] [/Root] [f383850c-b6aac90d-91539553-5e93999f] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Close with zero timeout " }
2025-11-03T16:52:21.924312Z :DEBUG: [/Root] [/Root] [f383850c-b6aac90d-91539553-5e93999f] [dc1] Abort session to cluster
2025-11-03T16:52:21.924897Z :NOTICE: [/Root] [/Root] [f383850c-b6aac90d-91539553-5e93999f] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
2025-11-03T16:52:21.925120Z :TWriteSession_WriteAndReadAndCommitRandomMessages INFO: Wait for client write event loop to stop
2025-11-03T16:52:21.925130Z :TWriteSession_WriteAndReadAndCommitRandomMessages DEBUG: Close writer (stop)
2025-11-03T16:52:21.925208Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|b9280e20-3862e277-1fa41d05-f3a954e3_0] Write session: close. Timeout = 0 ms
2025-11-03T16:52:21.925259Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|b9280e20-3862e277-1fa41d05-f3a954e3_0] Write session will now close
2025-11-03T16:52:21.925316Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|b9280e20-3862e277-1fa41d05-f3a954e3_0] Write session: aborting
2025-11-03T16:52:21.925751Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_7_1_798936181586527143_v1 grpc read done: success# 0, data# {  }
2025-11-03T16:52:21.925777Z node 7 :PQ_READ_PROXY INFO: read_session_actor.cpp:125: session cookie 1 consumer shared/user session shared/user_7_1_798936181586527143_v1 grpc read failed
2025-11-03T16:52:21.925803Z node 7 :PQ_READ_PROXY INFO: read_session_actor.cpp:92: session cookie 1 consumer shared/user session shared/user_7_1_798936181586527143_v1 grpc closed
2025-11-03T16:52:21.925837Z node 7 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 1 consumer shared/user session shared/user_7_1_798936181586527143_v1 is DEAD
2025-11-03T16:52:21.927248Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2258: [PQ: 72075186224037892] Destroy direct read session shared/user_7_1_798936181586527143_v1
2025-11-03T16:52:21.927296Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [7:7568543013360939018:2492] destroyed
2025-11-03T16:52:21.927350Z node 8 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_7_1_798936181586527143_v1
2025-11-03T16:52:21.927369Z node 7 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1659: [72075186224037893][rt3.dc1--test-topic] pipe [7:7568543013360939015:2489] disconnected.
2025-11-03T16:52:21.927403Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1670: [72075186224037893][rt3.dc1--test-topic] pipe [7:7568543013360939015:2489] disconnected; active server actors: 1
2025-11-03T16:52:21.927427Z node 7 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1679: [72075186224037893][rt3.dc1--test-topic] pipe [7:7568543013360939015:2489] client user disconnected session shared/user_7_1_798936181586527143_v1
2025-11-03T16:52:21.928065Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|b9280e20-3862e277-1fa41d05-f3a954e3_0] Write session: gracefully shut down, all writes complete
2025-11-03T16:52:21.928144Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|b9280e20-3862e277-1fa41d05-f3a954e3_0] Write session is aborting and will not restart
2025-11-03T16:52:21.928208Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|b9280e20-3862e277-1fa41d05-f3a954e3_0] Write session: destroy
2025-11-03T16:52:21.928258Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: test-message-group-id|b9280e20-3862e277-1fa41d05-f3a954e3_0 grpc read done: success: 0 data: 
2025-11-03T16:52:21.928285Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 2 sessionId: test-message-group-id|b9280e20-3862e277-1fa41d05-f3a954e3_0 grpc read failed
2025-11-03T16:52:21.928319Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 2 sessionId: test-message-group-id|b9280e20-3862e277-1fa41d05-f3a954e3_0 grpc closed
2025-11-03T16:52:21.928342Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2 sessionId: test-message-group-id|b9280e20-3862e277-1fa41d05-f3a954e3_0 is DEAD
2025-11-03T16:52:21.929265Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-11-03T16:52:21.929837Z :TWriteSession_WriteAndReadAndCommitRandomMessages DEBUG: Writer closed
2025-11-03T16:52:21.932288Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [7:7568543013360938998:2480] destroyed
2025-11-03T16:52:21.932340Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-11-03T16:52:21.932381Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:21.932399Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:21.932415Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:21.955535Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:21.955594Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:21.955634Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:21.964043Z :TWriteSession_WriteAndReadAndCommitRandomMessages INFO: Client write event loop stopped
2025-11-03T16:52:22.056465Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:22.056499Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:22.056516Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:22.137023Z node 7 :FLAT_TX_SCHEMESHARD WARN: schemeshard_impl.cpp:7727: Cannot get console configs
2025-11-03T16:52:22.137061Z node 7 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
2025-11-03T16:52:22.155229Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:22.155269Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:22.155291Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:24.540068Z :TWriteSession_WriteAndReadAndCommitRandomMessagesNoClusterDiscovery INFO: Random seed for debugging is 1762188744540045
2025-11-03T16:52:25.312945Z node 9 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[9:7568543030375950933:2080];send_to=[0:7307199536658146131:7762515];
2025-11-03T16:52:25.313023Z node 9 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
test_client.cpp: SetPath # /home/runner/.ya/build/build_root/7jz3/001974/r3tmp/tmptYhH14/pdisk_1.dat
2025-11-03T16:52:25.377748Z node 9 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-11-03T16:52:25.384855Z node 9 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-11-03T16:52:25.407136Z node 10 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-11-03T16:52:25.417614Z node 10 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-11-03T16:52:25.417774Z node 10 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=incorrect path status: LookupError;
2025-11-03T16:52:25.614258Z node 9 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
2025-11-03T16:52:25.632535Z node 10 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-11-03T16:52:25.640066Z node 9 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-11-03T16:52:25.641058Z node 9 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(9, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-11-03T16:52:25.641187Z node 9 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(9, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-11-03T16:52:25.644724Z node 9 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(10, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-11-03T16:52:25.644838Z node 9 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(10, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-11-03T16:52:25.653952Z node 9 :HIVE WARN: hive_impl.cpp:811: HIVE#72057594037968897 Handle TEvInterconnect::TEvNodeConnected, NodeId 10 Cookie 10
2025-11-03T16:52:25.654127Z node 9 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(9, (0,0,0,0)) VolatileState: Connecting -> Connected
2025-11-03T16:52:25.658179Z node 9 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(10, (0,0,0,0)) VolatileState: Connecting -> Connected
TServer::EnableGrpc on GrpcPort 6988, node 9
2025-11-03T16:52:25.832477Z node 9 :NET_CLASSIFIER WARN: net_classifier.cpp:190: distributable config is empty, broken or outdated, will use file: /home/runner/.ya/build/build_root/7jz3/001974/r3tmp/yandex51rp6P.tmp
2025-11-03T16:52:25.832508Z node 9 :NET_CLASSIFIER WARN: net_classifier.cpp:196: will try to initialize from file: /home/runner/.ya/build/build_root/7jz3/001974/r3tmp/yandex51rp6P.tmp
2025-11-03T16:52:25.832701Z node 9 :NET_CLASSIFIER WARN: net_classifier.cpp:202: successfully initialized from file: /home/runner/.ya/build/build_root/7jz3/001974/r3tmp/yandex51rp6P.tmp
2025-11-03T16:52:25.832911Z node 9 :NET_CLASSIFIER ERROR: net_classifier.cpp:228: got bad distributable configuration
2025-11-03T16:52:25.892415Z INFO: TTestServer started on Port 9995 GrpcPort 6988
2025-11-03T16:52:26.053592Z node 9 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-11-03T16:52:26.126180Z node 10 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
TClient is connected to server localhost:9995
PQClient connected to localhost:6988
WaitRootIsUp 'Root'...
TClient::Ls request: Root
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "Root"
    PathId: 1
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 1
    CreateStep: 0
    ParentPathId: 1
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 1
      SubDomainVersion: 0
      SecurityStateVersion: 0
    }
    ChildrenExist: false
  }
  Children {
    Name: ".sys"
    PathId: 18446744073709551615
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 0
    CreateStep: 0
    ParentPathId: 18446744073709551615
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 0
      Pl...
(TRUNCATED)
WaitRootIsUp 'Root' success.
2025-11-03T16:52:26.242994Z node 9 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpAlterSubDomain, opId: 281474976710657:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_alter_subdomain.cpp:311)
waiting...
waiting...
waiting...
2025-11-03T16:52:26.360511Z node 9 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
waiting...
2025-11-03T16:52:26.400347Z node 10 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-11-03T16:52:30.008953Z node 9 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [9:7568543051850788397:2331], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-03T16:52:30.009041Z node 9 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [9:7568543051850788381:2328], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-03T16:52:30.009774Z node 9 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-03T16:52:30.011077Z node 9 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [9:7568543051850788405:2334], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-03T16:52:30.011158Z node 9 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-03T16:52:30.014670Z node 9 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateResourcePool, opId: 281474976710661:3, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_resource_pool.cpp:179)
2025-11-03T16:52:30.020625Z node 9 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [9:7568543051850788439:2337], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-03T16:52:30.020719Z node 9 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-03T16:52:30.021419Z node 9 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [9:7568543051850788441:2338], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-03T16:52:30.021508Z node 9 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-03T16:52:30.149765Z node 9 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710662:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:690)
2025-11-03T16:52:30.180179Z node 9 :KQP_WORKLOAD_SERVICE WARN: helpers.h:73: [WorkloadService] [TPoolCreatorActor] ActorId: [9:7568543051850788403:2333], DatabaseId: /Root, PoolId: default, Scheduled retry for error: { <main>: Error: Transaction 281474976710661 completed, doublechecking }
2025-11-03T16:52:30.211575Z node 10 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:570: Compilation failed, self: [10:7568543054512421354:2305], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-11-03T16:52:30.215595Z node 10 :KQP_SESSION WARN: kqp_session_actor.cpp:2506: SessionId: ydb://session/3?node_id=10&id=ZTlhMzE3OGItYzU2MWI4N2UtZjQ3ZDI4ODUtNDg5ODIyNjE=, ActorId: [10:7568543054512421324:2299], ActorState: ExecuteState, TraceId: 01k95a4vama56c3trqa40cknb9, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-11-03T16:52:30.216217Z node 10 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-11-03T16:52:30.236837Z node 9 :TX_PROXY ERROR: schemereq.cpp:593: Actor# [9:7568543051850788552:2730] txid# 281474976710663, issues: { message: "Check failed: path: \'/Root/.metadata/workload_manager/pools/default\', error: path exist, request accepts it (id: [OwnerId: 72057594046644480, LocalPathId: 8], type: EPathTypeResourcePool, state: EPathStateNoChanges)" severity: 1 }
2025-11-03T16:52:30.260810Z node 9 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710664:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:690)
2025-11-03T16:52:30.282733Z node 9 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:570: Compilation failed, self: [9:7568543051850788581:2346], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:5:17: Error: At function: KiReadTable!
        <main>:5:17: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Versions]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-11-03T16:52:30.282944Z node 9 :KQP_SESSION WARN: kqp_session_actor.cpp:2506: SessionId: ydb://session/3?node_id=9&id=NzhhYWUxYTAtMzgzY2Y2MTQtZGQzYWY4NjYtZDNjNzk1MTQ=, ActorId: [9:7568543051850788370:2326], ActorState: ExecuteState, TraceId: 01k95a4v5p23vxf0tdyhvh7e1s, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-11-03T16:52:30.283419Z node 9 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 5 column: 17 } message: "At function: KiReadTable!" end_position { row: 5 column: 17 } severity: 1 issues { position { row: 5 column: 17 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Versions]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 5 column: 17 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-11-03T16:52:30.314246Z node 9 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[9:7568543030375950933:2080];send_to=[0:7307199536658146131:7762515];
2025-11-03T16:52:30.314333Z node 9 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
2025-11-03T16:52:30.473078Z node 9 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710665:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:690)
=== Init DC: UPSERT INTO `/Root/PQ/Config/V2/Cluster` (name, balancer, local, enabled, weight) VALUES ("dc1", "localhost:6988", true, true, 1000);
2025-11-03T16:52:30.858858Z node 9 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976710666. Ctx: { TraceId: 01k95a4vtcdt383jkfpsykzm7s, Database: , SessionId: ydb://session/3?node_id=9&id=YjI4MTQzYjEtOTYzNTIwLTRlNjlkMjI5LWUzYWVjOGM2, PoolId: default, DatabaseId: /Root}. Database not set, use /Root
=== CheckClustersList. Subcribe to ClusterTracker from [9:7568543051850788913:2994] 
=== CheckClustersList. Ok
2025-11-03T16:52:36.139559Z node 9 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710671:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:690)
waiting...
PQ Client: create topic: rt3.dc1--test-topic with 1 partitions
CallPersQueueGRPC request to localhost:6988
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-11-03T16:52:36.305952Z node 9 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
CallPersQueueGRPC request to localhost:6988
MetaRequest {
  CmdCreateTopic {
    Topic: "rt3.dc1--test-topic"
    NumPartitions: 1
    Config {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
  }
}
CallPersQueueGRPC response:
Status: 129
ProxyErrorCode: 53
SchemeStatus: 1
FlatTxId {
  TxId: 281474976710672
  SchemeShardTabletId: 72057594046644480
  PathId: 13
}
ErrorCode: OK
AddTopic: rt3.dc1--test-topic
===Run query:``DECLARE $version as Int64; DECLARE $path AS Utf8; DECLARE $cluster as Utf8; UPSERT INTO `/Root/PQ/Config/V2/Topics` (path, dc) VALUES ($path, $cluster); UPSERT INTO `/Root/PQ/Config/V2/Versions` (name, version) VALUES ("Topics", $version);`` with topic = test-topic, dc = dc1
2025-11-03T16:52:36.338747Z node 9 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1655: [72075186224037893][] pipe [9:7568543077620593081:3248] connected; active server actors: 1
2025-11-03T16:52:36.339943Z node 9 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1519: [72075186224037893][rt3.dc1--test-topic] updating configuration. Deleted partitions []. Added partitions [0]
2025-11-03T16:52:36.340608Z node 9 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:971: [72075186224037893][rt3.dc1--test-topic] Discovered subdomain [OwnerId: 72057594046644480, LocalPathId: 1] state, outOfSpace = 0 at RB 72075186224037893
2025-11-03T16:52:36.347016Z node 9 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:140: [72075186224037893][rt3.dc1--test-topic] BALANCER INIT DONE for rt3.dc1--test-topic: (0, 72075186224037892) 
2025-11-03T16:52:36.351187Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:2960: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-11-03T16:52:36.354612Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:2992: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-11-03T16:52:36.354892Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:787: [PQ: 72075186224037892] no config, start with empty partitions and default config
2025-11-03T16:52:36.354922Z node 10 :PERSQUEUE NOTICE: pq_impl.cpp:913: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-11-03T16:52:36.354962Z node 10 :PERSQUEUE INFO: pq_impl.cpp:612: [PQ: 72075186224037892] doesn't have tx writes info
2025-11-03T16:52:36.355294Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [9:7568543077620593080:3247], now have 1 active actors on pipe
2025-11-03T16:52:36.355315Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [9:7568543077620593108:2435], now have 1 active actors on pipe
2025-11-03T16:52:36.360184Z node 9 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:404: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 10, Generation 1
2025-11-03T16:52:36.363106Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-03T16:52:36.372576Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-03T16:52:36.390565Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [9:7568543077620593148:3300], now have 1 active actors on pipe
2025-11-03T16:52:36.391564Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-03T16:52:36.395341Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-03T16:52:36.396542Z node 10 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-11-03T16:52:36.396611Z node 10 :PERSQUEUE DEBUG: partition.cpp:1312: [72075186224037892][Partition][0][StateInit] HandleOnInit TEvPQ::TEvProposePartitionConfig
2025-11-03T16:52:36.396958Z node 10 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-11-03T16:52:36.397234Z node 10 :PERSQUEUE INFO: partition_init.cpp:1101: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [10:7568543080282225572:2378]
2025-11-03T16:52:36.400065Z node 10 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-11-03T16:52:36.400099Z node 10 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-11-03T16:52:36.400124Z node 10 :PERSQUEUE INFO: partition.cpp:707: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1 [10:7568543080282225572:2378]
2025-11-03T16:52:36.400160Z node 10 :PERSQUEUE DEBUG: partition.cpp:727: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 0 Head Offset 0 PartNo 0 PackedSize 0 count 0 nextOffset 0 batches 0
2025-11-03T16:52:36.400200Z node 10 :PERSQUEUE DEBUG: partition_mlp.cpp:83: [72075186224037892][Partition][0][StateIdle] Initializing MLP Consumers: 0
2025-11-03T16:52:36.401750Z node 10 :PERSQUEUE DEBUG: partition.cpp:4273: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 1
2025-11-03T16:52:36.401809Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:36.401915Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:36.401931Z node 10 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-03T16:52:36.401956Z node 10 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-11-03T16:52:36.401972Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:36.401986Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:36.401998Z node 10 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-11-03T16:52:36.402032Z node 10 :PERSQUEUE DEBUG: partition_read.cpp:923: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-11-03T16:52:36.402070Z node 10 :PERSQUEUE DEBUG: partition_mlp.cpp:60: [72075186224037892][Partition][0][StateIdle] Process MLP pending events. Count 0
2025-11-03T16:52:36.402607Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-03T16:52:36.402731Z node 10 :PERSQUEUE DEBUG: partition_compaction.cpp:183: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:52:36.406729Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-03T16:52:36.406862Z node 10 :PERSQUEUE DEBUG: partition.cpp:1416: [72075186224037892][Partition][0][StateIdle] Handle TEvPQ::TEvTxCommit Step 1762188756433, TxId 281474976710672
2025-11-03T16:52:36.406895Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:36.406914Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:36.407054Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:36.407297Z node 10 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-03T16:52:36.410417Z node 10 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-03T16:52:36.410575Z node 10 :PERSQUEUE DEBUG: partition_mlp.cpp:83: [72075186224037892][Partition][0][StateIdle] Initializing MLP Consumers: 0
2025-11-03T16:52:36.410664Z node 10 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-11-03T16:52:36.410680Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:36.410694Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:36.410713Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:36.410742Z node 10 :PERSQUEUE DEBUG: partition_compaction.cpp:183: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:52:36.411025Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:398: [PQ: 72075186224037892] Apply new config PartitionConfig { LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 } PartitionIds: 0 TopicName: "rt3.dc1--test-topic" Version: 0 LocalDC: true Codecs { Ids: 0 Ids: 1 Ids: 2 Codecs: "raw" Codecs: "gzip" Codecs: "lzop" } TopicPath: "/Root/PQ/rt3.dc1--test-topic" YcCloudId: "" YcFolderId: "" YdbDatabaseId: "" YdbDatabasePath: "/Root" Partitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } AllPartitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } Consumers { Name: "user" ReadFromTimestampsMs: 0 FormatVersion: 0 Version: 0 Generation: 0 } MonitoringProjectId: ""
2025-11-03T16:52:36.411095Z node 10 :PERSQUEUE NOTICE: pq_impl.cpp:913: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-11-03T16:52:36.411301Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-03T16:52:36.417520Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-03T16:52:36.417638Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-03T16:52:36.420501Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-03T16:52:36.498429Z node 9 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976710673. Ctx: { TraceId: 01k95a51ca81r2fqb2xndm17nw, Database: , SessionId: ydb://session/3?node_id=9&id=NGE3Njc2ZWEtNTVhOTg1MTctNjY2MzMyYTAtZTcwMDA3ZQ==, PoolId: default, DatabaseId: /Root}. Database not set, use /Root
2025-11-03T16:52:36.500934Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:36.500973Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:36.500989Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
===Query complete
TClient::Ls request: /Root/PQ/rt3.dc1--test-topic
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976710672
    CreateStep: 1762188756433
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts...
(TRUNCATED)
GetTopicVersionFromPath:  record Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976710672
    CreateStep: 1762188756433
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      YdbDatabasePath: "/Root"
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
    Partitions {
      PartitionId: 0
      TabletId: 72075186224037892
      Status: Active
    }
    AlterVersion: 1
    BalancerTabletID: 72075186224037893
    NextPartitionId: 1
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 1
      PlanResolution: 7
      Coordinators: 72057594046316545
      TimeCastBucketsPerMediator: 2
      Mediators: 72057594046382081
    }
    DomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    PathsInside: 12
    PathsLimit: 10000
    ShardsInside: 6
    ShardsLimit: 200000
    ResourcesDomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    DiskSpaceUsage {
      Tables {
        TotalSize: 0
        DataSize: 0
        IndexSize: 0
      }
      Topics {
        ReserveSize: 0
        AccountSize: 0
        DataSize: 0
        UsedReserveSize: 0
      }
    }
    PQPartitionsInside: 1
    PQPartitionsLimit: 1000000
    SchemeLimits {
      MaxDepth: 32
      MaxPaths: 10000
      MaxChildrenInDir: 100000
      MaxAclBytesSize: 10240
      MaxTableColumns: 200
      MaxTableColumnNameLength: 255
      MaxTableKeyColumns: 30
      MaxTableIndices: 20
      MaxShards: 200000
      MaxShardsInPath: 35000
      MaxConsistentCopyTargets: 10000
      MaxPathElementLength: 255
      ExtraPathSymbolsAllowed: "!\"#$%&\'()*+,-.:;<=>?@[\\]^_`{|}~"
      MaxPQPartitions: 1000000
      MaxTableCdcStreams: 5
      MaxExports: 10
      MaxImports: 10
      MaxColumnTableColumns: 10000
    }
  }
}
Path: "/Root/PQ/rt3.dc1--test-topic"
 name rt3.dc1--test-topic version1
CallPersQueueGRPC request to localhost:6988
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-11-03T16:52:36.564643Z node 9 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
MetaResponse {
  CmdGetTopicMetadataResult {
    TopicInfo {
      Topic: "rt3.dc1--test-topic"
      NumPartitions: 1
      Config {
        PartitionConfig {
          LifetimeSeconds: 86400
          LowWatermark: 8388608
          SourceIdLifetimeSeconds: 86400
          WriteSpeedInBytesPerSecond: 20000000
          BurstSize: 20000000
          SourceIdMaxCounts: 6000000
        }
        Version: 1
        LocalDC: true
        Codecs {
          Ids: 0
          Ids: 1
          Ids: 2
          Codecs: "raw"
          Codecs: "gzip"
          Codecs: "lzop"
        }
        TopicPath: "/Root/PQ/rt3.dc1--test-topic"
        YdbDatabasePath: "/Root"
        Consumers {
          Name: "user"
          ReadFromTimestampsMs: 0
          FormatVersion: 0
          Version: 0
        }
      }
      ErrorCode: OK
    }
  }
}
=== Topic created, have version: 1
2025-11-03T16:52:36.582626Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: try to update token
2025-11-03T16:52:36.583330Z :INFO: [] MessageGroupId [src] SessionId [] Write session: Do CDS request
2025-11-03T16:52:36.583372Z :INFO: [] MessageGroupId [src] SessionId [] Start write session. Will connect to endpoint: localhost:6988
2025-11-03T16:52:36.600757Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src" }
2025-11-03T16:52:36.601096Z node 9 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-11-03T16:52:36.601139Z node 9 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1
2025-11-03T16:52:36.601415Z node 9 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src" }
2025-11-03T16:52:36.601555Z node 9 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1 topic: "test-topic" message_group_id: "src" from ipv6:[::1]:60556
2025-11-03T16:52:36.601654Z node 9 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:60556 proto=v1  topic=test-topic durationSec=0
2025-11-03T16:52:36.601682Z node 9 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-11-03T16:52:36.601904Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:36.601941Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:36.601959Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:36.603871Z node 9 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1 sessionId:  describe result for acl check
2025-11-03T16:52:36.604042Z node 9 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-11-03T16:52:36.604067Z node 9 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-11-03T16:52:36.604084Z node 9 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-11-03T16:52:36.604111Z node 9 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [9:7568543077620593225:2456] (SourceId=src, PreferedPartition=(NULL)) StartKqpSession
2025-11-03T16:52:36.609723Z node 9 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [9:7568543077620593225:2456] (SourceId=src, PreferedPartition=(NULL)) Select from the table
2025-11-03T16:52:36.704461Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:36.704511Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:36.704530Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:36.808126Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:36.808173Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:36.808193Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:36.852365Z node 9 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [9:7568543077620593225:2456] (SourceId=src, PreferedPartition=(NULL)) RequestPQRB
2025-11-03T16:52:36.854072Z node 9 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1655: [72075186224037893][rt3.dc1--test-topic] pipe [9:7568543077620593268:2456] connected; active server actors: 1
2025-11-03T16:52:36.854195Z node 9 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [9:7568543077620593225:2456] (SourceId=src, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=src
2025-11-03T16:52:36.854217Z node 9 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [9:7568543077620593225:2456] (SourceId=src, PreferedPartition=(NULL)) Update the table
2025-11-03T16:52:36.864656Z node 9 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1659: [72075186224037893][rt3.dc1--test-topic] pipe [9:7568543077620593268:2456] disconnected.
2025-11-03T16:52:36.864718Z node 9 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1670: [72075186224037893][rt3.dc1--test-topic] pipe [9:7568543077620593268:2456] disconnected; active server actors: 1
2025-11-03T16:52:36.864746Z node 9 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1695: [72075186224037893][rt3.dc1--test-topic] pipe [9:7568543077620593268:2456] disconnected no session
2025-11-03T16:52:36.911304Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:36.911364Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:36.911385Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:37.001745Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [9:7568543081915560587:2456], now have 1 active actors on pipe
2025-11-03T16:52:37.002050Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:37.002095Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:37.002189Z node 10 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src|30d21d93-a6ef686b-e6907dd3-45f11e4e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src
2025-11-03T16:52:37.002240Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:37.002267Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:37.002282Z node 10 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-03T16:52:37.002329Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:37.002382Z node 10 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-03T16:52:37.002462Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-03T16:52:37.002990Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:37.003034Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:37.003120Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-03T16:52:37.004047Z :INFO: [] MessageGroupId [src] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1762188757004 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-11-03T16:52:37.000332Z node 9 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [9:7568543077620593225:2456] (SourceId=src, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-11-03T16:52:37.000380Z node 9 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [9:7568543077620593225:2456] (SourceId=src, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-11-03T16:52:37.000402Z node 9 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [9:7568543077620593225:2456] (SourceId=src, PreferedPartition=(NULL)) Start idle
2025-11-03T16:52:37.004199Z :INFO: [] MessageGroupId [src] SessionId [] Write session established. Init response: session_id: "src|30d21d93-a6ef686b-e6907dd3-45f11e4e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-11-03T16:52:37.000445Z node 9 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-11-03T16:52:37.001897Z node 9 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 10, Generation: 1
2025-11-03T16:52:37.003377Z node 9 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1 partition: 0 MaxSeqNo: 0 sessionId: src|30d21d93-a6ef686b-e6907dd3-45f11e4e_0
2025-11-03T16:52:37.004422Z :INFO: [] MessageGroupId [src] SessionId [src|30d21d93-a6ef686b-e6907dd3-45f11e4e_0] Write session: close. Timeout = 0 ms
2025-11-03T16:52:37.004505Z :INFO: [] MessageGroupId [src] SessionId [src|30d21d93-a6ef686b-e6907dd3-45f11e4e_0] Write session will now close
2025-11-03T16:52:37.004550Z :DEBUG: [] MessageGroupId [src] SessionId [src|30d21d93-a6ef686b-e6907dd3-45f11e4e_0] Write session: aborting
2025-11-03T16:52:37.005021Z :INFO: [] MessageGroupId [src] SessionId [src|30d21d93-a6ef686b-e6907dd3-45f11e4e_0] Write session: gracefully shut down, all writes complete
2025-11-03T16:52:37.005059Z :DEBUG: [] MessageGroupId [src] SessionId [src|30d21d93-a6ef686b-e6907dd3-45f11e4e_0] Write session: destroy
2025-11-03T16:52:37.005852Z node 9 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId: src|30d21d93-a6ef686b-e6907dd3-45f11e4e_0 grpc read done: success: 0 data: 
2025-11-03T16:52:37.005880Z node 9 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 1 sessionId: src|30d21d93-a6ef686b-e6907dd3-45f11e4e_0 grpc read failed
2025-11-03T16:52:37.005927Z node 9 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 1 sessionId: src|30d21d93-a6ef686b-e6907dd3-45f11e4e_0 grpc closed
2025-11-03T16:52:37.005943Z node 9 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1 sessionId: src|30d21d93-a6ef686b-e6907dd3-45f11e4e_0 is DEAD
2025-11-03T16:52:37.006604Z node 9 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-11-03T16:52:37.009285Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [9:7568543081915560587:2456] destroyed
2025-11-03T16:52:37.009337Z node 10 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-11-03T16:52:37.009368Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:37.009386Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:37.009401Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:37.011363Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:37.011382Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:37.011399Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:37.042881Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [] Write session: try to update token
2025-11-03T16:52:37.043928Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [] Write session: Do CDS request
2025-11-03T16:52:37.044005Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [] Do schedule cds request after 0 ms
2025-11-03T16:52:37.045350Z :INFO: [/Root] MessageGroupId [test-message-group-id] Running cds request ms
2025-11-03T16:52:37.044097Z :TWriteSession_WriteAndReadAndCommitRandomMessagesNoClusterDiscovery INFO: Wait for writer event
2025-11-03T16:52:37.052792Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [] Got CDS response: 
write_sessions_clusters { clusters { endpoint: "localhost:6988" name: "dc1" available: true } primary_cluster_selection_reason: CLIENT_LOCATION } version: 1
2025-11-03T16:52:37.052827Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [] Start write session. Will connect to endpoint: localhost:6988
2025-11-03T16:52:37.064554Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [] Write session: send init request: init_request { topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" }
2025-11-03T16:52:37.065036Z node 9 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-11-03T16:52:37.065076Z node 9 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2
2025-11-03T16:52:37.065540Z node 9 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" }
2025-11-03T16:52:37.065709Z node 9 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2 topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" from ipv6:[::1]:60600
2025-11-03T16:52:37.065742Z node 9 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:60600 proto=v1  topic=test-topic durationSec=0
2025-11-03T16:52:37.065754Z node 9 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-11-03T16:52:37.067447Z node 9 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2 sessionId:  describe result for acl check
2025-11-03T16:52:37.067611Z node 9 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-11-03T16:52:37.067633Z node 9 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-11-03T16:52:37.067720Z node 9 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-11-03T16:52:37.067750Z node 9 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [9:7568543081915560604:2473] (SourceId=test-message-group-id, PreferedPartition=(NULL)) StartKqpSession
2025-11-03T16:52:37.071437Z node 9 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [9:7568543081915560604:2473] (SourceId=test-message-group-id, PreferedPartition=(NULL)) Select from the table
2025-11-03T16:52:37.078500Z node 9 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [9:7568543081915560604:2473] (SourceId=test-message-group-id, PreferedPartition=(NULL)) RequestPQRB
2025-11-03T16:52:37.079065Z node 9 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1655: [72075186224037893][rt3.dc1--test-topic] pipe [9:7568543081915560623:2473] connected; active server actors: 1
2025-11-03T16:52:37.079129Z node 9 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [9:7568543081915560604:2473] (SourceId=test-message-group-id, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=test-message-group-id
2025-11-03T16:52:37.079149Z node 9 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [9:7568543081915560604:2473] (SourceId=test-message-group-id, PreferedPartition=(NULL)) Update the table
2025-11-03T16:52:37.079428Z node 9 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1659: [72075186224037893][rt3.dc1--test-topic] pipe [9:7568543081915560623:2473] disconnected.
2025-11-03T16:52:37.079459Z node 9 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1670: [72075186224037893][rt3.dc1--test-topic] pipe [9:7568543081915560623:2473] disconnected; active server actors: 1
2025-11-03T16:52:37.079481Z node 9 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1695: [72075186224037893][rt3.dc1--test-topic] pipe [9:7568543081915560623:2473] disconnected no session
2025-11-03T16:52:37.088086Z node 9 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [9:7568543081915560604:2473] (SourceId=test-message-group-id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-11-03T16:52:37.088135Z node 9 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [9:7568543081915560604:2473] (SourceId=test-message-group-id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-11-03T16:52:37.088157Z node 9 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [9:7568543081915560604:2473] (SourceId=test-message-group-id, PreferedPartition=(NULL)) Start idle
2025-11-03T16:52:37.088198Z node 9 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-11-03T16:52:37.092511Z node 9 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 10, Generation: 1
2025-11-03T16:52:37.095416Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [9:7568543081915560639:2473], now have 1 active actors on pipe
2025-11-03T16:52:37.095505Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:37.095529Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:37.095605Z node 10 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie test-message-group-id|ce618bc3-bb599573-4f98b36c-1bac21bf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner test-message-group-id
2025-11-03T16:52:37.095641Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:37.095660Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:37.095675Z node 10 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-03T16:52:37.095716Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:37.095771Z node 10 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-03T16:52:37.095820Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-03T16:52:37.099590Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:37.099622Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:37.099689Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-03T16:52:37.100433Z node 9 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2 partition: 0 MaxSeqNo: 0 sessionId: test-message-group-id|ce618bc3-bb599573-4f98b36c-1bac21bf_0
2025-11-03T16:52:37.101508Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1762188757101 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-11-03T16:52:37.101615Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [] Write session established. Init response: session_id: "test-message-group-id|ce618bc3-bb599573-4f98b36c-1bac21bf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-11-03T16:52:37.101814Z :TWriteSession_WriteAndReadAndCommitRandomMessagesNoClusterDiscovery INFO: Got new continue token
2025-11-03T16:52:37.101865Z :TWriteSession_WriteAndReadAndCommitRandomMessagesNoClusterDiscovery INFO: [] Write messages with sequence numbers 1
2025-11-03T16:52:37.101932Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ce618bc3-bb599573-4f98b36c-1bac21bf_0] Write 1 messages with Id from 1 to 1
2025-11-03T16:52:37.102003Z :TWriteSession_WriteAndReadAndCommitRandomMessagesNoClusterDiscovery INFO: Wait for writer event
2025-11-03T16:52:37.102048Z :TWriteSession_WriteAndReadAndCommitRandomMessagesNoClusterDiscovery INFO: Got new continue token
2025-11-03T16:52:37.102084Z :TWriteSession_WriteAndReadAndCommitRandomMessagesNoClusterDiscovery INFO: [] Write messages with sequence numbers 2
2025-11-03T16:52:37.102157Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ce618bc3-bb599573-4f98b36c-1bac21bf_0] Write 1 messages with Id from 2 to 2
2025-11-03T16:52:37.102220Z :TWriteSession_WriteAndReadAndCommitRandomMessagesNoClusterDiscovery INFO: Wait for writer event
2025-11-03T16:52:37.102248Z :TWriteSession_WriteAndReadAndCommitRandomMessagesNoClusterDiscovery INFO: Got new continue token
2025-11-03T16:52:37.102289Z :TWriteSession_WriteAndReadAndCommitRandomMessagesNoClusterDiscovery INFO: [] Write messages with sequence numbers 3
2025-11-03T16:52:37.102357Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ce618bc3-bb599573-4f98b36c-1bac21bf_0] Write 1 messages with Id from 3 to 3
2025-11-03T16:52:37.102389Z :TWriteSession_WriteAndReadAndCommitRandomMessagesNoClusterDiscovery INFO: Wait for writer event
2025-11-03T16:52:37.102430Z :TWriteSession_WriteAndReadAndCommitRandomMessagesNoClusterDiscovery INFO: Got new continue token
2025-11-03T16:52:37.102492Z :TWriteSession_WriteAndReadAndCommitRandomMessagesNoClusterDiscovery INFO: [] Write messages with sequence numbers 4
2025-11-03T16:52:37.102579Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ce618bc3-bb599573-4f98b36c-1bac21bf_0] Write 1 messages with Id from 4 to 4
2025-11-03T16:52:37.102692Z :TWriteSession_WriteAndReadAndCommitRandomMessagesNoClusterDiscovery INFO: Wait for writer event
2025-11-03T16:52:37.102766Z :TWriteSession_WriteAndReadAndCommitRandomMessagesNoClusterDiscovery INFO: Got new continue token
2025-11-03T16:52:37.102788Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ce618bc3-bb599573-4f98b36c-1bac21bf_0] Write session: try to update token
2025-11-03T16:52:37.102819Z :TWriteSession_WriteAndReadAndCommitRandomMessagesNoClusterDiscovery INFO: [] Write messages with sequence numbers 5
2025-11-03T16:52:37.102847Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ce618bc3-bb599573-4f98b36c-1bac21bf_0] Send 1 message(s) (3 left), first sequence number is 1
2025-11-03T16:52:37.103553Z node 9 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: test-message-group-id|ce618bc3-bb599573-4f98b36c-1bac21bf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:52:37.103797Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ce618bc3-bb599573-4f98b36c-1bac21bf_0] Write session: try to update token
2025-11-03T16:52:37.103862Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ce618bc3-bb599573-4f98b36c-1bac21bf_0] Send 1 message(s) (2 left), first sequence number is 2
2025-11-03T16:52:37.103943Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ce618bc3-bb599573-4f98b36c-1bac21bf_0] Write 1 messages with Id from 5 to 5
2025-11-03T16:52:37.103935Z node 9 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:52:37.104055Z :TWriteSession_WriteAndReadAndCommitRandomMessagesNoClusterDiscovery INFO: Wait for writer event
2025-11-03T16:52:37.104168Z :TWriteSession_WriteAndReadAndCommitRandomMessagesNoClusterDiscovery INFO: Got new continue token
2025-11-03T16:52:37.104737Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ce618bc3-bb599573-4f98b36c-1bac21bf_0] Write session: try to update token
2025-11-03T16:52:37.104782Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ce618bc3-bb599573-4f98b36c-1bac21bf_0] Send 1 message(s) (2 left), first sequence number is 3
2025-11-03T16:52:37.104935Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ce618bc3-bb599573-4f98b36c-1bac21bf_0] Write session: try to update token
2025-11-03T16:52:37.104983Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ce618bc3-bb599573-4f98b36c-1bac21bf_0] Send 1 message(s) (1 left), first sequence number is 4
2025-11-03T16:52:37.105563Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ce618bc3-bb599573-4f98b36c-1bac21bf_0] Write session: try to update token
2025-11-03T16:52:37.105601Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ce618bc3-bb599573-4f98b36c-1bac21bf_0] Send 1 message(s) (0 left), first sequence number is 5
2025-11-03T16:52:37.106498Z node 9 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:37.109201Z node 9 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: test-message-group-id|ce618bc3-bb599573-4f98b36c-1bac21bf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:52:37.109457Z node 9 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:52:37.109932Z node 9 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: test-message-group-id|ce618bc3-bb599573-4f98b36c-1bac21bf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:52:37.110169Z node 9 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:52:37.110494Z node 9 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: test-message-group-id|ce618bc3-bb599573-4f98b36c-1bac21bf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:52:37.110705Z node 9 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:52:37.110982Z node 9 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: test-message-group-id|ce618bc3-bb599573-4f98b36c-1bac21bf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:52:37.111145Z node 9 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:52:37.105889Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:37.105923Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:37.105977Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-11-03T16:52:37.108178Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:37.108208Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:37.108564Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0test-message-group-id' SeqNo: 1 partNo : 0 messageNo: 1 size 1910 offset: -1
2025-11-03T16:52:37.108615Z node 10 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:52:37.108667Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:37.108698Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:37.108711Z node 10 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-03T16:52:37.108819Z node 10 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0test-message-group-id' seqNo 1 partNo 0
2025-11-03T16:52:37.163311Z node 10 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0test-message-group-id' seqNo 1 partNo 0 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 1999 count 1 nextOffset 1 batches 1
2025-11-03T16:52:37.163391Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:37.164095Z node 10 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 0,1 HeadOffset 0 endOffset 0 curOffset 1 d0000000000_00000000000000000000_00000_0000000001_00000? size 1987 WTime 1762188757163
2025-11-03T16:52:37.164362Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:37.164400Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:37.164445Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:37.164458Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:37.164487Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:37.164498Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:37.164529Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:37.164542Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:37.164585Z node 10 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:52:37.164608Z node 10 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-03T16:52:37.164742Z node 10 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 0 partNo 0 count 1 size 1987
2025-11-03T16:52:37.164981Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 2  requestId: <none> cookie: 2
2025-11-03T16:52:37.165044Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 3  requestId: <none> cookie: 3
2025-11-03T16:52:37.165062Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 4  requestId: <none> cookie: 4
2025-11-03T16:52:37.165078Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 5  requestId: <none> cookie: 5
2025-11-03T16:52:37.168528Z node 9 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:37.168640Z node 9 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:37.168671Z node 9 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:37.168696Z node 9 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:37.169575Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:37.169611Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:37.169668Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0test-message-group-id' SeqNo: 2 partNo : 0 messageNo: 6 size 2800 offset: -1
2025-11-03T16:52:37.169718Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:37.169727Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:37.169745Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0test-message-group-id' SeqNo: 3 partNo : 0 messageNo: 7 size 3694 offset: -1
2025-11-03T16:52:37.169794Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:37.169803Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:37.169829Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0test-message-group-id' SeqNo: 4 partNo : 0 messageNo: 8 size 4585 offset: -1
2025-11-03T16:52:37.169878Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:37.169892Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:37.169917Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0test-message-group-id' SeqNo: 5 partNo : 0 messageNo: 9 size 5484 offset: -1
2025-11-03T16:52:37.169952Z node 10 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:52:37.170009Z node 10 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:52:37.170029Z node 10 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:52:37.170047Z node 10 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:52:37.170060Z node 10 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:52:37.170075Z node 10 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:52:37.170087Z node 10 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:52:37.170111Z node 10 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:52:37.178204Z node 10 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 0 count 1 size 1987 actorID [10:7568543080282225555:2378]
2025-11-03T16:52:37.178305Z node 10 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-03T16:52:37.178369Z node 10 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1932 WriteNewSizeFromSupportivePartitions# 0
2025-11-03T16:52:37.178407Z node 10 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:52:37.178468Z node 10 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0test-message-group-id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 1, partNo: 0, Offset: 0 is stored on disk
2025-11-03T16:52:37.178688Z node 10 :PERSQUEUE DEBUG: partition_read.cpp:923: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-11-03T16:52:37.178712Z node 10 :PERSQUEUE DEBUG: partition_read.cpp:965: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-11-03T16:52:37.178736Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:37.178782Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:37.178796Z node 10 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (4)
2025-11-03T16:52:37.178904Z node 10 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0test-message-group-id' seqNo 2 partNo 0
2025-11-03T16:52:37.179793Z node 10 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 0 suffix '63' size 1987
2025-11-03T16:52:37.180514Z node 10 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0test-message-group-id' seqNo 2 partNo 0 FormedBlobsCount 0 NewHead: Offset 1 PartNo 0 PackedSize 2889 count 1 nextOffset 2 batches 1
2025-11-03T16:52:37.180583Z node 10 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0test-message-group-id' seqNo 3 partNo 0
2025-11-03T16:52:37.180622Z node 10 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0test-message-group-id' seqNo 3 partNo 0 FormedBlobsCount 0 NewHead: Offset 1 PartNo 0 PackedSize 6640 count 2 nextOffset 3 batches 1
2025-11-03T16:52:37.180645Z node 10 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0test-message-group-id' seqNo 4 partNo 0
2025-11-03T16:52:37.180672Z node 10 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0test-message-group-id' seqNo 4 partNo 0 FormedBlobsCount 0 NewHead: Offset 1 PartNo 0 PackedSize 11282 count 3 nextOffset 4 batches 1
2025-11-03T16:52:37.180708Z node 10 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0test-message-group-id' seqNo 5 partNo 0
2025-11-03T16:52:37.180737Z node 10 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0test-message-group-id' seqNo 5 partNo 0 FormedBlobsCount 0 NewHead: Offset 1 PartNo 0 PackedSize 16823 count 4 nextOffset 5 batches 1
2025-11-03T16:52:37.180757Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:37.181513Z node 10 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 1,4 HeadOffset 1 endOffset 1 curOffset 5 d0000000000_00000000000000000001_00000_0000000004_00000? size 16707 WTime 1762188757181
2025-11-03T16:52:37.181690Z node 10 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:52:37.181764Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1  requestId: <none> cookie: 1
2025-11-03T16:52:37.181849Z node 10 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-03T16:52:37.181996Z node 10 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 1 partNo 0 count 4 size 16707
2025-11-03T16:52:37.182223Z node 10 :PERSQUEUE DEBUG: partition_read.cpp:880: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 partno 0 count 1 size 1024000 endOffset 1 max time lag 0ms effective offset 0
2025-11-03T16:52:37.182463Z node 10 :PERSQUEUE DEBUG: partition_read.cpp:1105: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 1987 count 1 last offset 0, current partition end offset: 1
2025-11-03T16:52:37.182490Z node 10 :PERSQUEUE DEBUG: partition_read.cpp:1121: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-11-03T16:52:37.182585Z node 10 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 0 partno 0 count 1 parts_count 0 source 1 size 1987 accessed 0 times before, last time 2025-11-03T16:52:37.000000Z
2025-11-03T16:52:37.182616Z node 10 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 3. All 1 blobs are from cache.
2025-11-03T16:52:37.182664Z node 10 :PERSQUEUE DEBUG: partition_read.cpp:572: FormAnswer for 1 blobs
2025-11-03T16:52:37.182801Z node 10 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 0 totakecount 1 count 1 size 1967 from pos 0 cbcount 1
2025-11-03T16:52:37.182882Z node 10 :PERSQUEUE DEBUG: partition_read.cpp:1015: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1762188757108 queuesize 0 startOffset 0
2025-11-03T16:52:37.182900Z node 10 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 0 suffix '63'
2025-11-03T16:52:37.184097Z node 9 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:37.187412Z node 10 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 1 count 4 size 16707 actorID [10:7568543080282225555:2378]
2025-11-03T16:52:37.187484Z node 10 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-03T16:52:37.187543Z node 10 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 16651 WriteNewSizeFromSupportivePartitions# 0
2025-11-03T16:52:37.187554Z node 10 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 1 partno 0 count 4 parts 0 suffix '63' size 16707
2025-11-03T16:52:37.187579Z node 10 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:52:37.187626Z node 10 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0test-message-group-id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 2, partNo: 0, Offset: 1 is stored on disk
2025-11-03T16:52:37.187658Z node 10 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:52:37.187683Z node 10 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0test-message-group-id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 3, partNo: 0, Offset: 2 is stored on disk
2025-11-03T16:52:37.187695Z node 10 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:52:37.187723Z node 10 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0test-message-group-id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 4, partNo: 0, Offset: 3 is stored on disk
2025-11-03T16:52:37.187743Z node 10 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:52:37.187770Z node 10 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0test-message-group-id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 5, partNo: 0, Offset: 4 is stored on disk
2025-11-03T16:52:37.188009Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:37.188033Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:37.188048Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:37.188090Z node 10 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:52:37.188159Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 6  requestId: <none> cookie: 2
2025-11-03T16:52:37.188200Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ce618bc3-bb599573-4f98b36c-1bac21bf_0] Write session got write response: sequence_numbers: 1 offsets: 0 already_written: false write_statistics { persist_duration_ms: 18 queued_in_partition_duration_ms: 51 }
2025-11-03T16:52:37.188239Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 7  requestId: <none> cookie: 3
2025-11-03T16:52:37.188254Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ce618bc3-bb599573-4f98b36c-1bac21bf_0] Write session: acknoledged message 1
2025-11-03T16:52:37.188270Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 8  requestId: <none> cookie: 4
2025-11-03T16:52:37.188291Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 9  requestId: <none> cookie: 5
2025-11-03T16:52:37.196079Z node 9 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:37.196161Z node 9 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:37.196220Z node 9 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:37.196250Z node 9 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:37.197158Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ce618bc3-bb599573-4f98b36c-1bac21bf_0] Write session got write response: sequence_numbers: 2 offsets: 1 already_written: false write_statistics { persist_duration_ms: 7 queued_in_partition_duration_ms: 10 }
2025-11-03T16:52:37.197201Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ce618bc3-bb599573-4f98b36c-1bac21bf_0] Write session: acknoledged message 2
2025-11-03T16:52:37.208146Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ce618bc3-bb599573-4f98b36c-1bac21bf_0] Write session got write response: sequence_numbers: 3 offsets: 2 already_written: false write_statistics { persist_duration_ms: 7 queued_in_partition_duration_ms: 10 }
2025-11-03T16:52:37.208188Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ce618bc3-bb599573-4f98b36c-1bac21bf_0] Write session: acknoledged message 3
2025-11-03T16:52:37.208391Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ce618bc3-bb599573-4f98b36c-1bac21bf_0] Write session got write response: sequence_numbers: 4 offsets: 3 already_written: false write_statistics { persist_duration_ms: 7 queued_in_partition_duration_ms: 10 }
2025-11-03T16:52:37.208426Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ce618bc3-bb599573-4f98b36c-1bac21bf_0] Write session: acknoledged message 4
2025-11-03T16:52:37.208576Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ce618bc3-bb599573-4f98b36c-1bac21bf_0] Write session got write response: sequence_numbers: 5 offsets: 4 already_written: false write_statistics { persist_duration_ms: 7 queued_in_partition_duration_ms: 10 }
2025-11-03T16:52:37.208597Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ce618bc3-bb599573-4f98b36c-1bac21bf_0] Write session: acknoledged message 5
2025-11-03T16:52:37.208668Z :TWriteSession_WriteAndReadAndCommitRandomMessagesNoClusterDiscovery INFO: All messages are written
2025-11-03T16:52:37.208875Z :INFO: [/Root] [/Root] [41060c4a-4384b7c3-dc22d47a-5f30f789] Starting read session
2025-11-03T16:52:37.208926Z :DEBUG: [/Root] [/Root] [41060c4a-4384b7c3-dc22d47a-5f30f789] Starting session to cluster null (localhost:6988)
2025-11-03T16:52:37.209081Z :DEBUG: [/Root] [/Root] [41060c4a-4384b7c3-dc22d47a-5f30f789] [null] In Reconnect, ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:52:37.209124Z :DEBUG: [/Root] [/Root] [41060c4a-4384b7c3-dc22d47a-5f30f789] [null] New values: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:52:37.209160Z :DEBUG: [/Root] [/Root] [41060c4a-4384b7c3-dc22d47a-5f30f789] [null] Reconnecting session to cluster null in 0.000000s
Get event on client
2025-11-03T16:52:37.212047Z :DEBUG: [/Root] [/Root] [41060c4a-4384b7c3-dc22d47a-5f30f789] [null] Successfully connected. Initializing session
2025-11-03T16:52:37.215459Z node 9 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:109: new grpc connection
2025-11-03T16:52:37.215484Z node 9 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:131: new session created cookie 1
2025-11-03T16:52:37.216927Z node 9 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { topic: "test-topic" } read_only_original: true consumer: "shared/user" read_params { max_read_size: 104857600 } } }
2025-11-03T16:52:37.217167Z node 9 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 1 consumer shared/user session shared/user_9_1_16795697126497985575_v1 read init: from# ipv6:[::1]:60600, request# { init_request { topics_read_settings { topic: "test-topic" } read_only_original: true consumer: "shared/user" read_params { max_read_size: 104857600 } } }
2025-11-03T16:52:37.217615Z node 9 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 1 consumer shared/user session shared/user_9_1_16795697126497985575_v1 auth for : user
2025-11-03T16:52:37.218546Z node 9 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 1 consumer shared/user session shared/user_9_1_16795697126497985575_v1 Handle describe topics response
2025-11-03T16:52:37.218679Z node 9 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 1 consumer shared/user session shared/user_9_1_16795697126497985575_v1 auth is DEAD
2025-11-03T16:52:37.218752Z node 9 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 1 consumer shared/user session shared/user_9_1_16795697126497985575_v1 auth ok: topics# 1, initDone# 0
2025-11-03T16:52:37.220029Z node 9 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 1 consumer shared/user session shared/user_9_1_16795697126497985575_v1 register session: topic# rt3.dc1--test-topic
2025-11-03T16:52:37.220284Z :INFO: [/Root] [/Root] [41060c4a-4384b7c3-dc22d47a-5f30f789] [null] Server session id: shared/user_9_1_16795697126497985575_v1
2025-11-03T16:52:37.220542Z :DEBUG: [/Root] [/Root] [41060c4a-4384b7c3-dc22d47a-5f30f789] [null] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:52:37.220631Z node 9 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1655: [72075186224037893][rt3.dc1--test-topic] pipe [9:7568543081915560661:2483] connected; active server actors: 1
2025-11-03T16:52:37.220718Z node 9 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_9_1_16795697126497985575_v1 grpc read done: success# 1, data# { read { } }
2025-11-03T16:52:37.220848Z node 9 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_9_1_16795697126497985575_v1 got read request: guid# 5d1d45d-7e27e273-f5ed2805-9ca291cc
2025-11-03T16:52:37.221070Z node 9 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1706: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [9:7568543081915560661:2483] session shared/user_9_1_16795697126497985575_v1
2025-11-03T16:52:37.221127Z node 9 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:639: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-11-03T16:52:37.221184Z node 9 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:669: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-11-03T16:52:37.221226Z node 9 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:871: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_9_1_16795697126497985575_v1" (Sender=[9:7568543081915560658:2483], Pipe=[9:7568543081915560661:2483], Partitions=[], ActiveFamilyCount=0)
2025-11-03T16:52:37.221261Z node 9 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1186: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-11-03T16:52:37.221312Z node 9 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1258: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-11-03T16:52:37.221371Z node 9 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1305: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_9_1_16795697126497985575_v1" (Sender=[9:7568543081915560658:2483], Pipe=[9:7568543081915560661:2483], Partitions=[], ActiveFamilyCount=0)
2025-11-03T16:52:37.221433Z node 9 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:549: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_9_1_16795697126497985575_v1" sender [9:7568543081915560658:2483] lock partition 0 for ReadingSession "shared/user_9_1_16795697126497985575_v1" (Sender=[9:7568543081915560658:2483], Pipe=[9:7568543081915560661:2483], Partitions=[], ActiveFamilyCount=1) generation 1 step 1
2025-11-03T16:52:37.221489Z node 9 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1325: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-11-03T16:52:37.221529Z node 9 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1402: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000186s
2025-11-03T16:52:37.222478Z node 9 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 1 consumer shared/user session shared/user_9_1_16795697126497985575_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 1 Session: "shared/user_9_1_16795697126497985575_v1" ClientId: "user" PipeClient { RawX1: 7568543081915560661 RawX2: 4503638282078643 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-11-03T16:52:37.222552Z node 9 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 1 consumer shared/user session shared/user_9_1_16795697126497985575_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-11-03T16:52:37.223552Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [9:7568543081915560664:2486], now have 1 active actors on pipe
2025-11-03T16:52:37.223796Z node 9 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_9_1_16795697126497985575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 1, pipe: [9:7568543081915560664:2486]
2025-11-03T16:52:37.224146Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:37.224180Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:37.224220Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:1748: [PQ: 72075186224037892] Created session shared/user_9_1_16795697126497985575_v1 on pipe: [9:7568543081915560664:2486]
2025-11-03T16:52:37.224279Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:37.224317Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:37.224333Z node 10 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-03T16:52:37.224398Z node 10 :PERSQUEUE DEBUG: partition.cpp:3666: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_9_1_16795697126497985575_v1
2025-11-03T16:52:37.224428Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:37.224570Z node 10 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-03T16:52:37.225078Z node 10 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_9_1_16795697126497985575_v1:1 with generation 1
2025-11-03T16:52:37.228289Z node 10 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-03T16:52:37.228367Z node 10 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-11-03T16:52:37.228394Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:37.228408Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:37.228425Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:37.228458Z node 10 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:52:37.228492Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-11-03T16:52:37.228853Z node 9 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_9_1_16795697126497985575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 5 WriteTimestampMS: 1762188757108 CreateTimestampMS: 1 SizeLag: 3974 WriteTimestampEstimateMS: 1762188757187 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-11-03T16:52:37.228898Z node 9 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 1 consumer shared/user session shared/user_9_1_16795697126497985575_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 5 readOffset 0 committedOffset 0
2025-11-03T16:52:37.228944Z node 9 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 1 consumer shared/user session shared/user_9_1_16795697126497985575_v1 sending to client partition status
2025-11-03T16:52:37.233466Z :INFO: [/Root] [/Root] [41060c4a-4384b7c3-dc22d47a-5f30f789] [null] Confirm partition stream create. Partition stream id: 1. Cluster: "dc1". Topic: "test-topic". Partition: 0. Read offset: (NULL)
2025-11-03T16:52:37.233692Z :TWriteSession_WriteAndReadAndCommitRandomMessagesNoClusterDiscovery INFO: Read message count is 0 (from 5 in total), committed offset count is 0 (maximum offset: 0)
Get event on client
2025-11-03T16:52:37.234089Z node 9 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_9_1_16795697126497985575_v1 grpc read done: success# 1, data# { start_read { topic { path: "test-topic" } cluster: "dc1" assign_id: 1 } }
2025-11-03T16:52:37.234244Z node 9 :PQ_READ_PROXY INFO: read_session_actor.cpp:539: session cookie 1 consumer shared/user session shared/user_9_1_16795697126497985575_v1 got StartRead from client: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 0, commitOffset# 0
2025-11-03T16:52:37.234299Z node 9 :PQ_READ_PROXY INFO: partition_actor.cpp:1023: session cookie 1 consumer shared/user session shared/user_9_1_16795697126497985575_v1 Start reading TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 5 readOffset 0 committedOffset 0 clientCommitOffset 0 clientReadOffset 0
2025-11-03T16:52:37.234328Z node 9 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_9_1_16795697126497985575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 0 endOffset 5
2025-11-03T16:52:37.234382Z node 9 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_9_1_16795697126497985575_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 0, endOffset# 5, WTime# 1762188757108, sizeLag# 3974
2025-11-03T16:52:37.234401Z node 9 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_9_1_16795697126497985575_v1TEvPartitionReady. Aval parts: 1
2025-11-03T16:52:37.234443Z node 9 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_9_1_16795697126497985575_v1 performing read request: guid# 5d1d45d-7e27e273-f5ed2805-9ca291cc, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 6, size# 4768, partitionsAsked# 1, maxTimeLag# 0ms
2025-11-03T16:52:37.234525Z node 9 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_9_1_16795697126497985575_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 6 maxSize 4768 maxTimeLagMs 0 readTimestampMs 0 readOffset 0 EndOffset 5 ClientCommitOffset 0 committedOffset 0 Guid 5d1d45d-7e27e273-f5ed2805-9ca291cc
2025-11-03T16:52:37.235091Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:37.235128Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:37.235267Z node 10 :PERSQUEUE DEBUG: partition_read.cpp:880: [72075186224037892][Partition][0][StateIdle] read cookie 4 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 partno 0 count 6 size 4768 endOffset 5 max time lag 0ms effective offset 0
2025-11-03T16:52:37.235694Z node 10 :PERSQUEUE DEBUG: partition_read.cpp:1105: [72075186224037892][Partition][0][StateIdle] read cookie 4 added 2 blobs, size 18694 count 5 last offset 1, current partition end offset: 5
2025-11-03T16:52:37.235714Z node 10 :PERSQUEUE DEBUG: partition_read.cpp:1121: [72075186224037892][Partition][0][StateIdle] Reading cookie 4. Send blob request.
2025-11-03T16:52:37.235756Z node 10 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 0 partno 0 count 1 parts_count 0 source 1 size 1987 accessed 1 times before, last time 2025-11-03T16:52:37.000000Z
2025-11-03T16:52:37.235777Z node 10 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 1 partno 0 count 4 parts_count 0 source 1 size 16707 accessed 0 times before, last time 2025-11-03T16:52:37.000000Z
2025-11-03T16:52:37.235835Z node 10 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 4. All 2 blobs are from cache.
2025-11-03T16:52:37.235886Z node 10 :PERSQUEUE DEBUG: partition_read.cpp:572: FormAnswer for 2 blobs
2025-11-03T16:52:37.235900Z node 10 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 0 suffix '63'
2025-11-03T16:52:37.235928Z node 10 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 1 partno 0 count 4 parts 0 suffix '63'
2025-11-03T16:52:37.236057Z node 10 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 0 totakecount 1 count 1 size 1967 from pos 0 cbcount 1
2025-11-03T16:52:37.236303Z node 10 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 1 totakecount 4 count 4 size 16685 from pos 0 cbcount 4
2025-11-03T16:52:37.236426Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-03T16:52:37.237320Z node 9 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_9_1_16795697126497985575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 5 Result { Offset: 0 Data: "... 1910 bytes ..." SourceId: "\000test-message-group-id" SeqNo: 1 WriteTimestampMS: 1762188757108 CreateTimestampMS: 1 UncompressedSize: 2048 PartitionKey: "" ExplicitHash: "" } Result { Offset: 1 Data: "... 2800 bytes ..." SourceId: "\000test-message-group-id" SeqNo: 2 WriteTimestampMS: 1762188757177 CreateTimestampMS: 2 UncompressedSize: 3072 PartitionKey: "" ExplicitHash: "" } Result { Offset: 2 Data: "... 3694 bytes ..." SourceId: "\000test-message-group-id" SeqNo: 3 WriteTimestampMS: 1762188757180 CreateTimestampMS: 3 UncompressedSize: 4096 PartitionKey: "" ExplicitHash: "" } Result { Offset: 3 Data: "... 4585 bytes ..." SourceId: "\000test-message-group-id" SeqNo: 4 WriteTimestampMS: 1762188757180 CreateTimestampMS: 4 UncompressedSize: 5120 PartitionKey: "" ExplicitHash: "" } Result { Offset: 4 Data: "... 5484 bytes ..." SourceId: "\000test-message-group-id" SeqNo: 5 WriteTimestampMS: 1762188757180 CreateTimestampMS: 5 UncompressedSize: 6144 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 2 SizeLag: 18446744073709536832 RealReadOffset: 4 WaitQuotaTimeMs: 0 EndOffset: 5 StartOffset: 0 } Cookie: 0 }
2025-11-03T16:52:37.238316Z node 9 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_9_1_16795697126497985575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 1 from offset 5
2025-11-03T16:52:37.238374Z node 9 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_9_1_16795697126497985575_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 5 ReadOffset 5 ReadGuid 5d1d45d-7e27e273-f5ed2805-9ca291cc has messages 1
2025-11-03T16:52:37.238579Z node 9 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_9_1_16795697126497985575_v1 read done: guid# 5d1d45d-7e27e273-f5ed2805-9ca291cc, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 18630
2025-11-03T16:52:37.238615Z node 9 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_9_1_16795697126497985575_v1 response to read: guid# 5d1d45d-7e27e273-f5ed2805-9ca291cc
2025-11-03T16:52:37.238929Z node 9 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_9_1_16795697126497985575_v1 Process answer. Aval parts: 0
2025-11-03T16:52:37.240163Z :DEBUG: [/Root] [/Root] [41060c4a-4384b7c3-dc22d47a-5f30f789] [null] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:52:37.240391Z node 9 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_9_1_16795697126497985575_v1 grpc read done: success# 1, data# { read { } }
2025-11-03T16:52:37.240522Z node 9 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_9_1_16795697126497985575_v1 got read request: guid# cf02ebc2-6f626859-b7e8a265-882229f9
2025-11-03T16:52:37.243908Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 0 (0-4)
2025-11-03T16:52:37.244580Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (0-0)
2025-11-03T16:52:37.244650Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 0} (1-1)
2025-11-03T16:52:37.244740Z :DEBUG: [/Root] Take Data. Partition 0. Read: {2, 0} (2-2)
2025-11-03T16:52:37.244771Z :DEBUG: [/Root] Take Data. Partition 0. Read: {2, 1} (3-3)
2025-11-03T16:52:37.244840Z :DEBUG: [/Root] Take Data. Partition 0. Read: {2, 2} (4-4)
2025-11-03T16:52:37.244887Z :DEBUG: [/Root] [/Root] [41060c4a-4384b7c3-dc22d47a-5f30f789] [null] The application data is transferred to the client. Number of messages 5, size 20480 bytes
2025-11-03T16:52:37.245057Z :DEBUG: [/Root] [/Root] [41060c4a-4384b7c3-dc22d47a-5f30f789] [null] Commit offsets [0, 1). Partition stream id: 1
2025-11-03T16:52:37.245110Z :DEBUG: [/Root] [/Root] [41060c4a-4384b7c3-dc22d47a-5f30f789] [null] Commit offsets [1, 2). Partition stream id: 1
2025-11-03T16:52:37.245138Z :DEBUG: [/Root] [/Root] [41060c4a-4384b7c3-dc22d47a-5f30f789] [null] Commit offsets [2, 3). Partition stream id: 1
2025-11-03T16:52:37.245166Z :DEBUG: [/Root] [/Root] [41060c4a-4384b7c3-dc22d47a-5f30f789] [null] Commit offsets [3, 4). Partition stream id: 1
2025-11-03T16:52:37.245195Z :DEBUG: [/Root] [/Root] [41060c4a-4384b7c3-dc22d47a-5f30f789] [null] Commit offsets [4, 5). Partition stream id: 1
2025-11-03T16:52:37.245387Z :TWriteSession_WriteAndReadAndCommitRandomMessagesNoClusterDiscovery INFO: Read message count is 5 (from 5 in total), committed offset count is 0 (maximum offset: 4)
Get event on client
2025-11-03T16:52:37.245737Z node 9 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_9_1_16795697126497985575_v1 grpc read done: success# 1, data# { commit { cookies { assign_id: 1 partition_cookie: 1 } } }
2025-11-03T16:52:37.245894Z node 9 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1449: session cookie 1 consumer shared/user session shared/user_9_1_16795697126497985575_v1 commit request from client for 1 in TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-11-03T16:52:37.245925Z node 9 :PQ_READ_PROXY DEBUG: partition_actor.cpp:129: session cookie 1 consumer shared/user session shared/user_9_1_16795697126497985575_v1 commit request from 1 to 1 in TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-11-03T16:52:37.245968Z node 9 :PQ_READ_PROXY DEBUG: partition_actor.cpp:203: session cookie 1 consumer shared/user session shared/user_9_1_16795697126497985575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) committing to position 5 prev 0 end 5 by cookie 1
2025-11-03T16:52:37.246387Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:37.246427Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:37.246490Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:37.246514Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:37.246529Z node 10 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-03T16:52:37.246594Z node 10 :PERSQUEUE DEBUG: partition.cpp:3666: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user offset is set to 5 (startOffset 0) session shared/user_9_1_16795697126497985575_v1
2025-11-03T16:52:37.246613Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:37.246740Z node 10 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-03T16:52:37.253297Z node 10 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-03T16:52:37.253348Z node 10 :PERSQUEUE DEBUG: partition_read.cpp:923: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 5 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-11-03T16:52:37.253394Z node 10 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-11-03T16:52:37.253423Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:37.253439Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:37.253456Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:37.253488Z node 10 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:52:37.253518Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-11-03T16:52:37.253831Z node 9 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_9_1_16795697126497985575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { Cookie: 1 }
2025-11-03T16:52:37.253874Z node 9 :PQ_READ_PROXY DEBUG: partition_actor.cpp:961: session cookie 1 consumer shared/user session shared/user_9_1_16795697126497985575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) commit done to position 5 endOffset 5 with cookie 1
2025-11-03T16:52:37.253917Z node 9 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:707: session cookie 1 consumer shared/user session shared/user_9_1_16795697126497985575_v1 replying for commits: assignId# 1, from# 1, to# 1, offset# 5
2025-11-03T16:52:37.254513Z :DEBUG: [/Root] [/Root] [41060c4a-4384b7c3-dc22d47a-5f30f789] [null] Committed response: cookies { assign_id: 1 partition_cookie: 1 }
2025-11-03T16:52:37.254714Z :TWriteSession_WriteAndReadAndCommitRandomMessagesNoClusterDiscovery INFO: Got commit ack with offset 5
2025-11-03T16:52:37.254775Z :TWriteSession_WriteAndReadAndCommitRandomMessagesNoClusterDiscovery INFO: Read message count is 5 (from 5 in total), committed offset count is 5 (maximum offset: 4)
2025-11-03T16:52:37.254812Z :TWriteSession_WriteAndReadAndCommitRandomMessagesNoClusterDiscovery INFO: Time took to write and read 5 messages, 0 [MiB] in total is 0 [s]
2025-11-03T16:52:37.254850Z :INFO: [/Root] [/Root] [41060c4a-4384b7c3-dc22d47a-5f30f789] Closing read session. Close timeout: 0.000000s
2025-11-03T16:52:37.254887Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:test-topic:0:1:4:5
2025-11-03T16:52:37.254919Z :INFO: [/Root] [/Root] [41060c4a-4384b7c3-dc22d47a-5f30f789] Counters: { Errors: 0 CurrentSessionLifetimeMs: 46 BytesRead: 20480 MessagesRead: 5 BytesReadCompressed: 18138 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-11-03T16:52:37.255004Z :NOTICE: [/Root] [/Root] [41060c4a-4384b7c3-dc22d47a-5f30f789] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Close with zero timeout " }
2025-11-03T16:52:37.255051Z :DEBUG: [/Root] [/Root] [41060c4a-4384b7c3-dc22d47a-5f30f789] [null] Abort session to cluster
2025-11-03T16:52:37.255402Z :NOTICE: [/Root] [/Root] [41060c4a-4384b7c3-dc22d47a-5f30f789] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
2025-11-03T16:52:37.255565Z :TWriteSession_WriteAndReadAndCommitRandomMessagesNoClusterDiscovery INFO: Wait for client write event loop to stop
2025-11-03T16:52:37.255587Z :TWriteSession_WriteAndReadAndCommitRandomMessagesNoClusterDiscovery DEBUG: Close writer (stop)
2025-11-03T16:52:37.255641Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ce618bc3-bb599573-4f98b36c-1bac21bf_0] Write session: close. Timeout = 0 ms
2025-11-03T16:52:37.255671Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ce618bc3-bb599573-4f98b36c-1bac21bf_0] Write session will now close
2025-11-03T16:52:37.255711Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ce618bc3-bb599573-4f98b36c-1bac21bf_0] Write session: aborting
2025-11-03T16:52:37.256089Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ce618bc3-bb599573-4f98b36c-1bac21bf_0] Write session: gracefully shut down, all writes complete
2025-11-03T16:52:37.256049Z node 9 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_9_1_16795697126497985575_v1 grpc read done: success# 0, data# {  }
2025-11-03T16:52:37.256073Z node 9 :PQ_READ_PROXY INFO: read_session_actor.cpp:125: session cookie 1 consumer shared/user session shared/user_9_1_16795697126497985575_v1 grpc read failed
2025-11-03T16:52:37.256099Z node 9 :PQ_READ_PROXY INFO: read_session_actor.cpp:92: session cookie 1 consumer shared/user session shared/user_9_1_16795697126497985575_v1 grpc closed
2025-11-03T16:52:37.256133Z node 9 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 1 consumer shared/user session shared/user_9_1_16795697126497985575_v1 is DEAD
2025-11-03T16:52:37.256125Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ce618bc3-bb599573-4f98b36c-1bac21bf_0] Write session: destroy
2025-11-03T16:52:37.256734Z :TWriteSession_WriteAndReadAndCommitRandomMessagesNoClusterDiscovery DEBUG: Writer closed
2025-11-03T16:52:37.257825Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:2258: [PQ: 72075186224037892] Destroy direct read session shared/user_9_1_16795697126497985575_v1
2025-11-03T16:52:37.257567Z node 9 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: test-message-group-id|ce618bc3-bb599573-4f98b36c-1bac21bf_0 grpc read done: success: 0 data: 
2025-11-03T16:52:37.257868Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [9:7568543081915560664:2486] destroyed
2025-11-03T16:52:37.257609Z node 9 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 2 sessionId: test-message-group-id|ce618bc3-bb599573-4f98b36c-1bac21bf_0 grpc read failed
2025-11-03T16:52:37.257653Z node 9 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 2 sessionId: test-message-group-id|ce618bc3-bb599573-4f98b36c-1bac21bf_0 grpc closed
2025-11-03T16:52:37.257686Z node 9 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2 sessionId: test-message-group-id|ce618bc3-bb599573-4f98b36c-1bac21bf_0 is DEAD
2025-11-03T16:52:37.258381Z node 9 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-11-03T16:52:37.257918Z node 10 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_9_1_16795697126497985575_v1
2025-11-03T16:52:37.258475Z node 9 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1659: [72075186224037893][rt3.dc1--test-topic] pipe [9:7568543081915560661:2483] disconnected.
2025-11-03T16:52:37.258498Z node 9 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1670: [72075186224037893][rt3.dc1--test-topic] pipe [9:7568543081915560661:2483] disconnected; active server actors: 1
2025-11-03T16:52:37.258516Z node 9 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1679: [72075186224037893][rt3.dc1--test-topic] pipe [9:7568543081915560661:2483] client user disconnected session shared/user_9_1_16795697126497985575_v1
2025-11-03T16:52:37.259207Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [9:7568543081915560639:2473] destroyed
2025-11-03T16:52:37.259245Z node 10 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-11-03T16:52:37.259278Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:37.259294Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:37.259313Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:37.263897Z :TWriteSession_WriteAndReadAndCommitRandomMessagesNoClusterDiscovery INFO: Client write event loop stopped
2025-11-03T16:52:37.265018Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:37.265060Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:37.265078Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:37.366803Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:37.366838Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:37.366857Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:37.466615Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:37.466648Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:37.466665Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:37.593035Z node 9 :KQP_EXECUTER ERROR: kqp_executer_impl.h:1006: ActorId: [9:7568543081915560681:2477] TxId: 281474976710678. Ctx: { TraceId: 01k95a524j2303cn1jdgxpcvqx, Database: /Root, SessionId: ydb://session/3?node_id=9&id=ODY2ZWQyNzAtYzk0YWFmYWUtODc0ZTViYzEtNTgxNTQwNmU=, PoolId: default}. UNAVAILABLE: Failed to send EvStartKqpTasksRequest because node is unavailable: 10
2025-11-03T16:52:37.593796Z node 9 :KQP_COMPUTE ERROR: dq_compute_actor_impl.h:1210: SelfId: [9:7568543081915560690:2477], TxId: 281474976710678, task: 3. Ctx: { CheckpointId : .  TraceId : 01k95a524j2303cn1jdgxpcvqx.  CustomerSuppliedId : .  RunScriptActorId : [0:0:0].  PoolId : default.  SessionId : ydb://session/3?node_id=9&id=ODY2ZWQyNzAtYzk0YWFmYWUtODc0ZTViYzEtNTgxNTQwNmU=.  CurrentExecutionId : .  Database : /Root.  DatabaseId : /Root. }. Handle abort execution event from: [9:7568543081915560681:2477], status: UNAVAILABLE, reason: { <main>: Error: Terminate execution }
2025-11-03T16:52:38.596579Z node 9 :KQP_SESSION WARN: kqp_session_actor.cpp:2987: SessionId: ydb://session/3?node_id=9&id=ODY2ZWQyNzAtYzk0YWFmYWUtODc0ZTViYzEtNTgxNTQwNmU=, ActorId: [9:7568543081915560641:2477], ActorState: ExecuteState, TraceId: 01k95a524j2303cn1jdgxpcvqx, Create QueryResponse for error on request, msg: 
2025-11-03T16:52:38.598538Z node 9 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Kikimr cluster or one of its subsystems was unavailable." issue_code: 2005 severity: 1 issues { message: "Failed to send EvStartKqpTasksRequest because node is unavailable: 10" severity: 1 } } TxMeta { id: "01k95a52jm5smpqwh9kt7q4ang" } } YdbStatus: UNAVAILABLE ConsumedRu: 297 }
2025-11-03T16:52:41.211509Z :TWriteSession_WriteEncoded INFO: Random seed for debugging is 1762188761211489
2025-11-03T16:52:41.782716Z node 11 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[11:7568543098318434847:2079];send_to=[0:7307199536658146131:7762515];
2025-11-03T16:52:41.782809Z node 11 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
test_client.cpp: SetPath # /home/runner/.ya/build/build_root/7jz3/001974/r3tmp/tmpwk4uzy/pdisk_1.dat
2025-11-03T16:52:41.855399Z node 11 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-11-03T16:52:41.855729Z node 12 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-11-03T16:52:41.859359Z node 12 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-11-03T16:52:41.859437Z node 12 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=incorrect path status: LookupError;
2025-11-03T16:52:41.859654Z node 11 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-11-03T16:52:42.000183Z node 11 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
2025-11-03T16:52:42.029762Z node 11 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(11, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-11-03T16:52:42.029861Z node 11 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(11, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-11-03T16:52:42.033477Z node 11 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(12, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-11-03T16:52:42.033570Z node 11 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(12, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-11-03T16:52:42.038921Z node 11 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(11, (0,0,0,0)) VolatileState: Connecting -> Connected
2025-11-03T16:52:42.041766Z node 11 :HIVE WARN: hive_impl.cpp:811: HIVE#72057594037968897 Handle TEvInterconnect::TEvNodeConnected, NodeId 12 Cookie 12
2025-11-03T16:52:42.043309Z node 11 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(12, (0,0,0,0)) VolatileState: Connecting -> Connected
2025-11-03T16:52:42.049013Z node 11 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
TServer::EnableGrpc on GrpcPort 6411, node 11
2025-11-03T16:52:42.144750Z node 11 :NET_CLASSIFIER WARN: net_classifier.cpp:190: distributable config is empty, broken or outdated, will use file: /home/runner/.ya/build/build_root/7jz3/001974/r3tmp/yandexJsQdMc.tmp
2025-11-03T16:52:42.144781Z node 11 :NET_CLASSIFIER WARN: net_classifier.cpp:196: will try to initialize from file: /home/runner/.ya/build/build_root/7jz3/001974/r3tmp/yandexJsQdMc.tmp
2025-11-03T16:52:42.144925Z node 11 :NET_CLASSIFIER WARN: net_classifier.cpp:202: successfully initialized from file: /home/runner/.ya/build/build_root/7jz3/001974/r3tmp/yandexJsQdMc.tmp
2025-11-03T16:52:42.145111Z node 11 :NET_CLASSIFIER ERROR: net_classifier.cpp:228: got bad distributable configuration
2025-11-03T16:52:42.153021Z node 12 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-11-03T16:52:42.196279Z INFO: TTestServer started on Port 24040 GrpcPort 6411
TClient is connected to server localhost:24040
PQClient connected to localhost:6411
WaitRootIsUp 'Root'...
TClient::Ls request: Root
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "Root"
    PathId: 1
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 1
    CreateStep: 0
    ParentPathId: 1
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 1
      SubDomainVersion: 0
      SecurityStateVersion: 0
    }
    ChildrenExist: false
  }
  Children {
    Name: ".sys"
    PathId: 18446744073709551615
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 0
    CreateStep: 0
    ParentPathId: 18446744073709551615
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 0
      Pl...
(TRUNCATED)
WaitRootIsUp 'Root' success.
2025-11-03T16:52:42.490460Z node 11 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpAlterSubDomain, opId: 281474976715657:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_alter_subdomain.cpp:311)
waiting...
waiting...
waiting...
waiting...
2025-11-03T16:52:42.795448Z node 11 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-11-03T16:52:42.848183Z node 12 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-11-03T16:52:46.783121Z node 11 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[11:7568543098318434847:2079];send_to=[0:7307199536658146131:7762515];
2025-11-03T16:52:46.783228Z node 11 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
2025-11-03T16:52:47.142644Z node 12 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [12:7568543124304940408:2301], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-03T16:52:47.142730Z node 12 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [12:7568543124304940419:2304], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-03T16:52:47.142807Z node 12 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-03T16:52:47.143601Z node 12 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [12:7568543124304940423:2306], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-03T16:52:47.143668Z node 12 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-03T16:52:47.155064Z node 11 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateResourcePool, opId: 281474976720657:3, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_resource_pool.cpp:179)
2025-11-03T16:52:47.194274Z node 12 :KQP_WORKLOAD_SERVICE WARN: helpers.h:73: [WorkloadService] [TPoolCreatorActor] ActorId: [12:7568543124304940422:2305], DatabaseId: /Root, PoolId: default, Scheduled retry for error: { <main>: Error: Transaction 281474976720657 completed, doublechecking }
2025-11-03T16:52:47.261985Z node 12 :TX_PROXY ERROR: schemereq.cpp:593: Actor# [12:7568543124304940452:2144] txid# 281474976720658, issues: { message: "Check failed: path: \'/Root/.metadata/workload_manager/pools/default\', error: path exist, request accepts it (id: [OwnerId: 72057594046644480, LocalPathId: 8], type: EPathTypeResourcePool, state: EPathStateNoChanges)" severity: 1 }
2025-11-03T16:52:47.325445Z node 12 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:570: Compilation failed, self: [12:7568543124304940459:2310], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-11-03T16:52:47.328252Z node 12 :KQP_SESSION WARN: kqp_session_actor.cpp:2506: SessionId: ydb://session/3?node_id=12&id=MzM2NDRjMWYtZGM3NTdkMmMtYjQ5NDM5MzItZGNiYTYzMTk=, ActorId: [12:7568543124304940404:2300], ActorState: ExecuteState, TraceId: 01k95a5bx3536be27v5krk9xqt, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-11-03T16:52:47.328810Z node 12 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-11-03T16:52:47.372438Z node 11 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:570: Compilation failed, self: [11:7568543124088239696:2335], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-11-03T16:52:47.375952Z node 11 :KQP_SESSION WARN: kqp_session_actor.cpp:2506: SessionId: ydb://session/3?node_id=11&id=OTA5Nzk1MjgtOWE0MTM3YmYtYjdmMmY1ZDYtNjdlMjg4ZGM=, ActorId: [11:7568543124088239668:2328], ActorState: ExecuteState, TraceId: 01k95a5c21d24q1bnkkdd68g2z, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-11-03T16:52:47.377419Z node 11 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-11-03T16:52:47.546142Z node 11 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976715661:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:690)
2025-11-03T16:52:47.699812Z node 11 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976715662:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:690)
2025-11-03T16:52:47.887956Z node 11 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976715663:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:690)
=== Init DC: UPSERT INTO `/Root/PQ/Config/V2/Cluster` (name, balancer, local, enabled, weight) VALUES ("dc1", "localhost:6411", true, true, 1000);
2025-11-03T16:52:48.451736Z node 11 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976715664. Ctx: { TraceId: 01k95a5ctf487xrkc2jgm4bra4, Database: , SessionId: ydb://session/3?node_id=11&id=MjRjMmYzNGMtNDUxYWUyNTYtYmFlZDE5MC0yMDg2NDI0NQ==, PoolId: default, DatabaseId: /Root}. Database not set, use /Root
=== CheckClustersList. Subcribe to ClusterTracker from [11:7568543128383207417:3002] 
=== CheckClustersList. Ok
2025-11-03T16:52:55.172013Z node 11 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976715669:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:690)
waiting...
PQ Client: create topic: rt3.dc1--test-topic with 1 partitions
CallPersQueueGRPC request to localhost:6411
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-11-03T16:52:55.311275Z node 11 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
CallPersQueueGRPC request to localhost:6411
MetaRequest {
  CmdCreateTopic {
    Topic: "rt3.dc1--test-topic"
    NumPartitions: 1
    Config {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
  }
}
CallPersQueueGRPC response:
Status: 129
ProxyErrorCode: 53
SchemeStatus: 1
FlatTxId {
  TxId: 281474976715670
  SchemeShardTabletId: 72057594046644480
  PathId: 13
}
ErrorCode: OK
AddTopic: rt3.dc1--test-topic
===Run query:``DECLARE $version as Int64; DECLARE $path AS Utf8; DECLARE $cluster as Utf8; UPSERT INTO `/Root/PQ/Config/V2/Topics` (path, dc) VALUES ($path, $cluster); UPSERT INTO `/Root/PQ/Config/V2/Versions` (name, version) VALUES ("Topics", $version);`` with topic = test-topic, dc = dc1
2025-11-03T16:52:55.419199Z node 12 :PERSQUEUE DEBUG: pq_impl.cpp:2960: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-11-03T16:52:55.423288Z node 12 :PERSQUEUE DEBUG: pq_impl.cpp:2992: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-11-03T16:52:55.423557Z node 12 :PERSQUEUE DEBUG: pq_impl.cpp:787: [PQ: 72075186224037892] no config, start with empty partitions and default config
2025-11-03T16:52:55.423607Z node 12 :PERSQUEUE NOTICE: pq_impl.cpp:913: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-11-03T16:52:55.423645Z node 12 :PERSQUEUE INFO: pq_impl.cpp:612: [PQ: 72075186224037892] doesn't have tx writes info
2025-11-03T16:52:55.424676Z node 12 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [11:7568543158447978901:3264], now have 1 active actors on pipe
2025-11-03T16:52:55.425225Z node 12 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-03T16:52:55.430059Z node 12 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-03T16:52:55.450029Z node 11 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1655: [72075186224037893][] pipe [11:7568543158447978902:3265] connected; active server actors: 1
2025-11-03T16:52:55.452996Z node 12 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [11:7568543158447978943:2440], now have 1 active actors on pipe
2025-11-03T16:52:55.450237Z node 11 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1519: [72075186224037893][rt3.dc1--test-topic] updating configuration. Deleted partitions []. Added partitions [0]
2025-11-03T16:52:55.452304Z node 11 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:971: [72075186224037893][rt3.dc1--test-topic] Discovered subdomain [OwnerId: 72057594046644480, LocalPathId: 1] state, outOfSpace = 0 at RB 72075186224037893
2025-11-03T16:52:55.452945Z node 11 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:404: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 12, Generation 1
2025-11-03T16:52:55.454013Z node 11 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:140: [72075186224037893][rt3.dc1--test-topic] BALANCER INIT DONE for rt3.dc1--test-topic: (0, 72075186224037892) 
2025-11-03T16:52:55.464145Z node 12 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [11:7568543158447978957:3311], now have 1 active actors on pipe
2025-11-03T16:52:55.464430Z node 12 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-03T16:52:55.475163Z node 12 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-03T16:52:55.476204Z node 12 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-11-03T16:52:55.476258Z node 12 :PERSQUEUE DEBUG: partition.cpp:1312: [72075186224037892][Partition][0][StateInit] HandleOnInit TEvPQ::TEvProposePartitionConfig
2025-11-03T16:52:55.476550Z node 12 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-11-03T16:52:55.476761Z node 12 :PERSQUEUE INFO: partition_init.cpp:1101: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [12:7568543158664679271:2385]
2025-11-03T16:52:55.484287Z node 12 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-11-03T16:52:55.484326Z node 12 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-11-03T16:52:55.484356Z node 12 :PERSQUEUE INFO: partition.cpp:707: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1 [12:7568543158664679271:2385]
2025-11-03T16:52:55.484390Z node 12 :PERSQUEUE DEBUG: partition.cpp:727: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 0 Head Offset 0 PartNo 0 PackedSize 0 count 0 nextOffset 0 batches 0
2025-11-03T16:52:55.484428Z node 12 :PERSQUEUE DEBUG: partition_mlp.cpp:83: [72075186224037892][Partition][0][StateIdle] Initializing MLP Consumers: 0
2025-11-03T16:52:55.485996Z node 12 :PERSQUEUE DEBUG: partition.cpp:4273: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 1
2025-11-03T16:52:55.486031Z node 12 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:55.486121Z node 12 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:55.486133Z node 12 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-03T16:52:55.486157Z node 12 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-11-03T16:52:55.486172Z node 12 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:55.486187Z node 12 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:55.486199Z node 12 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-11-03T16:52:55.486230Z node 12 :PERSQUEUE DEBUG: partition_read.cpp:923: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-11-03T16:52:55.486272Z node 12 :PERSQUEUE DEBUG: partition_mlp.cpp:60: [72075186224037892][Partition][0][StateIdle] Process MLP pending events. Count 0
2025-11-03T16:52:55.486637Z node 12 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-03T16:52:55.486769Z node 12 :PERSQUEUE DEBUG: partition_compaction.cpp:183: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:52:55.500310Z node 12 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-03T16:52:55.500468Z node 12 :PERSQUEUE DEBUG: partition.cpp:1416: [72075186224037892][Partition][0][StateIdle] Handle TEvPQ::TEvTxCommit Step 1762188775501, TxId 281474976715670
2025-11-03T16:52:55.500496Z node 12 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:55.500521Z node 12 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:55.500663Z node 12 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:55.500903Z node 12 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-03T16:52:55.509207Z node 12 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-03T16:52:55.509394Z node 12 :PERSQUEUE DEBUG: partition_mlp.cpp:83: [72075186224037892][Partition][0][StateIdle] Initializing MLP Consumers: 0
2025-11-03T16:52:55.509519Z node 12 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-11-03T16:52:55.509545Z node 12 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:55.509558Z node 12 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:55.509574Z node 12 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:55.509605Z node 12 :PERSQUEUE DEBUG: partition_compaction.cpp:183: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:52:55.509948Z node 12 :PERSQUEUE DEBUG: pq_impl.cpp:398: [PQ: 72075186224037892] Apply new config PartitionConfig { LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 } PartitionIds: 0 TopicName: "rt3.dc1--test-topic" Version: 0 LocalDC: true Codecs { Ids: 0 Ids: 1 Ids: 2 Codecs: "raw" Codecs: "gzip" Codecs: "lzop" } TopicPath: "/Root/PQ/rt3.dc1--test-topic" YcCloudId: "" YcFolderId: "" YdbDatabaseId: "" YdbDatabasePath: "/Root" Partitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } AllPartitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } Consumers { Name: "user" ReadFromTimestampsMs: 0 FormatVersion: 0 Version: 0 Generation: 0 } MonitoringProjectId: ""
2025-11-03T16:52:55.510038Z node 12 :PERSQUEUE NOTICE: pq_impl.cpp:913: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-11-03T16:52:55.510323Z node 12 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-03T16:52:55.529521Z node 11 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976715671. Ctx: { TraceId: 01k95a5kyxacx7jbnhkry3x2xa, Database: , SessionId: ydb://session/3?node_id=11&id=MzE3ZTBlNzYtNDBjYWZlNDItYjllZGYyOTItNWQxZTgwMzU=, PoolId: default, DatabaseId: /Root}. Database not set, use /Root
2025-11-03T16:52:55.532773Z node 12 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-03T16:52:55.532881Z node 12 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-03T16:52:55.547531Z node 12 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
===Query complete
TClient::Ls request: /Root/PQ/rt3.dc1--test-topic
2025-11-03T16:52:55.588100Z node 12 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:55.588136Z node 12 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:55.588155Z node 12 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976715670
    CreateStep: 1762188775501
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts...
(TRUNCATED)
GetTopicVersionFromPath:  record Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976715670
    CreateStep: 1762188775501
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      YdbDatabasePath: "/Root"
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
    Partitions {
      PartitionId: 0
      TabletId: 72075186224037892
      Status: Active
    }
    AlterVersion: 1
    BalancerTabletID: 72075186224037893
    NextPartitionId: 1
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 1
      PlanResolution: 7
      Coordinators: 72057594046316545
      TimeCastBucketsPerMediator: 2
      Mediators: 72057594046382081
    }
    DomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    PathsInside: 12
    PathsLimit: 10000
    ShardsInside: 6
    ShardsLimit: 200000
    ResourcesDomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    DiskSpaceUsage {
      Tables {
        TotalSize: 0
        DataSize: 0
        IndexSize: 0
      }
      Topics {
        ReserveSize: 0
        AccountSize: 0
        DataSize: 0
        UsedReserveSize: 0
      }
    }
    PQPartitionsInside: 1
    PQPartitionsLimit: 1000000
    SchemeLimits {
      MaxDepth: 32
      MaxPaths: 10000
      MaxChildrenInDir: 100000
      MaxAclBytesSize: 10240
      MaxTableColumns: 200
      MaxTableColumnNameLength: 255
      MaxTableKeyColumns: 30
      MaxTableIndices: 20
      MaxShards: 200000
      MaxShardsInPath: 35000
      MaxConsistentCopyTargets: 10000
      MaxPathElementLength: 255
      ExtraPathSymbolsAllowed: "!\"#$%&\'()*+,-.:;<=>?@[\\]^_`{|}~"
      MaxPQPartitions: 1000000
      MaxTableCdcStreams: 5
      MaxExports: 10
      MaxImports: 10
      MaxColumnTableColumns: 10000
    }
  }
}
Path: "/Root/PQ/rt3.dc1--test-topic"
 name rt3.dc1--test-topic version1
CallPersQueueGRPC request to localhost:6411
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-11-03T16:52:55.598895Z node 11 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
MetaResponse {
  CmdGetTopicMetadataResult {
    TopicInfo {
      Topic: "rt3.dc1--test-topic"
      NumPartitions: 1
      Config {
        PartitionConfig {
          LifetimeSeconds: 86400
          LowWatermark: 8388608
          SourceIdLifetimeSeconds: 86400
          WriteSpeedInBytesPerSecond: 20000000
          BurstSize: 20000000
          SourceIdMaxCounts: 6000000
        }
        Version: 1
        LocalDC: true
        Codecs {
          Ids: 0
          Ids: 1
          Ids: 2
          Codecs: "raw"
          Codecs: "gzip"
          Codecs: "lzop"
        }
        TopicPath: "/Root/PQ/rt3.dc1--test-topic"
        YdbDatabasePath: "/Root"
        Consumers {
          Name: "user"
          ReadFromTimestampsMs: 0
          FormatVersion: 0
          Version: 0
        }
      }
      ErrorCode: OK
    }
  }
}
=== Topic created, have version: 1
2025-11-03T16:52:55.620537Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: try to update token
2025-11-03T16:52:55.626575Z :INFO: [] MessageGroupId [src] SessionId [] Write session: Do CDS request
2025-11-03T16:52:55.626651Z :INFO: [] MessageGroupId [src] SessionId [] Start write session. Will connect to endpoint: localhost:6411
2025-11-03T16:52:55.649386Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src" }
2025-11-03T16:52:55.650874Z node 11 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-11-03T16:52:55.650910Z node 11 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1
2025-11-03T16:52:55.653321Z node 11 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src" }
2025-11-03T16:52:55.653470Z node 11 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1 topic: "test-topic" message_group_id: "src" from ipv6:[::1]:42790
2025-11-03T16:52:55.653491Z node 11 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:42790 proto=v1  topic=test-topic durationSec=0
2025-11-03T16:52:55.653503Z node 11 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-11-03T16:52:55.655851Z node 11 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1 sessionId:  describe result for acl check
2025-11-03T16:52:55.656009Z node 11 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-11-03T16:52:55.656022Z node 11 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-11-03T16:52:55.656034Z node 11 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-11-03T16:52:55.656053Z node 11 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [11:7568543158447979030:2456] (SourceId=src, PreferedPartition=(NULL)) StartKqpSession
2025-11-03T16:52:55.659390Z node 11 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [11:7568543158447979030:2456] (SourceId=src, PreferedPartition=(NULL)) Select from the table
2025-11-03T16:52:55.691517Z node 12 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:55.691557Z node 12 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:55.691574Z node 12 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:55.789510Z node 12 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:55.789541Z node 12 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:55.789557Z node 12 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:55.890959Z node 12 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:55.890995Z node 12 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:55.891012Z node 12 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:55.974130Z node 11 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [11:7568543158447979030:2456] (SourceId=src, PreferedPartition=(NULL)) RequestPQRB
2025-11-03T16:52:55.974549Z node 11 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1655: [72075186224037893][rt3.dc1--test-topic] pipe [11:7568543158447979075:2456] connected; active server actors: 1
2025-11-03T16:52:55.974601Z node 11 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [11:7568543158447979030:2456] (SourceId=src, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=src
2025-11-03T16:52:55.974621Z node 11 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [11:7568543158447979030:2456] (SourceId=src, PreferedPartition=(NULL)) Update the table
2025-11-03T16:52:55.977054Z node 11 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1659: [72075186224037893][rt3.dc1--test-topic] pipe [11:7568543158447979075:2456] disconnected.
2025-11-03T16:52:55.977090Z node 11 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1670: [72075186224037893][rt3.dc1--test-topic] pipe [11:7568543158447979075:2456] disconnected; active server actors: 1
2025-11-03T16:52:55.977114Z node 11 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1695: [72075186224037893][rt3.dc1--test-topic] pipe [11:7568543158447979075:2456] disconnected no session
2025-11-03T16:52:55.992123Z node 12 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:55.992157Z node 12 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:55.992188Z node 12 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:56.092254Z node 12 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:56.092291Z node 12 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:56.092309Z node 12 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:56.181797Z node 11 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [11:7568543158447979030:2456] (SourceId=src, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-11-03T16:52:56.181865Z node 11 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [11:7568543158447979030:2456] (SourceId=src, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-11-03T16:52:56.181890Z node 11 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [11:7568543158447979030:2456] (SourceId=src, PreferedPartition=(NULL)) Start idle
2025-11-03T16:52:56.181938Z node 11 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-11-03T16:52:56.185595Z node 11 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 12, Generation: 1
2025-11-03T16:52:56.185463Z node 12 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [11:7568543162742946403:2456], now have 1 active actors on pipe
2025-11-03T16:52:56.185993Z node 12 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:56.186027Z node 12 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:56.186136Z node 12 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src|c795e632-7f99d2e1-ca0836e9-83f3ccea_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src
2025-11-03T16:52:56.186196Z node 12 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:56.186238Z node 12 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:56.186255Z node 12 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-03T16:52:56.186303Z node 12 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:56.186345Z node 12 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-03T16:52:56.186402Z node 12 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-03T16:52:56.188000Z node 12 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:56.188046Z node 12 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:56.188149Z node 12 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-03T16:52:56.188491Z node 11 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1 partition: 0 MaxSeqNo: 0 sessionId: src|c795e632-7f99d2e1-ca0836e9-83f3ccea_0
2025-11-03T16:52:56.192179Z :INFO: [] MessageGroupId [src] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1762188776192 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-11-03T16:52:56.192346Z :INFO: [] MessageGroupId [src] SessionId [] Write session established. Init response: session_id: "src|c795e632-7f99d2e1-ca0836e9-83f3ccea_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-11-03T16:52:56.192660Z :INFO: [] MessageGroupId [src] SessionId [src|c795e632-7f99d2e1-ca0836e9-83f3ccea_0] Write session: close. Timeout = 0 ms
2025-11-03T16:52:56.192726Z :INFO: [] MessageGroupId [src] SessionId [src|c795e632-7f99d2e1-ca0836e9-83f3ccea_0] Write session will now close
2025-11-03T16:52:56.192786Z :DEBUG: [] MessageGroupId [src] SessionId [src|c795e632-7f99d2e1-ca0836e9-83f3ccea_0] Write session: aborting
2025-11-03T16:52:56.193417Z :INFO: [] MessageGroupId [src] SessionId [src|c795e632-7f99d2e1-ca0836e9-83f3ccea_0] Write session: gracefully shut down, all writes complete
2025-11-03T16:52:56.193474Z :DEBUG: [] MessageGroupId [src] SessionId [src|c795e632-7f99d2e1-ca0836e9-83f3ccea_0] Write session: destroy
2025-11-03T16:52:56.194326Z node 11 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId: src|c795e632-7f99d2e1-ca0836e9-83f3ccea_0 grpc read done: success: 0 data: 
2025-11-03T16:52:56.194354Z node 11 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 1 sessionId: src|c795e632-7f99d2e1-ca0836e9-83f3ccea_0 grpc read failed
2025-11-03T16:52:56.194391Z node 11 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 1 sessionId: src|c795e632-7f99d2e1-ca0836e9-83f3ccea_0 grpc closed
2025-11-03T16:52:56.194429Z node 11 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1 sessionId: src|c795e632-7f99d2e1-ca0836e9-83f3ccea_0 is DEAD
2025-11-03T16:52:56.195357Z node 11 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-11-03T16:52:56.197081Z node 12 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [11:7568543162742946403:2456] destroyed
2025-11-03T16:52:56.197164Z node 12 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:56.197186Z node 12 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:56.197208Z node 12 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:56.197304Z node 12 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-11-03T16:52:56.197340Z node 12 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:56.197361Z node 12 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:56.197378Z node 12 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:56.229814Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [] Write session: try to update token
2025-11-03T16:52:56.230406Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [] Write session: Do CDS request
2025-11-03T16:52:56.230483Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [] Do schedule cds request after 0 ms
message       M-.NLO 0   
2025-11-03T16:52:56.230878Z :INFO: [/Root] MessageGroupId [test-message-group-id] Running cds request ms
2025-11-03T16:52:56.251280Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [] Got CDS response: 
write_sessions_clusters { clusters { endpoint: "localhost:6411" name: "dc1" available: true } primary_cluster_selection_reason: CLIENT_LOCATION } version: 1
2025-11-03T16:52:56.251354Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [] Start write session. Will connect to endpoint: localhost:6411
2025-11-03T16:52:56.274322Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [] Write session: send init request: init_request { topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" }
2025-11-03T16:52:56.274827Z node 11 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-11-03T16:52:56.274860Z node 11 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2
2025-11-03T16:52:56.280557Z node 11 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" }
2025-11-03T16:52:56.280778Z node 11 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2 topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" from ipv6:[::1]:42830
2025-11-03T16:52:56.280810Z node 11 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:42830 proto=v1  topic=test-topic durationSec=0
2025-11-03T16:52:56.280824Z node 11 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-11-03T16:52:56.282804Z node 11 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2 sessionId:  describe result for acl check
2025-11-03T16:52:56.282946Z node 11 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-11-03T16:52:56.282958Z node 11 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-11-03T16:52:56.282971Z node 11 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-11-03T16:52:56.282990Z node 11 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [11:7568543162742946425:2480] (SourceId=test-message-group-id, PreferedPartition=(NULL)) StartKqpSession
2025-11-03T16:52:56.286896Z node 11 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [11:7568543162742946425:2480] (SourceId=test-message-group-id, PreferedPartition=(NULL)) Select from the table
2025-11-03T16:52:56.300178Z node 12 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:56.300217Z node 12 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:56.300239Z node 12 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:56.301758Z node 11 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [11:7568543162742946425:2480] (SourceId=test-message-group-id, PreferedPartition=(NULL)) RequestPQRB
2025-11-03T16:52:56.302252Z node 11 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1655: [72075186224037893][rt3.dc1--test-topic] pipe [11:7568543162742946446:2480] connected; active server actors: 1
2025-11-03T16:52:56.302285Z node 11 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [11:7568543162742946425:2480] (SourceId=test-message-group-id, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=test-message-group-id
2025-11-03T16:52:56.302303Z node 11 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [11:7568543162742946425:2480] (SourceId=test-message-group-id, PreferedPartition=(NULL)) Update the table
2025-11-03T16:52:56.303153Z node 11 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1659: [72075186224037893][rt3.dc1--test-topic] pipe [11:7568543162742946446:2480] disconnected.
2025-11-03T16:52:56.303177Z node 11 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1670: [72075186224037893][rt3.dc1--test-topic] pipe [11:7568543162742946446:2480] disconnected; active server actors: 1
2025-11-03T16:52:56.303204Z node 11 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1695: [72075186224037893][rt3.dc1--test-topic] pipe [11:7568543162742946446:2480] disconnected no session
2025-11-03T16:52:56.309585Z node 11 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [11:7568543162742946425:2480] (SourceId=test-message-group-id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-11-03T16:52:56.309626Z node 11 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [11:7568543162742946425:2480] (SourceId=test-message-group-id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-11-03T16:52:56.309640Z node 11 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [11:7568543162742946425:2480] (SourceId=test-message-group-id, PreferedPartition=(NULL)) Start idle
2025-11-03T16:52:56.309670Z node 11 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-11-03T16:52:56.311586Z node 11 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 12, Generation: 1
2025-11-03T16:52:56.313078Z node 11 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2 partition: 0 MaxSeqNo: 0 sessionId: test-message-group-id|21f8be36-ac0600f6-f82f1257-ff053958_0
2025-11-03T16:52:56.311548Z node 12 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [11:7568543162742946462:2480], now have 1 active actors on pipe
2025-11-03T16:52:56.311836Z node 12 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:56.311865Z node 12 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:56.311947Z node 12 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie test-message-group-id|21f8be36-ac0600f6-f82f1257-ff053958_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner test-message-group-id
2025-11-03T16:52:56.312013Z node 12 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:56.312036Z node 12 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:56.312051Z node 12 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-03T16:52:56.312097Z node 12 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:56.312138Z node 12 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-03T16:52:56.312193Z node 12 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-03T16:52:56.312734Z node 12 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:56.312756Z node 12 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:56.312820Z node 12 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-03T16:52:56.315989Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1762188776315 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-11-03T16:52:56.316134Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [] Write session established. Init response: session_id: "test-message-group-id|21f8be36-ac0600f6-f82f1257-ff053958_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-11-03T16:52:56.402612Z node 12 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:56.402654Z node 12 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:56.402673Z node 12 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:56.504056Z node 12 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:56.504093Z node 12 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:56.504109Z node 12 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:56.604180Z node 12 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:56.604217Z node 12 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:56.604233Z node 12 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:56.708144Z node 12 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:56.708189Z node 12 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:56.708220Z node 12 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:56.808587Z node 12 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:56.808629Z node 12 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:56.808649Z node 12 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:56.909465Z node 12 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:56.909512Z node 12 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:56.909534Z node 12 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:56.955380Z node 11 :FLAT_TX_SCHEMESHARD WARN: schemeshard_impl.cpp:7727: Cannot get console configs
2025-11-03T16:52:56.955417Z node 11 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
2025-11-03T16:52:57.009637Z node 12 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:57.009677Z node 12 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:57.009701Z node 12 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:57.112215Z node 12 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:57.112263Z node 12 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:57.112286Z node 12 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:57.213935Z node 12 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:57.213979Z node 12 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:57.214000Z node 12 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:57.314259Z node 12 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:57.314295Z node 12 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:57.314313Z node 12 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:57.312266Z node 11 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [11:7568543162742946425:2480] (SourceId=test-message-group-id, PreferedPartition=(NULL)) Update the table
2025-11-03T16:52:57.319198Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|21f8be36-ac0600f6-f82f1257-ff053958_0] Write 1 messages with Id from 1 to 1
2025-11-03T16:52:57.319353Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|21f8be36-ac0600f6-f82f1257-ff053958_0] Write 1 messages with Id from 2 to 2
2025-11-03T16:52:57.319435Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|21f8be36-ac0600f6-f82f1257-ff053958_0] Write 1 messages with Id from 3 to 3
2025-11-03T16:52:57.319485Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|21f8be36-ac0600f6-f82f1257-ff053958_0] Write 1 messages with Id from 4 to 4
GOT EVENT 0 1
GOT EVENT 0 2
2025-11-03T16:52:57.319802Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|21f8be36-ac0600f6-f82f1257-ff053958_0] Write session: try to update token
2025-11-03T16:52:57.319866Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|21f8be36-ac0600f6-f82f1257-ff053958_0] Send 1 message(s) (3 left), first sequence number is 1
2025-11-03T16:52:57.322183Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|21f8be36-ac0600f6-f82f1257-ff053958_0] Write session: try to update token
2025-11-03T16:52:57.322251Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|21f8be36-ac0600f6-f82f1257-ff053958_0] Send 3 message(s) (0 left), first sequence number is 2
2025-11-03T16:52:57.328354Z node 11 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: test-message-group-id|21f8be36-ac0600f6-f82f1257-ff053958_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:52:57.328704Z node 11 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:52:57.329119Z node 11 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: test-message-group-id|21f8be36-ac0600f6-f82f1257-ff053958_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:52:57.329336Z node 11 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:52:57.332273Z node 12 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:57.332319Z node 12 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:57.332368Z node 12 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:57.332380Z node 12 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:57.332454Z node 12 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-11-03T16:52:57.332516Z node 12 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1  requestId: <none> cookie: 2
2025-11-03T16:52:57.334692Z node 12 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:57.334128Z node 11 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:57.334726Z node 12 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:57.334198Z node 11 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:57.335127Z node 12 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0test-message-group-id' SeqNo: 1 partNo : 0 messageNo: 2 size 98 offset: -1
2025-11-03T16:52:57.335234Z node 12 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:57.335251Z node 12 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:57.335281Z node 12 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0test-message-group-id' SeqNo: 2 partNo : 0 messageNo: 3 size 91 offset: -1
2025-11-03T16:52:57.335304Z node 12 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0test-message-group-id' SeqNo: 3 partNo : 0 messageNo: 3 size 98 offset: -1
2025-11-03T16:52:57.335325Z node 12 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0test-message-group-id' SeqNo: 4 partNo : 0 messageNo: 3 size 71 offset: -1
2025-11-03T16:52:57.335362Z node 12 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:52:57.335422Z node 12 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:57.335449Z node 12 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:57.335463Z node 12 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-03T16:52:57.335577Z node 12 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0test-message-group-id' seqNo 1 partNo 0
2025-11-03T16:52:57.419707Z node 12 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0test-message-group-id' seqNo 1 partNo 0 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 187 count 1 nextOffset 1 batches 1
2025-11-03T16:52:57.419780Z node 12 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:57.420424Z node 12 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 0,1 HeadOffset 0 endOffset 0 curOffset 1 d0000000000_00000000000000000000_00000_0000000001_00000? size 175 WTime 1762188777420
2025-11-03T16:52:57.420629Z node 12 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:52:57.420682Z node 12 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:52:57.420715Z node 12 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:52:57.420736Z node 12 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-03T16:52:57.420872Z node 12 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 0 partNo 0 count 1 size 175
2025-11-03T16:52:57.435552Z node 12 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 0 count 1 size 175 actorID [12:7568543158664679253:2385]
2025-11-03T16:52:57.435630Z node 12 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-03T16:52:57.435688Z node 12 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 120 WriteNewSizeFromSupportivePartitions# 0
2025-11-03T16:52:57.435723Z node 12 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:52:57.435771Z node 12 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0test-message-group-id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 1, partNo: 0, Offset: 0 is stored on disk
2025-11-03T16:52:57.436028Z node 12 :PERSQUEUE DEBUG: partition_read.cpp:923: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-11-03T16:52:57.436058Z node 12 :PERSQUEUE DEBUG: partition_read.cpp:965: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-11-03T16:52:57.436081Z node 12 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:57.436084Z node 12 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 0 suffix '63' size 175
2025-11-03T16:52:57.436115Z node 12 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:57.436128Z node 12 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (3)
2025-11-03T16:52:57.436240Z node 12 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0test-message-group-id' seqNo 2 partNo 0
2025-11-03T16:52:57.440187Z node 11 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:57.438760Z node 12 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0test-message-group-id' seqNo 2 partNo 0 FormedBlobsCount 0 NewHead: Offset 1 PartNo 0 PackedSize 176 count 1 nextOffset 2 batches 1
2025-11-03T16:52:57.438845Z node 12 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0test-message-group-id' seqNo 3 partNo 0
2025-11-03T16:52:57.438884Z node 12 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0test-message-group-id' seqNo 3 partNo 0 FormedBlobsCount 0 NewHead: Offset 1 PartNo 0 PackedSize 331 count 2 nextOffset 3 batches 1
2025-11-03T16:52:57.438907Z node 12 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0test-message-group-id' seqNo 4 partNo 0
2025-11-03T16:52:57.438931Z node 12 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0test-message-group-id' seqNo 4 partNo 0 FormedBlobsCount 0 NewHead: Offset 1 PartNo 0 PackedSize 455 count 3 nextOffset 4 batches 1
2025-11-03T16:52:57.438956Z node 12 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:57.439561Z node 12 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 1,3 HeadOffset 1 endOffset 1 curOffset 4 d0000000000_00000000000000000001_00000_0000000003_00000? size 394 WTime 1762188777437
2025-11-03T16:52:57.439706Z node 12 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:52:57.439767Z node 12 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 2  requestId: <none> cookie: 1
2025-11-03T16:52:57.439857Z node 12 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-03T16:52:57.440015Z node 12 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 1 partNo 0 count 3 size 394
2025-11-03T16:52:57.440242Z node 12 :PERSQUEUE DEBUG: partition_read.cpp:880: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 partno 0 count 1 size 1024000 endOffset 1 max time lag 0ms effective offset 0
2025-11-03T16:52:57.440476Z node 12 :PERSQUEUE DEBUG: partition_read.cpp:1105: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 175 count 1 last offset 0, current partition end offset: 1
2025-11-03T16:52:57.440494Z node 12 :PERSQUEUE DEBUG: partition_read.cpp:1121: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-11-03T16:52:57.440567Z node 12 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 0 partno 0 count 1 parts_count 0 source 1 size 175 accessed 0 times before, last time 2025-11-03T16:52:57.000000Z
2025-11-03T16:52:57.440604Z node 12 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 3. All 1 blobs are from cache.
2025-11-03T16:52:57.440715Z node 12 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 0 suffix '63'
2025-11-03T16:52:57.440975Z node 12 :PERSQUEUE DEBUG: partition_read.cpp:572: FormAnswer for 1 blobs
2025-11-03T16:52:57.441112Z node 12 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 0 totakecount 1 count 1 size 155 from pos 0 cbcount 1
2025-11-03T16:52:57.441180Z node 12 :PERSQUEUE DEBUG: partition_read.cpp:1015: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1762188777332 queuesize 0 startOffset 0
2025-11-03T16:52:57.450293Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|21f8be36-ac0600f6-f82f1257-ff053958_0] Write session got write response: sequence_numbers: 1 offsets: 0 already_written: false write_statistics { persist_duration_ms: 18 queued_in_partition_duration_ms: 84 }
2025-11-03T16:52:57.450370Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|21f8be36-ac0600f6-f82f1257-ff053958_0] Write session: acknoledged message 1
GOT EVENT 1 2
2025-11-03T16:52:57.449724Z node 12 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 1 count 3 size 394 actorID [12:7568543158664679253:2385]
2025-11-03T16:52:57.449827Z node 12 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-03T16:52:57.449860Z node 12 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 1 partno 0 count 3 parts 0 suffix '63' size 394
2025-11-03T16:52:57.449889Z node 12 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 326 WriteNewSizeFromSupportivePartitions# 0
2025-11-03T16:52:57.449923Z node 12 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:52:57.449969Z node 12 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0test-message-group-id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 2, partNo: 0, Offset: 1 is stored on disk
2025-11-03T16:52:57.449990Z node 12 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:52:57.450014Z node 12 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0test-message-group-id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 3, partNo: 0, Offset: 2 is stored on disk
2025-11-03T16:52:57.450028Z node 12 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:52:57.450051Z node 12 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0test-message-group-id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 4, partNo: 0, Offset: 3 is stored on disk
2025-11-03T16:52:57.450278Z node 12 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:57.450293Z node 12 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:57.450310Z node 12 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:57.450346Z node 12 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:52:57.450425Z node 12 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 3  requestId: <none> cookie: 2
2025-11-03T16:52:57.451556Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|21f8be36-ac0600f6-f82f1257-ff053958_0] Write session got write response: sequence_numbers: 2 sequence_numbers: 3 sequence_numbers: 4 offsets: 1 offsets: 2 offsets: 3 already_written: false already_written: false already_written: false write_statistics { persist_duration_ms: 11 queued_in_partition_duration_ms: 17 }
2025-11-03T16:52:57.451607Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|21f8be36-ac0600f6-f82f1257-ff053958_0] Write session: acknoledged message 2
2025-11-03T16:52:57.451648Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|21f8be36-ac0600f6-f82f1257-ff053958_0] Write session: acknoledged message 3
2025-11-03T16:52:57.451679Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|21f8be36-ac0600f6-f82f1257-ff053958_0] Write session: acknoledged message 4
GOT EVENT 4 2
2025-11-03T16:52:57.450818Z node 11 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:57.520692Z node 12 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:57.520735Z node 12 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:57.520760Z node 12 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:57.621104Z node 12 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:57.621148Z node 12 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:57.621172Z node 12 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:57.722330Z node 12 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:57.722378Z node 12 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:57.722399Z node 12 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:57.797686Z node 11 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [11:7568543162742946425:2480] (SourceId=test-message-group-id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=1 Status=SUCCESS
2025-11-03T16:52:57.797716Z node 11 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [11:7568543162742946425:2480] (SourceId=test-message-group-id, PreferedPartition=(NULL)) Start idle
2025-11-03T16:52:57.824089Z node 12 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:57.824130Z node 12 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:57.824148Z node 12 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:57.932100Z node 12 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:57.932143Z node 12 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:57.932159Z node 12 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:58.031130Z node 12 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:58.031179Z node 12 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:58.031196Z node 12 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:58.132357Z node 12 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:58.132403Z node 12 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:58.132421Z node 12 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:58.235644Z node 12 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:58.235685Z node 12 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:58.235707Z node 12 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:58.335726Z node 12 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:58.335763Z node 12 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:58.335784Z node 12 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:58.436574Z node 12 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:58.436642Z node 12 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:58.436685Z node 12 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:58.540114Z node 12 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:58.540158Z node 12 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:58.540180Z node 12 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:58.640201Z node 12 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:58.640253Z node 12 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:58.640275Z node 12 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:58.743545Z node 12 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:58.743587Z node 12 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:58.743610Z node 12 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:58.847729Z node 12 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:58.847773Z node 12 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:58.847796Z node 12 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:58.948974Z node 12 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:58.949022Z node 12 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:58.949044Z node 12 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:59.052127Z node 12 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:59.052200Z node 12 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:59.052248Z node 12 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:59.152562Z node 12 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:59.152607Z node 12 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:59.152632Z node 12 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:59.261366Z node 12 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:59.261419Z node 12 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:59.261438Z node 12 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:59.361063Z node 12 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:59.361103Z node 12 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:59.361120Z node 12 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:59.461649Z node 12 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:59.461686Z node 12 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:59.461702Z node 12 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:59.562115Z node 12 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:59.562161Z node 12 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:59.562186Z node 12 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:59.663283Z node 12 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:59.663327Z node 12 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:59.663350Z node 12 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:59.764257Z node 12 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:59.764306Z node 12 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:59.764328Z node 12 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:59.866352Z node 12 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:59.866422Z node 12 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:59.866446Z node 12 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:59.965965Z node 12 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:59.966004Z node 12 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:59.966038Z node 12 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:53:00.070516Z node 12 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:53:00.070566Z node 12 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:53:00.070591Z node 12 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:53:00.173470Z node 12 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:53:00.173522Z node 12 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:53:00.173549Z node 12 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:53:00.280129Z node 12 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:53:00.280180Z node 12 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:53:00.280208Z node 12 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:53:00.380650Z node 12 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:53:00.380700Z node 12 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:53:00.380726Z node 12 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:53:00.484148Z node 12 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:53:00.484205Z node 12 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:53:00.484233Z node 12 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:53:00.496421Z node 12 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:53:00.588150Z node 12 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:53:00.588196Z node 12 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:53:00.588217Z node 12 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:53:00.696128Z node 12 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:53:00.696175Z node 12 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:53:00.696201Z node 12 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:53:00.796046Z node 12 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:53:00.796089Z node 12 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:53:00.796112Z node 12 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:53:00.900138Z node 12 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:53:00.900190Z node 12 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:53:00.900216Z node 12 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:53:00.999176Z node 12 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:53:00.999217Z node 12 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:53:00.999240Z node 12 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:53:01.105736Z node 12 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:53:01.105784Z node 12 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:53:01.105806Z node 12 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:53:01.210452Z node 12 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:53:01.210495Z node 12 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:53:01.210520Z node 12 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:53:01.312146Z node 12 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:53:01.312181Z node 12 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:53:01.312200Z node 12 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:53:01.418029Z node 12 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:53:01.418061Z node 12 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:53:01.418079Z node 12 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:53:01.520326Z node 12 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:53:01.520387Z node 12 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:53:01.520415Z node 12 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:53:01.620278Z node 12 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:53:01.620324Z node 12 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:53:01.620348Z node 12 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:53:01.732124Z node 12 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:53:01.732172Z node 12 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:53:01.732193Z node 12 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:53:01.832715Z node 12 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:53:01.832760Z node 12 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:53:01.832793Z node 12 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:53:01.936126Z node 12 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:53:01.936169Z node 12 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:53:01.936191Z node 12 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:53:02.044118Z node 12 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:53:02.044168Z node 12 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:53:02.044193Z node 12 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:53:02.143524Z node 12 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:53:02.143565Z node 12 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:53:02.143587Z node 12 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:53:02.243806Z node 12 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:53:02.243846Z node 12 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:53:02.243869Z node 12 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:53:02.345405Z node 12 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:53:02.345451Z node 12 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:53:02.345475Z node 12 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:53:02.447281Z node 12 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:53:02.447325Z node 12 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:53:02.447348Z node 12 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:53:02.452617Z :INFO: [/Root] [/Root] [7deba008-dcfd4111-f2d8fc1e-a5f1a7d2] Starting read session
2025-11-03T16:53:02.452712Z :DEBUG: [/Root] [/Root] [7deba008-dcfd4111-f2d8fc1e-a5f1a7d2] Starting session to cluster null (localhost:6411)
2025-11-03T16:53:02.452967Z :DEBUG: [/Root] [/Root] [7deba008-dcfd4111-f2d8fc1e-a5f1a7d2] [null] In Reconnect, ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:53:02.453021Z :DEBUG: [/Root] [/Root] [7deba008-dcfd4111-f2d8fc1e-a5f1a7d2] [null] New values: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:53:02.453073Z :DEBUG: [/Root] [/Root] [7deba008-dcfd4111-f2d8fc1e-a5f1a7d2] [null] Reconnecting session to cluster null in 0.000000s
Get event on client
2025-11-03T16:53:02.461345Z node 11 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:109: new grpc connection
2025-11-03T16:53:02.461370Z node 11 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:131: new session created cookie 1
2025-11-03T16:53:02.464148Z :DEBUG: [/Root] [/Root] [7deba008-dcfd4111-f2d8fc1e-a5f1a7d2] [null] Successfully connected. Initializing session
2025-11-03T16:53:02.465296Z node 11 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { topic: "test-topic" } read_only_original: true consumer: "shared/user" read_params { max_read_size: 104857600 } } }
2025-11-03T16:53:02.465584Z node 11 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 1 consumer shared/user session shared/user_11_1_17048185214180259351_v1 read init: from# ipv6:[::1]:42830, request# { init_request { topics_read_settings { topic: "test-topic" } read_only_original: true consumer: "shared/user" read_params { max_read_size: 104857600 } } }
2025-11-03T16:53:02.466136Z node 11 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 1 consumer shared/user session shared/user_11_1_17048185214180259351_v1 auth for : user
2025-11-03T16:53:02.466931Z node 11 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 1 consumer shared/user session shared/user_11_1_17048185214180259351_v1 Handle describe topics response
2025-11-03T16:53:02.467069Z node 11 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 1 consumer shared/user session shared/user_11_1_17048185214180259351_v1 auth is DEAD
2025-11-03T16:53:02.467148Z node 11 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 1 consumer shared/user session shared/user_11_1_17048185214180259351_v1 auth ok: topics# 1, initDone# 0
2025-11-03T16:53:02.468461Z node 11 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 1 consumer shared/user session shared/user_11_1_17048185214180259351_v1 register session: topic# rt3.dc1--test-topic
2025-11-03T16:53:02.469176Z :INFO: [/Root] [/Root] [7deba008-dcfd4111-f2d8fc1e-a5f1a7d2] [null] Server session id: shared/user_11_1_17048185214180259351_v1
2025-11-03T16:53:02.469398Z :DEBUG: [/Root] [/Root] [7deba008-dcfd4111-f2d8fc1e-a5f1a7d2] [null] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:53:02.473872Z node 11 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1655: [72075186224037893][rt3.dc1--test-topic] pipe [11:7568543188512750516:2534] connected; active server actors: 1
2025-11-03T16:53:02.473945Z node 11 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1706: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [11:7568543188512750516:2534] session shared/user_11_1_17048185214180259351_v1
2025-11-03T16:53:02.474000Z node 11 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:639: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-11-03T16:53:02.474065Z node 11 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:669: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-11-03T16:53:02.474125Z node 11 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:871: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_11_1_17048185214180259351_v1" (Sender=[11:7568543188512750513:2534], Pipe=[11:7568543188512750516:2534], Partitions=[], ActiveFamilyCount=0)
2025-11-03T16:53:02.474155Z node 11 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1186: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-11-03T16:53:02.474193Z node 11 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_11_1_17048185214180259351_v1 grpc read done: success# 1, data# { read { } }
2025-11-03T16:53:02.474211Z node 11 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1258: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-11-03T16:53:02.474255Z node 11 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_11_1_17048185214180259351_v1 got read request: guid# e69c694f-5e485752-456a9495-d7130ea6
2025-11-03T16:53:02.474282Z node 11 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1305: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_11_1_17048185214180259351_v1" (Sender=[11:7568543188512750513:2534], Pipe=[11:7568543188512750516:2534], Partitions=[], ActiveFamilyCount=0)
2025-11-03T16:53:02.474357Z node 11 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:549: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_11_1_17048185214180259351_v1" sender [11:7568543188512750513:2534] lock partition 0 for ReadingSession "shared/user_11_1_17048185214180259351_v1" (Sender=[11:7568543188512750513:2534], Pipe=[11:7568543188512750516:2534], Partitions=[], ActiveFamilyCount=1) generation 1 step 1
2025-11-03T16:53:02.474437Z node 11 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1325: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-11-03T16:53:02.474475Z node 11 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1402: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000235s
2025-11-03T16:53:02.475496Z node 11 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 1 consumer shared/user session shared/user_11_1_17048185214180259351_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 1 Session: "shared/user_11_1_17048185214180259351_v1" ClientId: "user" PipeClient { RawX1: 7568543188512750516 RawX2: 4503646872013286 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-11-03T16:53:02.475586Z node 11 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 1 consumer shared/user session shared/user_11_1_17048185214180259351_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-11-03T16:53:02.477792Z node 12 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [11:7568543188512750527:2541], now have 1 active actors on pipe
2025-11-03T16:53:02.480613Z node 12 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:53:02.480672Z node 12 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:53:02.480728Z node 12 :PERSQUEUE DEBUG: pq_impl.cpp:1748: [PQ: 72075186224037892] Created session shared/user_11_1_17048185214180259351_v1 on pipe: [11:7568543188512750527:2541]
2025-11-03T16:53:02.480821Z node 12 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:53:02.480857Z node 12 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:53:02.480879Z node 12 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-03T16:53:02.480972Z node 12 :PERSQUEUE DEBUG: partition.cpp:3666: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_11_1_17048185214180259351_v1
2025-11-03T16:53:02.480998Z node 12 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:53:02.481207Z node 12 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-03T16:53:02.481939Z node 12 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_11_1_17048185214180259351_v1:1 with generation 1
2025-11-03T16:53:02.479134Z node 11 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_11_1_17048185214180259351_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 1, pipe: [11:7568543188512750527:2541]
2025-11-03T16:53:02.491144Z node 12 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-03T16:53:02.491252Z node 12 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-11-03T16:53:02.491289Z node 12 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:53:02.491307Z node 12 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:53:02.491329Z node 12 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:53:02.491384Z node 12 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:53:02.491430Z node 12 :PERSQUEUE DEBUG: pq_impl.cpp:1186: [PQ: 72075186224037892] Topic 'rt3.dc1--test-topic' counters. CacheSize 569 CachedBlobs 2
2025-11-03T16:53:02.491465Z node 12 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-11-03T16:53:02.492239Z node 11 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_11_1_17048185214180259351_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 4 WriteTimestampMS: 1762188777332 CreateTimestampMS: 1762188777319 SizeLag: 350 WriteTimestampEstimateMS: 1762188782447 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-11-03T16:53:02.492303Z node 11 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 1 consumer shared/user session shared/user_11_1_17048185214180259351_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 4 readOffset 0 committedOffset 0
2025-11-03T16:53:02.492375Z node 11 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 1 consumer shared/user session shared/user_11_1_17048185214180259351_v1 sending to client partition status
2025-11-03T16:53:02.498136Z :INFO: [/Root] [/Root] [7deba008-dcfd4111-f2d8fc1e-a5f1a7d2] [null] Confirm partition stream create. Partition stream id: 1. Cluster: "dc1". Topic: "test-topic". Partition: 0. Read offset: (NULL)
Get event on client
2025-11-03T16:53:02.504312Z node 11 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_11_1_17048185214180259351_v1 grpc read done: success# 1, data# { start_read { topic { path: "test-topic" } cluster: "dc1" assign_id: 1 } }
2025-11-03T16:53:02.504502Z node 11 :PQ_READ_PROXY INFO: read_session_actor.cpp:539: session cookie 1 consumer shared/user session shared/user_11_1_17048185214180259351_v1 got StartRead from client: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 0, commitOffset# 0
2025-11-03T16:53:02.504557Z node 11 :PQ_READ_PROXY INFO: partition_actor.cpp:1023: session cookie 1 consumer shared/user session shared/user_11_1_17048185214180259351_v1 Start reading TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 4 readOffset 0 committedOffset 0 clientCommitOffset 0 clientReadOffset 0
2025-11-03T16:53:02.504602Z node 11 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_11_1_17048185214180259351_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 0 endOffset 4
2025-11-03T16:53:02.504681Z node 11 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_11_1_17048185214180259351_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 0, endOffset# 4, WTime# 1762188777332, sizeLag# 350
2025-11-03T16:53:02.504702Z node 11 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_11_1_17048185214180259351_v1TEvPartitionReady. Aval parts: 1
2025-11-03T16:53:02.504755Z node 11 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_11_1_17048185214180259351_v1 performing read request: guid# e69c694f-5e485752-456a9495-d7130ea6, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 4, size# 420, partitionsAsked# 1, maxTimeLag# 0ms
2025-11-03T16:53:02.504834Z node 11 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_11_1_17048185214180259351_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 4 maxSize 420 maxTimeLagMs 0 readTimestampMs 0 readOffset 0 EndOffset 4 ClientCommitOffset 0 committedOffset 0 Guid e69c694f-5e485752-456a9495-d7130ea6
2025-11-03T16:53:02.505822Z node 12 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:53:02.505896Z node 12 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:53:02.506065Z node 12 :PERSQUEUE DEBUG: partition_read.cpp:880: [72075186224037892][Partition][0][StateIdle] read cookie 4 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 partno 0 count 4 size 420 endOffset 4 max time lag 0ms effective offset 0
2025-11-03T16:53:02.506740Z node 12 :PERSQUEUE DEBUG: partition_read.cpp:1105: [72075186224037892][Partition][0][StateIdle] read cookie 4 added 2 blobs, size 569 count 4 last offset 1, current partition end offset: 4
2025-11-03T16:53:02.506769Z node 12 :PERSQUEUE DEBUG: partition_read.cpp:1121: [72075186224037892][Partition][0][StateIdle] Reading cookie 4. Send blob request.
2025-11-03T16:53:02.506835Z node 12 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 0 partno 0 count 1 parts_count 0 source 1 size 175 accessed 1 times before, last time 2025-11-03T16:52:57.000000Z
2025-11-03T16:53:02.506857Z node 12 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 1 partno 0 count 3 parts_count 0 source 1 size 394 accessed 0 times before, last time 2025-11-03T16:52:57.000000Z
2025-11-03T16:53:02.506910Z node 12 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 4. All 2 blobs are from cache.
2025-11-03T16:53:02.506980Z node 12 :PERSQUEUE DEBUG: partition_read.cpp:572: FormAnswer for 2 blobs
2025-11-03T16:53:02.507207Z node 12 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 0 totakecount 1 count 1 size 155 from pos 0 cbcount 1
2025-11-03T16:53:02.507442Z node 12 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 1 totakecount 3 count 3 size 374 from pos 0 cbcount 3
2025-11-03T16:53:02.507605Z node 12 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-03T16:53:02.508192Z node 12 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 0 suffix '63'
2025-11-03T16:53:02.508231Z node 12 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 1 partno 0 count 3 parts 0 suffix '63'
2025-11-03T16:53:02.511141Z :DEBUG: [/Root] [/Root] [7deba008-dcfd4111-f2d8fc1e-a5f1a7d2] [null] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:53:02.511511Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 0 (0-3)
2025-11-03T16:53:02.509523Z node 11 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_11_1_17048185214180259351_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 4 Result { Offset: 0 Data: "... 98 bytes ..." SourceId: "\000test-message-group-id" SeqNo: 1 WriteTimestampMS: 1762188777332 CreateTimestampMS: 1762188777319 UncompressedSize: 7 PartitionKey: "" ExplicitHash: "" } Result { Offset: 1 Data: "... 91 bytes ..." SourceId: "\000test-message-group-id" SeqNo: 2 WriteTimestampMS: 1762188777436 CreateTimestampMS: 1762188777319 UncompressedSize: 0 PartitionKey: "" ExplicitHash: "" } Result { Offset: 2 Data: "... 98 bytes ..." SourceId: "\000test-message-group-id" SeqNo: 3 WriteTimestampMS: 1762188777437 CreateTimestampMS: 1762188777319 UncompressedSize: 7 PartitionKey: "" ExplicitHash: "" } Result { Offset: 3 Data: "... 71 bytes ..." SourceId: "\000test-message-group-id" SeqNo: 4 WriteTimestampMS: 1762188777437 CreateTimestampMS: 1762188777319 UncompressedSize: 0 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 2 SizeLag: 18446744073709551388 RealReadOffset: 3 WaitQuotaTimeMs: 0 EndOffset: 4 StartOffset: 0 } Cookie: 0 }
2025-11-03T16:53:02.509800Z node 11 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_11_1_17048185214180259351_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 1 from offset 4
2025-11-03T16:53:02.509857Z node 11 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_11_1_17048185214180259351_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 4 ReadOffset 4 ReadGuid e69c694f-5e485752-456a9495-d7130ea6 has messages 1
2025-11-03T16:53:02.511691Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (0-0)
2025-11-03T16:53:02.510008Z node 11 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_11_1_17048185214180259351_v1 read done: guid# e69c694f-5e485752-456a9495-d7130ea6, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 549
2025-11-03T16:53:02.511748Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 0} (1-1)
2025-11-03T16:53:02.510038Z node 11 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_11_1_17048185214180259351_v1 response to read: guid# e69c694f-5e485752-456a9495-d7130ea6
2025-11-03T16:53:02.511782Z :DEBUG: [/Root] Take Data. Partition 0. Read: {2, 0} (2-2)
2025-11-03T16:53:02.510323Z node 11 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_11_1_17048185214180259351_v1 Process answer. Aval parts: 0
2025-11-03T16:53:02.511811Z :DEBUG: [/Root] Take Data. Partition 0. Read: {2, 1} (3-3)
2025-11-03T16:53:02.511866Z :DEBUG: [/Root] [/Root] [7deba008-dcfd4111-f2d8fc1e-a5f1a7d2] [null] The application data is transferred to the client. Number of messages 4, size 14 bytes
2025-11-03T16:53:02.512084Z :INFO: [/Root] [/Root] [7deba008-dcfd4111-f2d8fc1e-a5f1a7d2] Closing read session. Close timeout: 0.000000s
2025-11-03T16:53:02.512162Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:test-topic:0:1:3:0
2025-11-03T16:53:02.512214Z :INFO: [/Root] [/Root] [7deba008-dcfd4111-f2d8fc1e-a5f1a7d2] Counters: { Errors: 0 CurrentSessionLifetimeMs: 59 BytesRead: 14 MessagesRead: 4 BytesReadCompressed: 74 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-11-03T16:53:02.512322Z :NOTICE: [/Root] [/Root] [7deba008-dcfd4111-f2d8fc1e-a5f1a7d2] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Close with zero timeout " }
2025-11-03T16:53:02.512365Z :DEBUG: [/Root] [/Root] [7deba008-dcfd4111-f2d8fc1e-a5f1a7d2] [null] Abort session to cluster
2025-11-03T16:53:02.512863Z :NOTICE: [/Root] [/Root] [7deba008-dcfd4111-f2d8fc1e-a5f1a7d2] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
2025-11-03T16:53:02.513056Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|21f8be36-ac0600f6-f82f1257-ff053958_0] Write session: close. Timeout = 0 ms
2025-11-03T16:53:02.513090Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|21f8be36-ac0600f6-f82f1257-ff053958_0] Write session will now close
2025-11-03T16:53:02.513151Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|21f8be36-ac0600f6-f82f1257-ff053958_0] Write session: aborting
2025-11-03T16:53:02.513574Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|21f8be36-ac0600f6-f82f1257-ff053958_0] Write session: gracefully shut down, all writes complete
2025-11-03T16:53:02.513630Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|21f8be36-ac0600f6-f82f1257-ff053958_0] Write session: destroy
2025-11-03T16:53:02.521098Z node 11 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_11_1_17048185214180259351_v1 grpc read done: success# 1, data# { read { } }
2025-11-03T16:53:02.541783Z node 11 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: test-message-group-id|21f8be36-ac0600f6-f82f1257-ff053958_0 grpc read done: success: 0 data: 
2025-11-03T16:53:02.541818Z node 11 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 2 sessionId: test-message-group-id|21f8be36-ac0600f6-f82f1257-ff053958_0 grpc read failed
2025-11-03T16:53:02.541857Z node 11 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 2 sessionId: test-message-group-id|21f8be36-ac0600f6-f82f1257-ff053958_0 grpc closed
2025-11-03T16:53:02.541889Z node 11 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2 sessionId: test-message-group-id|21f8be36-ac0600f6-f82f1257-ff053958_0 is DEAD
2025-11-03T16:53:02.543447Z node 12 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [11:7568543162742946462:2480] destroyed
2025-11-03T16:53:02.543543Z node 12 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-11-03T16:53:02.543611Z node 12 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:53:02.543652Z node 12 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:53:02.543673Z node 12 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:53:02.544282Z node 12 :PERSQUEUE DEBUG: pq_impl.cpp:2258: [PQ: 72075186224037892] Destroy direct read session shared/user_11_1_17048185214180259351_v1
2025-11-03T16:53:02.544336Z node 12 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [11:7568543188512750527:2541] destroyed
2025-11-03T16:53:02.544398Z node 12 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_11_1_17048185214180259351_v1
2025-11-03T16:53:02.542783Z node 11 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-11-03T16:53:02.542913Z node 11 :PQ_READ_PROXY INFO: read_session_actor.cpp:92: session cookie 1 consumer shared/user session shared/user_11_1_17048185214180259351_v1 grpc closed
2025-11-03T16:53:02.542952Z node 11 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 1 consumer shared/user session shared/user_11_1_17048185214180259351_v1 is DEAD
2025-11-03T16:53:02.545376Z node 11 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1659: [72075186224037893][rt3.dc1--test-topic] pipe [11:7568543188512750516:2534] disconnected.
2025-11-03T16:53:02.545412Z node 11 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1670: [72075186224037893][rt3.dc1--test-topic] pipe [11:7568543188512750516:2534] disconnected; active server actors: 1
2025-11-03T16:53:02.545437Z node 11 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1679: [72075186224037893][rt3.dc1--test-topic] pipe [11:7568543188512750516:2534] client user disconnected session shared/user_11_1_17048185214180259351_v1
2025-11-03T16:53:02.547388Z node 12 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:53:02.547435Z node 12 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:53:02.547475Z node 12 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:53:02.652110Z node 12 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:53:02.652151Z node 12 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:53:02.652170Z node 12 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:53:02.756089Z node 12 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:53:02.756132Z node 12 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:53:02.756153Z node 12 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:53:02.856701Z node 12 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:53:02.856739Z node 12 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:53:02.856759Z node 12 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:53:03.098213Z node 11 :KQP_EXECUTER ERROR: kqp_executer_impl.h:1006: ActorId: [11:7568543192807717840:2532] TxId: 281474976715681. Ctx: { TraceId: 01k95a5tv5ffa8g9hkjm0kz661, Database: /Root, SessionId: ydb://session/3?node_id=11&id=NGVjNmVmM2ItNTU4YmM1MDAtN2QxZTI0NWQtNGI1MTk2Mjc=, PoolId: default}. UNAVAILABLE: Failed to send EvStartKqpTasksRequest because node is unavailable: 12
2025-11-03T16:53:03.098355Z node 11 :KQP_COMPUTE ERROR: dq_compute_actor_impl.h:1210: SelfId: [11:7568543192807717849:2532], TxId: 281474976715681, task: 3. Ctx: { CheckpointId : .  TraceId : 01k95a5tv5ffa8g9hkjm0kz661.  CustomerSuppliedId : .  RunScriptActorId : [0:0:0].  PoolId : default.  SessionId : ydb://session/3?node_id=11&id=NGVjNmVmM2ItNTU4YmM1MDAtN2QxZTI0NWQtNGI1MTk2Mjc=.  CurrentExecutionId : .  Database : /Root.  DatabaseId : /Root. }. Handle abort execution event from: [11:7568543192807717840:2532], status: UNAVAILABLE, reason: { <main>: Error: Terminate execution }
2025-11-03T16:53:05.386479Z :TestReorderedExecutor INFO: Random seed for debugging is 1762188785386459
2025-11-03T16:53:06.230109Z node 13 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[13:7568543207681116924:2144];send_to=[0:7307199536658146131:7762515];
2025-11-03T16:53:06.231628Z node 13 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
2025-11-03T16:53:06.315757Z node 13 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
test_client.cpp: SetPath # /home/runner/.ya/build/build_root/7jz3/001974/r3tmp/tmpmoiFdR/pdisk_1.dat
2025-11-03T16:53:06.323952Z node 13 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-11-03T16:53:06.356700Z node 14 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-11-03T16:53:06.378471Z node 14 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-11-03T16:53:06.378626Z node 14 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=incorrect path status: LookupError;
2025-11-03T16:53:06.490131Z node 13 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
2025-11-03T16:53:06.504108Z node 13 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-11-03T16:53:06.521500Z node 13 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(13, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-11-03T16:53:06.521615Z node 13 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(13, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-11-03T16:53:06.525024Z node 13 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(14, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-11-03T16:53:06.525122Z node 13 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(14, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-11-03T16:53:06.529273Z node 13 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(13, (0,0,0,0)) VolatileState: Connecting -> Connected
2025-11-03T16:53:06.530811Z node 13 :HIVE WARN: hive_impl.cpp:811: HIVE#72057594037968897 Handle TEvInterconnect::TEvNodeConnected, NodeId 14 Cookie 14
2025-11-03T16:53:06.531704Z node 13 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(14, (0,0,0,0)) VolatileState: Connecting -> Connected
TServer::EnableGrpc on GrpcPort 14592, node 13
2025-11-03T16:53:06.580181Z node 14 :BS_NODE WARN: {NWDC01@distconf.cpp:397} StateFunc too long Type# 268639238 Duration# 0.012103s
2025-11-03T16:53:06.737002Z node 14 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-11-03T16:53:06.778786Z node 13 :NET_CLASSIFIER WARN: net_classifier.cpp:190: distributable config is empty, broken or outdated, will use file: /home/runner/.ya/build/build_root/7jz3/001974/r3tmp/yandex0ZsLzt.tmp
2025-11-03T16:53:06.778820Z node 13 :NET_CLASSIFIER WARN: net_classifier.cpp:196: will try to initialize from file: /home/runner/.ya/build/build_root/7jz3/001974/r3tmp/yandex0ZsLzt.tmp
2025-11-03T16:53:06.779180Z node 13 :NET_CLASSIFIER WARN: net_classifier.cpp:202: successfully initialized from file: /home/runner/.ya/build/build_root/7jz3/001974/r3tmp/yandex0ZsLzt.tmp
2025-11-03T16:53:06.779378Z node 13 :NET_CLASSIFIER ERROR: net_classifier.cpp:228: got bad distributable configuration
2025-11-03T16:53:06.836935Z INFO: TTestServer started on Port 25736 GrpcPort 14592
2025-11-03T16:53:06.959870Z node 13 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
TClient is connected to server localhost:25736
PQClient connected to localhost:14592
WaitRootIsUp 'Root'...
TClient::Ls request: Root
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "Root"
    PathId: 1
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 1
    CreateStep: 0
    ParentPathId: 1
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 1
      SubDomainVersion: 0
      SecurityStateVersion: 0
    }
    ChildrenExist: false
  }
  Children {
    Name: ".sys"
    PathId: 18446744073709551615
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 0
    CreateStep: 0
    ParentPathId: 18446744073709551615
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 0
      Pl...
(TRUNCATED)
WaitRootIsUp 'Root' success.
2025-11-03T16:53:07.160687Z node 13 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpAlterSubDomain, opId: 281474976710657:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_alter_subdomain.cpp:311)
waiting...
waiting...
2025-11-03T16:53:07.232414Z node 13 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
waiting...
waiting...
2025-11-03T16:53:07.336119Z node 14 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-11-03T16:53:11.217587Z node 13 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[13:7568543207681116924:2144];send_to=[0:7307199536658146131:7762515];
2025-11-03T16:53:11.217674Z node 13 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
2025-11-03T16:53:12.814999Z node 14 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [14:7568543234335104916:2302], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-03T16:53:12.815087Z node 14 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [14:7568543234335104950:2305], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-03T16:53:12.815157Z node 14 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-03T16:53:12.818856Z node 14 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [14:7568543234335104954:2307], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-03T16:53:12.818963Z node 14 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-03T16:53:12.827003Z node 13 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateResourcePool, opId: 281474976720657:3, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_resource_pool.cpp:179)
2025-11-03T16:53:12.884687Z node 14 :KQP_WORKLOAD_SERVICE WARN: helpers.h:73: [WorkloadService] [TPoolCreatorActor] ActorId: [14:7568543234335104953:2306], DatabaseId: /Root, PoolId: default, Scheduled retry for error: { <main>: Error: Transaction 281474976720657 completed, doublechecking }
2025-11-03T16:53:12.964499Z node 14 :TX_PROXY ERROR: schemereq.cpp:593: Actor# [14:7568543234335104983:2147] txid# 281474976720658, issues: { message: "Check failed: path: \'/Root/.metadata/workload_manager/pools/default\', error: path exist, request accepts it (id: [OwnerId: 72057594046644480, LocalPathId: 8], type: EPathTypeResourcePool, state: EPathStateNoChanges)" severity: 1 }
2025-11-03T16:53:13.047386Z node 14 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:570: Compilation failed, self: [14:7568543234335104998:2311], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-11-03T16:53:13.054305Z node 14 :KQP_SESSION WARN: kqp_session_actor.cpp:2506: SessionId: ydb://session/3?node_id=14&id=ZDYyYjEyY2EtZWUwNDYxMWUtYjI0OGI4OWItOTYxYjZlODM=, ActorId: [14:7568543234335104912:2299], ActorState: ExecuteState, TraceId: 01k95a64z94h0dajaxc7qg6m8x, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-11-03T16:53:13.055058Z node 14 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-11-03T16:53:13.544543Z node 13 :KQP_PROXY ERROR: kqp_proxy_service.cpp:1316: TraceId: "01k95a5zm0aw66vsneab4jejxm", Request deadline has expired for 1.227524s seconds
2025-11-03T16:53:13.633618Z node 13 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710661:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:690)
2025-11-03T16:53:13.635036Z node 13 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:570: Compilation failed, self: [13:7568543237745889021:2342], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-11-03T16:53:13.635449Z node 13 :KQP_SESSION WARN: kqp_session_actor.cpp:2506: SessionId: ydb://session/3?node_id=13&id=ODBiMjcxYTYtZWU0N2ZkYzctMTM0ZDkzOWEtN2FmYWIzZWY=, ActorId: [13:7568543237745888970:2333], ActorState: ExecuteState, TraceId: 01k95a65pm7m9hm344hzvw53a8, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-11-03T16:53:13.635933Z node 13 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-11-03T16:53:13.872934Z node 13 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710662:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:690)
2025-11-03T16:53:14.136932Z node 14 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:570: Compilation failed, self: [14:7568543242925039686:2324], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:5:17: Error: At function: KiReadTable!
        <main>:5:17: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Versions]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-11-03T16:53:14.139127Z node 14 :KQP_SESSION WARN: kqp_session_actor.cpp:2506: SessionId: ydb://session/3?node_id=14&id=MzZjNzY1MTktOGNkMTAyNTctODYxYWZlZDktNjA0NTczM2E=, ActorId: [14:7568543242925039679:2320], ActorState: ExecuteState, TraceId: 01k95a666k4nngv108ehr4a9ps, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-11-03T16:53:14.139824Z node 14 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 5 column: 17 } message: "At function: KiReadTable!" end_position { row: 5 column: 17 } severity: 1 issues { position { row: 5 column: 17 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Versions]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 5 column: 17 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-11-03T16:53:14.232956Z node 13 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710663:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:690)
=== Init DC: UPSERT INTO `/Root/PQ/Config/V2/Cluster` (name, balancer, local, enabled, weight) VALUES ("dc1", "localhost:14592", true, true, 1000);
2025-11-03T16:53:14.880963Z node 13 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976710664. Ctx: { TraceId: 01k95a66pe3601pr956rzjdv14, Database: , SessionId: ydb://session/3?node_id=13&id=NGEyMWYwM2EtMzIwOTFhODYtY2RjYWQ0YjgtMTM5NjZlOGM=, PoolId: default, DatabaseId: /Root}. Database not set, use /Root
=== CheckClustersList. Subcribe to ClusterTracker from [13:7568543242040856739:2990] 
2025-11-03T16:53:21.448094Z node 13 :FLAT_TX_SCHEMESHARD WARN: schemeshard_impl.cpp:7727: Cannot get console configs
2025-11-03T16:53:21.448132Z node 13 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
=== CheckClustersList. Ok
2025-11-03T16:53:24.032287Z node 13 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710669:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:690)
waiting...
PQ Client: create topic: rt3.dc1--test-topic with 1 partitions
CallPersQueueGRPC request to localhost:14592
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-11-03T16:53:24.207603Z node 13 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
CallPersQueueGRPC request to localhost:14592
MetaRequest {
  CmdCreateTopic {
    Topic: "rt3.dc1--test-topic"
    NumPartitions: 1
    Config {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
  }
}
CallPersQueueGRPC response:
Status: 129
ProxyErrorCode: 53
SchemeStatus: 1
FlatTxId {
  TxId: 281474976710670
  SchemeShardTabletId: 72057594046644480
  PathId: 13
}
ErrorCode: OK
AddTopic: rt3.dc1--test-topic
===Run query:``DECLARE $version as Int64; DECLARE $path AS Utf8; DECLARE $cluster as Utf8; UPSERT INTO `/Root/PQ/Config/V2/Topics` (path, dc) VALUES ($path, $cluster); UPSERT INTO `/Root/PQ/Config/V2/Versions` (name, version) VALUES ("Topics", $version);`` with topic = test-topic, dc = dc1
2025-11-03T16:53:24.291585Z node 13 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1655: [72075186224037893][] pipe [13:7568543284990530144:3274] connected; active server actors: 1
2025-11-03T16:53:24.291862Z node 13 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1519: [72075186224037893][rt3.dc1--test-topic] updating configuration. Deleted partitions []. Added partitions [0]
2025-11-03T16:53:24.296082Z node 13 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:971: [72075186224037893][rt3.dc1--test-topic] Discovered subdomain [OwnerId: 72057594046644480, LocalPathId: 1] state, outOfSpace = 0 at RB 72075186224037893
2025-11-03T16:53:24.300057Z node 13 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:140: [72075186224037893][rt3.dc1--test-topic] BALANCER INIT DONE for rt3.dc1--test-topic: (0, 72075186224037892) 
2025-11-03T16:53:24.323609Z node 14 :PERSQUEUE DEBUG: pq_impl.cpp:2960: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-11-03T16:53:24.337697Z node 14 :PERSQUEUE DEBUG: pq_impl.cpp:2992: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-11-03T16:53:24.338132Z node 14 :PERSQUEUE DEBUG: pq_impl.cpp:787: [PQ: 72075186224037892] no config, start with empty partitions and default config
2025-11-03T16:53:24.338178Z node 14 :PERSQUEUE NOTICE: pq_impl.cpp:913: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-11-03T16:53:24.338238Z node 14 :PERSQUEUE INFO: pq_impl.cpp:612: [PQ: 72075186224037892] doesn't have tx writes info
2025-11-03T16:53:24.340398Z node 14 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [13:7568543284990530188:2451], now have 1 active actors on pipe
2025-11-03T16:53:24.340436Z node 14 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [13:7568543284990530143:3273], now have 1 active actors on pipe
2025-11-03T16:53:24.341443Z node 14 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-03T16:53:24.340271Z node 13 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:404: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 14, Generation 1
2025-11-03T16:53:24.360202Z node 14 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-03T16:53:24.396785Z node 14 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [13:7568543284990530227:3334], now have 1 active actors on pipe
2025-11-03T16:53:24.398534Z node 14 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-03T16:53:24.404080Z node 14 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-03T16:53:24.405334Z node 14 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-11-03T16:53:24.405400Z node 14 :PERSQUEUE DEBUG: partition.cpp:1312: [72075186224037892][Partition][0][StateInit] HandleOnInit TEvPQ::TEvProposePartitionConfig
2025-11-03T16:53:24.405791Z node 14 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-11-03T16:53:24.406048Z node 14 :PERSQUEUE INFO: partition_init.cpp:1101: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [14:7568543285874713024:2396]
2025-11-03T16:53:24.414909Z node 14 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-11-03T16:53:24.414956Z node 14 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-11-03T16:53:24.414994Z node 14 :PERSQUEUE INFO: partition.cpp:707: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1 [14:7568543285874713024:2396]
2025-11-03T16:53:24.415030Z node 14 :PERSQUEUE DEBUG: partition.cpp:727: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 0 Head Offset 0 PartNo 0 PackedSize 0 count 0 nextOffset 0 batches 0
2025-11-03T16:53:24.415075Z node 14 :PERSQUEUE DEBUG: partition_mlp.cpp:83: [72075186224037892][Partition][0][StateIdle] Initializing MLP Consumers: 0
2025-11-03T16:53:24.416657Z node 14 :PERSQUEUE DEBUG: partition.cpp:4273: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 1
2025-11-03T16:53:24.416704Z node 14 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:53:24.416823Z node 14 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:53:24.416839Z node 14 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-03T16:53:24.416873Z node 14 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-11-03T16:53:24.416893Z node 14 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-11-03T16:53:24.416912Z node 14 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:53:24.416928Z node 14 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-11-03T16:53:24.416967Z node 14 :PERSQUEUE DEBUG: partition_read.cpp:923: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-11-03T16:53:24.417024Z node 14 :PERSQUEUE DEBUG: partition_mlp.cpp:60: [72075186224037892][Partition][0][StateIdle] Process MLP pending events. Count 0
2025-11-03T16:53:24.417785Z node 14 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-03T16:53:24.417956Z node 14 :PERSQUEUE DEBUG: partition_compaction.cpp:183: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:53:24.426019Z node 14 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-03T16:53:24.426218Z node 14 :PERSQUEUE DEBUG: partition.cpp:1416: [72075186224037892][Partition][0][StateIdle] Handle TEvPQ::TEvTxCommit Step 1762188804425, TxId 281474976710670
2025-11-03T16:53:24.426252Z node 14 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-11-03T16:53:24.426272Z node 14 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:53:24.426460Z node 14 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:53:24.426782Z node 14 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-03T16:53:24.432154Z node 14 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-03T16:53:24.432400Z node 14 :PERSQUEUE DEBUG: partition_mlp.cpp:83: [72075186224037892][Partition][0][StateIdle] Initializing MLP Consumers: 0
2025-11-03T16:53:24.432565Z node 14 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-11-03T16:53:24.432601Z node 14 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:53:24.432618Z node 14 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:53:24.432636Z node 14 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:53:24.432683Z node 14 :PERSQUEUE DEBUG: partition_compaction.cpp:183: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:53:24.433137Z node 14 :PERSQUEUE DEBUG: pq_impl.cpp:398: [PQ: 72075186224037892] Apply new config PartitionConfig { LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 } PartitionIds: 0 TopicName: "rt3.dc1--test-topic" Version: 0 LocalDC: true Codecs { Ids: 0 Ids: 1 Ids: 2 Codecs: "raw" Codecs: "gzip" Codecs: "lzop" } TopicPath: "/Root/PQ/rt3.dc1--test-topic" YcCloudId: "" YcFolderId: "" YdbDatabaseId: "" YdbDatabasePath: "/Root" Partitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } AllPartitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } Consumers { Name: "user" ReadFromTimestampsMs: 0 FormatVersion: 0 Version: 0 Generation: 0 } MonitoringProjectId: ""
2025-11-03T16:53:24.433293Z node 14 :PERSQUEUE NOTICE: pq_impl.cpp:913: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-11-03T16:53:24.433702Z node 14 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-03T16:53:24.449186Z node 14 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-03T16:53:24.449341Z node 14 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-03T16:53:24.455471Z node 14 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-03T16:53:24.514477Z node 14 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:53:24.514516Z node 14 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:53:24.514540Z node 14 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:53:24.527541Z node 13 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976710671. Ctx: { TraceId: 01k95a6g6r00mpkhpkf1awtb6p, Database: , SessionId: ydb://session/3?node_id=13&id=ZDE3NmEyMjUtZjBiM2VhNWMtY2RhYjQ1MmItMTk2NTA4NTM=, PoolId: default, DatabaseId: /Root}. Database not set, use /Root
===Query complete
TClient::Ls request: /Root/PQ/rt3.dc1--test-topic
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976710670
    CreateStep: 1762188804425
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts...
(TRUNCATED)
GetTopicVersionFromPath:  record Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976710670
    CreateStep: 1762188804425
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      YdbDatabasePath: "/Root"
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
    Partitions {
      PartitionId: 0
      TabletId: 72075186224037892
      Status: Active
    }
    AlterVersion: 1
    BalancerTabletID: 72075186224037893
    NextPartitionId: 1
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 1
      PlanResolution: 7
      Coordinators: 72057594046316545
      TimeCastBucketsPerMediator: 2
      Mediators: 72057594046382081
    }
    DomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    PathsInside: 12
    PathsLimit: 10000
    ShardsInside: 6
    ShardsLimit: 200000
    ResourcesDomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    DiskSpaceUsage {
      Tables {
        TotalSize: 1328
        DataSize: 1328
        IndexSize: 0
      }
      Topics {
        ReserveSize: 0
        AccountSize: 0
        DataSize: 0
        UsedReserveSize: 0
      }
    }
    PQPartitionsInside: 1
    PQPartitionsLimit: 1000000
    SchemeLimits {
      MaxDepth: 32
      MaxPaths: 10000
      MaxChildrenInDir: 100000
      MaxAclBytesSize: 10240
      MaxTableColumns: 200
      MaxTableColumnNameLength: 255
      MaxTableKeyColumns: 30
      MaxTableIndices: 20
      MaxShards: 200000
      MaxShardsInPath: 35000
      MaxConsistentCopyTargets: 10000
      MaxPathElementLength: 255
      ExtraPathSymbolsAllowed: "!\"#$%&\'()*+,-.:;<=>?@[\\]^_`{|}~"
      MaxPQPartitions: 1000000
      MaxTableCdcStreams: 5
      MaxExports: 10
      MaxImports: 10
      MaxColumnTableColumns: 10000
    }
  }
}
Path: "/Root/PQ/rt3.dc1--test-topic"
 name rt3.dc1--test-topic version1
CallPersQueueGRPC request to localhost:14592
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-11-03T16:53:24.574185Z node 13 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
MetaResponse {
  CmdGetTopicMetadataResult {
    TopicInfo {
      Topic: "rt3.dc1--test-topic"
      NumPartitions: 1
      Config {
        PartitionConfig {
          LifetimeSeconds: 86400
          LowWatermark: 8388608
          SourceIdLifetimeSeconds: 86400
          WriteSpeedInBytesPerSecond: 20000000
          BurstSize: 20000000
          SourceIdMaxCounts: 6000000
        }
        Version: 1
        LocalDC: true
        Codecs {
          Ids: 0
          Ids: 1
          Ids: 2
          Codecs: "raw"
          Codecs: "gzip"
          Codecs: "lzop"
        }
        TopicPath: "/Root/PQ/rt3.dc1--test-topic"
        YdbDatabasePath: "/Root"
        Consumers {
          Name: "user"
          ReadFromTimestampsMs: 0
          FormatVersion: 0
          Version: 0
        }
      }
      ErrorCode: OK
    }
  }
}
=== Topic created, have version: 1
2025-11-03T16:53:24.605486Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: try to update token
2025-11-03T16:53:24.605966Z :INFO: [] MessageGroupId [src] SessionId [] Write session: Do CDS request
2025-11-03T16:53:24.606023Z :INFO: [] MessageGroupId [src] SessionId [] Start write session. Will connect to endpoint: localhost:14592
2025-11-03T16:53:24.614624Z node 14 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:53:24.614656Z node 14 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:53:24.614675Z node 14 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:53:24.639629Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src" }
2025-11-03T16:53:24.641728Z node 13 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-11-03T16:53:24.641773Z node 13 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1
2025-11-03T16:53:24.648861Z node 13 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src" }
2025-11-03T16:53:24.649037Z node 13 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1 topic: "test-topic" message_group_id: "src" from ipv6:[::1]:51898
2025-11-03T16:53:24.649076Z node 13 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51898 proto=v1  topic=test-topic durationSec=0
2025-11-03T16:53:24.649088Z node 13 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-11-03T16:53:24.651398Z node 13 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1 sessionId:  describe result for acl check
2025-11-03T16:53:24.651516Z node 13 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-11-03T16:53:24.651527Z node 13 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-11-03T16:53:24.651536Z node 13 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-11-03T16:53:24.651553Z node 13 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [13:7568543284990530309:2470] (SourceId=src, PreferedPartition=(NULL)) StartKqpSession
2025-11-03T16:53:24.654623Z node 13 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [13:7568543284990530309:2470] (SourceId=src, PreferedPartition=(NULL)) Select from the table
2025-11-03T16:53:24.714963Z node 14 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:53:24.715006Z node 14 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:53:24.715028Z node 14 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:53:24.815819Z node 14 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:53:24.815868Z node 14 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:53:24.815889Z node 14 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:53:24.887088Z node 13 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [13:7568543284990530309:2470] (SourceId=src, PreferedPartition=(NULL)) RequestPQRB
2025-11-03T16:53:24.891472Z node 13 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1655: [72075186224037893][rt3.dc1--test-topic] pipe [13:7568543284990530350:2470] connected; active server actors: 1
2025-11-03T16:53:24.891585Z node 13 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [13:7568543284990530309:2470] (SourceId=src, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=src
2025-11-03T16:53:24.891609Z node 13 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [13:7568543284990530309:2470] (SourceId=src, PreferedPartition=(NULL)) Update the table
2025-11-03T16:53:24.896176Z node 13 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1659: [72075186224037893][rt3.dc1--test-topic] pipe [13:7568543284990530350:2470] disconnected.
2025-11-03T16:53:24.896214Z node 13 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1670: [72075186224037893][rt3.dc1--test-topic] pipe [13:7568543284990530350:2470] disconnected; active server actors: 1
2025-11-03T16:53:24.896239Z node 13 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1695: [72075186224037893][rt3.dc1--test-topic] pipe [13:7568543284990530350:2470] disconnected no session
2025-11-03T16:53:24.916484Z node 14 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:53:24.916522Z node 14 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:53:24.916544Z node 14 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:53:25.020802Z node 14 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:53:25.020852Z node 14 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:53:25.020872Z node 14 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:53:25.121422Z node 14 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:53:25.121459Z node 14 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:53:25.121481Z node 14 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:53:25.161570Z node 13 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [13:7568543284990530309:2470] (SourceId=src, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-11-03T16:53:25.161629Z node 13 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [13:7568543284990530309:2470] (SourceId=src, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-11-03T16:53:25.161652Z node 13 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [13:7568543284990530309:2470] (SourceId=src, PreferedPartition=(NULL)) Start idle
2025-11-03T16:53:25.161695Z node 13 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-11-03T16:53:25.172527Z node 14 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [13:7568543289285497684:2470], now have 1 active actors on pipe
2025-11-03T16:53:25.173714Z node 13 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 14, Generation: 1
2025-11-03T16:53:25.175354Z node 14 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:53:25.175402Z node 14 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:53:25.175503Z node 14 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src|231f3216-1c1edbaf-2696a7a4-e4e8991c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src
2025-11-03T16:53:25.175550Z node 14 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:53:25.175580Z node 14 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:53:25.175597Z node 14 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-03T16:53:25.175642Z node 14 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:53:25.175686Z node 14 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-03T16:53:25.175767Z node 14 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-03T16:53:25.179722Z node 14 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:53:25.179766Z node 14 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:53:25.179859Z node 14 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-03T16:53:25.180545Z node 13 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1 partition: 0 MaxSeqNo: 0 sessionId: src|231f3216-1c1edbaf-2696a7a4-e4e8991c_0
2025-11-03T16:53:25.186196Z :INFO: [] MessageGroupId [src] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1762188805186 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-11-03T16:53:25.186365Z :INFO: [] MessageGroupId [src] SessionId [] Write session established. Init response: session_id: "src|231f3216-1c1edbaf-2696a7a4-e4e8991c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-11-03T16:53:25.193759Z :INFO: [] MessageGroupId [src] SessionId [src|231f3216-1c1edbaf-2696a7a4-e4e8991c_0] Write session: close. Timeout = 0 ms
2025-11-03T16:53:25.193839Z :INFO: [] MessageGroupId [src] SessionId [src|231f3216-1c1edbaf-2696a7a4-e4e8991c_0] Write session will now close
2025-11-03T16:53:25.193908Z :DEBUG: [] MessageGroupId [src] SessionId [src|231f3216-1c1edbaf-2696a7a4-e4e8991c_0] Write session: aborting
2025-11-03T16:53:25.194607Z :INFO: [] MessageGroupId [src] SessionId [src|231f3216-1c1edbaf-2696a7a4-e4e8991c_0] Write session: gracefully shut down, all writes complete
2025-11-03T16:53:25.194669Z :DEBUG: [] MessageGroupId [src] SessionId [src|231f3216-1c1edbaf-2696a7a4-e4e8991c_0] Write session: destroy
2025-11-03T16:53:25.196879Z node 13 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId: src|231f3216-1c1edbaf-2696a7a4-e4e8991c_0 grpc read done: success: 0 data: 
2025-11-03T16:53:25.196925Z node 13 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 1 sessionId: src|231f3216-1c1edbaf-2696a7a4-e4e8991c_0 grpc read failed
2025-11-03T16:53:25.197496Z node 13 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:824: session v1 closed cookie: 1 sessionId: src|231f3216-1c1edbaf-2696a7a4-e4e8991c_0
====TYdbPqTestRetryPolicy()
2025-11-03T16:53:25.200768Z :TestReorderedExecutor INFO: Enqueue message with sequence number 1
2025-11-03T16:53:25.200829Z :TestReorderedExecutor INFO: Enqueue message with sequence number 2
2025-11-03T16:53:25.197527Z node 13 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1 sessionId: src|231f3216-1c1edbaf-2696a7a4-e4e8991c_0 is DEAD
2025-11-03T16:53:25.198082Z node 13 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-11-03T16:53:25.200977Z node 14 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [13:7568543289285497684:2470] destroyed
2025-11-03T16:53:25.201031Z node 14 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-11-03T16:53:25.201099Z node 14 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:53:25.201123Z node 14 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:53:25.201138Z node 14 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:53:25.224522Z node 14 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:53:25.224562Z node 14 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:53:25.224585Z node 14 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:53:25.268140Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [] Write session: try to update token
2025-11-03T16:53:25.268480Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [] Write session: Do CDS request
2025-11-03T16:53:25.268530Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [] Do schedule cds request after 0 ms
2025-11-03T16:53:25.268630Z :TestReorderedExecutor INFO: Wait for writer event
2025-11-03T16:53:25.271147Z :INFO: [/Root] MessageGroupId [test-message-group-id] Running cds request ms
2025-11-03T16:53:25.292208Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [] Got CDS response: 
write_sessions_clusters { clusters { endpoint: "localhost:14592" name: "dc1" available: true } primary_cluster_selection_reason: CLIENT_LOCATION } version: 1
2025-11-03T16:53:25.292286Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [] Start write session. Will connect to endpoint: localhost:14592
2025-11-03T16:53:25.328376Z node 14 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:53:25.332115Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [] Write session: send init request: init_request { topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" }
2025-11-03T16:53:25.328421Z node 14 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:53:25.328439Z node 14 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:53:25.333581Z node 13 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-11-03T16:53:25.333624Z node 13 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2
2025-11-03T16:53:25.334258Z node 13 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" }
2025-11-03T16:53:25.334491Z node 13 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2 topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" from ipv6:[::1]:51914
2025-11-03T16:53:25.334521Z node 13 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51914 proto=v1  topic=test-topic durationSec=0
2025-11-03T16:53:25.334537Z node 13 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-11-03T16:53:25.337898Z node 13 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2 sessionId:  describe result for acl check
2025-11-03T16:53:25.338126Z node 13 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-11-03T16:53:25.338150Z node 13 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-11-03T16:53:25.338169Z node 13 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-11-03T16:53:25.338195Z node 13 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [13:7568543289285497707:2495] (SourceId=test-message-group-id, PreferedPartition=(NULL)) StartKqpSession
2025-11-03T16:53:25.342894Z node 13 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [13:7568543289285497707:2495] (SourceId=test-message-group-id, PreferedPartition=(NULL)) Select from the table
2025-11-03T16:53:25.368453Z node 13 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [13:7568543289285497707:2495] (SourceId=test-message-group-id, PreferedPartition=(NULL)) RequestPQRB
2025-11-03T16:53:25.369767Z node 13 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1655: [72075186224037893][rt3.dc1--test-topic] pipe [13:7568543289285497726:2495] connected; active server actors: 1
2025-11-03T16:53:25.370555Z node 13 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [13:7568543289285497707:2495] (SourceId=test-message-group-id, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=test-message-group-id
2025-11-03T16:53:25.370600Z node 13 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [13:7568543289285497707:2495] (SourceId=test-message-group-id, PreferedPartition=(NULL)) Update the table
2025-11-03T16:53:25.372239Z node 13 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1659: [72075186224037893][rt3.dc1--test-topic] pipe [13:7568543289285497726:2495] disconnected.
2025-11-03T16:53:25.372278Z node 13 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1670: [72075186224037893][rt3.dc1--test-topic] pipe [13:7568543289285497726:2495] disconnected; active server actors: 1
2025-11-03T16:53:25.372312Z node 13 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1695: [72075186224037893][rt3.dc1--test-topic] pipe [13:7568543289285497726:2495] disconnected no session
2025-11-03T16:53:25.384202Z node 13 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [13:7568543289285497707:2495] (SourceId=test-message-group-id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-11-03T16:53:25.384258Z node 13 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [13:7568543289285497707:2495] (SourceId=test-message-group-id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-11-03T16:53:25.384282Z node 13 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [13:7568543289285497707:2495] (SourceId=test-message-group-id, PreferedPartition=(NULL)) Start idle
2025-11-03T16:53:25.384329Z node 13 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-11-03T16:53:25.398907Z node 14 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [13:7568543289285497742:2495], now have 1 active actors on pipe
2025-11-03T16:53:25.399425Z node 13 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 14, Generation: 1
2025-11-03T16:53:25.399875Z node 14 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:53:25.399920Z node 14 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:53:25.400060Z node 14 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie test-message-group-id|83b7672-8de645ac-667dee07-aca1128f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner test-message-group-id
2025-11-03T16:53:25.400117Z node 14 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:53:25.400150Z node 14 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:53:25.400173Z node 14 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-03T16:53:25.400233Z node 14 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:53:25.400289Z node 14 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-03T16:53:25.400397Z node 14 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-03T16:53:25.402204Z node 13 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2 partition: 0 MaxSeqNo: 0 sessionId: test-message-group-id|83b7672-8de645ac-667dee07-aca1128f_0
2025-11-03T16:53:25.401589Z node 14 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:53:25.401632Z node 14 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:53:25.401740Z node 14 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-03T16:53:25.408172Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1762188805408 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-11-03T16:53:25.408322Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [] Write session established. Init response: session_id: "test-message-group-id|83b7672-8de645ac-667dee07-aca1128f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-11-03T16:53:25.412151Z :TestReorderedExecutor INFO: Got new continue token
2025-11-03T16:53:25.412244Z :TestReorderedExecutor INFO: [] Write messages with sequence numbers 1
2025-11-03T16:53:25.412318Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|83b7672-8de645ac-667dee07-aca1128f_0] Write 1 messages with Id from 1 to 1
2025-11-03T16:53:25.412422Z :TestReorderedExecutor INFO: Wait for writer event
2025-11-03T16:53:25.412459Z :TestReorderedExecutor INFO: Got new continue token
Enqueue task with id 12025-11-03T16:53:25.412526Z :TestReorderedExecutor INFO: [] Write messages with sequence numbers 2
2025-11-03T16:53:25.412588Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|83b7672-8de645ac-667dee07-aca1128f_0] Write 1 messages with Id from 2 to 2
Enqueue task with id 2
2025-11-03T16:53:25.412649Z :TestReorderedExecutor INFO: Wait for writer event
2025-11-03T16:53:25.412687Z :TestReorderedExecutor INFO: Got new continue token
2025-11-03T16:53:25.436373Z node 14 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:53:25.436425Z node 14 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:53:25.436454Z node 14 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:53:25.536190Z node 14 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:53:25.536237Z node 14 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:53:25.536259Z node 14 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:53:25.640176Z node 14 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:53:25.640213Z node 14 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:53:25.640233Z node 14 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:53:25.742316Z node 14 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:53:25.742352Z node 14 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:53:25.742373Z node 14 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:53:25.843733Z node 14 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:53:25.843781Z node 14 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:53:25.843801Z node 14 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:53:25.944731Z node 14 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:53:25.944772Z node 14 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:53:25.944795Z node 14 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:53:26.045365Z node 14 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:53:26.045405Z node 14 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:53:26.045428Z node 14 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:53:26.146188Z node 14 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:53:26.146228Z node 14 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:53:26.146251Z node 14 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
Got ok to execute task with id 2
Executing compression of 2
Compression of 2 Done
2025-11-03T16:53:26.246503Z node 14 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:53:26.246543Z node 14 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:53:26.246566Z node 14 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:53:26.346819Z node 14 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:53:26.346864Z node 14 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:53:26.346888Z node 14 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:53:26.404985Z node 13 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [13:7568543289285497707:2495] (SourceId=test-message-group-id, PreferedPartition=(NULL)) Update the table
2025-11-03T16:53:26.448295Z node 14 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:53:26.448337Z node 14 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:53:26.448362Z node 14 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:53:26.553283Z node 14 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:53:26.553319Z node 14 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:53:26.553340Z node 14 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:53:26.660094Z node 14 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:53:26.660141Z node 14 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:53:26.660165Z node 14 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:53:26.761751Z node 14 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:53:26.761791Z node 14 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:53:26.761824Z node 14 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:53:26.868060Z node 14 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:53:26.868101Z node 14 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:53:26.868121Z node 14 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:53:26.890250Z node 13 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [13:7568543289285497707:2495] (SourceId=test-message-group-id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=1 Status=SUCCESS
2025-11-03T16:53:26.890287Z node 13 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [13:7568543289285497707:2495] (SourceId=test-message-group-id, PreferedPartition=(NULL)) Start idle
2025-11-03T16:53:26.969378Z node 14 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:53:26.969420Z node 14 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:53:26.969445Z node 14 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:53:27.075290Z node 14 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:53:27.075328Z node 14 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:53:27.075348Z node 14 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:53:27.180093Z node 14 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:53:27.180137Z node 14 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:53:27.180158Z node 14 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
Waiting for writes to complete.
Got ok to execute task with id 1
Executing compression of 1
2025-11-03T16:53:27.213925Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|83b7672-8de645ac-667dee07-aca1128f_0] Write session: try to update token
2025-11-03T16:53:27.214011Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|83b7672-8de645ac-667dee07-aca1128f_0] Send 2 message(s) (0 left), first sequence number is 1
Compression of 1 Done
2025-11-03T16:53:27.224231Z node 13 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: test-message-group-id|83b7672-8de645ac-667dee07-aca1128f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:53:27.224547Z node 13 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:53:27.228348Z node 14 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:53:27.228395Z node 14 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:53:27.228479Z node 14 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-11-03T16:53:27.228883Z node 13 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:53:27.229372Z node 14 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:53:27.229403Z node 14 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:53:27.229804Z node 14 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0test-message-group-id' SeqNo: 1 partNo : 0 messageNo: 1 size 98 offset: -1
2025-11-03T16:53:27.229836Z node 14 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0test-message-group-id' SeqNo: 2 partNo : 0 messageNo: 1 size 98 offset: -1
2025-11-03T16:53:27.229891Z node 14 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:53:27.229938Z node 14 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:53:27.229971Z node 14 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:53:27.229987Z node 14 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (2)
2025-11-03T16:53:27.230103Z node 14 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0test-message-group-id' seqNo 1 partNo 0
2025-11-03T16:53:27.231077Z node 14 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0test-message-group-id' seqNo 1 partNo 0 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 187 count 1 nextOffset 1 batches 1
2025-11-03T16:53:27.231135Z node 14 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0test-message-group-id' seqNo 2 partNo 0
2025-11-03T16:53:27.231171Z node 14 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0test-message-group-id' seqNo 2 partNo 0 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 342 count 2 nextOffset 2 batches 1
2025-11-03T16:53:27.231192Z node 14 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:53:27.231853Z node 14 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 0,2 HeadOffset 0 endOffset 0 curOffset 2 d0000000000_00000000000000000000_00000_0000000002_00000? size 321 WTime 1762188807223
2025-11-03T16:53:27.232066Z node 14 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-03T16:53:27.232218Z node 14 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 0 partNo 0 count 2 size 321
2025-11-03T16:53:27.244840Z node 14 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 0 count 2 size 321 actorID [14:7568543285874713003:2396]
2025-11-03T16:53:27.244913Z node 14 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-03T16:53:27.244986Z node 14 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 240 WriteNewSizeFromSupportivePartitions# 0
2025-11-03T16:53:27.245028Z node 14 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:53:27.245082Z node 14 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0test-message-group-id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 1, partNo: 0, Offset: 0 is stored on disk
2025-11-03T16:53:27.245110Z node 14 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:53:27.245139Z node 14 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0test-message-group-id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 2, partNo: 0, Offset: 1 is stored on disk
2025-11-03T16:53:27.245385Z node 14 :PERSQUEUE DEBUG: partition_read.cpp:923: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-11-03T16:53:27.245415Z node 14 :PERSQUEUE DEBUG: partition_read.cpp:965: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-11-03T16:53:27.245440Z node 14 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:53:27.245456Z node 14 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:53:27.245475Z node 14 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:53:27.245514Z node 14 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:53:27.245582Z node 14 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1  requestId: <none> cookie: 1
2025-11-03T16:53:27.245716Z node 14 :PERSQUEUE DEBUG: partition_read.cpp:880: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 partno 0 count 1 size 1024000 endOffset 2 max time lag 0ms effective offset 0
2025-11-03T16:53:27.246000Z node 14 :PERSQUEUE DEBUG: partition_read.cpp:1105: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 321 count 2 last offset 0, current partition end offset: 2
2025-11-03T16:53:27.246022Z node 14 :PERSQUEUE DEBUG: partition_read.cpp:1121: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-11-03T16:53:27.246073Z node 14 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 0 partno 0 count 2 parts_count 0 source 1 size 321 accessed 0 times before, last time 2025-11-03T16:53:27.000000Z
2025-11-03T16:53:27.246106Z node 14 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 3. All 1 blobs are from cache.
2025-11-03T16:53:27.246157Z node 14 :PERSQUEUE DEBUG: partition_read.cpp:572: FormAnswer for 1 blobs
2025-11-03T16:53:27.246449Z node 14 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 0 totakecount 2 count 2 size 301 from pos 0 cbcount 2
2025-11-03T16:53:27.246540Z node 14 :PERSQUEUE DEBUG: partition_read.cpp:1015: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1762188807223 queuesize 0 startOffset 0
2025-11-03T16:53:27.247683Z node 13 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:53:27.247348Z node 14 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 2 parts 0 suffix '63' size 321
2025-11-03T16:53:27.247432Z node 14 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 2 parts 0 suffix '63'
2025-11-03T16:53:27.248745Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|83b7672-8de645ac-667dee07-aca1128f_0] Write session got write response: sequence_numbers: 1 sequence_numbers: 2 offsets: 0 offsets: 1 already_written: false already_written: false write_statistics { persist_duration_ms: 20 }
2025-11-03T16:53:27.248817Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|83b7672-8de645ac-667dee07-aca1128f_0] Write session: acknoledged message 1
2025-11-03T16:53:27.248866Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|83b7672-8de645ac-667dee07-aca1128f_0] Write session: acknoledged message 2
2025-11-03T16:53:27.249812Z :TestReorderedExecutor DEBUG: Close writer (stop)
2025-11-03T16:53:27.249807Z :TestReorderedExecutor INFO: Wait for client write event loop to stop
2025-11-03T16:53:27.249880Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|83b7672-8de645ac-667dee07-aca1128f_0] Write session: close. Timeout = 0 ms
2025-11-03T16:53:27.249927Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|83b7672-8de645ac-667dee07-aca1128f_0] Write session will now close
2025-11-03T16:53:27.249974Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|83b7672-8de645ac-667dee07-aca1128f_0] Write session: aborting
2025-11-03T16:53:27.250496Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|83b7672-8de645ac-667dee07-aca1128f_0] Write session: gracefully shut down, all writes complete
2025-11-03T16:53:27.250538Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|83b7672-8de645ac-667dee07-aca1128f_0] Write session: destroy
2025-11-03T16:53:27.250662Z :TestReorderedExecutor DEBUG: Writer closed
2025-11-03T16:53:27.251384Z :TestReorderedExecutor INFO: Client write event loop stopped
2025-11-03T16:53:27.256231Z node 14 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [13:7568543289285497742:2495] destroyed
2025-11-03T16:53:27.256294Z node 14 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-11-03T16:53:27.256336Z node 14 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:53:27.256355Z node 14 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:53:27.256372Z node 14 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:53:27.254026Z node 13 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: test-message-group-id|83b7672-8de645ac-667dee07-aca1128f_0 grpc read done: success: 0 data: 
2025-11-03T16:53:27.254071Z node 13 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 2 sessionId: test-message-group-id|83b7672-8de645ac-667dee07-aca1128f_0 grpc read failed
2025-11-03T16:53:27.254135Z node 13 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 2 sessionId: test-message-group-id|83b7672-8de645ac-667dee07-aca1128f_0 grpc closed
2025-11-03T16:53:27.254170Z node 13 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2 sessionId: test-message-group-id|83b7672-8de645ac-667dee07-aca1128f_0 is DEAD
2025-11-03T16:53:27.255615Z node 13 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-11-03T16:53:27.288122Z node 14 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:53:27.288161Z node 14 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:53:27.288180Z node 14 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:53:27.389813Z node 14 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:53:27.389856Z node 14 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:53:27.389875Z node 14 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:53:27.495231Z node 14 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:53:27.495274Z node 14 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:53:27.495297Z node 14 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:53:27.596144Z node 14 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:53:27.596182Z node 14 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:53:27.596204Z node 14 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:53:28.117934Z node 13 :KQP_EXECUTER ERROR: kqp_executer_impl.h:1006: ActorId: [13:7568543302170399751:2510] TxId: 281474976710678. Ctx: { TraceId: 01k95a6jy4414vsnhydefrjyca, Database: /Root, SessionId: ydb://session/3?node_id=13&id=ZDJlMzcwZTItZGQ1NjkyZDktNjQxZWY0MDAtZDA0NmY4NGQ=, PoolId: default}. UNAVAILABLE: Failed to send EvStartKqpTasksRequest because node is unavailable: 14
2025-11-03T16:53:28.118136Z node 13 :KQP_COMPUTE ERROR: dq_compute_actor_impl.h:1210: SelfId: [13:7568543302170399760:2510], TxId: 281474976710678, task: 3. Ctx: { TraceId : 01k95a6jy4414vsnhydefrjyca.  CheckpointId : .  CustomerSuppliedId : .  RunScriptActorId : [0:0:0].  PoolId : default.  SessionId : ydb://session/3?node_id=13&id=ZDJlMzcwZTItZGQ1NjkyZDktNjQxZWY0MDAtZDA0NmY4NGQ=.  CurrentExecutionId : .  DatabaseId : /Root.  Database : /Root. }. Handle abort execution event from: [13:7568543302170399751:2510], status: UNAVAILABLE, reason: { <main>: Error: Terminate execution }
2025-11-03T16:53:31.730244Z :TestExecutorMemUsage INFO: Random seed for debugging is 1762188811730217
2025-11-03T16:53:32.608509Z node 15 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[15:7568543318972336574:2079];send_to=[0:7307199536658146131:7762515];
2025-11-03T16:53:32.620474Z node 15 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
2025-11-03T16:53:32.697894Z node 16 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[16:7568543317152571821:2087];send_to=[0:7307199536658146131:7762515];
2025-11-03T16:53:32.698767Z node 16 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
2025-11-03T16:53:32.710552Z node 15 :BS_NODE WARN: {NWDC01@distconf.cpp:397} StateFunc too long Type# 268639238 Duration# 0.027863s
test_client.cpp: SetPath # /home/runner/.ya/build/build_root/7jz3/001974/r3tmp/tmp3dQMEV/pdisk_1.dat
2025-11-03T16:53:32.840729Z node 15 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-11-03T16:53:32.841428Z node 15 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-11-03T16:53:32.848961Z node 16 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-11-03T16:53:32.884083Z node 16 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-11-03T16:53:33.065638Z node 16 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-11-03T16:53:33.168055Z node 15 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-11-03T16:53:33.279298Z node 15 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
2025-11-03T16:53:33.369468Z node 15 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(15, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-11-03T16:53:33.369605Z node 15 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(15, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-11-03T16:53:33.374808Z node 15 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(16, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-11-03T16:53:33.374930Z node 15 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(16, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-11-03T16:53:33.381475Z node 15 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(15, (0,0,0,0)) VolatileState: Connecting -> Connected
2025-11-03T16:53:33.387359Z node 15 :HIVE WARN: hive_impl.cpp:811: HIVE#72057594037968897 Handle TEvInterconnect::TEvNodeConnected, NodeId 16 Cookie 16
2025-11-03T16:53:33.389574Z node 15 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(16, (0,0,0,0)) VolatileState: Connecting -> Connected
TServer::EnableGrpc on GrpcPort 19899, node 15
2025-11-03T16:53:33.581589Z node 15 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-11-03T16:53:33.617898Z node 16 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-11-03T16:53:33.660222Z node 15 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-11-03T16:53:33.680445Z node 15 :NET_CLASSIFIER WARN: net_classifier.cpp:190: distributable config is empty, broken or outdated, will use file: /home/runner/.ya/build/build_root/7jz3/001974/r3tmp/yandexChQmDF.tmp
2025-11-03T16:53:33.680477Z node 15 :NET_CLASSIFIER WARN: net_classifier.cpp:196: will try to initialize from file: /home/runner/.ya/build/build_root/7jz3/001974/r3tmp/yandexChQmDF.tmp
2025-11-03T16:53:33.680694Z node 15 :NET_CLASSIFIER WARN: net_classifier.cpp:202: successfully initialized from file: /home/runner/.ya/build/build_root/7jz3/001974/r3tmp/yandexChQmDF.tmp
2025-11-03T16:53:33.680932Z node 15 :NET_CLASSIFIER ERROR: net_classifier.cpp:228: got bad distributable configuration
2025-11-03T16:53:33.755306Z INFO: TTestServer started on Port 27628 GrpcPort 19899
2025-11-03T16:53:33.800157Z node 16 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
TClient is connected to server localhost:27628
PQClient connected to localhost:19899
WaitRootIsUp 'Root'...
TClient::Ls request: Root
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "Root"
    PathId: 1
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 1
    CreateStep: 0
    ParentPathId: 1
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 1
      SubDomainVersion: 0
      SecurityStateVersion: 0
    }
    ChildrenExist: false
  }
  Children {
    Name: ".sys"
    PathId: 18446744073709551615
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 0
    CreateStep: 0
    ParentPathId: 18446744073709551615
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 0
      Pl...
(TRUNCATED)
WaitRootIsUp 'Root' success.
2025-11-03T16:53:34.501473Z node 15 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpAlterSubDomain, opId: 281474976715657:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_alter_subdomain.cpp:311)
waiting...
waiting...
waiting...
2025-11-03T16:53:34.625252Z node 15 :FLAT_TX_SCHEMESHARD WARN: schemeshard__notify.cpp:122: NotifyTxCompletion, unknown transaction, txId: 281474976715659, at schemeshard: 72057594046644480
waiting...
2025-11-03T16:53:37.610403Z node 15 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[15:7568543318972336574:2079];send_to=[0:7307199536658146131:7762515];
2025-11-03T16:53:37.610534Z node 15 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
2025-11-03T16:53:37.665990Z node 16 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[16:7568543317152571821:2087];send_to=[0:7307199536658146131:7762515];
2025-11-03T16:53:37.666085Z node 16 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
2025-11-03T16:53:41.146781Z node 15 :KQP_PROXY ERROR: kqp_proxy_service.cpp:1316: TraceId: "01k95a6tbt5y9ca82c9yp1dcbf", Request deadline has expired for 1.443772s seconds
2025-11-03T16:53:41.160505Z node 15 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [15:7568543357627043311:2339], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-03T16:53:41.160629Z node 15 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-03T16:53:41.160818Z node 15 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [15:7568543357627043323:2342], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-03T16:53:41.160983Z node 15 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [15:7568543357627043325:2343], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-03T16:53:41.161046Z node 15 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-03T16:53:41.166770Z node 15 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateResourcePool, opId: 281474976715661:3, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_resource_pool.cpp:179)
2025-11-03T16:53:41.184393Z node 15 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [15:7568543357627043359:2346], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-03T16:53:41.184799Z node 15 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-03T16:53:41.191750Z node 15 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [15:7568543357627043370:2348], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-03T16:53:41.191905Z node 15 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-03T16:53:41.243289Z node 15 :KQP_WORKLOAD_SERVICE WARN: helpers.h:73: [WorkloadService] [TPoolCreatorActor] ActorId: [15:7568543357627043327:2344], DatabaseId: /Root, PoolId: default, Scheduled retry for error: { <main>: Error: Transaction 281474976715661 completed, doublechecking }
2025-11-03T16:53:41.306883Z node 15 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976715662:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:690)
2025-11-03T16:53:41.325878Z node 15 :TX_PROXY ERROR: schemereq.cpp:593: Actor# [15:7568543357627043440:2725] txid# 281474976715663, issues: { message: "Check failed: path: \'/Root/.metadata/workload_manager/pools/default\', error: path exist, request accepts it (id: [OwnerId: 72057594046644480, LocalPathId: 8], type: EPathTypeResourcePool, state: EPathStateNoChanges)" severity: 1 }
2025-11-03T16:53:41.416909Z node 15 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:570: Compilation failed, self: [15:7568543357627043461:2356], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-11-03T16:53:41.420239Z node 15 :KQP_SESSION WARN: kqp_session_actor.cpp:2506: SessionId: ydb://session/3?node_id=15&id=ZGVmNGU1YTUtNjA4ZDU4OGEtNDA2MzFmMzktNDc1NzMyZjE=, ActorId: [15:7568543357627043292:2337], ActorState: ExecuteState, TraceId: 01k95a70n0329mt9ecqkqaftc9, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-11-03T16:53:41.420789Z node 15 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-11-03T16:53:41.568996Z node 15 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976715664:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:690)
2025-11-03T16:53:41.667065Z node 16 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:570: Compilation failed, self: [16:7568543355807277893:2316], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:5:17: Error: At function: KiReadTable!
        <main>:5:17: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Versions]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-11-03T16:53:41.668255Z node 16 :KQP_SESSION WARN: kqp_session_actor.cpp:2506: SessionId: ydb://session/3?node_id=16&id=ZTUxMjUxODYtN2UzMTFmNDAtNzhjMTI5ZTEtYjE0MzMxYTA=, ActorId: [16:7568543355807277858:2309], ActorState: ExecuteState, TraceId: 01k95a711r5p1jvwbk751sffqg, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-11-03T16:53:41.668885Z node 16 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 5 column: 17 } message: "At function: KiReadTable!" end_position { row: 5 column: 17 } severity: 1 issues { position { row: 5 column: 17 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Versions]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 5 column: 17 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-11-03T16:53:41.915898Z node 15 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976715665:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:690)
=== Init DC: UPSERT INTO `/Root/PQ/Config/V2/Cluster` (name, balancer, local, enabled, weight) VALUES ("dc1", "localhost:19899", true, true, 1000);
2025-11-03T16:53:42.354951Z node 15 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976715666. Ctx: { TraceId: 01k95a71kg37xgxsks0g7rwvpa, Database: , SessionId: ydb://session/3?node_id=15&id=ZDNlOTdhYTctNDQzN2YxNjktOTVlOTkyOC01NjEwYTljYQ==, PoolId: default, DatabaseId: /Root}. Database not set, use /Root
=== CheckClustersList. Subcribe to ClusterTracker from [15:7568543361922011130:3017] 
2025-11-03T16:53:48.164266Z node 15 :FLAT_TX_SCHEMESHARD WARN: schemeshard_impl.cpp:7727: Cannot get console configs
2025-11-03T16:53:48.164304Z node 15 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
=== CheckClustersList. Ok
2025-11-03T16:53:51.879836Z node 15 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976715671:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:690)
waiting...
PQ Client: create topic: rt3.dc1--test-topic with 1 partitions
CallPersQueueGRPC request to localhost:19899
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-11-03T16:53:52.151318Z node 15 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
CallPersQueueGRPC request to localhost:19899
MetaRequest {
  CmdCreateTopic {
    Topic: "rt3.dc1--test-topic"
    NumPartitions: 1
    Config {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
  }
}
CallPersQueueGRPC response:
Status: 129
ProxyErrorCode: 53
SchemeStatus: 1
FlatTxId {
  TxId: 281474976715672
  SchemeShardTabletId: 72057594046644480
  PathId: 13
}
ErrorCode: OK
AddTopic: rt3.dc1--test-topic
===Run query:``DECLARE $version as Int64; DECLARE $path AS Utf8; DECLARE $cluster as Utf8; UPSERT INTO `/Root/PQ/Config/V2/Topics` (path, dc) VALUES ($path, $cluster); UPSERT INTO `/Root/PQ/Config/V2/Versions` (name, version) VALUES ("Topics", $version);`` with topic = test-topic, dc = dc1
2025-11-03T16:53:52.232106Z node 15 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1655: [72075186224037893][] pipe [15:7568543404871684559:3310] connected; active server actors: 1
2025-11-03T16:53:52.232384Z node 15 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1519: [72075186224037893][rt3.dc1--test-topic] updating configuration. Deleted partitions []. Added partitions [0]
2025-11-03T16:53:52.235482Z node 15 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:971: [72075186224037893][rt3.dc1--test-topic] Discovered subdomain [OwnerId: 72057594046644480, LocalPathId: 1] state, outOfSpace = 0 at RB 72075186224037893
2025-11-03T16:53:52.241173Z node 15 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:140: [72075186224037893][rt3.dc1--test-topic] BALANCER INIT DONE for rt3.dc1--test-topic: (0, 72075186224037892) 
2025-11-03T16:53:52.253575Z node 16 :PERSQUEUE DEBUG: pq_impl.cpp:2960: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-11-03T16:53:52.265363Z node 16 :PERSQUEUE DEBUG: pq_impl.cpp:2992: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-11-03T16:53:52.265712Z node 16 :PERSQUEUE DEBUG: pq_impl.cpp:787: [PQ: 72075186224037892] no config, start with empty partitions and default config
2025-11-03T16:53:52.265753Z node 16 :PERSQUEUE NOTICE: pq_impl.cpp:913: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-11-03T16:53:52.265806Z node 16 :PERSQUEUE INFO: pq_impl.cpp:612: [PQ: 72075186224037892] doesn't have tx writes info
2025-11-03T16:53:52.266296Z node 16 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [15:7568543404871684589:2462], now have 1 active actors on pipe
2025-11-03T16:53:52.266330Z node 16 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [15:7568543404871684558:3309], now have 1 active actors on pipe
2025-11-03T16:53:52.268477Z node 15 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:404: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 16, Generation 1
2025-11-03T16:53:52.275287Z node 16 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-03T16:53:52.288440Z node 16 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-03T16:53:52.300693Z node 16 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [15:7568543404871684622:3357], now have 1 active actors on pipe
2025-11-03T16:53:52.302822Z node 16 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-03T16:53:52.317436Z node 16 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-03T16:53:52.318606Z node 16 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-11-03T16:53:52.318664Z node 16 :PERSQUEUE DEBUG: partition.cpp:1312: [72075186224037892][Partition][0][StateInit] HandleOnInit TEvPQ::TEvProposePartitionConfig
2025-11-03T16:53:52.319032Z node 16 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-11-03T16:53:52.319278Z node 16 :PERSQUEUE INFO: partition_init.cpp:1101: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [16:7568543403051918553:2396]
2025-11-03T16:53:52.322956Z node 16 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-11-03T16:53:52.323005Z node 16 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-11-03T16:53:52.323036Z node 16 :PERSQUEUE INFO: partition.cpp:707: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1 [16:7568543403051918553:2396]
2025-11-03T16:53:52.323073Z node 16 :PERSQUEUE DEBUG: partition.cpp:727: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 0 Head Offset 0 PartNo 0 PackedSize 0 count 0 nextOffset 0 batches 0
2025-11-03T16:53:52.323117Z node 16 :PERSQUEUE DEBUG: partition_mlp.cpp:83: [72075186224037892][Partition][0][StateIdle] Initializing MLP Consumers: 0
2025-11-03T16:53:52.327395Z node 16 :PERSQUEUE DEBUG: partition.cpp:4273: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 1
2025-11-03T16:53:52.327439Z node 16 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:53:52.327564Z node 16 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:53:52.327581Z node 16 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-03T16:53:52.327614Z node 16 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-11-03T16:53:52.327633Z node 16 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-11-03T16:53:52.327653Z node 16 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:53:52.327668Z node 16 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-11-03T16:53:52.327710Z node 16 :PERSQUEUE DEBUG: partition_read.cpp:923: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-11-03T16:53:52.327760Z node 16 :PERSQUEUE DEBUG: partition_mlp.cpp:60: [72075186224037892][Partition][0][StateIdle] Process MLP pending events. Count 0
2025-11-03T16:53:52.328482Z node 16 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-03T16:53:52.328634Z node 16 :PERSQUEUE DEBUG: partition_compaction.cpp:183: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:53:52.334674Z node 16 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-03T16:53:52.334877Z node 16 :PERSQUEUE DEBUG: partition.cpp:1416: [72075186224037892][Partition][0][StateIdle] Handle TEvPQ::TEvTxCommit Step 1762188832341, TxId 281474976715672
2025-11-03T16:53:52.334919Z node 16 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-11-03T16:53:52.334942Z node 16 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:53:52.335169Z node 16 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:53:52.335525Z node 16 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-03T16:53:52.340123Z node 16 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-03T16:53:52.340346Z node 16 :PERSQUEUE DEBUG: partition_mlp.cpp:83: [72075186224037892][Partition][0][StateIdle] Initializing MLP Consumers: 0
2025-11-03T16:53:52.340488Z node 16 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-11-03T16:53:52.340518Z node 16 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:53:52.340536Z node 16 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:53:52.340554Z node 16 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:53:52.340590Z node 16 :PERSQUEUE DEBUG: partition_compaction.cpp:183: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:53:52.340995Z node 16 :PERSQUEUE DEBUG: pq_impl.cpp:398: [PQ: 72075186224037892] Apply new config PartitionConfig { LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 } PartitionIds: 0 TopicName: "rt3.dc1--test-topic" Version: 0 LocalDC: true Codecs { Ids: 0 Ids: 1 Ids: 2 Codecs: "raw" Codecs: "gzip" Codecs: "lzop" } TopicPath: "/Root/PQ/rt3.dc1--test-topic" YcCloudId: "" YcFolderId: "" YdbDatabaseId: "" YdbDatabasePath: "/Root" Partitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } AllPartitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } Consumers { Name: "user" ReadFromTimestampsMs: 0 FormatVersion: 0 Version: 0 Generation: 0 } MonitoringProjectId: ""
2025-11-03T16:53:52.341114Z node 16 :PERSQUEUE NOTICE: pq_impl.cpp:913: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-11-03T16:53:52.341464Z node 16 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-03T16:53:52.359221Z node 16 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-03T16:53:52.359371Z node 16 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-03T16:53:52.363282Z node 16 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-03T16:53:52.428043Z node 16 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:53:52.428100Z node 16 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:53:52.428123Z node 16 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:53:52.513921Z node 15 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976715673. Ctx: { TraceId: 01k95a7bfk4g2hz8fssfvmtaqx, Database: , SessionId: ydb://session/3?node_id=15&id=Yzg4YjgwNGItZDc4ZmUwOWMtYzhjZWRlMzUtNDBhMDk5YWI=, PoolId: default, DatabaseId: /Root}. Database not set, use /Root
2025-11-03T16:53:52.528530Z node 16 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:53:52.528572Z node 16 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:53:52.528597Z node 16 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
===Query complete
TClient::Ls request: /Root/PQ/rt3.dc1--test-topic
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976715672
    CreateStep: 1762188832341
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts...
(TRUNCATED)
GetTopicVersionFromPath:  record Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976715672
    CreateStep: 1762188832341
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      YdbDatabasePath: "/Root"
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
    Partitions {
      PartitionId: 0
      TabletId: 72075186224037892
      Status: Active
    }
    AlterVersion: 1
    BalancerTabletID: 72075186224037893
    NextPartitionId: 1
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 1
      PlanResolution: 7
      Coordinators: 72057594046316545
      TimeCastBucketsPerMediator: 2
      Mediators: 72057594046382081
    }
    DomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    PathsInside: 12
    PathsLimit: 10000
    ShardsInside: 6
    ShardsLimit: 200000
    ResourcesDomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    DiskSpaceUsage {
      Tables {
        TotalSize: 1328
        DataSize: 1328
        IndexSize: 0
      }
      Topics {
        ReserveSize: 0
        AccountSize: 0
        DataSize: 0
        UsedReserveSize: 0
      }
    }
    PQPartitionsInside: 1
    PQPartitionsLimit: 1000000
    SchemeLimits {
      MaxDepth: 32
      MaxPaths: 10000
      MaxChildrenInDir: 100000
      MaxAclBytesSize: 10240
      MaxTableColumns: 200
      MaxTableColumnNameLength: 255
      MaxTableKeyColumns: 30
      MaxTableIndices: 20
      MaxShards: 200000
      MaxShardsInPath: 35000
      MaxConsistentCopyTargets: 10000
      MaxPathElementLength: 255
      ExtraPathSymbolsAllowed: "!\"#$%&\'()*+,-.:;<=>?@[\\]^_`{|}~"
      MaxPQPartitions: 1000000
      MaxTableCdcStreams: 5
      MaxExports: 10
      MaxImports: 10
      MaxColumnTableColumns: 10000
    }
  }
}
Path: "/Root/PQ/rt3.dc1--test-topic"
 name rt3.dc1--test-topic version1
CallPersQueueGRPC request to localhost:19899
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
MetaResponse {
  CmdGetTopicMetadataResult {
    TopicInfo {
      Topic: "rt3.dc1--test-topic"
      NumPartitions: 1
      Config {
        PartitionConfig {
          LifetimeSeconds: 86400
          LowWatermark: 8388608
          SourceIdLifetimeSeconds: 86400
          WriteSpeedInBytesPerSecond: 20000000
          BurstSize: 20000000
          SourceIdMaxCounts: 6000000
        }
        Version: 1
        LocalDC: true
        Codecs {
          Ids: 0
          Ids: 1
          Ids: 2
          Codecs: "raw"
          Codecs: "gzip"
          Codecs: "lzop"
        }
        TopicPath: "/Root/PQ/rt3.dc1--test-topic"
        YdbDatabasePath: "/Root"
        Consumers {
          Name: "user"
          ReadFromTimestampsMs: 0
          FormatVersion: 0
          Version: 0
        }
      }
      ErrorCode: OK
    }
  }
}
=== Topic created, have version: 1
2025-11-03T16:53:52.572909Z node 15 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
2025-11-03T16:53:52.596871Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: try to update token
2025-11-03T16:53:52.604978Z :INFO: [] MessageGroupId [src] SessionId [] Write session: Do CDS request
2025-11-03T16:53:52.605069Z :INFO: [] MessageGroupId [src] SessionId [] Start write session. Will connect to endpoint: localhost:19899
2025-11-03T16:53:52.628885Z node 16 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:53:52.628936Z node 16 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:53:52.628971Z node 16 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:53:52.638948Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src" }
2025-11-03T16:53:52.640006Z node 15 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-11-03T16:53:52.640051Z node 15 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1
2025-11-03T16:53:52.640401Z node 15 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src" }
2025-11-03T16:53:52.640547Z node 15 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1 topic: "test-topic" message_group_id: "src" from ipv6:[::1]:48984
2025-11-03T16:53:52.640573Z node 15 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:48984 proto=v1  topic=test-topic durationSec=0
2025-11-03T16:53:52.640584Z node 15 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-11-03T16:53:52.642850Z node 15 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1 sessionId:  describe result for acl check
2025-11-03T16:53:52.643031Z node 15 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-11-03T16:53:52.643050Z node 15 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-11-03T16:53:52.643067Z node 15 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-11-03T16:53:52.643090Z node 15 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [15:7568543404871684703:2480] (SourceId=src, PreferedPartition=(NULL)) StartKqpSession
2025-11-03T16:53:52.647747Z node 15 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [15:7568543404871684703:2480] (SourceId=src, PreferedPartition=(NULL)) Select from the table
2025-11-03T16:53:52.736455Z node 16 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:53:52.736500Z node 16 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:53:52.736523Z node 16 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:53:52.841566Z node 16 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:53:52.841620Z node 16 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:53:52.841648Z node 16 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:53:52.943219Z node 16 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:53:52.943264Z node 16 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:53:52.943285Z node 16 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:53:53.019746Z node 15 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [15:7568543404871684703:2480] (SourceId=src, PreferedPartition=(NULL)) RequestPQRB
2025-11-03T16:53:53.021189Z node 15 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1655: [72075186224037893][rt3.dc1--test-topic] pipe [15:7568543409166652061:2480] connected; active server actors: 1
2025-11-03T16:53:53.021370Z node 15 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [15:7568543404871684703:2480] (SourceId=src, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=src
2025-11-03T16:53:53.021396Z node 15 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [15:7568543404871684703:2480] (SourceId=src, PreferedPartition=(NULL)) Update the table
2025-11-03T16:53:53.048107Z node 16 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:53:53.048159Z node 16 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:53:53.048184Z node 16 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:53:53.057902Z node 15 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1659: [72075186224037893][rt3.dc1--test-topic] pipe [15:7568543409166652061:2480] disconnected.
2025-11-03T16:53:53.057949Z node 15 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1670: [72075186224037893][rt3.dc1--test-topic] pipe [15:7568543409166652061:2480] disconnected; active server actors: 1
2025-11-03T16:53:53.057992Z node 15 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1695: [72075186224037893][rt3.dc1--test-topic] pipe [15:7568543409166652061:2480] disconnected no session
2025-11-03T16:53:53.152106Z node 16 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:53:53.152152Z node 16 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:53:53.152176Z node 16 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:53:53.238091Z node 15 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [15:7568543404871684703:2480] (SourceId=src, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-11-03T16:53:53.238148Z node 15 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [15:7568543404871684703:2480] (SourceId=src, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-11-03T16:53:53.238176Z node 15 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [15:7568543404871684703:2480] (SourceId=src, PreferedPartition=(NULL)) Start idle
2025-11-03T16:53:53.238217Z node 15 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-11-03T16:53:53.241060Z node 15 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 16, Generation: 1
2025-11-03T16:53:53.240740Z node 16 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [15:7568543409166652088:2480], now have 1 active actors on pipe
2025-11-03T16:53:53.241436Z node 16 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:53:53.241474Z node 16 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:53:53.241587Z node 16 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src|1e56fdc5-6a61e568-a1efad16-2d316a29_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src
2025-11-03T16:53:53.241637Z node 16 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:53:53.241668Z node 16 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:53:53.241688Z node 16 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-03T16:53:53.241753Z node 16 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:53:53.241802Z node 16 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-03T16:53:53.241865Z node 16 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-03T16:53:53.242562Z node 16 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:53:53.242585Z node 16 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:53:53.242708Z node 16 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-03T16:53:53.244585Z :INFO: [] MessageGroupId [src] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1762188833244 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-11-03T16:53:53.244728Z :INFO: [] MessageGroupId [src] SessionId [] Write session established. Init response: session_id: "src|1e56fdc5-6a61e568-a1efad16-2d316a29_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-11-03T16:53:53.243626Z node 15 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1 partition: 0 MaxSeqNo: 0 sessionId: src|1e56fdc5-6a61e568-a1efad16-2d316a29_0
2025-11-03T16:53:53.248182Z :INFO: [] MessageGroupId [src] SessionId [src|1e56fdc5-6a61e568-a1efad16-2d316a29_0] Write session: close. Timeout = 0 ms
2025-11-03T16:53:53.248241Z :INFO: [] MessageGroupId [src] SessionId [src|1e56fdc5-6a61e568-a1efad16-2d316a29_0] Write session will now close
2025-11-03T16:53:53.248305Z :DEBUG: [] MessageGroupId [src] SessionId [src|1e56fdc5-6a61e568-a1efad16-2d316a29_0] Write session: aborting
2025-11-03T16:53:53.248845Z :INFO: [] MessageGroupId [src] SessionId [src|1e56fdc5-6a61e568-a1efad16-2d316a29_0] Write session: gracefully shut down, all writes complete
2025-11-03T16:53:53.248900Z :DEBUG: [] MessageGroupId [src] SessionId [src|1e56fdc5-6a61e568-a1efad16-2d316a29_0] Write session: destroy
====TYdbPqTestRetryPolicy()
2025-11-03T16:53:53.253124Z node 16 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:53:53.253176Z node 16 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:53:53.253202Z node 16 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:53:53.263055Z node 15 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId: src|1e56fdc5-6a61e568-a1efad16-2d316a29_0 grpc read done: success: 0 data: 
2025-11-03T16:53:53.263104Z node 15 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 1 sessionId: src|1e56fdc5-6a61e568-a1efad16-2d316a29_0 grpc read failed
2025-11-03T16:53:53.263153Z node 15 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 1 sessionId: src|1e56fdc5-6a61e568-a1efad16-2d316a29_0 grpc closed
2025-11-03T16:53:53.263183Z node 15 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1 sessionId: src|1e56fdc5-6a61e568-a1efad16-2d316a29_0 is DEAD
2025-11-03T16:53:53.264130Z node 15 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-11-03T16:53:53.268724Z node 16 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [15:7568543409166652088:2480] destroyed
2025-11-03T16:53:53.268783Z node 16 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-11-03T16:53:53.268827Z node 16 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:53:53.268849Z node 16 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:53:53.268869Z node 16 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:53:53.279525Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [] Write session: try to update token
2025-11-03T16:53:53.282181Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [] Write session: Do CDS request
2025-11-03T16:53:53.282274Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [] Do schedule cds request after 0 ms
2025-11-03T16:53:53.289559Z :INFO: [/Root] MessageGroupId [test-message-group-id] Running cds request ms
2025-11-03T16:53:53.300207Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [] Got CDS response: 
write_sessions_clusters { clusters { endpoint: "localhost:19899" name: "dc1" available: true } primary_cluster_selection_reason: CLIENT_LOCATION } version: 1
2025-11-03T16:53:53.300275Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [] Start write session. Will connect to endpoint: localhost:19899
2025-11-03T16:53:53.327209Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [] Write session: send init request: init_request { topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" }
2025-11-03T16:53:53.327469Z node 15 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-11-03T16:53:53.327504Z node 15 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2
2025-11-03T16:53:53.328066Z node 15 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" }
2025-11-03T16:53:53.328251Z node 15 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2 topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" from ipv6:[::1]:49030
2025-11-03T16:53:53.328273Z node 15 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:49030 proto=v1  topic=test-topic durationSec=0
2025-11-03T16:53:53.328297Z node 15 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-11-03T16:53:53.330411Z node 15 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2 sessionId:  describe result for acl check
2025-11-03T16:53:53.330593Z node 15 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-11-03T16:53:53.330617Z node 15 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-11-03T16:53:53.330631Z node 15 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-11-03T16:53:53.330652Z node 15 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [15:7568543409166652101:2505] (SourceId=test-message-group-id, PreferedPartition=(NULL)) StartKqpSession
2025-11-03T16:53:53.340590Z node 15 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [15:7568543409166652101:2505] (SourceId=test-message-group-id, PreferedPartition=(NULL)) Select from the table
2025-11-03T16:53:53.352084Z node 15 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [15:7568543409166652101:2505] (SourceId=test-message-group-id, PreferedPartition=(NULL)) RequestPQRB
2025-11-03T16:53:53.353371Z node 15 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1655: [72075186224037893][rt3.dc1--test-topic] pipe [15:7568543409166652120:2505] connected; active server actors: 1
2025-11-03T16:53:53.353818Z node 15 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [15:7568543409166652101:2505] (SourceId=test-message-group-id, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=test-message-group-id
2025-11-03T16:53:53.353847Z node 15 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [15:7568543409166652101:2505] (SourceId=test-message-group-id, PreferedPartition=(NULL)) Update the table
2025-11-03T16:53:53.355240Z node 15 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1659: [72075186224037893][rt3.dc1--test-topic] pipe [15:7568543409166652120:2505] disconnected.
2025-11-03T16:53:53.355276Z node 15 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1670: [72075186224037893][rt3.dc1--test-topic] pipe [15:7568543409166652120:2505] disconnected; active server actors: 1
2025-11-03T16:53:53.355303Z node 15 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1695: [72075186224037893][rt3.dc1--test-topic] pipe [15:7568543409166652120:2505] disconnected no session
2025-11-03T16:53:53.356883Z node 16 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:53:53.356923Z node 16 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:53:53.356946Z node 16 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:53:53.366255Z node 15 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [15:7568543409166652101:2505] (SourceId=test-message-group-id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-11-03T16:53:53.366306Z node 15 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [15:7568543409166652101:2505] (SourceId=test-message-group-id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-11-03T16:53:53.366330Z node 15 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [15:7568543409166652101:2505] (SourceId=test-message-group-id, PreferedPartition=(NULL)) Start idle
2025-11-03T16:53:53.366385Z node 15 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-11-03T16:53:53.368653Z node 16 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [15:7568543409166652136:2505], now have 1 active actors on pipe
2025-11-03T16:53:53.372241Z node 15 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 16, Generation: 1
2025-11-03T16:53:53.378274Z node 16 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:53:53.378333Z node 16 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:53:53.378466Z node 16 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie test-message-group-id|388d852-3195bf28-af2aa820-3ba713f7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner test-message-group-id
2025-11-03T16:53:53.378524Z node 16 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:53:53.378554Z node 16 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:53:53.378574Z node 16 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-03T16:53:53.378633Z node 16 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:53:53.378690Z node 16 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-03T16:53:53.378805Z node 16 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-03T16:53:53.381252Z node 16 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:53:53.381300Z node 16 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:53:53.381397Z node 16 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-03T16:53:53.384953Z node 15 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2 partition: 0 MaxSeqNo: 0 sessionId: test-message-group-id|388d852-3195bf28-af2aa820-3ba713f7_0
2025-11-03T16:53:53.386410Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1762188833386 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-11-03T16:53:53.386567Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [] Write session established. Init response: session_id: "test-message-group-id|388d852-3195bf28-af2aa820-3ba713f7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-11-03T16:53:53.387654Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|388d852-3195bf28-af2aa820-3ba713f7_0] Write 1 messages with Id from 1 to 1
2025-11-03T16:53:53.387770Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|388d852-3195bf28-af2aa820-3ba713f7_0] Estimated memory usage 102417[B] reached maximum (1024[B])
Enqueue task with id 1
2025-11-03T16:53:53.458852Z node 16 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:53:53.458900Z node 16 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:53:53.458925Z node 16 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:53:53.563711Z node 16 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:53:53.563747Z node 16 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:53:53.563769Z node 16 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:53:53.661456Z node 16 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:53:53.661517Z node 16 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:53:53.661545Z node 16 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:53:53.762346Z node 16 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:53:53.762418Z node 16 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:53:53.762445Z node 16 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:53:53.862720Z node 16 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:53:53.862769Z node 16 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:53:53.862795Z node 16 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:53:53.964231Z node 16 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:53:53.964281Z node 16 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:53:53.964320Z node 16 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:53:54.067623Z node 16 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:53:54.067672Z node 16 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:53:54.067701Z node 16 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:53:54.173290Z node 16 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:53:54.173339Z node 16 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:53:54.173362Z node 16 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:53:54.276355Z node 16 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:53:54.276398Z node 16 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:53:54.276422Z node 16 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:53:54.383425Z node 16 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:53:54.383470Z node 16 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:53:54.383495Z node 16 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:53:54.384874Z node 15 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [15:7568543409166652101:2505] (SourceId=test-message-group-id, PreferedPartition=(NULL)) Update the table
2025-11-03T16:53:54.484108Z node 16 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:53:54.484144Z node 16 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:53:54.484168Z node 16 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:53:54.587331Z node 16 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:53:54.587384Z node 16 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:53:54.587413Z node 16 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:53:54.688482Z node 16 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:53:54.688526Z node 16 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:53:54.688550Z node 16 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:53:54.790971Z node 16 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:53:54.791017Z node 16 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:53:54.791041Z node 16 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:53:54.892838Z node 16 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:53:54.892879Z node 16 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:53:54.892911Z node 16 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:53:54.974823Z node 15 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [15:7568543409166652101:2505] (SourceId=test-message-group-id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=1 Status=SUCCESS
2025-11-03T16:53:54.974856Z node 15 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [15:7568543409166652101:2505] (SourceId=test-message-group-id, PreferedPartition=(NULL)) Start idle
2025-11-03T16:53:54.994083Z node 16 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:53:54.994122Z node 16 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:53:54.994142Z node 16 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:53:55.096773Z node 16 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:53:55.096813Z node 16 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:53:55.096833Z node 16 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:53:55.200098Z node 16 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:53:55.200141Z node 16 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:53:55.200164Z node 16 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:53:55.299330Z node 16 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:53:55.299377Z node 16 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:53:55.299402Z node 16 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:53:55.404116Z node 16 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:53:55.404164Z node 16 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:53:55.404190Z node 16 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:53:55.504224Z node 16 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:53:55.504265Z node 16 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:53:55.504290Z node 16 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:53:55.604846Z node 16 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:53:55.604894Z node 16 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:53:55.604920Z node 16 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:53:55.707052Z node 16 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:53:55.707098Z node 16 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:53:55.707122Z node 16 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:53:55.808205Z node 16 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:53:55.808253Z node 16 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:53:55.808280Z node 16 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:53:55.908663Z node 16 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:53:55.908711Z node 16 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:53:55.908740Z node 16 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:53:56.012117Z node 16 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:53:56.012164Z node 16 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:53:56.012191Z node 16 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:53:56.116140Z node 16 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:53:56.116197Z node 16 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:53:56.116224Z node 16 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:53:56.217082Z node 16 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:53:56.217120Z node 16 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:53:56.217140Z node 16 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:53:56.319166Z node 16 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:53:56.319204Z node 16 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:53:56.319226Z node 16 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
Got ok to execute task with id 1
Executing compression of 1
2025-11-03T16:53:56.394131Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|388d852-3195bf28-af2aa820-3ba713f7_0] Estimated memory usage got back to normal 305[B]
2025-11-03T16:53:56.394259Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|388d852-3195bf28-af2aa820-3ba713f7_0] Write session: try to update token
2025-11-03T16:53:56.394292Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|388d852-3195bf28-af2aa820-3ba713f7_0] Send 1 message(s) (0 left), first sequence number is 1
Compression of 1 Done
2025-11-03T16:53:56.396063Z node 15 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: test-message-group-id|388d852-3195bf28-af2aa820-3ba713f7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:53:56.396347Z node 15 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:53:56.396967Z node 16 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:53:56.397025Z node 16 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:53:56.397121Z node 16 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-11-03T16:53:56.397495Z node 15 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:53:56.397944Z node 16 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:53:56.397973Z node 16 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:53:56.398420Z node 16 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0test-message-group-id' SeqNo: 1 partNo : 0 messageNo: 1 size 377 offset: -1
2025-11-03T16:53:56.398479Z node 16 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:53:56.398534Z node 16 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:53:56.398570Z node 16 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:53:56.398587Z node 16 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-03T16:53:56.398721Z node 16 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0test-message-group-id' seqNo 1 partNo 0
2025-11-03T16:53:56.483764Z node 16 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0test-message-group-id' seqNo 1 partNo 0 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 466 count 1 nextOffset 1 batches 1
2025-11-03T16:53:56.483835Z node 16 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:53:56.488619Z node 16 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 0,1 HeadOffset 0 endOffset 0 curOffset 1 d0000000000_00000000000000000000_00000_0000000001_00000? size 454 WTime 1762188836488
2025-11-03T16:53:56.489552Z node 16 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:53:56.489581Z node 16 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-03T16:53:56.489750Z node 16 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 0 partNo 0 count 1 size 454
2025-11-03T16:53:56.508360Z node 16 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 0 count 1 size 454 actorID [16:7568543403051918536:2396]
2025-11-03T16:53:56.508446Z node 16 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-03T16:53:56.508506Z node 16 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 399 WriteNewSizeFromSupportivePartitions# 0
2025-11-03T16:53:56.508545Z node 16 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:53:56.508598Z node 16 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0test-message-group-id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 1, partNo: 0, Offset: 0 is stored on disk
2025-11-03T16:53:56.508849Z node 16 :PERSQUEUE DEBUG: partition_read.cpp:923: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-11-03T16:53:56.508877Z node 16 :PERSQUEUE DEBUG: partition_read.cpp:965: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-11-03T16:53:56.508904Z node 16 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:53:56.508921Z node 16 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:53:56.508939Z node 16 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:53:56.508977Z node 16 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:53:56.509025Z node 16 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1  requestId: <none> cookie: 1
2025-11-03T16:53:56.509168Z node 16 :PERSQUEUE DEBUG: partition_read.cpp:880: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 partno 0 count 1 size 1024000 endOffset 1 max time lag 0ms effective offset 0
2025-11-03T16:53:56.509439Z node 16 :PERSQUEUE DEBUG: partition_read.cpp:1105: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 454 count 1 last offset 0, current partition end offset: 1
2025-11-03T16:53:56.509462Z node 16 :PERSQUEUE DEBUG: partition_read.cpp:1121: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-11-03T16:53:56.509516Z node 16 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 0 partno 0 count 1 parts_count 0 source 1 size 454 accessed 0 times before, last time 2025-11-03T16:53:56.000000Z
2025-11-03T16:53:56.509548Z node 16 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 3. All 1 blobs are from cache.
2025-11-03T16:53:56.509599Z node 16 :PERSQUEUE DEBUG: partition_read.cpp:572: FormAnswer for 1 blobs
2025-11-03T16:53:56.509763Z node 16 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 0 totakecount 1 count 1 size 434 from pos 0 cbcount 1
2025-11-03T16:53:56.509841Z node 16 :PERSQUEUE DEBUG: partition_read.cpp:1015: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1762188836398 queuesize 0 startOffset 0
2025-11-03T16:53:56.510573Z node 16 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 0 suffix '63' size 454
2025-11-03T16:53:56.510649Z node 16 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 0 suffix '63'
2025-11-03T16:53:56.516093Z node 15 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:53:56.520755Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|388d852-3195bf28-af2aa820-3ba713f7_0] Write session got write response: sequence_numbers: 1 offsets: 0 already_written: false write_statistics { persist_duration_ms: 27 queued_in_partition_duration_ms: 82 }
2025-11-03T16:53:56.520824Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|388d852-3195bf28-af2aa820-3ba713f7_0] Write session: acknoledged message 1
===Will now kick tablets
{"NodeId":15,"Down":true}
{"NodeId":16,"Down":true}
{"TabletsKicked":3}
{"TabletsKicked":3}
====ExpectBreakDown
2025-11-03T16:53:56.573432Z node 15 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-11-03T16:53:56.573464Z node 15 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-11-03T16:53:56.573545Z node 15 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2 reason: pipe to partition's 0 tablet is dead #2 sessionId: test-message-group-id|388d852-3195bf28-af2aa820-3ba713f7_0
2025-11-03T16:53:56.573913Z node 15 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2 sessionId: test-message-group-id|388d852-3195bf28-af2aa820-3ba713f7_0 is DEAD
====CreateRetryState
Test retry state: get retry delay
2025-11-03T16:53:56.576878Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|388d852-3195bf28-af2aa820-3ba713f7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: pipe to partition's 0 tablet is dead #2, code: 500027 
2025-11-03T16:53:56.576945Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|388d852-3195bf28-af2aa820-3ba713f7_0] Write session will restart in 2.000000s
2025-11-03T16:53:56.577065Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|388d852-3195bf28-af2aa820-3ba713f7_0] Write session: Do CDS request
2025-11-03T16:53:56.577144Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|388d852-3195bf28-af2aa820-3ba713f7_0] Do schedule cds request after 2000 ms
2025-11-03T16:53:56.577492Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|388d852-3195bf28-af2aa820-3ba713f7_0] Write 1 messages with Id from 2 to 2
Enqueue task with id 2
2025-11-03T16:53:56.577583Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|388d852-3195bf28-af2aa820-3ba713f7_0] Estimated memory usage 102417[B] reached maximum (1024[B])
Got ok to execute task with id 2
Executing compression of 2
2025-11-03T16:53:56.579881Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|388d852-3195bf28-af2aa820-3ba713f7_0] Estimated memory usage got back to normal 305[B]
Compression of 2 Done
2025-11-03T16:53:56.580271Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|388d852-3195bf28-af2aa820-3ba713f7_0] Write 1 messages with Id from 3 to 3
2025-11-03T16:53:56.580323Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|388d852-3195bf28-af2aa820-3ba713f7_0] Estimated memory usage 102722[B] reached maximum (1024[B])
Enqueue task with id 3
Got ok to execute task with id 3
Executing compression of 3
2025-11-03T16:53:56.582183Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|388d852-3195bf28-af2aa820-3ba713f7_0] Estimated memory usage got back to normal 610[B]
Compression of 3 Done
2025-11-03T16:53:56.584178Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|388d852-3195bf28-af2aa820-3ba713f7_0] Write 1 messages with Id from 4 to 4
2025-11-03T16:53:56.584232Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|388d852-3195bf28-af2aa820-3ba713f7_0] Estimated memory usage 103027[B] reached maximum (1024[B])
Enqueue task with id 4
Got ok to execute task with id 4
Executing compression of 4
2025-11-03T16:53:56.586106Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|388d852-3195bf28-af2aa820-3ba713f7_0] Estimated memory usage got back to normal 915[B]
Compression of 4 Done
2025-11-03T16:53:56.588190Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|388d852-3195bf28-af2aa820-3ba713f7_0] Write 1 messages with Id from 5 to 5
2025-11-03T16:53:56.588242Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|388d852-3195bf28-af2aa820-3ba713f7_0] Estimated memory usage 103332[B] reached maximum (1024[B])
============ UT - Wait event...
Got ok to execute task with id 5
Enqueue task with id 5
Executing compression of 5
Compression of 5 Done
2025-11-03T16:53:57.693634Z node 16 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976720663. Failed to resolve tablet: 72075186224037890 after several retries.
2025-11-03T16:53:57.693828Z node 16 :KQP_EXECUTER WARN: kqp_executer_impl.h:245: ActorId: [16:7568543420231787935:2434] TxId: 281474976720663. Ctx: { TraceId: 01k95a7fb48d87p83nrrf8efrb, Database: /Root, SessionId: ydb://session/3?node_id=16&id=NzY4MTA5MTYtNGJiYjgxOGQtNjZlMTUwNTAtOTI4OGEzMzI=, PoolId: default}. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037890 after several retries.
2025-11-03T16:53:57.694587Z node 16 :KQP_SESSION WARN: kqp_session_actor.cpp:2987: SessionId: ydb://session/3?node_id=16&id=NzY4MTA5MTYtNGJiYjgxOGQtNjZlMTUwNTAtOTI4OGEzMzI=, ActorId: [16:7568543420231787908:2434], ActorState: ExecuteState, TraceId: 01k95a7fb48d87p83nrrf8efrb, Create QueryResponse for error on request, msg: 
2025-11-03T16:53:57.696157Z node 16 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Failed to resolve tablet: 72075186224037890 after several retries." severity: 1 } TxMeta { id: "01k95a7g0a5t2apmzn105zjqv0" } } YdbStatus: UNAVAILABLE ConsumedRu: 446 }
2025-11-03T16:53:58.017037Z node 15 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976715681. Failed to resolve tablet: 72075186224037888 after several retries.
2025-11-03T16:53:58.017174Z node 15 :KQP_EXECUTER WARN: kqp_executer_impl.h:245: ActorId: [15:7568543426346521493:2530] TxId: 281474976715681. Ctx: { TraceId: 01k95a7fhbc3gs0ey9bwcv4hvd, Database: /Root, SessionId: ydb://session/3?node_id=15&id=MmViZmVkYzEtMmY0NTZiMGQtOTEyOGEzOWItNDU3YTE4MDY=, PoolId: default}. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037888 after several retries.
2025-11-03T16:53:58.017461Z node 15 :KQP_SESSION WARN: kqp_session_actor.cpp:2987: SessionId: ydb://session/3?node_id=15&id=MmViZmVkYzEtMmY0NTZiMGQtOTEyOGEzOWItNDU3YTE4MDY=, ActorId: [15:7568543422051554159:2530], ActorState: ExecuteState, TraceId: 01k95a7fhbc3gs0ey9bwcv4hvd, Create QueryResponse for error on request, msg: 
2025-11-03T16:53:58.018890Z node 15 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Failed to resolve tablet: 72075186224037888 after several retries." severity: 1 } TxMeta { id: "01k95a7gam8g0sqbdfm26zre96" } } YdbStatus: UNAVAILABLE ConsumedRu: 524 }
2025-11-03T16:53:58.580875Z :INFO: [/Root] MessageGroupId [test-message-group-id] Running cds request ms
2025-11-03T16:53:58.591644Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|388d852-3195bf28-af2aa820-3ba713f7_0] Got CDS response: 
write_sessions_clusters { clusters { endpoint: "localhost:19899" name: "dc1" available: true } primary_cluster_selection_reason: CLIENT_LOCATION } version: 1
2025-11-03T16:53:58.591734Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|388d852-3195bf28-af2aa820-3ba713f7_0] Start write session. Will connect to endpoint: localhost:19899
2025-11-03T16:53:58.601722Z node 15 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-11-03T16:53:58.601762Z node 15 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3
2025-11-03T16:53:58.602012Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|388d852-3195bf28-af2aa820-3ba713f7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" }
2025-11-03T16:53:58.604443Z node 15 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" }
2025-11-03T16:53:58.604662Z node 15 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3 topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" from ipv6:[::1]:49030
2025-11-03T16:53:58.604688Z node 15 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:49030 proto=v1  topic=test-topic durationSec=0
2025-11-03T16:53:58.604702Z node 15 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-11-03T16:53:58.606807Z node 15 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3 sessionId:  describe result for acl check
2025-11-03T16:53:58.606998Z node 15 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-11-03T16:53:58.607018Z node 15 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-11-03T16:53:58.607032Z node 15 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-11-03T16:53:58.607055Z node 15 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [15:7568543430641488868:2541] (SourceId=test-message-group-id, PreferedPartition=(NULL)) StartKqpSession
2025-11-03T16:53:58.618445Z node 15 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [15:7568543430641488868:2541] (SourceId=test-message-group-id, PreferedPartition=(NULL)) Select from the table
2025-11-03T16:53:59.410253Z node 15 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976715683. Failed to resolve tablet: 72075186224037891 after several retries.
2025-11-03T16:53:59.410387Z node 15 :KQP_EXECUTER WARN: kqp_executer_impl.h:245: ActorId: [15:7568543430641488880:2543] TxId: 281474976715683. Ctx: { TraceId: 01k95a7hpt34najwvk6qeenax3, Database: /Root, SessionId: ydb://session/3?node_id=15&id=ZjI1MDc3NDktZjM3MzQ5ZGQtZDhhNzAwOTktNjhkYjg0OTM=, PoolId: default}. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037891 after several retries.
2025-11-03T16:53:59.410644Z node 15 :KQP_SESSION WARN: kqp_session_actor.cpp:2987: SessionId: ydb://session/3?node_id=15&id=ZjI1MDc3NDktZjM3MzQ5ZGQtZDhhNzAwOTktNjhkYjg0OTM=, ActorId: [15:7568543430641488869:2543], ActorState: ExecuteState, TraceId: 01k95a7hpt34najwvk6qeenax3, Create QueryResponse for error on request, msg: 
2025-11-03T16:53:59.416858Z node 15 :PQ_PARTITION_CHOOSER INFO: partition_chooser_impl__abstract_chooser_actor.h:312: TPartitionChooser [15:7568543430641488868:2541] (SourceId=test-message-group-id, PreferedPartition=(NULL)) ReplyError: kqp error Marker# PQ50 : Response {
  SessionId: "ydb://session/3?node_id=15&id=ZjI1MDc3NDktZjM3MzQ5ZGQtZDhhNzAwOTktNjhkYjg0OTM="
  QueryIssues {
    message: "Failed to resolve tablet: 72075186224037891 after several retries."
    severity: 1
  }
  TxMeta {
    id: "01k95a7hpvcx3h8a244p5qvavb"
  }
}
YdbStatus: UNAVAILABLE
ConsumedRu: 1
2025-11-03T16:53:59.417029Z node 15 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3 reason: kqp error Marker# PQ50 : Response {
  SessionId: "ydb://session/3?node_id=15&id=ZjI1MDc3NDktZjM3MzQ5ZGQtZDhhNzAwOTktNjhkYjg0OTM="
  QueryIssues {
    message: "Failed to resolve tablet: 72075186224037891 after several retries."
    severity: 1
  }
  TxMeta {
    id: "01k95a7hpvcx3h8a244p5qvavb"
  }
}
YdbStatus: UNAVAILABLE
ConsumedRu: 1
 sessionId: 
2025-11-03T16:53:59.417408Z node 15 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3 sessionId:  is DEAD
Test retry state: get retry delay
2025-11-03T16:53:59.420879Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|388d852-3195bf28-af2aa820-3ba713f7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: kqp error Marker# PQ50 : Response {   SessionId: "ydb://session/3?node_id=15&id=ZjI1MDc3NDktZjM3MzQ5ZGQtZDhhNzAwOTktNjhkYjg0OTM="   QueryIssues {     message: "Failed to resolve tablet: 72075186224037891 after several retries."     severity: 1   }   TxMeta {     id: "01k95a7hpvcx3h8a244p5qvavb"   } } YdbStatus: UNAVAILABLE ConsumedRu: 1 , code: 500001 
2025-11-03T16:53:59.420939Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|388d852-3195bf28-af2aa820-3ba713f7_0] Write session will restart in 2.000000s
2025-11-03T16:53:59.421081Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|388d852-3195bf28-af2aa820-3ba713f7_0] Write session: Do CDS request
2025-11-03T16:53:59.421134Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|388d852-3195bf28-af2aa820-3ba713f7_0] Do schedule cds request after 2000 ms
2025-11-03T16:53:59.588437Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|388d852-3195bf28-af2aa820-3ba713f7_0] Write session: close. Timeout = 0 ms
2025-11-03T16:53:59.588541Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|388d852-3195bf28-af2aa820-3ba713f7_0] Write session will now close
2025-11-03T16:53:59.588636Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|388d852-3195bf28-af2aa820-3ba713f7_0] Write session: aborting
2025-11-03T16:53:59.589680Z :WARNING: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|388d852-3195bf28-af2aa820-3ba713f7_0] Write session: could not confirm all writes in time or session aborted, perform hard shutdown
2025-11-03T16:53:59.589742Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|388d852-3195bf28-af2aa820-3ba713f7_0] Write session: destroy
2025-11-03T16:54:00.760367Z node 15 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976715685. Failed to resolve tablet: 72075186224037890 after several retries.
2025-11-03T16:54:00.760540Z node 15 :KQP_EXECUTER WARN: kqp_executer_impl.h:245: ActorId: [15:7568543434936456242:2546] TxId: 281474976715685. Ctx: { TraceId: 01k95a7j3e5f9364y4rysm2361, Database: /Root, SessionId: ydb://session/3?node_id=15&id=NTlmOGM0ZDctNmE4NWFiMTEtMTk2MDM3MGMtODVjZmJkNDk=, PoolId: default}. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037890 after several retries.
2025-11-03T16:54:00.760935Z node 15 :KQP_SESSION WARN: kqp_session_actor.cpp:2987: SessionId: ydb://session/3?node_id=15&id=NTlmOGM0ZDctNmE4NWFiMTEtMTk2MDM3MGMtODVjZmJkNDk=, ActorId: [15:7568543434936456206:2546], ActorState: ExecuteState, TraceId: 01k95a7j3e5f9364y4rysm2361, Create QueryResponse for error on request, msg: 
2025-11-03T16:54:00.766824Z node 15 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Failed to resolve tablet: 72075186224037890 after several retries." severity: 1 } TxMeta { id: "01k95a7jtm57vjr03w0by9cmt4" } } YdbStatus: UNAVAILABLE ConsumedRu: 488 }
2025-11-03T16:51:11.503264Z :WriteRAW INFO: Random seed for debugging is 1762188671503220
2025-11-03T16:51:11.966159Z node 1 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[1:7568542714913580587:2077];send_to=[0:7307199536658146131:7762515];
2025-11-03T16:51:11.966205Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
2025-11-03T16:51:12.077239Z node 1 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
test_client.cpp: SetPath # /home/runner/.ya/build/build_root/7jz3/001998/r3tmp/tmpFmbn23/pdisk_1.dat
2025-11-03T16:51:12.107068Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-11-03T16:51:12.392124Z node 2 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-11-03T16:51:12.392237Z node 2 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=incorrect path status: LookupError;
2025-11-03T16:51:12.425364Z node 1 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-11-03T16:51:12.465484Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(1, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-11-03T16:51:12.465590Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(1, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-11-03T16:51:12.466601Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(2, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-11-03T16:51:12.466644Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(2, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-11-03T16:51:12.477330Z node 1 :HIVE WARN: hive_impl.cpp:811: HIVE#72057594037968897 Handle TEvInterconnect::TEvNodeConnected, NodeId 2 Cookie 2
2025-11-03T16:51:12.477461Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(1, (0,0,0,0)) VolatileState: Connecting -> Connected
2025-11-03T16:51:12.480036Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(2, (0,0,0,0)) VolatileState: Connecting -> Connected
2025-11-03T16:51:12.552847Z node 1 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
2025-11-03T16:51:12.565468Z node 2 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
TServer::EnableGrpc on GrpcPort 26148, node 1
2025-11-03T16:51:12.700796Z node 1 :NET_CLASSIFIER WARN: net_classifier.cpp:190: distributable config is empty, broken or outdated, will use file: /home/runner/.ya/build/build_root/7jz3/001998/r3tmp/yandex9eJhGn.tmp
2025-11-03T16:51:12.700826Z node 1 :NET_CLASSIFIER WARN: net_classifier.cpp:196: will try to initialize from file: /home/runner/.ya/build/build_root/7jz3/001998/r3tmp/yandex9eJhGn.tmp
2025-11-03T16:51:12.701014Z node 1 :NET_CLASSIFIER WARN: net_classifier.cpp:202: successfully initialized from file: /home/runner/.ya/build/build_root/7jz3/001998/r3tmp/yandex9eJhGn.tmp
2025-11-03T16:51:12.701149Z node 1 :NET_CLASSIFIER ERROR: net_classifier.cpp:228: got bad distributable configuration
2025-11-03T16:51:12.716004Z node 1 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-11-03T16:51:12.732660Z INFO: TTestServer started on Port 63981 GrpcPort 26148
TClient is connected to server localhost:63981
PQClient connected to localhost:26148
WaitRootIsUp 'Root'...
TClient::Ls request: Root
TClient::Ls response: 2025-11-03T16:51:12.978311Z node 1 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "Root"
    PathId: 1
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 1
    CreateStep: 0
    ParentPathId: 1
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 1
      SubDomainVersion: 0
      SecurityStateVersion: 0
    }
    ChildrenExist: false
  }
  Children {
    Name: ".sys"
    PathId: 18446744073709551615
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 0
    CreateStep: 0
    ParentPathId: 18446744073709551615
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 0
      Pl...
(TRUNCATED)
WaitRootIsUp 'Root' success.
2025-11-03T16:51:13.035572Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpAlterSubDomain, opId: 281474976720657:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_alter_subdomain.cpp:311)
waiting...
waiting...
2025-11-03T16:51:13.086507Z node 2 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
waiting...
waiting...
2025-11-03T16:51:15.976032Z node 2 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [2:7568542729218968646:2299], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-03T16:51:15.976217Z node 2 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-03T16:51:15.977090Z node 2 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [2:7568542729218968673:2302], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-03T16:51:15.979325Z node 2 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [2:7568542729218968698:2304], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-03T16:51:15.979420Z node 2 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-03T16:51:15.986581Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateResourcePool, opId: 281474976715657:3, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_resource_pool.cpp:179)
2025-11-03T16:51:16.048724Z node 2 :KQP_WORKLOAD_SERVICE WARN: helpers.h:73: [WorkloadService] [TPoolCreatorActor] ActorId: [2:7568542729218968675:2303], DatabaseId: /Root, PoolId: default, Scheduled retry for error: { <main>: Error: Transaction 281474976715657 completed, doublechecking }
2025-11-03T16:51:16.120021Z node 2 :TX_PROXY ERROR: schemereq.cpp:593: Actor# [2:7568542733513936001:2142] txid# 281474976715658, issues: { message: "Check failed: path: \'/Root/.metadata/workload_manager/pools/default\', error: path exist, request accepts it (id: [OwnerId: 72057594046644480, LocalPathId: 8], type: EPathTypeResourcePool, state: EPathStateNoChanges)" severity: 1 }
2025-11-03T16:51:16.365978Z node 2 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:570: Compilation failed, self: [2:7568542733513936008:2308], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-11-03T16:51:16.367187Z node 2 :KQP_SESSION WARN: kqp_session_actor.cpp:2506: SessionId: ydb://session/3?node_id=2&id=Nzg0Zjg5OWYtMjQ5NDk0OGUtZWQxZGJmYzgtMjg1MDM4MzI=, ActorId: [2:7568542729218968643:2297], ActorState: ExecuteState, TraceId: 01k95a2jw1evwhy8skqcj8449g, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-11-03T16:51:16.364994Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720661:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:690)
2025-11-03T16:51:16.366047Z node 1 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:570: Compilation failed, self: [1:7568542736388418108:2334], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-11-03T16:51:16.366355Z node 1 :KQP_SESSION WARN: kqp_session_actor.cpp:2506: SessionId: ydb://session/3?node_id=1&id=MWFlNzQ1ZGQtZjQ3NzkxMWUtOGI4ZDI3MC0xMzg5NjBjNw==, ActorId: [1:7568542736388418079:2327], ActorState: ExecuteState, TraceId: 01k95a2jy12zh59yph3zgnw8ye, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-11-03T16:51:16.369347Z node 2 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-11-03T16:51:16.368991Z node 1 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-11-03T16:51:16.610390Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720662:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:690)
2025-11-03T16:51:16.804584Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720663:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:690)
=== Init DC: UPSERT INTO `/Root/PQ/Config/V2/Cluster` (name, balancer, local, enabled, weight) VALUES ("dc1", "localhost:26148", true, true, 1000);
2025-11-03T16:51:16.968628Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[1:7568542714913580587:2077];send_to=[0:7307199536658146131:7762515];
2025-11-03T16:51:16.968723Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
2025-11-03T16:51:17.127870Z node 1 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976720664. Ctx: { TraceId: 01k95a2kvjadf4es0x3ye46pgp, Database: , SessionId: ydb://session/3?node_id=1&id=ZmFlYWI3NS1iNDRmYzIyYy1jMzQ0NGI1Ni1kMTk0ZmY4Mw==, PoolId: default, DatabaseId: /Root}. Database not set, use /Root
=== CheckClustersList. Subcribe to ClusterTracker from [1:7568542740683385827:2974] 
=== CheckClustersList. Ok
2025-11-03T16:51:23.439576Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720669:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:690)
waiting...
PQ Client: create topic: rt3.dc1--test-topic with 1 partitions
CallPersQueueGRPC request to localhost:26148
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-11-03T16:51:23.524007Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
CallPersQueueGRPC request to localhost:26148
MetaRequest {
  CmdCreateTopic {
    Topic: "rt3.dc1--test-topic"
    NumPartitions: 1
    Config {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
  }
}
CallPersQueueGRPC response:
Status: 129
ProxyErrorCode: 53
SchemeStatus: 1
FlatTxId {
  TxId: 281474976720670
  SchemeShardTabletId: 72057594046644480
  PathId: 13
}
ErrorCode: OK
AddTopic: rt3.dc1--test-topic
===Run query:``DECLARE $version as Int64; DECLARE $path AS Utf8; DECLARE $cluster as Utf8; UPSERT INTO `/Root/PQ/Config/V2/Topics` (path, dc) VALUES ($path, $cluster); UPSERT INTO `/Root/PQ/Config/V2/Versions` (name, version) VALUES ("Topics", $version);`` with topic = test-topic, dc = dc1
2025-11-03T16:51:23.563652Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1655: [72075186224037893][] pipe [1:7568542766453189997:3228] connected; active server actors: 1
2025-11-03T16:51:23.563882Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1519: [72075186224037893][rt3.dc1--test-topic] updating configuration. Deleted partitions []. Added partitions [0]
2025-11-03T16:51:23.565957Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:971: [72075186224037893][rt3.dc1--test-topic] Discovered subdomain [OwnerId: 72057594046644480, LocalPathId: 1] state, outOfSpace = 0 at RB 72075186224037893
2025-11-03T16:51:23.569078Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:140: [72075186224037893][rt3.dc1--test-topic] BALANCER INIT DONE for rt3.dc1--test-topic: (0, 72075186224037892) 
2025-11-03T16:51:23.589944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2960: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-11-03T16:51:23.594017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2992: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-11-03T16:51:23.594310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:787: [PQ: 72075186224037892] no config, start with empty partitions and default config
2025-11-03T16:51:23.594352Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:913: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-11-03T16:51:23.594386Z node 2 :PERSQUEUE INFO: pq_impl.cpp:612: [PQ: 72075186224037892] doesn't have tx writes info
2025-11-03T16:51:23.595772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [1:7568542766453190029:2430], now have 1 active actors on pipe
2025-11-03T16:51:23.595795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [1:7568542766453189996:3227], now have 1 active actors on pipe
2025-11-03T16:51:23.596025Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:404: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1
2025-11-03T16:51:23.596892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-03T16:51:23.612918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-03T16:51:23.625401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [1:7568542766453190059:3277], now have 1 active actors on pipe
2025-11-03T16:51:23.626190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-03T16:51:23.641222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-03T16:51:23.642358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-11-03T16:51:23.642426Z node 2 :PERSQUEUE DEBUG: partition.cpp:1312: [72075186224037892][Partition][0][StateInit] HandleOnInit TEvPQ::TEvProposePartitionConfig
2025-11-03T16:51:23.642679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-11-03T16:51:23.643061Z node 2 :PERSQUEUE INFO: partition_init.cpp:1101: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7568542763578707520:2382]
2025-11-03T16:51:23.646472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-11-03T16:51:23.646512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-11-03T16:51:23.646533Z node 2 :PERSQUEUE INFO: partition.cpp:707: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1 [2:7568542763578707520:2382]
2025-11-03T16:51:23.646562Z node 2 :PERSQUEUE DEBUG: partition.cpp:727: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 0 Head Offset 0 PartNo 0 PackedSize 0 count 0 nextOffset 0 batches 0
2025-11-03T16:51:23.646595Z node 2 :PERSQUEUE DEBUG: partition_mlp.cpp:83: [72075186224037892][Partition][0][StateIdle] Initializing MLP Consumers: 0
2025-11-03T16:51:23.648326Z node 2 :PERSQUEUE DEBUG: partition.cpp:4273: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 1
2025-11-03T16:51:23.648376Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:23.648475Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:23.648487Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-03T16:51:23.648509Z node 2 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-11-03T16:51:23.648520Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:23.648532Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:23.648546Z node 2 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-11-03T16:51:23.648577Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:923: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-11-03T16:51:23.648612Z node 2 :PERSQUEUE DEBUG: partition_mlp.cpp:60: [72075186224037892][Partition][0][StateIdle] Process MLP pending events. Count 0
2025-11-03T16:51:23.649104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-03T16:51:23.649229Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:183: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:51:23.669237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-03T16:51:23.669386Z node 2 :PERSQUEUE DEBUG: partition.cpp:1416: [72075186224037892][Partition][0][StateIdle] Handle TEvPQ::TEvTxCommit Step 1762188683668, TxId 281474976720670
2025-11-03T16:51:23.669405Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:23.669423Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:23.669541Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:23.669786Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-03T16:51:23.672127Z node 2 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-03T16:51:23.672306Z node 2 :PERSQUEUE DEBUG: partition_mlp.cpp:83: [72075186224037892][Partition][0][StateIdle] Initializing MLP Consumers: 0
2025-11-03T16:51:23.672421Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-11-03T16:51:23.672460Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:23.672475Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:23.672487Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:23.672515Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:183: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:51:23.672837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:398: [PQ: 72075186224037892] Apply new config PartitionConfig { LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 } PartitionIds: 0 TopicName: "rt3.dc1--test-topic" Version: 0 LocalDC: true Codecs { Ids: 0 Ids: 1 Ids: 2 Codecs: "raw" Codecs: "gzip" Codecs: "lzop" } TopicPath: "/Root/PQ/rt3.dc1--test-topic" YcCloudId: "" YcFolderId: "" YdbDatabaseId: "" YdbDatabasePath: "/Root" Partitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } AllPartitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } Consumers { Name: "user" ReadFromTimestampsMs: 0 FormatVersion: 0 Version: 0 Generation: 0 } MonitoringProjectId: ""
2025-11-03T16:51:23.672929Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:913: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-11-03T16:51:23.673208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-03T16:51:23.677897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-03T16:51:23.677985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-03T16:51:23.685557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-03T16:51:23.715070Z node 1 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976720671. Ctx: { TraceId: 01k95a2tag0fm2cvv4gx14pw5y, Database: , SessionId: ydb://session/3?node_id=1&id=Yjk3YzE0NWQtOGRhZjliNDEtNTg2MWQxOTAtMjI4OTFkYTI=, PoolId: default, DatabaseId: /Root}. Database not set, use /Root
===Query complete
TClient::Ls request: /Root/PQ/rt3.dc1--test-topic
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976720670
    CreateStep: 1762188683668
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts...
(TRUNCATED)
GetTopicVersionFromPath:  record Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976720670
    CreateStep: 1762188683668
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      YdbDatabasePath: "/Root"
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
    Partitions {
      PartitionId: 0
      TabletId: 72075186224037892
      Status: Active
    }
    AlterVersion: 1
    BalancerTabletID: 72075186224037893
    NextPartitionId: 1
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 1
      PlanResolution: 7
      Coordinators: 72057594046316545
      TimeCastBucketsPerMediator: 2
      Mediators: 72057594046382081
    }
    DomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    PathsInside: 12
    PathsLimit: 10000
    ShardsInside: 6
    ShardsLimit: 200000
    ResourcesDomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    DiskSpaceUsage {
      Tables {
        TotalSize: 0
        DataSize: 0
        IndexSize: 0
      }
      Topics {
        ReserveSize: 0
        AccountSize: 0
        DataSize: 0
        UsedReserveSize: 0
      }
    }
    PQPartitionsInside: 1
    PQPartitionsLimit: 1000000
    SchemeLimits {
      MaxDepth: 32
      MaxPaths: 10000
      MaxChildrenInDir: 100000
      MaxAclBytesSize: 10240
      MaxTableColumns: 200
      MaxTableColumnNameLength: 255
      MaxTableKeyColumns: 30
      MaxTableIndices: 20
      MaxShards: 200000
      MaxShardsInPath: 35000
      MaxConsistentCopyTargets: 10000
      MaxPathElementLength: 255
      ExtraPathSymbolsAllowed: "!\"#$%&\'()*+,-.:;<=>?@[\\]^_`{|}~"
      MaxPQPartitions: 1000000
      MaxTableCdcStreams: 5
      MaxExports: 10
      MaxImports: 10
      MaxColumnTableColumns: 10000
    }
  }
}
Path: "/Root/PQ/rt3.dc1--test-topic"
 name rt3.dc1--test-topic version1
CallPersQueueGRPC request to localhost:26148
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-11-03T16:51:23.756067Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:23.756093Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:23.756109Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:23.757180Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
MetaResponse {
  CmdGetTopicMetadataResult {
    TopicInfo {
      Topic: "rt3.dc1--test-topic"
      NumPartitions: 1
      Config {
        PartitionConfig {
          LifetimeSeconds: 86400
          LowWatermark: 8388608
          SourceIdLifetimeSeconds: 86400
          WriteSpeedInBytesPerSecond: 20000000
          BurstSize: 20000000
          SourceIdMaxCounts: 6000000
        }
        Version: 1
        LocalDC: true
        Codecs {
          Ids: 0
          Ids: 1
          Ids: 2
          Codecs: "raw"
          Codecs: "gzip"
          Codecs: "lzop"
        }
        TopicPath: "/Root/PQ/rt3.dc1--test-topic"
        YdbDatabasePath: "/Root"
        Consumers {
          Name: "user"
          ReadFromTimestampsMs: 0
          FormatVersion: 0
          Version: 0
        }
      }
      ErrorCode: OK
    }
  }
}
=== Topic created, have version: 1
2025-11-03T16:51:23.776331Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: try to update token
2025-11-03T16:51:23.778094Z :INFO: [] MessageGroupId [src] SessionId [] Write session: Do CDS request
2025-11-03T16:51:23.778149Z :INFO: [] MessageGroupId [src] SessionId [] Start write session. Will connect to endpoint: localhost:26148
2025-11-03T16:51:23.787831Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-11-03T16:51:23.787864Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1
2025-11-03T16:51:23.795794Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src" }
2025-11-03T16:51:23.800124Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src" }
2025-11-03T16:51:23.800287Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1 topic: "test-topic" message_group_id: "src" from ipv6:[::1]:34342
2025-11-03T16:51:23.800302Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:34342 proto=v1  topic=test-topic durationSec=0
2025-11-03T16:51:23.800313Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-11-03T16:51:23.801844Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1 sessionId:  describe result for acl check
2025-11-03T16:51:23.801957Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-11-03T16:51:23.801972Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-11-03T16:51:23.801979Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-11-03T16:51:23.801993Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7568542766453190143:2449] (SourceId=src, PreferedPartition=(NULL)) StartKqpSession
2025-11-03T16:51:23.803834Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7568542766453190143:2449] (SourceId=src, PreferedPartition=(NULL)) Select from the table
2025-11-03T16:51:23.857600Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:23.857628Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:23.857637Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:23.960096Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:23.960122Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:23.960131Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:23.980764Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [1:7568542766453190143:2449] (SourceId=src, PreferedPartition=(NULL)) RequestPQRB
2025-11-03T16:51:23.981845Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1655: [72075186224037893][rt3.dc1--test-topic] pipe [1:7568542766453190182:2449] connected; active server actors: 1
2025-11-03T16:51:23.981951Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [1:7568542766453190143:2449] (SourceId=src, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=src
2025-11-03T16:51:23.981966Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7568542766453190143:2449] (SourceId=src, PreferedPartition=(NULL)) Update the table
2025-11-03T16:51:23.982660Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1659: [72075186224037893][rt3.dc1--test-topic] pipe [1:7568542766453190182:2449] disconnected.
2025-11-03T16:51:23.982707Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1670: [72075186224037893][rt3.dc1--test-topic] pipe [1:7568542766453190182:2449] disconnected; active server actors: 1
2025-11-03T16:51:23.982726Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1695: [72075186224037893][rt3.dc1--test-topic] pipe [1:7568542766453190182:2449] disconnected no session
2025-11-03T16:51:24.060261Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:24.060288Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:24.060298Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:24.111438Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7568542766453190143:2449] (SourceId=src, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-11-03T16:51:24.111492Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7568542766453190143:2449] (SourceId=src, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-11-03T16:51:24.111511Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7568542766453190143:2449] (SourceId=src, PreferedPartition=(NULL)) Start idle
2025-11-03T16:51:24.111540Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-11-03T16:51:24.112316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [1:7568542770748157508:2449], now have 1 active actors on pipe
2025-11-03T16:51:24.112496Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1
2025-11-03T16:51:24.112663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:24.112699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:24.112774Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src|1d414346-4c187deb-3663f71d-bdbc8f11_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src
2025-11-03T16:51:24.112840Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:24.112866Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:24.112882Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-03T16:51:24.112923Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:24.112960Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-03T16:51:24.113006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-03T16:51:24.113547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:24.113569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:24.113653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-03T16:51:24.113921Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1 partition: 0 MaxSeqNo: 0 sessionId: src|1d414346-4c187deb-3663f71d-bdbc8f11_0
2025-11-03T16:51:24.114569Z :INFO: [] MessageGroupId [src] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1762188684114 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-11-03T16:51:24.114683Z :INFO: [] MessageGroupId [src] SessionId [] Write session established. Init response: session_id: "src|1d414346-4c187deb-3663f71d-bdbc8f11_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-11-03T16:51:24.114889Z :INFO: [] MessageGroupId [src] SessionId [src|1d414346-4c187deb-3663f71d-bdbc8f11_0] Write session: close. Timeout = 0 ms
2025-11-03T16:51:24.114924Z :INFO: [] MessageGroupId [src] SessionId [src|1d414346-4c187deb-3663f71d-bdbc8f11_0] Write session will now close
2025-11-03T16:51:24.114957Z :DEBUG: [] MessageGroupId [src] SessionId [src|1d414346-4c187deb-3663f71d-bdbc8f11_0] Write session: aborting
2025-11-03T16:51:24.115288Z :INFO: [] MessageGroupId [src] SessionId [src|1d414346-4c187deb-3663f71d-bdbc8f11_0] Write session: gracefully shut down, all writes complete
2025-11-03T16:51:24.115317Z :DEBUG: [] MessageGroupId [src] SessionId [src|1d414346-4c187deb-3663f71d-bdbc8f11_0] Write session: destroy
2025-11-03T16:51:24.122662Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId: src|1d414346-4c187deb-3663f71d-bdbc8f11_0 grpc read done: success: 0 data: 
2025-11-03T16:51:24.122697Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 1 sessionId: src|1d414346-4c187deb-3663f71d-bdbc8f11_0 grpc read failed
2025-11-03T16:51:24.122734Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 1 sessionId: src|1d414346-4c187deb-3663f71d-bdbc8f11_0 grpc closed
2025-11-03T16:51:24.122751Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1 sessionId: src|1d414346-4c187deb-3663f71d-bdbc8f11_0 is DEAD
2025-11-03T16:51:24.123437Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-11-03T16:51:24.125424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [1:7568542770748157508:2449] destroyed
2025-11-03T16:51:24.125469Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-11-03T16:51:24.125495Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:24.125507Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:24.125521Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:24.127655Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_schema.cpp:207: new Alter topic request
2025-11-03T16:51:24.129567Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpAlterPersQueueGroup, opId: 281474976720674:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_alter_pq.cpp:313)
2025-11-03T16:51:24.135333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-03T16:51:24.135058Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1519: [72075186224037893][rt3.dc1--test-topic] updating configuration. Deleted partitions []. Added partitions []
2025-11-03T16:51:24.138585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-03T16:51:24.144235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-03T16:51:24.153285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-03T16:51:24.153536Z node 2 :PERSQUEUE DEBUG: partition.cpp:1277: [72075186224037892][Partition][0][StateIdle] Handle TEvPQ::TEvProposePartitionConfig Step 1762188684186, TxId 281474976720674
2025-11-03T16:51:24.153556Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:24.153637Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:24.153653Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-03T16:51:24.153672Z node 2 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-11-03T16:51:24.153833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-03T16:51:24.160661Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:24.160682Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:24.160709Z node 2 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-11-03T16:51:24.160757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-03T16:51:24.160855Z node 2 :PERSQUEUE DEBUG: partition.cpp:1416: [72075186224037892][Partition][0][StateIdle] Handle TEvPQ::TEvTxCommit Step 1762188684186, TxId 281474976720674
2025-11-03T16:51:24.160877Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:24.160886Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:24.161020Z node 2 :PERSQUEUE DEBUG: partition.cpp:3622: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user reinit with generation 2 done
2025-11-03T16:51:24.161037Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:24.161196Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-03T16:51:24.163402Z node 2 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-03T16:51:24.163568Z node 2 :PERSQUEUE DEBUG: partition_mlp.cpp:83: [72075186224037892][Partition][0][StateIdle] Initializing MLP Consumers: 0
2025-11-03T16:51:24.163638Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-11-03T16:51:24.163655Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:24.163664Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:24.163673Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:24.163694Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:183: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:51:24.164080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:398: [PQ: 72075186224037892] Apply new config PartitionConfig { MaxCountInPartition: 2147483647 MaxSizeInPartition: 9223372036854775807 LifetimeSeconds: 86400 SourceIdLifetimeSeconds: 1382400 WriteSpeedInBytesPerSecond: 1048576 BurstSize: 1048576 TotalPartitions: 1 SourceIdMaxCounts: 6000000 } PartitionIds: 0 TopicName: "rt3.dc1--test-topic" Version: 2 LocalDC: true RequireAuthWrite: true RequireAuthRead: true Producer: "unknown" Ident: "unknown" Topic: "test-topic" DC: "dc1" FormatVersion: 0 Codecs { Ids: 0 Ids: 1 Ids: 3 Codecs: "raw" Codecs: "gzip" Codecs: "zstd" } TopicPath: "/Root/PQ/rt3.dc1--test-topic" YcCloudId: "" YcFolderId: "" YdbDatabaseId: "" YdbDatabasePath: "/Root" Partitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } AllPartitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 72075186224037892 } Consumers { Name: "user" ReadFromTimestampsMs: 0 FormatVersion: 0 Codec { Ids: 0 Ids: 1 Ids: 3 Codecs: "raw" Codecs: "gzip" Codecs: "zstd" } ServiceType: "data-streams" Version: 1 Generation: 2 } MonitoringProjectId: ""
2025-11-03T16:51:24.164104Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:913: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-11-03T16:51:24.164360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
Alter topic response: { 2025-11-03T16:51:24.172901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-03T16:51:24.172983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-03T16:51:24.174523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
operation { ready: true status: SUCCESS } }
Alter result: {  }
2025-11-03T16:51:24.186937Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [] Write session: try to update token
2025-11-03T16:51:24.187491Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [] Write session: Do CDS request
2025-11-03T16:51:24.187543Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [] Do schedule cds request after 0 ms
2025-11-03T16:51:24.187714Z :INFO: [/Root] MessageGroupId [test-message-group-id] Running cds request ms
2025-11-03T16:51:24.194795Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [] Got CDS response: 
write_sessions_clusters { clusters { endpoint: "localhost:26148" name: "dc1" available: true } primary_cluster_selection_reason: CLIENT_LOCATION } version: 1
2025-11-03T16:51:24.194874Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [] Start write session. Will connect to endpoint: localhost:26148
2025-11-03T16:51:24.207298Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [] Write session: send init request: init_request { topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" }
2025-11-03T16:51:24.207564Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-11-03T16:51:24.207608Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2
2025-11-03T16:51:24.208155Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" }
2025-11-03T16:51:24.208368Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2 topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" from ipv6:[::1]:49318
2025-11-03T16:51:24.208386Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:49318 proto=v1  topic=test-topic durationSec=0
2025-11-03T16:51:24.208397Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-11-03T16:51:24.209842Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2 sessionId:  describe result for acl check
2025-11-03T16:51:24.209965Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-11-03T16:51:24.209975Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-11-03T16:51:24.209983Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-11-03T16:51:24.210000Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7568542770748157583:2470] (SourceId=test-message-group-id, PreferedPartition=(NULL)) StartKqpSession
2025-11-03T16:51:24.212975Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7568542770748157583:2470] (SourceId=test-message-group-id, PreferedPartition=(NULL)) Select from the table
2025-11-03T16:51:24.220421Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [1:7568542770748157583:2470] (SourceId=test-message-group-id, PreferedPartition=(NULL)) RequestPQRB
2025-11-03T16:51:24.221221Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1655: [72075186224037893][rt3.dc1--test-topic] pipe [1:7568542770748157599:2470] connected; active server actors: 1
2025-11-03T16:51:24.221376Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [1:7568542770748157583:2470] (SourceId=test-message-group-id, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=test-message-group-id
2025-11-03T16:51:24.221398Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7568542770748157583:2470] (SourceId=test-message-group-id, PreferedPartition=(NULL)) Update the table
2025-11-03T16:51:24.222270Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1659: [72075186224037893][rt3.dc1--test-topic] pipe [1:7568542770748157599:2470] disconnected.
2025-11-03T16:51:24.222297Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1670: [72075186224037893][rt3.dc1--test-topic] pipe [1:7568542770748157599:2470] disconnected; active server actors: 1
2025-11-03T16:51:24.222313Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1695: [72075186224037893][rt3.dc1--test-topic] pipe [1:7568542770748157599:2470] disconnected no session
2025-11-03T16:51:24.239561Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7568542770748157583:2470] (SourceId=test-message-group-id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-11-03T16:51:24.239593Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7568542770748157583:2470] (SourceId=test-message-group-id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-11-03T16:51:24.239614Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7568542770748157583:2470] (SourceId=test-message-group-id, PreferedPartition=(NULL)) Start idle
2025-11-03T16:51:24.239637Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-11-03T16:51:24.240467Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1
2025-11-03T16:51:24.242456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [1:7568542770748157617:2470], now have 1 active actors on pipe
2025-11-03T16:51:24.242512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:24.242531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:24.242615Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie test-message-group-id|ba4a54e-8119b27b-5c33be0a-b4032eaf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner test-message-group-id
2025-11-03T16:51:24.242648Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:24.242663Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:24.242673Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-03T16:51:24.242725Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:24.242777Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-03T16:51:24.242813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-03T16:51:24.243604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:24.243625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:24.243674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-03T16:51:24.244010Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2 partition: 0 MaxSeqNo: 0 sessionId: test-message-group-id|ba4a54e-8119b27b-5c33be0a-b4032eaf_0
2025-11-03T16:51:24.244762Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1762188684244 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-11-03T16:51:24.244854Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [] Write session established. Init response: session_id: "test-message-group-id|ba4a54e-8119b27b-5c33be0a-b4032eaf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_ZSTD
2025-11-03T16:51:24.245021Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ba4a54e-8119b27b-5c33be0a-b4032eaf_0] Write 1 messages with Id from 1 to 1
2025-11-03T16:51:24.245117Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ba4a54e-8119b27b-5c33be0a-b4032eaf_0] Write session: try to update token
2025-11-03T16:51:24.245151Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ba4a54e-8119b27b-5c33be0a-b4032eaf_0] Send 1 message(s) (0 left), first sequence number is 1
2025-11-03T16:51:24.245336Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ba4a54e-8119b27b-5c33be0a-b4032eaf_0] Write 1 messages with Id from 2 to 2
2025-11-03T16:51:24.245373Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ba4a54e-8119b27b-5c33be0a-b4032eaf_0] Write session: try to update token
2025-11-03T16:51:24.245393Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ba4a54e-8119b27b-5c33be0a-b4032eaf_0] Send 1 message(s) (0 left), first sequence number is 2
2025-11-03T16:51:24.245423Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ba4a54e-8119b27b-5c33be0a-b4032eaf_0] Write session: close. Timeout = 18446744073709551 ms
2025-11-03T16:51:24.245744Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: test-message-group-id|ba4a54e-8119b27b-5c33be0a-b4032eaf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:51:24.245982Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:51:24.246324Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: test-message-group-id|ba4a54e-8119b27b-5c33be0a-b4032eaf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:51:24.246478Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:51:24.246502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:24.246523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:24.246583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-11-03T16:51:24.246912Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:24.246949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:24.246964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:24.247005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1  requestId: <none> cookie: 2
2025-11-03T16:51:24.247288Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:24.247416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:24.247431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:24.247691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0test-message-group-id' SeqNo: 1 partNo : 0 messageNo: 2 size 84 offset: -1
2025-11-03T16:51:24.247726Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:51:24.247775Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:24.247798Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:24.247811Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-03T16:51:24.247920Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0test-message-group-id' seqNo 1 partNo 0
2025-11-03T16:51:24.248809Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0test-message-group-id' seqNo 1 partNo 0 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 173 count 1 nextOffset 1 batches 1
2025-11-03T16:51:24.248858Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:24.249352Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 0,1 HeadOffset 0 endOffset 0 curOffset 1 d0000000000_00000000000000000000_00000_0000000001_00000? size 161 WTime 1762188684249
2025-11-03T16:51:24.249500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:24.249513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:24.249547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0test-message-group-id' SeqNo: 2 partNo : 0 messageNo: 3 size 83 offset: -1
2025-11-03T16:51:24.249570Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-03T16:51:24.249699Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 0 partNo 0 count 1 size 161
2025-11-03T16:51:24.249727Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:51:24.249754Z node 2 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:51:24.252246Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 0 count 1 size 161 actorID [2:7568542763578707502:2382]
2025-11-03T16:51:24.252292Z node 2 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-03T16:51:24.252330Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 106 WriteNewSizeFromSupportivePartitions# 0
2025-11-03T16:51:24.252363Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:51:24.252402Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0test-message-group-id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 1, partNo: 0, Offset: 0 is stored on disk
2025-11-03T16:51:24.252580Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:923: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 2
2025-11-03T16:51:24.252617Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:965: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 2
2025-11-03T16:51:24.252634Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:24.252654Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:24.252664Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-03T16:51:24.252752Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0test-message-group-id' seqNo 2 partNo 0
2025-11-03T16:51:24.253608Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0test-message-group-id' seqNo 2 partNo 0 FormedBlobsCount 0 NewHead: Offset 1 PartNo 0 PackedSize 172 count 1 nextOffset 2 batches 1
2025-11-03T16:51:24.253644Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:24.254134Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 1,1 HeadOffset 1 endOffset 1 curOffset 2 d0000000000_00000000000000000001_00000_0000000001_00000? size 160 WTime 1762188684253
2025-11-03T16:51:24.254256Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:51:24.254297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 2  requestId: <none> cookie: 1
2025-11-03T16:51:24.254353Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-03T16:51:24.254450Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 1 partNo 0 count 1 size 160
2025-11-03T16:51:24.254607Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:880: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 partno 0 count 1 size 1024000 endOffset 1 max time lag 0ms effective offset 0
2025-11-03T16:51:24.254807Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1105: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 161 count 1 last offset 0, current partition end offset: 1
2025-11-03T16:51:24.254824Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1121: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-11-03T16:51:24.254890Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 0 partno 0 count 1 parts_count 0 source 1 size 161 accessed 0 times before, last time 2025-11-03T16:51:24.000000Z
2025-11-03T16:51:24.254925Z node 2 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 3. All 1 blobs are from cache.
2025-11-03T16:51:24.255238Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:572: FormAnswer for 1 blobs
2025-11-03T16:51:24.255357Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 0 totakecount 1 count 1 size 141 from pos 0 cbcount 1
2025-11-03T16:51:24.255419Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1015: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1762188684247 queuesize 0 startOffset 0
2025-11-03T16:51:24.255590Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 0 suffix '63' size 161
2025-11-03T16:51:24.255641Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 0 suffix '63'
2025-11-03T16:51:24.256767Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:24.257998Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 1 count 1 size 160 actorID [2:7568542763578707502:2382]
2025-11-03T16:51:24.258040Z node 2 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-03T16:51:24.258075Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 105 WriteNewSizeFromSupportivePartitions# 0
2025-11-03T16:51:24.258098Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:51:24.258122Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0test-message-group-id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 2, partNo: 0, Offset: 1 is stored on disk
2025-11-03T16:51:24.258222Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 1 partno 0 count 1 parts 0 suffix '63' size 160
2025-11-03T16:51:24.258240Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:24.258249Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:24.258258Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:24.258281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:51:24.258306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 3  requestId: <none> cookie: 2
2025-11-03T16:51:24.258872Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:24.259861Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ba4a54e-8119b27b-5c33be0a-b4032eaf_0] Write session got write response: sequence_numbers: 1 offsets: 0 already_written: false write_statistics { persist_duration_ms: 3 queued_in_partition_duration_ms: 1 }
2025-11-03T16:51:24.259906Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ba4a54e-8119b27b-5c33be0a-b4032eaf_0] Write session: acknoledged message 1
2025-11-03T16:51:24.260245Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ba4a54e-8119b27b-5c33be0a-b4032eaf_0] Write session got write response: sequence_numbers: 2 offsets: 1 already_written: false write_statistics { persist_duration_ms: 2 queued_in_partition_duration_ms: 3 }
2025-11-03T16:51:24.260276Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ba4a54e-8119b27b-5c33be0a-b4032eaf_0] Write session: acknoledged message 2
2025-11-03T16:51:24.260885Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:24.260903Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:24.260912Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:24.345562Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ba4a54e-8119b27b-5c33be0a-b4032eaf_0] Write session will now close
2025-11-03T16:51:24.345635Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ba4a54e-8119b27b-5c33be0a-b4032eaf_0] Write session: aborting
2025-11-03T16:51:24.346095Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ba4a54e-8119b27b-5c33be0a-b4032eaf_0] Write session: gracefully shut down, all writes complete
2025-11-03T16:51:24.346135Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ba4a54e-8119b27b-5c33be0a-b4032eaf_0] Write session: destroy
Start read
2025-11-03T16:51:24.346409Z :INFO: [/Root] [/Root] [78a8578e-5bf8de0d-fb22d838-fd501cbb] Starting read session
2025-11-03T16:51:24.346432Z :DEBUG: [/Root] [/Root] [78a8578e-5bf8de0d-fb22d838-fd501cbb] Starting cluster discovery
2025-11-03T16:51:24.350318Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: test-message-group-id|ba4a54e-8119b27b-5c33be0a-b4032eaf_0 grpc read done: success: 0 data: 
2025-11-03T16:51:24.350341Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 2 sessionId: test-message-group-id|ba4a54e-8119b27b-5c33be0a-b4032eaf_0 grpc read failed
2025-11-03T16:51:24.350366Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 2 sessionId: test-message-group-id|ba4a54e-8119b27b-5c33be0a-b4032eaf_0 grpc closed
2025-11-03T16:51:24.350378Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2 sessionId: test-message-group-id|ba4a54e-8119b27b-5c33be0a-b4032eaf_0 is DEAD
2025-11-03T16:51:24.350965Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-11-03T16:51:24.351364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [1:7568542770748157617:2470] destroyed
2025-11-03T16:51:24.351401Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-11-03T16:51:24.351426Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:24.351436Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:24.351445Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:24.352620Z :DEBUG: [/Root] [/Root] [78a8578e-5bf8de0d-fb22d838-fd501cbb] Cluster discovery request succeeded
2025-11-03T16:51:24.352673Z :DEBUG: [/Root] [/Root] [78a8578e-5bf8de0d-fb22d838-fd501cbb] Starting session to cluster dc1 (localhost:26148)
2025-11-03T16:51:24.352785Z :DEBUG: [/Root] [/Root] [78a8578e-5bf8de0d-fb22d838-fd501cbb] [dc1] In Reconnect, ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:51:24.352824Z :DEBUG: [/Root] [/Root] [78a8578e-5bf8de0d-fb22d838-fd501cbb] [dc1] New values: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:51:24.352846Z :DEBUG: [/Root] [/Root] [78a8578e-5bf8de0d-fb22d838-fd501cbb] [dc1] Reconnecting session to cluster dc1 in 0.000000s
2025-11-03T16:51:24.361339Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:24.361369Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:24.361382Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:24.365210Z :DEBUG: [/Root] [/Root] [78a8578e-5bf8de0d-fb22d838-fd501cbb] [dc1] Successfully connected. Initializing session
2025-11-03T16:51:24.365553Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:109: new grpc connection
2025-11-03T16:51:24.365573Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:131: new session created cookie 1
2025-11-03T16:51:24.366226Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { topic: "test-topic" } read_only_original: true consumer: "shared/user" read_params { max_read_size: 104857600 } } }
2025-11-03T16:51:24.366445Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 1 consumer shared/user session shared/user_1_1_925615705237884016_v1 read init: from# ipv6:[::1]:49328, request# { init_request { topics_read_settings { topic: "test-topic" } read_only_original: true consumer: "shared/user" read_params { max_read_size: 104857600 } } }
2025-11-03T16:51:24.366834Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 1 consumer shared/user session shared/user_1_1_925615705237884016_v1 auth for : user
2025-11-03T16:51:24.367310Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 1 consumer shared/user session shared/user_1_1_925615705237884016_v1 Handle describe topics response
2025-11-03T16:51:24.367428Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 1 consumer shared/user session shared/user_1_1_925615705237884016_v1 auth is DEAD
2025-11-03T16:51:24.367489Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 1 consumer shared/user session shared/user_1_1_925615705237884016_v1 auth ok: topics# 1, initDone# 0
2025-11-03T16:51:24.368465Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 1 consumer shared/user session shared/user_1_1_925615705237884016_v1 register session: topic# rt3.dc1--test-topic
2025-11-03T16:51:24.369102Z :INFO: [/Root] [/Root] [78a8578e-5bf8de0d-fb22d838-fd501cbb] [dc1] Server session id: shared/user_1_1_925615705237884016_v1
2025-11-03T16:51:24.369249Z :DEBUG: [/Root] [/Root] [78a8578e-5bf8de0d-fb22d838-fd501cbb] [dc1] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:51:24.369682Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1655: [72075186224037893][rt3.dc1--test-topic] pipe [1:7568542770748157626:2475] connected; active server actors: 1
2025-11-03T16:51:24.369823Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1706: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [1:7568542770748157626:2475] session shared/user_1_1_925615705237884016_v1
2025-11-03T16:51:24.369973Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:639: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-11-03T16:51:24.370050Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:669: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-11-03T16:51:24.370086Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:871: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_1_1_925615705237884016_v1" (Sender=[1:7568542770748157623:2475], Pipe=[1:7568542770748157626:2475], Partitions=[], ActiveFamilyCount=0)
2025-11-03T16:51:24.370114Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1186: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-11-03T16:51:24.370173Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1258: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-11-03T16:51:24.370228Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1305: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_1_925615705237884016_v1" (Sender=[1:7568542770748157623:2475], Pipe=[1:7568542770748157626:2475], Partitions=[], ActiveFamilyCount=0)
2025-11-03T16:51:24.370282Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:549: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_1_1_925615705237884016_v1" sender [1:7568542770748157623:2475] lock partition 0 for ReadingSession "shared/user_1_1_925615705237884016_v1" (Sender=[1:7568542770748157623:2475], Pipe=[1:7568542770748157626:2475], Partitions=[], ActiveFamilyCount=1) generation 1 step 1
2025-11-03T16:51:24.370354Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1325: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-11-03T16:51:24.370380Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1402: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000185s
2025-11-03T16:51:24.371228Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 1 consumer shared/user session shared/user_1_1_925615705237884016_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 1 Session: "shared/user_1_1_925615705237884016_v1" ClientId: "user" PipeClient { RawX1: 7568542770748157626 RawX2: 4503603922340267 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-11-03T16:51:24.371299Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 1 consumer shared/user session shared/user_1_1_925615705237884016_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-11-03T16:51:24.371996Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_925615705237884016_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 1, pipe: [1:7568542770748157629:2478]
2025-11-03T16:51:24.372489Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_1_1_925615705237884016_v1 grpc read done: success# 1, data# { read { } }
2025-11-03T16:51:24.372573Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_1_1_925615705237884016_v1 got read request: guid# 38fc5cf6-4c5b517b-dde97cf9-35371a46
2025-11-03T16:51:24.371901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [1:7568542770748157629:2478], now have 1 active actors on pipe
2025-11-03T16:51:24.373578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:24.373612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:24.373643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1748: [PQ: 72075186224037892] Created session shared/user_1_1_925615705237884016_v1 on pipe: [1:7568542770748157629:2478]
2025-11-03T16:51:24.373713Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:24.373731Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:24.373742Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-03T16:51:24.373813Z node 2 :PERSQUEUE DEBUG: partition.cpp:3666: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_1_1_925615705237884016_v1
2025-11-03T16:51:24.373844Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:24.373925Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_1_925615705237884016_v1:1 with generation 1
2025-11-03T16:51:24.373969Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-03T16:51:24.376525Z node 2 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-03T16:51:24.376587Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-11-03T16:51:24.376608Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:24.376617Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:24.376626Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:24.376646Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:51:24.376673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-11-03T16:51:24.377041Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_1_1_925615705237884016_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 2 WriteTimestampMS: 1762188684247 CreateTimestampMS: 1762188684244 SizeLag: 322 WriteTimestampEstimateMS: 1762188684361 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-11-03T16:51:24.377080Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 1 consumer shared/user session shared/user_1_1_925615705237884016_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 2 readOffset 0 committedOffset 0
2025-11-03T16:51:24.377129Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 1 consumer shared/user session shared/user_1_1_925615705237884016_v1 sending to client partition status
2025-11-03T16:51:24.380643Z :INFO: [/Root] [/Root] [78a8578e-5bf8de0d-fb22d838-fd501cbb] [dc1] Confirm partition stream create. Partition stream id: 1. Cluster: "dc1". Topic: "test-topic". Partition: 0. Read offset: (NULL)
2025-11-03T16:51:24.384268Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_1_1_925615705237884016_v1 grpc read done: success# 1, data# { start_read { topic { path: "test-topic" } cluster: "dc1" assign_id: 1 } }
2025-11-03T16:51:24.384467Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:539: session cookie 1 consumer shared/user session shared/user_1_1_925615705237884016_v1 got StartRead from client: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 0, commitOffset# 0
2025-11-03T16:51:24.384525Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1023: session cookie 1 consumer shared/user session shared/user_1_1_925615705237884016_v1 Start reading TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 2 readOffset 0 committedOffset 0 clientCommitOffset 0 clientReadOffset 0
2025-11-03T16:51:24.384554Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_1_1_925615705237884016_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 0 endOffset 2
2025-11-03T16:51:24.384607Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_1_1_925615705237884016_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 0, endOffset# 2, WTime# 1762188684247, sizeLag# 322
2025-11-03T16:51:24.384626Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_1_1_925615705237884016_v1TEvPartitionReady. Aval parts: 1
2025-11-03T16:51:24.384666Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_1_1_925615705237884016_v1 performing read request: guid# 38fc5cf6-4c5b517b-dde97cf9-35371a46, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 2, size# 386, partitionsAsked# 1, maxTimeLag# 0ms
2025-11-03T16:51:24.384736Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_1_1_925615705237884016_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 2 maxSize 386 maxTimeLagMs 0 readTimestampMs 0 readOffset 0 EndOffset 2 ClientCommitOffset 0 committedOffset 0 Guid 38fc5cf6-4c5b517b-dde97cf9-35371a46
2025-11-03T16:51:24.385471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:24.385505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:24.385600Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:880: [72075186224037892][Partition][0][StateIdle] read cookie 4 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 partno 0 count 2 size 386 endOffset 2 max time lag 0ms effective offset 0
2025-11-03T16:51:24.385914Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1105: [72075186224037892][Partition][0][StateIdle] read cookie 4 added 2 blobs, size 321 count 2 last offset 1, current partition end offset: 2
2025-11-03T16:51:24.385937Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1121: [72075186224037892][Partition][0][StateIdle] Reading cookie 4. Send blob request.
2025-11-03T16:51:24.385975Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 0 partno 0 count 1 parts_count 0 source 1 size 161 accessed 1 times before, last time 2025-11-03T16:51:24.000000Z
2025-11-03T16:51:24.385990Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 1 partno 0 count 1 parts_count 0 source 1 size 160 accessed 0 times before, last time 2025-11-03T16:51:24.000000Z
2025-11-03T16:51:24.386017Z node 2 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 4. All 2 blobs are from cache.
2025-11-03T16:51:24.386054Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:572: FormAnswer for 2 blobs
2025-11-03T16:51:24.386156Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 0 totakecount 1 count 1 size 141 from pos 0 cbcount 1
2025-11-03T16:51:24.386232Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 1 totakecount 1 count 1 size 140 from pos 0 cbcount 1
2025-11-03T16:51:24.386305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-03T16:51:24.386926Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 0 suffix '63'
2025-11-03T16:51:24.386950Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 1 partno 0 count 1 parts 0 suffix '63'
2025-11-03T16:51:24.392227Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_1_1_925615705237884016_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 2 Result { Offset: 0 Data: "... 84 bytes ..." SourceId: "\000test-message-group-id" SeqNo: 1 WriteTimestampMS: 1762188684247 CreateTimestampMS: 1762188684244 UncompressedSize: 13 PartitionKey: "" ExplicitHash: "" } Result { Offset: 1 Data: "... 83 bytes ..." SourceId: "\000test-message-group-id" SeqNo: 2 WriteTimestampMS: 1762188684252 CreateTimestampMS: 1762188684245 UncompressedSize: 12 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 2 SizeLag: 41 RealReadOffset: 1 WaitQuotaTimeMs: 0 EndOffset: 2 StartOffset: 0 } Cookie: 0 }
2025-11-03T16:51:24.392418Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_1_1_925615705237884016_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 1 from offset 2
2025-11-03T16:51:24.392472Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_1_1_925615705237884016_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 2 ReadOffset 2 ReadGuid 38fc5cf6-4c5b517b-dde97cf9-35371a46 has messages 1
2025-11-03T16:51:24.392601Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_1_1_925615705237884016_v1 read done: guid# 38fc5cf6-4c5b517b-dde97cf9-35371a46, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 351
2025-11-03T16:51:24.392634Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_1_1_925615705237884016_v1 response to read: guid# 38fc5cf6-4c5b517b-dde97cf9-35371a46
2025-11-03T16:51:24.392933Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_1_1_925615705237884016_v1 Process answer. Aval parts: 0
2025-11-03T16:51:24.393976Z :DEBUG: [/Root] [/Root] [78a8578e-5bf8de0d-fb22d838-fd501cbb] [dc1] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:51:24.394215Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 0 (0-1)
2025-11-03T16:51:24.394324Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (0-0)
2025-11-03T16:51:24.394365Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 0} (1-1)
Got messages
totalReceived: 2 wait: 2
2025-11-03T16:51:24.394849Z :DEBUG: [/Root] [/Root] [78a8578e-5bf8de0d-fb22d838-fd501cbb] [dc1] The application data is transferred to the client. Number of messages 2, size 25 bytes
2025-11-03T16:51:24.395155Z :INFO: [/Root] [/Root] [78a8578e-5bf8de0d-fb22d838-fd501cbb] Closing read session. Close timeout: 0.000000s
2025-11-03T16:51:24.395198Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): dc1:test-topic:0:1:1:0
2025-11-03T16:51:24.395222Z :INFO: [/Root] [/Root] [78a8578e-5bf8de0d-fb22d838-fd501cbb] Counters: { Errors: 0 CurrentSessionLifetimeMs: 48 BytesRead: 25 MessagesRead: 2 BytesReadCompressed: 25 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-11-03T16:51:24.395292Z :NOTICE: [/Root] [/Root] [78a8578e-5bf8de0d-fb22d838-fd501cbb] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Close with zero timeout " }
2025-11-03T16:51:24.395328Z :DEBUG: [/Root] [/Root] [78a8578e-5bf8de0d-fb22d838-fd501cbb] [dc1] Abort session to cluster
2025-11-03T16:51:24.395648Z :NOTICE: [/Root] [/Root] [78a8578e-5bf8de0d-fb22d838-fd501cbb] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
Start read
2025-11-03T16:51:24.395839Z :INFO: [/Root] [/Root] [5db8ca64-1d2b2d70-833ebca7-50455856] Starting read session
2025-11-03T16:51:24.395856Z :DEBUG: [/Root] [/Root] [5db8ca64-1d2b2d70-833ebca7-50455856] Starting cluster discovery
2025-11-03T16:51:24.397080Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_1_1_925615705237884016_v1 grpc read done: success# 1, data# { read { } }
2025-11-03T16:51:24.397120Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:92: session cookie 1 consumer shared/user session shared/user_1_1_925615705237884016_v1 grpc closed
2025-11-03T16:51:24.397158Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 1 consumer shared/user session shared/user_1_1_925615705237884016_v1 is DEAD
2025-11-03T16:51:24.400083Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1659: [72075186224037893][rt3.dc1--test-topic] pipe [1:7568542770748157626:2475] disconnected.
2025-11-03T16:51:24.400129Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1670: [72075186224037893][rt3.dc1--test-topic] pipe [1:7568542770748157626:2475] disconnected; active server actors: 1
2025-11-03T16:51:24.400160Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1679: [72075186224037893][rt3.dc1--test-topic] pipe [1:7568542770748157626:2475] client user disconnected session shared/user_1_1_925615705237884016_v1
2025-11-03T16:51:24.398321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2258: [PQ: 72075186224037892] Destroy direct read session shared/user_1_1_925615705237884016_v1
2025-11-03T16:51:24.398372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [1:7568542770748157629:2478] destroyed
2025-11-03T16:51:24.398438Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_1_925615705237884016_v1
2025-11-03T16:51:24.403477Z :DEBUG: [/Root] [/Root] [5db8ca64-1d2b2d70-833ebca7-50455856] Cluster discovery request succeeded
2025-11-03T16:51:24.403548Z :DEBUG: [/Root] [/Root] [5db8ca64-1d2b2d70-833ebca7-50455856] Starting session to cluster dc1 (localhost:26148)
2025-11-03T16:51:24.403655Z :DEBUG: [/Root] [/Root] [5db8ca64-1d2b2d70-833ebca7-50455856] [dc1] In Reconnect, ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:51:24.403701Z :DEBUG: [/Root] [/Root] [5db8ca64-1d2b2d70-833ebca7-50455856] [dc1] New values: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:51:24.403737Z :DEBUG: [/Root] [/Root] [5db8ca64-1d2b2d70-833ebca7-50455856] [dc1] Reconnecting session to cluster dc1 in 0.000000s
2025-11-03T16:51:24.413856Z :DEBUG: [/Root] [/Root] [5db8ca64-1d2b2d70-833ebca7-50455856] [dc1] Successfully connected. Initializing session
2025-11-03T16:51:24.414534Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:109: new grpc connection
2025-11-03T16:51:24.414558Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:131: new session created cookie 2
2025-11-03T16:51:24.417053Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 2 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { topic: "test-topic" } read_only_original: true consumer: "shared/user" read_params { max_read_size: 104857600 } } }
2025-11-03T16:51:24.417241Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 2 consumer shared/user session shared/user_1_2_17679447807135311148_v1 read init: from# ipv6:[::1]:49352, request# { init_request { topics_read_settings { topic: "test-topic" } read_only_original: true consumer: "shared/user" read_params { max_read_size: 104857600 } } }
2025-11-03T16:51:24.417586Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 2 consumer shared/user session shared/user_1_2_17679447807135311148_v1 auth for : user
2025-11-03T16:51:24.418386Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 2 consumer shared/user session shared/user_1_2_17679447807135311148_v1 Handle describe topics response
2025-11-03T16:51:24.418474Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 2 consumer shared/user session shared/user_1_2_17679447807135311148_v1 auth is DEAD
2025-11-03T16:51:24.418538Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 2 consumer shared/user session shared/user_1_2_17679447807135311148_v1 auth ok: topics# 1, initDone# 0
2025-11-03T16:51:24.419339Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 2 consumer shared/user session shared/user_1_2_17679447807135311148_v1 register session: topic# rt3.dc1--test-topic
2025-11-03T16:51:24.420110Z :INFO: [/Root] [/Root] [5db8ca64-1d2b2d70-833ebca7-50455856] [dc1] Server session id: shared/user_1_2_17679447807135311148_v1
2025-11-03T16:51:24.420313Z :DEBUG: [/Root] [/Root] [5db8ca64-1d2b2d70-833ebca7-50455856] [dc1] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:51:24.422640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [1:7568542770748157639:2483], now have 1 active actors on pipe
2025-11-03T16:51:24.423158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:24.423183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:24.423211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1748: [PQ: 72075186224037892] Created session shared/user_1_2_17679447807135311148_v1 on pipe: [1:7568542770748157639:2483]
2025-11-03T16:51:24.423275Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:24.423293Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:24.423301Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-03T16:51:24.423301Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_2_17679447807135311148_v1:1 with generation 1
2025-11-03T16:51:24.423351Z node 2 :PERSQUEUE DEBUG: partition.cpp:3666: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_1_2_17679447807135311148_v1
2025-11-03T16:51:24.423363Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:24.423465Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-03T16:51:24.420992Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1655: [72075186224037893][rt3.dc1--test-topic] pipe [1:7568542770748157636:2480] connected; active server actors: 1
2025-11-03T16:51:24.421099Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1706: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [1:7568542770748157636:2480] session shared/user_1_2_17679447807135311148_v1
2025-11-03T16:51:24.421136Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:639: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-11-03T16:51:24.421172Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:669: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-11-03T16:51:24.421202Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:871: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_1_2_17679447807135311148_v1" (Sender=[1:7568542770748157633:2480], Pipe=[1:7568542770748157636:2480], Partitions=[], ActiveFamilyCount=0)
2025-11-03T16:51:24.421218Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1186: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-11-03T16:51:24.421252Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1258: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-11-03T16:51:24.421347Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1305: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_2_17679447807135311148_v1" (Sender=[1:7568542770748157633:2480], Pipe=[1:7568542770748157636:2480], Partitions=[], ActiveFamilyCount=0)
2025-11-03T16:51:24.421400Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:549: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_1_2_17679447807135311148_v1" sender [1:7568542770748157633:2480] lock partition 0 for ReadingSession "shared/user_1_2_17679447807135311148_v1" (Sender=[1:7568542770748157633:2480], Pipe=[1:7568542770748157636:2480], Partitions=[], ActiveFamilyCount=1) generation 1 step 2
2025-11-03T16:51:24.421433Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1325: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-11-03T16:51:24.421450Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1402: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000183s
2025-11-03T16:51:24.422035Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 2 consumer shared/user session shared/user_1_2_17679447807135311148_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 2 Session: "shared/user_1_2_17679447807135311148_v1" ClientId: "user" PipeClient { RawX1: 7568542770748157636 RawX2: 4503603922340272 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-11-03T16:51:24.422090Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 2 consumer shared/user session shared/user_1_2_17679447807135311148_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-11-03T16:51:24.422946Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_17679447807135311148_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 1, pipe: [1:7568542770748157639:2483]
2025-11-03T16:51:24.426599Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 2 consumer shared/user session shared/user_1_2_17679447807135311148_v1 grpc read done: success# 1, data# { read { } }
2025-11-03T16:51:24.426777Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 2 consumer shared/user session shared/user_1_2_17679447807135311148_v1 got read request: guid# f58fd748-392df7bf-5b72489b-a927a86a
2025-11-03T16:51:24.427473Z node 2 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-03T16:51:24.427539Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-11-03T16:51:24.427563Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:24.427573Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:24.427583Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:24.427610Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:51:24.427641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-11-03T16:51:24.428877Z :INFO: [/Root] [/Root] [5db8ca64-1d2b2d70-833ebca7-50455856] [dc1] Confirm partition stream create. Partition stream id: 1. Cluster: "dc1". Topic: "test-topic". Partition: 0. Read offset: (NULL)
2025-11-03T16:51:24.428186Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 2 consumer shared/user session shared/user_1_2_17679447807135311148_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 2 WriteTimestampMS: 1762188684247 CreateTimestampMS: 1762188684244 SizeLag: 322 WriteTimestampEstimateMS: 1762188684376 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-11-03T16:51:24.428216Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 2 consumer shared/user session shared/user_1_2_17679447807135311148_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 2 readOffset 0 committedOffset 0
2025-11-03T16:51:24.428247Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 2 consumer shared/user session shared/user_1_2_17679447807135311148_v1 sending to client partition status
2025-11-03T16:51:24.429699Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 2 consumer shared/user session shared/user_1_2_17679447807135311148_v1 grpc read done: success# 1, data# { start_read { topic { path: "test-topic" } cluster: "dc1" assign_id: 1 } }
2025-11-03T16:51:24.429816Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:539: session cookie 2 consumer shared/user session shared/user_1_2_17679447807135311148_v1 got StartRead from client: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 0, commitOffset# 0
2025-11-03T16:51:24.429849Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1023: session cookie 2 consumer shared/user session shared/user_1_2_17679447807135311148_v1 Start reading TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 2 readOffset 0 committedOffset 0 clientCommitOffset 0 clientReadOffset 0
2025-11-03T16:51:24.429866Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 2 consumer shared/user session shared/user_1_2_17679447807135311148_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 0 endOffset 2
2025-11-03T16:51:24.429904Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 2 consumer shared/user session shared/user_1_2_17679447807135311148_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 0, endOffset# 2, WTime# 1762188684247, sizeLag# 322
2025-11-03T16:51:24.429917Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 2 consumer shared/user session shared/user_1_2_17679447807135311148_v1TEvPartitionReady. Aval parts: 1
2025-11-03T16:51:24.429942Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 2 consumer shared/user session shared/user_1_2_17679447807135311148_v1 performing read request: guid# f58fd748-392df7bf-5b72489b-a927a86a, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 2, size# 386, partitionsAsked# 1, maxTimeLag# 0ms
2025-11-03T16:51:24.429997Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 2 consumer shared/user session shared/user_1_2_17679447807135311148_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 2 maxSize 386 maxTimeLagMs 0 readTimestampMs 0 readOffset 0 EndOffset 2 ClientCommitOffset 0 committedOffset 0 Guid f58fd748-392df7bf-5b72489b-a927a86a
2025-11-03T16:51:24.430311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:24.430334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:24.430427Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:880: [72075186224037892][Partition][0][StateIdle] read cookie 5 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 partno 0 count 2 size 386 endOffset 2 max time lag 0ms effective offset 0
2025-11-03T16:51:24.430630Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1105: [72075186224037892][Partition][0][StateIdle] read cookie 5 added 2 blobs, size 321 count 2 last offset 1, current partition end offset: 2
2025-11-03T16:51:24.430644Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1121: [72075186224037892][Partition][0][StateIdle] Reading cookie 5. Send blob request.
2025-11-03T16:51:24.430680Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 0 partno 0 count 1 parts_count 0 source 1 size 161 accessed 2 times before, last time 2025-11-03T16:51:24.000000Z
2025-11-03T16:51:24.430691Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 1 partno 0 count 1 parts_count 0 source 1 size 160 accessed 1 times before, last time 2025-11-03T16:51:24.000000Z
2025-11-03T16:51:24.430709Z node 2 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 5. All 2 blobs are from cache.
2025-11-03T16:51:24.430760Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:572: FormAnswer for 2 blobs
2025-11-03T16:51:24.430831Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 0 totakecount 1 count 1 size 141 from pos 0 cbcount 1
2025-11-03T16:51:24.430863Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 0 suffix '63'
2025-11-03T16:51:24.430871Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 1 totakecount 1 count 1 size 140 from pos 0 cbcount 1
2025-11-03T16:51:24.430881Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 1 partno 0 count 1 parts 0 suffix '63'
2025-11-03T16:51:24.430922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-03T16:51:24.432311Z :DEBUG: [/Root] [/Root] [5db8ca64-1d2b2d70-833ebca7-50455856] [dc1] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:51:24.432483Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 0 (0-1)
2025-11-03T16:51:24.432657Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (0-0)
2025-11-03T16:51:24.432716Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 0} (1-1)
Got messages
2025-11-03T16:51:24.431396Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 2 consumer shared/user session shared/user_1_2_17679447807135311148_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 2 Result { Offset: 0 Data: "... 84 bytes ..." SourceId: "\000test-message-group-id" SeqNo: 1 WriteTimestampMS: 1762188684247 CreateTimestampMS: 1762188684244 UncompressedSize: 13 PartitionKey: "" ExplicitHash: "" } Result { Offset: 1 Data: "... 83 bytes ..." SourceId: "\000test-message-group-id" SeqNo: 2 WriteTimestampMS: 1762188684252 CreateTimestampMS: 1762188684245 UncompressedSize: 12 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 2 SizeLag: 41 RealReadOffset: 1 WaitQuotaTimeMs: 0 EndOffset: 2 StartOffset: 0 } Cookie: 0 }
2025-11-03T16:51:24.431495Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 2 consumer shared/user session shared/user_1_2_17679447807135311148_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 1 from offset 2
2025-11-03T16:51:24.431522Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 2 consumer shared/user session shared/user_1_2_17679447807135311148_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 2 ReadOffset 2 ReadGuid f58fd748-392df7bf-5b72489b-a927a86a has messages 1
2025-11-03T16:51:24.431597Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 2 consumer shared/user session shared/user_1_2_17679447807135311148_v1 read done: guid# f58fd748-392df7bf-5b72489b-a927a86a, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 351
totalReceived: 2 wait: 2
2025-11-03T16:51:24.431614Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 2 consumer shared/user session shared/user_1_2_17679447807135311148_v1 response to read: guid# f58fd748-392df7bf-5b72489b-a927a86a
2025-11-03T16:51:24.431758Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 2 consumer shared/user session shared/user_1_2_17679447807135311148_v1 Process answer. Aval parts: 0
2025-11-03T16:51:24.433049Z :DEBUG: [/Root] [/Root] [5db8ca64-1d2b2d70-833ebca7-50455856] [dc1] The application data is transferred to the client. Number of messages 2, size 25 bytes
2025-11-03T16:51:24.433070Z :INFO: [/Root] [/Root] [5db8ca64-1d2b2d70-833ebca7-50455856] Closing read session. Close timeout: 0.000000s
2025-11-03T16:51:24.433120Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): dc1:test-topic:0:1:1:0
2025-11-03T16:51:24.433164Z :INFO: [/Root] [/Root] [5db8ca64-1d2b2d70-833ebca7-50455856] Counters: { Errors: 0 CurrentSessionLifetimeMs: 37 BytesRead: 25 MessagesRead: 2 BytesReadCompressed: 25 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-11-03T16:51:24.433260Z :NOTICE: [/Root] [/Root] [5db8ca64-1d2b2d70-833ebca7-50455856] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Close with zero timeout " }
2025-11-03T16:51:24.433305Z :DEBUG: [/Root] [/Root] [5db8ca64-1d2b2d70-833ebca7-50455856] [dc1] Abort session to cluster
2025-11-03T16:51:24.433127Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 2 consumer shared/user session shared/user_1_2_17679447807135311148_v1 grpc read done: success# 1, data# { read { } }
2025-11-03T16:51:24.433211Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 2 consumer shared/user session shared/user_1_2_17679447807135311148_v1 got read request: guid# 603955a2-724d7a10-ad7806a9-2ceb946b
2025-11-03T16:51:24.434056Z :NOTICE: [/Root] [/Root] [5db8ca64-1d2b2d70-833ebca7-50455856] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
2025-11-03T16:51:24.436505Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 2 consumer shared/user session shared/user_1_2_17679447807135311148_v1 grpc read done: success# 0, data# {  }
2025-11-03T16:51:24.436524Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:125: session cookie 2 consumer shared/user session shared/user_1_2_17679447807135311148_v1 grpc read failed
2025-11-03T16:51:24.436541Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:92: session cookie 2 consumer shared/user session shared/user_1_2_17679447807135311148_v1 grpc closed
2025-11-03T16:51:24.436562Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 2 consumer shared/user session shared/user_1_2_17679447807135311148_v1 is DEAD
2025-11-03T16:51:24.438374Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1659: [72075186224037893][rt3.dc1--test-topic] pipe [1:7568542770748157636:2480] disconnected.
2025-11-03T16:51:24.438401Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1670: [72075186224037893][rt3.dc1--test-topic] pipe [1:7568542770748157636:2480] disconnected; active server actors: 1
2025-11-03T16:51:24.438414Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1679: [72075186224037893][rt3.dc1--test-topic] pipe [1:7568542770748157636:2480] client user disconnected session shared/user_1_2_17679447807135311148_v1
2025-11-03T16:51:24.439072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2258: [PQ: 72075186224037892] Destroy direct read session shared/user_1_2_17679447807135311148_v1
2025-11-03T16:51:24.439105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [1:7568542770748157639:2483] destroyed
2025-11-03T16:51:24.439160Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_2_17679447807135311148_v1
2025-11-03T16:51:24.463640Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:24.463663Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:24.463673Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:24.565397Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:24.565422Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:24.565433Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:24.668523Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:24.668552Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:24.668571Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:25.831556Z :WriteGZIP INFO: Random seed for debugging is 1762188685831536
2025-11-03T16:51:26.691185Z node 3 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[3:7568542779396476746:2082];send_to=[0:7307199536658146131:7762515];
2025-11-03T16:51:26.694311Z node 3 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
2025-11-03T16:51:26.723754Z node 3 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-11-03T16:51:26.724694Z node 3 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-11-03T16:51:26.725550Z node 4 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[4:7568542775757699033:2151];send_to=[0:7307199536658146131:7762515];
2025-11-03T16:51:26.725948Z node 4 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
test_client.cpp: SetPath # /home/runner/.ya/build/build_root/7jz3/001998/r3tmp/tmpcIasnU/pdisk_1.dat
2025-11-03T16:51:26.737614Z node 4 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-11-03T16:51:26.739787Z node 4 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-11-03T16:51:26.934583Z node 3 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
2025-11-03T16:51:26.963092Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(3, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-11-03T16:51:26.963242Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(3, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-11-03T16:51:26.964913Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(4, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-11-03T16:51:26.965006Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(4, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-11-03T16:51:26.972019Z node 3 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-11-03T16:51:26.977945Z node 3 :HIVE WARN: hive_impl.cpp:811: HIVE#72057594037968897 Handle TEvInterconnect::TEvNodeConnected, NodeId 4 Cookie 4
2025-11-03T16:51:26.978121Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(3, (0,0,0,0)) VolatileState: Connecting -> Connected
2025-11-03T16:51:26.979814Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(4, (0,0,0,0)) VolatileState: Connecting -> Connected
2025-11-03T16:51:26.996221Z node 4 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
TServer::EnableGrpc on GrpcPort 4930, node 3
2025-11-03T16:51:27.135022Z node 3 :NET_CLASSIFIER WARN: net_classifier.cpp:190: distributable config is empty, broken or outdated, will use file: /home/runner/.ya/build/build_root/7jz3/001998/r3tmp/yandexeBx6AL.tmp
2025-11-03T16:51:27.135050Z node 3 :NET_CLASSIFIER WARN: net_classifier.cpp:196: will try to initialize from file: /home/runner/.ya/build/build_root/7jz3/001998/r3tmp/yandexeBx6AL.tmp
2025-11-03T16:51:27.135233Z node 3 :NET_CLASSIFIER WARN: net_classifier.cpp:202: successfully initialized from file: /home/runner/.ya/build/build_root/7jz3/001998/r3tmp/yandexeBx6AL.tmp
2025-11-03T16:51:27.135411Z node 3 :NET_CLASSIFIER ERROR: net_classifier.cpp:228: got bad distributable configuration
2025-11-03T16:51:27.171512Z INFO: TTestServer started on Port 12152 GrpcPort 4930
TClient is connected to server localhost:12152
PQClient connected to localhost:4930
WaitRootIsUp 'Root'...
TClient::Ls request: Root
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "Root"
    PathId: 1
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 1
    CreateStep: 0
    ParentPathId: 1
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 1
      SubDomainVersion: 0
      SecurityStateVersion: 0
    }
    ChildrenExist: false
  }
  Children {
    Name: ".sys"
    PathId: 18446744073709551615
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 0
    CreateStep: 0
    ParentPathId: 18446744073709551615
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 0
      Pl...
(TRUNCATED)
WaitRootIsUp 'Root' success.
2025-11-03T16:51:27.395228Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpAlterSubDomain, opId: 281474976710657:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_alter_subdomain.cpp:311)
waiting...
2025-11-03T16:51:27.425803Z node 3 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
waiting...
waiting...
waiting...
2025-11-03T16:51:27.696873Z node 3 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-11-03T16:51:27.735019Z node 4 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-11-03T16:51:31.009742Z node 3 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [3:7568542800871314198:2329], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-03T16:51:31.009842Z node 3 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-03T16:51:31.010171Z node 3 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [3:7568542800871314210:2332], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-03T16:51:31.015305Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateResourcePool, opId: 281474976710661:3, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_resource_pool.cpp:179)
2025-11-03T16:51:31.078082Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__notify.cpp:122: NotifyTxCompletion, unknown transaction, txId: 281474976710661, at schemeshard: 72057594046644480
2025-11-03T16:51:31.085793Z node 3 :KQP_WORKLOAD_SERVICE WARN: helpers.h:73: [WorkloadService] [TPoolCreatorActor] ActorId: [3:7568542800871314212:2333], DatabaseId: /Root, PoolId: default, Scheduled retry for error: { <main>: Error: Transaction 281474976710661 completed, doublechecking }
2025-11-03T16:51:31.089442Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710662:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:690)
2025-11-03T16:51:31.130771Z node 4 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:570: Compilation failed, self: [4:7568542797232535765:2305], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-11-03T16:51:31.135475Z node 4 :KQP_SESSION WARN: kqp_session_actor.cpp:2506: SessionId: ydb://session/3?node_id=4&id=YThkMzQ1MzQtNTQxNDIyZjYtMWM1ZmRmY2QtODVmNmU0NDU=, ActorId: [4:7568542797232535746:2299], ActorState: ExecuteState, TraceId: 01k95a31ky6a5skp9zjbbywhe2, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-11-03T16:51:31.135883Z node 4 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-11-03T16:51:31.164890Z node 3 :TX_PROXY ERROR: schemereq.cpp:593: Actor# [3:7568542800871314377:2726] txid# 281474976710663, issues: { message: "Check failed: path: \'/Root/.metadata/workload_manager/pools/default\', error: path exist, request accepts it (id: [OwnerId: 72057594046644480, LocalPathId: 8], type: EPathTypeResourcePool, state: EPathStateNoChanges)" severity: 1 }
2025-11-03T16:51:31.199505Z node 3 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:570: Compilation failed, self: [3:7568542800871314390:2345], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:5:17: Error: At function: KiReadTable!
        <main>:5:17: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Versions]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-11-03T16:51:31.199777Z node 3 :KQP_SESSION WARN: kqp_session_actor.cpp:2506: SessionId: ydb://session/3?node_id=3&id=NDg3MDk0MzQtOWU5ZjdiZjYtYTg2MzNkOGItMWE4YzFhZWE=, ActorId: [3:7568542800871314179:2326], ActorState: ExecuteState, TraceId: 01k95a31hzbtzqxvpdvmcap80w, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-11-03T16:51:31.199810Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710664:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:690)
2025-11-03T16:51:31.200350Z node 3 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 5 column: 17 } message: "At function: KiReadTable!" end_position { row: 5 column: 17 } severity: 1 issues { position { row: 5 column: 17 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Versions]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 5 column: 17 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-11-03T16:51:31.379395Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710665:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:690)
=== Init DC: UPSERT INTO `/Root/PQ/Config/V2/Cluster` (name, balancer, local, enabled, weight) VALUES ("dc1", "localhost:4930", true, true, 1000);
2025-11-03T16:51:31.691284Z node 3 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[3:7568542779396476746:2082];send_to=[0:7307199536658146131:7762515];
2025-11-03T16:51:31.692201Z node 3 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
2025-11-03T16:51:31.695232Z node 3 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976710666. Ctx: { TraceId: 01k95a321s0zw372tc4hc80pvr, Database: , SessionId: ydb://session/3?node_id=3&id=MWYxNWZkZTYtMzQ1ZTBlMmYtOGI2MjllYjQtMjQ0ZWQxYQ==, PoolId: default, DatabaseId: /Root}. Database not set, use /Root
=== CheckClustersList. Subcribe to ClusterTracker from [3:7568542800871314714:2977] 
2025-11-03T16:51:31.724979Z node 4 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[4:7568542775757699033:2151];send_to=[0:7307199536658146131:7762515];
2025-11-03T16:51:31.725059Z node 4 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
=== CheckClustersList. Ok
2025-11-03T16:51:39.032178Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710671:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:690)
waiting...
PQ Client: create topic: rt3.dc1--test-topic with 1 partitions
CallPersQueueGRPC request to localhost:4930
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-11-03T16:51:39.138038Z node 3 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
CallPersQueueGRPC request to localhost:4930
MetaRequest {
  CmdCreateTopic {
    Topic: "rt3.dc1--test-topic"
    NumPartitions: 1
    Config {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
  }
}
CallPersQueueGRPC response:
Status: 129
ProxyErrorCode: 53
SchemeStatus: 1
FlatTxId {
  TxId: 281474976710672
  SchemeShardTabletId: 72057594046644480
  PathId: 13
}
ErrorCode: OK
AddTopic: rt3.dc1--test-topic
===Run query:``DECLARE $version as Int64; DECLARE $path AS Utf8; DECLARE $cluster as Utf8; UPSERT INTO `/Root/PQ/Config/V2/Topics` (path, dc) VALUES ($path, $cluster); UPSERT INTO `/Root/PQ/Config/V2/Versions` (name, version) VALUES ("Topics", $version);`` with topic = test-topic, dc = dc1
2025-11-03T16:51:39.190164Z node 3 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1655: [72075186224037893][] pipe [3:7568542835231053519:3259] connected; active server actors: 1
2025-11-03T16:51:39.190360Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1519: [72075186224037893][rt3.dc1--test-topic] updating configuration. Deleted partitions []. Added partitions [0]
2025-11-03T16:51:39.190832Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:971: [72075186224037893][rt3.dc1--test-topic] Discovered subdomain [OwnerId: 72057594046644480, LocalPathId: 1] state, outOfSpace = 0 at RB 72075186224037893
2025-11-03T16:51:39.191894Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:140: [72075186224037893][rt3.dc1--test-topic] BALANCER INIT DONE for rt3.dc1--test-topic: (0, 72075186224037892) 
2025-11-03T16:51:39.188288Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2960: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-11-03T16:51:39.192316Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2992: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-11-03T16:51:39.192592Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:787: [PQ: 72075186224037892] no config, start with empty partitions and default config
2025-11-03T16:51:39.192624Z node 4 :PERSQUEUE NOTICE: pq_impl.cpp:913: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-11-03T16:51:39.192666Z node 4 :PERSQUEUE INFO: pq_impl.cpp:612: [PQ: 72075186224037892] doesn't have tx writes info
2025-11-03T16:51:39.193065Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [3:7568542835231053542:2441], now have 1 active actors on pipe
2025-11-03T16:51:39.193104Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [3:7568542835231053518:3258], now have 1 active actors on pipe
2025-11-03T16:51:39.193842Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-03T16:51:39.193894Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:404: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 4, Generation 1
2025-11-03T16:51:39.201497Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-03T16:51:39.214281Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [3:7568542835231053565:3295], now have 1 active actors on pipe
2025-11-03T16:51:39.215320Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-03T16:51:39.225939Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-03T16:51:39.227227Z node 4 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-11-03T16:51:39.227279Z node 4 :PERSQUEUE DEBUG: partition.cpp:1312: [72075186224037892][Partition][0][StateInit] HandleOnInit TEvPQ::TEvProposePartitionConfig
2025-11-03T16:51:39.227652Z node 4 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-11-03T16:51:39.227933Z node 4 :PERSQUEUE INFO: partition_init.cpp:1101: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [4:7568542831592274582:2380]
2025-11-03T16:51:39.231715Z node 4 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-11-03T16:51:39.231758Z node 4 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-11-03T16:51:39.231784Z node 4 :PERSQUEUE INFO: partition.cpp:707: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1 [4:7568542831592274582:2380]
2025-11-03T16:51:39.231813Z node 4 :PERSQUEUE DEBUG: partition.cpp:727: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 0 Head Offset 0 PartNo 0 PackedSize 0 count 0 nextOffset 0 batches 0
2025-11-03T16:51:39.231851Z node 4 :PERSQUEUE DEBUG: partition_mlp.cpp:83: [72075186224037892][Partition][0][StateIdle] Initializing MLP Consumers: 0
2025-11-03T16:51:39.233464Z node 4 :PERSQUEUE DEBUG: partition.cpp:4273: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 1
2025-11-03T16:51:39.233533Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:39.233623Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:39.233639Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-03T16:51:39.233664Z node 4 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-11-03T16:51:39.233680Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:39.233694Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:39.233706Z node 4 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-11-03T16:51:39.233739Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:923: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-11-03T16:51:39.233779Z node 4 :PERSQUEUE DEBUG: partition_mlp.cpp:60: [72075186224037892][Partition][0][StateIdle] Process MLP pending events. Count 0
2025-11-03T16:51:39.234799Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-03T16:51:39.234980Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:183: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:51:39.246681Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-03T16:51:39.246851Z node 4 :PERSQUEUE DEBUG: partition.cpp:1416: [72075186224037892][Partition][0][StateIdle] Handle TEvPQ::TEvTxCommit Step 1762188699257, TxId 281474976710672
2025-11-03T16:51:39.246884Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:39.246899Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:39.247034Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:39.247285Z node 4 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-03T16:51:39.255844Z node 4 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-03T16:51:39.256043Z node 4 :PERSQUEUE DEBUG: partition_mlp.cpp:83: [72075186224037892][Partition][0][StateIdle] Initializing MLP Consumers: 0
2025-11-03T16:51:39.256188Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-11-03T16:51:39.256225Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:39.256238Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:39.256252Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:39.256288Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:183: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:51:39.256651Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:398: [PQ: 72075186224037892] Apply new config PartitionConfig { LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 } PartitionIds: 0 TopicName: "rt3.dc1--test-topic" Version: 0 LocalDC: true Codecs { Ids: 0 Ids: 1 Ids: 2 Codecs: "raw" Codecs: "gzip" Codecs: "lzop" } TopicPath: "/Root/PQ/rt3.dc1--test-topic" YcCloudId: "" YcFolderId: "" YdbDatabaseId: "" YdbDatabasePath: "/Root" Partitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } AllPartitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } Consumers { Name: "user" ReadFromTimestampsMs: 0 FormatVersion: 0 Version: 0 Generation: 0 } MonitoringProjectId: ""
2025-11-03T16:51:39.256763Z node 4 :PERSQUEUE NOTICE: pq_impl.cpp:913: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-11-03T16:51:39.257066Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-03T16:51:39.275046Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-03T16:51:39.275174Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-03T16:51:39.279833Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-03T16:51:39.334436Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:39.334473Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:39.334487Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:39.349802Z node 3 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976710673. Ctx: { TraceId: 01k95a39j64p96sw3nchn0dpbb, Database: , SessionId: ydb://session/3?node_id=3&id=OTY5MjdiZTAtYzRmNWUwODctOWIwOTE2NC1mNDExYTRjNw==, PoolId: default, DatabaseId: /Root}. Database not set, use /Root
===Query complete
TClient::Ls request: /Root/PQ/rt3.dc1--test-topic
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976710672
    CreateStep: 1762188699257
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts...
(TRUNCATED)
GetTopicVersionFromPath:  record Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976710672
    CreateStep: 1762188699257
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      YdbDatabasePath: "/Root"
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
    Partitions {
      PartitionId: 0
      TabletId: 72075186224037892
      Status: Active
    }
    AlterVersion: 1
    BalancerTabletID: 72075186224037893
    NextPartitionId: 1
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 1
      PlanResolution: 7
      Coordinators: 72057594046316545
      TimeCastBucketsPerMediator: 2
      Mediators: 72057594046382081
    }
    DomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    PathsInside: 12
    PathsLimit: 10000
    ShardsInside: 6
    ShardsLimit: 200000
    ResourcesDomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    DiskSpaceUsage {
      Tables {
        TotalSize: 0
        DataSize: 0
        IndexSize: 0
      }
      Topics {
        ReserveSize: 0
        AccountSize: 0
        DataSize: 0
        UsedReserveSize: 0
      }
    }
    PQPartitionsInside: 1
    PQPartitionsLimit: 1000000
    SchemeLimits {
      MaxDepth: 32
      MaxPaths: 10000
      MaxChildrenInDir: 100000
      MaxAclBytesSize: 10240
      MaxTableColumns: 200
      MaxTableColumnNameLength: 255
      MaxTableKeyColumns: 30
      MaxTableIndices: 20
      MaxShards: 200000
      MaxShardsInPath: 35000
      MaxConsistentCopyTargets: 10000
      MaxPathElementLength: 255
      ExtraPathSymbolsAllowed: "!\"#$%&\'()*+,-.:;<=>?@[\\]^_`{|}~"
      MaxPQPartitions: 1000000
      MaxTableCdcStreams: 5
      MaxExports: 10
      MaxImports: 10
      MaxColumnTableColumns: 10000
    }
  }
}
Path: "/Root/PQ/rt3.dc1--test-topic"
 name rt3.dc1--test-topic version1
CallPersQueueGRPC request to localhost:4930
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-11-03T16:51:39.426455Z node 3 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
MetaResponse {
  CmdGetTopicMetadataResult {
    TopicInfo {
      Topic: "rt3.dc1--test-topic"
      NumPartitions: 1
      Config {
        PartitionConfig {
          LifetimeSeconds: 86400
          LowWatermark: 8388608
          SourceIdLifetimeSeconds: 86400
          WriteSpeedInBytesPerSecond: 20000000
          BurstSize: 20000000
          SourceIdMaxCounts: 6000000
        }
        Version: 1
        LocalDC: true
        Codecs {
          Ids: 0
          Ids: 1
          Ids: 2
          Codecs: "raw"
          Codecs: "gzip"
          Codecs: "lzop"
        }
        TopicPath: "/Root/PQ/rt3.dc1--test-topic"
        YdbDatabasePath: "/Root"
        Consumers {
          Name: "user"
          ReadFromTimestampsMs: 0
          FormatVersion: 0
          Version: 0
        }
      }
      ErrorCode: OK
    }
  }
}
=== Topic created, have version: 1
2025-11-03T16:51:39.437993Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:39.438036Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:39.438056Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:39.444897Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: try to update token
2025-11-03T16:51:39.445375Z :INFO: [] MessageGroupId [src] SessionId [] Write session: Do CDS request
2025-11-03T16:51:39.445416Z :INFO: [] MessageGroupId [src] SessionId [] Start write session. Will connect to endpoint: localhost:4930
2025-11-03T16:51:39.478219Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src" }
2025-11-03T16:51:39.479154Z node 3 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-11-03T16:51:39.479190Z node 3 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1
2025-11-03T16:51:39.479951Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src" }
2025-11-03T16:51:39.480100Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1 topic: "test-topic" message_group_id: "src" from ipv6:[::1]:40158
2025-11-03T16:51:39.480118Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40158 proto=v1  topic=test-topic durationSec=0
2025-11-03T16:51:39.480129Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-11-03T16:51:39.482029Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1 sessionId:  describe result for acl check
2025-11-03T16:51:39.482208Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-11-03T16:51:39.482234Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-11-03T16:51:39.482247Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-11-03T16:51:39.482265Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [3:7568542835231053654:2458] (SourceId=src, PreferedPartition=(NULL)) StartKqpSession
2025-11-03T16:51:39.488346Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [3:7568542835231053654:2458] (SourceId=src, PreferedPartition=(NULL)) Select from the table
2025-11-03T16:51:39.537349Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:39.537380Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:39.537394Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:39.644098Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:39.644135Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:39.644148Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:39.720325Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [3:7568542835231053654:2458] (SourceId=src, PreferedPartition=(NULL)) RequestPQRB
2025-11-03T16:51:39.720844Z node 3 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1655: [72075186224037893][rt3.dc1--test-topic] pipe [3:7568542835231053697:2458] connected; active server actors: 1
2025-11-03T16:51:39.720891Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [3:7568542835231053654:2458] (SourceId=src, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=src
2025-11-03T16:51:39.720911Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [3:7568542835231053654:2458] (SourceId=src, PreferedPartition=(NULL)) Update the table
2025-11-03T16:51:39.723582Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1659: [72075186224037893][rt3.dc1--test-topic] pipe [3:7568542835231053697:2458] disconnected.
2025-11-03T16:51:39.723637Z node 3 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1670: [72075186224037893][rt3.dc1--test-topic] pipe [3:7568542835231053697:2458] disconnected; active server actors: 1
2025-11-03T16:51:39.723659Z node 3 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1695: [72075186224037893][rt3.dc1--test-topic] pipe [3:7568542835231053697:2458] disconnected no session
2025-11-03T16:51:39.742626Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:39.742677Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:39.742692Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:39.847521Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:39.847555Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:39.847571Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:39.859364Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [3:7568542835231053654:2458] (SourceId=src, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-11-03T16:51:39.859400Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [3:7568542835231053654:2458] (SourceId=src, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-11-03T16:51:39.859413Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [3:7568542835231053654:2458] (SourceId=src, PreferedPartition=(NULL)) Start idle
2025-11-03T16:51:39.859437Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-11-03T16:51:39.860782Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [3:7568542835231053722:2458], now have 1 active actors on pipe
2025-11-03T16:51:39.861737Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:39.861779Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:39.861872Z node 4 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src|5f080a47-9da59d63-9d2f3536-d17a07c4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src
2025-11-03T16:51:39.861918Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:39.861942Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:39.861955Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-03T16:51:39.862000Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:39.862049Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-03T16:51:39.862101Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-03T16:51:39.861259Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 4, Generation: 1
2025-11-03T16:51:39.863533Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:39.863574Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:39.863694Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-03T16:51:39.865055Z :INFO: [] MessageGroupId [src] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1762188699865 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-11-03T16:51:39.865191Z :INFO: [] MessageGroupId [src] SessionId [] Write session established. Init response: session_id: "src|5f080a47-9da59d63-9d2f3536-d17a07c4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-11-03T16:51:39.865423Z :INFO: [] MessageGroupId [src] SessionId [src|5f080a47-9da59d63-9d2f3536-d17a07c4_0] Write session: close. Timeout = 0 ms
2025-11-03T16:51:39.865461Z :INFO: [] MessageGroupId [src] SessionId [src|5f080a47-9da59d63-9d2f3536-d17a07c4_0] Write session will now close
2025-11-03T16:51:39.865517Z :DEBUG: [] MessageGroupId [src] SessionId [src|5f080a47-9da59d63-9d2f3536-d17a07c4_0] Write session: aborting
2025-11-03T16:51:39.865988Z :INFO: [] MessageGroupId [src] SessionId [src|5f080a47-9da59d63-9d2f3536-d17a07c4_0] Write session: gracefully shut down, all writes complete
2025-11-03T16:51:39.866033Z :DEBUG: [] MessageGroupId [src] SessionId [src|5f080a47-9da59d63-9d2f3536-d17a07c4_0] Write session: destroy
2025-11-03T16:51:39.864077Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1 partition: 0 MaxSeqNo: 0 sessionId: src|5f080a47-9da59d63-9d2f3536-d17a07c4_0
2025-11-03T16:51:39.872206Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId: src|5f080a47-9da59d63-9d2f3536-d17a07c4_0 grpc read done: success: 0 data: 
2025-11-03T16:51:39.872225Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 1 sessionId: src|5f080a47-9da59d63-9d2f3536-d17a07c4_0 grpc read failed
2025-11-03T16:51:39.883752Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:824: session v1 closed cookie: 1 sessionId: src|5f080a47-9da59d63-9d2f3536-d17a07c4_0
2025-11-03T16:51:39.883791Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1 sessionId: src|5f080a47-9da59d63-9d2f3536-d17a07c4_0 is DEAD
2025-11-03T16:51:39.884295Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-11-03T16:51:39.892592Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [3:7568542835231053722:2458] destroyed
2025-11-03T16:51:39.892660Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-11-03T16:51:39.892692Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:39.892707Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:39.892721Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:39.898827Z node 3 :PQ_READ_PROXY DEBUG: grpc_pq_schema.cpp:207: new Alter topic request
2025-11-03T16:51:39.900647Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpAlterPersQueueGroup, opId: 281474976710676:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_alter_pq.cpp:313)
2025-11-03T16:51:39.933862Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-03T16:51:39.933504Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1519: [72075186224037893][rt3.dc1--test-topic] updating configuration. Deleted partitions []. Added partitions []
2025-11-03T16:51:39.946096Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-03T16:51:39.952107Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:39.952145Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:39.952162Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:39.968033Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-03T16:51:39.989272Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-03T16:51:39.989599Z node 4 :PERSQUEUE DEBUG: partition.cpp:1277: [72075186224037892][Partition][0][StateIdle] Handle TEvPQ::TEvProposePartitionConfig Step 1762188700006, TxId 281474976710676
2025-11-03T16:51:39.989626Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:39.989708Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:39.989721Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-03T16:51:39.989748Z node 4 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-11-03T16:51:39.989965Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-03T16:51:40.008180Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-03T16:51:40.008346Z node 4 :PERSQUEUE DEBUG: partition.cpp:1416: [72075186224037892][Partition][0][StateIdle] Handle TEvPQ::TEvTxCommit Step 1762188700006, TxId 281474976710676
2025-11-03T16:51:40.008374Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:40.008388Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:40.008564Z node 4 :PERSQUEUE DEBUG: partition.cpp:3622: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user reinit with generation 2 done
2025-11-03T16:51:40.008640Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:40.008907Z node 4 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-03T16:51:40.013227Z node 4 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-03T16:51:40.013450Z node 4 :PERSQUEUE DEBUG: partition_mlp.cpp:83: [72075186224037892][Partition][0][StateIdle] Initializing MLP Consumers: 0
2025-11-03T16:51:40.013600Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-11-03T16:51:40.013632Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:40.013646Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:40.013662Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:40.013698Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:183: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:51:40.014143Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:398: [PQ: 72075186224037892] Apply new config PartitionConfig { MaxCountInPartition: 2147483647 MaxSizeInPartition: 9223372036854775807 LifetimeSeconds: 86400 SourceIdLifetimeSeconds: 1382400 WriteSpeedInBytesPerSecond: 1048576 BurstSize: 1048576 TotalPartitions: 1 SourceIdMaxCounts: 6000000 } PartitionIds: 0 TopicName: "rt3.dc1--test-topic" Version: 2 LocalDC: true RequireAuthWrite: true RequireAuthRead: true Producer: "unknown" Ident: "unknown" Topic: "test-topic" DC: "dc1" FormatVersion: 0 Codecs { Ids: 0 Ids: 1 Ids: 3 Codecs: "raw" Codecs: "gzip" Codecs: "zstd" } TopicPath: "/Root/PQ/rt3.dc1--test-topic" YcCloudId: "" YcFolderId: "" YdbDatabaseId: "" YdbDatabasePath: "/Root" Partitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } AllPartitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 72075186224037892 } Consumers { Name: "user" ReadFromTimestampsMs: 0 FormatVersion: 0 Codec { Ids: 0 Ids: 1 Ids: 3 Codecs: "raw" Codecs: "gzip" Codecs: "zstd" } ServiceType: "data-streams" Version: 1 Generation: 2 } MonitoringProjectId: ""
2025-11-03T16:51:40.014173Z node 4 :PERSQUEUE NOTICE: pq_impl.cpp:913: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-11-03T16:51:40.014495Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
Alter topic response: { operation { ready: true status: SUCCESS } }
Alter result: {  }
2025-11-03T16:51:40.038979Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-03T16:51:40.039099Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-03T16:51:40.049924Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-03T16:51:40.056069Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:40.056103Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:40.056120Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:40.076085Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [] Write session: try to update token
2025-11-03T16:51:40.076593Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [] Write session: Do CDS request
2025-11-03T16:51:40.076657Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [] Do schedule cds request after 0 ms
2025-11-03T16:51:40.076787Z :INFO: [/Root] MessageGroupId [test-message-group-id] Running cds request ms
2025-11-03T16:51:40.095203Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [] Got CDS response: 
write_sessions_clusters { clusters { endpoint: "localhost:4930" name: "dc1" available: true } primary_cluster_selection_reason: CLIENT_LOCATION } version: 1
2025-11-03T16:51:40.095264Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [] Start write session. Will connect to endpoint: localhost:4930
2025-11-03T16:51:40.129841Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [] Write session: send init request: init_request { topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" }
2025-11-03T16:51:40.130678Z node 3 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-11-03T16:51:40.130715Z node 3 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2
2025-11-03T16:51:40.132601Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" }
2025-11-03T16:51:40.132760Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2 topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" from ipv6:[::1]:40208
2025-11-03T16:51:40.132777Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40208 proto=v1  topic=test-topic durationSec=0
2025-11-03T16:51:40.132788Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-11-03T16:51:40.135251Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2 sessionId:  describe result for acl check
2025-11-03T16:51:40.135408Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-11-03T16:51:40.135419Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-11-03T16:51:40.135430Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-11-03T16:51:40.135447Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [3:7568542839526021118:2485] (SourceId=test-message-group-id, PreferedPartition=(NULL)) StartKqpSession
2025-11-03T16:51:40.138514Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [3:7568542839526021118:2485] (SourceId=test-message-group-id, PreferedPartition=(NULL)) Select from the table
2025-11-03T16:51:40.159597Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:40.159629Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:40.159644Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:40.160042Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [3:7568542839526021118:2485] (SourceId=test-message-group-id, PreferedPartition=(NULL)) RequestPQRB
2025-11-03T16:51:40.160783Z node 3 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1655: [72075186224037893][rt3.dc1--test-topic] pipe [3:7568542839526021137:2485] connected; active server actors: 1
2025-11-03T16:51:40.160887Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [3:7568542839526021118:2485] (SourceId=test-message-group-id, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=test-message-group-id
2025-11-03T16:51:40.160908Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [3:7568542839526021118:2485] (SourceId=test-message-group-id, PreferedPartition=(NULL)) Update the table
2025-11-03T16:51:40.164094Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1659: [72075186224037893][rt3.dc1--test-topic] pipe [3:7568542839526021137:2485] disconnected.
2025-11-03T16:51:40.164126Z node 3 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1670: [72075186224037893][rt3.dc1--test-topic] pipe [3:7568542839526021137:2485] disconnected; active server actors: 1
2025-11-03T16:51:40.164146Z node 3 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1695: [72075186224037893][rt3.dc1--test-topic] pipe [3:7568542839526021137:2485] disconnected no session
2025-11-03T16:51:40.239034Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [3:7568542839526021118:2485] (SourceId=test-message-group-id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-11-03T16:51:40.239078Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [3:7568542839526021118:2485] (SourceId=test-message-group-id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-11-03T16:51:40.239096Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [3:7568542839526021118:2485] (SourceId=test-message-group-id, PreferedPartition=(NULL)) Start idle
2025-11-03T16:51:40.239126Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-11-03T16:51:40.243506Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [3:7568542839526021154:2485], now have 1 active actors on pipe
2025-11-03T16:51:40.243674Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 4, Generation: 1
2025-11-03T16:51:40.248203Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:40.248254Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:40.248348Z node 4 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie test-message-group-id|20cf8492-1dc27f22-52ab916e-449e33e9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner test-message-group-id
2025-11-03T16:51:40.248403Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:40.248424Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:40.248435Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-03T16:51:40.248480Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:40.248518Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-03T16:51:40.248583Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-03T16:51:40.255550Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:40.255609Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:40.255724Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-03T16:51:40.256563Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2 partition: 0 MaxSeqNo: 0 sessionId: test-message-group-id|20cf8492-1dc27f22-52ab916e-449e33e9_0
2025-11-03T16:51:40.260183Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:40.260208Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:40.260223Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:40.260600Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1762188700260 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-11-03T16:51:40.260747Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [] Write session established. Init response: session_id: "test-message-group-id|20cf8492-1dc27f22-52ab916e-449e33e9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_ZSTD
2025-11-03T16:51:40.262971Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|20cf8492-1dc27f22-52ab916e-449e33e9_0] Write 1 messages with Id from 1 to 1
2025-11-03T16:51:40.263100Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|20cf8492-1dc27f22-52ab916e-449e33e9_0] Write 1 messages with Id from 2 to 2
2025-11-03T16:51:40.263147Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|20cf8492-1dc27f22-52ab916e-449e33e9_0] Write session: close. Timeout = 18446744073709551 ms
2025-11-03T16:51:40.263791Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|20cf8492-1dc27f22-52ab916e-449e33e9_0] Write session: try to update token
2025-11-03T16:51:40.263915Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|20cf8492-1dc27f22-52ab916e-449e33e9_0] Send 1 message(s) (1 left), first sequence number is 1
2025-11-03T16:51:40.264715Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|20cf8492-1dc27f22-52ab916e-449e33e9_0] Write session: try to update token
2025-11-03T16:51:40.264768Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|20cf8492-1dc27f22-52ab916e-449e33e9_0] Send 1 message(s) (0 left), first sequence number is 2
2025-11-03T16:51:40.265327Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: test-message-group-id|20cf8492-1dc27f22-52ab916e-449e33e9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:51:40.265587Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:51:40.266344Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:40.266390Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:40.266468Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-11-03T16:51:40.271786Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: test-message-group-id|20cf8492-1dc27f22-52ab916e-449e33e9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:51:40.271868Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:40.272431Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:51:40.274699Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:40.274739Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:40.275058Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0test-message-group-id' SeqNo: 1 partNo : 0 messageNo: 1 size 104 offset: -1
2025-11-03T16:51:40.275116Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:40.275129Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:40.275156Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:51:40.275203Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:40.275227Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:40.275247Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-03T16:51:40.275402Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0test-message-group-id' seqNo 1 partNo 0
2025-11-03T16:51:40.276385Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0test-message-group-id' seqNo 1 partNo 0 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 193 count 1 nextOffset 1 batches 1
2025-11-03T16:51:40.276431Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:40.276864Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 0,1 HeadOffset 0 endOffset 0 curOffset 1 d0000000000_00000000000000000000_00000_0000000001_00000? size 181 WTime 1762188700276
2025-11-03T16:51:40.277039Z node 4 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-03T16:51:40.277140Z node 4 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 0 partNo 0 count 1 size 181
2025-11-03T16:51:40.277175Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 2  requestId: <none> cookie: 2
2025-11-03T16:51:40.281630Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:40.285514Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:40.285553Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:40.285607Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0test-message-group-id' SeqNo: 2 partNo : 0 messageNo: 3 size 103 offset: -1
2025-11-03T16:51:40.285791Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:51:40.285853Z node 4 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:51:40.285891Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 0 count 1 size 181 actorID [4:7568542831592274564:2380]
2025-11-03T16:51:40.285942Z node 4 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-03T16:51:40.285987Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 126 WriteNewSizeFromSupportivePartitions# 0
2025-11-03T16:51:40.286014Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:51:40.286048Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0test-message-group-id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 1, partNo: 0, Offset: 0 is stored on disk
2025-11-03T16:51:40.286233Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:923: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 2
2025-11-03T16:51:40.286254Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:965: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 2
2025-11-03T16:51:40.286275Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:40.286296Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:40.286307Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-03T16:51:40.286390Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0test-message-group-id' seqNo 2 partNo 0
2025-11-03T16:51:40.287383Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0test-message-group-id' seqNo 2 partNo 0 FormedBlobsCount 0 NewHead: Offset 1 PartNo 0 PackedSize 192 count 1 nextOffset 2 batches 1
2025-11-03T16:51:40.287416Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:40.287838Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 1,1 HeadOffset 1 endOffset 1 curOffset 2 d0000000000_00000000000000000001_00000_0000000001_00000? size 180 WTime 1762188700284
2025-11-03T16:51:40.287944Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:51:40.288014Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1  requestId: <none> cookie: 1
2025-11-03T16:51:40.288078Z node 4 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-03T16:51:40.288143Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 0 suffix '63' size 181
2025-11-03T16:51:40.288179Z node 4 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 1 partNo 0 count 1 size 180
2025-11-03T16:51:40.288382Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:880: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 partno 0 count 1 size 1024000 endOffset 1 max time lag 0ms effective offset 0
2025-11-03T16:51:40.288551Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:1105: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 181 count 1 last offset 0, current partition end offset: 1
2025-11-03T16:51:40.288566Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:1121: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-11-03T16:51:40.288632Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 0 partno 0 count 1 parts_count 0 source 1 size 181 accessed 0 times before, last time 2025-11-03T16:51:40.000000Z
2025-11-03T16:51:40.288669Z node 4 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 3. All 1 blobs are from cache.
2025-11-03T16:51:40.289019Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:572: FormAnswer for 1 blobs
2025-11-03T16:51:40.289127Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 0 totakecount 1 count 1 size 161 from pos 0 cbcount 1
2025-11-03T16:51:40.289186Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:1015: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1762188700272 queuesize 0 startOffset 0
2025-11-03T16:51:40.290805Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:40.289416Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 0 suffix '63'
2025-11-03T16:51:40.292862Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|20cf8492-1dc27f22-52ab916e-449e33e9_0] Write session got write response: sequence_numbers: 1 offsets: 0 already_written: false write_statistics { persist_duration_ms: 8 queued_in_partition_duration_ms: 3 }
2025-11-03T16:51:40.292913Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|20cf8492-1dc27f22-52ab916e-449e33e9_0] Write session: acknoledged message 1
2025-11-03T16:51:40.296655Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 1 count 1 size 180 actorID [4:7568542831592274564:2380]
2025-11-03T16:51:40.296726Z node 4 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-03T16:51:40.296774Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 125 WriteNewSizeFromSupportivePartitions# 0
2025-11-03T16:51:40.296803Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:51:40.296868Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0test-message-group-id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 2, partNo: 0, Offset: 1 is stored on disk
2025-11-03T16:51:40.297028Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:40.297040Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:40.297050Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:40.297080Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:51:40.297116Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 3  requestId: <none> cookie: 2
2025-11-03T16:51:40.297292Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 1 partno 0 count 1 parts 0 suffix '63' size 180
2025-11-03T16:51:40.298705Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:40.299925Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|20cf8492-1dc27f22-52ab916e-449e33e9_0] Write session got write response: sequence_numbers: 2 offsets: 1 already_written: false write_statistics { persist_duration_ms: 11 }
2025-11-03T16:51:40.300080Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|20cf8492-1dc27f22-52ab916e-449e33e9_0] Write session: acknoledged message 2
2025-11-03T16:51:40.363777Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|20cf8492-1dc27f22-52ab916e-449e33e9_0] Write session will now close
2025-11-03T16:51:40.363851Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|20cf8492-1dc27f22-52ab916e-449e33e9_0] Write session: aborting
2025-11-03T16:51:40.364276Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:40.364311Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:40.364327Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:40.365397Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|20cf8492-1dc27f22-52ab916e-449e33e9_0] Write session: gracefully shut down, all writes complete
2025-11-03T16:51:40.365449Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|20cf8492-1dc27f22-52ab916e-449e33e9_0] Write session: destroy
Start read
2025-11-03T16:51:40.365786Z :INFO: [/Root] [/Root] [e0f427f-a8e29bf9-ab9e7001-1ffa310a] Starting read session
2025-11-03T16:51:40.365823Z :DEBUG: [/Root] [/Root] [e0f427f-a8e29bf9-ab9e7001-1ffa310a] Starting cluster discovery
2025-11-03T16:51:40.372408Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: test-message-group-id|20cf8492-1dc27f22-52ab916e-449e33e9_0 grpc read done: success: 0 data: 
2025-11-03T16:51:40.372437Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 2 sessionId: test-message-group-id|20cf8492-1dc27f22-52ab916e-449e33e9_0 grpc read failed
2025-11-03T16:51:40.372471Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 2 sessionId: test-message-group-id|20cf8492-1dc27f22-52ab916e-449e33e9_0 grpc closed
2025-11-03T16:51:40.372490Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2 sessionId: test-message-group-id|20cf8492-1dc27f22-52ab916e-449e33e9_0 is DEAD
2025-11-03T16:51:40.373301Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-11-03T16:51:40.376362Z :DEBUG: [/Root] [/Root] [e0f427f-a8e29bf9-ab9e7001-1ffa310a] Cluster discovery request succeeded
2025-11-03T16:51:40.376473Z :DEBUG: [/Root] [/Root] [e0f427f-a8e29bf9-ab9e7001-1ffa310a] Starting session to cluster dc1 (localhost:4930)
2025-11-03T16:51:40.376630Z :DEBUG: [/Root] [/Root] [e0f427f-a8e29bf9-ab9e7001-1ffa310a] [dc1] In Reconnect, ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:51:40.376665Z :DEBUG: [/Root] [/Root] [e0f427f-a8e29bf9-ab9e7001-1ffa310a] [dc1] New values: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:51:40.376706Z :DEBUG: [/Root] [/Root] [e0f427f-a8e29bf9-ab9e7001-1ffa310a] [dc1] Reconnecting session to cluster dc1 in 0.000000s
2025-11-03T16:51:40.380093Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [3:7568542839526021154:2485] destroyed
2025-11-03T16:51:40.380154Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-11-03T16:51:40.380192Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:40.380205Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:40.380217Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:40.382142Z :DEBUG: [/Root] [/Root] [e0f427f-a8e29bf9-ab9e7001-1ffa310a] [dc1] Successfully connected. Initializing session
2025-11-03T16:51:40.384160Z node 3 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:109: new grpc connection
2025-11-03T16:51:40.384187Z node 3 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:131: new session created cookie 1
2025-11-03T16:51:40.384846Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { topic: "test-topic" } read_only_original: true consumer: "shared/user" read_params { max_read_size: 104857600 } } }
2025-11-03T16:51:40.385057Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 1 consumer shared/user session shared/user_3_1_7987667140212863488_v1 read init: from# ipv6:[::1]:40212, request# { init_request { topics_read_settings { topic: "test-topic" } read_only_original: true consumer: "shared/user" read_params { max_read_size: 104857600 } } }
2025-11-03T16:51:40.385427Z node 3 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 1 consumer shared/user session shared/user_3_1_7987667140212863488_v1 auth for : user
2025-11-03T16:51:40.386164Z node 3 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 1 consumer shared/user session shared/user_3_1_7987667140212863488_v1 Handle describe topics response
2025-11-03T16:51:40.386277Z node 3 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 1 consumer shared/user session shared/user_3_1_7987667140212863488_v1 auth is DEAD
2025-11-03T16:51:40.386350Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 1 consumer shared/user session shared/user_3_1_7987667140212863488_v1 auth ok: topics# 1, initDone# 0
2025-11-03T16:51:40.387555Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 1 consumer shared/user session shared/user_3_1_7987667140212863488_v1 register session: topic# rt3.dc1--test-topic
2025-11-03T16:51:40.388470Z node 3 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1655: [72075186224037893][rt3.dc1--test-topic] pipe [3:7568542839526021164:2490] connected; active server actors: 1
2025-11-03T16:51:40.388688Z node 3 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1706: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [3:7568542839526021164:2490] session shared/user_3_1_7987667140212863488_v1
2025-11-03T16:51:40.388740Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:639: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-11-03T16:51:40.388793Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:669: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-11-03T16:51:40.388833Z node 3 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:871: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_3_1_7987667140212863488_v1" (Sender=[3:7568542839526021161:2490], Pipe=[3:7568542839526021164:2490], Partitions=[], ActiveFamilyCount=0)
2025-11-03T16:51:40.388860Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1186: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-11-03T16:51:40.388911Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1258: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-11-03T16:51:40.388964Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1305: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_3_1_7987667140212863488_v1" (Sender=[3:7568542839526021161:2490], Pipe=[3:7568542839526021164:2490], Partitions=[], ActiveFamilyCount=0)
2025-11-03T16:51:40.389024Z node 3 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:549: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_3_1_7987667140212863488_v1" sender [3:7568542839526021161:2490] lock partition 0 for ReadingSession "shared/user_3_1_7987667140212863488_v1" (Sender=[3:7568542839526021161:2490], Pipe=[3:7568542839526021164:2490], Partitions=[], ActiveFamilyCount=1) generation 1 step 1
2025-11-03T16:51:40.389113Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1325: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-11-03T16:51:40.389142Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1402: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000209s
2025-11-03T16:51:40.390003Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 1 consumer shared/user session shared/user_3_1_7987667140212863488_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 1 Session: "shared/user_3_1_7987667140212863488_v1" ClientId: "user" PipeClient { RawX1: 7568542839526021164 RawX2: 4503612512274874 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-11-03T16:51:40.390116Z node 3 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 1 consumer shared/user session shared/user_3_1_7987667140212863488_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-11-03T16:51:40.397194Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [3:7568542839526021167:2493], now have 1 active actors on pipe
2025-11-03T16:51:40.397611Z node 3 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_3_1_7987667140212863488_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 1, pipe: [3:7568542839526021167:2493]
2025-11-03T16:51:40.397998Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:40.398033Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:40.398074Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:1748: [PQ: 72075186224037892] Created session shared/user_3_1_7987667140212863488_v1 on pipe: [3:7568542839526021167:2493]
2025-11-03T16:51:40.398150Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:40.398178Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:40.398190Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-03T16:51:40.398277Z node 4 :PERSQUEUE DEBUG: partition.cpp:3666: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_3_1_7987667140212863488_v1
2025-11-03T16:51:40.398291Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:40.398462Z node 4 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-03T16:51:40.399063Z node 4 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_3_1_7987667140212863488_v1:1 with generation 1
2025-11-03T16:51:40.406638Z node 4 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-03T16:51:40.406755Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-11-03T16:51:40.406789Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:40.406803Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:40.406815Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:40.406854Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:51:40.406891Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-11-03T16:51:40.411473Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_3_1_7987667140212863488_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 2 WriteTimestampMS: 1762188700272 CreateTimestampMS: 1762188700262 SizeLag: 362 WriteTimestampEstimateMS: 1762188700380 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-11-03T16:51:40.411528Z node 3 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 1 consumer shared/user session shared/user_3_1_7987667140212863488_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 2 readOffset 0 committedOffset 0
2025-11-03T16:51:40.411580Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 1 consumer shared/user session shared/user_3_1_7987667140212863488_v1 sending to client partition status
2025-11-03T16:51:40.412719Z :INFO: [/Root] [/Root] [e0f427f-a8e29bf9-ab9e7001-1ffa310a] [dc1] Server session id: shared/user_3_1_7987667140212863488_v1
2025-11-03T16:51:40.412967Z :DEBUG: [/Root] [/Root] [e0f427f-a8e29bf9-ab9e7001-1ffa310a] [dc1] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:51:40.413419Z :INFO: [/Root] [/Root] [e0f427f-a8e29bf9-ab9e7001-1ffa310a] [dc1] Confirm partition stream create. Partition stream id: 1. Cluster: "dc1". Topic: "test-topic". Partition: 0. Read offset: (NULL)
2025-11-03T16:51:40.414006Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_3_1_7987667140212863488_v1 grpc read done: success# 1, data# { read { } }
2025-11-03T16:51:40.414141Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_3_1_7987667140212863488_v1 got read request: guid# 80cede5b-31612aac-3b230add-880c3b7e
2025-11-03T16:51:40.414565Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_3_1_7987667140212863488_v1 grpc read done: success# 1, data# { start_read { topic { path: "test-topic" } cluster: "dc1" assign_id: 1 } }
2025-11-03T16:51:40.414714Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:539: session cookie 1 consumer shared/user session shared/user_3_1_7987667140212863488_v1 got StartRead from client: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 0, commitOffset# 0
2025-11-03T16:51:40.414757Z node 3 :PQ_READ_PROXY INFO: partition_actor.cpp:1023: session cookie 1 consumer shared/user session shared/user_3_1_7987667140212863488_v1 Start reading TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 2 readOffset 0 committedOffset 0 clientCommitOffset 0 clientReadOffset 0
2025-11-03T16:51:40.414782Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_3_1_7987667140212863488_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 0 endOffset 2
2025-11-03T16:51:40.414836Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_3_1_7987667140212863488_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 0, endOffset# 2, WTime# 1762188700272, sizeLag# 362
2025-11-03T16:51:40.414852Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_3_1_7987667140212863488_v1TEvPartitionReady. Aval parts: 1
2025-11-03T16:51:40.414889Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_3_1_7987667140212863488_v1 performing read request: guid# 80cede5b-31612aac-3b230add-880c3b7e, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 2, size# 434, partitionsAsked# 1, maxTimeLag# 0ms
2025-11-03T16:51:40.414967Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_3_1_7987667140212863488_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 2 maxSize 434 maxTimeLagMs 0 readTimestampMs 0 readOffset 0 EndOffset 2 ClientCommitOffset 0 committedOffset 0 Guid 80cede5b-31612aac-3b230add-880c3b7e
2025-11-03T16:51:40.416049Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:40.416089Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:40.416210Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:880: [72075186224037892][Partition][0][StateIdle] read cookie 4 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 partno 0 count 2 size 434 endOffset 2 max time lag 0ms effective offset 0
2025-11-03T16:51:40.416570Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:1105: [72075186224037892][Partition][0][StateIdle] read cookie 4 added 2 blobs, size 361 count 2 last offset 1, current partition end offset: 2
2025-11-03T16:51:40.416587Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:1121: [72075186224037892][Partition][0][StateIdle] Reading cookie 4. Send blob request.
2025-11-03T16:51:40.416633Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 0 partno 0 count 1 parts_count 0 source 1 size 181 accessed 1 times before, last time 2025-11-03T16:51:40.000000Z
2025-11-03T16:51:40.416651Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 1 partno 0 count 1 parts_count 0 source 1 size 180 accessed 0 times before, last time 2025-11-03T16:51:40.000000Z
2025-11-03T16:51:40.416705Z node 4 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 4. All 2 blobs are from cache.
2025-11-03T16:51:40.416786Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:572: FormAnswer for 2 blobs
2025-11-03T16:51:40.416938Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 0 totakecount 1 count 1 size 161 from pos 0 cbcount 1
2025-11-03T16:51:40.417014Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 1 totakecount 1 count 1 size 160 from pos 0 cbcount 1
2025-11-03T16:51:40.417115Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-03T16:51:40.417731Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 0 suffix '63'
2025-11-03T16:51:40.417763Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 1 partno 0 count 1 parts 0 suffix '63'
2025-11-03T16:51:40.419900Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_3_1_7987667140212863488_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 2 Result { Offset: 0 Data: "... 104 bytes ..." SourceId: "\000test-message-group-id" SeqNo: 1 WriteTimestampMS: 1762188700272 CreateTimestampMS: 1762188700262 UncompressedSize: 13 PartitionKey: "" ExplicitHash: "" } Result { Offset: 1 Data: "... 103 bytes ..." SourceId: "\000test-message-group-id" SeqNo: 2 WriteTimestampMS: 1762188700284 CreateTimestampMS: 1762188700263 UncompressedSize: 12 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 2 SizeLag: 41 RealReadOffset: 1 WaitQuotaTimeMs: 0 EndOffset: 2 StartOffset: 0 } Cookie: 0 }
2025-11-03T16:51:40.420095Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_3_1_7987667140212863488_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 1 from offset 2
2025-11-03T16:51:40.420140Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_3_1_7987667140212863488_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 2 ReadOffset 2 ReadGuid 80cede5b-31612aac-3b230add-880c3b7e has messages 1
2025-11-03T16:51:40.424562Z :DEBUG: [/Root] [/Root] [e0f427f-a8e29bf9-ab9e7001-1ffa310a] [dc1] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:51:40.420280Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_3_1_7987667140212863488_v1 read done: guid# 80cede5b-31612aac-3b230add-880c3b7e, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 391
2025-11-03T16:51:40.420314Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_3_1_7987667140212863488_v1 response to read: guid# 80cede5b-31612aac-3b230add-880c3b7e
2025-11-03T16:51:40.420623Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_3_1_7987667140212863488_v1 Process answer. Aval parts: 0
2025-11-03T16:51:40.425101Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 0 (0-1)
2025-11-03T16:51:40.425199Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (0-0)
2025-11-03T16:51:40.425241Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 0} (1-1)
2025-11-03T16:51:40.425099Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_3_1_7987667140212863488_v1 grpc read done: success# 1, data# { read { } }
Got messages
2025-11-03T16:51:40.425236Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_3_1_7987667140212863488_v1 got read request: guid# bafda4b7-76825a2a-97d12012-f00c5cb3
totalReceived: 2 wait: 2
2025-11-03T16:51:40.425585Z :DEBUG: [/Root] [/Root] [e0f427f-a8e29bf9-ab9e7001-1ffa310a] [dc1] The application data is transferred to the client. Number of messages 2, size 25 bytes
2025-11-03T16:51:40.425750Z :INFO: [/Root] [/Root] [e0f427f-a8e29bf9-ab9e7001-1ffa310a] Closing read session. Close timeout: 0.000000s
2025-11-03T16:51:40.425796Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): dc1:test-topic:0:1:1:0
2025-11-03T16:51:40.425851Z :INFO: [/Root] [/Root] [e0f427f-a8e29bf9-ab9e7001-1ffa310a] Counters: { Errors: 0 CurrentSessionLifetimeMs: 60 BytesRead: 25 MessagesRead: 2 BytesReadCompressed: 65 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-11-03T16:51:40.425962Z :NOTICE: [/Root] [/Root] [e0f427f-a8e29bf9-ab9e7001-1ffa310a] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Close with zero timeout " }
2025-11-03T16:51:40.426013Z :DEBUG: [/Root] [/Root] [e0f427f-a8e29bf9-ab9e7001-1ffa310a] [dc1] Abort session to cluster
2025-11-03T16:51:40.426541Z :NOTICE: [/Root] [/Root] [e0f427f-a8e29bf9-ab9e7001-1ffa310a] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
Start read
2025-11-03T16:51:40.426944Z :INFO: [/Root] [/Root] [6ff26485-785c76b1-980498ac-fc3100db] Starting read session
2025-11-03T16:51:40.426983Z :DEBUG: [/Root] [/Root] [6ff26485-785c76b1-980498ac-fc3100db] Starting cluster discovery
2025-11-03T16:51:40.435036Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2258: [PQ: 72075186224037892] Destroy direct read session shared/user_3_1_7987667140212863488_v1
2025-11-03T16:51:40.435082Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [3:7568542839526021167:2493] destroyed
2025-11-03T16:51:40.435132Z node 4 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_3_1_7987667140212863488_v1
2025-11-03T16:51:40.432692Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_3_1_7987667140212863488_v1 grpc read done: success# 0, data# {  }
2025-11-03T16:51:40.432721Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:125: session cookie 1 consumer shared/user session shared/user_3_1_7987667140212863488_v1 grpc read failed
2025-11-03T16:51:40.432751Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:92: session cookie 1 consumer shared/user session shared/user_3_1_7987667140212863488_v1 grpc closed
2025-11-03T16:51:40.432788Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 1 consumer shared/user session shared/user_3_1_7987667140212863488_v1 is DEAD
2025-11-03T16:51:40.435404Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1659: [72075186224037893][rt3.dc1--test-topic] pipe [3:7568542839526021164:2490] disconnected.
2025-11-03T16:51:40.435430Z node 3 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1670: [72075186224037893][rt3.dc1--test-topic] pipe [3:7568542839526021164:2490] disconnected; active server actors: 1
2025-11-03T16:51:40.435458Z node 3 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1679: [72075186224037893][rt3.dc1--test-topic] pipe [3:7568542839526021164:2490] client user disconnected session shared/user_3_1_7987667140212863488_v1
2025-11-03T16:51:40.439038Z :DEBUG: [/Root] [/Root] [6ff26485-785c76b1-980498ac-fc3100db] Cluster discovery request succeeded
2025-11-03T16:51:40.439128Z :DEBUG: [/Root] [/Root] [6ff26485-785c76b1-980498ac-fc3100db] Starting session to cluster dc1 (localhost:4930)
2025-11-03T16:51:40.439272Z :DEBUG: [/Root] [/Root] [6ff26485-785c76b1-980498ac-fc3100db] [dc1] In Reconnect, ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:51:40.439309Z :DEBUG: [/Root] [/Root] [6ff26485-785c76b1-980498ac-fc3100db] [dc1] New values: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:51:40.439342Z :DEBUG: [/Root] [/Root] [6ff26485-785c76b1-980498ac-fc3100db] [dc1] Reconnecting session to cluster dc1 in 0.000000s
2025-11-03T16:51:40.446216Z :DEBUG: [/Root] [/Root] [6ff26485-785c76b1-980498ac-fc3100db] [dc1] Successfully connected. Initializing session
2025-11-03T16:51:40.445377Z node 3 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:109: new grpc connection
2025-11-03T16:51:40.445400Z node 3 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:131: new session created cookie 2
2025-11-03T16:51:40.448441Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 2 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { topic: "test-topic" } read_only_original: true consumer: "shared/user" read_params { max_read_size: 104857600 } } }
2025-11-03T16:51:40.448681Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 2 consumer shared/user session shared/user_3_2_4174131979827998666_v1 read init: from# ipv6:[::1]:40228, request# { init_request { topics_read_settings { topic: "test-topic" } read_only_original: true consumer: "shared/user" read_params { max_read_size: 104857600 } } }
2025-11-03T16:51:40.450031Z node 3 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 2 consumer shared/user session shared/user_3_2_4174131979827998666_v1 auth for : user
2025-11-03T16:51:40.450929Z node 3 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 2 consumer shared/user session shared/user_3_2_4174131979827998666_v1 Handle describe topics response
2025-11-03T16:51:40.451049Z node 3 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 2 consumer shared/user session shared/user_3_2_4174131979827998666_v1 auth is DEAD
2025-11-03T16:51:40.451132Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 2 consumer shared/user session shared/user_3_2_4174131979827998666_v1 auth ok: topics# 1, initDone# 0
2025-11-03T16:51:40.452240Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 2 consumer shared/user session shared/user_3_2_4174131979827998666_v1 register session: topic# rt3.dc1--test-topic
2025-11-03T16:51:40.452773Z :INFO: [/Root] [/Root] [6ff26485-785c76b1-980498ac-fc3100db] [dc1] Server session id: shared/user_3_2_4174131979827998666_v1
2025-11-03T16:51:40.452986Z :DEBUG: [/Root] [/Root] [6ff26485-785c76b1-980498ac-fc3100db] [dc1] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:51:40.453451Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 2 consumer shared/user session shared/user_3_2_4174131979827998666_v1 grpc read done: success# 1, data# { read { } }
2025-11-03T16:51:40.453575Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 2 consumer shared/user session shared/user_3_2_4174131979827998666_v1 got read request: guid# 4fbd3122-fed7ceeb-7459090c-c5ca2b6a
2025-11-03T16:51:40.456496Z node 3 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1655: [72075186224037893][rt3.dc1--test-topic] pipe [3:7568542839526021186:2496] connected; active server actors: 1
2025-11-03T16:51:40.456620Z node 3 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1706: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [3:7568542839526021186:2496] session shared/user_3_2_4174131979827998666_v1
2025-11-03T16:51:40.456663Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:639: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-11-03T16:51:40.456722Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:669: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-11-03T16:51:40.456794Z node 3 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:871: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_3_2_4174131979827998666_v1" (Sender=[3:7568542839526021182:2496], Pipe=[3:7568542839526021186:2496], Partitions=[], ActiveFamilyCount=0)
2025-11-03T16:51:40.456824Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1186: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-11-03T16:51:40.456883Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1258: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-11-03T16:51:40.456947Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1305: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_3_2_4174131979827998666_v1" (Sender=[3:7568542839526021182:2496], Pipe=[3:7568542839526021186:2496], Partitions=[], ActiveFamilyCount=0)
2025-11-03T16:51:40.457002Z node 3 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:549: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_3_2_4174131979827998666_v1" sender [3:7568542839526021182:2496] lock partition 0 for ReadingSession "shared/user_3_2_4174131979827998666_v1" (Sender=[3:7568542839526021182:2496], Pipe=[3:7568542839526021186:2496], Partitions=[], ActiveFamilyCount=1) generation 1 step 2
2025-11-03T16:51:40.457055Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1325: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-11-03T16:51:40.457081Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1402: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000170s
2025-11-03T16:51:40.457822Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 2 consumer shared/user session shared/user_3_2_4174131979827998666_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 2 Session: "shared/user_3_2_4174131979827998666_v1" ClientId: "user" PipeClient { RawX1: 7568542839526021186 RawX2: 4503612512274880 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-11-03T16:51:40.457921Z node 3 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 2 consumer shared/user session shared/user_3_2_4174131979827998666_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-11-03T16:51:40.459292Z node 3 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_3_2_4174131979827998666_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 1, pipe: [3:7568542839526021189:2499]
2025-11-03T16:51:40.458990Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [3:7568542839526021189:2499], now have 1 active actors on pipe
2025-11-03T16:51:40.459654Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:40.459685Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:40.459722Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:1748: [PQ: 72075186224037892] Created session shared/user_3_2_4174131979827998666_v1 on pipe: [3:7568542839526021189:2499]
2025-11-03T16:51:40.459789Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:40.459815Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:40.459827Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-03T16:51:40.459894Z node 4 :PERSQUEUE DEBUG: partition.cpp:3666: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_3_2_4174131979827998666_v1
2025-11-03T16:51:40.459909Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:40.460089Z node 4 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-03T16:51:40.460674Z node 4 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_3_2_4174131979827998666_v1:1 with generation 1
2025-11-03T16:51:40.464463Z node 4 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:51:40.468054Z node 4 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-03T16:51:40.468154Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-11-03T16:51:40.468190Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:40.468209Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:40.468226Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:40.468263Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:51:40.468302Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-11-03T16:51:40.469412Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 2 consumer shared/user session shared/user_3_2_4174131979827998666_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 2 WriteTimestampMS: 1762188700272 CreateTimestampMS: 1762188700262 SizeLag: 362 WriteTimestampEstimateMS: 1762188700404 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-11-03T16:51:40.472114Z :INFO: [/Root] [/Root] [6ff26485-785c76b1-980498ac-fc3100db] [dc1] Confirm partition stream create. Partition stream id: 1. Cluster: "dc1". Topic: "test-topic". Partition: 0. Read offset: (NULL)
2025-11-03T16:51:40.469470Z node 3 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 2 consumer shared/user session shared/user_3_2_4174131979827998666_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 2 readOffset 0 committedOffset 0
2025-11-03T16:51:40.469544Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 2 consumer shared/user session shared/user_3_2_4174131979827998666_v1 sending to client partition status
2025-11-03T16:51:40.473917Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:40.473970Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:40.474095Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:880: [72075186224037892][Partition][0][StateIdle] read cookie 5 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 partno 0 count 2 size 434 endOffset 2 max time lag 0ms effective offset 0
2025-11-03T16:51:40.474485Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:1105: [72075186224037892][Partition][0][StateIdle] read cookie 5 added 2 blobs, size 361 count 2 last offset 1, current partition end offset: 2
2025-11-03T16:51:40.474509Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:1121: [72075186224037892][Partition][0][StateIdle] Reading cookie 5. Send blob request.
2025-11-03T16:51:40.474575Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 0 partno 0 count 1 parts_count 0 source 1 size 181 accessed 2 times before, last time 2025-11-03T16:51:40.000000Z
2025-11-03T16:51:40.474596Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 1 partno 0 count 1 parts_count 0 source 1 size 180 accessed 1 times before, last time 2025-11-03T16:51:40.000000Z
2025-11-03T16:51:40.474670Z node 4 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 5. All 2 blobs are from cache.
2025-11-03T16:51:40.474729Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:572: FormAnswer for 2 blobs
2025-11-03T16:51:40.474883Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 0 totakecount 1 count 1 size 161 from pos 0 cbcount 1
2025-11-03T16:51:40.474959Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 1 totakecount 1 count 1 size 160 from pos 0 cbcount 1
2025-11-03T16:51:40.475042Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-03T16:51:40.472841Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 2 consumer shared/user session shared/user_3_2_4174131979827998666_v1 grpc read done: success# 1, data# { start_read { topic { path: "test-topic" } cluster: "dc1" assign_id: 1 } }
2025-11-03T16:51:40.475222Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 0 suffix '63'
2025-11-03T16:51:40.475249Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 1 partno 0 count 1 parts 0 suffix '63'
2025-11-03T16:51:40.473013Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:539: session cookie 2 consumer shared/user session shared/user_3_2_4174131979827998666_v1 got StartRead from client: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 0, commitOffset# 0
2025-11-03T16:51:40.473081Z node 3 :PQ_READ_PROXY INFO: partition_actor.cpp:1023: session cookie 2 consumer shared/user session shared/user_3_2_4174131979827998666_v1 Start reading TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 2 readOffset 0 committedOffset 0 clientCommitOffset 0 clientReadOffset 0
2025-11-03T16:51:40.473105Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 2 consumer shared/user session shared/user_3_2_4174131979827998666_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 0 endOffset 2
2025-11-03T16:51:40.473164Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 2 consumer shared/user session shared/user_3_2_4174131979827998666_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 0, endOffset# 2, WTime# 1762188700272, sizeLag# 362
2025-11-03T16:51:40.473180Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 2 consumer shared/user session shared/user_3_2_4174131979827998666_v1TEvPartitionReady. Aval parts: 1
2025-11-03T16:51:40.473233Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 2 consumer shared/user session shared/user_3_2_4174131979827998666_v1 performing read request: guid# 4fbd3122-fed7ceeb-7459090c-c5ca2b6a, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 2, size# 434, partitionsAsked# 1, maxTimeLag# 0ms
2025-11-03T16:51:40.473308Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 2 consumer shared/user session shared/user_3_2_4174131979827998666_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 2 maxSize 434 maxTimeLagMs 0 readTimestampMs 0 readOffset 0 EndOffset 2 ClientCommitOffset 0 committedOffset 0 Guid 4fbd3122-fed7ceeb-7459090c-c5ca2b6a
2025-11-03T16:51:40.476414Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 2 consumer shared/user session shared/user_3_2_4174131979827998666_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 2 Result { Offset: 0 Data: "... 104 bytes ..." SourceId: "\000test-message-group-id" SeqNo: 1 WriteTimestampMS: 1762188700272 CreateTimestampMS: 1762188700262 UncompressedSize: 13 PartitionKey: "" ExplicitHash: "" } Result { Offset: 1 Data: "... 103 bytes ..." SourceId: "\000test-message-group-id" SeqNo: 2 WriteTimestampMS: 1762188700284 CreateTimestampMS: 1762188700263 UncompressedSize: 12 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 2 SizeLag: 41 RealReadOffset: 1 WaitQuotaTimeMs: 0 EndOffset: 2 StartOffset: 0 } Cookie: 0 }
2025-11-03T16:51:40.476568Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 2 consumer shared/user session shared/user_3_2_4174131979827998666_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 1 from offset 2
2025-11-03T16:51:40.476631Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 2 consumer shared/user session shared/user_3_2_4174131979827998666_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 2 ReadOffset 2 ReadGuid 4fbd3122-fed7ceeb-7459090c-c5ca2b6a has messages 1
2025-11-03T16:51:40.476954Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 2 consumer shared/user session shared/user_3_2_4174131979827998666_v1 read done: guid# 4fbd3122-fed7ceeb-7459090c-c5ca2b6a, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 391
2025-11-03T16:51:40.476988Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 2 consumer shared/user session shared/user_3_2_4174131979827998666_v1 response to read: guid# 4fbd3122-fed7ceeb-7459090c-c5ca2b6a
2025-11-03T16:51:40.477268Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 2 consumer shared/user session shared/user_3_2_4174131979827998666_v1 Process answer. Aval parts: 0
2025-11-03T16:51:40.480835Z :DEBUG: [/Root] [/Root] [6ff26485-785c76b1-980498ac-fc3100db] [dc1] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:51:40.481028Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 0 (0-1)
2025-11-03T16:51:40.481138Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (0-0)
2025-11-03T16:51:40.481186Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 0} (1-1)
Got messages
totalReceived: 2 wait: 2
2025-11-03T16:51:40.481511Z :DEBUG: [/Root] [/Root] [6ff26485-785c76b1-980498ac-fc3100db] [dc1] The application data is transferred to the client. Number of messages 2, size 65 bytes
2025-11-03T16:51:40.481642Z :INFO: [/Root] [/Root] [6ff26485-785c76b1-980498ac-fc3100db] Closing read session. Close timeout: 0.000000s
2025-11-03T16:51:40.481688Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): dc1:test-topic:0:1:1:0
2025-11-03T16:51:40.481737Z :INFO: [/Root] [/Root] [6ff26485-785c76b1-980498ac-fc3100db] Counters: { Errors: 0 CurrentSessionLifetimeMs: 54 BytesRead: 65 MessagesRead: 2 BytesReadCompressed: 65 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-11-03T16:51:40.481840Z :NOTICE: [/Root] [/Root] [6ff26485-785c76b1-980498ac-fc3100db] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Close with zero timeout " }
2025-11-03T16:51:40.481885Z :DEBUG: [/Root] [/Root] [6ff26485-785c76b1-980498ac-fc3100db] [dc1] Abort session to cluster
2025-11-03T16:51:40.482356Z :NOTICE: [/Root] [/Root] [6ff26485-785c76b1-980498ac-fc3100db] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
2025-11-03T16:51:40.485896Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2258: [PQ: 72075186224037892] Destroy direct read session shared/user_3_2_4174131979827998666_v1
2025-11-03T16:51:40.485941Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [3:7568542839526021189:2499] destroyed
2025-11-03T16:51:40.485986Z node 4 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_3_2_4174131979827998666_v1
2025-11-03T16:51:40.484157Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 2 consumer shared/user session shared/user_3_2_4174131979827998666_v1 grpc read done: success# 1, data# { read { } }
2025-11-03T16:51:40.484237Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:92: session cookie 2 consumer shared/user session shared/user_3_2_4174131979827998666_v1 grpc closed
2025-11-03T16:51:40.484298Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 2 consumer shared/user session shared/user_3_2_4174131979827998666_v1 is DEAD
2025-11-03T16:51:40.486126Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1659: [72075186224037893][rt3.dc1--test-topic] pipe [3:7568542839526021186:2496] disconnected.
2025-11-03T16:51:40.486149Z node 3 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1670: [72075186224037893][rt3.dc1--test-topic] pipe [3:7568542839526021186:2496] disconnected; active server actors: 1
2025-11-03T16:51:40.486165Z node 3 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1679: [72075186224037893][rt3.dc1--test-topic] pipe [3:7568542839526021186:2496] client user disconnected session shared/user_3_2_4174131979827998666_v1
2025-11-03T16:51:40.568065Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:40.568096Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:40.568108Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:40.669142Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:40.669196Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:40.669212Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:42.387763Z :WriteZSTD INFO: Random seed for debugging is 1762188702387740
2025-11-03T16:51:43.246180Z node 5 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[5:7568542849596806689:2081];send_to=[0:7307199536658146131:7762515];
2025-11-03T16:51:43.246356Z node 5 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
2025-11-03T16:51:43.336151Z node 5 :BS_NODE WARN: {NWDC01@distconf.cpp:397} StateFunc too long Type# 268639238 Duration# 0.008298s
2025-11-03T16:51:43.390529Z node 5 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-11-03T16:51:43.443020Z node 5 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-11-03T16:51:43.469112Z node 6 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[6:7568542849093033081:2076];send_to=[0:7307199536658146131:7762515];
2025-11-03T16:51:43.469169Z node 6 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
test_client.cpp: SetPath # /home/runner/.ya/build/build_root/7jz3/001998/r3tmp/tmpmQSAMp/pdisk_1.dat
2025-11-03T16:51:43.491395Z node 6 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-11-03T16:51:43.498824Z node 6 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-11-03T16:51:43.660060Z node 5 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-11-03T16:51:43.684624Z node 5 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
2025-11-03T16:51:43.727350Z node 5 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(5, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-11-03T16:51:43.727498Z node 5 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(5, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-11-03T16:51:43.733267Z node 5 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(6, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-11-03T16:51:43.733363Z node 5 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(6, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-11-03T16:51:43.741971Z node 5 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(5, (0,0,0,0)) VolatileState: Connecting -> Connected
2025-11-03T16:51:43.745996Z node 5 :HIVE WARN: hive_impl.cpp:811: HIVE#72057594037968897 Handle TEvInterconnect::TEvNodeConnected, NodeId 6 Cookie 6
2025-11-03T16:51:43.752524Z node 5 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(6, (0,0,0,0)) VolatileState: Connecting -> Connected
TServer::EnableGrpc on GrpcPort 65062, node 5
2025-11-03T16:51:43.953030Z node 6 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-11-03T16:51:44.036819Z node 5 :NET_CLASSIFIER WARN: net_classifier.cpp:190: distributable config is empty, broken or outdated, will use file: /home/runner/.ya/build/build_root/7jz3/001998/r3tmp/yandexZKlCK8.tmp
2025-11-03T16:51:44.036848Z node 5 :NET_CLASSIFIER WARN: net_classifier.cpp:196: will try to initialize from file: /home/runner/.ya/build/build_root/7jz3/001998/r3tmp/yandexZKlCK8.tmp
2025-11-03T16:51:44.037016Z node 5 :NET_CLASSIFIER WARN: net_classifier.cpp:202: successfully initialized from file: /home/runner/.ya/build/build_root/7jz3/001998/r3tmp/yandexZKlCK8.tmp
2025-11-03T16:51:44.037192Z node 5 :NET_CLASSIFIER ERROR: net_classifier.cpp:228: got bad distributable configuration
2025-11-03T16:51:44.100177Z INFO: TTestServer started on Port 1266 GrpcPort 65062
2025-11-03T16:51:44.206797Z node 5 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-11-03T16:51:44.316803Z node 5 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
TClient is connected to server localhost:1266
PQClient connected to localhost:65062
WaitRootIsUp 'Root'...
TClient::Ls request: Root
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "Root"
    PathId: 1
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 1
    CreateStep: 0
    ParentPathId: 1
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 1
      SubDomainVersion: 0
      SecurityStateVersion: 0
    }
    ChildrenExist: false
  }
  Children {
    Name: ".sys"
    PathId: 18446744073709551615
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 0
    CreateStep: 0
    ParentPathId: 18446744073709551615
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 0
      Pl...
(TRUNCATED)
WaitRootIsUp 'Root' success.
2025-11-03T16:51:44.484242Z node 6 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-11-03T16:51:44.485451Z node 5 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpAlterSubDomain, opId: 281474976720657:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_alter_subdomain.cpp:311)
waiting...
waiting...
waiting...
waiting...
2025-11-03T16:51:44.632222Z node 5 :FLAT_TX_SCHEMESHARD WARN: schemeshard__notify.cpp:122: NotifyTxCompletion, unknown transaction, txId: 281474976720660, at schemeshard: 72057594046644480
2025-11-03T16:51:48.249391Z node 5 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[5:7568542849596806689:2081];send_to=[0:7307199536658146131:7762515];
2025-11-03T16:51:48.249479Z node 5 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
2025-11-03T16:51:48.471774Z node 6 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[6:7568542849093033081:2076];send_to=[0:7307199536658146131:7762515];
2025-11-03T16:51:48.471853Z node 6 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
2025-11-03T16:51:48.698603Z node 6 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [6:7568542870567869898:2304], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-03T16:51:48.698698Z node 6 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [6:7568542870567869870:2301], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-03T16:51:48.698810Z node 6 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-03T16:51:48.702078Z node 6 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [6:7568542870567869905:2306], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-03T16:51:48.702177Z node 6 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-03T16:51:48.711700Z node 5 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateResourcePool, opId: 281474976715657:3, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_resource_pool.cpp:179)
2025-11-03T16:51:48.752770Z node 6 :KQP_WORKLOAD_SERVICE WARN: helpers.h:73: [WorkloadService] [TPoolCreatorActor] ActorId: [6:7568542870567869904:2305], DatabaseId: /Root, PoolId: default, Scheduled retry for error: { <main>: Error: Transaction 281474976715657 completed, doublechecking }
2025-11-03T16:51:48.861497Z node 6 :TX_PROXY ERROR: schemereq.cpp:593: Actor# [6:7568542870567869934:2143] txid# 281474976715658, issues: { message: "Check failed: path: \'/Root/.metadata/workload_manager/pools/default\', error: path exist, request accepts it (id: [OwnerId: 72057594046644480, LocalPathId: 8], type: EPathTypeResourcePool, state: EPathStateNoChanges)" severity: 1 }
2025-11-03T16:51:48.914729Z node 6 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:570: Compilation failed, self: [6:7568542870567869941:2310], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-11-03T16:51:48.916345Z node 6 :KQP_SESSION WARN: kqp_session_actor.cpp:2506: SessionId: ydb://session/3?node_id=6&id=ODk3NDRiYWEtNjMwNWY2NzItY2Y3OGVhZWUtMmFiNTQwZmU=, ActorId: [6:7568542870567869864:2299], ActorState: ExecuteState, TraceId: 01k95a3jtk9f7sa9e6b3z3rsj5, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-11-03T16:51:48.916815Z node 6 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-11-03T16:51:49.359239Z node 5 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:570: Compilation failed, self: [5:7568542875366611542:2336], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-11-03T16:51:49.362935Z node 5 :KQP_SESSION WARN: kqp_session_actor.cpp:2506: SessionId: ydb://session/3?node_id=5&id=ODBhZWFjNzMtOWMzOTU3MDktMWIwYjk0YjItYzE2NzBlMzg=, ActorId: [5:7568542875366611517:2330], ActorState: ExecuteState, TraceId: 01k95a3kdmbez7s63pap32j95b, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-11-03T16:51:49.363377Z node 5 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-11-03T16:51:49.383610Z node 5 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720661:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:690)
2025-11-03T16:51:49.527853Z node 5 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720662:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:690)
2025-11-03T16:51:49.772970Z node 5 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720663:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:690)
=== Init DC: UPSERT INTO `/Root/PQ/Config/V2/Cluster` (name, balancer, local, enabled, weight) VALUES ("dc1", "localhost:65062", true, true, 1000);
2025-11-03T16:51:50.354008Z node 5 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976720664. Ctx: { TraceId: 01k95a3m49f9a12ez1k3jbd0bk, Database: , SessionId: ydb://session/3?node_id=5&id=MTY3OGUzMTUtZDk4YmQ5MmYtOTM5NDU3MzMtNWVhZjRiZjQ=, PoolId: default, DatabaseId: /Root}. Database not set, use /Root
=== CheckClustersList. Subcribe to ClusterTracker from [5:7568542879661579255:2987] 
=== CheckClustersList. Ok
2025-11-03T16:51:55.732316Z node 5 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720669:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:690)
waiting...
PQ Client: create topic: rt3.dc1--test-topic with 1 partitions
CallPersQueueGRPC request to localhost:65062
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-11-03T16:51:55.940997Z node 5 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
CallPersQueueGRPC request to localhost:65062
MetaRequest {
  CmdCreateTopic {
    Topic: "rt3.dc1--test-topic"
    NumPartitions: 1
    Config {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
  }
}
CallPersQueueGRPC response:
Status: 129
ProxyErrorCode: 53
SchemeStatus: 1
FlatTxId {
  TxId: 281474976720670
  SchemeShardTabletId: 72057594046644480
  PathId: 13
}
ErrorCode: OK
AddTopic: rt3.dc1--test-topic
===Run query:``DECLARE $version as Int64; DECLARE $path AS Utf8; DECLARE $cluster as Utf8; UPSERT INTO `/Root/PQ/Config/V2/Topics` (path, dc) VALUES ($path, $cluster); UPSERT INTO `/Root/PQ/Config/V2/Versions` (name, version) VALUES ("Topics", $version);`` with topic = test-topic, dc = dc1
2025-11-03T16:51:56.032099Z node 5 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1655: [72075186224037893][] pipe [5:7568542905431383410:3239] connected; active server actors: 1
2025-11-03T16:51:56.032337Z node 5 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1519: [72075186224037893][rt3.dc1--test-topic] updating configuration. Deleted partitions []. Added partitions [0]
2025-11-03T16:51:56.035283Z node 5 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:971: [72075186224037893][rt3.dc1--test-topic] Discovered subdomain [OwnerId: 72057594046644480, LocalPathId: 1] state, outOfSpace = 0 at RB 72075186224037893
2025-11-03T16:51:56.039705Z node 5 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:140: [72075186224037893][rt3.dc1--test-topic] BALANCER INIT DONE for rt3.dc1--test-topic: (0, 72075186224037892) 
2025-11-03T16:51:56.067331Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2960: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-11-03T16:51:56.076738Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2992: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-11-03T16:51:56.077065Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:787: [PQ: 72075186224037892] no config, start with empty partitions and default config
2025-11-03T16:51:56.077101Z node 6 :PERSQUEUE NOTICE: pq_impl.cpp:913: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-11-03T16:51:56.077146Z node 6 :PERSQUEUE INFO: pq_impl.cpp:612: [PQ: 72075186224037892] doesn't have tx writes info
2025-11-03T16:51:56.079059Z node 5 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:404: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 6, Generation 1
2025-11-03T16:51:56.077844Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [5:7568542905431383409:3238], now have 1 active actors on pipe
2025-11-03T16:51:56.077881Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [5:7568542905431383436:2432], now have 1 active actors on pipe
2025-11-03T16:51:56.079971Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-03T16:51:56.098748Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-03T16:51:56.121633Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [5:7568542905431383473:3284], now have 1 active actors on pipe
2025-11-03T16:51:56.122366Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-03T16:51:56.137099Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-03T16:51:56.137985Z node 6 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-11-03T16:51:56.138032Z node 6 :PERSQUEUE DEBUG: partition.cpp:1312: [72075186224037892][Partition][0][StateInit] HandleOnInit TEvPQ::TEvProposePartitionConfig
2025-11-03T16:51:56.138298Z node 6 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-11-03T16:51:56.138486Z node 6 :PERSQUEUE INFO: partition_init.cpp:1101: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [6:7568542904927608761:2388]
2025-11-03T16:51:56.153169Z node 6 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-11-03T16:51:56.153209Z node 6 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-11-03T16:51:56.153236Z node 6 :PERSQUEUE INFO: partition.cpp:707: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1 [6:7568542904927608761:2388]
2025-11-03T16:51:56.153261Z node 6 :PERSQUEUE DEBUG: partition.cpp:727: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 0 Head Offset 0 PartNo 0 PackedSize 0 count 0 nextOffset 0 batches 0
2025-11-03T16:51:56.153299Z node 6 :PERSQUEUE DEBUG: partition_mlp.cpp:83: [72075186224037892][Partition][0][StateIdle] Initializing MLP Consumers: 0
2025-11-03T16:51:56.154721Z node 6 :PERSQUEUE DEBUG: partition.cpp:4273: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 1
2025-11-03T16:51:56.154767Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:56.154857Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:56.154870Z node 6 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-03T16:51:56.154889Z node 6 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-11-03T16:51:56.154903Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:56.154915Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:56.154927Z node 6 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-11-03T16:51:56.154956Z node 6 :PERSQUEUE DEBUG: partition_read.cpp:923: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-11-03T16:51:56.154991Z node 6 :PERSQUEUE DEBUG: partition_mlp.cpp:60: [72075186224037892][Partition][0][StateIdle] Process MLP pending events. Count 0
2025-11-03T16:51:56.155505Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-03T16:51:56.155625Z node 6 :PERSQUEUE DEBUG: partition_compaction.cpp:183: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:51:56.173596Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-03T16:51:56.173740Z node 6 :PERSQUEUE DEBUG: partition.cpp:1416: [72075186224037892][Partition][0][StateIdle] Handle TEvPQ::TEvTxCommit Step 1762188716162, TxId 281474976720670
2025-11-03T16:51:56.173768Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:56.173781Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:56.173925Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:56.174247Z node 6 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-03T16:51:56.182074Z node 6 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-03T16:51:56.182250Z node 6 :PERSQUEUE DEBUG: partition_mlp.cpp:83: [72075186224037892][Partition][0][StateIdle] Initializing MLP Consumers: 0
2025-11-03T16:51:56.182363Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-11-03T16:51:56.182391Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:56.182401Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:56.182413Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:56.182440Z node 6 :PERSQUEUE DEBUG: partition_compaction.cpp:183: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:51:56.182773Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:398: [PQ: 72075186224037892] Apply new config PartitionConfig { LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 } PartitionIds: 0 TopicName: "rt3.dc1--test-topic" Version: 0 LocalDC: true Codecs { Ids: 0 Ids: 1 Ids: 2 Codecs: "raw" Codecs: "gzip" Codecs: "lzop" } TopicPath: "/Root/PQ/rt3.dc1--test-topic" YcCloudId: "" YcFolderId: "" YdbDatabaseId: "" YdbDatabasePath: "/Root" Partitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } AllPartitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } Consumers { Name: "user" ReadFromTimestampsMs: 0 FormatVersion: 0 Version: 0 Generation: 0 } MonitoringProjectId: ""
2025-11-03T16:51:56.182863Z node 6 :PERSQUEUE NOTICE: pq_impl.cpp:913: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-11-03T16:51:56.183159Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-03T16:51:56.195664Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-03T16:51:56.195761Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-03T16:51:56.199691Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-03T16:51:56.204747Z node 5 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976720671. Ctx: { TraceId: 01k95a3t0xe7x2sppv86g1k74h, Database: , SessionId: ydb://session/3?node_id=5&id=NDdhNzZiNzctN2VhMGEyNTgtYmY2ZGMyM2UtOTk4YWRiYw==, PoolId: default, DatabaseId: /Root}. Database not set, use /Root
===Query complete
TClient::Ls request: /Root/PQ/rt3.dc1--test-topic
2025-11-03T16:51:56.254373Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:56.254406Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:56.254432Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976720670
    CreateStep: 1762188716162
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts...
(TRUNCATED)
GetTopicVersionFromPath:  record Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976720670
    CreateStep: 1762188716162
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      YdbDatabasePath: "/Root"
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
    Partitions {
      PartitionId: 0
      TabletId: 72075186224037892
      Status: Active
    }
    AlterVersion: 1
    BalancerTabletID: 72075186224037893
    NextPartitionId: 1
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 1
      PlanResolution: 7
      Coordinators: 72057594046316545
      TimeCastBucketsPerMediator: 2
      Mediators: 72057594046382081
    }
    DomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    PathsInside: 12
    PathsLimit: 10000
    ShardsInside: 6
    ShardsLimit: 200000
    ResourcesDomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    DiskSpaceUsage {
      Tables {
        TotalSize: 0
        DataSize: 0
        IndexSize: 0
      }
      Topics {
        ReserveSize: 0
        AccountSize: 0
        DataSize: 0
        UsedReserveSize: 0
      }
    }
    PQPartitionsInside: 1
    PQPartitionsLimit: 1000000
    SchemeLimits {
      MaxDepth: 32
      MaxPaths: 10000
      MaxChildrenInDir: 100000
      MaxAclBytesSize: 10240
      MaxTableColumns: 200
      MaxTableColumnNameLength: 255
      MaxTableKeyColumns: 30
      MaxTableIndices: 20
      MaxShards: 200000
      MaxShardsInPath: 35000
      MaxConsistentCopyTargets: 10000
      MaxPathElementLength: 255
      ExtraPathSymbolsAllowed: "!\"#$%&\'()*+,-.:;<=>?@[\\]^_`{|}~"
      MaxPQPartitions: 1000000
      MaxTableCdcStreams: 5
      MaxExports: 10
      MaxImports: 10
      MaxColumnTableColumns: 10000
    }
  }
}
Path: "/Root/PQ/rt3.dc1--test-topic"
 name rt3.dc1--test-topic version1
CallPersQueueGRPC request to localhost:65062
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-11-03T16:51:56.264506Z node 5 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
MetaResponse {
  CmdGetTopicMetadataResult {
    TopicInfo {
      Topic: "rt3.dc1--test-topic"
      NumPartitions: 1
      Config {
        PartitionConfig {
          LifetimeSeconds: 86400
          LowWatermark: 8388608
          SourceIdLifetimeSeconds: 86400
          WriteSpeedInBytesPerSecond: 20000000
          BurstSize: 20000000
          SourceIdMaxCounts: 6000000
        }
        Version: 1
        LocalDC: true
        Codecs {
          Ids: 0
          Ids: 1
          Ids: 2
          Codecs: "raw"
          Codecs: "gzip"
          Codecs: "lzop"
        }
        TopicPath: "/Root/PQ/rt3.dc1--test-topic"
        YdbDatabasePath: "/Root"
        Consumers {
          Name: "user"
          ReadFromTimestampsMs: 0
          FormatVersion: 0
          Version: 0
        }
      }
      ErrorCode: OK
    }
  }
}
=== Topic created, have version: 1
2025-11-03T16:51:56.287064Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: try to update token
2025-11-03T16:51:56.287482Z :INFO: [] MessageGroupId [src] SessionId [] Write session: Do CDS request
2025-11-03T16:51:56.287544Z :INFO: [] MessageGroupId [src] SessionId [] Start write session. Will connect to endpoint: localhost:65062
2025-11-03T16:51:56.316765Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src" }
2025-11-03T16:51:56.317809Z node 5 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-11-03T16:51:56.317850Z node 5 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1
2025-11-03T16:51:56.320781Z node 5 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src" }
2025-11-03T16:51:56.320975Z node 5 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1 topic: "test-topic" message_group_id: "src" from ipv6:[::1]:54108
2025-11-03T16:51:56.320992Z node 5 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54108 proto=v1  topic=test-topic durationSec=0
2025-11-03T16:51:56.321006Z node 5 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-11-03T16:51:56.323359Z node 5 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1 sessionId:  describe result for acl check
2025-11-03T16:51:56.323512Z node 5 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-11-03T16:51:56.323527Z node 5 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-11-03T16:51:56.323538Z node 5 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-11-03T16:51:56.323559Z node 5 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [5:7568542905431383555:2451] (SourceId=src, PreferedPartition=(NULL)) StartKqpSession
2025-11-03T16:51:56.331406Z node 5 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [5:7568542905431383555:2451] (SourceId=src, PreferedPartition=(NULL)) Select from the table
2025-11-03T16:51:56.356279Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:56.356313Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:56.356326Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:56.456725Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:56.456751Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:56.456766Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:56.560422Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:56.560450Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:56.560464Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:56.664523Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:56.664553Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:56.664567Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:56.722047Z node 5 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [5:7568542905431383555:2451] (SourceId=src, PreferedPartition=(NULL)) RequestPQRB
2025-11-03T16:51:56.723343Z node 5 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1655: [72075186224037893][rt3.dc1--test-topic] pipe [5:7568542905431383596:2451] connected; active server actors: 1
2025-11-03T16:51:56.723580Z node 5 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [5:7568542905431383555:2451] (SourceId=src, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=src
2025-11-03T16:51:56.723614Z node 5 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [5:7568542905431383555:2451] (SourceId=src, PreferedPartition=(NULL)) Update the table
2025-11-03T16:51:56.732178Z node 5 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1659: [72075186224037893][rt3.dc1--test-topic] pipe [5:7568542905431383596:2451] disconnected.
2025-11-03T16:51:56.732223Z node 5 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1670: [72075186224037893][rt3.dc1--test-topic] pipe [5:7568542905431383596:2451] disconnected; active server actors: 1
2025-11-03T16:51:56.732245Z node 5 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1695: [72075186224037893][rt3.dc1--test-topic] pipe [5:7568542905431383596:2451] disconnected no session
2025-11-03T16:51:56.765205Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:56.765241Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:56.765259Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:56.868265Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:56.868296Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:56.868312Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:56.970704Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:56.970729Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:56.970744Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:56.970210Z node 5 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [5:7568542905431383555:2451] (SourceId=src, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-11-03T16:51:56.970254Z node 5 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [5:7568542905431383555:2451] (SourceId=src, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-11-03T16:51:56.970276Z node 5 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [5:7568542905431383555:2451] (SourceId=src, PreferedPartition=(NULL)) Start idle
2025-11-03T16:51:56.970322Z node 5 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-11-03T16:51:56.972621Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [5:7568542905431383638:2451], now have 1 active actors on pipe
2025-11-03T16:51:56.973321Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:56.973366Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:56.973470Z node 6 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src|d26db05f-bb5519ae-f1a8a1d4-30dc92e4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src
2025-11-03T16:51:56.973546Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:56.973573Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:56.973587Z node 6 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-03T16:51:56.973648Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:56.973697Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-03T16:51:56.973750Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-03T16:51:56.974757Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:56.974788Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:56.974861Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-03T16:51:56.976653Z :INFO: [] MessageGroupId [src] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1762188716976 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-11-03T16:51:56.976781Z :INFO: [] MessageGroupId [src] SessionId [] Write session established. Init response: session_id: "src|d26db05f-bb5519ae-f1a8a1d4-30dc92e4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-11-03T16:51:56.977040Z :INFO: [] MessageGroupId [src] SessionId [src|d26db05f-bb5519ae-f1a8a1d4-30dc92e4_0] Write session: close. Timeout = 0 ms
2025-11-03T16:51:56.977088Z :INFO: [] MessageGroupId [src] SessionId [src|d26db05f-bb5519ae-f1a8a1d4-30dc92e4_0] Write session will now close
2025-11-03T16:51:56.977132Z :DEBUG: [] MessageGroupId [src] SessionId [src|d26db05f-bb5519ae-f1a8a1d4-30dc92e4_0] Write session: aborting
2025-11-03T16:51:56.977534Z :INFO: [] MessageGroupId [src] SessionId [src|d26db05f-bb5519ae-f1a8a1d4-30dc92e4_0] Write session: gracefully shut down, all writes complete
2025-11-03T16:51:56.977580Z :DEBUG: [] MessageGroupId [src] SessionId [src|d26db05f-bb5519ae-f1a8a1d4-30dc92e4_0] Write session: destroy
2025-11-03T16:51:56.972988Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 6, Generation: 1
2025-11-03T16:51:56.975378Z node 5 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1 partition: 0 MaxSeqNo: 0 sessionId: src|d26db05f-bb5519ae-f1a8a1d4-30dc92e4_0
2025-11-03T16:51:56.983935Z node 5 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId: src|d26db05f-bb5519ae-f1a8a1d4-30dc92e4_0 grpc read done: success: 0 data: 
2025-11-03T16:51:56.983966Z node 5 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 1 sessionId: src|d26db05f-bb5519ae-f1a8a1d4-30dc92e4_0 grpc read failed
2025-11-03T16:51:56.984012Z node 5 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 1 sessionId: src|d26db05f-bb5519ae-f1a8a1d4-30dc92e4_0 grpc closed
2025-11-03T16:51:56.984032Z node 5 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1 sessionId: src|d26db05f-bb5519ae-f1a8a1d4-30dc92e4_0 is DEAD
2025-11-03T16:51:56.984857Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-11-03T16:51:56.990932Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [5:7568542905431383638:2451] destroyed
2025-11-03T16:51:56.990984Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-11-03T16:51:56.991017Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:56.991030Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:56.991651Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:57.009873Z node 5 :PQ_READ_PROXY DEBUG: grpc_pq_schema.cpp:207: new Alter topic request
2025-11-03T16:51:57.013699Z node 5 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpAlterPersQueueGroup, opId: 281474976720674:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_alter_pq.cpp:313)
2025-11-03T16:51:57.032541Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-03T16:51:57.032347Z node 5 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1519: [72075186224037893][rt3.dc1--test-topic] updating configuration. Deleted partitions []. Added partitions []
2025-11-03T16:51:57.045352Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-03T16:51:57.062156Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-03T16:51:57.076446Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:57.076480Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:57.076497Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:57.085076Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-03T16:51:57.085316Z node 6 :PERSQUEUE DEBUG: partition.cpp:1277: [72075186224037892][Partition][0][StateIdle] Handle TEvPQ::TEvProposePartitionConfig Step 1762188717100, TxId 281474976720674
2025-11-03T16:51:57.085342Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:57.085430Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:57.085447Z node 6 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-03T16:51:57.085488Z node 6 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-11-03T16:51:57.085722Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-03T16:51:57.095414Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-03T16:51:57.095627Z node 6 :PERSQUEUE DEBUG: partition.cpp:1416: [72075186224037892][Partition][0][StateIdle] Handle TEvPQ::TEvTxCommit Step 1762188717100, TxId 281474976720674
2025-11-03T16:51:57.095657Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:57.095673Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:57.095859Z node 6 :PERSQUEUE DEBUG: partition.cpp:3622: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user reinit with generation 2 done
2025-11-03T16:51:57.095879Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:57.096143Z node 6 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-03T16:51:57.105948Z node 6 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-03T16:51:57.106205Z node 6 :PERSQUEUE DEBUG: partition_mlp.cpp:83: [72075186224037892][Partition][0][StateIdle] Initializing MLP Consumers: 0
2025-11-03T16:51:57.106364Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-11-03T16:51:57.106400Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:57.106415Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:57.106443Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:57.106482Z node 6 :PERSQUEUE DEBUG: partition_compaction.cpp:183: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:51:57.106967Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:398: [PQ: 72075186224037892] Apply new config PartitionConfig { MaxCountInPartition: 2147483647 MaxSizeInPartition: 9223372036854775807 LifetimeSeconds: 86400 SourceIdLifetimeSeconds: 1382400 WriteSpeedInBytesPerSecond: 1048576 BurstSize: 1048576 TotalPartitions: 1 SourceIdMaxCounts: 6000000 } PartitionIds: 0 TopicName: "rt3.dc1--test-topic" Version: 2 LocalDC: true RequireAuthWrite: true RequireAuthRead: true Producer: "unknown" Ident: "unknown" Topic: "test-topic" DC: "dc1" FormatVersion: 0 Codecs { Ids: 0 Ids: 1 Ids: 3 Codecs: "raw" Codecs: "gzip" Codecs: "zstd" } TopicPath: "/Root/PQ/rt3.dc1--test-topic" YcCloudId: "" YcFolderId: "" YdbDatabaseId: "" YdbDatabasePath: "/Root" Partitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } AllPartitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 72075186224037892 } Consumers { Name: "user" ReadFromTimestampsMs: 0 FormatVersion: 0 Codec { Ids: 0 Ids: 1 Ids: 3 Codecs: "raw" Codecs: "gzip" Codecs: "zstd" } ServiceType: "data-streams" Version: 1 Generation: 2 } MonitoringProjectId: ""
2025-11-03T16:51:57.106998Z node 6 :PERSQUEUE NOTICE: pq_impl.cpp:913: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-11-03T16:51:57.107314Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
Alter topic response: { operation { ready: true status: SUCCESS } }
Alter result: {  }
2025-11-03T16:51:57.132226Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-03T16:51:57.132360Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-03T16:51:57.140183Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-03T16:51:57.152622Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [] Write session: try to update token
2025-11-03T16:51:57.155107Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [] Write session: Do CDS request
2025-11-03T16:51:57.155242Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [] Do schedule cds request after 0 ms
2025-11-03T16:51:57.155379Z :INFO: [/Root] MessageGroupId [test-message-group-id] Running cds request ms
2025-11-03T16:51:57.165500Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [] Got CDS response: 
write_sessions_clusters { clusters { endpoint: "localhost:65062" name: "dc1" available: true } primary_cluster_selection_reason: CLIENT_LOCATION } version: 1
2025-11-03T16:51:57.165571Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [] Start write session. Will connect to endpoint: localhost:65062
2025-11-03T16:51:57.176529Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:57.176557Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:57.176572Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:57.188098Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [] Write session: send init request: init_request { topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" }
2025-11-03T16:51:57.193267Z node 5 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-11-03T16:51:57.193305Z node 5 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2
2025-11-03T16:51:57.193686Z node 5 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" }
2025-11-03T16:51:57.193827Z node 5 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2 topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" from ipv6:[::1]:54126
2025-11-03T16:51:57.193842Z node 5 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54126 proto=v1  topic=test-topic durationSec=0
2025-11-03T16:51:57.193853Z node 5 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-11-03T16:51:57.195426Z node 5 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2 sessionId:  describe result for acl check
2025-11-03T16:51:57.195553Z node 5 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-11-03T16:51:57.195565Z node 5 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-11-03T16:51:57.195576Z node 5 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-11-03T16:51:57.195593Z node 5 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [5:7568542909726351012:2475] (SourceId=test-message-group-id, PreferedPartition=(NULL)) StartKqpSession
2025-11-03T16:51:57.205536Z node 5 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [5:7568542909726351012:2475] (SourceId=test-message-group-id, PreferedPartition=(NULL)) Select from the table
2025-11-03T16:51:57.226601Z node 5 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [5:7568542909726351012:2475] (SourceId=test-message-group-id, PreferedPartition=(NULL)) RequestPQRB
2025-11-03T16:51:57.229177Z node 5 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1655: [72075186224037893][rt3.dc1--test-topic] pipe [5:7568542909726351031:2475] connected; active server actors: 1
2025-11-03T16:51:57.229306Z node 5 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [5:7568542909726351012:2475] (SourceId=test-message-group-id, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=test-message-group-id
2025-11-03T16:51:57.229330Z node 5 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [5:7568542909726351012:2475] (SourceId=test-message-group-id, PreferedPartition=(NULL)) Update the table
2025-11-03T16:51:57.230467Z node 5 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1659: [72075186224037893][rt3.dc1--test-topic] pipe [5:7568542909726351031:2475] disconnected.
2025-11-03T16:51:57.230493Z node 5 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1670: [72075186224037893][rt3.dc1--test-topic] pipe [5:7568542909726351031:2475] disconnected; active server actors: 1
2025-11-03T16:51:57.230516Z node 5 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1695: [72075186224037893][rt3.dc1--test-topic] pipe [5:7568542909726351031:2475] disconnected no session
2025-11-03T16:51:57.253825Z node 5 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [5:7568542909726351012:2475] (SourceId=test-message-group-id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-11-03T16:51:57.253873Z node 5 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [5:7568542909726351012:2475] (SourceId=test-message-group-id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-11-03T16:51:57.253897Z node 5 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [5:7568542909726351012:2475] (SourceId=test-message-group-id, PreferedPartition=(NULL)) Start idle
2025-11-03T16:51:57.253931Z node 5 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-11-03T16:51:57.260456Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [5:7568542909726351047:2475], now have 1 active actors on pipe
2025-11-03T16:51:57.262142Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 6, Generation: 1
2025-11-03T16:51:57.264499Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:57.264549Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:57.264642Z node 6 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie test-message-group-id|25ac5fce-f176e289-cbe5fecd-5f9b220e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner test-message-group-id
2025-11-03T16:51:57.264691Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:57.264715Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:57.264730Z node 6 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-03T16:51:57.264776Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:57.264825Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-03T16:51:57.264877Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-03T16:51:57.270639Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1762188717270 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-11-03T16:51:57.270780Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [] Write session established. Init response: session_id: "test-message-group-id|25ac5fce-f176e289-cbe5fecd-5f9b220e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_ZSTD
2025-11-03T16:51:57.268398Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:57.272105Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|25ac5fce-f176e289-cbe5fecd-5f9b220e_0] Write 1 messages with Id from 1 to 1
2025-11-03T16:51:57.268452Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:57.268549Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-03T16:51:57.269464Z node 5 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2 partition: 0 MaxSeqNo: 0 sessionId: test-message-group-id|25ac5fce-f176e289-cbe5fecd-5f9b220e_0
2025-11-03T16:51:57.272219Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|25ac5fce-f176e289-cbe5fecd-5f9b220e_0] Write 1 messages with Id from 2 to 2
2025-11-03T16:51:57.272264Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|25ac5fce-f176e289-cbe5fecd-5f9b220e_0] Write session: close. Timeout = 18446744073709551 ms
2025-11-03T16:51:57.277451Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|25ac5fce-f176e289-cbe5fecd-5f9b220e_0] Write session: try to update token
2025-11-03T16:51:57.277511Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|25ac5fce-f176e289-cbe5fecd-5f9b220e_0] Send 2 message(s) (0 left), first sequence number is 1
2025-11-03T16:51:57.278386Z node 5 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: test-message-group-id|25ac5fce-f176e289-cbe5fecd-5f9b220e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:51:57.278733Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:51:57.278236Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:57.278274Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:57.278287Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:57.283614Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:57.282377Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:57.282428Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:57.282507Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-11-03T16:51:57.284277Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:57.284316Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:57.284703Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0test-message-group-id' SeqNo: 1 partNo : 0 messageNo: 1 size 93 offset: -1
2025-11-03T16:51:57.284735Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0test-message-group-id' SeqNo: 2 partNo : 0 messageNo: 1 size 92 offset: -1
2025-11-03T16:51:57.284787Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:51:57.284857Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:57.284894Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:57.284908Z node 6 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (2)
2025-11-03T16:51:57.285040Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0test-message-group-id' seqNo 1 partNo 0
2025-11-03T16:51:57.285976Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0test-message-group-id' seqNo 1 partNo 0 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 182 count 1 nextOffset 1 batches 1
2025-11-03T16:51:57.286032Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0test-message-group-id' seqNo 2 partNo 0
2025-11-03T16:51:57.286068Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0test-message-group-id' seqNo 2 partNo 0 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 331 count 2 nextOffset 2 batches 1
2025-11-03T16:51:57.286090Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:57.286665Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 0,2 HeadOffset 0 endOffset 0 curOffset 2 d0000000000_00000000000000000000_00000_0000000002_00000? size 310 WTime 1762188717282
2025-11-03T16:51:57.286840Z node 6 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-03T16:51:57.286976Z node 6 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 0 partNo 0 count 2 size 310
2025-11-03T16:51:57.294174Z node 6 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 0 count 2 size 310 actorID [6:7568542904927608744:2388]
2025-11-03T16:51:57.294250Z node 6 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-03T16:51:57.294313Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 229 WriteNewSizeFromSupportivePartitions# 0
2025-11-03T16:51:57.294355Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:51:57.294402Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0test-message-group-id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 1, partNo: 0, Offset: 0 is stored on disk
2025-11-03T16:51:57.294426Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:51:57.294450Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0test-message-group-id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 2, partNo: 0, Offset: 1 is stored on disk
2025-11-03T16:51:57.294679Z node 6 :PERSQUEUE DEBUG: partition_read.cpp:923: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 2
2025-11-03T16:51:57.294701Z node 6 :PERSQUEUE DEBUG: partition_read.cpp:965: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 2
2025-11-03T16:51:57.294729Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:57.294744Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:57.294759Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:57.294797Z node 6 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:51:57.294869Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1  requestId: <none> cookie: 1
2025-11-03T16:51:57.295005Z node 6 :PERSQUEUE DEBUG: partition_read.cpp:880: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 partno 0 count 1 size 1024000 endOffset 2 max time lag 0ms effective offset 0
2025-11-03T16:51:57.295242Z node 6 :PERSQUEUE DEBUG: partition_read.cpp:1105: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 310 count 2 last offset 0, current partition end offset: 2
2025-11-03T16:51:57.295264Z node 6 :PERSQUEUE DEBUG: partition_read.cpp:1121: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-11-03T16:51:57.295311Z node 6 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 0 partno 0 count 2 parts_count 0 source 1 size 310 accessed 0 times before, last time 2025-11-03T16:51:57.000000Z
2025-11-03T16:51:57.295341Z node 6 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 3. All 1 blobs are from cache.
2025-11-03T16:51:57.295393Z node 6 :PERSQUEUE DEBUG: partition_read.cpp:572: FormAnswer for 1 blobs
2025-11-03T16:51:57.295946Z node 6 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 0 totakecount 2 count 2 size 290 from pos 0 cbcount 2
2025-11-03T16:51:57.296076Z node 6 :PERSQUEUE DEBUG: partition_read.cpp:1015: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1762188717282 queuesize 0 startOffset 0
2025-11-03T16:51:57.296253Z node 6 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 2 parts 0 suffix '63' size 310
2025-11-03T16:51:57.296314Z node 6 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 2 parts 0 suffix '63'
2025-11-03T16:51:57.296564Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:57.297677Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|25ac5fce-f176e289-cbe5fecd-5f9b220e_0] Write session got write response: sequence_numbers: 1 sequence_numbers: 2 offsets: 0 offsets: 1 already_written: false already_written: false write_statistics { persist_duration_ms: 10 }
2025-11-03T16:51:57.297730Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|25ac5fce-f176e289-cbe5fecd-5f9b220e_0] Write session: acknoledged message 1
2025-11-03T16:51:57.297776Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|25ac5fce-f176e289-cbe5fecd-5f9b220e_0] Write session: acknoledged message 2
2025-11-03T16:51:57.372621Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|25ac5fce-f176e289-cbe5fecd-5f9b220e_0] Write session will now close
2025-11-03T16:51:57.372721Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|25ac5fce-f176e289-cbe5fecd-5f9b220e_0] Write session: aborting
2025-11-03T16:51:57.373390Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|25ac5fce-f176e289-cbe5fecd-5f9b220e_0] Write session: gracefully shut down, all writes complete
2025-11-03T16:51:57.373448Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|25ac5fce-f176e289-cbe5fecd-5f9b220e_0] Write session: destroy
Start read
2025-11-03T16:51:57.373803Z :INFO: [/Root] [/Root] [d1383809-955a77fd-c7a52252-4d5f5723] Starting read session
2025-11-03T16:51:57.373841Z :DEBUG: [/Root] [/Root] [d1383809-955a77fd-c7a52252-4d5f5723] Starting cluster discovery
2025-11-03T16:51:57.378153Z node 5 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: test-message-group-id|25ac5fce-f176e289-cbe5fecd-5f9b220e_0 grpc read done: success: 0 data: 
2025-11-03T16:51:57.378187Z node 5 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 2 sessionId: test-message-group-id|25ac5fce-f176e289-cbe5fecd-5f9b220e_0 grpc read failed
2025-11-03T16:51:57.378229Z node 5 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 2 sessionId: test-message-group-id|25ac5fce-f176e289-cbe5fecd-5f9b220e_0 grpc closed
2025-11-03T16:51:57.378248Z node 5 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2 sessionId: test-message-group-id|25ac5fce-f176e289-cbe5fecd-5f9b220e_0 is DEAD
2025-11-03T16:51:57.379105Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-11-03T16:51:57.396267Z :DEBUG: [/Root] [/Root] [d1383809-955a77fd-c7a52252-4d5f5723] Cluster discovery request succeeded
2025-11-03T16:51:57.396364Z :DEBUG: [/Root] [/Root] [d1383809-955a77fd-c7a52252-4d5f5723] Starting session to cluster dc1 (localhost:65062)
2025-11-03T16:51:57.396601Z :DEBUG: [/Root] [/Root] [d1383809-955a77fd-c7a52252-4d5f5723] [dc1] In Reconnect, ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:51:57.396681Z :DEBUG: [/Root] [/Root] [d1383809-955a77fd-c7a52252-4d5f5723] [dc1] New values: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:51:57.396724Z :DEBUG: [/Root] [/Root] [d1383809-955a77fd-c7a52252-4d5f5723] [dc1] Reconnecting session to cluster dc1 in 0.000000s
2025-11-03T16:51:57.405327Z :DEBUG: [/Root] [/Root] [d1383809-955a77fd-c7a52252-4d5f5723] [dc1] Successfully connected. Initializing session
2025-11-03T16:51:57.408150Z node 5 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:109: new grpc connection
2025-11-03T16:51:57.408180Z node 5 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:131: new session created cookie 1
2025-11-03T16:51:57.409958Z node 5 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { topic: "test-topic" } read_only_original: true consumer: "shared/user" read_params { max_read_size: 104857600 } } }
2025-11-03T16:51:57.410236Z node 5 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 1 consumer shared/user session shared/user_5_1_4103898549532674287_v1 read init: from# ipv6:[::1]:54142, request# { init_request { topics_read_settings { topic: "test-topic" } read_only_original: true consumer: "shared/user" read_params { max_read_size: 104857600 } } }
2025-11-03T16:51:57.410740Z node 5 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 1 consumer shared/user session shared/user_5_1_4103898549532674287_v1 auth for : user
2025-11-03T16:51:57.411642Z node 5 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 1 consumer shared/user session shared/user_5_1_4103898549532674287_v1 Handle describe topics response
2025-11-03T16:51:57.411770Z node 5 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 1 consumer shared/user session shared/user_5_1_4103898549532674287_v1 auth is DEAD
2025-11-03T16:51:57.411865Z node 5 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 1 consumer shared/user session shared/user_5_1_4103898549532674287_v1 auth ok: topics# 1, initDone# 0
2025-11-03T16:51:57.413147Z node 5 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 1 consumer shared/user session shared/user_5_1_4103898549532674287_v1 register session: topic# rt3.dc1--test-topic
2025-11-03T16:51:57.416240Z :INFO: [/Root] [/Root] [d1383809-955a77fd-c7a52252-4d5f5723] [dc1] Server session id: shared/user_5_1_4103898549532674287_v1
2025-11-03T16:51:57.416523Z :DEBUG: [/Root] [/Root] [d1383809-955a77fd-c7a52252-4d5f5723] [dc1] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:51:57.416600Z node 5 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1655: [72075186224037893][rt3.dc1--test-topic] pipe [5:7568542909726351072:2483] connected; active server actors: 1
2025-11-03T16:51:57.416896Z node 5 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1706: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [5:7568542909726351072:2483] session shared/user_5_1_4103898549532674287_v1
2025-11-03T16:51:57.416969Z node 5 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:639: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-11-03T16:51:57.416977Z node 5 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_5_1_4103898549532674287_v1 grpc read done: success# 1, data# { read { } }
2025-11-03T16:51:57.417037Z node 5 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:669: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-11-03T16:51:57.417083Z node 5 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:871: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_5_1_4103898549532674287_v1" (Sender=[5:7568542909726351069:2483], Pipe=[5:7568542909726351072:2483], Partitions=[], ActiveFamilyCount=0)
2025-11-03T16:51:57.417087Z node 5 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_5_1_4103898549532674287_v1 got read request: guid# cb66d4c9-860bc069-3cc5b9db-9ac966ff
2025-11-03T16:51:57.417113Z node 5 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1186: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-11-03T16:51:57.417182Z node 5 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1258: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-11-03T16:51:57.417246Z node 5 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1305: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_5_1_4103898549532674287_v1" (Sender=[5:7568542909726351069:2483], Pipe=[5:7568542909726351072:2483], Partitions=[], ActiveFamilyCount=0)
2025-11-03T16:51:57.417313Z node 5 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:549: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_5_1_4103898549532674287_v1" sender [5:7568542909726351069:2483] lock partition 0 for ReadingSession "shared/user_5_1_4103898549532674287_v1" (Sender=[5:7568542909726351069:2483], Pipe=[5:7568542909726351072:2483], Partitions=[], ActiveFamilyCount=1) generation 1 step 1
2025-11-03T16:51:57.417372Z node 5 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1325: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-11-03T16:51:57.417405Z node 5 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1402: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000198s
2025-11-03T16:51:57.418417Z node 5 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 1 consumer shared/user session shared/user_5_1_4103898549532674287_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 1 Session: "shared/user_5_1_4103898549532674287_v1" ClientId: "user" PipeClient { RawX1: 7568542909726351072 RawX2: 4503621102209459 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-11-03T16:51:57.418503Z node 5 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 1 consumer shared/user session shared/user_5_1_4103898549532674287_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-11-03T16:51:57.420057Z node 5 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_5_1_4103898549532674287_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 1, pipe: [5:7568542909726351075:2486]
2025-11-03T16:51:57.557603Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:57.557643Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:57.557660Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:57.557736Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [5:7568542909726351047:2475] destroyed
2025-11-03T16:51:57.557778Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [5:7568542909726351075:2486], now have 1 active actors on pipe
2025-11-03T16:51:57.557845Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:57.557870Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:57.557905Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:1748: [PQ: 72075186224037892] Created session shared/user_5_1_4103898549532674287_v1 on pipe: [5:7568542909726351075:2486]
2025-11-03T16:51:57.557954Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-11-03T16:51:57.557985Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:57.557998Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:57.558009Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:57.558047Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:57.558067Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:57.558078Z node 6 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-03T16:51:57.558141Z node 6 :PERSQUEUE DEBUG: partition.cpp:3666: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_5_1_4103898549532674287_v1
2025-11-03T16:51:57.558155Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:57.558285Z node 6 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-03T16:51:57.567322Z node 6 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_5_1_4103898549532674287_v1:1 with generation 1
2025-11-03T16:51:57.569687Z node 6 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-03T16:51:57.569763Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-11-03T16:51:57.569795Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:57.569811Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:57.569824Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:57.569862Z node 6 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:51:57.569898Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-11-03T16:51:57.572276Z node 5 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_5_1_4103898549532674287_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 2 WriteTimestampMS: 1762188717282 CreateTimestampMS: 1762188717272 SizeLag: 310 WriteTimestampEstimateMS: 1762188717555 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-11-03T16:51:57.572338Z node 5 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 1 consumer shared/user session shared/user_5_1_4103898549532674287_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 2 readOffset 0 committedOffset 0
2025-11-03T16:51:57.572407Z node 5 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 1 consumer shared/user session shared/user_5_1_4103898549532674287_v1 sending to client partition status
2025-11-03T16:51:57.577903Z :INFO: [/Root] [/Root] [d1383809-955a77fd-c7a52252-4d5f5723] [dc1] Confirm partition stream create. Partition stream id: 1. Cluster: "dc1". Topic: "test-topic". Partition: 0. Read offset: (NULL)
2025-11-03T16:51:57.581076Z node 5 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_5_1_4103898549532674287_v1 grpc read done: success# 1, data# { start_read { topic { path: "test-topic" } cluster: "dc1" assign_id: 1 } }
2025-11-03T16:51:57.581297Z node 5 :PQ_READ_PROXY INFO: read_session_actor.cpp:539: session cookie 1 consumer shared/user session shared/user_5_1_4103898549532674287_v1 got StartRead from client: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 0, commitOffset# 0
2025-11-03T16:51:57.581360Z node 5 :PQ_READ_PROXY INFO: partition_actor.cpp:1023: session cookie 1 consumer shared/user session shared/user_5_1_4103898549532674287_v1 Start reading TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 2 readOffset 0 committedOffset 0 clientCommitOffset 0 clientReadOffset 0
2025-11-03T16:51:57.581388Z node 5 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_5_1_4103898549532674287_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 0 endOffset 2
2025-11-03T16:51:57.581452Z node 5 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_5_1_4103898549532674287_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 0, endOffset# 2, WTime# 1762188717282, sizeLag# 310
2025-11-03T16:51:57.581469Z node 5 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_5_1_4103898549532674287_v1TEvPartitionReady. Aval parts: 1
2025-11-03T16:51:57.581517Z node 5 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_5_1_4103898549532674287_v1 performing read request: guid# cb66d4c9-860bc069-3cc5b9db-9ac966ff, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 2, size# 372, partitionsAsked# 1, maxTimeLag# 0ms
2025-11-03T16:51:57.581578Z node 5 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_5_1_4103898549532674287_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 2 maxSize 372 maxTimeLagMs 0 readTimestampMs 0 readOffset 0 EndOffset 2 ClientCommitOffset 0 committedOffset 0 Guid cb66d4c9-860bc069-3cc5b9db-9ac966ff
2025-11-03T16:51:57.584396Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:57.584444Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:57.584576Z node 6 :PERSQUEUE DEBUG: partition_read.cpp:880: [72075186224037892][Partition][0][StateIdle] read cookie 4 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 partno 0 count 2 size 372 endOffset 2 max time lag 0ms effective offset 0
2025-11-03T16:51:57.585854Z node 6 :PERSQUEUE DEBUG: partition_read.cpp:1105: [72075186224037892][Partition][0][StateIdle] read cookie 4 added 1 blobs, size 310 count 2 last offset 0, current partition end offset: 2
2025-11-03T16:51:57.585883Z node 6 :PERSQUEUE DEBUG: partition_read.cpp:1121: [72075186224037892][Partition][0][StateIdle] Reading cookie 4. Send blob request.
2025-11-03T16:51:57.585948Z node 6 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 0 partno 0 count 2 parts_count 0 source 1 size 310 accessed 1 times before, last time 2025-11-03T16:51:57.000000Z
2025-11-03T16:51:57.585984Z node 6 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 4. All 1 blobs are from cache.
2025-11-03T16:51:57.586041Z node 6 :PERSQUEUE DEBUG: partition_read.cpp:572: FormAnswer for 1 blobs
2025-11-03T16:51:57.586253Z node 6 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 0 totakecount 2 count 2 size 290 from pos 0 cbcount 2
2025-11-03T16:51:57.586373Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-03T16:51:57.587490Z node 6 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 2 parts 0 suffix '63'
2025-11-03T16:51:57.588037Z node 5 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_5_1_4103898549532674287_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 2 Result { Offset: 0 Data: "... 93 bytes ..." SourceId: "\000test-message-group-id" SeqNo: 1 WriteTimestampMS: 1762188717282 CreateTimestampMS: 1762188717272 UncompressedSize: 13 PartitionKey: "" ExplicitHash: "" } Result { Offset: 1 Data: "... 92 bytes ..." SourceId: "\000test-message-group-id" SeqNo: 2 WriteTimestampMS: 1762188717282 CreateTimestampMS: 1762188717272 UncompressedSize: 12 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 11 RealReadOffset: 1 WaitQuotaTimeMs: 0 EndOffset: 2 StartOffset: 0 } Cookie: 0 }
2025-11-03T16:51:57.588206Z node 5 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_5_1_4103898549532674287_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 1 from offset 2
2025-11-03T16:51:57.588249Z node 5 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_5_1_4103898549532674287_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 2 ReadOffset 2 ReadGuid cb66d4c9-860bc069-3cc5b9db-9ac966ff has messages 1
2025-11-03T16:51:57.588373Z node 5 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_5_1_4103898549532674287_v1 read done: guid# cb66d4c9-860bc069-3cc5b9db-9ac966ff, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 252
2025-11-03T16:51:57.588410Z node 5 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_5_1_4103898549532674287_v1 response to read: guid# cb66d4c9-860bc069-3cc5b9db-9ac966ff
2025-11-03T16:51:57.588715Z node 5 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_5_1_4103898549532674287_v1 Process answer. Aval parts: 0
2025-11-03T16:51:57.589588Z :DEBUG: [/Root] [/Root] [d1383809-955a77fd-c7a52252-4d5f5723] [dc1] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:51:57.590016Z node 5 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_5_1_4103898549532674287_v1 grpc read done: success# 1, data# { read { } }
2025-11-03T16:51:57.590121Z node 5 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_5_1_4103898549532674287_v1 got read request: guid# 73d6d824-7e2d9759-e88b710b-5b451040
2025-11-03T16:51:57.592937Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 0 (0-1)
2025-11-03T16:51:57.593056Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (0-0)
2025-11-03T16:51:57.593102Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 1} (1-1)
Got messages
totalReceived: 2 wait: 2
2025-11-03T16:51:57.593452Z :DEBUG: [/Root] [/Root] [d1383809-955a77fd-c7a52252-4d5f5723] [dc1] The application data is transferred to the client. Number of messages 2, size 25 bytes
2025-11-03T16:51:57.594442Z :INFO: [/Root] [/Root] [d1383809-955a77fd-c7a52252-4d5f5723] Closing read session. Close timeout: 0.000000s
2025-11-03T16:51:57.594517Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): dc1:test-topic:0:1:1:0
2025-11-03T16:51:57.594588Z :INFO: [/Root] [/Root] [d1383809-955a77fd-c7a52252-4d5f5723] Counters: { Errors: 0 CurrentSessionLifetimeMs: 220 BytesRead: 25 MessagesRead: 2 BytesReadCompressed: 43 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-11-03T16:51:57.594698Z :NOTICE: [/Root] [/Root] [d1383809-955a77fd-c7a52252-4d5f5723] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Close with zero timeout " }
2025-11-03T16:51:57.594757Z :DEBUG: [/Root] [/Root] [d1383809-955a77fd-c7a52252-4d5f5723] [dc1] Abort session to cluster
2025-11-03T16:51:57.595363Z :NOTICE: [/Root] [/Root] [d1383809-955a77fd-c7a52252-4d5f5723] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
Start read
2025-11-03T16:51:57.595748Z :INFO: [/Root] [/Root] [e4bae366-245467bc-15c41cf7-3ccef816] Starting read session
2025-11-03T16:51:57.595783Z :DEBUG: [/Root] [/Root] [e4bae366-245467bc-15c41cf7-3ccef816] Starting cluster discovery
2025-11-03T16:51:57.601213Z node 5 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_5_1_4103898549532674287_v1 grpc read done: success# 0, data# {  }
2025-11-03T16:51:57.601241Z node 5 :PQ_READ_PROXY INFO: read_session_actor.cpp:125: session cookie 1 consumer shared/user session shared/user_5_1_4103898549532674287_v1 grpc read failed
2025-11-03T16:51:57.601275Z node 5 :PQ_READ_PROXY INFO: read_session_actor.cpp:92: session cookie 1 consumer shared/user session shared/user_5_1_4103898549532674287_v1 grpc closed
2025-11-03T16:51:57.601314Z node 5 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 1 consumer shared/user session shared/user_5_1_4103898549532674287_v1 is DEAD
2025-11-03T16:51:57.602367Z node 5 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1659: [72075186224037893][rt3.dc1--test-topic] pipe [5:7568542909726351072:2483] disconnected.
2025-11-03T16:51:57.602395Z node 5 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1670: [72075186224037893][rt3.dc1--test-topic] pipe [5:7568542909726351072:2483] disconnected; active server actors: 1
2025-11-03T16:51:57.602414Z node 5 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1679: [72075186224037893][rt3.dc1--test-topic] pipe [5:7568542909726351072:2483] client user disconnected session shared/user_5_1_4103898549532674287_v1
2025-11-03T16:51:57.605256Z :DEBUG: [/Root] [/Root] [e4bae366-245467bc-15c41cf7-3ccef816] Cluster discovery request succeeded
2025-11-03T16:51:57.605325Z :DEBUG: [/Root] [/Root] [e4bae366-245467bc-15c41cf7-3ccef816] Starting session to cluster dc1 (localhost:65062)
2025-11-03T16:51:57.605494Z :DEBUG: [/Root] [/Root] [e4bae366-245467bc-15c41cf7-3ccef816] [dc1] In Reconnect, ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:51:57.605533Z :DEBUG: [/Root] [/Root] [e4bae366-245467bc-15c41cf7-3ccef816] [dc1] New values: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:51:57.605572Z :DEBUG: [/Root] [/Root] [e4bae366-245467bc-15c41cf7-3ccef816] [dc1] Reconnecting session to cluster dc1 in 0.000000s
2025-11-03T16:51:57.611522Z :DEBUG: [/Root] [/Root] [e4bae366-245467bc-15c41cf7-3ccef816] [dc1] Successfully connected. Initializing session
2025-11-03T16:51:57.612620Z node 5 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:109: new grpc connection
2025-11-03T16:51:57.612644Z node 5 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:131: new session created cookie 2
2025-11-03T16:51:57.613272Z node 5 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 2 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { topic: "test-topic" } read_only_original: true consumer: "shared/user" read_params { max_read_size: 104857600 } } }
2025-11-03T16:51:57.613490Z node 5 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 2 consumer shared/user session shared/user_5_2_10546887840192080482_v1 read init: from# ipv6:[::1]:54144, request# { init_request { topics_read_settings { topic: "test-topic" } read_only_original: true consumer: "shared/user" read_params { max_read_size: 104857600 } } }
2025-11-03T16:51:57.613877Z node 5 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 2 consumer shared/user session shared/user_5_2_10546887840192080482_v1 auth for : user
2025-11-03T16:51:57.614830Z node 5 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 2 consumer shared/user session shared/user_5_2_10546887840192080482_v1 Handle describe topics response
2025-11-03T16:51:57.615024Z node 5 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 2 consumer shared/user session shared/user_5_2_10546887840192080482_v1 auth is DEAD
2025-11-03T16:51:57.615127Z node 5 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 2 consumer shared/user session shared/user_5_2_10546887840192080482_v1 auth ok: topics# 1, initDone# 0
2025-11-03T16:51:57.616168Z node 5 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 2 consumer shared/user session shared/user_5_2_10546887840192080482_v1 register session: topic# rt3.dc1--test-topic
2025-11-03T16:51:57.617351Z node 5 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1655: [72075186224037893][rt3.dc1--test-topic] pipe [5:7568542909726351086:2488] connected; active server actors: 1
2025-11-03T16:51:57.617508Z node 5 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1706: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [5:7568542909726351086:2488] session shared/user_5_2_10546887840192080482_v1
2025-11-03T16:51:57.617562Z node 5 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:639: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-11-03T16:51:57.617619Z node 5 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:669: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-11-03T16:51:57.617665Z node 5 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:871: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_5_2_10546887840192080482_v1" (Sender=[5:7568542909726351083:2488], Pipe=[5:7568542909726351086:2488], Partitions=[], ActiveFamilyCount=0)
2025-11-03T16:51:57.617696Z node 5 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1186: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-11-03T16:51:57.617747Z node 5 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1258: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-11-03T16:51:57.617800Z node 5 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1305: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_5_2_10546887840192080482_v1" (Sender=[5:7568542909726351083:2488], Pipe=[5:7568542909726351086:2488], Partitions=[], ActiveFamilyCount=0)
2025-11-03T16:51:57.617881Z node 5 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:549: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_5_2_10546887840192080482_v1" sender [5:7568542909726351083:2488] lock partition 0 for ReadingSession "shared/user_5_2_10546887840192080482_v1" (Sender=[5:7568542909726351083:2488], Pipe=[5:7568542909726351086:2488], Partitions=[], ActiveFamilyCount=1) generation 1 step 2
2025-11-03T16:51:57.617935Z node 5 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1325: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-11-03T16:51:57.617966Z node 5 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1402: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000195s
2025-11-03T16:51:57.618816Z node 5 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 2 consumer shared/user session shared/user_5_2_10546887840192080482_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 2 Session: "shared/user_5_2_10546887840192080482_v1" ClientId: "user" PipeClient { RawX1: 7568542909726351086 RawX2: 4503621102209464 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-11-03T16:51:57.618902Z node 5 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 2 consumer shared/user session shared/user_5_2_10546887840192080482_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-11-03T16:51:57.620013Z :INFO: [/Root] [/Root] [e4bae366-245467bc-15c41cf7-3ccef816] [dc1] Server session id: shared/user_5_2_10546887840192080482_v1
2025-11-03T16:51:57.620248Z :DEBUG: [/Root] [/Root] [e4bae366-245467bc-15c41cf7-3ccef816] [dc1] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:51:57.620747Z node 5 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 2 consumer shared/user session shared/user_5_2_10546887840192080482_v1 grpc read done: success# 1, data# { read { } }
2025-11-03T16:51:57.620823Z node 5 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 2 consumer shared/user session shared/user_5_2_10546887840192080482_v1 got read request: guid# 67c422ae-536aaf1b-3c2feeb4-a0804365
2025-11-03T16:51:57.621690Z node 5 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_5_2_10546887840192080482_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 1, pipe: [5:7568542909726351090:2491]
2025-11-03T16:51:58.612131Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset):
2025-11-03T16:51:58.612235Z :INFO: [/Root] [/Root] [e4bae366-245467bc-15c41cf7-3ccef816] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1016 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-11-03T16:51:58.640082Z node 5 :FLAT_TX_SCHEMESHARD WARN: schemeshard_impl.cpp:7727: Cannot get console configs
2025-11-03T16:51:58.640122Z node 5 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
2025-11-03T16:51:59.350967Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2258: [PQ: 72075186224037892] Destroy direct read session shared/user_5_1_4103898549532674287_v1
2025-11-03T16:51:59.351027Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [5:7568542909726351075:2486] destroyed
2025-11-03T16:51:59.351076Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [5:7568542909726351090:2491], now have 1 active actors on pipe
2025-11-03T16:51:59.351144Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:59.351171Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:59.351210Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:1748: [PQ: 72075186224037892] Created session shared/user_5_2_10546887840192080482_v1 on pipe: [5:7568542909726351090:2491]
2025-11-03T16:51:59.351272Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:59.351288Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:59.351308Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:59.351419Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:59.351443Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:59.351456Z node 6 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-03T16:51:59.351519Z node 6 :PERSQUEUE DEBUG: partition.cpp:3666: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_5_2_10546887840192080482_v1
2025-11-03T16:51:59.351535Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:59.351683Z node 6 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-03T16:51:59.352953Z node 6 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_5_1_4103898549532674287_v1
2025-11-03T16:51:59.352986Z node 6 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_5_2_10546887840192080482_v1:1 with generation 1
2025-11-03T16:51:59.365237Z node 5 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 2 consumer shared/user session shared/user_5_2_10546887840192080482_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 2 WriteTimestampMS: 1762188717282 CreateTimestampMS: 1762188717272 SizeLag: 310 WriteTimestampEstimateMS: 1762188719351 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-11-03T16:51:59.365299Z node 5 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 2 consumer shared/user session shared/user_5_2_10546887840192080482_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 2 readOffset 0 committedOffset 0
2025-11-03T16:51:59.365374Z node 5 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 2 consumer shared/user session shared/user_5_2_10546887840192080482_v1 sending to client partition status
2025-11-03T16:51:59.367951Z :INFO: [/Root] [/Root] [e4bae366-245467bc-15c41cf7-3ccef816] [dc1] Confirm partition stream create. Partition stream id: 1. Cluster: "dc1". Topic: "test-topic". Partition: 0. Read offset: (NULL)
2025-11-03T16:51:59.364337Z node 6 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-03T16:51:59.364452Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-11-03T16:51:59.364492Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:59.364510Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:59.364527Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:59.364569Z node 6 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:51:59.364610Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-11-03T16:51:59.371697Z node 5 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 2 consumer shared/user session shared/user_5_2_10546887840192080482_v1 grpc read done: success# 1, data# { start_read { topic { path: "test-topic" } cluster: "dc1" assign_id: 1 } }
2025-11-03T16:51:59.371843Z node 5 :PQ_READ_PROXY INFO: read_session_actor.cpp:539: session cookie 2 consumer shared/user session shared/user_5_2_10546887840192080482_v1 got StartRead from client: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 0, commitOffset# 0
2025-11-03T16:51:59.371914Z node 5 :PQ_READ_PROXY INFO: partition_actor.cpp:1023: session cookie 2 consumer shared/user session shared/user_5_2_10546887840192080482_v1 Start reading TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 2 readOffset 0 committedOffset 0 clientCommitOffset 0 clientReadOffset 0
2025-11-03T16:51:59.371953Z node 5 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 2 consumer shared/user session shared/user_5_2_10546887840192080482_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 0 endOffset 2
2025-11-03T16:51:59.372043Z node 5 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 2 consumer shared/user session shared/user_5_2_10546887840192080482_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 0, endOffset# 2, WTime# 1762188717282, sizeLag# 310
2025-11-03T16:51:59.372063Z node 5 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 2 consumer shared/user session shared/user_5_2_10546887840192080482_v1TEvPartitionReady. Aval parts: 1
2025-11-03T16:51:59.372112Z node 5 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 2 consumer shared/user session shared/user_5_2_10546887840192080482_v1 performing read request: guid# 67c422ae-536aaf1b-3c2feeb4-a0804365, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 2, size# 372, partitionsAsked# 1, maxTimeLag# 0ms
2025-11-03T16:51:59.372199Z node 5 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 2 consumer shared/user session shared/user_5_2_10546887840192080482_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 2 maxSize 372 maxTimeLagMs 0 readTimestampMs 0 readOffset 0 EndOffset 2 ClientCommitOffset 0 committedOffset 0 Guid 67c422ae-536aaf1b-3c2feeb4-a0804365
2025-11-03T16:51:59.372826Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:59.372867Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:59.372991Z node 6 :PERSQUEUE DEBUG: partition_read.cpp:880: [72075186224037892][Partition][0][StateIdle] read cookie 5 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 partno 0 count 2 size 372 endOffset 2 max time lag 0ms effective offset 0
2025-11-03T16:51:59.373237Z node 6 :PERSQUEUE DEBUG: partition_read.cpp:1105: [72075186224037892][Partition][0][StateIdle] read cookie 5 added 1 blobs, size 310 count 2 last offset 0, current partition end offset: 2
2025-11-03T16:51:59.373260Z node 6 :PERSQUEUE DEBUG: partition_read.cpp:1121: [72075186224037892][Partition][0][StateIdle] Reading cookie 5. Send blob request.
2025-11-03T16:51:59.373311Z node 6 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 0 partno 0 count 2 parts_count 0 source 1 size 310 accessed 2 times before, last time 2025-11-03T16:51:57.000000Z
2025-11-03T16:51:59.373357Z node 6 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 5. All 1 blobs are from cache.
2025-11-03T16:51:59.373409Z node 6 :PERSQUEUE DEBUG: partition_read.cpp:572: FormAnswer for 1 blobs
2025-11-03T16:51:59.373429Z node 6 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 2 parts 0 suffix '63'
2025-11-03T16:51:59.373629Z node 6 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 0 totakecount 2 count 2 size 290 from pos 0 cbcount 2
2025-11-03T16:51:59.373750Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-03T16:51:59.374536Z node 5 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 2 consumer shared/user session shared/user_5_2_10546887840192080482_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 2 Result { Offset: 0 Data: "... 93 bytes ..." SourceId: "\000test-message-group-id" SeqNo: 1 WriteTimestampMS: 1762188717282 CreateTimestampMS: 1762188717272 UncompressedSize: 13 PartitionKey: "" ExplicitHash: "" } Result { Offset: 1 Data: "... 92 bytes ..." SourceId: "\000test-message-group-id" SeqNo: 2 WriteTimestampMS: 1762188717282 CreateTimestampMS: 1762188717272 UncompressedSize: 12 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 11 RealReadOffset: 1 WaitQuotaTimeMs: 0 EndOffset: 2 StartOffset: 0 } Cookie: 0 }
2025-11-03T16:51:59.374719Z node 5 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 2 consumer shared/user session shared/user_5_2_10546887840192080482_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 1 from offset 2
2025-11-03T16:51:59.374768Z node 5 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 2 consumer shared/user session shared/user_5_2_10546887840192080482_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 2 ReadOffset 2 ReadGuid 67c422ae-536aaf1b-3c2feeb4-a0804365 has messages 1
2025-11-03T16:51:59.374931Z node 5 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 2 consumer shared/user session shared/user_5_2_10546887840192080482_v1 read done: guid# 67c422ae-536aaf1b-3c2feeb4-a0804365, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 252
2025-11-03T16:51:59.374962Z node 5 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 2 consumer shared/user session shared/user_5_2_10546887840192080482_v1 response to read: guid# 67c422ae-536aaf1b-3c2feeb4-a0804365
2025-11-03T16:51:59.375232Z node 5 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 2 consumer shared/user session shared/user_5_2_10546887840192080482_v1 Process answer. Aval parts: 0
2025-11-03T16:51:59.376388Z :DEBUG: [/Root] [/Root] [e4bae366-245467bc-15c41cf7-3ccef816] [dc1] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:51:59.376682Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 0 (0-1)
2025-11-03T16:51:59.376775Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (0-0)
2025-11-03T16:51:59.376824Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 1} (1-1)
2025-11-03T16:51:59.377016Z node 5 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 2 consumer shared/user session shared/user_5_2_10546887840192080482_v1 grpc read done: success# 1, data# { read { } }
2025-11-03T16:51:59.377135Z node 5 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 2 consumer shared/user session shared/user_5_2_10546887840192080482_v1 got read request: guid# 25065d56-443a8def-40a510ca-f49bc11d
Got messages
totalReceived: 2 wait: 2
2025-11-03T16:51:59.377591Z :DEBUG: [/Root] [/Root] [e4bae366-245467bc-15c41cf7-3ccef816] [dc1] The application data is transferred to the client. Number of messages 2, size 43 bytes
2025-11-03T16:51:59.377740Z :INFO: [/Root] [/Root] [e4bae366-245467bc-15c41cf7-3ccef816] Closing read session. Close timeout: 0.000000s
2025-11-03T16:51:59.377793Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): dc1:test-topic:0:1:1:0
2025-11-03T16:51:59.377846Z :INFO: [/Root] [/Root] [e4bae366-245467bc-15c41cf7-3ccef816] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1782 BytesRead: 43 MessagesRead: 2 BytesReadCompressed: 43 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-11-03T16:51:59.377958Z :NOTICE: [/Root] [/Root] [e4bae366-245467bc-15c41cf7-3ccef816] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Close with zero timeout " }
2025-11-03T16:51:59.378016Z :DEBUG: [/Root] [/Root] [e4bae366-245467bc-15c41cf7-3ccef816] [dc1] Abort session to cluster
2025-11-03T16:51:59.378503Z :NOTICE: [/Root] [/Root] [e4bae366-245467bc-15c41cf7-3ccef816] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
2025-11-03T16:51:59.382761Z node 5 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 2 consumer shared/user session shared/user_5_2_10546887840192080482_v1 grpc read done: success# 0, data# {  }
2025-11-03T16:51:59.382791Z node 5 :PQ_READ_PROXY INFO: read_session_actor.cpp:125: session cookie 2 consumer shared/user session shared/user_5_2_10546887840192080482_v1 grpc read failed
2025-11-03T16:51:59.382823Z node 5 :PQ_READ_PROXY INFO: read_session_actor.cpp:92: session cookie 2 consumer shared/user session shared/user_5_2_10546887840192080482_v1 grpc closed
2025-11-03T16:51:59.382872Z node 5 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 2 consumer shared/user session shared/user_5_2_10546887840192080482_v1 is DEAD
2025-11-03T16:51:59.383753Z node 5 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1659: [72075186224037893][rt3.dc1--test-topic] pipe [5:7568542909726351086:2488] disconnected.
2025-11-03T16:51:59.383779Z node 5 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1670: [72075186224037893][rt3.dc1--test-topic] pipe [5:7568542909726351086:2488] disconnected; active server actors: 1
2025-11-03T16:51:59.383799Z node 5 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1679: [72075186224037893][rt3.dc1--test-topic] pipe [5:7568542909726351086:2488] client user disconnected session shared/user_5_2_10546887840192080482_v1
2025-11-03T16:51:59.384673Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2258: [PQ: 72075186224037892] Destroy direct read session shared/user_5_2_10546887840192080482_v1
2025-11-03T16:51:59.384730Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [5:7568542909726351090:2491] destroyed
2025-11-03T16:51:59.384774Z node 6 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_5_2_10546887840192080482_v1
2025-11-03T16:51:59.451395Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:59.451427Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:59.451444Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:59.551637Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:59.551683Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:59.551706Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:02.300293Z :WriteWithMixedCodecs INFO: Random seed for debugging is 1762188722300274
2025-11-03T16:52:03.544419Z node 7 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[7:7568542936816173418:2079];send_to=[0:7307199536658146131:7762515];
2025-11-03T16:52:03.544478Z node 7 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
test_client.cpp: SetPath # /home/runner/.ya/build/build_root/7jz3/001998/r3tmp/tmp2z21Ua/pdisk_1.dat
2025-11-03T16:52:03.685540Z node 7 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-11-03T16:52:03.711350Z node 7 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:123: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, got undelivered to scheme cache: ActorUnknown
2025-11-03T16:52:03.774945Z node 8 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-11-03T16:52:03.802625Z node 8 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-11-03T16:52:03.802784Z node 8 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=incorrect path status: LookupError;
2025-11-03T16:52:03.816138Z node 7 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-11-03T16:52:04.052094Z node 8 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-11-03T16:52:04.116079Z node 7 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-11-03T16:52:04.188022Z node 7 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
2025-11-03T16:52:04.270871Z node 7 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(7, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-11-03T16:52:04.271009Z node 7 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(7, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-11-03T16:52:04.277088Z node 7 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(8, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-11-03T16:52:04.277186Z node 7 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(8, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-11-03T16:52:04.292024Z node 7 :HIVE WARN: hive_impl.cpp:811: HIVE#72057594037968897 Handle TEvInterconnect::TEvNodeConnected, NodeId 8 Cookie 8
2025-11-03T16:52:04.292172Z node 7 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(7, (0,0,0,0)) VolatileState: Connecting -> Connected
2025-11-03T16:52:04.292839Z node 7 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(8, (0,0,0,0)) VolatileState: Connecting -> Connected
TServer::EnableGrpc on GrpcPort 6533, node 7
2025-11-03T16:52:04.420681Z node 8 :BS_NODE WARN: {NWDC01@distconf.cpp:397} StateFunc too long Type# 268639238 Duration# 0.006105s
2025-11-03T16:52:04.432077Z node 8 :BS_NODE WARN: {NWDC01@distconf.cpp:397} StateFunc too long Type# 268639239 Duration# 0.011306s
2025-11-03T16:52:04.432154Z node 8 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-11-03T16:52:04.492729Z node 7 :NET_CLASSIFIER WARN: net_classifier.cpp:190: distributable config is empty, broken or outdated, will use file: /home/runner/.ya/build/build_root/7jz3/001998/r3tmp/yandexEbKCwb.tmp
2025-11-03T16:52:04.492757Z node 7 :NET_CLASSIFIER WARN: net_classifier.cpp:196: will try to initialize from file: /home/runner/.ya/build/build_root/7jz3/001998/r3tmp/yandexEbKCwb.tmp
2025-11-03T16:52:04.492927Z node 7 :NET_CLASSIFIER WARN: net_classifier.cpp:202: successfully initialized from file: /home/runner/.ya/build/build_root/7jz3/001998/r3tmp/yandexEbKCwb.tmp
2025-11-03T16:52:04.493124Z node 7 :NET_CLASSIFIER ERROR: net_classifier.cpp:228: got bad distributable configuration
2025-11-03T16:52:04.585582Z INFO: TTestServer started on Port 27335 GrpcPort 6533
2025-11-03T16:52:04.594880Z node 7 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-11-03T16:52:04.614387Z node 7 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-11-03T16:52:04.704291Z node 8 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
TClient is connected to server localhost:27335
PQClient connected to localhost:6533
WaitRootIsUp 'Root'...
TClient::Ls request: Root
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "Root"
    PathId: 1
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 1
    CreateStep: 0
    ParentPathId: 1
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 1
      SubDomainVersion: 0
      SecurityStateVersion: 0
    }
    ChildrenExist: false
  }
  Children {
    Name: ".sys"
    PathId: 18446744073709551615
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 0
    CreateStep: 0
    ParentPathId: 18446744073709551615
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 0
      Pl...
(TRUNCATED)
WaitRootIsUp 'Root' success.
2025-11-03T16:52:05.226631Z node 7 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpAlterSubDomain, opId: 281474976710657:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_alter_subdomain.cpp:311)
waiting...
waiting...
waiting...
waiting...
2025-11-03T16:52:08.536979Z node 7 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[7:7568542936816173418:2079];send_to=[0:7307199536658146131:7762515];
2025-11-03T16:52:08.537083Z node 7 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
2025-11-03T16:52:09.695733Z node 7 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [7:7568542962585978189:2334], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-03T16:52:09.695852Z node 7 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [7:7568542962585978184:2331], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-03T16:52:09.696584Z node 7 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-03T16:52:09.698616Z node 7 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [7:7568542962585978201:2337], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-03T16:52:09.698701Z node 7 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-03T16:52:09.700564Z node 7 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateResourcePool, opId: 281474976710661:3, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_resource_pool.cpp:179)
2025-11-03T16:52:09.716147Z node 7 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [7:7568542962585978241:2340], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-03T16:52:09.716704Z node 7 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-03T16:52:09.742711Z node 7 :KQP_WORKLOAD_SERVICE WARN: helpers.h:73: [WorkloadService] [TPoolCreatorActor] ActorId: [7:7568542962585978199:2336], DatabaseId: /Root, PoolId: default, Scheduled retry for error: { <main>: Error: Transaction 281474976710661 completed, doublechecking }
2025-11-03T16:52:09.760902Z node 7 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710662:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:690)
2025-11-03T16:52:09.827756Z node 7 :TX_PROXY ERROR: schemereq.cpp:593: Actor# [7:7568542962585978353:2732] txid# 281474976710663, issues: { message: "Check failed: path: \'/Root/.metadata/workload_manager/pools/default\', error: path exist, request accepts it (id: [OwnerId: 72057594046644480, LocalPathId: 8], type: EPathTypeResourcePool, state: EPathStateNoChanges)" severity: 1 }
2025-11-03T16:52:09.886375Z node 7 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:570: Compilation failed, self: [7:7568542962585978364:2349], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:5:17: Error: At function: KiReadTable!
        <main>:5:17: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Versions]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-11-03T16:52:09.886957Z node 7 :KQP_SESSION WARN: kqp_session_actor.cpp:2506: SessionId: ydb://session/3?node_id=7&id=MjliMzM4ZjctZTMyODAxNWQtYWEzY2Y0YzAtMjdlOGU1ZmU=, ActorId: [7:7568542962585978182:2330], ActorState: ExecuteState, TraceId: 01k95a47axbkypp14m30z389r8, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-11-03T16:52:09.887891Z node 7 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 5 column: 17 } message: "At function: KiReadTable!" end_position { row: 5 column: 17 } severity: 1 issues { position { row: 5 column: 17 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Versions]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 5 column: 17 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-11-03T16:52:09.891971Z node 7 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710664:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:690)
2025-11-03T16:52:10.133196Z node 7 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710665:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:690)
=== Init DC: UPSERT INTO `/Root/PQ/Config/V2/Cluster` (name, balancer, local, enabled, weight) VALUES ("dc1", "localhost:6533", true, true, 1000);
2025-11-03T16:52:10.582210Z node 7 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976710666. Ctx: { TraceId: 01k95a47yx1kjn88bexxwg73f7, Database: , SessionId: ydb://session/3?node_id=7&id=YmQ5MzgyMDUtNDQzNmU5NzMtYmQ1NzY0MzktNzJmZWU2YWY=, PoolId: default, DatabaseId: /Root}. Database not set, use /Root
=== CheckClustersList. Subcribe to ClusterTracker from [7:7568542966880945999:2985] 
=== CheckClustersList. Ok
2025-11-03T16:52:15.982244Z node 7 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710671:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:690)
waiting...
PQ Client: create topic: rt3.dc1--test-topic with 1 partitions
CallPersQueueGRPC request to localhost:6533
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-11-03T16:52:16.211840Z node 7 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
CallPersQueueGRPC request to localhost:6533
MetaRequest {
  CmdCreateTopic {
    Topic: "rt3.dc1--test-topic"
    NumPartitions: 1
    Config {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
  }
}
CallPersQueueGRPC response:
Status: 129
ProxyErrorCode: 53
SchemeStatus: 1
FlatTxId {
  TxId: 281474976710672
  SchemeShardTabletId: 72057594046644480
  PathId: 13
}
ErrorCode: OK
AddTopic: rt3.dc1--test-topic
===Run query:``DECLARE $version as Int64; DECLARE $path AS Utf8; DECLARE $cluster as Utf8; UPSERT INTO `/Root/PQ/Config/V2/Topics` (path, dc) VALUES ($path, $cluster); UPSERT INTO `/Root/PQ/Config/V2/Versions` (name, version) VALUES ("Topics", $version);`` with topic = test-topic, dc = dc1
2025-11-03T16:52:16.369638Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1655: [72075186224037893][] pipe [7:7568542992650750155:3230] connected; active server actors: 1
2025-11-03T16:52:16.369854Z node 7 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1519: [72075186224037893][rt3.dc1--test-topic] updating configuration. Deleted partitions []. Added partitions [0]
2025-11-03T16:52:16.370977Z node 7 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:971: [72075186224037893][rt3.dc1--test-topic] Discovered subdomain [OwnerId: 72057594046644480, LocalPathId: 1] state, outOfSpace = 0 at RB 72075186224037893
2025-11-03T16:52:16.382815Z node 7 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:140: [72075186224037893][rt3.dc1--test-topic] BALANCER INIT DONE for rt3.dc1--test-topic: (0, 72075186224037892) 
2025-11-03T16:52:16.390418Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2960: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-11-03T16:52:16.400366Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2992: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-11-03T16:52:16.400687Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:787: [PQ: 72075186224037892] no config, start with empty partitions and default config
2025-11-03T16:52:16.400727Z node 8 :PERSQUEUE NOTICE: pq_impl.cpp:913: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-11-03T16:52:16.400778Z node 8 :PERSQUEUE INFO: pq_impl.cpp:612: [PQ: 72075186224037892] doesn't have tx writes info
2025-11-03T16:52:16.402537Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [7:7568542992650750180:2441], now have 1 active actors on pipe
2025-11-03T16:52:16.402573Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [7:7568542992650750154:3229], now have 1 active actors on pipe
2025-11-03T16:52:16.403015Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-03T16:52:16.404197Z node 7 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:404: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 8, Generation 1
2025-11-03T16:52:16.420857Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-03T16:52:16.432514Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [7:7568542992650750216:3278], now have 1 active actors on pipe
2025-11-03T16:52:16.438454Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-03T16:52:16.444101Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-03T16:52:16.445253Z node 8 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-11-03T16:52:16.445311Z node 8 :PERSQUEUE DEBUG: partition.cpp:1312: [72075186224037892][Partition][0][StateInit] HandleOnInit TEvPQ::TEvProposePartitionConfig
2025-11-03T16:52:16.445693Z node 8 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-11-03T16:52:16.445945Z node 8 :PERSQUEUE INFO: partition_init.cpp:1101: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [8:7568542990700301919:2375]
2025-11-03T16:52:16.456938Z node 8 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-11-03T16:52:16.456984Z node 8 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-11-03T16:52:16.457020Z node 8 :PERSQUEUE INFO: partition.cpp:707: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1 [8:7568542990700301919:2375]
2025-11-03T16:52:16.457055Z node 8 :PERSQUEUE DEBUG: partition.cpp:727: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 0 Head Offset 0 PartNo 0 PackedSize 0 count 0 nextOffset 0 batches 0
2025-11-03T16:52:16.457104Z node 8 :PERSQUEUE DEBUG: partition_mlp.cpp:83: [72075186224037892][Partition][0][StateIdle] Initializing MLP Consumers: 0
2025-11-03T16:52:16.464887Z node 8 :PERSQUEUE DEBUG: partition.cpp:4273: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 1
2025-11-03T16:52:16.464944Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:16.465051Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:16.465068Z node 8 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-03T16:52:16.465106Z node 8 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-11-03T16:52:16.465123Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:16.465140Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:16.465155Z node 8 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-11-03T16:52:16.465194Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:923: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-11-03T16:52:16.465240Z node 8 :PERSQUEUE DEBUG: partition_mlp.cpp:60: [72075186224037892][Partition][0][StateIdle] Process MLP pending events. Count 0
2025-11-03T16:52:16.465702Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-03T16:52:16.465860Z node 8 :PERSQUEUE DEBUG: partition_compaction.cpp:183: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:52:16.474472Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-03T16:52:16.474669Z node 8 :PERSQUEUE DEBUG: partition.cpp:1416: [72075186224037892][Partition][0][StateIdle] Handle TEvPQ::TEvTxCommit Step 1762188736476, TxId 281474976710672
2025-11-03T16:52:16.474705Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:16.474721Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:16.474892Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:16.475223Z node 8 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-03T16:52:16.479020Z node 8 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-03T16:52:16.479232Z node 8 :PERSQUEUE DEBUG: partition_mlp.cpp:83: [72075186224037892][Partition][0][StateIdle] Initializing MLP Consumers: 0
2025-11-03T16:52:16.479372Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-11-03T16:52:16.479406Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:16.479420Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:16.479434Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:16.479475Z node 8 :PERSQUEUE DEBUG: partition_compaction.cpp:183: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:52:16.479922Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:398: [PQ: 72075186224037892] Apply new config PartitionConfig { LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 } PartitionIds: 0 TopicName: "rt3.dc1--test-topic" Version: 0 LocalDC: true Codecs { Ids: 0 Ids: 1 Ids: 2 Codecs: "raw" Codecs: "gzip" Codecs: "lzop" } TopicPath: "/Root/PQ/rt3.dc1--test-topic" YcCloudId: "" YcFolderId: "" YdbDatabaseId: "" YdbDatabasePath: "/Root" Partitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } AllPartitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } Consumers { Name: "user" ReadFromTimestampsMs: 0 FormatVersion: 0 Version: 0 Generation: 0 } MonitoringProjectId: ""
2025-11-03T16:52:16.480048Z node 8 :PERSQUEUE NOTICE: pq_impl.cpp:913: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-11-03T16:52:16.480386Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-03T16:52:16.501046Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-03T16:52:16.501171Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-03T16:52:16.509379Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-03T16:52:16.568114Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:16.568157Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:16.568178Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:16.648365Z node 7 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976710673. Ctx: { TraceId: 01k95a4dte2rz8cs4s4j2xnp9q, Database: , SessionId: ydb://session/3?node_id=7&id=Njg3MDQ0NWMtNWRjMjE4MWItMWE2MTAwZDktYzNhMTI0Y2Q=, PoolId: default, DatabaseId: /Root}. Database not set, use /Root
2025-11-03T16:52:16.664827Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:16.664868Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:16.664886Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
===Query complete
TClient::Ls request: /Root/PQ/rt3.dc1--test-topic
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976710672
    CreateStep: 1762188736476
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts...
(TRUNCATED)
GetTopicVersionFromPath:  record Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976710672
    CreateStep: 1762188736476
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      YdbDatabasePath: "/Root"
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
    Partitions {
      PartitionId: 0
      TabletId: 72075186224037892
      Status: Active
    }
    AlterVersion: 1
    BalancerTabletID: 72075186224037893
    NextPartitionId: 1
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 1
      PlanResolution: 7
      Coordinators: 72057594046316545
      TimeCastBucketsPerMediator: 2
      Mediators: 72057594046382081
    }
    DomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    PathsInside: 12
    PathsLimit: 10000
    ShardsInside: 6
    ShardsLimit: 200000
    ResourcesDomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    DiskSpaceUsage {
      Tables {
        TotalSize: 0
        DataSize: 0
        IndexSize: 0
      }
      Topics {
        ReserveSize: 0
        AccountSize: 0
        DataSize: 0
        UsedReserveSize: 0
      }
    }
    PQPartitionsInside: 1
    PQPartitionsLimit: 1000000
    SchemeLimits {
      MaxDepth: 32
      MaxPaths: 10000
      MaxChildrenInDir: 100000
      MaxAclBytesSize: 10240
      MaxTableColumns: 200
      MaxTableColumnNameLength: 255
      MaxTableKeyColumns: 30
      MaxTableIndices: 20
      MaxShards: 200000
      MaxShardsInPath: 35000
      MaxConsistentCopyTargets: 10000
      MaxPathElementLength: 255
      ExtraPathSymbolsAllowed: "!\"#$%&\'()*+,-.:;<=>?@[\\]^_`{|}~"
      MaxPQPartitions: 1000000
      MaxTableCdcStreams: 5
      MaxExports: 10
      MaxImports: 10
      MaxColumnTableColumns: 10000
    }
  }
}
Path: "/Root/PQ/rt3.dc1--test-topic"
 name rt3.dc1--test-topic version1
CallPersQueueGRPC request to localhost:6533
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-11-03T16:52:16.722065Z node 7 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
MetaResponse {
  CmdGetTopicMetadataResult {
    TopicInfo {
      Topic: "rt3.dc1--test-topic"
      NumPartitions: 1
      Config {
        PartitionConfig {
          LifetimeSeconds: 86400
          LowWatermark: 8388608
          SourceIdLifetimeSeconds: 86400
          WriteSpeedInBytesPerSecond: 20000000
          BurstSize: 20000000
          SourceIdMaxCounts: 6000000
        }
        Version: 1
        LocalDC: true
        Codecs {
          Ids: 0
          Ids: 1
          Ids: 2
          Codecs: "raw"
          Codecs: "gzip"
          Codecs: "lzop"
        }
        TopicPath: "/Root/PQ/rt3.dc1--test-topic"
        YdbDatabasePath: "/Root"
        Consumers {
          Name: "user"
          ReadFromTimestampsMs: 0
          FormatVersion: 0
          Version: 0
        }
      }
      ErrorCode: OK
    }
  }
}
=== Topic created, have version: 1
2025-11-03T16:52:16.750192Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: try to update token
2025-11-03T16:52:16.750594Z :INFO: [] MessageGroupId [src] SessionId [] Write session: Do CDS request
2025-11-03T16:52:16.750631Z :INFO: [] MessageGroupId [src] SessionId [] Start write session. Will connect to endpoint: localhost:6533
2025-11-03T16:52:16.767784Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:16.767816Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:16.767834Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:16.789225Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src" }
2025-11-03T16:52:16.792271Z node 7 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-11-03T16:52:16.792317Z node 7 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1
2025-11-03T16:52:16.804184Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src" }
2025-11-03T16:52:16.804385Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1 topic: "test-topic" message_group_id: "src" from ipv6:[::1]:39790
2025-11-03T16:52:16.804405Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:39790 proto=v1  topic=test-topic durationSec=0
2025-11-03T16:52:16.804417Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-11-03T16:52:16.807525Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1 sessionId:  describe result for acl check
2025-11-03T16:52:16.807694Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-11-03T16:52:16.807708Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-11-03T16:52:16.807723Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-11-03T16:52:16.807746Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [7:7568542992650750303:2461] (SourceId=src, PreferedPartition=(NULL)) StartKqpSession
2025-11-03T16:52:16.812150Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [7:7568542992650750303:2461] (SourceId=src, PreferedPartition=(NULL)) Select from the table
2025-11-03T16:52:16.872134Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:16.872166Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:16.872192Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:17.282842Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [7:7568542992650750303:2461] (SourceId=src, PreferedPartition=(NULL)) RequestPQRB
2025-11-03T16:52:17.283832Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1655: [72075186224037893][rt3.dc1--test-topic] pipe [7:7568542996945717654:2461] connected; active server actors: 1
2025-11-03T16:52:17.283971Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [7:7568542992650750303:2461] (SourceId=src, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=src
2025-11-03T16:52:17.284005Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [7:7568542992650750303:2461] (SourceId=src, PreferedPartition=(NULL)) Update the table
2025-11-03T16:52:17.333861Z node 7 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1659: [72075186224037893][rt3.dc1--test-topic] pipe [7:7568542996945717654:2461] disconnected.
2025-11-03T16:52:17.333902Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1670: [72075186224037893][rt3.dc1--test-topic] pipe [7:7568542996945717654:2461] disconnected; active server actors: 1
2025-11-03T16:52:17.333918Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1695: [72075186224037893][rt3.dc1--test-topic] pipe [7:7568542996945717654:2461] disconnected no session
2025-11-03T16:52:17.470481Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [7:7568542992650750303:2461] (SourceId=src, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-11-03T16:52:17.470532Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [7:7568542992650750303:2461] (SourceId=src, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-11-03T16:52:17.470550Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [7:7568542992650750303:2461] (SourceId=src, PreferedPartition=(NULL)) Start idle
2025-11-03T16:52:17.470579Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-11-03T16:52:17.480672Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 8, Generation: 1
2025-11-03T16:52:19.080887Z node 7 :FLAT_TX_SCHEMESHARD WARN: schemeshard_impl.cpp:7727: Cannot get console configs
2025-11-03T16:52:19.080914Z node 7 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
2025-11-03T16:52:20.351872Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:20.351901Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:20.351916Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:20.352030Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [7:7568542996945717678:2461], now have 1 active actors on pipe
2025-11-03T16:52:20.352092Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:20.352118Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:20.352197Z node 8 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src|aa74f395-690e78f6-de165b36-859a0a8c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src
2025-11-03T16:52:20.352244Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:20.352266Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:20.352279Z node 8 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-03T16:52:20.352316Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:20.352347Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-03T16:52:20.352395Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-03T16:52:20.355559Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:20.355588Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:20.355664Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-03T16:52:20.356638Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1 partition: 0 MaxSeqNo: 0 sessionId: src|aa74f395-690e78f6-de165b36-859a0a8c_0
2025-11-03T16:52:20.360164Z :INFO: [] MessageGroupId [src] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1762188740360 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-11-03T16:52:20.360298Z :INFO: [] MessageGroupId [src] SessionId [] Write session established. Init response: session_id: "src|aa74f395-690e78f6-de165b36-859a0a8c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-11-03T16:52:20.361885Z :INFO: [] MessageGroupId [src] SessionId [src|aa74f395-690e78f6-de165b36-859a0a8c_0] Write session: close. Timeout = 0 ms
2025-11-03T16:52:20.361953Z :INFO: [] MessageGroupId [src] SessionId [src|aa74f395-690e78f6-de165b36-859a0a8c_0] Write session will now close
2025-11-03T16:52:20.361996Z :DEBUG: [] MessageGroupId [src] SessionId [src|aa74f395-690e78f6-de165b36-859a0a8c_0] Write session: aborting
2025-11-03T16:52:20.362470Z :INFO: [] MessageGroupId [src] SessionId [src|aa74f395-690e78f6-de165b36-859a0a8c_0] Write session: gracefully shut down, all writes complete
2025-11-03T16:52:20.362529Z :DEBUG: [] MessageGroupId [src] SessionId [src|aa74f395-690e78f6-de165b36-859a0a8c_0] Write session: destroy
2025-11-03T16:52:20.363365Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId: src|aa74f395-690e78f6-de165b36-859a0a8c_0 grpc read done: success: 0 data: 
2025-11-03T16:52:20.363390Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 1 sessionId: src|aa74f395-690e78f6-de165b36-859a0a8c_0 grpc read failed
2025-11-03T16:52:20.363420Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 1 sessionId: src|aa74f395-690e78f6-de165b36-859a0a8c_0 grpc closed
2025-11-03T16:52:20.363437Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1 sessionId: src|aa74f395-690e78f6-de165b36-859a0a8c_0 is DEAD
2025-11-03T16:52:20.364772Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-11-03T16:52:20.373040Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [7:7568542996945717678:2461] destroyed
2025-11-03T16:52:20.373090Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-11-03T16:52:20.373118Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:20.373133Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:20.373147Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:20.383902Z node 7 :PQ_READ_PROXY DEBUG: grpc_pq_schema.cpp:207: new Alter topic request
2025-11-03T16:52:20.386265Z node 7 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpAlterPersQueueGroup, opId: 281474976710677:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_alter_pq.cpp:313)
2025-11-03T16:52:20.408030Z node 7 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1519: [72075186224037893][rt3.dc1--test-topic] updating configuration. Deleted partitions []. Added partitions []
2025-11-03T16:52:20.408246Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-03T16:52:20.428212Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-03T16:52:20.442531Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-03T16:52:20.453352Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:20.453382Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:20.453400Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:20.457845Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-03T16:52:20.458128Z node 8 :PERSQUEUE DEBUG: partition.cpp:1277: [72075186224037892][Partition][0][StateIdle] Handle TEvPQ::TEvProposePartitionConfig Step 1762188740487, TxId 281474976710677
2025-11-03T16:52:20.458153Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:20.458253Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:20.458275Z node 8 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-03T16:52:20.458305Z node 8 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-11-03T16:52:20.458551Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-03T16:52:20.466185Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-03T16:52:20.466326Z node 8 :PERSQUEUE DEBUG: partition.cpp:1416: [72075186224037892][Partition][0][StateIdle] Handle TEvPQ::TEvTxCommit Step 1762188740487, TxId 281474976710677
2025-11-03T16:52:20.466369Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:20.466383Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:20.466537Z node 8 :PERSQUEUE DEBUG: partition.cpp:3622: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user reinit with generation 2 done
2025-11-03T16:52:20.466559Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:20.466763Z node 8 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-03T16:52:20.469915Z node 8 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-03T16:52:20.476310Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:490: [72075186224037892][Partition][0][StateIdle] Received TPartition::Handle TEvHandleWriteResponse.
2025-11-03T16:52:20.476606Z node 8 :PERSQUEUE DEBUG: partition_mlp.cpp:83: [72075186224037892][Partition][0][StateIdle] Initializing MLP Consumers: 0
2025-11-03T16:52:20.476798Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-11-03T16:52:20.476832Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:20.476848Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:20.476863Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:20.476903Z node 8 :PERSQUEUE DEBUG: partition_compaction.cpp:183: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:52:20.477305Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:398: [PQ: 72075186224037892] Apply new config PartitionConfig { MaxCountInPartition: 2147483647 MaxSizeInPartition: 9223372036854775807 LifetimeSeconds: 86400 SourceIdLifetimeSeconds: 1382400 WriteSpeedInBytesPerSecond: 1048576 BurstSize: 1048576 TotalPartitions: 1 SourceIdMaxCounts: 6000000 } PartitionIds: 0 TopicName: "rt3.dc1--test-topic" Version: 2 LocalDC: true RequireAuthWrite: true RequireAuthRead: true Producer: "unknown" Ident: "unknown" Topic: "test-topic" DC: "dc1" FormatVersion: 0 Codecs { Ids: 0 Ids: 1 Ids: 3 Codecs: "raw" Codecs: "gzip" Codecs: "zstd" } TopicPath: "/Root/PQ/rt3.dc1--test-topic" YcCloudId: "" YcFolderId: "" YdbDatabaseId: "" YdbDatabasePath: "/Root" Partitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } AllPartitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 72075186224037892 } Consumers { Name: "user" ReadFromTimestampsMs: 0 FormatVersion: 0 Codec { Ids: 0 Ids: 1 Ids: 3 Codecs: "raw" Codecs: "gzip" Codecs: "zstd" } ServiceType: "data-streams" Version: 1 Generation: 2 } MonitoringProjectId: ""
2025-11-03T16:52:20.477332Z node 8 :PERSQUEUE NOTICE: pq_impl.cpp:913: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-11-03T16:52:20.477667Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-03T16:52:20.494588Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-03T16:52:20.494686Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
Alter topic response: { operation { ready: true status: SUCCESS } }
Alter result: {  }
2025-11-03T16:52:20.499202Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-03T16:52:20.540524Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [] Write session: try to update token
2025-11-03T16:52:20.540957Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [] Write session: Do CDS request
2025-11-03T16:52:20.541014Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [] Do schedule cds request after 0 ms
2025-11-03T16:52:20.544238Z :INFO: [/Root] MessageGroupId [test-message-group-id] Running cds request ms
2025-11-03T16:52:20.560149Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [] Got CDS response: 
write_sessions_clusters { clusters { endpoint: "localhost:6533" name: "dc1" available: true } primary_cluster_selection_reason: CLIENT_LOCATION } version: 1
2025-11-03T16:52:20.560234Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [] Start write session. Will connect to endpoint: localhost:6533
2025-11-03T16:52:20.560113Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:20.560148Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:20.560165Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:20.592236Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [] Write session: send init request: init_request { topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" }
2025-11-03T16:52:20.593029Z node 7 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-11-03T16:52:20.593061Z node 7 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2
2025-11-03T16:52:20.593379Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" }
2025-11-03T16:52:20.593507Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2 topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" from ipv6:[::1]:39838
2025-11-03T16:52:20.593524Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:39838 proto=v1  topic=test-topic durationSec=0
2025-11-03T16:52:20.593532Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-11-03T16:52:20.595282Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2 sessionId:  describe result for acl check
2025-11-03T16:52:20.595423Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-11-03T16:52:20.595435Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-11-03T16:52:20.595447Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-11-03T16:52:20.595464Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [7:7568543009830619727:2496] (SourceId=test-message-group-id, PreferedPartition=(NULL)) StartKqpSession
2025-11-03T16:52:20.598692Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [7:7568543009830619727:2496] (SourceId=test-message-group-id, PreferedPartition=(NULL)) Select from the table
2025-11-03T16:52:20.621615Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [7:7568543009830619727:2496] (SourceId=test-message-group-id, PreferedPartition=(NULL)) RequestPQRB
2025-11-03T16:52:20.622450Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1655: [72075186224037893][rt3.dc1--test-topic] pipe [7:7568543009830619747:2496] connected; active server actors: 1
2025-11-03T16:52:20.622562Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [7:7568543009830619727:2496] (SourceId=test-message-group-id, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=test-message-group-id
2025-11-03T16:52:20.622582Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [7:7568543009830619727:2496] (SourceId=test-message-group-id, PreferedPartition=(NULL)) Update the table
2025-11-03T16:52:20.623466Z node 7 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1659: [72075186224037893][rt3.dc1--test-topic] pipe [7:7568543009830619747:2496] disconnected.
2025-11-03T16:52:20.623490Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1670: [72075186224037893][rt3.dc1--test-topic] pipe [7:7568543009830619747:2496] disconnected; active server actors: 1
2025-11-03T16:52:20.623508Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1695: [72075186224037893][rt3.dc1--test-topic] pipe [7:7568543009830619747:2496] disconnected no session
2025-11-03T16:52:20.638248Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [7:7568543009830619727:2496] (SourceId=test-message-group-id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-11-03T16:52:20.638289Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [7:7568543009830619727:2496] (SourceId=test-message-group-id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-11-03T16:52:20.638308Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [7:7568543009830619727:2496] (SourceId=test-message-group-id, PreferedPartition=(NULL)) Start idle
2025-11-03T16:52:20.638337Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-11-03T16:52:20.640391Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 8, Generation: 1
2025-11-03T16:52:20.644113Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [7:7568543009830619765:2496], now have 1 active actors on pipe
2025-11-03T16:52:20.644235Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:20.644263Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:20.644342Z node 8 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie test-message-group-id|569a9b20-6daf58df-7063426-7d4046c9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner test-message-group-id
2025-11-03T16:52:20.644386Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:20.644406Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:20.644420Z node 8 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-03T16:52:20.644459Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:20.644496Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-03T16:52:20.644546Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-03T16:52:20.648727Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:20.648768Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:20.648855Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-03T16:52:20.649356Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2 partition: 0 MaxSeqNo: 0 sessionId: test-message-group-id|569a9b20-6daf58df-7063426-7d4046c9_0
2025-11-03T16:52:20.652719Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1762188740652 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-11-03T16:52:20.652858Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [] Write session established. Init response: session_id: "test-message-group-id|569a9b20-6daf58df-7063426-7d4046c9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_ZSTD
2025-11-03T16:52:20.653068Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|569a9b20-6daf58df-7063426-7d4046c9_0] Write 1 messages with Id from 1 to 1
2025-11-03T16:52:20.653184Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|569a9b20-6daf58df-7063426-7d4046c9_0] Write session: try to update token
2025-11-03T16:52:20.653232Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|569a9b20-6daf58df-7063426-7d4046c9_0] Send 1 message(s) (0 left), first sequence number is 1
2025-11-03T16:52:20.653454Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|569a9b20-6daf58df-7063426-7d4046c9_0] Write 1 messages with Id from 2 to 2
2025-11-03T16:52:20.653501Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|569a9b20-6daf58df-7063426-7d4046c9_0] Write session: try to update token
2025-11-03T16:52:20.653523Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|569a9b20-6daf58df-7063426-7d4046c9_0] Send 1 message(s) (0 left), first sequence number is 2
2025-11-03T16:52:20.653556Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|569a9b20-6daf58df-7063426-7d4046c9_0] Write session: close. Timeout = 18446744073709551 ms
2025-11-03T16:52:20.656138Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: test-message-group-id|569a9b20-6daf58df-7063426-7d4046c9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:52:20.656458Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:52:20.657037Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:20.657078Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:20.657154Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-11-03T16:52:20.657504Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:20.657963Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:20.657991Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:20.658370Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0test-message-group-id' SeqNo: 1 partNo : 0 messageNo: 1 size 84 offset: -1
2025-11-03T16:52:20.658421Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:52:20.658467Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:20.658516Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:20.658528Z node 8 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-03T16:52:20.658643Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0test-message-group-id' seqNo 1 partNo 0
2025-11-03T16:52:20.659607Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0test-message-group-id' seqNo 1 partNo 0 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 173 count 1 nextOffset 1 batches 1
2025-11-03T16:52:20.659649Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:20.660219Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 0,1 HeadOffset 0 endOffset 0 curOffset 1 d0000000000_00000000000000000000_00000_0000000001_00000? size 161 WTime 1762188740658
2025-11-03T16:52:20.660399Z node 8 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:52:20.660419Z node 8 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-03T16:52:20.660544Z node 8 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 0 partNo 0 count 1 size 161
2025-11-03T16:52:20.663002Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: test-message-group-id|569a9b20-6daf58df-7063426-7d4046c9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:52:20.663472Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:52:20.663880Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:20.663912Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:20.663992Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 2  requestId: <none> cookie: 2
2025-11-03T16:52:20.664335Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:20.669059Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:20.669096Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:20.669151Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0test-message-group-id' SeqNo: 2 partNo : 0 messageNo: 3 size 83 offset: -1
2025-11-03T16:52:20.669331Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:52:20.669380Z node 8 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:52:20.669424Z node 8 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 0 count 1 size 161 actorID [8:7568542990700301902:2375]
2025-11-03T16:52:20.669472Z node 8 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-03T16:52:20.669519Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 106 WriteNewSizeFromSupportivePartitions# 0
2025-11-03T16:52:20.669552Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:52:20.669592Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0test-message-group-id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 1, partNo: 0, Offset: 0 is stored on disk
2025-11-03T16:52:20.669795Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:923: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 2
2025-11-03T16:52:20.669818Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:965: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 2
2025-11-03T16:52:20.669841Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:20.669867Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:20.669881Z node 8 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-03T16:52:20.669982Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0test-message-group-id' seqNo 2 partNo 0
2025-11-03T16:52:20.672742Z node 8 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 0 suffix '63' size 161
2025-11-03T16:52:20.795852Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0test-message-group-id' seqNo 2 partNo 0 FormedBlobsCount 0 NewHead: Offset 1 PartNo 0 PackedSize 172 count 1 nextOffset 2 batches 1
2025-11-03T16:52:20.795933Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:20.802788Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 1,1 HeadOffset 1 endOffset 1 curOffset 2 d0000000000_00000000000000000001_00000_0000000001_00000? size 160 WTime 1762188740800
2025-11-03T16:52:20.802969Z node 8 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:52:20.803065Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1  requestId: <none> cookie: 1
2025-11-03T16:52:20.803163Z node 8 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:52:20.803183Z node 8 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-03T16:52:20.803324Z node 8 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 1 partNo 0 count 1 size 160
2025-11-03T16:52:20.803535Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:880: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 partno 0 count 1 size 1024000 endOffset 1 max time lag 0ms effective offset 0
2025-11-03T16:52:20.803757Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:1105: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 161 count 1 last offset 0, current partition end offset: 1
2025-11-03T16:52:20.803778Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:1121: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-11-03T16:52:20.803849Z node 8 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 0 partno 0 count 1 parts_count 0 source 1 size 161 accessed 0 times before, last time 2025-11-03T16:52:20.000000Z
2025-11-03T16:52:20.803893Z node 8 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 3. All 1 blobs are from cache.
2025-11-03T16:52:20.805656Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:20.804310Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:572: FormAnswer for 1 blobs
2025-11-03T16:52:20.804450Z node 8 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 0 suffix '63'
2025-11-03T16:52:20.804463Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 0 totakecount 1 count 1 size 141 from pos 0 cbcount 1
2025-11-03T16:52:20.804539Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:1015: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1762188740658 queuesize 0 startOffset 0
2025-11-03T16:52:20.807910Z node 8 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 1 count 1 size 160 actorID [8:7568542990700301902:2375]
2025-11-03T16:52:20.807968Z node 8 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-03T16:52:20.808044Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 105 WriteNewSizeFromSupportivePartitions# 0
2025-11-03T16:52:20.808077Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:52:20.808091Z node 8 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 1 partno 0 count 1 parts 0 suffix '63' size 160
2025-11-03T16:52:20.808121Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0test-message-group-id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 2, partNo: 0, Offset: 1 is stored on disk
2025-11-03T16:52:20.808342Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:20.808357Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:20.808369Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:20.808407Z node 8 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:52:20.808455Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 3  requestId: <none> cookie: 2
2025-11-03T16:52:20.808870Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:20.812242Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|569a9b20-6daf58df-7063426-7d4046c9_0] Write session got write response: sequence_numbers: 1 offsets: 0 already_written: false write_statistics { persist_duration_ms: 9 queued_in_partition_duration_ms: 1 }
2025-11-03T16:52:20.812305Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|569a9b20-6daf58df-7063426-7d4046c9_0] Write session: acknoledged message 1
2025-11-03T16:52:20.812621Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|569a9b20-6daf58df-7063426-7d4046c9_0] Write session got write response: sequence_numbers: 2 offsets: 1 already_written: false write_statistics { persist_duration_ms: 13 queued_in_partition_duration_ms: 126 }
2025-11-03T16:52:20.812673Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|569a9b20-6daf58df-7063426-7d4046c9_0] Write session: acknoledged message 2
2025-11-03T16:52:20.856336Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|569a9b20-6daf58df-7063426-7d4046c9_0] Write session will now close
2025-11-03T16:52:20.856412Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|569a9b20-6daf58df-7063426-7d4046c9_0] Write session: aborting
2025-11-03T16:52:20.856984Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|569a9b20-6daf58df-7063426-7d4046c9_0] Write session: gracefully shut down, all writes complete
2025-11-03T16:52:20.857041Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|569a9b20-6daf58df-7063426-7d4046c9_0] Write session: destroy
2025-11-03T16:52:20.857555Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [] Write session: try to update token
2025-11-03T16:52:20.857635Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [] Write session: Do CDS request
2025-11-03T16:52:20.857687Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [] Do schedule cds request after 0 ms
2025-11-03T16:52:20.859737Z :INFO: [/Root] MessageGroupId [test-message-group-id] Running cds request ms
2025-11-03T16:52:20.861558Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: test-message-group-id|569a9b20-6daf58df-7063426-7d4046c9_0 grpc read done: success: 0 data: 
2025-11-03T16:52:20.861595Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 2 sessionId: test-message-group-id|569a9b20-6daf58df-7063426-7d4046c9_0 grpc read failed
2025-11-03T16:52:20.861638Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 2 sessionId: test-message-group-id|569a9b20-6daf58df-7063426-7d4046c9_0 grpc closed
2025-11-03T16:52:20.861662Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2 sessionId: test-message-group-id|569a9b20-6daf58df-7063426-7d4046c9_0 is DEAD
2025-11-03T16:52:20.862534Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-11-03T16:52:20.864596Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [7:7568543009830619765:2496] destroyed
2025-11-03T16:52:20.864650Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-11-03T16:52:20.864688Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:20.864704Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:20.864717Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:20.869843Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [] Got CDS response: 
write_sessions_clusters { clusters { endpoint: "localhost:6533" name: "dc1" available: true } primary_cluster_selection_reason: CLIENT_LOCATION } version: 1
2025-11-03T16:52:20.869915Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [] Start write session. Will connect to endpoint: localhost:6533
2025-11-03T16:52:20.878295Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [] Write session: send init request: init_request { topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" }
2025-11-03T16:52:20.883186Z node 7 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-11-03T16:52:20.883226Z node 7 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3
2025-11-03T16:52:20.883973Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" }
2025-11-03T16:52:20.884186Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3 topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" from ipv6:[::1]:39848
2025-11-03T16:52:20.884208Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:39848 proto=v1  topic=test-topic durationSec=0
2025-11-03T16:52:20.884223Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-11-03T16:52:20.888533Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3 sessionId:  describe result for acl check
2025-11-03T16:52:20.888715Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-11-03T16:52:20.888728Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-11-03T16:52:20.888741Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-11-03T16:52:20.888764Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [7:7568543009830619777:2503] (SourceId=test-message-group-id, PreferedPartition=(NULL)) StartKqpSession
2025-11-03T16:52:20.894721Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [7:7568543009830619777:2503] (SourceId=test-message-group-id, PreferedPartition=(NULL)) Select from the table
2025-11-03T16:52:20.904253Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:20.904297Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:20.904316Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:20.903822Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [7:7568543009830619777:2503] (SourceId=test-message-group-id, PreferedPartition=(NULL)) Update the table
2025-11-03T16:52:20.922200Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [7:7568543009830619777:2503] (SourceId=test-message-group-id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-11-03T16:52:20.922250Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [7:7568543009830619777:2503] (SourceId=test-message-group-id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-11-03T16:52:20.922273Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [7:7568543009830619777:2503] (SourceId=test-message-group-id, PreferedPartition=(NULL)) Start idle
2025-11-03T16:52:20.922313Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-11-03T16:52:20.924668Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [7:7568543009830619810:2503], now have 1 active actors on pipe
2025-11-03T16:52:20.925069Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 8, Generation: 1
2025-11-03T16:52:20.928400Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:20.928444Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:20.928533Z node 8 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie test-message-group-id|7bf6c6ba-fa029fa2-db3054f8-9097d1d4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner test-message-group-id
2025-11-03T16:52:20.928568Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:20.928602Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:20.928616Z node 8 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-03T16:52:20.928663Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:20.928710Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-03T16:52:20.928766Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-03T16:52:20.936495Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:20.936541Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:20.936630Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-03T16:52:20.937207Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3 partition: 0 MaxSeqNo: 2 sessionId: test-message-group-id|7bf6c6ba-fa029fa2-db3054f8-9097d1d4_0
2025-11-03T16:52:20.940597Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1762188740940 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-11-03T16:52:20.940783Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [] Write session established. Init response: last_sequence_number: 2 session_id: "test-message-group-id|7bf6c6ba-fa029fa2-db3054f8-9097d1d4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_ZSTD
2025-11-03T16:52:20.944131Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7bf6c6ba-fa029fa2-db3054f8-9097d1d4_0] Write 1 messages with Id from 1 to 1
2025-11-03T16:52:20.944257Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7bf6c6ba-fa029fa2-db3054f8-9097d1d4_0] Write 1 messages with Id from 2 to 2
2025-11-03T16:52:20.944304Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7bf6c6ba-fa029fa2-db3054f8-9097d1d4_0] Write session: close. Timeout = 18446744073709551 ms
2025-11-03T16:52:20.944784Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7bf6c6ba-fa029fa2-db3054f8-9097d1d4_0] Write session: try to update token
2025-11-03T16:52:20.944833Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7bf6c6ba-fa029fa2-db3054f8-9097d1d4_0] Send 1 message(s) (1 left), first sequence number is 3
2025-11-03T16:52:20.945257Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7bf6c6ba-fa029fa2-db3054f8-9097d1d4_0] Write session: try to update token
2025-11-03T16:52:20.945299Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7bf6c6ba-fa029fa2-db3054f8-9097d1d4_0] Send 1 message(s) (0 left), first sequence number is 4
2025-11-03T16:52:20.945881Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3 sessionId: test-message-group-id|7bf6c6ba-fa029fa2-db3054f8-9097d1d4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:52:20.946167Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:52:20.946513Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3 sessionId: test-message-group-id|7bf6c6ba-fa029fa2-db3054f8-9097d1d4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:52:20.946688Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:52:20.952535Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:20.952582Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:20.952630Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:20.952656Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:20.952732Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-11-03T16:52:20.952775Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1  requestId: <none> cookie: 2
2025-11-03T16:52:20.953869Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:20.953940Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:20.955057Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:20.955091Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:20.955148Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0test-message-group-id' SeqNo: 3 partNo : 0 messageNo: 2 size 104 offset: -1
2025-11-03T16:52:20.955215Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:20.955229Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:20.955252Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0test-message-group-id' SeqNo: 4 partNo : 0 messageNo: 3 size 103 offset: -1
2025-11-03T16:52:20.955283Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:52:20.955326Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:20.955355Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:20.955367Z node 8 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-03T16:52:20.955475Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0test-message-group-id' seqNo 3 partNo 0
2025-11-03T16:52:20.956369Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0test-message-group-id' seqNo 3 partNo 0 FormedBlobsCount 0 NewHead: Offset 2 PartNo 0 PackedSize 193 count 1 nextOffset 3 batches 1
2025-11-03T16:52:20.956415Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:20.956980Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 2,1 HeadOffset 2 endOffset 2 curOffset 3 d0000000000_00000000000000000002_00000_0000000001_00000? size 181 WTime 1762188740952
2025-11-03T16:52:20.957151Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:52:20.957191Z node 8 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:52:20.957214Z node 8 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-03T16:52:20.957337Z node 8 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 2 partNo 0 count 1 size 181
2025-11-03T16:52:20.965404Z node 8 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 2 count 1 size 181 actorID [8:7568542990700301902:2375]
2025-11-03T16:52:20.965473Z node 8 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-03T16:52:20.965530Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 126 WriteNewSizeFromSupportivePartitions# 0
2025-11-03T16:52:20.965570Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:52:20.965614Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0test-message-group-id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 3, partNo: 0, Offset: 2 is stored on disk
2025-11-03T16:52:20.965833Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:20.965860Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:20.965874Z node 8 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-03T16:52:20.965983Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0test-message-group-id' seqNo 4 partNo 0
2025-11-03T16:52:20.966876Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0test-message-group-id' seqNo 4 partNo 0 FormedBlobsCount 0 NewHead: Offset 3 PartNo 0 PackedSize 192 count 1 nextOffset 4 batches 1
2025-11-03T16:52:20.966918Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:20.967482Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 3,1 HeadOffset 3 endOffset 3 curOffset 4 d0000000000_00000000000000000003_00000_0000000001_00000? size 180 WTime 1762188740961
2025-11-03T16:52:20.967614Z node 8 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:52:20.967679Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 2  requestId: <none> cookie: 1
2025-11-03T16:52:20.967745Z node 8 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-03T16:52:20.967875Z node 8 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 3 partNo 0 count 1 size 180
2025-11-03T16:52:20.969030Z node 8 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 2 partno 0 count 1 parts 0 suffix '63' size 181
2025-11-03T16:52:20.973297Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7bf6c6ba-fa029fa2-db3054f8-9097d1d4_0] Write session got write response: sequence_numbers: 3 offsets: 2 already_written: false write_statistics { persist_duration_ms: 8 }
2025-11-03T16:52:20.973358Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7bf6c6ba-fa029fa2-db3054f8-9097d1d4_0] Write session: acknoledged message 1
2025-11-03T16:52:20.972156Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:20.977385Z node 8 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 3 count 1 size 180 actorID [8:7568542990700301902:2375]
2025-11-03T16:52:20.977453Z node 8 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-03T16:52:20.977506Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 125 WriteNewSizeFromSupportivePartitions# 0
2025-11-03T16:52:20.977542Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:52:20.977590Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0test-message-group-id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 4, partNo: 0, Offset: 3 is stored on disk
2025-11-03T16:52:20.977797Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:20.977812Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:20.977825Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:20.977862Z node 8 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:52:20.977906Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 3  requestId: <none> cookie: 2
2025-11-03T16:52:20.978326Z node 8 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 3 partno 0 count 1 parts 0 suffix '63' size 180
2025-11-03T16:52:20.978602Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:20.983495Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7bf6c6ba-fa029fa2-db3054f8-9097d1d4_0] Write session got write response: sequence_numbers: 4 offsets: 3 already_written: false write_statistics { persist_duration_ms: 14 queued_in_partition_duration_ms: 8 }
2025-11-03T16:52:20.983554Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7bf6c6ba-fa029fa2-db3054f8-9097d1d4_0] Write session: acknoledged message 2
2025-11-03T16:52:21.012221Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:21.012256Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:21.012275Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:21.046918Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7bf6c6ba-fa029fa2-db3054f8-9097d1d4_0] Write session will now close
2025-11-03T16:52:21.047006Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7bf6c6ba-fa029fa2-db3054f8-9097d1d4_0] Write session: aborting
2025-11-03T16:52:21.047539Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7bf6c6ba-fa029fa2-db3054f8-9097d1d4_0] Write session: gracefully shut down, all writes complete
2025-11-03T16:52:21.047592Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7bf6c6ba-fa029fa2-db3054f8-9097d1d4_0] Write session: destroy
2025-11-03T16:52:21.048145Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [] Write session: try to update token
2025-11-03T16:52:21.048236Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [] Write session: Do CDS request
2025-11-03T16:52:21.048289Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [] Do schedule cds request after 0 ms
2025-11-03T16:52:21.048613Z :INFO: [/Root] MessageGroupId [test-message-group-id] Running cds request ms
2025-11-03T16:52:21.052162Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3 sessionId: test-message-group-id|7bf6c6ba-fa029fa2-db3054f8-9097d1d4_0 grpc read done: success: 0 data: 
2025-11-03T16:52:21.052197Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 3 sessionId: test-message-group-id|7bf6c6ba-fa029fa2-db3054f8-9097d1d4_0 grpc read failed
2025-11-03T16:52:21.052241Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 3 sessionId: test-message-group-id|7bf6c6ba-fa029fa2-db3054f8-9097d1d4_0 grpc closed
2025-11-03T16:52:21.052258Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3 sessionId: test-message-group-id|7bf6c6ba-fa029fa2-db3054f8-9097d1d4_0 is DEAD
2025-11-03T16:52:21.053072Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-11-03T16:52:21.054407Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [7:7568543009830619810:2503] destroyed
2025-11-03T16:52:21.054453Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-11-03T16:52:21.054485Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:21.054516Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:21.054529Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:21.063540Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [] Got CDS response: 
write_sessions_clusters { clusters { endpoint: "localhost:6533" name: "dc1" available: true } primary_cluster_selection_reason: CLIENT_LOCATION } version: 1
2025-11-03T16:52:21.063632Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [] Start write session. Will connect to endpoint: localhost:6533
2025-11-03T16:52:21.071559Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [] Write session: send init request: init_request { topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" }
2025-11-03T16:52:21.072285Z node 7 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-11-03T16:52:21.072331Z node 7 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 4
2025-11-03T16:52:21.073528Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 4 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" }
2025-11-03T16:52:21.073747Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 4 topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" from ipv6:[::1]:39872
2025-11-03T16:52:21.073769Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=4 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:39872 proto=v1  topic=test-topic durationSec=0
2025-11-03T16:52:21.073785Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-11-03T16:52:21.076401Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 4 sessionId:  describe result for acl check
2025-11-03T16:52:21.076628Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-11-03T16:52:21.076650Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-11-03T16:52:21.076668Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-11-03T16:52:21.076696Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [7:7568543014125587115:2508] (SourceId=test-message-group-id, PreferedPartition=(NULL)) StartKqpSession
2025-11-03T16:52:21.082596Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [7:7568543014125587115:2508] (SourceId=test-message-group-id, PreferedPartition=(NULL)) Select from the table
2025-11-03T16:52:21.103960Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [7:7568543014125587115:2508] (SourceId=test-message-group-id, PreferedPartition=(NULL)) Update the table
2025-11-03T16:52:21.116119Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:21.116152Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:21.116171Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:21.118154Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [7:7568543014125587115:2508] (SourceId=test-message-group-id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-11-03T16:52:21.118205Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [7:7568543014125587115:2508] (SourceId=test-message-group-id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-11-03T16:52:21.118228Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [7:7568543014125587115:2508] (SourceId=test-message-group-id, PreferedPartition=(NULL)) Start idle
2025-11-03T16:52:21.118268Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 4 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-11-03T16:52:21.120781Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [7:7568543014125587148:2508], now have 1 active actors on pipe
2025-11-03T16:52:21.121103Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 8, Generation: 1
2025-11-03T16:52:21.121534Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:21.121594Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:21.121693Z node 8 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie test-message-group-id|8ec8d396-dc0c4fc0-9a876071-411f2d21_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner test-message-group-id
2025-11-03T16:52:21.121741Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:21.121767Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:21.121785Z node 8 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-03T16:52:21.121858Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:21.121917Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-03T16:52:21.121987Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-03T16:52:21.123671Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:21.123709Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:21.123804Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-03T16:52:21.124350Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 4 partition: 0 MaxSeqNo: 4 sessionId: test-message-group-id|8ec8d396-dc0c4fc0-9a876071-411f2d21_0
2025-11-03T16:52:21.125719Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1762188741125 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-11-03T16:52:21.125868Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [] Write session established. Init response: last_sequence_number: 4 session_id: "test-message-group-id|8ec8d396-dc0c4fc0-9a876071-411f2d21_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_ZSTD
2025-11-03T16:52:21.126101Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|8ec8d396-dc0c4fc0-9a876071-411f2d21_0] Write 1 messages with Id from 1 to 1
2025-11-03T16:52:21.126204Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|8ec8d396-dc0c4fc0-9a876071-411f2d21_0] Write 1 messages with Id from 2 to 2
2025-11-03T16:52:21.126249Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|8ec8d396-dc0c4fc0-9a876071-411f2d21_0] Write session: close. Timeout = 18446744073709551 ms
2025-11-03T16:52:21.128938Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|8ec8d396-dc0c4fc0-9a876071-411f2d21_0] Write session: try to update token
2025-11-03T16:52:21.129016Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|8ec8d396-dc0c4fc0-9a876071-411f2d21_0] Send 1 message(s) (1 left), first sequence number is 5
2025-11-03T16:52:21.131450Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 4 sessionId: test-message-group-id|8ec8d396-dc0c4fc0-9a876071-411f2d21_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:52:21.131824Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:52:21.132746Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|8ec8d396-dc0c4fc0-9a876071-411f2d21_0] Write session: try to update token
2025-11-03T16:52:21.132809Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|8ec8d396-dc0c4fc0-9a876071-411f2d21_0] Send 1 message(s) (0 left), first sequence number is 6
2025-11-03T16:52:21.132714Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:21.132767Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:21.132859Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-11-03T16:52:21.133525Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:21.133624Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 4 sessionId: test-message-group-id|8ec8d396-dc0c4fc0-9a876071-411f2d21_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:52:21.134008Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:52:21.134733Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:21.134776Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:21.134852Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0test-message-group-id' SeqNo: 5 partNo : 0 messageNo: 1 size 93 offset: -1
2025-11-03T16:52:21.134914Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:21.134927Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:21.134971Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:52:21.135030Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:21.135067Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:21.135080Z node 8 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-03T16:52:21.135220Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0test-message-group-id' seqNo 5 partNo 0
2025-11-03T16:52:21.136122Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0test-message-group-id' seqNo 5 partNo 0 FormedBlobsCount 0 NewHead: Offset 4 PartNo 0 PackedSize 182 count 1 nextOffset 5 batches 1
2025-11-03T16:52:21.136174Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:21.136870Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 4,1 HeadOffset 4 endOffset 4 curOffset 5 d0000000000_00000000000000000004_00000_0000000001_00000? size 170 WTime 1762188741135
2025-11-03T16:52:21.137120Z node 8 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-03T16:52:21.137284Z node 8 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 4 partNo 0 count 1 size 170
2025-11-03T16:52:21.137335Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 2  requestId: <none> cookie: 2
2025-11-03T16:52:21.138451Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:21.139408Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:21.139445Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:21.139516Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0test-message-group-id' SeqNo: 6 partNo : 0 messageNo: 3 size 92 offset: -1
2025-11-03T16:52:21.139564Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:52:21.139621Z node 8 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:52:21.146089Z node 8 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 4 count 1 size 170 actorID [8:7568542990700301902:2375]
2025-11-03T16:52:21.146185Z node 8 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-03T16:52:21.146254Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 115 WriteNewSizeFromSupportivePartitions# 0
2025-11-03T16:52:21.146305Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:52:21.146370Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0test-message-group-id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 5, partNo: 0, Offset: 4 is stored on disk
2025-11-03T16:52:21.146684Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:21.146725Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:21.146743Z node 8 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-03T16:52:21.146884Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0test-message-group-id' seqNo 6 partNo 0
2025-11-03T16:52:21.148447Z node 8 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 4 partno 0 count 1 parts 0 suffix '63' size 170
2025-11-03T16:52:21.244042Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0test-message-group-id' seqNo 6 partNo 0 FormedBlobsCount 0 NewHead: Offset 5 PartNo 0 PackedSize 181 count 1 nextOffset 6 batches 1
2025-11-03T16:52:21.244130Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:21.244814Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 5,1 HeadOffset 5 endOffset 5 curOffset 6 d0000000000_00000000000000000005_00000_0000000001_00000? size 169 WTime 1762188741244
2025-11-03T16:52:21.244994Z node 8 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:52:21.245128Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1  requestId: <none> cookie: 1
2025-11-03T16:52:21.245222Z node 8 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:52:21.245246Z node 8 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-03T16:52:21.245402Z node 8 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 5 partNo 0 count 1 size 169
2025-11-03T16:52:21.246334Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:21.248779Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|8ec8d396-dc0c4fc0-9a876071-411f2d21_0] Write session got write response: sequence_numbers: 5 offsets: 4 already_written: false write_statistics { persist_duration_ms: 10 queued_in_partition_duration_ms: 3 }
2025-11-03T16:52:21.248843Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|8ec8d396-dc0c4fc0-9a876071-411f2d21_0] Write session: acknoledged message 1
2025-11-03T16:52:21.249298Z node 8 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 5 count 1 size 169 actorID [8:7568542990700301902:2375]
2025-11-03T16:52:21.249372Z node 8 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-03T16:52:21.249432Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 114 WriteNewSizeFromSupportivePartitions# 0
2025-11-03T16:52:21.249477Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:52:21.249531Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0test-message-group-id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 6, partNo: 0, Offset: 5 is stored on disk
2025-11-03T16:52:21.249775Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:21.249793Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:21.249808Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:21.249852Z node 8 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:52:21.249905Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 3  requestId: <none> cookie: 2
2025-11-03T16:52:21.250333Z node 8 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 5 partno 0 count 1 parts 0 suffix '63' size 169
2025-11-03T16:52:21.251624Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|8ec8d396-dc0c4fc0-9a876071-411f2d21_0] Write session got write response: sequence_numbers: 6 offsets: 5 already_written: false write_statistics { persist_duration_ms: 5 queued_in_partition_duration_ms: 106 }
2025-11-03T16:52:21.250606Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:21.251699Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|8ec8d396-dc0c4fc0-9a876071-411f2d21_0] Write session: acknoledged message 2
2025-11-03T16:52:21.327342Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|8ec8d396-dc0c4fc0-9a876071-411f2d21_0] Write session will now close
2025-11-03T16:52:21.327431Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|8ec8d396-dc0c4fc0-9a876071-411f2d21_0] Write session: aborting
2025-11-03T16:52:21.328113Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|8ec8d396-dc0c4fc0-9a876071-411f2d21_0] Write session: gracefully shut down, all writes complete
2025-11-03T16:52:21.328173Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|8ec8d396-dc0c4fc0-9a876071-411f2d21_0] Write session: destroy
Start read
2025-11-03T16:52:21.328544Z :INFO: [/Root] [/Root] [1601f8a0-fb6b9f10-2c6952a-708cb530] Starting read session
2025-11-03T16:52:21.328589Z :DEBUG: [/Root] [/Root] [1601f8a0-fb6b9f10-2c6952a-708cb530] Starting cluster discovery
2025-11-03T16:52:21.330684Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 4 sessionId: test-message-group-id|8ec8d396-dc0c4fc0-9a876071-411f2d21_0 grpc read done: success: 0 data: 
2025-11-03T16:52:21.330719Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 4 sessionId: test-message-group-id|8ec8d396-dc0c4fc0-9a876071-411f2d21_0 grpc read failed
2025-11-03T16:52:21.330759Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 4 sessionId: test-message-group-id|8ec8d396-dc0c4fc0-9a876071-411f2d21_0 grpc closed
2025-11-03T16:52:21.330780Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 4 sessionId: test-message-group-id|8ec8d396-dc0c4fc0-9a876071-411f2d21_0 is DEAD
2025-11-03T16:52:21.332215Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-11-03T16:52:21.332934Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [7:7568543014125587148:2508] destroyed
2025-11-03T16:52:21.332995Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-11-03T16:52:21.333037Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:21.333054Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:21.333069Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:21.336909Z :DEBUG: [/Root] [/Root] [1601f8a0-fb6b9f10-2c6952a-708cb530] Cluster discovery request succeeded
2025-11-03T16:52:21.337000Z :DEBUG: [/Root] [/Root] [1601f8a0-fb6b9f10-2c6952a-708cb530] Starting session to cluster dc1 (localhost:6533)
2025-11-03T16:52:21.337166Z :DEBUG: [/Root] [/Root] [1601f8a0-fb6b9f10-2c6952a-708cb530] [dc1] In Reconnect, ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:52:21.337202Z :DEBUG: [/Root] [/Root] [1601f8a0-fb6b9f10-2c6952a-708cb530] [dc1] New values: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:52:21.337249Z :DEBUG: [/Root] [/Root] [1601f8a0-fb6b9f10-2c6952a-708cb530] [dc1] Reconnecting session to cluster dc1 in 0.000000s
2025-11-03T16:52:21.345260Z :DEBUG: [/Root] [/Root] [1601f8a0-fb6b9f10-2c6952a-708cb530] [dc1] Successfully connected. Initializing session
2025-11-03T16:52:21.346830Z node 7 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:109: new grpc connection
2025-11-03T16:52:21.346858Z node 7 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:131: new session created cookie 1
2025-11-03T16:52:21.348448Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:21.348484Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:21.348502Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:21.347602Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { topic: "test-topic" } read_only_original: true consumer: "shared/user" read_params { max_read_size: 104857600 } } }
2025-11-03T16:52:21.347886Z node 7 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 1 consumer shared/user session shared/user_7_1_5617136888976824886_v1 read init: from# ipv6:[::1]:39876, request# { init_request { topics_read_settings { topic: "test-topic" } read_only_original: true consumer: "shared/user" read_params { max_read_size: 104857600 } } }
2025-11-03T16:52:21.348457Z node 7 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 1 consumer shared/user session shared/user_7_1_5617136888976824886_v1 auth for : user
2025-11-03T16:52:21.349167Z node 7 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 1 consumer shared/user session shared/user_7_1_5617136888976824886_v1 Handle describe topics response
2025-11-03T16:52:21.349307Z node 7 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 1 consumer shared/user session shared/user_7_1_5617136888976824886_v1 auth is DEAD
2025-11-03T16:52:21.349405Z node 7 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 1 consumer shared/user session shared/user_7_1_5617136888976824886_v1 auth ok: topics# 1, initDone# 0
2025-11-03T16:52:21.350826Z node 7 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 1 consumer shared/user session shared/user_7_1_5617136888976824886_v1 register session: topic# rt3.dc1--test-topic
2025-11-03T16:52:21.351934Z :INFO: [/Root] [/Root] [1601f8a0-fb6b9f10-2c6952a-708cb530] [dc1] Server session id: shared/user_7_1_5617136888976824886_v1
2025-11-03T16:52:21.352212Z :DEBUG: [/Root] [/Root] [1601f8a0-fb6b9f10-2c6952a-708cb530] [dc1] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:52:21.352791Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_7_1_5617136888976824886_v1 grpc read done: success# 1, data# { read { } }
2025-11-03T16:52:21.352875Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_7_1_5617136888976824886_v1 got read request: guid# b0b61a69-12330030-2f7b27c9-d494ffe5
2025-11-03T16:52:21.353276Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1655: [72075186224037893][rt3.dc1--test-topic] pipe [7:7568543014125587158:2513] connected; active server actors: 1
2025-11-03T16:52:21.353697Z node 7 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1706: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [7:7568543014125587158:2513] session shared/user_7_1_5617136888976824886_v1
2025-11-03T16:52:21.353764Z node 7 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:639: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-11-03T16:52:21.353830Z node 7 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:669: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-11-03T16:52:21.353888Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:871: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_7_1_5617136888976824886_v1" (Sender=[7:7568543014125587155:2513], Pipe=[7:7568543014125587158:2513], Partitions=[], ActiveFamilyCount=0)
2025-11-03T16:52:21.353923Z node 7 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1186: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-11-03T16:52:21.353989Z node 7 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1258: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-11-03T16:52:21.354059Z node 7 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1305: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_7_1_5617136888976824886_v1" (Sender=[7:7568543014125587155:2513], Pipe=[7:7568543014125587158:2513], Partitions=[], ActiveFamilyCount=0)
2025-11-03T16:52:21.354136Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:549: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_7_1_5617136888976824886_v1" sender [7:7568543014125587155:2513] lock partition 0 for ReadingSession "shared/user_7_1_5617136888976824886_v1" (Sender=[7:7568543014125587155:2513], Pipe=[7:7568543014125587158:2513], Partitions=[], ActiveFamilyCount=1) generation 1 step 1
2025-11-03T16:52:21.354199Z node 7 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1325: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-11-03T16:52:21.354234Z node 7 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1402: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000216s
2025-11-03T16:52:21.355339Z node 7 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 1 consumer shared/user session shared/user_7_1_5617136888976824886_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 1 Session: "shared/user_7_1_5617136888976824886_v1" ClientId: "user" PipeClient { RawX1: 7568543014125587158 RawX2: 4503629692144081 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-11-03T16:52:21.355443Z node 7 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 1 consumer shared/user session shared/user_7_1_5617136888976824886_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-11-03T16:52:21.356530Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [7:7568543014125587161:2516], now have 1 active actors on pipe
2025-11-03T16:52:21.357430Z node 7 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_7_1_5617136888976824886_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 1, pipe: [7:7568543014125587161:2516]
2025-11-03T16:52:21.357792Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:21.357832Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:21.357878Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:1748: [PQ: 72075186224037892] Created session shared/user_7_1_5617136888976824886_v1 on pipe: [7:7568543014125587161:2516]
2025-11-03T16:52:21.357948Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:21.357973Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:21.357987Z node 8 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-03T16:52:21.358069Z node 8 :PERSQUEUE DEBUG: partition.cpp:3666: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_7_1_5617136888976824886_v1
2025-11-03T16:52:21.358091Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:21.358252Z node 8 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-03T16:52:21.358871Z node 8 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_7_1_5617136888976824886_v1:1 with generation 1
2025-11-03T16:52:21.362181Z node 8 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-03T16:52:21.362279Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-11-03T16:52:21.362319Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:21.362338Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:21.362356Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:21.362401Z node 8 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:52:21.362447Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-11-03T16:52:21.363114Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_7_1_5617136888976824886_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 6 WriteTimestampMS: 1762188740658 CreateTimestampMS: 1762188740653 SizeLag: 1013 WriteTimestampEstimateMS: 1762188741348 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-11-03T16:52:21.363176Z node 7 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 1 consumer shared/user session shared/user_7_1_5617136888976824886_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 6 readOffset 0 committedOffset 0
2025-11-03T16:52:21.363242Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 1 consumer shared/user session shared/user_7_1_5617136888976824886_v1 sending to client partition status
2025-11-03T16:52:21.365350Z :INFO: [/Root] [/Root] [1601f8a0-fb6b9f10-2c6952a-708cb530] [dc1] Confirm partition stream create. Partition stream id: 1. Cluster: "dc1". Topic: "test-topic". Partition: 0. Read offset: (NULL)
2025-11-03T16:52:21.374758Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_7_1_5617136888976824886_v1 grpc read done: success# 1, data# { start_read { topic { path: "test-topic" } cluster: "dc1" assign_id: 1 } }
2025-11-03T16:52:21.375031Z node 7 :PQ_READ_PROXY INFO: read_session_actor.cpp:539: session cookie 1 consumer shared/user session shared/user_7_1_5617136888976824886_v1 got StartRead from client: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 0, commitOffset# 0
2025-11-03T16:52:21.375112Z node 7 :PQ_READ_PROXY INFO: partition_actor.cpp:1023: session cookie 1 consumer shared/user session shared/user_7_1_5617136888976824886_v1 Start reading TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 6 readOffset 0 committedOffset 0 clientCommitOffset 0 clientReadOffset 0
2025-11-03T16:52:21.375146Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_7_1_5617136888976824886_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 0 endOffset 6
2025-11-03T16:52:21.375220Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_7_1_5617136888976824886_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 0, endOffset# 6, WTime# 1762188740658, sizeLag# 1013
2025-11-03T16:52:21.375240Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_7_1_5617136888976824886_v1TEvPartitionReady. Aval parts: 1
2025-11-03T16:52:21.375293Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_7_1_5617136888976824886_v1 performing read request: guid# b0b61a69-12330030-2f7b27c9-d494ffe5, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 7, size# 1215, partitionsAsked# 1, maxTimeLag# 0ms
2025-11-03T16:52:21.375384Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_7_1_5617136888976824886_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 7 maxSize 1215 maxTimeLagMs 0 readTimestampMs 0 readOffset 0 EndOffset 6 ClientCommitOffset 0 committedOffset 0 Guid b0b61a69-12330030-2f7b27c9-d494ffe5
2025-11-03T16:52:21.384202Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:21.384256Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:21.384395Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:880: [72075186224037892][Partition][0][StateIdle] read cookie 4 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 partno 0 count 7 size 1215 endOffset 6 max time lag 0ms effective offset 0
2025-11-03T16:52:21.385619Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:1105: [72075186224037892][Partition][0][StateIdle] read cookie 4 added 6 blobs, size 1021 count 6 last offset 5, current partition end offset: 6
2025-11-03T16:52:21.385643Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:1121: [72075186224037892][Partition][0][StateIdle] Reading cookie 4. Send blob request.
2025-11-03T16:52:21.385708Z node 8 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 0 partno 0 count 1 parts_count 0 source 1 size 161 accessed 1 times before, last time 2025-11-03T16:52:20.000000Z
2025-11-03T16:52:21.385727Z node 8 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 1 partno 0 count 1 parts_count 0 source 1 size 160 accessed 0 times before, last time 2025-11-03T16:52:20.000000Z
2025-11-03T16:52:21.385746Z node 8 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 2 partno 0 count 1 parts_count 0 source 1 size 181 accessed 0 times before, last time 2025-11-03T16:52:20.000000Z
2025-11-03T16:52:21.385762Z node 8 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 3 partno 0 count 1 parts_count 0 source 1 size 180 accessed 0 times before, last time 2025-11-03T16:52:20.000000Z
2025-11-03T16:52:21.385779Z node 8 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 4 partno 0 count 1 parts_count 0 source 1 size 170 accessed 0 times before, last time 2025-11-03T16:52:21.000000Z
2025-11-03T16:52:21.385797Z node 8 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 5 partno 0 count 1 parts_count 0 source 1 size 169 accessed 0 times before, last time 2025-11-03T16:52:21.000000Z
2025-11-03T16:52:21.385862Z node 8 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 4. All 6 blobs are from cache.
2025-11-03T16:52:21.385960Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:572: FormAnswer for 6 blobs
2025-11-03T16:52:21.385961Z node 8 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 0 suffix '63'
2025-11-03T16:52:21.385999Z node 8 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 1 partno 0 count 1 parts 0 suffix '63'
2025-11-03T16:52:21.386024Z node 8 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 2 partno 0 count 1 parts 0 suffix '63'
2025-11-03T16:52:21.386048Z node 8 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 3 partno 0 count 1 parts 0 suffix '63'
2025-11-03T16:52:21.386072Z node 8 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 4 partno 0 count 1 parts 0 suffix '63'
2025-11-03T16:52:21.386096Z node 8 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 5 partno 0 count 1 parts 0 suffix '63'
2025-11-03T16:52:21.386249Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 0 totakecount 1 count 1 size 141 from pos 0 cbcount 1
2025-11-03T16:52:21.386327Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 1 totakecount 1 count 1 size 140 from pos 0 cbcount 1
2025-11-03T16:52:21.386376Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 2 totakecount 1 count 1 size 161 from pos 0 cbcount 1
2025-11-03T16:52:21.386426Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 3 totakecount 1 count 1 size 160 from pos 0 cbcount 1
2025-11-03T16:52:21.386477Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 4 totakecount 1 count 1 size 150 from pos 0 cbcount 1
2025-11-03T16:52:21.386544Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 5 totakecount 1 count 1 size 149 from pos 0 cbcount 1
2025-11-03T16:52:21.386678Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-03T16:52:21.392853Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_7_1_5617136888976824886_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 6 Result { Offset: 0 Data: "... 84 bytes ..." SourceId: "\000test-message-group-id" SeqNo: 1 WriteTimestampMS: 1762188740658 CreateTimestampMS: 1762188740653 UncompressedSize: 13 PartitionKey: "" ExplicitHash: "" } Result { Offset: 1 Data: "... 83 bytes ..." SourceId: "\000test-message-group-id" SeqNo: 2 WriteTimestampMS: 1762188740668 CreateTimestampMS: 1762188740653 UncompressedSize: 12 PartitionKey: "" ExplicitHash: "" } Result { Offset: 2 Data: "... 104 bytes ..." SourceId: "\000test-message-group-id" SeqNo: 3 WriteTimestampMS: 1762188740952 CreateTimestampMS: 1762188740944 UncompressedSize: 13 PartitionKey: "" ExplicitHash: "" } Result { Offset: 3 Data: "... 103 bytes ..." SourceId: "\000test-message-group-id" SeqNo: 4 WriteTimestampMS: 1762188740961 CreateTimestampMS: 1762188740944 UncompressedSize: 12 PartitionKey: "" ExplicitHash: "" } Result { Offset: 4 Data: "... 93 bytes ..." SourceId: "\000test-message-group-id" SeqNo: 5 WriteTimestampMS: 1762188741132 CreateTimestampMS: 1762188741126 UncompressedSize: 13 PartitionKey: "" ExplicitHash: "" } Result { Offset: 5 Data: "... 92 bytes ..." SourceId: "\000test-message-group-id" SeqNo: 6 WriteTimestampMS: 1762188741146 CreateTimestampMS: 1762188741126 UncompressedSize: 12 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 6 SizeLag: 112 RealReadOffset: 5 WaitQuotaTimeMs: 0 EndOffset: 6 StartOffset: 0 } Cookie: 0 }
2025-11-03T16:52:21.393219Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_7_1_5617136888976824886_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 1 from offset 6
2025-11-03T16:52:21.393272Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_7_1_5617136888976824886_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 6 ReadOffset 6 ReadGuid b0b61a69-12330030-2f7b27c9-d494ffe5 has messages 1
2025-11-03T16:52:21.393453Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_7_1_5617136888976824886_v1 read done: guid# b0b61a69-12330030-2f7b27c9-d494ffe5, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 1003
2025-11-03T16:52:21.393490Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_7_1_5617136888976824886_v1 response to read: guid# b0b61a69-12330030-2f7b27c9-d494ffe5
2025-11-03T16:52:21.393774Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_7_1_5617136888976824886_v1 Process answer. Aval parts: 0
2025-11-03T16:52:21.396865Z :DEBUG: [/Root] [/Root] [1601f8a0-fb6b9f10-2c6952a-708cb530] [dc1] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:52:21.398739Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 0 (0-5)
2025-11-03T16:52:21.398857Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (0-0)
2025-11-03T16:52:21.398903Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 0} (1-1)
2025-11-03T16:52:21.398946Z :DEBUG: [/Root] Take Data. Partition 0. Read: {2, 0} (2-2)
2025-11-03T16:52:21.398977Z :DEBUG: [/Root] Take Data. Partition 0. Read: {3, 0} (3-3)
2025-11-03T16:52:21.399012Z :DEBUG: [/Root] Take Data. Partition 0. Read: {4, 0} (4-4)
2025-11-03T16:52:21.399041Z :DEBUG: [/Root] Take Data. Partition 0. Read: {5, 0} (5-5)
Got messages
totalReceived: 6 wait: 6
2025-11-03T16:52:21.399394Z :DEBUG: [/Root] [/Root] [1601f8a0-fb6b9f10-2c6952a-708cb530] [dc1] The application data is transferred to the client. Number of messages 6, size 75 bytes
2025-11-03T16:52:21.399419Z :INFO: [/Root] [/Root] [1601f8a0-fb6b9f10-2c6952a-708cb530] Closing read session. Close timeout: 0.000000s
2025-11-03T16:52:21.399515Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): dc1:test-topic:0:1:5:0
2025-11-03T16:52:21.399574Z :INFO: [/Root] [/Root] [1601f8a0-fb6b9f10-2c6952a-708cb530] Counters: { Errors: 0 CurrentSessionLifetimeMs: 71 BytesRead: 75 MessagesRead: 6 BytesReadCompressed: 133 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-11-03T16:52:21.399717Z :NOTICE: [/Root] [/Root] [1601f8a0-fb6b9f10-2c6952a-708cb530] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Close with zero timeout " }
2025-11-03T16:52:21.399784Z :DEBUG: [/Root] [/Root] [1601f8a0-fb6b9f10-2c6952a-708cb530] [dc1] Abort session to cluster
2025-11-03T16:52:21.400424Z :NOTICE: [/Root] [/Root] [1601f8a0-fb6b9f10-2c6952a-708cb530] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
2025-11-03T16:52:21.400221Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_7_1_5617136888976824886_v1 grpc read done: success# 1, data# { read { } }
2025-11-03T16:52:21.400370Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_7_1_5617136888976824886_v1 got read request: guid# d11ccbbc-e38fc41d-d22ead65-69fbbe40
Start read
2025-11-03T16:52:21.400867Z :INFO: [/Root] [/Root] [9d5ae5b8-3afe743-73b0c5d5-d61c182e] Starting read session
2025-11-03T16:52:21.400908Z :DEBUG: [/Root] [/Root] [9d5ae5b8-3afe743-73b0c5d5-d61c182e] Starting cluster discovery
2025-11-03T16:52:21.408263Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_7_1_5617136888976824886_v1 grpc read done: success# 0, data# {  }
2025-11-03T16:52:21.408303Z node 7 :PQ_READ_PROXY INFO: read_session_actor.cpp:125: session cookie 1 consumer shared/user session shared/user_7_1_5617136888976824886_v1 grpc read failed
2025-11-03T16:52:21.408335Z node 7 :PQ_READ_PROXY INFO: read_session_actor.cpp:92: session cookie 1 consumer shared/user session shared/user_7_1_5617136888976824886_v1 grpc closed
2025-11-03T16:52:21.408380Z node 7 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 1 consumer shared/user session shared/user_7_1_5617136888976824886_v1 is DEAD
2025-11-03T16:52:21.411284Z node 7 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1659: [72075186224037893][rt3.dc1--test-topic] pipe [7:7568543014125587158:2513] disconnected.
2025-11-03T16:52:21.411325Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1670: [72075186224037893][rt3.dc1--test-topic] pipe [7:7568543014125587158:2513] disconnected; active server actors: 1
2025-11-03T16:52:21.411349Z node 7 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1679: [72075186224037893][rt3.dc1--test-topic] pipe [7:7568543014125587158:2513] client user disconnected session shared/user_7_1_5617136888976824886_v1
2025-11-03T16:52:21.411077Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2258: [PQ: 72075186224037892] Destroy direct read session shared/user_7_1_5617136888976824886_v1
2025-11-03T16:52:21.411141Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [7:7568543014125587161:2516] destroyed
2025-11-03T16:52:21.411201Z node 8 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_7_1_5617136888976824886_v1
2025-11-03T16:52:21.421695Z :DEBUG: [/Root] [/Root] [9d5ae5b8-3afe743-73b0c5d5-d61c182e] Cluster discovery request succeeded
2025-11-03T16:52:21.421779Z :DEBUG: [/Root] [/Root] [9d5ae5b8-3afe743-73b0c5d5-d61c182e] Starting session to cluster dc1 (localhost:6533)
2025-11-03T16:52:21.421962Z :DEBUG: [/Root] [/Root] [9d5ae5b8-3afe743-73b0c5d5-d61c182e] [dc1] In Reconnect, ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:52:21.422008Z :DEBUG: [/Root] [/Root] [9d5ae5b8-3afe743-73b0c5d5-d61c182e] [dc1] New values: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:52:21.422053Z :DEBUG: [/Root] [/Root] [9d5ae5b8-3afe743-73b0c5d5-d61c182e] [dc1] Reconnecting session to cluster dc1 in 0.000000s
2025-11-03T16:52:21.433200Z :DEBUG: [/Root] [/Root] [9d5ae5b8-3afe743-73b0c5d5-d61c182e] [dc1] Successfully connected. Initializing session
2025-11-03T16:52:21.440415Z node 7 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:109: new grpc connection
2025-11-03T16:52:21.440442Z node 7 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:131: new session created cookie 2
2025-11-03T16:52:21.441117Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 2 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { topic: "test-topic" } read_only_original: true consumer: "shared/user" read_params { max_read_size: 104857600 } } }
2025-11-03T16:52:21.441382Z node 7 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 2 consumer shared/user session shared/user_7_2_3416736529225403752_v1 read init: from# ipv6:[::1]:39906, request# { init_request { topics_read_settings { topic: "test-topic" } read_only_original: true consumer: "shared/user" read_params { max_read_size: 104857600 } } }
2025-11-03T16:52:21.441889Z node 7 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 2 consumer shared/user session shared/user_7_2_3416736529225403752_v1 auth for : user
2025-11-03T16:52:21.448399Z node 7 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 2 consumer shared/user session shared/user_7_2_3416736529225403752_v1 Handle describe topics response
2025-11-03T16:52:21.448564Z node 7 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 2 consumer shared/user session shared/user_7_2_3416736529225403752_v1 auth is DEAD
2025-11-03T16:52:21.448664Z node 7 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 2 consumer shared/user session shared/user_7_2_3416736529225403752_v1 auth ok: topics# 1, initDone# 0
2025-11-03T16:52:21.450018Z node 7 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 2 consumer shared/user session shared/user_7_2_3416736529225403752_v1 register session: topic# rt3.dc1--test-topic
2025-11-03T16:52:21.450512Z :INFO: [/Root] [/Root] [9d5ae5b8-3afe743-73b0c5d5-d61c182e] [dc1] Server session id: shared/user_7_2_3416736529225403752_v1
2025-11-03T16:52:21.450768Z :DEBUG: [/Root] [/Root] [9d5ae5b8-3afe743-73b0c5d5-d61c182e] [dc1] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:52:21.451199Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 2 consumer shared/user session shared/user_7_2_3416736529225403752_v1 grpc read done: success# 1, data# { read { } }
2025-11-03T16:52:21.451282Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 2 consumer shared/user session shared/user_7_2_3416736529225403752_v1 got read request: guid# 10326de0-9b1281ed-9ef71bb9-2aaf63f3
2025-11-03T16:52:21.450961Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:21.451001Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:21.451020Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:21.460805Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1655: [72075186224037893][rt3.dc1--test-topic] pipe [7:7568543014125587172:2520] connected; active server actors: 1
2025-11-03T16:52:21.461042Z node 7 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1706: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [7:7568543014125587172:2520] session shared/user_7_2_3416736529225403752_v1
2025-11-03T16:52:21.461105Z node 7 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:639: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-11-03T16:52:21.461169Z node 7 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:669: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-11-03T16:52:21.461222Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:871: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_7_2_3416736529225403752_v1" (Sender=[7:7568543014125587169:2520], Pipe=[7:7568543014125587172:2520], Partitions=[], ActiveFamilyCount=0)
2025-11-03T16:52:21.461258Z node 7 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1186: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-11-03T16:52:21.461323Z node 7 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1258: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-11-03T16:52:21.461385Z node 7 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1305: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_7_2_3416736529225403752_v1" (Sender=[7:7568543014125587169:2520], Pipe=[7:7568543014125587172:2520], Partitions=[], ActiveFamilyCount=0)
2025-11-03T16:52:21.461457Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:549: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_7_2_3416736529225403752_v1" sender [7:7568543014125587169:2520] lock partition 0 for ReadingSession "shared/user_7_2_3416736529225403752_v1" (Sender=[7:7568543014125587169:2520], Pipe=[7:7568543014125587172:2520], Partitions=[], ActiveFamilyCount=1) generation 1 step 2
2025-11-03T16:52:21.461518Z node 7 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1325: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-11-03T16:52:21.461555Z node 7 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1402: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000204s
2025-11-03T16:52:21.462576Z node 7 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 2 consumer shared/user session shared/user_7_2_3416736529225403752_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 2 Session: "shared/user_7_2_3416736529225403752_v1" ClientId: "user" PipeClient { RawX1: 7568543014125587172 RawX2: 4503629692144088 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-11-03T16:52:21.462674Z node 7 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 2 consumer shared/user session shared/user_7_2_3416736529225403752_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-11-03T16:52:21.469089Z node 7 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_7_2_3416736529225403752_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 1, pipe: [7:7568543014125587176:2523]
2025-11-03T16:52:21.468284Z node 8 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:52:21.469456Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [7:7568543014125587176:2523], now have 1 active actors on pipe
2025-11-03T16:52:21.469530Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:21.469560Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:21.469598Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:1748: [PQ: 72075186224037892] Created session shared/user_7_2_3416736529225403752_v1 on pipe: [7:7568543014125587176:2523]
2025-11-03T16:52:21.469663Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:21.469686Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:21.469699Z node 8 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-03T16:52:21.469773Z node 8 :PERSQUEUE DEBUG: partition.cpp:3666: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_7_2_3416736529225403752_v1
2025-11-03T16:52:21.469794Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:21.469949Z node 8 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-03T16:52:21.470581Z node 8 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_7_2_3416736529225403752_v1:1 with generation 1
2025-11-03T16:52:21.481745Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 2 consumer shared/user session shared/user_7_2_3416736529225403752_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 6 WriteTimestampMS: 1762188740658 CreateTimestampMS: 1762188740653 SizeLag: 1013 WriteTimestampEstimateMS: 1762188741465 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-11-03T16:52:21.481806Z node 7 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 2 consumer shared/user session shared/user_7_2_3416736529225403752_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 6 readOffset 0 committedOffset 0
2025-11-03T16:52:21.481864Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 2 consumer shared/user session shared/user_7_2_3416736529225403752_v1 sending to client partition status
2025-11-03T16:52:21.480792Z node 8 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-03T16:52:21.480899Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-11-03T16:52:21.480938Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:21.480955Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:21.480971Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:21.481017Z node 8 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:52:21.481060Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:1186: [PQ: 72075186224037892] Topic 'rt3.dc1--test-topic' counters. CacheSize 1021 CachedBlobs 6
2025-11-03T16:52:21.481098Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-11-03T16:52:21.487188Z :INFO: [/Root] [/Root] [9d5ae5b8-3afe743-73b0c5d5-d61c182e] [dc1] Confirm partition stream create. Partition stream id: 1. Cluster: "dc1". Topic: "test-topic". Partition: 0. Read offset: (NULL)
2025-11-03T16:52:21.487900Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 2 consumer shared/user session shared/user_7_2_3416736529225403752_v1 grpc read done: success# 1, data# { start_read { topic { path: "test-topic" } cluster: "dc1" assign_id: 1 } }
2025-11-03T16:52:21.488073Z node 7 :PQ_READ_PROXY INFO: read_session_actor.cpp:539: session cookie 2 consumer shared/user session shared/user_7_2_3416736529225403752_v1 got StartRead from client: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 0, commitOffset# 0
2025-11-03T16:52:21.488141Z node 7 :PQ_READ_PROXY INFO: partition_actor.cpp:1023: session cookie 2 consumer shared/user session shared/user_7_2_3416736529225403752_v1 Start reading TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 6 readOffset 0 committedOffset 0 clientCommitOffset 0 clientReadOffset 0
2025-11-03T16:52:21.488172Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 2 consumer shared/user session shared/user_7_2_3416736529225403752_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 0 endOffset 6
2025-11-03T16:52:21.488252Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 2 consumer shared/user session shared/user_7_2_3416736529225403752_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 0, endOffset# 6, WTime# 1762188740658, sizeLag# 1013
2025-11-03T16:52:21.488277Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 2 consumer shared/user session shared/user_7_2_3416736529225403752_v1TEvPartitionReady. Aval parts: 1
2025-11-03T16:52:21.488333Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 2 consumer shared/user session shared/user_7_2_3416736529225403752_v1 performing read request: guid# 10326de0-9b1281ed-9ef71bb9-2aaf63f3, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 7, size# 1215, partitionsAsked# 1, maxTimeLag# 0ms
2025-11-03T16:52:21.488420Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 2 consumer shared/user session shared/user_7_2_3416736529225403752_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 7 maxSize 1215 maxTimeLagMs 0 readTimestampMs 0 readOffset 0 EndOffset 6 ClientCommitOffset 0 committedOffset 0 Guid 10326de0-9b1281ed-9ef71bb9-2aaf63f3
2025-11-03T16:52:21.489404Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:21.489451Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:21.489589Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:880: [72075186224037892][Partition][0][StateIdle] read cookie 5 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 partno 0 count 7 size 1215 endOffset 6 max time lag 0ms effective offset 0
2025-11-03T16:52:21.491041Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:1105: [72075186224037892][Partition][0][StateIdle] read cookie 5 added 6 blobs, size 1021 count 6 last offset 5, current partition end offset: 6
2025-11-03T16:52:21.491071Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:1121: [72075186224037892][Partition][0][StateIdle] Reading cookie 5. Send blob request.
2025-11-03T16:52:21.491142Z node 8 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 0 partno 0 count 1 parts_count 0 source 1 size 161 accessed 2 times before, last time 2025-11-03T16:52:21.000000Z
2025-11-03T16:52:21.491163Z node 8 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 1 partno 0 count 1 parts_count 0 source 1 size 160 accessed 1 times before, last time 2025-11-03T16:52:21.000000Z
2025-11-03T16:52:21.491183Z node 8 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 2 partno 0 count 1 parts_count 0 source 1 size 181 accessed 1 times before, last time 2025-11-03T16:52:21.000000Z
2025-11-03T16:52:21.491200Z node 8 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 3 partno 0 count 1 parts_count 0 source 1 size 180 accessed 1 times before, last time 2025-11-03T16:52:21.000000Z
2025-11-03T16:52:21.491220Z node 8 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 4 partno 0 count 1 parts_count 0 source 1 size 170 accessed 1 times before, last time 2025-11-03T16:52:21.000000Z
2025-11-03T16:52:21.491238Z node 8 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 5 partno 0 count 1 parts_count 0 source 1 size 169 accessed 1 times before, last time 2025-11-03T16:52:21.000000Z
2025-11-03T16:52:21.491286Z node 8 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 5. All 6 blobs are from cache.
2025-11-03T16:52:21.491376Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:572: FormAnswer for 6 blobs
2025-11-03T16:52:21.491676Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 0 totakecount 1 count 1 size 141 from pos 0 cbcount 1
2025-11-03T16:52:21.491762Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 1 totakecount 1 count 1 size 140 from pos 0 cbcount 1
2025-11-03T16:52:21.491829Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 2 totakecount 1 count 1 size 161 from pos 0 cbcount 1
2025-11-03T16:52:21.491886Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 3 totakecount 1 count 1 size 160 from pos 0 cbcount 1
2025-11-03T16:52:21.491949Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 4 totakecount 1 count 1 size 150 from pos 0 cbcount 1
2025-11-03T16:52:21.492033Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 5 totakecount 1 count 1 size 149 from pos 0 cbcount 1
2025-11-03T16:52:21.492177Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-03T16:52:21.493495Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 2 consumer shared/user session shared/user_7_2_3416736529225403752_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 6 Result { Offset: 0 Data: "... 84 bytes ..." SourceId: "\000test-message-group-id" SeqNo: 1 WriteTimestampMS: 1762188740658 CreateTimestampMS: 1762188740653 UncompressedSize: 13 PartitionKey: "" ExplicitHash: "" } Result { Offset: 1 Data: "... 83 bytes ..." SourceId: "\000test-message-group-id" SeqNo: 2 WriteTimestampMS: 1762188740668 CreateTimestampMS: 1762188740653 UncompressedSize: 12 PartitionKey: "" ExplicitHash: "" } Result { Offset: 2 Data: "... 104 bytes ..." SourceId: "\000test-message-group-id" SeqNo: 3 WriteTimestampMS: 1762188740952 CreateTimestampMS: 1762188740944 UncompressedSize: 13 PartitionKey: "" ExplicitHash: "" } Result { Offset: 3 Data: "... 103 bytes ..." SourceId: "\000test-message-group-id" SeqNo: 4 WriteTimestampMS: 1762188740961 CreateTimestampMS: 1762188740944 UncompressedSize: 12 PartitionKey: "" ExplicitHash: "" } Result { Offset: 4 Data: "... 93 bytes ..." SourceId: "\000test-message-group-id" SeqNo: 5 WriteTimestampMS: 1762188741132 CreateTimestampMS: 1762188741126 UncompressedSize: 13 PartitionKey: "" ExplicitHash: "" } Result { Offset: 5 Data: "... 92 bytes ..." SourceId: "\000test-message-group-id" SeqNo: 6 WriteTimestampMS: 1762188741146 CreateTimestampMS: 1762188741126 UncompressedSize: 12 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 6 SizeLag: 112 RealReadOffset: 5 WaitQuotaTimeMs: 0 EndOffset: 6 StartOffset: 0 } Cookie: 0 }
2025-11-03T16:52:21.493827Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 2 consumer shared/user session shared/user_7_2_3416736529225403752_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 1 from offset 6
2025-11-03T16:52:21.493877Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 2 consumer shared/user session shared/user_7_2_3416736529225403752_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 6 ReadOffset 6 ReadGuid 10326de0-9b1281ed-9ef71bb9-2aaf63f3 has messages 1
2025-11-03T16:52:21.494054Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 2 consumer shared/user session shared/user_7_2_3416736529225403752_v1 read done: guid# 10326de0-9b1281ed-9ef71bb9-2aaf63f3, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 1003
2025-11-03T16:52:21.494090Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 2 consumer shared/user session shared/user_7_2_3416736529225403752_v1 response to read: guid# 10326de0-9b1281ed-9ef71bb9-2aaf63f3
2025-11-03T16:52:21.494417Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 2 consumer shared/user session shared/user_7_2_3416736529225403752_v1 Process answer. Aval parts: 0
2025-11-03T16:52:21.492593Z node 8 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 0 suffix '63'
2025-11-03T16:52:21.492636Z node 8 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 1 partno 0 count 1 parts 0 suffix '63'
2025-11-03T16:52:21.492661Z node 8 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 2 partno 0 count 1 parts 0 suffix '63'
2025-11-03T16:52:21.492694Z node 8 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 3 partno 0 count 1 parts 0 suffix '63'
2025-11-03T16:52:21.492717Z node 8 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 4 partno 0 count 1 parts 0 suffix '63'
2025-11-03T16:52:21.492738Z node 8 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 5 partno 0 count 1 parts 0 suffix '63'
2025-11-03T16:52:21.500785Z :DEBUG: [/Root] [/Root] [9d5ae5b8-3afe743-73b0c5d5-d61c182e] [dc1] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:52:21.501343Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 0 (0-5)
2025-11-03T16:52:21.501455Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (0-0)
2025-11-03T16:52:21.501516Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 0} (1-1)
2025-11-03T16:52:21.501557Z :DEBUG: [/Root] Take Data. Partition 0. Read: {2, 0} (2-2)
2025-11-03T16:52:21.501592Z :DEBUG: [/Root] Take Data. Partition 0. Read: {3, 0} (3-3)
2025-11-03T16:52:21.501639Z :DEBUG: [/Root] Take Data. Partition 0. Read: {4, 0} (4-4)
2025-11-03T16:52:21.501666Z :DEBUG: [/Root] Take Data. Partition 0. Read: {5, 0} (5-5)
Got messages
totalReceived: 6 wait: 6
2025-11-03T16:52:21.501983Z :DEBUG: [/Root] [/Root] [9d5ae5b8-3afe743-73b0c5d5-d61c182e] [dc1] The application data is transferred to the client. Number of messages 6, size 133 bytes
2025-11-03T16:52:21.503482Z :INFO: [/Root] [/Root] [9d5ae5b8-3afe743-73b0c5d5-d61c182e] Closing read session. Close timeout: 0.000000s
2025-11-03T16:52:21.503566Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): dc1:test-topic:0:1:5:0
2025-11-03T16:52:21.503629Z :INFO: [/Root] [/Root] [9d5ae5b8-3afe743-73b0c5d5-d61c182e] Counters: { Errors: 0 CurrentSessionLifetimeMs: 102 BytesRead: 133 MessagesRead: 6 BytesReadCompressed: 133 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-11-03T16:52:21.503763Z :NOTICE: [/Root] [/Root] [9d5ae5b8-3afe743-73b0c5d5-d61c182e] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Close with zero timeout " }
2025-11-03T16:52:21.503831Z :DEBUG: [/Root] [/Root] [9d5ae5b8-3afe743-73b0c5d5-d61c182e] [dc1] Abort session to cluster
2025-11-03T16:52:21.504453Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 2 consumer shared/user session shared/user_7_2_3416736529225403752_v1 grpc read done: success# 1, data# { read { } }
2025-11-03T16:52:21.504620Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 2 consumer shared/user session shared/user_7_2_3416736529225403752_v1 got read request: guid# 5fce6448-8cf507bb-6391472f-2c70a670
2025-11-03T16:52:21.506691Z :NOTICE: [/Root] [/Root] [9d5ae5b8-3afe743-73b0c5d5-d61c182e] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
2025-11-03T16:52:21.505588Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 2 consumer shared/user session shared/user_7_2_3416736529225403752_v1 grpc read done: success# 0, data# {  }
2025-11-03T16:52:21.505615Z node 7 :PQ_READ_PROXY INFO: read_session_actor.cpp:125: session cookie 2 consumer shared/user session shared/user_7_2_3416736529225403752_v1 grpc read failed
2025-11-03T16:52:21.505644Z node 7 :PQ_READ_PROXY INFO: read_session_actor.cpp:92: session cookie 2 consumer shared/user session shared/user_7_2_3416736529225403752_v1 grpc closed
2025-11-03T16:52:21.505683Z node 7 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 2 consumer shared/user session shared/user_7_2_3416736529225403752_v1 is DEAD
2025-11-03T16:52:21.506693Z node 7 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1659: [72075186224037893][rt3.dc1--test-topic] pipe [7:7568543014125587172:2520] disconnected.
2025-11-03T16:52:21.506722Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1670: [72075186224037893][rt3.dc1--test-topic] pipe [7:7568543014125587172:2520] disconnected; active server actors: 1
2025-11-03T16:52:21.506745Z node 7 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1679: [72075186224037893][rt3.dc1--test-topic] pipe [7:7568543014125587172:2520] client user disconnected session shared/user_7_2_3416736529225403752_v1
2025-11-03T16:52:21.507537Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2258: [PQ: 72075186224037892] Destroy direct read session shared/user_7_2_3416736529225403752_v1
2025-11-03T16:52:21.507601Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [7:7568543014125587176:2523] destroyed
2025-11-03T16:52:21.507660Z node 8 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_7_2_3416736529225403752_v1
2025-11-03T16:52:21.560107Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:21.560151Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:21.560176Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:21.660625Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:21.660677Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:21.660697Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:21.978443Z node 7 :KQP_EXECUTER ERROR: kqp_executer_impl.h:1006: ActorId: [7:7568543014125587207:2517] TxId: 281474976710684. Ctx: { TraceId: 01k95a4jr6586eab91v50q61tt, Database: /Root, SessionId: ydb://session/3?node_id=7&id=M2E1NzU3YjctNzcyM2QzMzAtNjlmZTU1YTktZmMyNmFmNjk=, PoolId: default}. UNAVAILABLE: Failed to send EvStartKqpTasksRequest because node is unavailable: 8
2025-11-03T16:52:21.979185Z node 7 :KQP_COMPUTE ERROR: dq_compute_actor_impl.h:1210: SelfId: [7:7568543014125587214:2517], TxId: 281474976710684, task: 3. Ctx: { CheckpointId : .  TraceId : 01k95a4jr6586eab91v50q61tt.  RunScriptActorId : [0:0:0].  CustomerSuppliedId : .  PoolId : default.  SessionId : ydb://session/3?node_id=7&id=M2E1NzU3YjctNzcyM2QzMzAtNjlmZTU1YTktZmMyNmFmNjk=.  CurrentExecutionId : .  DatabaseId : /Root.  Database : /Root. }. Handle abort execution event from: [7:7568543014125587207:2517], status: UNAVAILABLE, reason: { <main>: Error: Terminate execution }
2025-11-03T16:52:23.583504Z :ReadSession INFO: Random seed for debugging is 1762188743583488
2025-11-03T16:52:24.208908Z node 9 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[9:7568543026149864529:2079];send_to=[0:7307199536658146131:7762515];
2025-11-03T16:52:24.208973Z node 9 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
2025-11-03T16:52:24.265385Z node 10 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[10:7568543025474748346:2152];send_to=[0:7307199536658146131:7762515];
2025-11-03T16:52:24.293631Z node 10 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-11-03T16:52:24.294457Z node 10 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
test_client.cpp: SetPath # /home/runner/.ya/build/build_root/7jz3/001998/r3tmp/tmpxZe1ge/pdisk_1.dat
2025-11-03T16:52:24.301665Z node 9 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-11-03T16:52:24.321385Z node 10 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-11-03T16:52:24.344004Z node 9 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-11-03T16:52:24.536474Z node 10 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-11-03T16:52:24.572088Z node 9 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-11-03T16:52:24.585282Z node 9 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
2025-11-03T16:52:24.615142Z node 9 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(9, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-11-03T16:52:24.615245Z node 9 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(9, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-11-03T16:52:24.621280Z node 9 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(10, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-11-03T16:52:24.621371Z node 9 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(10, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-11-03T16:52:24.632825Z node 9 :HIVE WARN: hive_impl.cpp:811: HIVE#72057594037968897 Handle TEvInterconnect::TEvNodeConnected, NodeId 10 Cookie 10
2025-11-03T16:52:24.632995Z node 9 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(9, (0,0,0,0)) VolatileState: Connecting -> Connected
2025-11-03T16:52:24.634245Z node 9 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(10, (0,0,0,0)) VolatileState: Connecting -> Connected
TServer::EnableGrpc on GrpcPort 3784, node 9
2025-11-03T16:52:24.796672Z node 9 :NET_CLASSIFIER WARN: net_classifier.cpp:190: distributable config is empty, broken or outdated, will use file: /home/runner/.ya/build/build_root/7jz3/001998/r3tmp/yandexnoYf6Y.tmp
2025-11-03T16:52:24.796699Z node 9 :NET_CLASSIFIER WARN: net_classifier.cpp:196: will try to initialize from file: /home/runner/.ya/build/build_root/7jz3/001998/r3tmp/yandexnoYf6Y.tmp
2025-11-03T16:52:24.796841Z node 9 :NET_CLASSIFIER WARN: net_classifier.cpp:202: successfully initialized from file: /home/runner/.ya/build/build_root/7jz3/001998/r3tmp/yandexnoYf6Y.tmp
2025-11-03T16:52:24.797008Z node 9 :NET_CLASSIFIER ERROR: net_classifier.cpp:228: got bad distributable configuration
2025-11-03T16:52:24.846821Z INFO: TTestServer started on Port 1304 GrpcPort 3784
2025-11-03T16:52:24.850818Z node 10 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-11-03T16:52:24.938990Z node 9 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
TClient is connected to server localhost:1304
PQClient connected to localhost:3784
WaitRootIsUp 'Root'...
TClient::Ls request: Root
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "Root"
    PathId: 1
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 1
    CreateStep: 0
    ParentPathId: 1
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 1
      SubDomainVersion: 0
      SecurityStateVersion: 0
    }
    ChildrenExist: false
  }
  Children {
    Name: ".sys"
    PathId: 18446744073709551615
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 0
    CreateStep: 0
    ParentPathId: 18446744073709551615
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 0
      Pl...
(TRUNCATED)
WaitRootIsUp 'Root' success.
2025-11-03T16:52:25.148755Z node 9 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpAlterSubDomain, opId: 281474976710657:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_alter_subdomain.cpp:311)
waiting...
waiting...
waiting...
2025-11-03T16:52:25.224282Z node 9 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
waiting...
2025-11-03T16:52:25.268264Z node 10 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-11-03T16:52:28.876188Z node 10 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [10:7568543042654617795:2303], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-03T16:52:28.876370Z node 10 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [10:7568543042654617784:2300], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-03T16:52:28.876544Z node 10 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-03T16:52:28.879610Z node 10 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [10:7568543042654617799:2305], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-03T16:52:28.879783Z node 10 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-03T16:52:28.886810Z node 9 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateResourcePool, opId: 281474976715657:3, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_resource_pool.cpp:179)
2025-11-03T16:52:28.912338Z node 10 :KQP_WORKLOAD_SERVICE WARN: helpers.h:73: [WorkloadService] [TPoolCreatorActor] ActorId: [10:7568543042654617798:2304], DatabaseId: /Root, PoolId: default, Scheduled retry for error: { <main>: Error: Transaction 281474976715657 completed, doublechecking }
2025-11-03T16:52:29.106207Z node 10 :TX_PROXY ERROR: schemereq.cpp:593: Actor# [10:7568543046949585124:2143] txid# 281474976715658, issues: { message: "Check failed: path: \'/Root/.metadata/workload_manager/pools/default\', error: path exist, request accepts it (id: [OwnerId: 72057594046644480, LocalPathId: 8], type: EPathTypeResourcePool, state: EPathStateNoChanges)" severity: 1 }
2025-11-03T16:52:29.170814Z node 10 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:570: Compilation failed, self: [10:7568543046949585139:2309], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-11-03T16:52:29.172999Z node 10 :KQP_SESSION WARN: kqp_session_actor.cpp:2506: SessionId: ydb://session/3?node_id=10&id=Mzg3ZTFhZS1iNzY5N2VlZC0xZGViMjY0Ni1mYjkwOTIwNQ==, ActorId: [10:7568543042654617782:2299], ActorState: ExecuteState, TraceId: 01k95a4t28a2yzttz29neewsrv, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-11-03T16:52:29.188799Z node 10 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-11-03T16:52:29.224955Z node 9 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[9:7568543026149864529:2079];send_to=[0:7307199536658146131:7762515];
2025-11-03T16:52:29.225069Z node 9 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
2025-11-03T16:52:29.232602Z node 9 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:570: Compilation failed, self: [9:7568543047624702061:2334], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-11-03T16:52:29.236867Z node 9 :KQP_SESSION WARN: kqp_session_actor.cpp:2506: SessionId: ydb://session/3?node_id=9&id=YWQ1N2YxOC01YjQ2YzJhYi1hM2FkYThiOS1jZTFiNmE3OA==, ActorId: [9:7568543047624702018:2327], ActorState: ExecuteState, TraceId: 01k95a4tbbc0ej2kv6jsr47tjg, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-11-03T16:52:29.237441Z node 9 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-11-03T16:52:29.258794Z node 9 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710661:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:690)
2025-11-03T16:52:29.264096Z node 10 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[10:7568543025474748346:2152];send_to=[0:7307199536658146131:7762515];
2025-11-03T16:52:29.264193Z node 10 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
2025-11-03T16:52:29.472367Z node 9 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710662:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:690)
2025-11-03T16:52:29.620648Z node 9 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710663:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:690)
=== Init DC: UPSERT INTO `/Root/PQ/Config/V2/Cluster` (name, balancer, local, enabled, weight) VALUES ("dc1", "localhost:3784", true, true, 1000);
2025-11-03T16:52:29.931279Z node 9 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976710664. Ctx: { TraceId: 01k95a4tx762bhxqppq938bp2k, Database: , SessionId: ydb://session/3?node_id=9&id=MmZkMzQ1MTYtMjBkMWJiODctNzUzODZjNTktNWViOGM5OWE=, PoolId: default, DatabaseId: /Root}. Database not set, use /Root
=== CheckClustersList. Subcribe to ClusterTracker from [9:7568543047624702465:2978] 
=== CheckClustersList. Ok
2025-11-03T16:52:36.291823Z node 9 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710669:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:690)
waiting...
PQ Client: create topic: rt3.dc1--test-topic with 1 partitions
CallPersQueueGRPC request to localhost:3784
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
CallPersQueueGRPC request to localhost:3784
MetaRequest {
  CmdCreateTopic {
    Topic: "rt3.dc1--test-topic"
    NumPartitions: 1
    Config {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
  }
}
2025-11-03T16:52:36.384039Z node 9 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
Status: 129
ProxyErrorCode: 53
SchemeStatus: 1
FlatTxId {
  TxId: 281474976710670
  SchemeShardTabletId: 72057594046644480
  PathId: 13
}
ErrorCode: OK
AddTopic: rt3.dc1--test-topic
===Run query:``DECLARE $version as Int64; DECLARE $path AS Utf8; DECLARE $cluster as Utf8; UPSERT INTO `/Root/PQ/Config/V2/Topics` (path, dc) VALUES ($path, $cluster); UPSERT INTO `/Root/PQ/Config/V2/Versions` (name, version) VALUES ("Topics", $version);`` with topic = test-topic, dc = dc1
2025-11-03T16:52:36.450527Z node 9 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1655: [72075186224037893][] pipe [9:7568543077689473963:3251] connected; active server actors: 1
2025-11-03T16:52:36.450730Z node 9 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1519: [72075186224037893][rt3.dc1--test-topic] updating configuration. Deleted partitions []. Added partitions [0]
2025-11-03T16:52:36.453816Z node 9 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:971: [72075186224037893][rt3.dc1--test-topic] Discovered subdomain [OwnerId: 72057594046644480, LocalPathId: 1] state, outOfSpace = 0 at RB 72075186224037893
2025-11-03T16:52:36.457144Z node 9 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:140: [72075186224037893][rt3.dc1--test-topic] BALANCER INIT DONE for rt3.dc1--test-topic: (0, 72075186224037892) 
2025-11-03T16:52:36.458256Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:2960: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-11-03T16:52:36.462437Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:2992: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-11-03T16:52:36.462729Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:787: [PQ: 72075186224037892] no config, start with empty partitions and default config
2025-11-03T16:52:36.462763Z node 10 :PERSQUEUE NOTICE: pq_impl.cpp:913: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-11-03T16:52:36.462804Z node 10 :PERSQUEUE INFO: pq_impl.cpp:612: [PQ: 72075186224037892] doesn't have tx writes info
2025-11-03T16:52:36.463448Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [9:7568543077689473962:3250], now have 1 active actors on pipe
2025-11-03T16:52:36.463482Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [9:7568543077689473985:2434], now have 1 active actors on pipe
2025-11-03T16:52:36.463661Z node 9 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:404: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 10, Generation 1
2025-11-03T16:52:36.467906Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-03T16:52:36.472669Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-03T16:52:36.479390Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [9:7568543077689474017:3296], now have 1 active actors on pipe
2025-11-03T16:52:36.479975Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-03T16:52:36.483820Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-03T16:52:36.485159Z node 10 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-11-03T16:52:36.485231Z node 10 :PERSQUEUE DEBUG: partition.cpp:1312: [72075186224037892][Partition][0][StateInit] HandleOnInit TEvPQ::TEvProposePartitionConfig
2025-11-03T16:52:36.485674Z node 10 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-11-03T16:52:36.485946Z node 10 :PERSQUEUE INFO: partition_init.cpp:1101: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [10:7568543077014356664:2391]
2025-11-03T16:52:36.489765Z node 10 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-11-03T16:52:36.489805Z node 10 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-11-03T16:52:36.489837Z node 10 :PERSQUEUE INFO: partition.cpp:707: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1 [10:7568543077014356664:2391]
2025-11-03T16:52:36.489881Z node 10 :PERSQUEUE DEBUG: partition.cpp:727: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 0 Head Offset 0 PartNo 0 PackedSize 0 count 0 nextOffset 0 batches 0
2025-11-03T16:52:36.489930Z node 10 :PERSQUEUE DEBUG: partition_mlp.cpp:83: [72075186224037892][Partition][0][StateIdle] Initializing MLP Consumers: 0
2025-11-03T16:52:36.491997Z node 10 :PERSQUEUE DEBUG: partition.cpp:4273: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 1
2025-11-03T16:52:36.492042Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:36.492154Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:36.492175Z node 10 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-03T16:52:36.492205Z node 10 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-11-03T16:52:36.492225Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:36.492242Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:36.492265Z node 10 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-11-03T16:52:36.492313Z node 10 :PERSQUEUE DEBUG: partition_read.cpp:923: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-11-03T16:52:36.492365Z node 10 :PERSQUEUE DEBUG: partition_mlp.cpp:60: [72075186224037892][Partition][0][StateIdle] Process MLP pending events. Count 0
2025-11-03T16:52:36.493125Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-03T16:52:36.493323Z node 10 :PERSQUEUE DEBUG: partition_compaction.cpp:183: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:52:36.499204Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-03T16:52:36.499420Z node 10 :PERSQUEUE DEBUG: partition.cpp:1416: [72075186224037892][Partition][0][StateIdle] Handle TEvPQ::TEvTxCommit Step 1762188756524, TxId 281474976710670
2025-11-03T16:52:36.499458Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:36.499475Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:36.499655Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:36.499952Z node 10 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-03T16:52:36.506261Z node 10 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-03T16:52:36.506486Z node 10 :PERSQUEUE DEBUG: partition_mlp.cpp:83: [72075186224037892][Partition][0][StateIdle] Initializing MLP Consumers: 0
2025-11-03T16:52:36.506614Z node 10 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-11-03T16:52:36.506642Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:36.506659Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:36.506670Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:36.506706Z node 10 :PERSQUEUE DEBUG: partition_compaction.cpp:183: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:52:36.507096Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:398: [PQ: 72075186224037892] Apply new config PartitionConfig { LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 } PartitionIds: 0 TopicName: "rt3.dc1--test-topic" Version: 0 LocalDC: true Codecs { Ids: 0 Ids: 1 Ids: 2 Codecs: "raw" Codecs: "gzip" Codecs: "lzop" } TopicPath: "/Root/PQ/rt3.dc1--test-topic" YcCloudId: "" YcFolderId: "" YdbDatabaseId: "" YdbDatabasePath: "/Root" Partitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } AllPartitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } Consumers { Name: "user" ReadFromTimestampsMs: 0 FormatVersion: 0 Version: 0 Generation: 0 } MonitoringProjectId: ""
2025-11-03T16:52:36.507198Z node 10 :PERSQUEUE NOTICE: pq_impl.cpp:913: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-11-03T16:52:36.507482Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-03T16:52:36.525356Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-03T16:52:36.525496Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-03T16:52:36.537195Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-03T16:52:36.585773Z node 9 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976710671. Ctx: { TraceId: 01k95a51ef7zvp5g1s75pt0r8r, Database: , SessionId: ydb://session/3?node_id=9&id=NGUwZTJjZjctMmM3NTRjYzItMTA0NTVlOGQtZDZkNDgzZmI=, PoolId: default, DatabaseId: /Root}. Database not set, use /Root
2025-11-03T16:52:36.592972Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:36.593000Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:36.593015Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
===Query complete
TClient::Ls request: /Root/PQ/rt3.dc1--test-topic
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976710670
    CreateStep: 1762188756524
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts...
(TRUNCATED)
GetTopicVersionFromPath:  record Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976710670
    CreateStep: 1762188756524
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      YdbDatabasePath: "/Root"
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
    Partitions {
      PartitionId: 0
      TabletId: 72075186224037892
      Status: Active
    }
    AlterVersion: 1
    BalancerTabletID: 72075186224037893
    NextPartitionId: 1
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 1
      PlanResolution: 7
      Coordinators: 72057594046316545
      TimeCastBucketsPerMediator: 2
      Mediators: 72057594046382081
    }
    DomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    PathsInside: 12
    PathsLimit: 10000
    ShardsInside: 6
    ShardsLimit: 200000
    ResourcesDomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    DiskSpaceUsage {
      Tables {
        TotalSize: 0
        DataSize: 0
        IndexSize: 0
      }
      Topics {
        ReserveSize: 0
        AccountSize: 0
        DataSize: 0
        UsedReserveSize: 0
      }
    }
    PQPartitionsInside: 1
    PQPartitionsLimit: 1000000
    SchemeLimits {
      MaxDepth: 32
      MaxPaths: 10000
      MaxChildrenInDir: 100000
      MaxAclBytesSize: 10240
      MaxTableColumns: 200
      MaxTableColumnNameLength: 255
      MaxTableKeyColumns: 30
      MaxTableIndices: 20
      MaxShards: 200000
      MaxShardsInPath: 35000
      MaxConsistentCopyTargets: 10000
      MaxPathElementLength: 255
      ExtraPathSymbolsAllowed: "!\"#$%&\'()*+,-.:;<=>?@[\\]^_`{|}~"
      MaxPQPartitions: 1000000
      MaxTableCdcStreams: 5
      MaxExports: 10
      MaxImports: 10
      MaxColumnTableColumns: 10000
    }
  }
}
Path: "/Root/PQ/rt3.dc1--test-topic"
 name rt3.dc1--test-topic version1
CallPersQueueGRPC request to localhost:3784
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-11-03T16:52:36.621094Z node 9 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
MetaResponse {
  CmdGetTopicMetadataResult {
    TopicInfo {
      Topic: "rt3.dc1--test-topic"
      NumPartitions: 1
      Config {
        PartitionConfig {
          LifetimeSeconds: 86400
          LowWatermark: 8388608
          SourceIdLifetimeSeconds: 86400
          WriteSpeedInBytesPerSecond: 20000000
          BurstSize: 20000000
          SourceIdMaxCounts: 6000000
        }
        Version: 1
        LocalDC: true
        Codecs {
          Ids: 0
          Ids: 1
          Ids: 2
          Codecs: "raw"
          Codecs: "gzip"
          Codecs: "lzop"
        }
        TopicPath: "/Root/PQ/rt3.dc1--test-topic"
        YdbDatabasePath: "/Root"
        Consumers {
          Name: "user"
          ReadFromTimestampsMs: 0
          FormatVersion: 0
          Version: 0
        }
      }
      ErrorCode: OK
    }
  }
}
=== Topic created, have version: 1
2025-11-03T16:52:36.631491Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: try to update token
2025-11-03T16:52:36.632799Z :INFO: [] MessageGroupId [src] SessionId [] Write session: Do CDS request
2025-11-03T16:52:36.632846Z :INFO: [] MessageGroupId [src] SessionId [] Start write session. Will connect to endpoint: localhost:3784
2025-11-03T16:52:36.643475Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src" }
2025-11-03T16:52:36.643866Z node 9 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-11-03T16:52:36.643898Z node 9 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1
2025-11-03T16:52:36.644197Z node 9 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src" }
2025-11-03T16:52:36.644317Z node 9 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1 topic: "test-topic" message_group_id: "src" from ipv6:[::1]:48208
2025-11-03T16:52:36.644342Z node 9 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:48208 proto=v1  topic=test-topic durationSec=0
2025-11-03T16:52:36.644352Z node 9 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-11-03T16:52:36.646110Z node 9 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1 sessionId:  describe result for acl check
2025-11-03T16:52:36.646252Z node 9 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-11-03T16:52:36.646271Z node 9 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-11-03T16:52:36.646283Z node 9 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-11-03T16:52:36.646302Z node 9 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [9:7568543077689474091:2451] (SourceId=src, PreferedPartition=(NULL)) StartKqpSession
2025-11-03T16:52:36.649597Z node 9 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [9:7568543077689474091:2451] (SourceId=src, PreferedPartition=(NULL)) Select from the table
2025-11-03T16:52:36.693080Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:36.693114Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:36.693131Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:36.793443Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:36.793474Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:36.793490Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:36.861610Z node 9 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [9:7568543077689474091:2451] (SourceId=src, PreferedPartition=(NULL)) RequestPQRB
2025-11-03T16:52:36.862219Z node 9 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1655: [72075186224037893][rt3.dc1--test-topic] pipe [9:7568543077689474131:2451] connected; active server actors: 1
2025-11-03T16:52:36.862313Z node 9 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [9:7568543077689474091:2451] (SourceId=src, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=src
2025-11-03T16:52:36.862335Z node 9 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [9:7568543077689474091:2451] (SourceId=src, PreferedPartition=(NULL)) Update the table
2025-11-03T16:52:36.862703Z node 9 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1659: [72075186224037893][rt3.dc1--test-topic] pipe [9:7568543077689474131:2451] disconnected.
2025-11-03T16:52:36.862725Z node 9 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1670: [72075186224037893][rt3.dc1--test-topic] pipe [9:7568543077689474131:2451] disconnected; active server actors: 1
2025-11-03T16:52:36.862743Z node 9 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1695: [72075186224037893][rt3.dc1--test-topic] pipe [9:7568543077689474131:2451] disconnected no session
2025-11-03T16:52:36.894423Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:36.894482Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:36.894503Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:36.996086Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:36.996122Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:36.996140Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:37.061235Z node 9 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [9:7568543077689474091:2451] (SourceId=src, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-11-03T16:52:37.061280Z node 9 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [9:7568543077689474091:2451] (SourceId=src, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-11-03T16:52:37.061300Z node 9 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [9:7568543077689474091:2451] (SourceId=src, PreferedPartition=(NULL)) Start idle
2025-11-03T16:52:37.061334Z node 9 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-11-03T16:52:37.062270Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [9:7568543081984441454:2451], now have 1 active actors on pipe
2025-11-03T16:52:37.062483Z node 9 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 10, Generation: 1
2025-11-03T16:52:37.062694Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:37.062737Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:37.062825Z node 10 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src|b02990e8-34bf7c71-45312ba2-57b26fa6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src
2025-11-03T16:52:37.062875Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:37.062898Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:37.062913Z node 10 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-03T16:52:37.062975Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:37.063018Z node 10 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-03T16:52:37.063070Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-03T16:52:37.063671Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:37.063701Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:37.063772Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-03T16:52:37.064151Z node 9 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1 partition: 0 MaxSeqNo: 0 sessionId: src|b02990e8-34bf7c71-45312ba2-57b26fa6_0
2025-11-03T16:52:37.064908Z :INFO: [] MessageGroupId [src] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1762188757064 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-11-03T16:52:37.065022Z :INFO: [] MessageGroupId [src] SessionId [] Write session established. Init response: session_id: "src|b02990e8-34bf7c71-45312ba2-57b26fa6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-11-03T16:52:37.065284Z :INFO: [] MessageGroupId [src] SessionId [src|b02990e8-34bf7c71-45312ba2-57b26fa6_0] Write session: close. Timeout = 0 ms
2025-11-03T16:52:37.065345Z :INFO: [] MessageGroupId [src] SessionId [src|b02990e8-34bf7c71-45312ba2-57b26fa6_0] Write session will now close
2025-11-03T16:52:37.065391Z :DEBUG: [] MessageGroupId [src] SessionId [src|b02990e8-34bf7c71-45312ba2-57b26fa6_0] Write session: aborting
2025-11-03T16:52:37.065815Z :INFO: [] MessageGroupId [src] SessionId [src|b02990e8-34bf7c71-45312ba2-57b26fa6_0] Write session: gracefully shut down, all writes complete
2025-11-03T16:52:37.065863Z :DEBUG: [] MessageGroupId [src] SessionId [src|b02990e8-34bf7c71-45312ba2-57b26fa6_0] Write session: destroy
2025-11-03T16:52:37.066384Z node 9 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId: src|b02990e8-34bf7c71-45312ba2-57b26fa6_0 grpc read done: success: 0 data: 
2025-11-03T16:52:37.066409Z node 9 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 1 sessionId: src|b02990e8-34bf7c71-45312ba2-57b26fa6_0 grpc read failed
2025-11-03T16:52:37.066864Z node 9 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:824: session v1 closed cookie: 1 sessionId: src|b02990e8-34bf7c71-45312ba2-57b26fa6_0
2025-11-03T16:52:37.066893Z node 9 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1 sessionId: src|b02990e8-34bf7c71-45312ba2-57b26fa6_0 is DEAD
2025-11-03T16:52:37.067271Z node 9 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-11-03T16:52:37.067884Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [9:7568543081984441454:2451] destroyed
2025-11-03T16:52:37.067936Z node 10 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-11-03T16:52:37.067968Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:37.068111Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:37.068132Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:37.080883Z :DEBUG: [] MessageGroupId [test-message-group-id] SessionId [] Write session: try to update token
2025-11-03T16:52:37.081382Z :INFO: [] MessageGroupId [test-message-group-id] SessionId [] Write session: Do CDS request
2025-11-03T16:52:37.081479Z :INFO: [] MessageGroupId [test-message-group-id] SessionId [] Start write session. Will connect to endpoint: localhost:3784
2025-11-03T16:52:37.088758Z :ReadSession INFO: WriteToTopic: message1
2025-11-03T16:52:37.089989Z :DEBUG: [] MessageGroupId [test-message-group-id] SessionId [] Write session: send init request: init_request { topic: "test-topic" message_group_id: "test-message-group-id" }
2025-11-03T16:52:37.089780Z node 9 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-11-03T16:52:37.089808Z node 9 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2
2025-11-03T16:52:37.090503Z node 9 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "test-message-group-id" }
2025-11-03T16:52:37.090638Z node 9 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2 topic: "test-topic" message_group_id: "test-message-group-id" from ipv6:[::1]:48226
2025-11-03T16:52:37.090656Z node 9 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:48226 proto=v1  topic=test-topic durationSec=0
2025-11-03T16:52:37.090667Z node 9 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-11-03T16:52:37.092256Z node 9 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2 sessionId:  describe result for acl check
2025-11-03T16:52:37.092405Z node 9 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-11-03T16:52:37.092446Z node 9 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-11-03T16:52:37.092459Z node 9 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-11-03T16:52:37.092478Z node 9 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [9:7568543081984441463:2465] (SourceId=test-message-group-id, PreferedPartition=(NULL)) StartKqpSession
2025-11-03T16:52:37.095735Z node 9 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [9:7568543081984441463:2465] (SourceId=test-message-group-id, PreferedPartition=(NULL)) Select from the table
2025-11-03T16:52:37.096456Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:37.096490Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:37.096504Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:37.105723Z node 9 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [9:7568543081984441463:2465] (SourceId=test-message-group-id, PreferedPartition=(NULL)) RequestPQRB
2025-11-03T16:52:37.106568Z node 9 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1655: [72075186224037893][rt3.dc1--test-topic] pipe [9:7568543081984441483:2465] connected; active server actors: 1
2025-11-03T16:52:37.106670Z node 9 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [9:7568543081984441463:2465] (SourceId=test-message-group-id, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=test-message-group-id
2025-11-03T16:52:37.106690Z node 9 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [9:7568543081984441463:2465] (SourceId=test-message-group-id, PreferedPartition=(NULL)) Update the table
2025-11-03T16:52:37.107904Z node 9 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1659: [72075186224037893][rt3.dc1--test-topic] pipe [9:7568543081984441483:2465] disconnected.
2025-11-03T16:52:37.107935Z node 9 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1670: [72075186224037893][rt3.dc1--test-topic] pipe [9:7568543081984441483:2465] disconnected; active server actors: 1
2025-11-03T16:52:37.107955Z node 9 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1695: [72075186224037893][rt3.dc1--test-topic] pipe [9:7568543081984441483:2465] disconnected no session
2025-11-03T16:52:37.118467Z node 9 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [9:7568543081984441463:2465] (SourceId=test-message-group-id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-11-03T16:52:37.118502Z node 9 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [9:7568543081984441463:2465] (SourceId=test-message-group-id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-11-03T16:52:37.118520Z node 9 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [9:7568543081984441463:2465] (SourceId=test-message-group-id, PreferedPartition=(NULL)) Start idle
2025-11-03T16:52:37.118548Z node 9 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-11-03T16:52:37.122401Z node 9 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 10, Generation: 1
2025-11-03T16:52:37.124078Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [9:7568543081984441499:2465], now have 1 active actors on pipe
2025-11-03T16:52:37.124162Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:37.124192Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:37.124269Z node 10 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie test-message-group-id|718becaa-7b55bbe1-dacde730-b61bfabe_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner test-message-group-id
2025-11-03T16:52:37.124307Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:37.124328Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:37.124342Z node 10 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-03T16:52:37.124383Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:37.124425Z node 10 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-03T16:52:37.124472Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-03T16:52:37.127913Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:37.127972Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:37.128069Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-03T16:52:37.129293Z node 9 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2 partition: 0 MaxSeqNo: 0 sessionId: test-message-group-id|718becaa-7b55bbe1-dacde730-b61bfabe_0
2025-11-03T16:52:37.136162Z :INFO: [] MessageGroupId [test-message-group-id] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1762188757136 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-11-03T16:52:37.136297Z :INFO: [] MessageGroupId [test-message-group-id] SessionId [] Write session established. Init response: session_id: "test-message-group-id|718becaa-7b55bbe1-dacde730-b61bfabe_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-11-03T16:52:37.144127Z :DEBUG: [] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|718becaa-7b55bbe1-dacde730-b61bfabe_0] Write 1 messages with Id from 1 to 1
2025-11-03T16:52:37.144244Z :ReadSession INFO: WriteToTopic: message2
2025-11-03T16:52:37.144289Z :DEBUG: [] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|718becaa-7b55bbe1-dacde730-b61bfabe_0] Write 1 messages with Id from 2 to 2
2025-11-03T16:52:37.144340Z :INFO: [] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|718becaa-7b55bbe1-dacde730-b61bfabe_0] Write session: close. Timeout = 18446744073709551 ms
2025-11-03T16:52:37.144739Z :DEBUG: [] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|718becaa-7b55bbe1-dacde730-b61bfabe_0] Write session: try to update token
2025-11-03T16:52:37.144792Z :DEBUG: [] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|718becaa-7b55bbe1-dacde730-b61bfabe_0] Send 1 message(s) (1 left), first sequence number is 1
2025-11-03T16:52:37.146414Z :DEBUG: [] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|718becaa-7b55bbe1-dacde730-b61bfabe_0] Write session: try to update token
2025-11-03T16:52:37.146473Z :DEBUG: [] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|718becaa-7b55bbe1-dacde730-b61bfabe_0] Send 1 message(s) (0 left), first sequence number is 2
2025-11-03T16:52:37.145459Z node 9 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: test-message-group-id|718becaa-7b55bbe1-dacde730-b61bfabe_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:52:37.145719Z node 9 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:52:37.146977Z node 9 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: test-message-group-id|718becaa-7b55bbe1-dacde730-b61bfabe_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:52:37.147160Z node 9 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:52:37.150364Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:37.150412Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:37.150480Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:37.150496Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:37.150567Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-11-03T16:52:37.150611Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1  requestId: <none> cookie: 2
2025-11-03T16:52:37.151720Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:37.151751Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:37.151150Z node 9 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:37.151228Z node 9 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:37.152229Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0test-message-group-id' SeqNo: 1 partNo : 0 messageNo: 2 size 99 offset: -1
2025-11-03T16:52:37.152306Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:37.152328Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:37.152356Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0test-message-group-id' SeqNo: 2 partNo : 0 messageNo: 3 size 99 offset: -1
2025-11-03T16:52:37.152385Z node 10 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:52:37.152428Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:37.152468Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:37.152480Z node 10 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-03T16:52:37.152603Z node 10 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0test-message-group-id' seqNo 1 partNo 0
2025-11-03T16:52:37.153495Z node 10 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0test-message-group-id' seqNo 1 partNo 0 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 188 count 1 nextOffset 1 batches 1
2025-11-03T16:52:37.153546Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:37.154116Z node 10 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 0,1 HeadOffset 0 endOffset 0 curOffset 1 d0000000000_00000000000000000000_00000_0000000001_00000? size 176 WTime 1762188757153
2025-11-03T16:52:37.154296Z node 10 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:52:37.154341Z node 10 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:52:37.154368Z node 10 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-03T16:52:37.154519Z node 10 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 0 partNo 0 count 1 size 176
2025-11-03T16:52:37.158547Z node 10 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 0 count 1 size 176 actorID [10:7568543077014356647:2391]
2025-11-03T16:52:37.158593Z node 10 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-03T16:52:37.158641Z node 10 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 121 WriteNewSizeFromSupportivePartitions# 0
2025-11-03T16:52:37.158657Z node 10 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 0 suffix '63' size 176
2025-11-03T16:52:37.158664Z node 10 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:52:37.158698Z node 10 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0test-message-group-id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 1, partNo: 0, Offset: 0 is stored on disk
2025-11-03T16:52:37.158858Z node 10 :PERSQUEUE DEBUG: partition_read.cpp:923: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-11-03T16:52:37.158874Z node 10 :PERSQUEUE DEBUG: partition_read.cpp:965: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-11-03T16:52:37.158890Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:37.158910Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:37.158922Z node 10 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-03T16:52:37.158997Z node 10 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0test-message-group-id' seqNo 2 partNo 0
2025-11-03T16:52:37.173570Z node 10 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0test-message-group-id' seqNo 2 partNo 0 FormedBlobsCount 0 NewHead: Offset 1 PartNo 0 PackedSize 188 count 1 nextOffset 2 batches 1
2025-11-03T16:52:37.173631Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:37.174071Z node 10 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 1,1 HeadOffset 1 endOffset 1 curOffset 2 d0000000000_00000000000000000001_00000_0000000001_00000? size 176 WTime 1762188757173
2025-11-03T16:52:37.174198Z node 10 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:52:37.174267Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 2  requestId: <none> cookie: 1
2025-11-03T16:52:37.174331Z node 10 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-03T16:52:37.174426Z node 10 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 1 partNo 0 count 1 size 176
2025-11-03T16:52:37.174579Z node 10 :PERSQUEUE DEBUG: partition_read.cpp:880: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 partno 0 count 1 size 1024000 endOffset 1 max time lag 0ms effective offset 0
2025-11-03T16:52:37.174790Z node 10 :PERSQUEUE DEBUG: partition_read.cpp:1105: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 176 count 1 last offset 0, current partition end offset: 1
2025-11-03T16:52:37.174816Z node 10 :PERSQUEUE DEBUG: partition_read.cpp:1121: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-11-03T16:52:37.175293Z :DEBUG: [] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|718becaa-7b55bbe1-dacde730-b61bfabe_0] Write session got write response: sequence_numbers: 1 offsets: 0 already_written: false write_statistics { persist_duration_ms: 5 queued_in_partition_duration_ms: 1 }
2025-11-03T16:52:37.175347Z :DEBUG: [] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|718becaa-7b55bbe1-dacde730-b61bfabe_0] Write session: acknoledged message 1
2025-11-03T16:52:37.174881Z node 10 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 0 partno 0 count 1 parts_count 0 source 1 size 176 accessed 0 times before, last time 2025-11-03T16:52:37.000000Z
2025-11-03T16:52:37.174922Z node 10 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 3. All 1 blobs are from cache.
2025-11-03T16:52:37.175057Z node 10 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 0 suffix '63'
2025-11-03T16:52:37.175258Z node 10 :PERSQUEUE DEBUG: partition_read.cpp:572: FormAnswer for 1 blobs
2025-11-03T16:52:37.175381Z node 10 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 0 totakecount 1 count 1 size 156 from pos 0 cbcount 1
2025-11-03T16:52:37.175459Z node 10 :PERSQUEUE DEBUG: partition_read.cpp:1015: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1762188757152 queuesize 0 startOffset 0
2025-11-03T16:52:37.174573Z node 9 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:37.177849Z node 10 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 1 count 1 size 176 actorID [10:7568543077014356647:2391]
2025-11-03T16:52:37.177918Z node 10 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-03T16:52:37.177967Z node 10 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 121 WriteNewSizeFromSupportivePartitions# 0
2025-11-03T16:52:37.177976Z node 10 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 1 partno 0 count 1 parts 0 suffix '63' size 176
2025-11-03T16:52:37.178004Z node 10 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:52:37.178045Z node 10 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0test-message-group-id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 2, partNo: 0, Offset: 1 is stored on disk
2025-11-03T16:52:37.178259Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:37.178278Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:37.178290Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:37.178324Z node 10 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:52:37.178371Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 3  requestId: <none> cookie: 2
2025-11-03T16:52:37.179180Z :DEBUG: [] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|718becaa-7b55bbe1-dacde730-b61bfabe_0] Write session got write response: sequence_numbers: 2 offsets: 1 already_written: false write_statistics { persist_duration_ms: 4 queued_in_partition_duration_ms: 18 }
2025-11-03T16:52:37.179242Z :DEBUG: [] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|718becaa-7b55bbe1-dacde730-b61bfabe_0] Write session: acknoledged message 2
2025-11-03T16:52:37.178562Z node 9 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:37.197531Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:37.197563Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:37.197580Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:37.248056Z :INFO: [] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|718becaa-7b55bbe1-dacde730-b61bfabe_0] Write session will now close
2025-11-03T16:52:37.248131Z :DEBUG: [] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|718becaa-7b55bbe1-dacde730-b61bfabe_0] Write session: aborting
2025-11-03T16:52:37.248603Z :INFO: [] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|718becaa-7b55bbe1-dacde730-b61bfabe_0] Write session: gracefully shut down, all writes complete
2025-11-03T16:52:37.248651Z :DEBUG: [] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|718becaa-7b55bbe1-dacde730-b61bfabe_0] Write session: destroy
2025-11-03T16:52:37.251620Z node 9 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: test-message-group-id|718becaa-7b55bbe1-dacde730-b61bfabe_0 grpc read done: success: 0 data: 
2025-11-03T16:52:37.251654Z node 9 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 2 sessionId: test-message-group-id|718becaa-7b55bbe1-dacde730-b61bfabe_0 grpc read failed
2025-11-03T16:52:37.251689Z node 9 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 2 sessionId: test-message-group-id|718becaa-7b55bbe1-dacde730-b61bfabe_0 grpc closed
2025-11-03T16:52:37.251711Z node 9 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2 sessionId: test-message-group-id|718becaa-7b55bbe1-dacde730-b61bfabe_0 is DEAD
2025-11-03T16:52:37.253964Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [9:7568543081984441499:2465] destroyed
2025-11-03T16:52:37.254014Z node 10 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-11-03T16:52:37.254060Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:37.254073Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:37.252495Z node 9 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-11-03T16:52:37.254086Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:37.265705Z :INFO: [/Root] [/Root] [5070f69d-53be735-4a95661f-5875673c] Starting read session
2025-11-03T16:52:37.265753Z :DEBUG: [/Root] [/Root] [5070f69d-53be735-4a95661f-5875673c] Starting cluster discovery
2025-11-03T16:52:37.272911Z :DEBUG: [/Root] [/Root] [5070f69d-53be735-4a95661f-5875673c] Cluster discovery request succeeded
2025-11-03T16:52:37.272996Z :DEBUG: [/Root] [/Root] [5070f69d-53be735-4a95661f-5875673c] Starting session to cluster dc1 (localhost:3784)
2025-11-03T16:52:37.280460Z :DEBUG: [/Root] [/Root] [5070f69d-53be735-4a95661f-5875673c] [dc1] In Reconnect, ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:52:37.281034Z :DEBUG: [/Root] [/Root] [5070f69d-53be735-4a95661f-5875673c] [dc1] New values: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:52:37.281290Z :DEBUG: [/Root] [/Root] [5070f69d-53be735-4a95661f-5875673c] [dc1] Reconnecting session to cluster dc1 in 0.000000s
2025-11-03T16:52:37.302006Z :DEBUG: [/Root] [/Root] [5070f69d-53be735-4a95661f-5875673c] [dc1] Successfully connected. Initializing session
2025-11-03T16:52:37.300091Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:37.300124Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:37.300138Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:37.302600Z node 9 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:109: new grpc connection
2025-11-03T16:52:37.302618Z node 9 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:131: new session created cookie 1
2025-11-03T16:52:37.302988Z node 9 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { topic: "test-topic" } read_only_original: true consumer: "shared/user" read_params { max_read_size: 104857600 } } }
2025-11-03T16:52:37.303158Z node 9 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 1 consumer shared/user session shared/user_9_1_9657992707628700637_v1 read init: from# ipv6:[::1]:48244, request# { init_request { topics_read_settings { topic: "test-topic" } read_only_original: true consumer: "shared/user" read_params { max_read_size: 104857600 } } }
2025-11-03T16:52:37.303497Z node 9 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 1 consumer shared/user session shared/user_9_1_9657992707628700637_v1 auth for : user
2025-11-03T16:52:37.304128Z node 9 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 1 consumer shared/user session shared/user_9_1_9657992707628700637_v1 Handle describe topics response
2025-11-03T16:52:37.304257Z node 9 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 1 consumer shared/user session shared/user_9_1_9657992707628700637_v1 auth is DEAD
2025-11-03T16:52:37.306355Z :INFO: [/Root] [/Root] [5070f69d-53be735-4a95661f-5875673c] [dc1] Server session id: shared/user_9_1_9657992707628700637_v1
2025-11-03T16:52:37.306609Z :DEBUG: [/Root] [/Root] [5070f69d-53be735-4a95661f-5875673c] [dc1] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:52:37.304332Z node 9 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 1 consumer shared/user session shared/user_9_1_9657992707628700637_v1 auth ok: topics# 1, initDone# 0
2025-11-03T16:52:37.305785Z node 9 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 1 consumer shared/user session shared/user_9_1_9657992707628700637_v1 register session: topic# rt3.dc1--test-topic
2025-11-03T16:52:37.306069Z node 9 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1655: [72075186224037893][rt3.dc1--test-topic] pipe [9:7568543081984441530:2480] connected; active server actors: 1
2025-11-03T16:52:37.306088Z node 9 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1706: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [9:7568543081984441530:2480] session shared/user_9_1_9657992707628700637_v1
2025-11-03T16:52:37.306120Z node 9 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:639: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-11-03T16:52:37.306154Z node 9 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:669: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-11-03T16:52:37.306194Z node 9 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:871: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_9_1_9657992707628700637_v1" (Sender=[9:7568543081984441527:2480], Pipe=[9:7568543081984441530:2480], Partitions=[], ActiveFamilyCount=0)
2025-11-03T16:52:37.306226Z node 9 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1186: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-11-03T16:52:37.306263Z node 9 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1258: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-11-03T16:52:37.306308Z node 9 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1305: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_9_1_9657992707628700637_v1" (Sender=[9:7568543081984441527:2480], Pipe=[9:7568543081984441530:2480], Partitions=[], ActiveFamilyCount=0)
2025-11-03T16:52:37.306351Z node 9 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:549: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_9_1_9657992707628700637_v1" sender [9:7568543081984441527:2480] lock partition 0 for ReadingSession "shared/user_9_1_9657992707628700637_v1" (Sender=[9:7568543081984441527:2480], Pipe=[9:7568543081984441530:2480], Partitions=[], ActiveFamilyCount=1) generation 1 step 1
2025-11-03T16:52:37.306400Z node 9 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1325: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-11-03T16:52:37.306426Z node 9 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1402: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000141s
2025-11-03T16:52:37.307062Z node 9 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 1 consumer shared/user session shared/user_9_1_9657992707628700637_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 1 Session: "shared/user_9_1_9657992707628700637_v1" ClientId: "user" PipeClient { RawX1: 7568543081984441530 RawX2: 4503638282078640 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-11-03T16:52:37.307109Z node 9 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_9_1_9657992707628700637_v1 grpc read done: success# 1, data# { read { } }
2025-11-03T16:52:37.307188Z node 9 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_9_1_9657992707628700637_v1 got read request: guid# 9d753e7d-cc438797-d7c710e7-949fdbe1
2025-11-03T16:52:37.307258Z node 9 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 1 consumer shared/user session shared/user_9_1_9657992707628700637_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-11-03T16:52:37.308004Z node 9 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_9_1_9657992707628700637_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 1, pipe: [9:7568543081984441533:2483]
2025-11-03T16:52:37.309167Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [9:7568543081984441533:2483], now have 1 active actors on pipe
2025-11-03T16:52:37.309255Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:37.309279Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:37.309311Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:1748: [PQ: 72075186224037892] Created session shared/user_9_1_9657992707628700637_v1 on pipe: [9:7568543081984441533:2483]
2025-11-03T16:52:37.309370Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:37.309395Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:37.309407Z node 10 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-03T16:52:37.309484Z node 10 :PERSQUEUE DEBUG: partition.cpp:3666: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_9_1_9657992707628700637_v1
2025-11-03T16:52:37.309501Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:37.309630Z node 10 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-03T16:52:37.310110Z node 10 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_9_1_9657992707628700637_v1:1 with generation 1
2025-11-03T16:52:37.320261Z node 10 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-03T16:52:37.320340Z node 10 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-11-03T16:52:37.320367Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:37.320380Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:37.320393Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:37.320425Z node 10 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:52:37.320464Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-11-03T16:52:37.321320Z node 9 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_9_1_9657992707628700637_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 2 WriteTimestampMS: 1762188757152 CreateTimestampMS: 1762188757144 SizeLag: 352 WriteTimestampEstimateMS: 1762188757299 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-11-03T16:52:37.324070Z :INFO: [/Root] [/Root] [5070f69d-53be735-4a95661f-5875673c] [dc1] Confirm partition stream create. Partition stream id: 1. Cluster: "dc1". Topic: "test-topic". Partition: 0. Read offset: (NULL)
2025-11-03T16:52:37.321394Z node 9 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 1 consumer shared/user session shared/user_9_1_9657992707628700637_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 2 readOffset 0 committedOffset 0
2025-11-03T16:52:37.321470Z node 9 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 1 consumer shared/user session shared/user_9_1_9657992707628700637_v1 sending to client partition status
create event CreatePartitionStream { PartitionStreamId: 1 TopicPath: test-topic Cluster: dc1 PartitionId: 0 CommittedOffset: 0 EndOffset: 2 }
2025-11-03T16:52:37.324834Z node 9 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_9_1_9657992707628700637_v1 grpc read done: success# 1, data# { start_read { topic { path: "test-topic" } cluster: "dc1" assign_id: 1 } }
2025-11-03T16:52:37.325082Z node 9 :PQ_READ_PROXY INFO: read_session_actor.cpp:539: session cookie 1 consumer shared/user session shared/user_9_1_9657992707628700637_v1 got StartRead from client: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 0, commitOffset# 0
2025-11-03T16:52:37.325166Z node 9 :PQ_READ_PROXY INFO: partition_actor.cpp:1023: session cookie 1 consumer shared/user session shared/user_9_1_9657992707628700637_v1 Start reading TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 2 readOffset 0 committedOffset 0 clientCommitOffset 0 clientReadOffset 0
2025-11-03T16:52:37.325205Z node 9 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_9_1_9657992707628700637_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 0 endOffset 2
2025-11-03T16:52:37.325286Z node 9 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_9_1_9657992707628700637_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 0, endOffset# 2, WTime# 1762188757152, sizeLag# 352
2025-11-03T16:52:37.325313Z node 9 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_9_1_9657992707628700637_v1TEvPartitionReady. Aval parts: 1
2025-11-03T16:52:37.325371Z node 9 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_9_1_9657992707628700637_v1 performing read request: guid# 9d753e7d-cc438797-d7c710e7-949fdbe1, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 2, size# 422, partitionsAsked# 1, maxTimeLag# 0ms
2025-11-03T16:52:37.325463Z node 9 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_9_1_9657992707628700637_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 2 maxSize 422 maxTimeLagMs 0 readTimestampMs 0 readOffset 0 EndOffset 2 ClientCommitOffset 0 committedOffset 0 Guid 9d753e7d-cc438797-d7c710e7-949fdbe1
2025-11-03T16:52:37.328308Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:37.328350Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:37.328462Z node 10 :PERSQUEUE DEBUG: partition_read.cpp:880: [72075186224037892][Partition][0][StateIdle] read cookie 4 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 partno 0 count 2 size 422 endOffset 2 max time lag 0ms effective offset 0
2025-11-03T16:52:37.328903Z node 10 :PERSQUEUE DEBUG: partition_read.cpp:1105: [72075186224037892][Partition][0][StateIdle] read cookie 4 added 2 blobs, size 352 count 2 last offset 1, current partition end offset: 2
2025-11-03T16:52:37.328922Z node 10 :PERSQUEUE DEBUG: partition_read.cpp:1121: [72075186224037892][Partition][0][StateIdle] Reading cookie 4. Send blob request.
2025-11-03T16:52:37.328968Z node 10 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 0 partno 0 count 1 parts_count 0 source 1 size 176 accessed 1 times before, last time 2025-11-03T16:52:37.000000Z
2025-11-03T16:52:37.328989Z node 10 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 1 partno 0 count 1 parts_count 0 source 1 size 176 accessed 0 times before, last time 2025-11-03T16:52:37.000000Z
2025-11-03T16:52:37.329029Z node 10 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 4. All 2 blobs are from cache.
2025-11-03T16:52:37.329076Z node 10 :PERSQUEUE DEBUG: partition_read.cpp:572: FormAnswer for 2 blobs
2025-11-03T16:52:37.329231Z node 10 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 0 totakecount 1 count 1 size 156 from pos 0 cbcount 1
2025-11-03T16:52:37.329303Z node 10 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 1 totakecount 1 count 1 size 156 from pos 0 cbcount 1
2025-11-03T16:52:37.329396Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-03T16:52:37.329635Z node 10 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 0 suffix '63'
2025-11-03T16:52:37.329661Z node 10 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 1 partno 0 count 1 parts 0 suffix '63'
2025-11-03T16:52:37.330304Z node 9 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_9_1_9657992707628700637_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 2 Result { Offset: 0 Data: "... 99 bytes ..." SourceId: "\000test-message-group-id" SeqNo: 1 WriteTimestampMS: 1762188757152 CreateTimestampMS: 1762188757144 UncompressedSize: 8 PartitionKey: "" ExplicitHash: "" } Result { Offset: 1 Data: "... 99 bytes ..." SourceId: "\000test-message-group-id" SeqNo: 2 WriteTimestampMS: 1762188757158 CreateTimestampMS: 1762188757144 UncompressedSize: 8 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 2 SizeLag: 40 RealReadOffset: 1 WaitQuotaTimeMs: 0 EndOffset: 2 StartOffset: 0 } Cookie: 0 }
2025-11-03T16:52:37.330538Z node 9 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_9_1_9657992707628700637_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 1 from offset 2
2025-11-03T16:52:37.330591Z node 9 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_9_1_9657992707628700637_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 2 ReadOffset 2 ReadGuid 9d753e7d-cc438797-d7c710e7-949fdbe1 has messages 1
2025-11-03T16:52:37.330761Z node 9 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_9_1_9657992707628700637_v1 read done: guid# 9d753e7d-cc438797-d7c710e7-949fdbe1, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 382
2025-11-03T16:52:37.330796Z node 9 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_9_1_9657992707628700637_v1 response to read: guid# 9d753e7d-cc438797-d7c710e7-949fdbe1
2025-11-03T16:52:37.331108Z node 9 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_9_1_9657992707628700637_v1 Process answer. Aval parts: 0
2025-11-03T16:52:37.336704Z :DEBUG: [/Root] [/Root] [5070f69d-53be735-4a95661f-5875673c] [dc1] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:52:37.336960Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 0 (0-1)
2025-11-03T16:52:37.336976Z node 9 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_9_1_9657992707628700637_v1 grpc read done: success# 1, data# { read { } }
2025-11-03T16:52:37.337119Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (0-0)
2025-11-03T16:52:37.337121Z node 9 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_9_1_9657992707628700637_v1 got read request: guid# eb491e35-930d7bbb-8f815425-2ad0891b
2025-11-03T16:52:37.337186Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 0} (1-1)
2025-11-03T16:52:37.337242Z :DEBUG: [/Root] [/Root] [5070f69d-53be735-4a95661f-5875673c] [dc1] The application data is transferred to the client. Number of messages 2, size 16 bytes
data event DataReceived { PartitionStreamId: 1 PartitionId: 0 Message { Data: ..8 bytes.. Partition stream id: 1 Cluster: "dc1". Topic: "test-topic" Partition: 0 PartitionKey: "" Information: { Offset: 0 SeqNo: 1 MessageGroupId: "test-message-group-id" CreateTime: 2025-11-03T16:52:37.144000Z WriteTime: 2025-11-03T16:52:37.152000Z Ip: "ipv6:[::1]:48226" UncompressedSize: 8 Meta: { "logtype": "unknown", "ident": "unknown", "server": "ipv6:[::1]:48226" } } } Message { Data: ..8 bytes.. Partition stream id: 1 Cluster: "dc1". Topic: "test-topic" Partition: 0 PartitionKey: "" Information: { Offset: 1 SeqNo: 2 MessageGroupId: "test-message-group-id" CreateTime: 2025-11-03T16:52:37.144000Z WriteTime: 2025-11-03T16:52:37.158000Z Ip: "ipv6:[::1]:48226" UncompressedSize: 8 Meta: { "logtype": "unknown", "ident": "unknown", "server": "ipv6:[::1]:48226" } } } }
2025-11-03T16:52:37.347033Z :DEBUG: [] MessageGroupId [test-message-group-id] SessionId [] Write session: try to update token
2025-11-03T16:52:37.347583Z :INFO: [] MessageGroupId [test-message-group-id] SessionId [] Write session: Do CDS request
2025-11-03T16:52:37.347643Z :INFO: [] MessageGroupId [test-message-group-id] SessionId [] Start write session. Will connect to endpoint: localhost:3784
2025-11-03T16:52:37.357286Z :ReadSession INFO: WriteToTopic: message3
2025-11-03T16:52:37.358906Z :DEBUG: [] MessageGroupId [test-message-group-id] SessionId [] Write session: send init request: init_request { topic: "test-topic" message_group_id: "test-message-group-id" }
2025-11-03T16:52:37.360997Z node 9 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-11-03T16:52:37.361030Z node 9 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3
2025-11-03T16:52:37.362095Z node 9 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "test-message-group-id" }
2025-11-03T16:52:37.362234Z node 9 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3 topic: "test-topic" message_group_id: "test-message-group-id" from ipv6:[::1]:48268
2025-11-03T16:52:37.362256Z node 9 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:48268 proto=v1  topic=test-topic durationSec=0
2025-11-03T16:52:37.362281Z node 9 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-11-03T16:52:37.363756Z node 9 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3 sessionId:  describe result for acl check
2025-11-03T16:52:37.363887Z node 9 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-11-03T16:52:37.363905Z node 9 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-11-03T16:52:37.363916Z node 9 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-11-03T16:52:37.363931Z node 9 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [9:7568543081984441549:2490] (SourceId=test-message-group-id, PreferedPartition=(NULL)) StartKqpSession
2025-11-03T16:52:37.367175Z node 9 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [9:7568543081984441549:2490] (SourceId=test-message-group-id, PreferedPartition=(NULL)) Select from the table
2025-11-03T16:52:37.373764Z node 9 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [9:7568543081984441549:2490] (SourceId=test-message-group-id, PreferedPartition=(NULL)) Update the table
2025-11-03T16:52:37.381905Z node 9 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [9:7568543081984441549:2490] (SourceId=test-message-group-id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-11-03T16:52:37.381949Z node 9 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [9:7568543081984441549:2490] (SourceId=test-message-group-id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-11-03T16:52:37.381970Z node 9 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [9:7568543081984441549:2490] (SourceId=test-message-group-id, PreferedPartition=(NULL)) Start idle
2025-11-03T16:52:37.382001Z node 9 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-11-03T16:52:37.383878Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [9:7568543081984441586:2490], now have 1 active actors on pipe
2025-11-03T16:52:37.384246Z node 9 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 10, Generation: 1
2025-11-03T16:52:37.384614Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:37.384675Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:37.384770Z node 10 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie test-message-group-id|c131c45e-ba23afd4-35c4d70c-8f60e2f3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner test-message-group-id
2025-11-03T16:52:37.384816Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:37.384840Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:37.384857Z node 10 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-03T16:52:37.384908Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:37.384967Z node 10 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-03T16:52:37.385036Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-03T16:52:37.385545Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:37.385577Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:37.385655Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-03T16:52:37.385939Z node 9 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3 partition: 0 MaxSeqNo: 2 sessionId: test-message-group-id|c131c45e-ba23afd4-35c4d70c-8f60e2f3_0
2025-11-03T16:52:37.386562Z :INFO: [] MessageGroupId [test-message-group-id] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1762188757386 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-11-03T16:52:37.386679Z :INFO: [] MessageGroupId [test-message-group-id] SessionId [] Write session established. Init response: last_sequence_number: 2 session_id: "test-message-group-id|c131c45e-ba23afd4-35c4d70c-8f60e2f3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-11-03T16:52:37.386895Z :DEBUG: [] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|c131c45e-ba23afd4-35c4d70c-8f60e2f3_0] Write 1 messages with Id from 1 to 1
2025-11-03T16:52:37.386983Z :INFO: [] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|c131c45e-ba23afd4-35c4d70c-8f60e2f3_0] Write session: close. Timeout = 18446744073709551 ms
2025-11-03T16:52:37.387301Z :DEBUG: [] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|c131c45e-ba23afd4-35c4d70c-8f60e2f3_0] Write session: try to update token
2025-11-03T16:52:37.387352Z :DEBUG: [] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|c131c45e-ba23afd4-35c4d70c-8f60e2f3_0] Send 1 message(s) (0 left), first sequence number is 3
2025-11-03T16:52:37.387765Z node 9 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3 sessionId: test-message-group-id|c131c45e-ba23afd4-35c4d70c-8f60e2f3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:52:37.389700Z node 9 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:52:37.390247Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:37.390307Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:37.390392Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-11-03T16:52:37.390602Z node 9 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:37.390962Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:37.390990Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:37.391060Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0test-message-group-id' SeqNo: 3 partNo : 0 messageNo: 1 size 99 offset: -1
2025-11-03T16:52:37.391114Z node 10 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:52:37.391171Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:37.391211Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:37.391227Z node 10 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-03T16:52:37.391380Z node 10 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0test-message-group-id' seqNo 3 partNo 0
2025-11-03T16:52:37.392362Z node 10 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0test-message-group-id' seqNo 3 partNo 0 FormedBlobsCount 0 NewHead: Offset 2 PartNo 0 PackedSize 188 count 1 nextOffset 3 batches 1
2025-11-03T16:52:37.392422Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:37.393068Z node 10 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 2,1 HeadOffset 2 endOffset 2 curOffset 3 d0000000000_00000000000000000002_00000_0000000001_00000? size 176 WTime 1762188757390
2025-11-03T16:52:37.393269Z node 10 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-03T16:52:37.393427Z node 10 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 2 partNo 0 count 1 size 176
2025-11-03T16:52:37.396682Z node 10 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 2 count 1 size 176 actorID [10:7568543077014356647:2391]
2025-11-03T16:52:37.396767Z node 10 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-03T16:52:37.396825Z node 10 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 2 partno 0 count 1 parts 0 suffix '63' size 176
2025-11-03T16:52:37.396831Z node 10 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 121 WriteNewSizeFromSupportivePartitions# 0
2025-11-03T16:52:37.396870Z node 10 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:52:37.396924Z node 10 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0test-message-group-id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 3, partNo: 0, Offset: 2 is stored on disk
2025-11-03T16:52:37.397211Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:37.397234Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:37.397250Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:37.397291Z node 10 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:52:37.397342Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1  requestId: <none> cookie: 1
2025-11-03T16:52:37.397387Z node 9 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 1 consumer shared/user session shared/user_9_1_9657992707628700637_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 2 EndOffset 2 newEndOffset 3 commitOffset 0 clientCommitOffset 0 cookie 1 readingFinished 0 firstRead 0
2025-11-03T16:52:37.397444Z node 9 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_9_1_9657992707628700637_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 2 endOffset 3
2025-11-03T16:52:37.397493Z node 9 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_9_1_9657992707628700637_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 2, endOffset# 3, WTime# 1762188757158, sizeLag# 176
2025-11-03T16:52:37.397510Z node 9 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_9_1_9657992707628700637_v1TEvPartitionReady. Aval parts: 1
2025-11-03T16:52:37.397564Z node 9 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_9_1_9657992707628700637_v1 performing read request: guid# eb491e35-930d7bbb-8f815425-2ad0891b, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 1, size# 211, partitionsAsked# 1, maxTimeLag# 0ms
2025-11-03T16:52:37.397618Z node 9 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_9_1_9657992707628700637_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 1 maxSize 211 maxTimeLagMs 0 readTimestampMs 0 readOffset 2 EndOffset 3 ClientCommitOffset 0 committedOffset 0 Guid eb491e35-930d7bbb-8f815425-2ad0891b
2025-11-03T16:52:37.397744Z node 9 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:37.398069Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:37.398117Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:37.398249Z node 10 :PERSQUEUE DEBUG: partition_read.cpp:880: [72075186224037892][Partition][0][StateIdle] read cookie 5 Topic 'rt3.dc1--test-topic' partition 0 user user offset 2 partno 0 count 1 size 211 endOffset 3 max time lag 0ms effective offset 2
2025-11-03T16:52:37.398431Z :DEBUG: [] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|c131c45e-ba23afd4-35c4d70c-8f60e2f3_0] Write session got write response: sequence_numbers: 3 offsets: 2 already_written: false write_statistics { persist_duration_ms: 5 }
2025-11-03T16:52:37.398497Z :DEBUG: [] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|c131c45e-ba23afd4-35c4d70c-8f60e2f3_0] Write session: acknoledged message 1
2025-11-03T16:52:37.398531Z node 10 :PERSQUEUE DEBUG: partition_read.cpp:1105: [72075186224037892][Partition][0][StateIdle] read cookie 5 added 1 blobs, size 176 count 1 last offset 2, current partition end offset: 3
2025-11-03T16:52:37.398560Z node 10 :PERSQUEUE DEBUG: partition_read.cpp:1121: [72075186224037892][Partition][0][StateIdle] Reading cookie 5. Send blob request.
2025-11-03T16:52:37.398614Z node 10 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 2 partno 0 count 1 parts_count 0 source 1 size 176 accessed 0 times before, last time 2025-11-03T16:52:37.000000Z
2025-11-03T16:52:37.398665Z node 10 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 5. All 1 blobs are from cache.
2025-11-03T16:52:37.398729Z node 10 :PERSQUEUE DEBUG: partition_read.cpp:572: FormAnswer for 1 blobs
2025-11-03T16:52:37.398884Z node 10 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 2 totakecount 1 count 1 size 156 from pos 0 cbcount 1
2025-11-03T16:52:37.398999Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 2
2025-11-03T16:52:37.399207Z node 10 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 2 partno 0 count 1 parts 0 suffix '63'
2025-11-03T16:52:37.399593Z node 9 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_9_1_9657992707628700637_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 3 Result { Offset: 2 Data: "... 99 bytes ..." SourceId: "\000test-message-group-id" SeqNo: 3 WriteTimestampMS: 1762188757390 CreateTimestampMS: 1762188757386 UncompressedSize: 8 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 20 RealReadOffset: 2 WaitQuotaTimeMs: 0 EndOffset: 3 StartOffset: 0 } Cookie: 2 }
2025-11-03T16:52:37.399693Z node 9 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_9_1_9657992707628700637_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 2 from offset 3
2025-11-03T16:52:37.399723Z node 9 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_9_1_9657992707628700637_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 3 ReadOffset 3 ReadGuid eb491e35-930d7bbb-8f815425-2ad0891b has messages 1
2025-11-03T16:52:37.399818Z node 9 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_9_1_9657992707628700637_v1 read done: guid# eb491e35-930d7bbb-8f815425-2ad0891b, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 220
2025-11-03T16:52:37.399852Z node 9 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_9_1_9657992707628700637_v1 response to read: guid# eb491e35-930d7bbb-8f815425-2ad0891b
2025-11-03T16:52:37.400065Z node 9 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_9_1_9657992707628700637_v1 Process answer. Aval parts: 0
2025-11-03T16:52:37.400125Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:37.400163Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:37.400181Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:37.400559Z :DEBUG: [/Root] [/Root] [5070f69d-53be735-4a95661f-5875673c] [dc1] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:52:37.400706Z node 9 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_9_1_9657992707628700637_v1 grpc read done: success# 1, data# { read { } }
2025-11-03T16:52:37.400838Z node 9 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_9_1_9657992707628700637_v1 got read request: guid# 1eaca626-7dabb89f-6adcd9fd-d8e931e8
2025-11-03T16:52:37.404200Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 0 (2-2)
2025-11-03T16:52:37.487294Z :INFO: [] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|c131c45e-ba23afd4-35c4d70c-8f60e2f3_0] Write session will now close
2025-11-03T16:52:37.487372Z :DEBUG: [] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|c131c45e-ba23afd4-35c4d70c-8f60e2f3_0] Write session: aborting
2025-11-03T16:52:37.488420Z :INFO: [] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|c131c45e-ba23afd4-35c4d70c-8f60e2f3_0] Write session: gracefully shut down, all writes complete
2025-11-03T16:52:37.488489Z :DEBUG: [] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|c131c45e-ba23afd4-35c4d70c-8f60e2f3_0] Write session is aborting and will not restart
2025-11-03T16:52:37.488562Z :DEBUG: [] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|c131c45e-ba23afd4-35c4d70c-8f60e2f3_0] Write session: destroy
2025-11-03T16:52:37.488429Z node 9 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3 sessionId: test-message-group-id|c131c45e-ba23afd4-35c4d70c-8f60e2f3_0 grpc read done: success: 0 data: 
2025-11-03T16:52:37.488456Z node 9 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 3 sessionId: test-message-group-id|c131c45e-ba23afd4-35c4d70c-8f60e2f3_0 grpc read failed
2025-11-03T16:52:37.488726Z node 9 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:824: session v1 closed cookie: 3 sessionId: test-message-group-id|c131c45e-ba23afd4-35c4d70c-8f60e2f3_0
2025-11-03T16:52:37.488748Z node 9 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3 sessionId: test-message-group-id|c131c45e-ba23afd4-35c4d70c-8f60e2f3_0 is DEAD
2025-11-03T16:52:37.489005Z node 9 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-11-03T16:52:37.489435Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [9:7568543081984441586:2490] destroyed
2025-11-03T16:52:37.489504Z node 10 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-11-03T16:52:37.489563Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:37.489583Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:37.489601Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:37.491048Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (2-2)
2025-11-03T16:52:37.491114Z :DEBUG: [/Root] [/Root] [5070f69d-53be735-4a95661f-5875673c] [dc1] The application data is transferred to the client. Number of messages 1, size 8 bytes
data event DataReceived { PartitionStreamId: 1 PartitionId: 0 Message { Data: ..8 bytes.. Partition stream id: 1 Cluster: "dc1". Topic: "test-topic" Partition: 0 PartitionKey: "" Information: { Offset: 2 SeqNo: 3 MessageGroupId: "test-message-group-id" CreateTime: 2025-11-03T16:52:37.386000Z WriteTime: 2025-11-03T16:52:37.390000Z Ip: "ipv6:[::1]:48268" UncompressedSize: 8 Meta: { "logtype": "unknown", "ident": "unknown", "server": "ipv6:[::1]:48268" } } } }
2025-11-03T16:52:37.491310Z :DEBUG: [/Root] [/Root] [5070f69d-53be735-4a95661f-5875673c] [dc1] Commit offsets [2, 3). Partition stream id: 1
2025-11-03T16:52:37.491590Z :DEBUG: [/Root] [/Root] [5070f69d-53be735-4a95661f-5875673c] [dc1] Commit offsets [0, 2). Partition stream id: 1
2025-11-03T16:52:37.492180Z node 9 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_9_1_9657992707628700637_v1 grpc read done: success# 1, data# { commit { cookies { assign_id: 1 partition_cookie: 2 } } }
2025-11-03T16:52:37.492407Z node 9 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1449: session cookie 1 consumer shared/user session shared/user_9_1_9657992707628700637_v1 commit request from client for 2 in TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-11-03T16:52:37.492481Z node 9 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_9_1_9657992707628700637_v1 grpc read done: success# 1, data# { commit { cookies { assign_id: 1 partition_cookie: 1 } } }
2025-11-03T16:52:37.492594Z node 9 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1449: session cookie 1 consumer shared/user session shared/user_9_1_9657992707628700637_v1 commit request from client for 1 in TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-11-03T16:52:37.492634Z node 9 :PQ_READ_PROXY DEBUG: partition_actor.cpp:129: session cookie 1 consumer shared/user session shared/user_9_1_9657992707628700637_v1 commit request from 1 to 2 in TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-11-03T16:52:37.492726Z node 9 :PQ_READ_PROXY DEBUG: partition_actor.cpp:203: session cookie 1 consumer shared/user session shared/user_9_1_9657992707628700637_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) committing to position 3 prev 0 end 3 by cookie 2
2025-11-03T16:52:37.493189Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:37.493240Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:37.493315Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:37.493340Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:37.493352Z node 10 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-03T16:52:37.493409Z node 10 :PERSQUEUE DEBUG: partition.cpp:3666: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user offset is set to 3 (startOffset 0) session shared/user_9_1_9657992707628700637_v1
2025-11-03T16:52:37.493429Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:37.493568Z node 10 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-03T16:52:37.496617Z node 10 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-03T16:52:37.496695Z node 10 :PERSQUEUE DEBUG: partition_read.cpp:923: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 3 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-11-03T16:52:37.496743Z node 10 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-11-03T16:52:37.496772Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:37.496785Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:37.496796Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:37.496827Z node 10 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:52:37.496854Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 2
2025-11-03T16:52:37.497118Z node 9 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_9_1_9657992707628700637_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { Cookie: 2 }
2025-11-03T16:52:37.497175Z node 9 :PQ_READ_PROXY DEBUG: partition_actor.cpp:961: session cookie 1 consumer shared/user session shared/user_9_1_9657992707628700637_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) commit done to position 3 endOffset 3 with cookie 2
2025-11-03T16:52:37.497227Z node 9 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:707: session cookie 1 consumer shared/user session shared/user_9_1_9657992707628700637_v1 replying for commits: assignId# 1, from# 1, to# 2, offset# 3
2025-11-03T16:52:37.497787Z :DEBUG: [/Root] [/Root] [5070f69d-53be735-4a95661f-5875673c] [dc1] Committed response: cookies { assign_id: 1 partition_cookie: 1 } cookies { assign_id: 1 partition_cookie: 2 }
commit ack or close event CommitAcknowledgement { PartitionStreamId: 1 PartitionId: 0 CommittedOffset: 3 }
2025-11-03T16:52:37.498246Z :INFO: [/Root] [/Root] [5070f69d-53be735-4a95661f-5875673c] Closing read session. Close timeout: 0.000000s
2025-11-03T16:52:37.498300Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): dc1:test-topic:0:1:2:3
2025-11-03T16:52:37.498344Z :INFO: [/Root] [/Root] [5070f69d-53be735-4a95661f-5875673c] Counters: { Errors: 0 CurrentSessionLifetimeMs: 232 BytesRead: 24 MessagesRead: 3 BytesReadCompressed: 84 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-11-03T16:52:37.498443Z :NOTICE: [/Root] [/Root] [5070f69d-53be735-4a95661f-5875673c] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Close with zero timeout " }
2025-11-03T16:52:37.498502Z :DEBUG: [/Root] [/Root] [5070f69d-53be735-4a95661f-5875673c] [dc1] Abort session to cluster
2025-11-03T16:52:37.498922Z :NOTICE: [/Root] [/Root] [5070f69d-53be735-4a95661f-5875673c] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
2025-11-03T16:52:37.500064Z node 9 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_9_1_9657992707628700637_v1 grpc read done: success# 0, data# {  }
2025-11-03T16:52:37.500089Z node 9 :PQ_READ_PROXY INFO: read_session_actor.cpp:125: session cookie 1 consumer shared/user session shared/user_9_1_9657992707628700637_v1 grpc read failed
2025-11-03T16:52:37.500117Z node 9 :PQ_READ_PROXY INFO: read_session_actor.cpp:92: session cookie 1 consumer shared/user session shared/user_9_1_9657992707628700637_v1 grpc closed
2025-11-03T16:52:37.500151Z node 9 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 1 consumer shared/user session shared/user_9_1_9657992707628700637_v1 is DEAD
2025-11-03T16:52:37.501220Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:37.501264Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:37.501279Z node 9 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1659: [72075186224037893][rt3.dc1--test-topic] pipe [9:7568543081984441530:2480] disconnected.
2025-11-03T16:52:37.501308Z node 9 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1670: [72075186224037893][rt3.dc1--test-topic] pipe [9:7568543081984441530:2480] disconnected; active server actors: 1
2025-11-03T16:52:37.501329Z node 9 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1679: [72075186224037893][rt3.dc1--test-topic] pipe [9:7568543081984441530:2480] client user disconnected session shared/user_9_1_9657992707628700637_v1
2025-11-03T16:52:37.501284Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:37.501359Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:2258: [PQ: 72075186224037892] Destroy direct read session shared/user_9_1_9657992707628700637_v1
2025-11-03T16:52:37.501392Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [9:7568543081984441533:2483] destroyed
2025-11-03T16:52:37.501444Z node 10 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_9_1_9657992707628700637_v1
2025-11-03T16:52:37.603642Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:37.603677Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:37.603692Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:37.708121Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:37.708161Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:37.708182Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:37.795906Z node 9 :KQP_EXECUTER ERROR: kqp_executer_impl.h:1006: ActorId: [9:7568543081984441601:2476] TxId: 281474976710678. Ctx: { TraceId: 01k95a5292b5wevg1t7ejgsxeg, Database: /Root, SessionId: ydb://session/3?node_id=9&id=MjYxZDg0ZGEtMmE1ZmU5MzYtYjY4NDAwMjUtMTc1MGZiYWQ=, PoolId: default}. UNAVAILABLE: Failed to send EvStartKqpTasksRequest because node is unavailable: 10
2025-11-03T16:52:37.796069Z node 9 :KQP_COMPUTE ERROR: dq_compute_actor_impl.h:1210: SelfId: [9:7568543081984441610:2476], TxId: 281474976710678, task: 3. Ctx: { TraceId : 01k95a5292b5wevg1t7ejgsxeg.  CheckpointId : .  RunScriptActorId : [0:0:0].  CustomerSuppliedId : .  PoolId : default.  SessionId : ydb://session/3?node_id=9&id=MjYxZDg0ZGEtMmE1ZmU5MzYtYjY4NDAwMjUtMTc1MGZiYWQ=.  CurrentExecutionId : .  Database : /Root.  DatabaseId : /Root. }. Handle abort execution event from: [9:7568543081984441601:2476], status: UNAVAILABLE, reason: { <main>: Error: Terminate execution }
2025-11-03T16:52:39.410255Z :ReadSession INFO: Random seed for debugging is 1762188759410222
2025-11-03T16:52:39.940681Z node 11 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[11:7568543093102362592:2153];send_to=[0:7307199536658146131:7762515];
2025-11-03T16:52:39.940978Z node 11 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
2025-11-03T16:52:39.963099Z node 11 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-11-03T16:52:39.966822Z node 11 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-11-03T16:52:39.971616Z node 12 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[12:7568543091934920374:2154];send_to=[0:7307199536658146131:7762515];
test_client.cpp: SetPath # /home/runner/.ya/build/build_root/7jz3/001998/r3tmp/tmptOIEs0/pdisk_1.dat
2025-11-03T16:52:40.002695Z node 12 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-11-03T16:52:40.004838Z node 12 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
2025-11-03T16:52:40.010737Z node 12 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-11-03T16:52:40.143032Z node 11 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-11-03T16:52:40.158191Z node 11 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
2025-11-03T16:52:40.172092Z node 12 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-11-03T16:52:40.187996Z node 11 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(11, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-11-03T16:52:40.188103Z node 11 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(11, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-11-03T16:52:40.190825Z node 11 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(12, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-11-03T16:52:40.190908Z node 11 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(12, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-11-03T16:52:40.198686Z node 11 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(11, (0,0,0,0)) VolatileState: Connecting -> Connected
2025-11-03T16:52:40.200926Z node 11 :HIVE WARN: hive_impl.cpp:811: HIVE#72057594037968897 Handle TEvInterconnect::TEvNodeConnected, NodeId 12 Cookie 12
2025-11-03T16:52:40.205248Z node 11 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(12, (0,0,0,0)) VolatileState: Connecting -> Connected
TServer::EnableGrpc on GrpcPort 3534, node 11
2025-11-03T16:52:40.283162Z node 11 :NET_CLASSIFIER WARN: net_classifier.cpp:190: distributable config is empty, broken or outdated, will use file: /home/runner/.ya/build/build_root/7jz3/001998/r3tmp/yandexgZFrU7.tmp
2025-11-03T16:52:40.283200Z node 11 :NET_CLASSIFIER WARN: net_classifier.cpp:196: will try to initialize from file: /home/runner/.ya/build/build_root/7jz3/001998/r3tmp/yandexgZFrU7.tmp
2025-11-03T16:52:40.283378Z node 11 :NET_CLASSIFIER WARN: net_classifier.cpp:202: successfully initialized from file: /home/runner/.ya/build/build_root/7jz3/001998/r3tmp/yandexgZFrU7.tmp
2025-11-03T16:52:40.283620Z node 11 :NET_CLASSIFIER ERROR: net_classifier.cpp:228: got bad distributable configuration
2025-11-03T16:52:40.317083Z INFO: TTestServer started on Port 9015 GrpcPort 3534
TClient is connected to server localhost:9015
PQClient connected to localhost:3534
WaitRootIsUp 'Root'...
TClient::Ls request: Root
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "Root"
    PathId: 1
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 1
    CreateStep: 0
    ParentPathId: 1
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 1
      SubDomainVersion: 0
      SecurityStateVersion: 0
    }
    ChildrenExist: false
  }
  Children {
    Name: ".sys"
    PathId: 18446744073709551615
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 0
    CreateStep: 0
    ParentPathId: 18446744073709551615
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 0
      Pl...
(TRUNCATED)
WaitRootIsUp 'Root' success.
2025-11-03T16:52:40.490892Z node 11 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpAlterSubDomain, opId: 281474976710657:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_alter_subdomain.cpp:311)
waiting...
waiting...
2025-11-03T16:52:40.550098Z node 12 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
waiting...
waiting...
2025-11-03T16:52:40.589418Z node 11 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-11-03T16:52:40.942561Z node 11 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-11-03T16:52:40.996132Z node 12 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-11-03T16:52:44.934367Z node 11 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[11:7568543093102362592:2153];send_to=[0:7307199536658146131:7762515];
2025-11-03T16:52:44.934475Z node 11 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
2025-11-03T16:52:44.972114Z node 12 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[12:7568543091934920374:2154];send_to=[0:7307199536658146131:7762515];
2025-11-03T16:52:44.972197Z node 12 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
2025-11-03T16:52:45.400850Z node 12 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [12:7568543117704724374:2301], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-03T16:52:45.400851Z node 12 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [12:7568543117704724386:2304], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-03T16:52:45.400973Z node 12 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-03T16:52:45.405798Z node 12 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [12:7568543117704724396:2306], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-03T16:52:45.406028Z node 12 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-03T16:52:45.411019Z node 11 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateResourcePool, opId: 281474976720657:3, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_resource_pool.cpp:179)
2025-11-03T16:52:45.445123Z node 12 :KQP_WORKLOAD_SERVICE WARN: helpers.h:73: [WorkloadService] [TPoolCreatorActor] ActorId: [12:7568543117704724395:2305], DatabaseId: /Root, PoolId: default, Scheduled retry for error: { <main>: Error: Transaction 281474976720657 completed, doublechecking }
2025-11-03T16:52:45.542899Z node 12 :TX_PROXY ERROR: schemereq.cpp:593: Actor# [12:7568543117704724426:2142] txid# 281474976720658, issues: { message: "Check failed: path: \'/Root/.metadata/workload_manager/pools/default\', error: path exist, request accepts it (id: [OwnerId: 72057594046644480, LocalPathId: 8], type: EPathTypeResourcePool, state: EPathStateNoChanges)" severity: 1 }
2025-11-03T16:52:45.603574Z node 12 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:570: Compilation failed, self: [12:7568543117704724433:2310], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-11-03T16:52:45.603916Z node 12 :KQP_SESSION WARN: kqp_session_actor.cpp:2506: SessionId: ydb://session/3?node_id=12&id=NjI0YTE4MGUtMzQzYTFhZTYtNmQ0N2VkYmItNmY3M2VjNmQ=, ActorId: [12:7568543117704724357:2300], ActorState: ExecuteState, TraceId: 01k95a5a6n5nq4j2pv9ehagcre, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-11-03T16:52:45.604533Z node 12 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-11-03T16:52:45.677419Z node 11 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:570: Compilation failed, self: [11:7568543118872167363:2337], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-11-03T16:52:45.681339Z node 11 :KQP_SESSION WARN: kqp_session_actor.cpp:2506: SessionId: ydb://session/3?node_id=11&id=MTFkYjMwYjYtMTY3MjIwOTctOTQyZmVmMWYtNDE3MWYyYjM=, ActorId: [11:7568543118872167327:2330], ActorState: ExecuteState, TraceId: 01k95a5adrbwta9vz65fnbvsdy, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-11-03T16:52:45.681906Z node 11 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-11-03T16:52:45.701154Z node 11 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710661:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:690)
2025-11-03T16:52:45.788138Z node 11 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710662:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:690)
2025-11-03T16:52:45.978316Z node 11 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710663:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:690)
=== Init DC: UPSERT INTO `/Root/PQ/Config/V2/Cluster` (name, balancer, local, enabled, weight) VALUES ("dc1", "localhost:3534", true, true, 1000);
2025-11-03T16:52:46.372536Z node 11 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976710664. Ctx: { TraceId: 01k95a5ayd9yrn17gwyenh1fkq, Database: , SessionId: ydb://session/3?node_id=11&id=Mzk2MGEzZDItNTE3MTA5MmEtNDM2ZDAxYmItMzFkMzcxZGI=, PoolId: default, DatabaseId: /Root}. Database not set, use /Root
=== CheckClustersList. Subcribe to ClusterTracker from [11:7568543123167135065:2983] 
=== CheckClustersList. Ok
2025-11-03T16:52:53.119578Z node 11 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710669:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:690)
waiting...
PQ Client: create topic: rt3.dc1--test-topic with 1 partitions
CallPersQueueGRPC request to localhost:3534
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-11-03T16:52:53.261458Z node 11 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
CallPersQueueGRPC request to localhost:3534
MetaRequest {
  CmdCreateTopic {
    Topic: "rt3.dc1--test-topic"
    NumPartitions: 1
    Config {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
  }
}
CallPersQueueGRPC response:
Status: 129
ProxyErrorCode: 53
SchemeStatus: 1
FlatTxId {
  TxId: 281474976710670
  SchemeShardTabletId: 72057594046644480
  PathId: 13
}
ErrorCode: OK
AddTopic: rt3.dc1--test-topic
===Run query:``DECLARE $version as Int64; DECLARE $path AS Utf8; DECLARE $cluster as Utf8; UPSERT INTO `/Root/PQ/Config/V2/Topics` (path, dc) VALUES ($path, $cluster); UPSERT INTO `/Root/PQ/Config/V2/Versions` (name, version) VALUES ("Topics", $version);`` with topic = test-topic, dc = dc1
2025-11-03T16:52:53.304726Z node 11 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1655: [72075186224037893][] pipe [11:7568543153231906553:3252] connected; active server actors: 1
2025-11-03T16:52:53.306162Z node 11 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1519: [72075186224037893][rt3.dc1--test-topic] updating configuration. Deleted partitions []. Added partitions [0]
2025-11-03T16:52:53.309809Z node 11 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:971: [72075186224037893][rt3.dc1--test-topic] Discovered subdomain [OwnerId: 72057594046644480, LocalPathId: 1] state, outOfSpace = 0 at RB 72075186224037893
2025-11-03T16:52:53.313873Z node 11 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:140: [72075186224037893][rt3.dc1--test-topic] BALANCER INIT DONE for rt3.dc1--test-topic: (0, 72075186224037892) 
2025-11-03T16:52:53.324073Z node 12 :PERSQUEUE DEBUG: pq_impl.cpp:2960: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-11-03T16:52:53.326491Z node 12 :PERSQUEUE DEBUG: pq_impl.cpp:2992: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-11-03T16:52:53.326667Z node 12 :PERSQUEUE DEBUG: pq_impl.cpp:787: [PQ: 72075186224037892] no config, start with empty partitions and default config
2025-11-03T16:52:53.326689Z node 12 :PERSQUEUE NOTICE: pq_impl.cpp:913: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-11-03T16:52:53.326724Z node 12 :PERSQUEUE INFO: pq_impl.cpp:612: [PQ: 72075186224037892] doesn't have tx writes info
2025-11-03T16:52:53.329745Z node 11 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:404: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 12, Generation 1
2025-11-03T16:52:53.329924Z node 12 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [11:7568543153231906579:2438], now have 1 active actors on pipe
2025-11-03T16:52:53.329962Z node 12 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [11:7568543153231906552:3251], now have 1 active actors on pipe
2025-11-03T16:52:53.330356Z node 12 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-03T16:52:53.334072Z node 12 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-03T16:52:53.344388Z node 12 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [11:7568543153231906608:3293], now have 1 active actors on pipe
2025-11-03T16:52:53.348499Z node 12 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-03T16:52:53.369683Z node 12 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-03T16:52:53.370635Z node 12 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-11-03T16:52:53.370685Z node 12 :PERSQUEUE DEBUG: partition.cpp:1312: [72075186224037892][Partition][0][StateInit] HandleOnInit TEvPQ::TEvProposePartitionConfig
2025-11-03T16:52:53.370996Z node 12 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-11-03T16:52:53.371225Z node 12 :PERSQUEUE INFO: partition_init.cpp:1101: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [12:7568543152064463263:2392]
2025-11-03T16:52:53.374403Z node 12 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-11-03T16:52:53.374439Z node 12 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-11-03T16:52:53.374464Z node 12 :PERSQUEUE INFO: partition.cpp:707: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1 [12:7568543152064463263:2392]
2025-11-03T16:52:53.374493Z node 12 :PERSQUEUE DEBUG: partition.cpp:727: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 0 Head Offset 0 PartNo 0 PackedSize 0 count 0 nextOffset 0 batches 0
2025-11-03T16:52:53.374533Z node 12 :PERSQUEUE DEBUG: partition_mlp.cpp:83: [72075186224037892][Partition][0][StateIdle] Initializing MLP Consumers: 0
2025-11-03T16:52:53.375919Z node 12 :PERSQUEUE DEBUG: partition.cpp:4273: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 1
2025-11-03T16:52:53.375955Z node 12 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:53.378219Z node 12 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:53.378250Z node 12 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-03T16:52:53.378288Z node 12 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-11-03T16:52:53.378307Z node 12 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:53.378322Z node 12 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:53.378347Z node 12 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-11-03T16:52:53.378383Z node 12 :PERSQUEUE DEBUG: partition_read.cpp:923: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-11-03T16:52:53.378455Z node 12 :PERSQUEUE DEBUG: partition_mlp.cpp:60: [72075186224037892][Partition][0][StateIdle] Process MLP pending events. Count 0
2025-11-03T16:52:53.379054Z node 12 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-03T16:52:53.379233Z node 12 :PERSQUEUE DEBUG: partition_compaction.cpp:183: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:52:53.388209Z node 12 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-03T16:52:53.388372Z node 12 :PERSQUEUE DEBUG: partition.cpp:1416: [72075186224037892][Partition][0][StateIdle] Handle TEvPQ::TEvTxCommit Step 1762188773387, TxId 281474976710670
2025-11-03T16:52:53.388400Z node 12 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:53.388415Z node 12 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:53.388560Z node 12 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:53.388801Z node 12 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-03T16:52:53.396766Z node 12 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-03T16:52:53.396970Z node 12 :PERSQUEUE DEBUG: partition_mlp.cpp:83: [72075186224037892][Partition][0][StateIdle] Initializing MLP Consumers: 0
2025-11-03T16:52:53.397124Z node 12 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-11-03T16:52:53.397153Z node 12 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:53.397167Z node 12 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:53.397181Z node 12 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:53.397215Z node 12 :PERSQUEUE DEBUG: partition_compaction.cpp:183: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:52:53.397591Z node 12 :PERSQUEUE DEBUG: pq_impl.cpp:398: [PQ: 72075186224037892] Apply new config PartitionConfig { LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 } PartitionIds: 0 TopicName: "rt3.dc1--test-topic" Version: 0 LocalDC: true Codecs { Ids: 0 Ids: 1 Ids: 2 Codecs: "raw" Codecs: "gzip" Codecs: "lzop" } TopicPath: "/Root/PQ/rt3.dc1--test-topic" YcCloudId: "" YcFolderId: "" YdbDatabaseId: "" YdbDatabasePath: "/Root" Partitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } AllPartitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } Consumers { Name: "user" ReadFromTimestampsMs: 0 FormatVersion: 0 Version: 0 Generation: 0 } MonitoringProjectId: ""
2025-11-03T16:52:53.397693Z node 12 :PERSQUEUE NOTICE: pq_impl.cpp:913: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-11-03T16:52:53.397988Z node 12 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-03T16:52:53.420923Z node 12 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-03T16:52:53.421058Z node 12 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-03T16:52:53.431116Z node 12 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-03T16:52:53.478477Z node 12 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:53.478512Z node 12 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:53.478531Z node 12 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:53.535731Z node 11 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976710671. Ctx: { TraceId: 01k95a5hyg8jgz3n96zd7caf5q, Database: , SessionId: ydb://session/3?node_id=11&id=ODI3ZDY5ZGUtZjI0ZDgyMTktOTg2Njk0OTYtYzJlMDI2Y2Y=, PoolId: default, DatabaseId: /Root}. Database not set, use /Root
2025-11-03T16:52:53.582984Z node 12 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:53.583031Z node 12 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:53.583049Z node 12 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
===Query complete
TClient::Ls request: /Root/PQ/rt3.dc1--test-topic
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976710670
    CreateStep: 1762188773387
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts...
(TRUNCATED)
GetTopicVersionFromPath:  record Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976710670
    CreateStep: 1762188773387
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      YdbDatabasePath: "/Root"
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
    Partitions {
      PartitionId: 0
      TabletId: 72075186224037892
      Status: Active
    }
    AlterVersion: 1
    BalancerTabletID: 72075186224037893
    NextPartitionId: 1
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 1
      PlanResolution: 7
      Coordinators: 72057594046316545
      TimeCastBucketsPerMediator: 2
      Mediators: 72057594046382081
    }
    DomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    PathsInside: 12
    PathsLimit: 10000
    ShardsInside: 6
    ShardsLimit: 200000
    ResourcesDomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    DiskSpaceUsage {
      Tables {
        TotalSize: 0
        DataSize: 0
        IndexSize: 0
      }
      Topics {
        ReserveSize: 0
        AccountSize: 0
        DataSize: 0
        UsedReserveSize: 0
      }
    }
    PQPartitionsInside: 1
    PQPartitionsLimit: 1000000
    SchemeLimits {
      MaxDepth: 32
      MaxPaths: 10000
      MaxChildrenInDir: 100000
      MaxAclBytesSize: 10240
      MaxTableColumns: 200
      MaxTableColumnNameLength: 255
      MaxTableKeyColumns: 30
      MaxTableIndices: 20
      MaxShards: 200000
      MaxShardsInPath: 35000
      MaxConsistentCopyTargets: 10000
      MaxPathElementLength: 255
      ExtraPathSymbolsAllowed: "!\"#$%&\'()*+,-.:;<=>?@[\\]^_`{|}~"
      MaxPQPartitions: 1000000
      MaxTableCdcStreams: 5
      MaxExports: 10
      MaxImports: 10
      MaxColumnTableColumns: 10000
    }
  }
}
Path: "/Root/PQ/rt3.dc1--test-topic"
 name rt3.dc1--test-topic version1
CallPersQueueGRPC request to localhost:3534
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-11-03T16:52:53.601562Z node 11 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
MetaResponse {
  CmdGetTopicMetadataResult {
    TopicInfo {
      Topic: "rt3.dc1--test-topic"
      NumPartitions: 1
      Config {
        PartitionConfig {
          LifetimeSeconds: 86400
          LowWatermark: 8388608
          SourceIdLifetimeSeconds: 86400
          WriteSpeedInBytesPerSecond: 20000000
          BurstSize: 20000000
          SourceIdMaxCounts: 6000000
        }
        Version: 1
        LocalDC: true
        Codecs {
          Ids: 0
          Ids: 1
          Ids: 2
          Codecs: "raw"
          Codecs: "gzip"
          Codecs: "lzop"
        }
        TopicPath: "/Root/PQ/rt3.dc1--test-topic"
        YdbDatabasePath: "/Root"
        Consumers {
          Name: "user"
          ReadFromTimestampsMs: 0
          FormatVersion: 0
          Version: 0
        }
      }
      ErrorCode: OK
    }
  }
}
=== Topic created, have version: 1
2025-11-03T16:52:53.613802Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: try to update token
2025-11-03T16:52:53.614499Z :INFO: [] MessageGroupId [src] SessionId [] Write session: Do CDS request
2025-11-03T16:52:53.614531Z :INFO: [] MessageGroupId [src] SessionId [] Start write session. Will connect to endpoint: localhost:3534
2025-11-03T16:52:53.625934Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src" }
2025-11-03T16:52:53.627617Z node 11 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-11-03T16:52:53.627659Z node 11 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1
2025-11-03T16:52:53.628652Z node 11 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src" }
2025-11-03T16:52:53.628788Z node 11 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1 topic: "test-topic" message_group_id: "src" from ipv6:[::1]:60362
2025-11-03T16:52:53.628808Z node 11 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:60362 proto=v1  topic=test-topic durationSec=0
2025-11-03T16:52:53.628819Z node 11 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-11-03T16:52:53.630763Z node 11 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1 sessionId:  describe result for acl check
2025-11-03T16:52:53.630901Z node 11 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-11-03T16:52:53.630916Z node 11 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-11-03T16:52:53.630931Z node 11 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-11-03T16:52:53.630957Z node 11 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [11:7568543153231906692:2456] (SourceId=src, PreferedPartition=(NULL)) StartKqpSession
2025-11-03T16:52:53.634747Z node 11 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [11:7568543153231906692:2456] (SourceId=src, PreferedPartition=(NULL)) Select from the table
2025-11-03T16:52:53.683273Z node 12 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:53.683302Z node 12 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:53.683316Z node 12 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:53.783651Z node 12 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:53.783691Z node 12 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:53.783708Z node 12 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:53.875148Z node 11 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [11:7568543153231906692:2456] (SourceId=src, PreferedPartition=(NULL)) RequestPQRB
2025-11-03T16:52:53.876122Z node 11 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1655: [72075186224037893][rt3.dc1--test-topic] pipe [11:7568543153231906731:2456] connected; active server actors: 1
2025-11-03T16:52:53.876388Z node 11 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [11:7568543153231906692:2456] (SourceId=src, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=src
2025-11-03T16:52:53.876413Z node 11 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [11:7568543153231906692:2456] (SourceId=src, PreferedPartition=(NULL)) Update the table
2025-11-03T16:52:53.877949Z node 11 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1659: [72075186224037893][rt3.dc1--test-topic] pipe [11:7568543153231906731:2456] disconnected.
2025-11-03T16:52:53.877990Z node 11 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1670: [72075186224037893][rt3.dc1--test-topic] pipe [11:7568543153231906731:2456] disconnected; active server actors: 1
2025-11-03T16:52:53.878011Z node 11 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1695: [72075186224037893][rt3.dc1--test-topic] pipe [11:7568543153231906731:2456] disconnected no session
2025-11-03T16:52:53.884348Z node 12 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:53.884378Z node 12 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:53.884393Z node 12 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:53.984362Z node 12 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:53.984401Z node 12 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:53.984417Z node 12 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:54.032445Z node 11 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [11:7568543153231906692:2456] (SourceId=src, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-11-03T16:52:54.032483Z node 11 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [11:7568543153231906692:2456] (SourceId=src, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-11-03T16:52:54.032504Z node 11 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [11:7568543153231906692:2456] (SourceId=src, PreferedPartition=(NULL)) Start idle
2025-11-03T16:52:54.032534Z node 11 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-11-03T16:52:54.034088Z node 12 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [11:7568543157526874058:2456], now have 1 active actors on pipe
2025-11-03T16:52:54.034161Z node 11 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 12, Generation: 1
2025-11-03T16:52:54.034663Z node 12 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:54.034711Z node 12 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:54.034819Z node 12 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src|4ce677c1-ef8d9db-f63470fa-b814aa61_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src
2025-11-03T16:52:54.034869Z node 12 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:54.034899Z node 12 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:54.034914Z node 12 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-03T16:52:54.034954Z node 12 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:54.034999Z node 12 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-03T16:52:54.035076Z node 12 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-03T16:52:54.036400Z node 12 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:54.036432Z node 12 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:54.036516Z node 12 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-03T16:52:54.036857Z node 11 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1 partition: 0 MaxSeqNo: 0 sessionId: src|4ce677c1-ef8d9db-f63470fa-b814aa61_0
2025-11-03T16:52:54.037663Z :INFO: [] MessageGroupId [src] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1762188774037 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-11-03T16:52:54.037864Z :INFO: [] MessageGroupId [src] SessionId [] Write session established. Init response: session_id: "src|4ce677c1-ef8d9db-f63470fa-b814aa61_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-11-03T16:52:54.038114Z :INFO: [] MessageGroupId [src] SessionId [src|4ce677c1-ef8d9db-f63470fa-b814aa61_0] Write session: close. Timeout = 0 ms
2025-11-03T16:52:54.038154Z :INFO: [] MessageGroupId [src] SessionId [src|4ce677c1-ef8d9db-f63470fa-b814aa61_0] Write session will now close
2025-11-03T16:52:54.038190Z :DEBUG: [] MessageGroupId [src] SessionId [src|4ce677c1-ef8d9db-f63470fa-b814aa61_0] Write session: aborting
2025-11-03T16:52:54.038585Z :INFO: [] MessageGroupId [src] SessionId [src|4ce677c1-ef8d9db-f63470fa-b814aa61_0] Write session: gracefully shut down, all writes complete
2025-11-03T16:52:54.038619Z :DEBUG: [] MessageGroupId [src] SessionId [src|4ce677c1-ef8d9db-f63470fa-b814aa61_0] Write session: destroy
2025-11-03T16:52:54.040181Z node 11 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId: src|4ce677c1-ef8d9db-f63470fa-b814aa61_0 grpc read done: success: 0 data: 
2025-11-03T16:52:54.040205Z node 11 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 1 sessionId: src|4ce677c1-ef8d9db-f63470fa-b814aa61_0 grpc read failed
2025-11-03T16:52:54.040236Z node 11 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 1 sessionId: src|4ce677c1-ef8d9db-f63470fa-b814aa61_0 grpc closed
2025-11-03T16:52:54.040258Z node 11 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1 sessionId: src|4ce677c1-ef8d9db-f63470fa-b814aa61_0 is DEAD
2025-11-03T16:52:54.041159Z node 11 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-11-03T16:52:54.041981Z node 12 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [11:7568543157526874058:2456] destroyed
2025-11-03T16:52:54.042041Z node 12 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-11-03T16:52:54.042076Z node 12 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:54.042092Z node 12 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:54.042107Z node 12 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:54.056250Z :DEBUG: [] MessageGroupId [test-message-group-id] SessionId [] Write session: try to update token
2025-11-03T16:52:54.056610Z :INFO: [] MessageGroupId [test-message-group-id] SessionId [] Write session: Do CDS request
2025-11-03T16:52:54.056638Z :INFO: [] MessageGroupId [test-message-group-id] SessionId [] Start write session. Will connect to endpoint: localhost:3534
2025-11-03T16:52:54.064056Z :ReadSession INFO: WriteToTopic: message1
2025-11-03T16:52:54.065118Z :DEBUG: [] MessageGroupId [test-message-group-id] SessionId [] Write session: send init request: init_request { topic: "test-topic" message_group_id: "test-message-group-id" }
2025-11-03T16:52:54.065060Z node 11 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-11-03T16:52:54.065089Z node 11 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2
2025-11-03T16:52:54.065584Z node 11 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "test-message-group-id" }
2025-11-03T16:52:54.065723Z node 11 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2 topic: "test-topic" message_group_id: "test-message-group-id" from ipv6:[::1]:34364
2025-11-03T16:52:54.065741Z node 11 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:34364 proto=v1  topic=test-topic durationSec=0
2025-11-03T16:52:54.065752Z node 11 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-11-03T16:52:54.067876Z node 11 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2 sessionId:  describe result for acl check
2025-11-03T16:52:54.068041Z node 11 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-11-03T16:52:54.068056Z node 11 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-11-03T16:52:54.068069Z node 11 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-11-03T16:52:54.068090Z node 11 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [11:7568543157526874069:2474] (SourceId=test-message-group-id, PreferedPartition=(NULL)) StartKqpSession
2025-11-03T16:52:54.071376Z node 11 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [11:7568543157526874069:2474] (SourceId=test-message-group-id, PreferedPartition=(NULL)) Select from the table
2025-11-03T16:52:54.083258Z node 11 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [11:7568543157526874069:2474] (SourceId=test-message-group-id, PreferedPartition=(NULL)) RequestPQRB
2025-11-03T16:52:54.083749Z node 11 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1655: [72075186224037893][rt3.dc1--test-topic] pipe [11:7568543157526874089:2474] connected; active server actors: 1
2025-11-03T16:52:54.083807Z node 11 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [11:7568543157526874069:2474] (SourceId=test-message-group-id, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=test-message-group-id
2025-11-03T16:52:54.083828Z node 11 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [11:7568543157526874069:2474] (SourceId=test-message-group-id, PreferedPartition=(NULL)) Update the table
2025-11-03T16:52:54.084881Z node 11 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1659: [72075186224037893][rt3.dc1--test-topic] pipe [11:7568543157526874089:2474] disconnected.
2025-11-03T16:52:54.084916Z node 11 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1670: [72075186224037893][rt3.dc1--test-topic] pipe [11:7568543157526874089:2474] disconnected; active server actors: 1
2025-11-03T16:52:54.084936Z node 11 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1695: [72075186224037893][rt3.dc1--test-topic] pipe [11:7568543157526874089:2474] disconnected no session
2025-11-03T16:52:54.084791Z node 12 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:54.084821Z node 12 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:54.084844Z node 12 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:54.095367Z node 11 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [11:7568543157526874069:2474] (SourceId=test-message-group-id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-11-03T16:52:54.095408Z node 11 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [11:7568543157526874069:2474] (SourceId=test-message-group-id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-11-03T16:52:54.095429Z node 11 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [11:7568543157526874069:2474] (SourceId=test-message-group-id, PreferedPartition=(NULL)) Start idle
2025-11-03T16:52:54.095461Z node 11 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-11-03T16:52:54.097611Z node 12 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [11:7568543157526874105:2474], now have 1 active actors on pipe
2025-11-03T16:52:54.098120Z node 12 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:54.098161Z node 12 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:54.098240Z node 12 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie test-message-group-id|575c662f-7f68e55b-64187568-4c120684_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner test-message-group-id
2025-11-03T16:52:54.098284Z node 12 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:54.098309Z node 12 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:54.098325Z node 12 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-03T16:52:54.097799Z node 11 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 12, Generation: 1
2025-11-03T16:52:54.098371Z node 12 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:54.098440Z node 12 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-03T16:52:54.098506Z node 12 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-03T16:52:54.098949Z node 12 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:54.098971Z node 12 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:54.099015Z node 12 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-03T16:52:54.099285Z node 11 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2 partition: 0 MaxSeqNo: 0 sessionId: test-message-group-id|575c662f-7f68e55b-64187568-4c120684_0
2025-11-03T16:52:54.100017Z :INFO: [] MessageGroupId [test-message-group-id] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1762188774099 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-11-03T16:52:54.100152Z :INFO: [] MessageGroupId [test-message-group-id] SessionId [] Write session established. Init response: session_id: "test-message-group-id|575c662f-7f68e55b-64187568-4c120684_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-11-03T16:52:54.100403Z :DEBUG: [] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|575c662f-7f68e55b-64187568-4c120684_0] Write 1 messages with Id from 1 to 1
2025-11-03T16:52:54.100470Z :ReadSession INFO: WriteToTopic: message2
2025-11-03T16:52:54.100512Z :DEBUG: [] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|575c662f-7f68e55b-64187568-4c120684_0] Write 1 messages with Id from 2 to 2
2025-11-03T16:52:54.100553Z :INFO: [] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|575c662f-7f68e55b-64187568-4c120684_0] Write session: close. Timeout = 18446744073709551 ms
2025-11-03T16:52:54.101157Z :DEBUG: [] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|575c662f-7f68e55b-64187568-4c120684_0] Write session: try to update token
2025-11-03T16:52:54.101226Z :DEBUG: [] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|575c662f-7f68e55b-64187568-4c120684_0] Send 2 message(s) (0 left), first sequence number is 1
2025-11-03T16:52:54.101855Z node 11 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: test-message-group-id|575c662f-7f68e55b-64187568-4c120684_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:52:54.102135Z node 11 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:52:54.102841Z node 12 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:54.102876Z node 12 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:54.102943Z node 12 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-11-03T16:52:54.103162Z node 11 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:54.103790Z node 12 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:54.103817Z node 12 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:54.104146Z node 12 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0test-message-group-id' SeqNo: 1 partNo : 0 messageNo: 1 size 99 offset: -1
2025-11-03T16:52:54.104174Z node 12 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0test-message-group-id' SeqNo: 2 partNo : 0 messageNo: 1 size 99 offset: -1
2025-11-03T16:52:54.104226Z node 12 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:52:54.104279Z node 12 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:54.104307Z node 12 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:54.104321Z node 12 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (2)
2025-11-03T16:52:54.104425Z node 12 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0test-message-group-id' seqNo 1 partNo 0
2025-11-03T16:52:54.105278Z node 12 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0test-message-group-id' seqNo 1 partNo 0 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 188 count 1 nextOffset 1 batches 1
2025-11-03T16:52:54.105335Z node 12 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0test-message-group-id' seqNo 2 partNo 0
2025-11-03T16:52:54.105371Z node 12 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0test-message-group-id' seqNo 2 partNo 0 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 344 count 2 nextOffset 2 batches 1
2025-11-03T16:52:54.105391Z node 12 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:54.105952Z node 12 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 0,2 HeadOffset 0 endOffset 0 curOffset 2 d0000000000_00000000000000000000_00000_0000000002_00000? size 323 WTime 1762188774104
2025-11-03T16:52:54.106116Z node 12 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-03T16:52:54.106248Z node 12 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 0 partNo 0 count 2 size 323
2025-11-03T16:52:54.115460Z node 12 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 0 count 2 size 323 actorID [12:7568543152064463246:2392]
2025-11-03T16:52:54.115527Z node 12 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-03T16:52:54.115580Z node 12 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 242 WriteNewSizeFromSupportivePartitions# 0
2025-11-03T16:52:54.115613Z node 12 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:52:54.115657Z node 12 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0test-message-group-id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 1, partNo: 0, Offset: 0 is stored on disk
2025-11-03T16:52:54.115679Z node 12 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:52:54.115702Z node 12 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0test-message-group-id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 2, partNo: 0, Offset: 1 is stored on disk
2025-11-03T16:52:54.115886Z node 12 :PERSQUEUE DEBUG: partition_read.cpp:923: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-11-03T16:52:54.115914Z node 12 :PERSQUEUE DEBUG: partition_read.cpp:965: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-11-03T16:52:54.115937Z node 12 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:54.115950Z node 12 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:54.115962Z node 12 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:54.116013Z node 12 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:52:54.116075Z node 12 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1  requestId: <none> cookie: 1
2025-11-03T16:52:54.116190Z node 12 :PERSQUEUE DEBUG: partition_read.cpp:880: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 partno 0 count 1 size 1024000 endOffset 2 max time lag 0ms effective offset 0
2025-11-03T16:52:54.116398Z node 12 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 2 parts 0 suffix '63' size 323
2025-11-03T16:52:54.116424Z node 12 :PERSQUEUE DEBUG: partition_read.cpp:1105: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 323 count 2 last offset 0, current partition end offset: 2
2025-11-03T16:52:54.116443Z node 12 :PERSQUEUE DEBUG: partition_read.cpp:1121: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-11-03T16:52:54.116488Z node 12 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 0 partno 0 count 2 parts_count 0 source 1 size 323 accessed 0 times before, last time 2025-11-03T16:52:54.000000Z
2025-11-03T16:52:54.116533Z node 12 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 3. All 1 blobs are from cache.
2025-11-03T16:52:54.116587Z node 12 :PERSQUEUE DEBUG: partition_read.cpp:572: FormAnswer for 1 blobs
2025-11-03T16:52:54.116643Z node 12 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 2 parts 0 suffix '63'
2025-11-03T16:52:54.116802Z node 12 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 0 totakecount 2 count 2 size 303 from pos 0 cbcount 2
2025-11-03T16:52:54.116880Z node 12 :PERSQUEUE DEBUG: partition_read.cpp:1015: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1762188774104 queuesize 0 startOffset 0
2025-11-03T16:52:54.117000Z node 11 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:54.117990Z :DEBUG: [] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|575c662f-7f68e55b-64187568-4c120684_0] Write session got write response: sequence_numbers: 1 sequence_numbers: 2 offsets: 0 offsets: 1 already_written: false already_written: false write_statistics { persist_duration_ms: 7 }
2025-11-03T16:52:54.118039Z :DEBUG: [] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|575c662f-7f68e55b-64187568-4c120684_0] Write session: acknoledged message 1
2025-11-03T16:52:54.118073Z :DEBUG: [] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|575c662f-7f68e55b-64187568-4c120684_0] Write session: acknoledged message 2
2025-11-03T16:52:54.190180Z node 12 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:54.190218Z node 12 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:54.190235Z node 12 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:54.204087Z :INFO: [] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|575c662f-7f68e55b-64187568-4c120684_0] Write session will now close
2025-11-03T16:52:54.204144Z :DEBUG: [] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|575c662f-7f68e55b-64187568-4c120684_0] Write session: aborting
2025-11-03T16:52:54.204546Z :INFO: [] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|575c662f-7f68e55b-64187568-4c120684_0] Write session: gracefully shut down, all writes complete
2025-11-03T16:52:54.204584Z :DEBUG: [] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|575c662f-7f68e55b-64187568-4c120684_0] Write session: destroy
2025-11-03T16:52:54.216063Z node 11 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: test-message-group-id|575c662f-7f68e55b-64187568-4c120684_0 grpc read done: success: 0 data: 
2025-11-03T16:52:54.216099Z node 11 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 2 sessionId: test-message-group-id|575c662f-7f68e55b-64187568-4c120684_0 grpc read failed
2025-11-03T16:52:54.216140Z node 11 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 2 sessionId: test-message-group-id|575c662f-7f68e55b-64187568-4c120684_0 grpc closed
2025-11-03T16:52:54.216163Z node 11 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2 sessionId: test-message-group-id|575c662f-7f68e55b-64187568-4c120684_0 is DEAD
2025-11-03T16:52:54.216949Z node 11 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-11-03T16:52:54.217405Z node 12 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [11:7568543157526874105:2474] destroyed
2025-11-03T16:52:54.217455Z node 12 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-11-03T16:52:54.217492Z node 12 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:54.217506Z node 12 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:54.217519Z node 12 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:54.225855Z :INFO: [/Root] [/Root] [758fe058-d26ff4cf-a0b9f613-dfe5ba5f] Starting read session
2025-11-03T16:52:54.225887Z :DEBUG: [/Root] [/Root] [758fe058-d26ff4cf-a0b9f613-dfe5ba5f] Starting cluster discovery
2025-11-03T16:52:54.233044Z :DEBUG: [/Root] [/Root] [758fe058-d26ff4cf-a0b9f613-dfe5ba5f] Cluster discovery request succeeded
2025-11-03T16:52:54.233121Z :DEBUG: [/Root] [/Root] [758fe058-d26ff4cf-a0b9f613-dfe5ba5f] Starting session to cluster dc1 (localhost:3534)
2025-11-03T16:52:54.240141Z :DEBUG: [/Root] [/Root] [758fe058-d26ff4cf-a0b9f613-dfe5ba5f] [dc1] In Reconnect, ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:52:54.240191Z :DEBUG: [/Root] [/Root] [758fe058-d26ff4cf-a0b9f613-dfe5ba5f] [dc1] New values: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:52:54.240225Z :DEBUG: [/Root] [/Root] [758fe058-d26ff4cf-a0b9f613-dfe5ba5f] [dc1] Reconnecting session to cluster dc1 in 0.000000s
2025-11-03T16:52:54.249826Z :DEBUG: [/Root] [/Root] [758fe058-d26ff4cf-a0b9f613-dfe5ba5f] [dc1] Successfully connected. Initializing session
2025-11-03T16:52:54.249496Z node 11 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:109: new grpc connection
2025-11-03T16:52:54.249521Z node 11 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:131: new session created cookie 1
2025-11-03T16:52:54.250722Z node 11 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { topic: "test-topic" } read_only_original: true consumer: "shared/user" read_params { max_read_size: 104857600 } } }
2025-11-03T16:52:54.250931Z node 11 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 1 consumer shared/user session shared/user_11_1_2676471346957218810_v1 read init: from# ipv6:[::1]:34398, request# { init_request { topics_read_settings { topic: "test-topic" } read_only_original: true consumer: "shared/user" read_params { max_read_size: 104857600 } } }
2025-11-03T16:52:54.251345Z node 11 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 1 consumer shared/user session shared/user_11_1_2676471346957218810_v1 auth for : user
2025-11-03T16:52:54.251927Z node 11 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 1 consumer shared/user session shared/user_11_1_2676471346957218810_v1 Handle describe topics response
2025-11-03T16:52:54.252045Z node 11 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 1 consumer shared/user session shared/user_11_1_2676471346957218810_v1 auth is DEAD
2025-11-03T16:52:54.252111Z node 11 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 1 consumer shared/user session shared/user_11_1_2676471346957218810_v1 auth ok: topics# 1, initDone# 0
2025-11-03T16:52:54.253149Z node 11 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 1 consumer shared/user session shared/user_11_1_2676471346957218810_v1 register session: topic# rt3.dc1--test-topic
2025-11-03T16:52:54.253874Z :INFO: [/Root] [/Root] [758fe058-d26ff4cf-a0b9f613-dfe5ba5f] [dc1] Server session id: shared/user_11_1_2676471346957218810_v1
2025-11-03T16:52:54.254067Z :DEBUG: [/Root] [/Root] [758fe058-d26ff4cf-a0b9f613-dfe5ba5f] [dc1] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:52:54.254541Z node 11 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_11_1_2676471346957218810_v1 grpc read done: success# 1, data# { read { } }
2025-11-03T16:52:54.254612Z node 11 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_11_1_2676471346957218810_v1 got read request: guid# c3ff63ed-343af352-b8f4152b-b909078b
2025-11-03T16:52:54.254924Z node 11 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1655: [72075186224037893][rt3.dc1--test-topic] pipe [11:7568543157526874135:2490] connected; active server actors: 1
2025-11-03T16:52:54.255049Z node 11 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1706: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [11:7568543157526874135:2490] session shared/user_11_1_2676471346957218810_v1
2025-11-03T16:52:54.255095Z node 11 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:639: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-11-03T16:52:54.255146Z node 11 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:669: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-11-03T16:52:54.255190Z node 11 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:871: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_11_1_2676471346957218810_v1" (Sender=[11:7568543157526874132:2490], Pipe=[11:7568543157526874135:2490], Partitions=[], ActiveFamilyCount=0)
2025-11-03T16:52:54.255221Z node 11 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1186: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-11-03T16:52:54.255277Z node 11 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1258: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-11-03T16:52:54.255332Z node 11 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1305: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_11_1_2676471346957218810_v1" (Sender=[11:7568543157526874132:2490], Pipe=[11:7568543157526874135:2490], Partitions=[], ActiveFamilyCount=0)
2025-11-03T16:52:54.255395Z node 11 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:549: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_11_1_2676471346957218810_v1" sender [11:7568543157526874132:2490] lock partition 0 for ReadingSession "shared/user_11_1_2676471346957218810_v1" (Sender=[11:7568543157526874132:2490], Pipe=[11:7568543157526874135:2490], Partitions=[], ActiveFamilyCount=1) generation 1 step 1
2025-11-03T16:52:54.255475Z node 11 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1325: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-11-03T16:52:54.255507Z node 11 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1402: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000206s
2025-11-03T16:52:54.256411Z node 11 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 1 consumer shared/user session shared/user_11_1_2676471346957218810_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 1 Session: "shared/user_11_1_2676471346957218810_v1" ClientId: "user" PipeClient { RawX1: 7568543157526874135 RawX2: 4503646872013242 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-11-03T16:52:54.256491Z node 11 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 1 consumer shared/user session shared/user_11_1_2676471346957218810_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-11-03T16:52:54.257610Z node 11 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_11_1_2676471346957218810_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 1, pipe: [11:7568543157526874138:2493]
2025-11-03T16:52:54.257462Z node 12 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [11:7568543157526874138:2493], now have 1 active actors on pipe
2025-11-03T16:52:54.257914Z node 12 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:54.257951Z node 12 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:54.258000Z node 12 :PERSQUEUE DEBUG: pq_impl.cpp:1748: [PQ: 72075186224037892] Created session shared/user_11_1_2676471346957218810_v1 on pipe: [11:7568543157526874138:2493]
2025-11-03T16:52:54.258059Z node 12 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:54.258088Z node 12 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:54.258100Z node 12 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-03T16:52:54.258162Z node 12 :PERSQUEUE DEBUG: partition.cpp:3666: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_11_1_2676471346957218810_v1
2025-11-03T16:52:54.258187Z node 12 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:54.258318Z node 12 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-03T16:52:54.258765Z node 12 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_11_1_2676471346957218810_v1:1 with generation 1
2025-11-03T16:52:54.262831Z node 11 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_11_1_2676471346957218810_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 2 WriteTimestampMS: 1762188774104 CreateTimestampMS: 1762188774100 SizeLag: 323 WriteTimestampEstimateMS: 1762188774212 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-11-03T16:52:54.262881Z node 11 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 1 consumer shared/user session shared/user_11_1_2676471346957218810_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 2 readOffset 0 committedOffset 0
2025-11-03T16:52:54.262942Z node 11 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 1 consumer shared/user session shared/user_11_1_2676471346957218810_v1 sending to client partition status
2025-11-03T16:52:54.262161Z node 12 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-03T16:52:54.262235Z node 12 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-11-03T16:52:54.262261Z node 12 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:54.262276Z node 12 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:54.262287Z node 12 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:54.262321Z node 12 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:52:54.262356Z node 12 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-11-03T16:52:54.272092Z :INFO: [/Root] [/Root] [758fe058-d26ff4cf-a0b9f613-dfe5ba5f] [dc1] Confirm partition stream create. Partition stream id: 1. Cluster: "dc1". Topic: "test-topic". Partition: 0. Read offset: (NULL)
create event CreatePartitionStream { PartitionStreamId: 1 TopicPath: test-topic Cluster: dc1 PartitionId: 0 CommittedOffset: 0 EndOffset: 2 }
2025-11-03T16:52:54.273368Z node 11 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_11_1_2676471346957218810_v1 grpc read done: success# 1, data# { start_read { topic { path: "test-topic" } cluster: "dc1" assign_id: 1 } }
2025-11-03T16:52:54.273561Z node 11 :PQ_READ_PROXY INFO: read_session_actor.cpp:539: session cookie 1 consumer shared/user session shared/user_11_1_2676471346957218810_v1 got StartRead from client: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 0, commitOffset# 0
2025-11-03T16:52:54.273621Z node 11 :PQ_READ_PROXY INFO: partition_actor.cpp:1023: session cookie 1 consumer shared/user session shared/user_11_1_2676471346957218810_v1 Start reading TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 2 readOffset 0 committedOffset 0 clientCommitOffset 0 clientReadOffset 0
2025-11-03T16:52:54.273651Z node 11 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_11_1_2676471346957218810_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 0 endOffset 2
2025-11-03T16:52:54.273720Z node 11 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_11_1_2676471346957218810_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 0, endOffset# 2, WTime# 1762188774104, sizeLag# 323
2025-11-03T16:52:54.273739Z node 11 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_11_1_2676471346957218810_v1TEvPartitionReady. Aval parts: 1
2025-11-03T16:52:54.273786Z node 11 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_11_1_2676471346957218810_v1 performing read request: guid# c3ff63ed-343af352-b8f4152b-b909078b, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 2, size# 387, partitionsAsked# 1, maxTimeLag# 0ms
2025-11-03T16:52:54.273871Z node 11 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_11_1_2676471346957218810_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 2 maxSize 387 maxTimeLagMs 0 readTimestampMs 0 readOffset 0 EndOffset 2 ClientCommitOffset 0 committedOffset 0 Guid c3ff63ed-343af352-b8f4152b-b909078b
2025-11-03T16:52:54.277897Z node 12 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:54.277943Z node 12 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:54.278064Z node 12 :PERSQUEUE DEBUG: partition_read.cpp:880: [72075186224037892][Partition][0][StateIdle] read cookie 4 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 partno 0 count 2 size 387 endOffset 2 max time lag 0ms effective offset 0
2025-11-03T16:52:54.278305Z node 12 :PERSQUEUE DEBUG: partition_read.cpp:1105: [72075186224037892][Partition][0][StateIdle] read cookie 4 added 1 blobs, size 323 count 2 last offset 0, current partition end offset: 2
2025-11-03T16:52:54.278325Z node 12 :PERSQUEUE DEBUG: partition_read.cpp:1121: [72075186224037892][Partition][0][StateIdle] Reading cookie 4. Send blob request.
2025-11-03T16:52:54.278371Z node 12 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 0 partno 0 count 2 parts_count 0 source 1 size 323 accessed 1 times before, last time 2025-11-03T16:52:54.000000Z
2025-11-03T16:52:54.278416Z node 12 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 4. All 1 blobs are from cache.
2025-11-03T16:52:54.278470Z node 12 :PERSQUEUE DEBUG: partition_read.cpp:572: FormAnswer for 1 blobs
2025-11-03T16:52:54.278525Z node 12 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 2 parts 0 suffix '63'
2025-11-03T16:52:54.278681Z node 12 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 0 totakecount 2 count 2 size 303 from pos 0 cbcount 2
2025-11-03T16:52:54.278793Z node 12 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-03T16:52:54.279439Z node 11 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_11_1_2676471346957218810_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 2 Result { Offset: 0 Data: "... 99 bytes ..." SourceId: "\000test-message-group-id" SeqNo: 1 WriteTimestampMS: 1762188774104 CreateTimestampMS: 1762188774100 UncompressedSize: 8 PartitionKey: "" ExplicitHash: "" } Result { Offset: 1 Data: "... 99 bytes ..." SourceId: "\000test-message-group-id" SeqNo: 2 WriteTimestampMS: 1762188774104 CreateTimestampMS: 1762188774100 UncompressedSize: 8 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 11 RealReadOffset: 1 WaitQuotaTimeMs: 0 EndOffset: 2 StartOffset: 0 } Cookie: 0 }
2025-11-03T16:52:54.279604Z node 11 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_11_1_2676471346957218810_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 1 from offset 2
2025-11-03T16:52:54.279648Z node 11 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_11_1_2676471346957218810_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 2 ReadOffset 2 ReadGuid c3ff63ed-343af352-b8f4152b-b909078b has messages 1
2025-11-03T16:52:54.279757Z node 11 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_11_1_2676471346957218810_v1 read done: guid# c3ff63ed-343af352-b8f4152b-b909078b, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 265
2025-11-03T16:52:54.279782Z node 11 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_11_1_2676471346957218810_v1 response to read: guid# c3ff63ed-343af352-b8f4152b-b909078b
2025-11-03T16:52:54.280048Z node 11 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_11_1_2676471346957218810_v1 Process answer. Aval parts: 0
2025-11-03T16:52:54.281523Z :DEBUG: [/Root] [/Root] [758fe058-d26ff4cf-a0b9f613-dfe5ba5f] [dc1] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:52:54.281804Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 0 (0-1)
2025-11-03T16:52:54.282086Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (0-0)
2025-11-03T16:52:54.282128Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 1} (1-1)
2025-11-03T16:52:54.282167Z :DEBUG: [/Root] [/Root] [758fe058-d26ff4cf-a0b9f613-dfe5ba5f] [dc1] The application data is transferred to the client. Number of messages 2, size 16 bytes
data event DataReceived { PartitionStreamId: 1 PartitionId: 0 Message { Data: ..8 bytes.. Partition stream id: 1 Cluster: "dc1". Topic: "test-topic" Partition: 0 PartitionKey: "" Information: { Offset: 0 SeqNo: 1 MessageGroupId: "test-message-group-id" CreateTime: 2025-11-03T16:52:54.100000Z WriteTime: 2025-11-03T16:52:54.104000Z Ip: "ipv6:[::1]:34364" UncompressedSize: 8 Meta: { "logtype": "unknown", "ident": "unknown", "server": "ipv6:[::1]:34364" } } } Message { Data: ..8 bytes.. Partition stream id: 1 Cluster: "dc1". Topic: "test-topic" Partition: 0 PartitionKey: "" Information: { Offset: 1 SeqNo: 2 MessageGroupId: "test-message-group-id" CreateTime: 2025-11-03T16:52:54.100000Z WriteTime: 2025-11-03T16:52:54.104000Z Ip: "ipv6:[::1]:34364" UncompressedSize: 8 Meta: { "logtype": "unknown", "ident": "unknown", "server": "ipv6:[::1]:34364" } } } }
2025-11-03T16:52:54.282052Z node 11 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_11_1_2676471346957218810_v1 grpc read done: success# 1, data# { read { } }
2025-11-03T16:52:54.282193Z node 11 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_11_1_2676471346957218810_v1 got read request: guid# c0869dac-40a7da6a-ae2ae420-46802d78
2025-11-03T16:52:54.290577Z node 12 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:54.290605Z node 12 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:54.290620Z node 12 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:54.296261Z :DEBUG: [] MessageGroupId [test-message-group-id] SessionId [] Write session: try to update token
2025-11-03T16:52:54.296640Z :INFO: [] MessageGroupId [test-message-group-id] SessionId [] Write session: Do CDS request
2025-11-03T16:52:54.296671Z :INFO: [] MessageGroupId [test-message-group-id] SessionId [] Start write session. Will connect to endpoint: localhost:3534
2025-11-03T16:52:54.304942Z :ReadSession INFO: WriteToTopic: message3
2025-11-03T16:52:54.316202Z :DEBUG: [] MessageGroupId [test-message-group-id] SessionId [] Write session: send init request: init_request { topic: "test-topic" message_group_id: "test-message-group-id" }
2025-11-03T16:52:54.314956Z node 11 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-11-03T16:52:54.314985Z node 11 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3
2025-11-03T16:52:54.317124Z node 11 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "test-message-group-id" }
2025-11-03T16:52:54.317265Z node 11 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3 topic: "test-topic" message_group_id: "test-message-group-id" from ipv6:[::1]:34416
2025-11-03T16:52:54.317282Z node 11 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:34416 proto=v1  topic=test-topic durationSec=0
2025-11-03T16:52:54.317294Z node 11 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-11-03T16:52:54.319115Z node 11 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3 sessionId:  describe result for acl check
2025-11-03T16:52:54.319235Z node 11 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-11-03T16:52:54.319282Z node 11 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-11-03T16:52:54.319296Z node 11 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-11-03T16:52:54.319315Z node 11 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [11:7568543157526874152:2497] (SourceId=test-message-group-id, PreferedPartition=(NULL)) StartKqpSession
2025-11-03T16:52:54.323008Z node 11 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [11:7568543157526874152:2497] (SourceId=test-message-group-id, PreferedPartition=(NULL)) Select from the table
2025-11-03T16:52:54.340207Z node 11 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [11:7568543157526874152:2497] (SourceId=test-message-group-id, PreferedPartition=(NULL)) Update the table
2025-11-03T16:52:54.353697Z node 11 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [11:7568543157526874152:2497] (SourceId=test-message-group-id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-11-03T16:52:54.353738Z node 11 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [11:7568543157526874152:2497] (SourceId=test-message-group-id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-11-03T16:52:54.353870Z node 11 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [11:7568543157526874152:2497] (SourceId=test-message-group-id, PreferedPartition=(NULL)) Start idle
2025-11-03T16:52:54.353901Z node 11 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-11-03T16:52:54.356241Z node 11 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 12, Generation: 1
2025-11-03T16:52:54.356012Z node 12 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [11:7568543157526874185:2497], now have 1 active actors on pipe
2025-11-03T16:52:54.356490Z node 12 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:54.356517Z node 12 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:54.356600Z node 12 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie test-message-group-id|6d757bd-691eaca5-a0a20abb-f27972f6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner test-message-group-id
2025-11-03T16:52:54.356630Z node 12 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:54.356651Z node 12 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:54.356665Z node 12 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-03T16:52:54.356710Z node 12 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:54.356758Z node 12 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-03T16:52:54.356816Z node 12 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-03T16:52:54.357370Z node 12 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:54.357392Z node 12 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:54.357737Z node 11 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3 partition: 0 MaxSeqNo: 2 sessionId: test-message-group-id|6d757bd-691eaca5-a0a20abb-f27972f6_0
2025-11-03T16:52:54.357455Z node 12 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-03T16:52:54.360177Z :INFO: [] MessageGroupId [test-message-group-id] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1762188774360 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-11-03T16:52:54.360319Z :INFO: [] MessageGroupId [test-message-group-id] SessionId [] Write session established. Init response: last_sequence_number: 2 session_id: "test-message-group-id|6d757bd-691eaca5-a0a20abb-f27972f6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-11-03T16:52:54.364068Z :DEBUG: [] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|6d757bd-691eaca5-a0a20abb-f27972f6_0] Write 1 messages with Id from 1 to 1
2025-11-03T16:52:54.364151Z :INFO: [] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|6d757bd-691eaca5-a0a20abb-f27972f6_0] Write session: close. Timeout = 18446744073709551 ms
2025-11-03T16:52:54.368430Z :DEBUG: [] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|6d757bd-691eaca5-a0a20abb-f27972f6_0] Write session: try to update token
2025-11-03T16:52:54.368489Z :DEBUG: [] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|6d757bd-691eaca5-a0a20abb-f27972f6_0] Send 1 message(s) (0 left), first sequence number is 3
2025-11-03T16:52:54.369247Z node 11 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3 sessionId: test-message-group-id|6d757bd-691eaca5-a0a20abb-f27972f6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:52:54.369516Z node 11 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:52:54.369972Z node 12 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:54.370017Z node 12 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:54.370091Z node 12 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-11-03T16:52:54.375361Z node 11 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:54.375994Z node 12 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:54.376031Z node 12 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:54.376087Z node 12 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0test-message-group-id' SeqNo: 3 partNo : 0 messageNo: 1 size 99 offset: -1
2025-11-03T16:52:54.376131Z node 12 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:52:54.376174Z node 12 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:54.376201Z node 12 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:54.376216Z node 12 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-03T16:52:54.376319Z node 12 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0test-message-group-id' seqNo 3 partNo 0
2025-11-03T16:52:54.377607Z node 12 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0test-message-group-id' seqNo 3 partNo 0 FormedBlobsCount 0 NewHead: Offset 2 PartNo 0 PackedSize 188 count 1 nextOffset 3 batches 1
2025-11-03T16:52:54.377651Z node 12 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:54.378280Z node 12 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 2,1 HeadOffset 2 endOffset 2 curOffset 3 d0000000000_00000000000000000002_00000_0000000001_00000? size 176 WTime 1762188774376
2025-11-03T16:52:54.378457Z node 12 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-03T16:52:54.378585Z node 12 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 2 partNo 0 count 1 size 176
2025-11-03T16:52:54.386553Z node 12 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 2 count 1 size 176 actorID [12:7568543152064463246:2392]
2025-11-03T16:52:54.386629Z node 12 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-03T16:52:54.386679Z node 12 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 121 WriteNewSizeFromSupportivePartitions# 0
2025-11-03T16:52:54.386706Z node 12 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:52:54.386720Z node 12 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 2 partno 0 count 1 parts 0 suffix '63' size 176
2025-11-03T16:52:54.386750Z node 12 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0test-message-group-id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 3, partNo: 0, Offset: 2 is stored on disk
2025-11-03T16:52:54.386950Z node 12 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:54.386961Z node 12 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:54.386970Z node 12 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:54.386994Z node 12 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:52:54.387027Z node 12 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1  requestId: <none> cookie: 1
2025-11-03T16:52:54.387170Z node 11 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 1 consumer shared/user session shared/user_11_1_2676471346957218810_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 2 EndOffset 2 newEndOffset 3 commitOffset 0 clientCommitOffset 0 cookie 1 readingFinished 0 firstRead 0
2025-11-03T16:52:54.387207Z node 11 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_11_1_2676471346957218810_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 2 endOffset 3
2025-11-03T16:52:54.387264Z node 11 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_11_1_2676471346957218810_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 2, endOffset# 3, WTime# 1762188774104, sizeLag# 176
2025-11-03T16:52:54.387295Z node 11 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_11_1_2676471346957218810_v1TEvPartitionReady. Aval parts: 1
2025-11-03T16:52:54.387353Z node 11 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_11_1_2676471346957218810_v1 performing read request: guid# c0869dac-40a7da6a-ae2ae420-46802d78, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 1, size# 211, partitionsAsked# 1, maxTimeLag# 0ms
2025-11-03T16:52:54.387427Z node 11 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_11_1_2676471346957218810_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 1 maxSize 211 maxTimeLagMs 0 readTimestampMs 0 readOffset 2 EndOffset 3 ClientCommitOffset 0 committedOffset 0 Guid c0869dac-40a7da6a-ae2ae420-46802d78
2025-11-03T16:52:54.388313Z node 11 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:54.389112Z node 12 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:54.389154Z node 12 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:54.391122Z node 11 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_11_1_2676471346957218810_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 3 Result { Offset: 2 Data: "... 99 bytes ..." SourceId: "\000test-message-group-id" SeqNo: 3 WriteTimestampMS: 1762188774376 CreateTimestampMS: 1762188774364 UncompressedSize: 8 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 20 RealReadOffset: 2 WaitQuotaTimeMs: 0 EndOffset: 3 StartOffset: 0 } Cookie: 2 }
2025-11-03T16:52:54.391279Z node 11 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_11_1_2676471346957218810_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 2 from offset 3
2025-11-03T16:52:54.391324Z node 11 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_11_1_2676471346957218810_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 3 ReadOffset 3 ReadGuid c0869dac-40a7da6a-ae2ae420-46802d78 has messages 1
2025-11-03T16:52:54.391446Z node 11 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_11_1_2676471346957218810_v1 read done: guid# c0869dac-40a7da6a-ae2ae420-46802d78, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 220
2025-11-03T16:52:54.391478Z node 11 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_11_1_2676471346957218810_v1 response to read: guid# c0869dac-40a7da6a-ae2ae420-46802d78
2025-11-03T16:52:54.391732Z node 11 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_11_1_2676471346957218810_v1 Process answer. Aval parts: 0
2025-11-03T16:52:54.389464Z node 12 :PERSQUEUE DEBUG: partition_read.cpp:880: [72075186224037892][Partition][0][StateIdle] read cookie 5 Topic 'rt3.dc1--test-topic' partition 0 user user offset 2 partno 0 count 1 size 211 endOffset 3 max time lag 0ms effective offset 2
2025-11-03T16:52:54.392384Z :DEBUG: [] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|6d757bd-691eaca5-a0a20abb-f27972f6_0] Write session got write response: sequence_numbers: 3 offsets: 2 already_written: false write_statistics { persist_duration_ms: 9 }
2025-11-03T16:52:54.389751Z node 12 :PERSQUEUE DEBUG: partition_read.cpp:1105: [72075186224037892][Partition][0][StateIdle] read cookie 5 added 1 blobs, size 176 count 1 last offset 2, current partition end offset: 3
2025-11-03T16:52:54.389772Z node 12 :PERSQUEUE DEBUG: partition_read.cpp:1121: [72075186224037892][Partition][0][StateIdle] Reading cookie 5. Send blob request.
2025-11-03T16:52:54.392430Z :DEBUG: [] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|6d757bd-691eaca5-a0a20abb-f27972f6_0] Write session: acknoledged message 1
2025-11-03T16:52:54.389827Z node 12 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 2 partno 0 count 1 parts_count 0 source 1 size 176 accessed 0 times before, last time 2025-11-03T16:52:54.000000Z
2025-11-03T16:52:54.389881Z node 12 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 5. All 1 blobs are from cache.
2025-11-03T16:52:54.389929Z node 12 :PERSQUEUE DEBUG: partition_read.cpp:572: FormAnswer for 1 blobs
2025-11-03T16:52:54.390096Z node 12 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 2 totakecount 1 count 1 size 156 from pos 0 cbcount 1
2025-11-03T16:52:54.390214Z node 12 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 2
2025-11-03T16:52:54.390631Z node 12 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 2 partno 0 count 1 parts 0 suffix '63'
2025-11-03T16:52:54.392771Z node 12 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:54.392793Z node 12 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:54.392810Z node 12 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:54.396541Z :DEBUG: [/Root] [/Root] [758fe058-d26ff4cf-a0b9f613-dfe5ba5f] [dc1] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:52:54.398288Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 0 (2-2)
2025-11-03T16:52:54.403576Z node 11 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_11_1_2676471346957218810_v1 grpc read done: success# 1, data# { read { } }
2025-11-03T16:52:54.403779Z node 11 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_11_1_2676471346957218810_v1 got read request: guid# 842d5c03-ae9dbb37-7ff9bac0-d3f52c08
2025-11-03T16:52:54.465214Z :INFO: [] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|6d757bd-691eaca5-a0a20abb-f27972f6_0] Write session will now close
2025-11-03T16:52:54.465266Z :DEBUG: [] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|6d757bd-691eaca5-a0a20abb-f27972f6_0] Write session: aborting
2025-11-03T16:52:54.465657Z :INFO: [] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|6d757bd-691eaca5-a0a20abb-f27972f6_0] Write session: gracefully shut down, all writes complete
2025-11-03T16:52:54.465689Z :DEBUG: [] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|6d757bd-691eaca5-a0a20abb-f27972f6_0] Write session: destroy
2025-11-03T16:52:54.469132Z node 11 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3 sessionId: test-message-group-id|6d757bd-691eaca5-a0a20abb-f27972f6_0 grpc read done: success: 0 data: 
2025-11-03T16:52:54.469167Z node 11 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 3 sessionId: test-message-group-id|6d757bd-691eaca5-a0a20abb-f27972f6_0 grpc read failed
2025-11-03T16:52:54.469208Z node 11 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 3 sessionId: test-message-group-id|6d757bd-691eaca5-a0a20abb-f27972f6_0 grpc closed
2025-11-03T16:52:54.469228Z node 11 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3 sessionId: test-message-group-id|6d757bd-691eaca5-a0a20abb-f27972f6_0 is DEAD
2025-11-03T16:52:54.470087Z node 11 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-11-03T16:52:54.470527Z node 12 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [11:7568543157526874185:2497] destroyed
2025-11-03T16:52:54.470574Z node 12 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-11-03T16:52:54.470607Z node 12 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:54.470622Z node 12 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:54.470637Z node 12 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:54.476130Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (2-2)
2025-11-03T16:52:54.476190Z :DEBUG: [/Root] [/Root] [758fe058-d26ff4cf-a0b9f613-dfe5ba5f] [dc1] The application data is transferred to the client. Number of messages 1, size 8 bytes
data event DataReceived { PartitionStreamId: 1 PartitionId: 0 Message { Data: ..8 bytes.. Partition stream id: 1 Cluster: "dc1". Topic: "test-topic" Partition: 0 PartitionKey: "" Information: { Offset: 2 SeqNo: 3 MessageGroupId: "test-message-group-id" CreateTime: 2025-11-03T16:52:54.364000Z WriteTime: 2025-11-03T16:52:54.376000Z Ip: "ipv6:[::1]:34416" UncompressedSize: 8 Meta: { "logtype": "unknown", "ident": "unknown", "server": "ipv6:[::1]:34416" } } } }
2025-11-03T16:52:54.476330Z :DEBUG: [/Root] [/Root] [758fe058-d26ff4cf-a0b9f613-dfe5ba5f] [dc1] Commit offsets [2, 3). Partition stream id: 1
2025-11-03T16:52:54.484069Z :DEBUG: [/Root] [/Root] [758fe058-d26ff4cf-a0b9f613-dfe5ba5f] [dc1] Commit offsets [0, 2). Partition stream id: 1
2025-11-03T16:52:54.485862Z node 11 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_11_1_2676471346957218810_v1 grpc read done: success# 1, data# { commit { cookies { assign_id: 1 partition_cookie: 2 } } }
2025-11-03T16:52:54.486049Z node 11 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1449: session cookie 1 consumer shared/user session shared/user_11_1_2676471346957218810_v1 commit request from client for 2 in TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-11-03T16:52:54.486099Z node 11 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_11_1_2676471346957218810_v1 grpc read done: success# 1, data# { commit { cookies { assign_id: 1 partition_cookie: 1 } } }
2025-11-03T16:52:54.486215Z node 11 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1449: session cookie 1 consumer shared/user session shared/user_11_1_2676471346957218810_v1 commit request from client for 1 in TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-11-03T16:52:54.486240Z node 11 :PQ_READ_PROXY DEBUG: partition_actor.cpp:129: session cookie 1 consumer shared/user session shared/user_11_1_2676471346957218810_v1 commit request from 1 to 2 in TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-11-03T16:52:54.486285Z node 11 :PQ_READ_PROXY DEBUG: partition_actor.cpp:203: session cookie 1 consumer shared/user session shared/user_11_1_2676471346957218810_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) committing to position 3 prev 0 end 3 by cookie 2
2025-11-03T16:52:54.486726Z node 12 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:54.486768Z node 12 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:54.486823Z node 12 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:54.486845Z node 12 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:54.486858Z node 12 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-03T16:52:54.486916Z node 12 :PERSQUEUE DEBUG: partition.cpp:3666: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user offset is set to 3 (startOffset 0) session shared/user_11_1_2676471346957218810_v1
2025-11-03T16:52:54.486935Z node 12 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:54.487073Z node 12 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-03T16:52:54.488088Z :INFO: [/Root] [/Root] [758fe058-d26ff4cf-a0b9f613-dfe5ba5f] Closing read session. Close timeout: 30.000000s
2025-11-03T16:52:54.488156Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): dc1:test-topic:0:1:2:0
2025-11-03T16:52:54.488218Z :INFO: [/Root] [/Root] [758fe058-d26ff4cf-a0b9f613-dfe5ba5f] Counters: { Errors: 0 CurrentSessionLifetimeMs: 262 BytesRead: 24 MessagesRead: 3 BytesReadCompressed: 84 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-11-03T16:52:54.488729Z :NOTICE: [/Root] [/Root] [758fe058-d26ff4cf-a0b9f613-dfe5ba5f] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
commit ack or close event SessionClosed { Status: SUCCESS Issues: "<main>: Error: Session was gracefully closed " }
2025-11-03T16:52:54.488817Z :INFO: [/Root] [/Root] [758fe058-d26ff4cf-a0b9f613-dfe5ba5f] Closing read session. Close timeout: 0.000000s
2025-11-03T16:52:54.488849Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): dc1:test-topic:0:1:2:0
2025-11-03T16:52:54.488879Z :INFO: [/Root] [/Root] [758fe058-d26ff4cf-a0b9f613-dfe5ba5f] Counters: { Errors: 0 CurrentSessionLifetimeMs: 263 BytesRead: 24 MessagesRead: 3 BytesReadCompressed: 84 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-11-03T16:52:54.488933Z :NOTICE: [/Root] [/Root] [758fe058-d26ff4cf-a0b9f613-dfe5ba5f] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
2025-11-03T16:52:54.491737Z node 12 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:52:54.497196Z node 12 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-03T16:52:54.497253Z node 12 :PERSQUEUE DEBUG: partition_read.cpp:923: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 3 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-11-03T16:52:54.497302Z node 12 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-11-03T16:52:54.497331Z node 12 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:54.497347Z node 12 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:54.497779Z node 11 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_11_1_2676471346957218810_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { Cookie: 2 }
2025-11-03T16:52:54.497361Z node 12 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:54.497393Z node 12 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:52:54.497843Z node 11 :PQ_READ_PROXY DEBUG: partition_actor.cpp:961: session cookie 1 consumer shared/user session shared/user_11_1_2676471346957218810_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) commit done to position 3 endOffset 3 with cookie 2
2025-11-03T16:52:54.497882Z node 11 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:707: session cookie 1 consumer shared/user session shared/user_11_1_2676471346957218810_v1 replying for commits: assignId# 1, from# 1, to# 2, offset# 3
2025-11-03T16:52:54.502781Z node 11 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_11_1_2676471346957218810_v1 grpc read done: success# 0, data# {  }
2025-11-03T16:52:54.502799Z node 11 :PQ_READ_PROXY INFO: read_session_actor.cpp:125: session cookie 1 consumer shared/user session shared/user_11_1_2676471346957218810_v1 grpc read failed
2025-11-03T16:52:54.502836Z node 11 :PQ_READ_PROXY INFO: read_session_actor.cpp:92: session cookie 1 consumer shared/user session shared/user_11_1_2676471346957218810_v1 grpc closed
2025-11-03T16:52:54.502875Z node 11 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 1 consumer shared/user session shared/user_11_1_2676471346957218810_v1 is DEAD
2025-11-03T16:52:54.504148Z node 11 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1659: [72075186224037893][rt3.dc1--test-topic] pipe [11:7568543157526874135:2490] disconnected.
2025-11-03T16:52:54.504175Z node 11 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1670: [72075186224037893][rt3.dc1--test-topic] pipe [11:7568543157526874135:2490] disconnected; active server actors: 1
2025-11-03T16:52:54.504195Z node 11 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1679: [72075186224037893][rt3.dc1--test-topic] pipe [11:7568543157526874135:2490] client user disconnected session shared/user_11_1_2676471346957218810_v1
2025-11-03T16:52:54.497422Z node 12 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 2
2025-11-03T16:52:54.504549Z node 12 :PERSQUEUE DEBUG: pq_impl.cpp:2258: [PQ: 72075186224037892] Destroy direct read session shared/user_11_1_2676471346957218810_v1
2025-11-03T16:52:54.504595Z node 12 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [11:7568543157526874138:2493] destroyed
2025-11-03T16:52:54.504653Z node 12 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_11_1_2676471346957218810_v1
2025-11-03T16:52:54.592251Z node 12 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:54.592298Z node 12 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:54.592315Z node 12 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:54.693599Z node 12 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:54.693634Z node 12 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:54.693650Z node 12 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:54.800109Z node 12 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:54.800150Z node 12 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:54.800167Z node 12 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:54.899305Z node 12 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:54.899350Z node 12 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:54.899367Z node 12 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:55.122158Z node 11 :FLAT_TX_SCHEMESHARD WARN: schemeshard_impl.cpp:7727: Cannot get console configs
2025-11-03T16:52:55.122195Z node 11 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
2025-11-03T16:52:57.470346Z :ReadSession INFO: Random seed for debugging is 1762188777470323
2025-11-03T16:52:58.173110Z node 14 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[14:7568543171103953928:2075];send_to=[0:7307199536658146131:7762515];
test_client.cpp: SetPath # /home/runner/.ya/build/build_root/7jz3/001998/r3tmp/tmpz67J6R/pdisk_1.dat
2025-11-03T16:52:58.251544Z node 13 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-11-03T16:52:58.297163Z node 14 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-11-03T16:52:58.297650Z node 14 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
2025-11-03T16:52:58.303089Z node 14 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-11-03T16:52:58.301455Z node 13 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-11-03T16:52:58.301638Z node 13 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=incorrect path status: LookupError;
2025-11-03T16:52:58.477144Z node 14 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-11-03T16:52:58.490343Z node 13 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-11-03T16:52:58.521097Z node 13 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
2025-11-03T16:52:58.577051Z node 13 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(13, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-11-03T16:52:58.577173Z node 13 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(13, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-11-03T16:52:58.581051Z node 13 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(14, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-11-03T16:52:58.581165Z node 13 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(14, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-11-03T16:52:58.580076Z node 14 :CONFIGS_DISPATCHER ERROR: configs_dispatcher.cpp:1229: Notification cookie mismatch for subscription [14:7568543171103953888:2073] 1762188778145772 != 1762188778145769
2025-11-03T16:52:58.587543Z node 13 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(13, (0,0,0,0)) VolatileState: Connecting -> Connected
2025-11-03T16:52:58.598318Z node 13 :HIVE WARN: hive_impl.cpp:811: HIVE#72057594037968897 Handle TEvInterconnect::TEvNodeConnected, NodeId 14 Cookie 14
2025-11-03T16:52:58.603896Z node 13 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(14, (0,0,0,0)) VolatileState: Connecting -> Connected
TServer::EnableGrpc on GrpcPort 24214, node 13
2025-11-03T16:52:58.821440Z node 13 :NET_CLASSIFIER WARN: net_classifier.cpp:190: distributable config is empty, broken or outdated, will use file: /home/runner/.ya/build/build_root/7jz3/001998/r3tmp/yandex2Xa2DT.tmp
2025-11-03T16:52:58.821485Z node 13 :NET_CLASSIFIER WARN: net_classifier.cpp:196: will try to initialize from file: /home/runner/.ya/build/build_root/7jz3/001998/r3tmp/yandex2Xa2DT.tmp
2025-11-03T16:52:58.821689Z node 13 :NET_CLASSIFIER WARN: net_classifier.cpp:202: successfully initialized from file: /home/runner/.ya/build/build_root/7jz3/001998/r3tmp/yandex2Xa2DT.tmp
2025-11-03T16:52:58.821922Z node 13 :NET_CLASSIFIER ERROR: net_classifier.cpp:228: got bad distributable configuration
2025-11-03T16:52:58.854365Z INFO: TTestServer started on Port 15130 GrpcPort 24214
2025-11-03T16:52:58.871182Z node 13 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-11-03T16:52:59.018607Z node 14 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
TClient is connected to server localhost:15130
PQClient connected to localhost:24214
WaitRootIsUp 'Root'...
TClient::Ls request: Root
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "Root"
    PathId: 1
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 1
    CreateStep: 0
    ParentPathId: 1
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 1
      SubDomainVersion: 0
      SecurityStateVersion: 0
    }
    ChildrenExist: false
  }
  Children {
    Name: ".sys"
    PathId: 18446744073709551615
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 0
    CreateStep: 0
    ParentPathId: 18446744073709551615
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 0
      Pl...
(TRUNCATED)
WaitRootIsUp 'Root' success.
2025-11-03T16:52:59.066992Z node 13 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpAlterSubDomain, opId: 281474976710657:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_alter_subdomain.cpp:311)
waiting...
waiting...
2025-11-03T16:52:59.151607Z node 13 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
waiting...
waiting...
2025-11-03T16:52:59.268277Z node 14 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-11-03T16:53:03.149809Z node 14 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[14:7568543171103953928:2075];send_to=[0:7307199536658146131:7762515];
2025-11-03T16:53:03.149905Z node 14 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
2025-11-03T16:53:04.438906Z node 14 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [14:7568543196873758031:2303], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-03T16:53:04.438993Z node 14 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [14:7568543196873758063:2306], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-03T16:53:04.439119Z node 14 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-03T16:53:04.464498Z node 13 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateResourcePool, opId: 281474976720657:3, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_resource_pool.cpp:179)
2025-11-03T16:53:04.509978Z node 14 :KQP_WORKLOAD_SERVICE WARN: helpers.h:73: [WorkloadService] [TPoolCreatorActor] ActorId: [14:7568543196873758068:2307], DatabaseId: /Root, PoolId: default, Scheduled retry for error: { <main>: Error: Transaction 281474976720657 completed, doublechecking }
2025-11-03T16:53:04.541340Z node 13 :KQP_PROXY ERROR: kqp_proxy_service.cpp:1316: TraceId: "01k95a5qra9bcqn5e2q3rym7zg", Request deadline has expired for 0.278314s seconds
2025-11-03T16:53:04.588065Z node 14 :TX_PROXY ERROR: schemereq.cpp:593: Actor# [14:7568543196873758107:2148] txid# 281474976720658, issues: { message: "Check failed: path: \'/Root/.metadata/workload_manager/pools/default\', error: path exist, request accepts it (id: [OwnerId: 72057594046644480, LocalPathId: 8], type: EPathTypeResourcePool, state: EPathStateNoChanges)" severity: 1 }
2025-11-03T16:53:04.592764Z node 13 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:570: Compilation failed, self: [13:7568543197838213482:2339], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-11-03T16:53:04.598873Z node 13 :KQP_SESSION WARN: kqp_session_actor.cpp:2506: SessionId: ydb://session/3?node_id=13&id=ZTdkNDU5NzQtZmFjYWNlMDMtMzg3MjllLTc0NmZmMDZi, ActorId: [13:7568543197838213431:2330], ActorState: ExecuteState, TraceId: 01k95a5wwxd5xtjzyp6h6hamh0, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-11-03T16:53:04.599418Z node 13 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-11-03T16:53:04.638436Z node 14 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:570: Compilation failed, self: [14:7568543196873758113:2312], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-11-03T16:53:04.640204Z node 14 :KQP_SESSION WARN: kqp_session_actor.cpp:2506: SessionId: ydb://session/3?node_id=14&id=ZDc3YjVmNWUtODNiMjk3ZjktM2M3OGMxYmYtNzEzNmQ3Mzg=, ActorId: [14:7568543196873758027:2300], ActorState: ExecuteState, TraceId: 01k95a5wsab8cdd5jd7jp4sd92, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-11-03T16:53:04.640739Z node 14 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-11-03T16:53:04.670802Z node 13 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710661:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:690)
2025-11-03T16:53:04.830885Z node 13 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710662:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:690)
2025-11-03T16:53:05.071448Z node 13 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710663:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:690)
=== Init DC: UPSERT INTO `/Root/PQ/Config/V2/Cluster` (name, balancer, local, enabled, weight) VALUES ("dc1", "localhost:24214", true, true, 1000);
2025-11-03T16:53:05.450004Z node 13 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976710664. Ctx: { TraceId: 01k95a5xkcafy8h71gjy92h0gd, Database: , SessionId: ydb://session/3?node_id=13&id=ZGY5ZjgzZDEtZjAzMzFmM2MtZjBhOGFkMjItNjA0YTBlOA==, PoolId: default, DatabaseId: /Root}. Database not set, use /Root
=== CheckClustersList. Subcribe to ClusterTracker from [13:7568543202133181185:2993] 
=== CheckClustersList. Ok
2025-11-03T16:53:11.199923Z node 13 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710669:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:690)
waiting...
PQ Client: create topic: rt3.dc1--test-topic with 1 partitions
CallPersQueueGRPC request to localhost:24214
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-11-03T16:53:11.410713Z node 13 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
CallPersQueueGRPC request to localhost:24214
MetaRequest {
  CmdCreateTopic {
    Topic: "rt3.dc1--test-topic"
    NumPartitions: 1
    Config {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
  }
}
CallPersQueueGRPC response:
Status: 129
ProxyErrorCode: 53
SchemeStatus: 1
FlatTxId {
  TxId: 281474976710670
  SchemeShardTabletId: 72057594046644480
  PathId: 13
}
ErrorCode: OK
AddTopic: rt3.dc1--test-topic
===Run query:``DECLARE $version as Int64; DECLARE $path AS Utf8; DECLARE $cluster as Utf8; UPSERT INTO `/Root/PQ/Config/V2/Topics` (path, dc) VALUES ($path, $cluster); UPSERT INTO `/Root/PQ/Config/V2/Versions` (name, version) VALUES ("Topics", $version);`` with topic = test-topic, dc = dc1
2025-11-03T16:53:11.492825Z node 13 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1655: [72075186224037893][] pipe [13:7568543227902985357:3249] connected; active server actors: 1
2025-11-03T16:53:11.493136Z node 13 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1519: [72075186224037893][rt3.dc1--test-topic] updating configuration. Deleted partitions []. Added partitions [0]
2025-11-03T16:53:11.494549Z node 13 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:971: [72075186224037893][rt3.dc1--test-topic] Discovered subdomain [OwnerId: 72057594046644480, LocalPathId: 1] state, outOfSpace = 0 at RB 72075186224037893
2025-11-03T16:53:11.505603Z node 13 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:140: [72075186224037893][rt3.dc1--test-topic] BALANCER INIT DONE for rt3.dc1--test-topic: (0, 72075186224037892) 
2025-11-03T16:53:11.510616Z node 14 :PERSQUEUE DEBUG: pq_impl.cpp:2960: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-11-03T16:53:11.519580Z node 14 :PERSQUEUE DEBUG: pq_impl.cpp:2992: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-11-03T16:53:11.519919Z node 14 :PERSQUEUE DEBUG: pq_impl.cpp:787: [PQ: 72075186224037892] no config, start with empty partitions and default config
2025-11-03T16:53:11.519963Z node 14 :PERSQUEUE NOTICE: pq_impl.cpp:913: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-11-03T16:53:11.520029Z node 14 :PERSQUEUE INFO: pq_impl.cpp:612: [PQ: 72075186224037892] doesn't have tx writes info
2025-11-03T16:53:11.521385Z node 14 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [13:7568543227902985355:3248], now have 1 active actors on pipe
2025-11-03T16:53:11.521441Z node 14 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [13:7568543227902985372:2428], now have 1 active actors on pipe
2025-11-03T16:53:11.526722Z node 14 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-03T16:53:11.528306Z node 13 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:404: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 14, Generation 1
2025-11-03T16:53:11.541690Z node 14 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-03T16:53:11.555267Z node 14 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [13:7568543227902985402:3288], now have 1 active actors on pipe
2025-11-03T16:53:11.557724Z node 14 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-03T16:53:11.565516Z node 14 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-03T16:53:11.566975Z node 14 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-11-03T16:53:11.567043Z node 14 :PERSQUEUE DEBUG: partition.cpp:1312: [72075186224037892][Partition][0][StateInit] HandleOnInit TEvPQ::TEvProposePartitionConfig
2025-11-03T16:53:11.567422Z node 14 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-11-03T16:53:11.567729Z node 14 :PERSQUEUE INFO: partition_init.cpp:1101: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [14:7568543226938529639:2393]
2025-11-03T16:53:11.576425Z node 14 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-11-03T16:53:11.576475Z node 14 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-11-03T16:53:11.576506Z node 14 :PERSQUEUE INFO: partition.cpp:707: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1 [14:7568543226938529639:2393]
2025-11-03T16:53:11.576542Z node 14 :PERSQUEUE DEBUG: partition.cpp:727: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 0 Head Offset 0 PartNo 0 PackedSize 0 count 0 nextOffset 0 batches 0
2025-11-03T16:53:11.576591Z node 14 :PERSQUEUE DEBUG: partition_mlp.cpp:83: [72075186224037892][Partition][0][StateIdle] Initializing MLP Consumers: 0
2025-11-03T16:53:11.578263Z node 14 :PERSQUEUE DEBUG: partition.cpp:4273: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 1
2025-11-03T16:53:11.578318Z node 14 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:53:11.578453Z node 14 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:53:11.578473Z node 14 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-03T16:53:11.578503Z node 14 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-11-03T16:53:11.578523Z node 14 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-11-03T16:53:11.578539Z node 14 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:53:11.578558Z node 14 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-11-03T16:53:11.578598Z node 14 :PERSQUEUE DEBUG: partition_read.cpp:923: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-11-03T16:53:11.578647Z node 14 :PERSQUEUE DEBUG: partition_mlp.cpp:60: [72075186224037892][Partition][0][StateIdle] Process MLP pending events. Count 0
2025-11-03T16:53:11.579373Z node 14 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-03T16:53:11.579540Z node 14 :PERSQUEUE DEBUG: partition_compaction.cpp:183: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:53:11.604387Z node 14 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-03T16:53:11.604584Z node 14 :PERSQUEUE DEBUG: partition.cpp:1416: [72075186224037892][Partition][0][StateIdle] Handle TEvPQ::TEvTxCommit Step 1762188791594, TxId 281474976710670
2025-11-03T16:53:11.604626Z node 14 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-11-03T16:53:11.604644Z node 14 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:53:11.604818Z node 14 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:53:11.605091Z node 14 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-03T16:53:11.616634Z node 14 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-03T16:53:11.616855Z node 14 :PERSQUEUE DEBUG: partition_mlp.cpp:83: [72075186224037892][Partition][0][StateIdle] Initializing MLP Consumers: 0
2025-11-03T16:53:11.617013Z node 14 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-11-03T16:53:11.617041Z node 14 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:53:11.617059Z node 14 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:53:11.617091Z node 14 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:53:11.617129Z node 14 :PERSQUEUE DEBUG: partition_compaction.cpp:183: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:53:11.617533Z node 14 :PERSQUEUE DEBUG: pq_impl.cpp:398: [PQ: 72075186224037892] Apply new config PartitionConfig { LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 } PartitionIds: 0 TopicName: "rt3.dc1--test-topic" Version: 0 LocalDC: true Codecs { Ids: 0 Ids: 1 Ids: 2 Codecs: "raw" Codecs: "gzip" Codecs: "lzop" } TopicPath: "/Root/PQ/rt3.dc1--test-topic" YcCloudId: "" YcFolderId: "" YdbDatabaseId: "" YdbDatabasePath: "/Root" Partitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } AllPartitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } Consumers { Name: "user" ReadFromTimestampsMs: 0 FormatVersion: 0 Version: 0 Generation: 0 } MonitoringProjectId: ""
2025-11-03T16:53:11.617651Z node 14 :PERSQUEUE NOTICE: pq_impl.cpp:913: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-11-03T16:53:11.618034Z node 14 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-03T16:53:11.631187Z node 14 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-03T16:53:11.631309Z node 14 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-03T16:53:11.635527Z node 14 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-03T16:53:11.678561Z node 14 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:53:11.678603Z node 14 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:53:11.678622Z node 14 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:53:11.702017Z node 13 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976710671. Ctx: { TraceId: 01k95a63ph7931d8axz845p3ck, Database: , SessionId: ydb://session/3?node_id=13&id=M2Q0OGFmZmQtZTA0ZWRjYjctZDY4MmVlMmUtMTQwMzZlMQ==, PoolId: default, DatabaseId: /Root}. Database not set, use /Root
===Query complete
TClient::Ls request: /Root/PQ/rt3.dc1--test-topic
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976710670
    CreateStep: 1762188791594
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts...
(TRUNCATED)
GetTopicVersionFromPath:  record Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976710670
    CreateStep: 1762188791594
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      YdbDatabasePath: "/Root"
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
    Partitions {
      PartitionId: 0
      TabletId: 72075186224037892
      Status: Active
    }
    AlterVersion: 1
    BalancerTabletID: 72075186224037893
    NextPartitionId: 1
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 1
      PlanResolution: 7
      Coordinators: 72057594046316545
      TimeCastBucketsPerMediator: 2
      Mediators: 72057594046382081
    }
    DomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    PathsInside: 12
    PathsLimit: 10000
    ShardsInside: 6
    ShardsLimit: 200000
    ResourcesDomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    DiskSpaceUsage {
      Tables {
        TotalSize: 0
        DataSize: 0
        IndexSize: 0
      }
      Topics {
        ReserveSize: 0
        AccountSize: 0
        DataSize: 0
        UsedReserveSize: 0
      }
    }
    PQPartitionsInside: 1
    PQPartitionsLimit: 1000000
    SchemeLimits {
      MaxDepth: 32
      MaxPaths: 10000
      MaxChildrenInDir: 100000
      MaxAclBytesSize: 10240
      MaxTableColumns: 200
      MaxTableColumnNameLength: 255
      MaxTableKeyColumns: 30
      MaxTableIndices: 20
      MaxShards: 200000
      MaxShardsInPath: 35000
      MaxConsistentCopyTargets: 10000
      MaxPathElementLength: 255
      ExtraPathSymbolsAllowed: "!\"#$%&\'()*+,-.:;<=>?@[\\]^_`{|}~"
      MaxPQPartitions: 1000000
      MaxTableCdcStreams: 5
      MaxExports: 10
      MaxImports: 10
      MaxColumnTableColumns: 10000
    }
  }
}
Path: "/Root/PQ/rt3.dc1--test-topic"
 name rt3.dc1--test-topic version1
CallPersQueueGRPC request to localhost:24214
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-11-03T16:53:11.760678Z node 13 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
MetaResponse {
  CmdGetTopicMetadataResult {
    TopicInfo {
      Topic: "rt3.dc1--test-topic"
      NumPartitions: 1
      Config {
        PartitionConfig {
          LifetimeSeconds: 86400
          LowWatermark: 8388608
          SourceIdLifetimeSeconds: 86400
          WriteSpeedInBytesPerSecond: 20000000
          BurstSize: 20000000
          SourceIdMaxCounts: 6000000
        }
        Version: 1
        LocalDC: true
        Codecs {
          Ids: 0
          Ids: 1
          Ids: 2
          Codecs: "raw"
          Codecs: "gzip"
          Codecs: "lzop"
        }
        TopicPath: "/Root/PQ/rt3.dc1--test-topic"
        YdbDatabasePath: "/Root"
        Consumers {
          Name: "user"
          ReadFromTimestampsMs: 0
          FormatVersion: 0
          Version: 0
        }
      }
      ErrorCode: OK
    }
  }
}
=== Topic created, have version: 1
2025-11-03T16:53:11.778384Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: try to update token
2025-11-03T16:53:11.784937Z :INFO: [] MessageGroupId [src] SessionId [] Write session: Do CDS request
2025-11-03T16:53:11.784984Z :INFO: [] MessageGroupId [src] SessionId [] Start write session. Will connect to endpoint: localhost:24214
2025-11-03T16:53:11.788102Z node 14 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:53:11.788149Z node 14 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:53:11.788175Z node 14 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:53:11.798803Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src" }
2025-11-03T16:53:11.800018Z node 13 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-11-03T16:53:11.800057Z node 13 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1
2025-11-03T16:53:11.800595Z node 13 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src" }
2025-11-03T16:53:11.800758Z node 13 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1 topic: "test-topic" message_group_id: "src" from ipv6:[::1]:36432
2025-11-03T16:53:11.800779Z node 13 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:36432 proto=v1  topic=test-topic durationSec=0
2025-11-03T16:53:11.800791Z node 13 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-11-03T16:53:11.803097Z node 13 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1 sessionId:  describe result for acl check
2025-11-03T16:53:11.803291Z node 13 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-11-03T16:53:11.803309Z node 13 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-11-03T16:53:11.803324Z node 13 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-11-03T16:53:11.803347Z node 13 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [13:7568543227902985487:2448] (SourceId=src, PreferedPartition=(NULL)) StartKqpSession
2025-11-03T16:53:11.807970Z node 13 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [13:7568543227902985487:2448] (SourceId=src, PreferedPartition=(NULL)) Select from the table
2025-11-03T16:53:11.892121Z node 14 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:53:11.892166Z node 14 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:53:11.892188Z node 14 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:53:11.992177Z node 14 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:53:11.992217Z node 14 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:53:11.992236Z node 14 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:53:12.092231Z node 14 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:53:12.092266Z node 14 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:53:12.092284Z node 14 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:53:12.196128Z node 14 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:53:12.196170Z node 14 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:53:12.196189Z node 14 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:53:12.251793Z node 13 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [13:7568543227902985487:2448] (SourceId=src, PreferedPartition=(NULL)) RequestPQRB
2025-11-03T16:53:12.252744Z node 13 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1655: [72075186224037893][rt3.dc1--test-topic] pipe [13:7568543232197952844:2448] connected; active server actors: 1
2025-11-03T16:53:12.252961Z node 13 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [13:7568543227902985487:2448] (SourceId=src, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=src
2025-11-03T16:53:12.252986Z node 13 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [13:7568543227902985487:2448] (SourceId=src, PreferedPartition=(NULL)) Update the table
2025-11-03T16:53:12.254930Z node 13 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1659: [72075186224037893][rt3.dc1--test-topic] pipe [13:7568543232197952844:2448] disconnected.
2025-11-03T16:53:12.254965Z node 13 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1670: [72075186224037893][rt3.dc1--test-topic] pipe [13:7568543232197952844:2448] disconnected; active server actors: 1
2025-11-03T16:53:12.254986Z node 13 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1695: [72075186224037893][rt3.dc1--test-topic] pipe [13:7568543232197952844:2448] disconnected no session
2025-11-03T16:53:12.296274Z node 14 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:53:12.296315Z node 14 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:53:12.296332Z node 14 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:53:12.400569Z node 14 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:53:12.400607Z node 14 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:53:12.400624Z node 14 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:53:12.412040Z node 13 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [13:7568543227902985487:2448] (SourceId=src, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-11-03T16:53:12.412092Z node 13 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [13:7568543227902985487:2448] (SourceId=src, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-11-03T16:53:12.412115Z node 13 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [13:7568543227902985487:2448] (SourceId=src, PreferedPartition=(NULL)) Start idle
2025-11-03T16:53:12.412153Z node 13 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-11-03T16:53:12.420394Z node 14 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [13:7568543232197952873:2448], now have 1 active actors on pipe
2025-11-03T16:53:12.420606Z node 13 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 14, Generation: 1
2025-11-03T16:53:12.424324Z node 14 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:53:12.424373Z node 14 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:53:12.424461Z node 14 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src|b86df2d2-3ff84fe5-2d1a7bb4-765a52d2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src
2025-11-03T16:53:12.424502Z node 14 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:53:12.424527Z node 14 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:53:12.424545Z node 14 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-03T16:53:12.424587Z node 14 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:53:12.424629Z node 14 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-03T16:53:12.424684Z node 14 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-03T16:53:12.427124Z node 14 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:53:12.427164Z node 14 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:53:12.427249Z node 14 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-03T16:53:12.427989Z node 13 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1 partition: 0 MaxSeqNo: 0 sessionId: src|b86df2d2-3ff84fe5-2d1a7bb4-765a52d2_0
2025-11-03T16:53:12.435526Z :INFO: [] MessageGroupId [src] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1762188792435 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-11-03T16:53:12.435681Z :INFO: [] MessageGroupId [src] SessionId [] Write session established. Init response: session_id: "src|b86df2d2-3ff84fe5-2d1a7bb4-765a52d2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-11-03T16:53:12.436080Z :INFO: [] MessageGroupId [src] SessionId [src|b86df2d2-3ff84fe5-2d1a7bb4-765a52d2_0] Write session: close. Timeout = 0 ms
2025-11-03T16:53:12.436124Z :INFO: [] MessageGroupId [src] SessionId [src|b86df2d2-3ff84fe5-2d1a7bb4-765a52d2_0] Write session will now close
2025-11-03T16:53:12.436161Z :DEBUG: [] MessageGroupId [src] SessionId [src|b86df2d2-3ff84fe5-2d1a7bb4-765a52d2_0] Write session: aborting
2025-11-03T16:53:12.436607Z :INFO: [] MessageGroupId [src] SessionId [src|b86df2d2-3ff84fe5-2d1a7bb4-765a52d2_0] Write session: gracefully shut down, all writes complete
2025-11-03T16:53:12.436640Z :DEBUG: [] MessageGroupId [src] SessionId [src|b86df2d2-3ff84fe5-2d1a7bb4-765a52d2_0] Write session: destroy
2025-11-03T16:53:12.439741Z node 14 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [13:7568543232197952873:2448] destroyed
2025-11-03T16:53:12.439794Z node 14 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-11-03T16:53:12.439831Z node 14 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:53:12.437812Z node 13 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId: src|b86df2d2-3ff84fe5-2d1a7bb4-765a52d2_0 grpc read done: success: 0 data: 
2025-11-03T16:53:12.437862Z node 13 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 1 sessionId: src|b86df2d2-3ff84fe5-2d1a7bb4-765a52d2_0 grpc read failed
2025-11-03T16:53:12.437906Z node 13 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 1 sessionId: src|b86df2d2-3ff84fe5-2d1a7bb4-765a52d2_0 grpc closed
2025-11-03T16:53:12.437927Z node 13 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1 sessionId: src|b86df2d2-3ff84fe5-2d1a7bb4-765a52d2_0 is DEAD
2025-11-03T16:53:12.438888Z node 13 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-11-03T16:53:12.439847Z node 14 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:53:12.439861Z node 14 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:53:12.465850Z :DEBUG: [] MessageGroupId [test-message-group-id] SessionId [] Write session: try to update token
2025-11-03T16:53:12.466246Z :INFO: [] MessageGroupId [test-message-group-id] SessionId [] Write session: Do CDS request
2025-11-03T16:53:12.466280Z :INFO: [] MessageGroupId [test-message-group-id] SessionId [] Start write session. Will connect to endpoint: localhost:24214
2025-11-03T16:53:12.481618Z :ReadSession INFO: WriteToTopic: message1
2025-11-03T16:53:12.501993Z :DEBUG: [] MessageGroupId [test-message-group-id] SessionId [] Write session: send init request: init_request { topic: "test-topic" message_group_id: "test-message-group-id" }
2025-11-03T16:53:12.503854Z node 13 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-11-03T16:53:12.503893Z node 13 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2
2025-11-03T16:53:12.504092Z node 14 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:53:12.504127Z node 14 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:53:12.504141Z node 14 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:53:12.504680Z node 13 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "test-message-group-id" }
2025-11-03T16:53:12.504840Z node 13 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2 topic: "test-topic" message_group_id: "test-message-group-id" from ipv6:[::1]:36446
2025-11-03T16:53:12.504860Z node 13 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:36446 proto=v1  topic=test-topic durationSec=0
2025-11-03T16:53:12.504871Z node 13 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-11-03T16:53:12.512065Z node 13 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2 sessionId:  describe result for acl check
2025-11-03T16:53:12.512243Z node 13 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-11-03T16:53:12.512258Z node 13 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-11-03T16:53:12.512273Z node 13 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-11-03T16:53:12.512292Z node 13 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [13:7568543232197952884:2468] (SourceId=test-message-group-id, PreferedPartition=(NULL)) StartKqpSession
2025-11-03T16:53:12.519704Z node 13 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [13:7568543232197952884:2468] (SourceId=test-message-group-id, PreferedPartition=(NULL)) Select from the table
2025-11-03T16:53:12.538630Z node 13 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [13:7568543232197952884:2468] (SourceId=test-message-group-id, PreferedPartition=(NULL)) RequestPQRB
2025-11-03T16:53:12.539641Z node 13 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1655: [72075186224037893][rt3.dc1--test-topic] pipe [13:7568543232197952903:2468] connected; active server actors: 1
2025-11-03T16:53:12.539810Z node 13 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [13:7568543232197952884:2468] (SourceId=test-message-group-id, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=test-message-group-id
2025-11-03T16:53:12.539831Z node 13 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [13:7568543232197952884:2468] (SourceId=test-message-group-id, PreferedPartition=(NULL)) Update the table
2025-11-03T16:53:12.544162Z node 13 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1659: [72075186224037893][rt3.dc1--test-topic] pipe [13:7568543232197952903:2468] disconnected.
2025-11-03T16:53:12.544208Z node 13 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1670: [72075186224037893][rt3.dc1--test-topic] pipe [13:7568543232197952903:2468] disconnected; active server actors: 1
2025-11-03T16:53:12.544229Z node 13 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1695: [72075186224037893][rt3.dc1--test-topic] pipe [13:7568543232197952903:2468] disconnected no session
2025-11-03T16:53:12.565852Z node 13 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [13:7568543232197952884:2468] (SourceId=test-message-group-id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-11-03T16:53:12.565895Z node 13 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [13:7568543232197952884:2468] (SourceId=test-message-group-id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-11-03T16:53:12.565916Z node 13 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [13:7568543232197952884:2468] (SourceId=test-message-group-id, PreferedPartition=(NULL)) Start idle
2025-11-03T16:53:12.565946Z node 13 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-11-03T16:53:12.568372Z node 13 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 14, Generation: 1
2025-11-03T16:53:12.571500Z node 13 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2 partition: 0 MaxSeqNo: 0 sessionId: test-message-group-id|c8925d60-c1237cff-b1b92b1b-13257fe2_0
2025-11-03T16:53:12.569562Z node 14 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [13:7568543232197952919:2468], now have 1 active actors on pipe
2025-11-03T16:53:12.569631Z node 14 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:53:12.569659Z node 14 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:53:12.569734Z node 14 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie test-message-group-id|c8925d60-c1237cff-b1b92b1b-13257fe2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner test-message-group-id
2025-11-03T16:53:12.569810Z node 14 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:53:12.569833Z node 14 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:53:12.569847Z node 14 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-03T16:53:12.569888Z node 14 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:53:12.569945Z node 14 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-03T16:53:12.570000Z node 14 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-03T16:53:12.571067Z node 14 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:53:12.571093Z node 14 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:53:12.571169Z node 14 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-03T16:53:12.572424Z :INFO: [] MessageGroupId [test-message-group-id] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1762188792572 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-11-03T16:53:12.572590Z :INFO: [] MessageGroupId [test-message-group-id] SessionId [] Write session established. Init response: session_id: "test-message-group-id|c8925d60-c1237cff-b1b92b1b-13257fe2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-11-03T16:53:12.572933Z :DEBUG: [] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|c8925d60-c1237cff-b1b92b1b-13257fe2_0] Write 1 messages with Id from 1 to 1
2025-11-03T16:53:12.573039Z :ReadSession INFO: WriteToTopic: message2
2025-11-03T16:53:12.573087Z :DEBUG: [] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|c8925d60-c1237cff-b1b92b1b-13257fe2_0] Write 1 messages with Id from 2 to 2
2025-11-03T16:53:12.573128Z :INFO: [] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|c8925d60-c1237cff-b1b92b1b-13257fe2_0] Write session: close. Timeout = 18446744073709551 ms
2025-11-03T16:53:12.576481Z :DEBUG: [] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|c8925d60-c1237cff-b1b92b1b-13257fe2_0] Write session: try to update token
2025-11-03T16:53:12.576545Z :DEBUG: [] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|c8925d60-c1237cff-b1b92b1b-13257fe2_0] Send 1 message(s) (1 left), first sequence number is 1
2025-11-03T16:53:12.577703Z :DEBUG: [] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|c8925d60-c1237cff-b1b92b1b-13257fe2_0] Write session: try to update token
2025-11-03T16:53:12.577772Z :DEBUG: [] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|c8925d60-c1237cff-b1b92b1b-13257fe2_0] Send 1 message(s) (0 left), first sequence number is 2
2025-11-03T16:53:12.577195Z node 13 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: test-message-group-id|c8925d60-c1237cff-b1b92b1b-13257fe2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:53:12.577440Z node 13 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:53:12.578298Z node 13 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: test-message-group-id|c8925d60-c1237cff-b1b92b1b-13257fe2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:53:12.578494Z node 13 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:53:12.580013Z node 13 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:53:12.578076Z node 14 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:53:12.578136Z node 14 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:53:12.578227Z node 14 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-11-03T16:53:12.583622Z node 13 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:53:12.580455Z node 14 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:53:12.580490Z node 14 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:53:12.580555Z node 14 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:53:12.580575Z node 14 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:53:12.580936Z node 14 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0test-message-group-id' SeqNo: 1 partNo : 0 messageNo: 2 size 99 offset: -1
2025-11-03T16:53:12.581005Z node 14 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:53:12.581044Z node 14 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:53:12.581073Z node 14 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:53:12.581085Z node 14 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-03T16:53:12.581211Z node 14 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0test-message-group-id' seqNo 1 partNo 0
2025-11-03T16:53:12.582023Z node 14 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0test-message-group-id' seqNo 1 partNo 0 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 188 count 1 nextOffset 1 batches 1
2025-11-03T16:53:12.582061Z node 14 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:53:12.582606Z node 14 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 0,1 HeadOffset 0 endOffset 0 curOffset 1 d0000000000_00000000000000000000_00000_0000000001_00000? size 176 WTime 1762188792582
2025-11-03T16:53:12.582750Z node 14 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1  requestId: <none> cookie: 2
2025-11-03T16:53:12.582808Z node 14 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-03T16:53:12.582919Z node 14 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 0 partNo 0 count 1 size 176
2025-11-03T16:53:12.585546Z node 14 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:53:12.585581Z node 14 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:53:12.585627Z node 14 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0test-message-group-id' SeqNo: 2 partNo : 0 messageNo: 3 size 99 offset: -1
2025-11-03T16:53:12.585667Z node 14 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:53:12.585723Z node 14 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:53:12.589432Z node 14 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 0 count 1 size 176 actorID [14:7568543226938529622:2393]
2025-11-03T16:53:12.589518Z node 14 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-03T16:53:12.589584Z node 14 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 121 WriteNewSizeFromSupportivePartitions# 0
2025-11-03T16:53:12.589626Z node 14 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:53:12.589681Z node 14 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0test-message-group-id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 1, partNo: 0, Offset: 0 is stored on disk
2025-11-03T16:53:12.589929Z node 14 :PERSQUEUE DEBUG: partition_read.cpp:923: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-11-03T16:53:12.589957Z node 14 :PERSQUEUE DEBUG: partition_read.cpp:965: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-11-03T16:53:12.589987Z node 14 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:53:12.590019Z node 14 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:53:12.590039Z node 14 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-03T16:53:12.590168Z node 14 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0test-message-group-id' seqNo 2 partNo 0
2025-11-03T16:53:12.591104Z node 14 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0test-message-group-id' seqNo 2 partNo 0 FormedBlobsCount 0 NewHead: Offset 1 PartNo 0 PackedSize 188 count 1 nextOffset 2 batches 1
2025-11-03T16:53:12.591150Z node 14 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:53:12.598189Z node 13 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:53:12.600285Z :DEBUG: [] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|c8925d60-c1237cff-b1b92b1b-13257fe2_0] Write session got write response: sequence_numbers: 1 offsets: 0 already_written: false write_statistics { persist_duration_ms: 7 queued_in_partition_duration_ms: 1 }
2025-11-03T16:53:12.600339Z :DEBUG: [] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|c8925d60-c1237cff-b1b92b1b-13257fe2_0] Write session: acknoledged message 1
2025-11-03T16:53:12.604062Z node 13 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:53:12.608227Z :DEBUG: [] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|c8925d60-c1237cff-b1b92b1b-13257fe2_0] Write session got write response: sequence_numbers: 2 offsets: 1 already_written: false write_statistics { persist_duration_ms: 11 queued_in_partition_duration_ms: 5 }
2025-11-03T16:53:12.608287Z :DEBUG: [] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|c8925d60-c1237cff-b1b92b1b-13257fe2_0] Write session: acknoledged message 2
2025-11-03T16:53:12.591877Z node 14 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 1,1 HeadOffset 1 endOffset 1 curOffset 2 d0000000000_00000000000000000001_00000_0000000001_00000? size 176 WTime 1762188792591
2025-11-03T16:53:12.592061Z node 14 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:53:12.592121Z node 14 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 2  requestId: <none> cookie: 1
2025-11-03T16:53:12.592235Z node 14 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 0 suffix '63' size 176
2025-11-03T16:53:12.592380Z node 14 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-03T16:53:12.592533Z node 14 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 1 partNo 0 count 1 size 176
2025-11-03T16:53:12.592749Z node 14 :PERSQUEUE DEBUG: partition_read.cpp:880: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 partno 0 count 1 size 1024000 endOffset 1 max time lag 0ms effective offset 0
2025-11-03T16:53:12.592990Z node 14 :PERSQUEUE DEBUG: partition_read.cpp:1105: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 176 count 1 last offset 0, current partition end offset: 1
2025-11-03T16:53:12.593011Z node 14 :PERSQUEUE DEBUG: partition_read.cpp:1121: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-11-03T16:53:12.593095Z node 14 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 0 partno 0 count 1 parts_count 0 source 1 size 176 accessed 0 times before, last time 2025-11-03T16:53:12.000000Z
2025-11-03T16:53:12.593173Z node 14 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 0 suffix '63'
2025-11-03T16:53:12.593420Z node 14 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 3. All 1 blobs are from cache.
2025-11-03T16:53:12.599536Z node 14 :PERSQUEUE DEBUG: partition_read.cpp:572: FormAnswer for 1 blobs
2025-11-03T16:53:12.599750Z node 14 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 0 totakecount 1 count 1 size 156 from pos 0 cbcount 1
2025-11-03T16:53:12.599851Z node 14 :PERSQUEUE DEBUG: partition_read.cpp:1015: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1762188792580 queuesize 0 startOffset 0
2025-11-03T16:53:12.601674Z node 14 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 1 count 1 size 176 actorID [14:7568543226938529622:2393]
2025-11-03T16:53:12.601756Z node 14 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-03T16:53:12.601814Z node 14 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 121 WriteNewSizeFromSupportivePartitions# 0
2025-11-03T16:53:12.601855Z node 14 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:53:12.601914Z node 14 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0test-message-group-id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 2, partNo: 0, Offset: 1 is stored on disk
2025-11-03T16:53:12.602148Z node 14 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:53:12.602165Z node 14 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:53:12.602180Z node 14 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:53:12.602233Z node 14 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:53:12.602288Z node 14 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 3  requestId: <none> cookie: 2
2025-11-03T16:53:12.602528Z node 14 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 1 partno 0 count 1 parts 0 suffix '63' size 176
2025-11-03T16:53:12.605805Z node 14 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:53:12.605830Z node 14 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:53:12.605846Z node 14 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:53:12.675142Z :INFO: [] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|c8925d60-c1237cff-b1b92b1b-13257fe2_0] Write session will now close
2025-11-03T16:53:12.675209Z :DEBUG: [] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|c8925d60-c1237cff-b1b92b1b-13257fe2_0] Write session: aborting
2025-11-03T16:53:12.675665Z :INFO: [] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|c8925d60-c1237cff-b1b92b1b-13257fe2_0] Write session: gracefully shut down, all writes complete
2025-11-03T16:53:12.675704Z :DEBUG: [] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|c8925d60-c1237cff-b1b92b1b-13257fe2_0] Write session: destroy
2025-11-03T16:53:12.695950Z node 14 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [13:7568543232197952919:2468] destroyed
2025-11-03T16:53:12.693253Z node 13 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: test-message-group-id|c8925d60-c1237cff-b1b92b1b-13257fe2_0 grpc read done: success: 0 data: 
2025-11-03T16:53:12.693293Z node 13 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 2 sessionId: test-message-group-id|c8925d60-c1237cff-b1b92b1b-13257fe2_0 grpc read failed
2025-11-03T16:53:12.696056Z node 14 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-11-03T16:53:12.696100Z node 14 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:53:12.693453Z node 13 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:824: session v1 closed cookie: 2 sessionId: test-message-group-id|c8925d60-c1237cff-b1b92b1b-13257fe2_0
2025-11-03T16:53:12.696121Z node 14 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:53:12.696138Z node 14 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:53:12.693475Z node 13 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2 sessionId: test-message-group-id|c8925d60-c1237cff-b1b92b1b-13257fe2_0 is DEAD
2025-11-03T16:53:12.693770Z node 13 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-11-03T16:53:12.708753Z node 14 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:53:12.708788Z node 14 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:53:12.708805Z node 14 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:53:12.709409Z :INFO: [/Root] [/Root] [e2eb6d3e-aba9aae3-4ac69078-e304edd7] Starting read session
2025-11-03T16:53:12.709458Z :DEBUG: [/Root] [/Root] [e2eb6d3e-aba9aae3-4ac69078-e304edd7] Starting cluster discovery
2025-11-03T16:53:12.732898Z :DEBUG: [/Root] [/Root] [e2eb6d3e-aba9aae3-4ac69078-e304edd7] Cluster discovery request succeeded
2025-11-03T16:53:12.732992Z :DEBUG: [/Root] [/Root] [e2eb6d3e-aba9aae3-4ac69078-e304edd7] Starting session to cluster dc1 (localhost:24214)
2025-11-03T16:53:12.743343Z :DEBUG: [/Root] [/Root] [e2eb6d3e-aba9aae3-4ac69078-e304edd7] [dc1] In Reconnect, ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:53:12.743398Z :DEBUG: [/Root] [/Root] [e2eb6d3e-aba9aae3-4ac69078-e304edd7] [dc1] New values: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:53:12.748092Z :DEBUG: [/Root] [/Root] [e2eb6d3e-aba9aae3-4ac69078-e304edd7] [dc1] Reconnecting session to cluster dc1 in 0.000000s
2025-11-03T16:53:12.778232Z :DEBUG: [/Root] [/Root] [e2eb6d3e-aba9aae3-4ac69078-e304edd7] [dc1] Successfully connected. Initializing session
2025-11-03T16:53:12.777816Z node 13 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:109: new grpc connection
2025-11-03T16:53:12.777845Z node 13 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:131: new session created cookie 1
2025-11-03T16:53:12.779293Z node 13 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { topic: "test-topic" } read_only_original: true consumer: "shared/user" read_params { max_read_size: 104857600 } } }
2025-11-03T16:53:12.779565Z node 13 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 1 consumer shared/user session shared/user_13_1_9377515094832883100_v1 read init: from# ipv6:[::1]:36466, request# { init_request { topics_read_settings { topic: "test-topic" } read_only_original: true consumer: "shared/user" read_params { max_read_size: 104857600 } } }
2025-11-03T16:53:12.780148Z node 13 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 1 consumer shared/user session shared/user_13_1_9377515094832883100_v1 auth for : user
2025-11-03T16:53:12.785754Z node 13 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 1 consumer shared/user session shared/user_13_1_9377515094832883100_v1 Handle describe topics response
2025-11-03T16:53:12.785921Z node 13 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 1 consumer shared/user session shared/user_13_1_9377515094832883100_v1 auth is DEAD
2025-11-03T16:53:12.786021Z node 13 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 1 consumer shared/user session shared/user_13_1_9377515094832883100_v1 auth ok: topics# 1, initDone# 0
2025-11-03T16:53:12.787574Z node 13 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 1 consumer shared/user session shared/user_13_1_9377515094832883100_v1 register session: topic# rt3.dc1--test-topic
2025-11-03T16:53:12.788209Z :INFO: [/Root] [/Root] [e2eb6d3e-aba9aae3-4ac69078-e304edd7] [dc1] Server session id: shared/user_13_1_9377515094832883100_v1
2025-11-03T16:53:12.788470Z node 13 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1655: [72075186224037893][rt3.dc1--test-topic] pipe [13:7568543232197952941:2480] connected; active server actors: 1
2025-11-03T16:53:12.788631Z :DEBUG: [/Root] [/Root] [e2eb6d3e-aba9aae3-4ac69078-e304edd7] [dc1] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:53:12.788732Z node 13 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1706: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [13:7568543232197952941:2480] session shared/user_13_1_9377515094832883100_v1
2025-11-03T16:53:12.788796Z node 13 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:639: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-11-03T16:53:12.788855Z node 13 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:669: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-11-03T16:53:12.788905Z node 13 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:871: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_13_1_9377515094832883100_v1" (Sender=[13:7568543232197952938:2480], Pipe=[13:7568543232197952941:2480], Partitions=[], ActiveFamilyCount=0)
2025-11-03T16:53:12.788940Z node 13 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1186: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-11-03T16:53:12.789020Z node 13 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1258: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-11-03T16:53:12.789100Z node 13 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1305: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_13_1_9377515094832883100_v1" (Sender=[13:7568543232197952938:2480], Pipe=[13:7568543232197952941:2480], Partitions=[], ActiveFamilyCount=0)
2025-11-03T16:53:12.789187Z node 13 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:549: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_13_1_9377515094832883100_v1" sender [13:7568543232197952938:2480] lock partition 0 for ReadingSession "shared/user_13_1_9377515094832883100_v1" (Sender=[13:7568543232197952938:2480], Pipe=[13:7568543232197952941:2480], Partitions=[], ActiveFamilyCount=1) generation 1 step 1
2025-11-03T16:53:12.789256Z node 13 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1325: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-11-03T16:53:12.789299Z node 13 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1402: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000244s
2025-11-03T16:53:12.790137Z node 13 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 1 consumer shared/user session shared/user_13_1_9377515094832883100_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 1 Session: "shared/user_13_1_9377515094832883100_v1" ClientId: "user" PipeClient { RawX1: 7568543232197952941 RawX2: 4503655461947824 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-11-03T16:53:12.790238Z node 13 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 1 consumer shared/user session shared/user_13_1_9377515094832883100_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-11-03T16:53:12.790498Z node 13 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_13_1_9377515094832883100_v1 grpc read done: success# 1, data# { read { } }
2025-11-03T16:53:12.790655Z node 13 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_13_1_9377515094832883100_v1 got read request: guid# 553b0977-9e60337b-8237c1ab-1573ed42
2025-11-03T16:53:12.791204Z node 14 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [13:7568543232197952944:2483], now have 1 active actors on pipe
2025-11-03T16:53:12.791503Z node 13 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_13_1_9377515094832883100_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 1, pipe: [13:7568543232197952944:2483]
2025-11-03T16:53:12.791743Z node 14 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:53:12.791771Z node 14 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:53:12.791799Z node 14 :PERSQUEUE DEBUG: pq_impl.cpp:1748: [PQ: 72075186224037892] Created session shared/user_13_1_9377515094832883100_v1 on pipe: [13:7568543232197952944:2483]
2025-11-03T16:53:12.791858Z node 14 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:53:12.791880Z node 14 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:53:12.791891Z node 14 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-03T16:53:12.791945Z node 14 :PERSQUEUE DEBUG: partition.cpp:3666: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_13_1_9377515094832883100_v1
2025-11-03T16:53:12.791970Z node 14 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:53:12.792100Z node 14 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-03T16:53:12.792501Z node 14 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_13_1_9377515094832883100_v1:1 with generation 1
2025-11-03T16:53:12.797476Z node 14 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-03T16:53:12.797567Z node 14 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-11-03T16:53:12.797600Z node 14 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:53:12.797616Z node 14 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:53:12.797634Z node 14 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:53:12.797671Z node 14 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:53:12.797716Z node 14 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-11-03T16:53:12.798440Z node 13 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_13_1_9377515094832883100_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 2 WriteTimestampMS: 1762188792580 CreateTimestampMS: 1762188792572 SizeLag: 352 WriteTimestampEstimateMS: 1762188792708 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-11-03T16:53:12.798500Z node 13 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 1 consumer shared/user session shared/user_13_1_9377515094832883100_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 2 readOffset 0 committedOffset 0
2025-11-03T16:53:12.798557Z node 13 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 1 consumer shared/user session shared/user_13_1_9377515094832883100_v1 sending to client partition status
2025-11-03T16:53:12.799594Z :INFO: [/Root] [/Root] [e2eb6d3e-aba9aae3-4ac69078-e304edd7] [dc1] Confirm partition stream create. Partition stream id: 1. Cluster: "dc1". Topic: "test-topic". Partition: 0. Read offset: (NULL)
create event CreatePartitionStream { PartitionStreamId: 1 TopicPath: test-topic Cluster: dc1 PartitionId: 0 CommittedOffset: 0 EndOffset: 2 }
2025-11-03T16:53:12.804663Z node 13 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_13_1_9377515094832883100_v1 grpc read done: success# 1, data# { start_read { topic { path: "test-topic" } cluster: "dc1" assign_id: 1 } }
2025-11-03T16:53:12.804848Z node 13 :PQ_READ_PROXY INFO: read_session_actor.cpp:539: session cookie 1 consumer shared/user session shared/user_13_1_9377515094832883100_v1 got StartRead from client: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 0, commitOffset# 0
2025-11-03T16:53:12.804904Z node 13 :PQ_READ_PROXY INFO: partition_actor.cpp:1023: session cookie 1 consumer shared/user session shared/user_13_1_9377515094832883100_v1 Start reading TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 2 readOffset 0 committedOffset 0 clientCommitOffset 0 clientReadOffset 0
2025-11-03T16:53:12.804938Z node 13 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_13_1_9377515094832883100_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 0 endOffset 2
2025-11-03T16:53:12.805012Z node 13 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_13_1_9377515094832883100_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 0, endOffset# 2, WTime# 1762188792580, sizeLag# 352
2025-11-03T16:53:12.805031Z node 13 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_13_1_9377515094832883100_v1TEvPartitionReady. Aval parts: 1
2025-11-03T16:53:12.805085Z node 13 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_13_1_9377515094832883100_v1 performing read request: guid# 553b0977-9e60337b-8237c1ab-1573ed42, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 2, size# 422, partitionsAsked# 1, maxTimeLag# 0ms
2025-11-03T16:53:12.805165Z node 13 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_13_1_9377515094832883100_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 2 maxSize 422 maxTimeLagMs 0 readTimestampMs 0 readOffset 0 EndOffset 2 ClientCommitOffset 0 committedOffset 0 Guid 553b0977-9e60337b-8237c1ab-1573ed42
2025-11-03T16:53:12.806214Z node 14 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:53:12.806256Z node 14 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:53:12.806413Z node 14 :PERSQUEUE DEBUG: partition_read.cpp:880: [72075186224037892][Partition][0][StateIdle] read cookie 4 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 partno 0 count 2 size 422 endOffset 2 max time lag 0ms effective offset 0
2025-11-03T16:53:12.806937Z node 14 :PERSQUEUE DEBUG: partition_read.cpp:1105: [72075186224037892][Partition][0][StateIdle] read cookie 4 added 2 blobs, size 352 count 2 last offset 1, current partition end offset: 2
2025-11-03T16:53:12.806960Z node 14 :PERSQUEUE DEBUG: partition_read.cpp:1121: [72075186224037892][Partition][0][StateIdle] Reading cookie 4. Send blob request.
2025-11-03T16:53:12.807022Z node 14 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 0 partno 0 count 1 parts_count 0 source 1 size 176 accessed 1 times before, last time 2025-11-03T16:53:12.000000Z
2025-11-03T16:53:12.807051Z node 14 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 1 partno 0 count 1 parts_count 0 source 1 size 176 accessed 0 times before, last time 2025-11-03T16:53:12.000000Z
2025-11-03T16:53:12.807101Z node 14 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 4. All 2 blobs are from cache.
2025-11-03T16:53:12.807157Z node 14 :PERSQUEUE DEBUG: partition_read.cpp:572: FormAnswer for 2 blobs
2025-11-03T16:53:12.807351Z node 14 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 0 totakecount 1 count 1 size 156 from pos 0 cbcount 1
2025-11-03T16:53:12.807441Z node 14 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 1 totakecount 1 count 1 size 156 from pos 0 cbcount 1
2025-11-03T16:53:12.807552Z node 14 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-03T16:53:12.808179Z node 14 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 0 suffix '63'
2025-11-03T16:53:12.808211Z node 14 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 1 partno 0 count 1 parts 0 suffix '63'
2025-11-03T16:53:12.808939Z node 13 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_13_1_9377515094832883100_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 2 Result { Offset: 0 Data: "... 99 bytes ..." SourceId: "\000test-message-group-id" SeqNo: 1 WriteTimestampMS: 1762188792580 CreateTimestampMS: 1762188792572 UncompressedSize: 8 PartitionKey: "" ExplicitHash: "" } Result { Offset: 1 Data: "... 99 bytes ..." SourceId: "\000test-message-group-id" SeqNo: 2 WriteTimestampMS: 1762188792590 CreateTimestampMS: 1762188792573 UncompressedSize: 8 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 2 SizeLag: 40 RealReadOffset: 1 WaitQuotaTimeMs: 0 EndOffset: 2 StartOffset: 0 } Cookie: 0 }
2025-11-03T16:53:12.809158Z node 13 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_13_1_9377515094832883100_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 1 from offset 2
2025-11-03T16:53:12.809204Z node 13 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_13_1_9377515094832883100_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 2 ReadOffset 2 ReadGuid 553b0977-9e60337b-8237c1ab-1573ed42 has messages 1
2025-11-03T16:53:12.809388Z node 13 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_13_1_9377515094832883100_v1 read done: guid# 553b0977-9e60337b-8237c1ab-1573ed42, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 382
2025-11-03T16:53:12.809417Z node 13 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_13_1_9377515094832883100_v1 response to read: guid# 553b0977-9e60337b-8237c1ab-1573ed42
2025-11-03T16:53:12.809689Z node 13 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_13_1_9377515094832883100_v1 Process answer. Aval parts: 0
2025-11-03T16:53:12.812231Z node 14 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:53:12.812275Z node 14 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:53:12.812294Z node 14 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:53:12.812825Z :DEBUG: [/Root] [/Root] [e2eb6d3e-aba9aae3-4ac69078-e304edd7] [dc1] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:53:12.813157Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 0 (0-1)
2025-11-03T16:53:12.813324Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (0-0)
2025-11-03T16:53:12.813371Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 0} (1-1)
2025-11-03T16:53:12.813416Z :DEBUG: [/Root] [/Root] [e2eb6d3e-aba9aae3-4ac69078-e304edd7] [dc1] The application data is transferred to the client. Number of messages 2, size 16 bytes
data event DataReceived { PartitionStreamId: 1 PartitionId: 0 Message { Data: ..8 bytes.. Partition stream id: 1 Cluster: "dc1". Topic: "test-topic" Partition: 0 PartitionKey: "" Information: { Offset: 0 SeqNo: 1 MessageGroupId: "test-message-group-id" CreateTime: 2025-11-03T16:53:12.572000Z WriteTime: 2025-11-03T16:53:12.580000Z Ip: "ipv6:[::1]:36446" UncompressedSize: 8 Meta: { "logtype": "unknown", "ident": "unknown", "server": "ipv6:[::1]:36446" } } } Message { Data: ..8 bytes.. Partition stream id: 1 Cluster: "dc1". Topic: "test-topic" Partition: 0 PartitionKey: "" Information: { Offset: 1 SeqNo: 2 MessageGroupId: "test-message-group-id" CreateTime: 2025-11-03T16:53:12.573000Z WriteTime: 2025-11-03T16:53:12.590000Z Ip: "ipv6:[::1]:36446" UncompressedSize: 8 Meta: { "logtype": "unknown", "ident": "unknown", "server": "ipv6:[::1]:36446" } } } }
2025-11-03T16:53:12.821525Z node 13 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_13_1_9377515094832883100_v1 grpc read done: success# 1, data# { read { } }
2025-11-03T16:53:12.821688Z node 13 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_13_1_9377515094832883100_v1 got read request: guid# 3ef6162b-564e8b7-a2fafbe7-54c5add5
2025-11-03T16:53:12.831114Z :DEBUG: [] MessageGroupId [test-message-group-id] SessionId [] Write session: try to update token
2025-11-03T16:53:12.831960Z :INFO: [] MessageGroupId [test-message-group-id] SessionId [] Write session: Do CDS request
2025-11-03T16:53:12.832044Z :INFO: [] MessageGroupId [test-message-group-id] SessionId [] Start write session. Will connect to endpoint: localhost:24214
2025-11-03T16:53:12.850285Z :ReadSession INFO: WriteToTopic: message3
2025-11-03T16:53:12.852810Z :DEBUG: [] MessageGroupId [test-message-group-id] SessionId [] Write session: send init request: init_request { topic: "test-topic" message_group_id: "test-message-group-id" }
2025-11-03T16:53:12.853755Z node 13 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-11-03T16:53:12.853804Z node 13 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3
2025-11-03T16:53:12.860383Z node 13 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "test-message-group-id" }
2025-11-03T16:53:12.860575Z node 13 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3 topic: "test-topic" message_group_id: "test-message-group-id" from ipv6:[::1]:36476
2025-11-03T16:53:12.860597Z node 13 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:36476 proto=v1  topic=test-topic durationSec=0
2025-11-03T16:53:12.860609Z node 13 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-11-03T16:53:12.863011Z node 13 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3 sessionId:  describe result for acl check
2025-11-03T16:53:12.863159Z node 13 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-11-03T16:53:12.863172Z node 13 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-11-03T16:53:12.863185Z node 13 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-11-03T16:53:12.863205Z node 13 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [13:7568543232197952955:2488] (SourceId=test-message-group-id, PreferedPartition=(NULL)) StartKqpSession
2025-11-03T16:53:12.866773Z node 13 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [13:7568543232197952955:2488] (SourceId=test-message-group-id, PreferedPartition=(NULL)) Select from the table
2025-11-03T16:53:12.896713Z node 13 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [13:7568543232197952955:2488] (SourceId=test-message-group-id, PreferedPartition=(NULL)) Update the table
2025-11-03T16:53:12.914031Z node 14 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:53:12.914067Z node 14 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:53:12.914084Z node 14 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:53:12.919487Z node 13 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [13:7568543232197952955:2488] (SourceId=test-message-group-id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-11-03T16:53:12.919538Z node 13 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [13:7568543232197952955:2488] (SourceId=test-message-group-id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-11-03T16:53:12.919562Z node 13 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [13:7568543232197952955:2488] (SourceId=test-message-group-id, PreferedPartition=(NULL)) Start idle
2025-11-03T16:53:12.919600Z node 13 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-11-03T16:53:12.922254Z node 13 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 14, Generation: 1
2025-11-03T16:53:12.924043Z node 14 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [13:7568543232197952992:2488], now have 1 active actors on pipe
2025-11-03T16:53:12.924135Z node 14 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:53:12.924164Z node 14 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:53:12.924242Z node 14 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie test-message-group-id|4f3fe7ab-2a46b0d8-3389ca04-8694ca12_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner test-message-group-id
2025-11-03T16:53:12.924277Z node 14 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:53:12.924298Z node 14 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:53:12.924314Z node 14 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-03T16:53:12.924359Z node 14 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:53:12.924403Z node 14 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-03T16:53:12.924451Z node 14 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-03T16:53:12.927948Z node 14 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:53:12.928014Z node 14 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:53:12.928104Z node 14 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-03T16:53:12.928623Z node 13 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3 partition: 0 MaxSeqNo: 2 sessionId: test-message-group-id|4f3fe7ab-2a46b0d8-3389ca04-8694ca12_0
2025-11-03T16:53:12.932763Z :INFO: [] MessageGroupId [test-message-group-id] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1762188792932 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-11-03T16:53:12.932913Z :INFO: [] MessageGroupId [test-message-group-id] SessionId [] Write session established. Init response: last_sequence_number: 2 session_id: "test-message-group-id|4f3fe7ab-2a46b0d8-3389ca04-8694ca12_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-11-03T16:53:12.933238Z :DEBUG: [] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|4f3fe7ab-2a46b0d8-3389ca04-8694ca12_0] Write 1 messages with Id from 1 to 1
2025-11-03T16:53:12.933316Z :INFO: [] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|4f3fe7ab-2a46b0d8-3389ca04-8694ca12_0] Write session: close. Timeout = 18446744073709551 ms
2025-11-03T16:53:12.933816Z :DEBUG: [] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|4f3fe7ab-2a46b0d8-3389ca04-8694ca12_0] Write session: try to update token
2025-11-03T16:53:12.933882Z :DEBUG: [] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|4f3fe7ab-2a46b0d8-3389ca04-8694ca12_0] Send 1 message(s) (0 left), first sequence number is 3
2025-11-03T16:53:12.936449Z node 13 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3 sessionId: test-message-group-id|4f3fe7ab-2a46b0d8-3389ca04-8694ca12_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:53:12.936802Z node 13 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:53:12.943049Z node 14 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:53:12.943105Z node 14 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:53:12.943185Z node 14 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-11-03T16:53:12.943694Z node 13 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:53:12.944345Z node 14 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:53:12.944378Z node 14 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:53:12.944434Z node 14 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0test-message-group-id' SeqNo: 3 partNo : 0 messageNo: 1 size 99 offset: -1
2025-11-03T16:53:12.944474Z node 14 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:53:12.944521Z node 14 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:53:12.944552Z node 14 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:53:12.944566Z node 14 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-03T16:53:12.944684Z node 14 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0test-message-group-id' seqNo 3 partNo 0
2025-11-03T16:53:12.945625Z node 14 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0test-message-group-id' seqNo 3 partNo 0 FormedBlobsCount 0 NewHead: Offset 2 PartNo 0 PackedSize 188 count 1 nextOffset 3 batches 1
2025-11-03T16:53:12.945667Z node 14 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:53:12.946263Z node 14 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 2,1 HeadOffset 2 endOffset 2 curOffset 3 d0000000000_00000000000000000002_00000_0000000001_00000? size 176 WTime 1762188792946
2025-11-03T16:53:12.946466Z node 14 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-03T16:53:12.946605Z node 14 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 2 partNo 0 count 1 size 176
2025-11-03T16:53:12.956846Z node 14 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 2 count 1 size 176 actorID [14:7568543226938529622:2393]
2025-11-03T16:53:12.956928Z node 14 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-03T16:53:12.956987Z node 14 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 121 WriteNewSizeFromSupportivePartitions# 0
2025-11-03T16:53:12.957026Z node 14 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:53:12.957083Z node 14 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0test-message-group-id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 3, partNo: 0, Offset: 2 is stored on disk
2025-11-03T16:53:12.957332Z node 14 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:53:12.957347Z node 14 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:53:12.957362Z node 14 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:53:12.957404Z node 14 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:53:12.957459Z node 14 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1  requestId: <none> cookie: 1
2025-11-03T16:53:12.959227Z node 14 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 2 partno 0 count 1 parts 0 suffix '63' size 176
2025-11-03T16:53:12.960157Z node 13 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 1 consumer shared/user session shared/user_13_1_9377515094832883100_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 2 EndOffset 2 newEndOffset 3 commitOffset 0 clientCommitOffset 0 cookie 1 readingFinished 0 firstRead 0
2025-11-03T16:53:12.960198Z node 13 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_13_1_9377515094832883100_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 2 endOffset 3
2025-11-03T16:53:12.960263Z node 13 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:53:12.960711Z node 13 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_13_1_9377515094832883100_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 2, endOffset# 3, WTime# 1762188792590, sizeLag# 176
2025-11-03T16:53:12.960733Z node 13 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_13_1_9377515094832883100_v1TEvPartitionReady. Aval parts: 1
2025-11-03T16:53:12.960788Z node 13 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_13_1_9377515094832883100_v1 performing read request: guid# 3ef6162b-564e8b7-a2fafbe7-54c5add5, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 1, size# 211, partitionsAsked# 1, maxTimeLag# 0ms
2025-11-03T16:53:12.960849Z node 13 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_13_1_9377515094832883100_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 1 maxSize 211 maxTimeLagMs 0 readTimestampMs 0 readOffset 2 EndOffset 3 ClientCommitOffset 0 committedOffset 0 Guid 3ef6162b-564e8b7-a2fafbe7-54c5add5
2025-11-03T16:53:12.961723Z :DEBUG: [] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|4f3fe7ab-2a46b0d8-3389ca04-8694ca12_0] Write session got write response: sequence_numbers: 3 offsets: 2 already_written: false write_statistics { persist_duration_ms: 10 queued_in_partition_duration_ms: 1 }
2025-11-03T16:53:12.961792Z :DEBUG: [] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|4f3fe7ab-2a46b0d8-3389ca04-8694ca12_0] Write session: acknoledged message 1
2025-11-03T16:53:13.036053Z :INFO: [] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|4f3fe7ab-2a46b0d8-3389ca04-8694ca12_0] Write session will now close
2025-11-03T16:53:13.036114Z :DEBUG: [] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|4f3fe7ab-2a46b0d8-3389ca04-8694ca12_0] Write session: aborting
2025-11-03T16:53:13.036543Z :INFO: [] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|4f3fe7ab-2a46b0d8-3389ca04-8694ca12_0] Write session: gracefully shut down, all writes complete
2025-11-03T16:53:13.036583Z :DEBUG: [] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|4f3fe7ab-2a46b0d8-3389ca04-8694ca12_0] Write session: destroy
2025-11-03T16:53:13.039841Z node 13 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3 sessionId: test-message-group-id|4f3fe7ab-2a46b0d8-3389ca04-8694ca12_0 grpc read done: success: 0 data: 
2025-11-03T16:53:13.039879Z node 13 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 3 sessionId: test-message-group-id|4f3fe7ab-2a46b0d8-3389ca04-8694ca12_0 grpc read failed
2025-11-03T16:53:13.039925Z node 13 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 3 sessionId: test-message-group-id|4f3fe7ab-2a46b0d8-3389ca04-8694ca12_0 grpc closed
2025-11-03T16:53:13.039948Z node 13 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3 sessionId: test-message-group-id|4f3fe7ab-2a46b0d8-3389ca04-8694ca12_0 is DEAD
2025-11-03T16:53:13.040791Z node 13 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-11-03T16:53:13.484941Z node 13 :FLAT_TX_SCHEMESHARD WARN: schemeshard_impl.cpp:7727: Cannot get console configs
2025-11-03T16:53:13.484980Z node 13 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
2025-11-03T16:53:13.747788Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): dc1:test-topic:0:1:1:0
2025-11-03T16:53:13.747904Z :INFO: [/Root] [/Root] [e2eb6d3e-aba9aae3-4ac69078-e304edd7] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1038 BytesRead: 16 MessagesRead: 2 BytesReadCompressed: 56 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-11-03T16:53:15.684444Z node 14 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:53:15.684499Z node 14 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:53:15.684587Z node 14 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:53:15.684603Z node 14 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:53:15.684619Z node 14 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:53:15.684685Z node 14 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [13:7568543232197952992:2488] destroyed
2025-11-03T16:53:15.684752Z node 14 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-11-03T16:53:15.684787Z node 14 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:53:15.684805Z node 14 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:53:15.684822Z node 14 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:53:15.684895Z node 14 :PERSQUEUE DEBUG: partition_read.cpp:880: [72075186224037892][Partition][0][StateIdle] read cookie 5 Topic 'rt3.dc1--test-topic' partition 0 user user offset 2 partno 0 count 1 size 211 endOffset 3 max time lag 0ms effective offset 2
2025-11-03T16:53:15.685205Z node 14 :PERSQUEUE DEBUG: partition_read.cpp:1105: [72075186224037892][Partition][0][StateIdle] read cookie 5 added 1 blobs, size 176 count 1 last offset 2, current partition end offset: 3
2025-11-03T16:53:15.685228Z node 14 :PERSQUEUE DEBUG: partition_read.cpp:1121: [72075186224037892][Partition][0][StateIdle] Reading cookie 5. Send blob request.
2025-11-03T16:53:15.685288Z node 14 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 2 partno 0 count 1 parts_count 0 source 1 size 176 accessed 0 times before, last time 2025-11-03T16:53:12.000000Z
2025-11-03T16:53:15.685339Z node 14 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 5. All 1 blobs are from cache.
2025-11-03T16:53:15.685392Z node 14 :PERSQUEUE DEBUG: partition_read.cpp:572: FormAnswer for 1 blobs
2025-11-03T16:53:15.685560Z node 14 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 2 totakecount 1 count 1 size 156 from pos 0 cbcount 1
2025-11-03T16:53:15.685679Z node 14 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 2
2025-11-03T16:53:15.688174Z node 14 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 2 partno 0 count 1 parts 0 suffix '63'
2025-11-03T16:53:15.691629Z node 13 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_13_1_9377515094832883100_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 3 Result { Offset: 2 Data: "... 99 bytes ..." SourceId: "\000test-message-group-id" SeqNo: 3 WriteTimestampMS: 1762188792944 CreateTimestampMS: 1762188792933 UncompressedSize: 8 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 20 RealReadOffset: 2 WaitQuotaTimeMs: 0 EndOffset: 3 StartOffset: 0 } Cookie: 2 }
2025-11-03T16:53:15.691811Z node 13 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_13_1_9377515094832883100_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 2 from offset 3
2025-11-03T16:53:15.691892Z node 13 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_13_1_9377515094832883100_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 3 ReadOffset 3 ReadGuid 3ef6162b-564e8b7-a2fafbe7-54c5add5 has messages 1
2025-11-03T16:53:15.695767Z :DEBUG: [/Root] [/Root] [e2eb6d3e-aba9aae3-4ac69078-e304edd7] [dc1] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:53:15.696091Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 0 (2-2)
2025-11-03T16:53:15.692440Z node 13 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_13_1_9377515094832883100_v1 read done: guid# 3ef6162b-564e8b7-a2fafbe7-54c5add5, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 220
2025-11-03T16:53:15.692495Z node 13 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_13_1_9377515094832883100_v1 response to read: guid# 3ef6162b-564e8b7-a2fafbe7-54c5add5
2025-11-03T16:53:15.692797Z node 13 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_13_1_9377515094832883100_v1 Process answer. Aval parts: 0
2025-11-03T16:53:15.696272Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (2-2)
2025-11-03T16:53:15.696328Z :DEBUG: [/Root] [/Root] [e2eb6d3e-aba9aae3-4ac69078-e304edd7] [dc1] The application data is transferred to the client. Number of messages 1, size 8 bytes
data event DataReceived { PartitionStreamId: 1 PartitionId: 0 Message { Data: ..8 bytes.. Partition stream id: 1 Cluster: "dc1". Topic: "test-topic" Partition: 0 PartitionKey: "" Information: { Offset: 2 SeqNo: 3 MessageGroupId: "test-message-group-id" CreateTime: 2025-11-03T16:53:12.933000Z WriteTime: 2025-11-03T16:53:12.944000Z Ip: "ipv6:[::1]:36476" UncompressedSize: 8 Meta: { "logtype": "unknown", "ident": "unknown", "server": "ipv6:[::1]:36476" } } } }
2025-11-03T16:53:15.696484Z :DEBUG: [/Root] [/Root] [e2eb6d3e-aba9aae3-4ac69078-e304edd7] [dc1] Commit offsets [2, 3). Partition stream id: 1
2025-11-03T16:53:15.696698Z :INFO: [/Root] [/Root] [e2eb6d3e-aba9aae3-4ac69078-e304edd7] Closing read session. Close timeout: 30.000000s
2025-11-03T16:53:15.696739Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): dc1:test-topic:0:1:2:0
2025-11-03T16:53:15.696775Z :INFO: [/Root] [/Root] [e2eb6d3e-aba9aae3-4ac69078-e304edd7] Counters: { Errors: 0 CurrentSessionLifetimeMs: 2987 BytesRead: 24 MessagesRead: 3 BytesReadCompressed: 84 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-11-03T16:53:15.697453Z :NOTICE: [/Root] [/Root] [e2eb6d3e-aba9aae3-4ac69078-e304edd7] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
close event SessionClosed { Status: SUCCESS Issues: "<main>: Error: Session was gracefully closed " }
2025-11-03T16:53:15.697629Z :INFO: [/Root] [/Root] [e2eb6d3e-aba9aae3-4ac69078-e304edd7] Closing read session. Close timeout: 0.000000s
2025-11-03T16:53:15.697671Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): dc1:test-topic:0:1:2:0
2025-11-03T16:53:15.697713Z :INFO: [/Root] [/Root] [e2eb6d3e-aba9aae3-4ac69078-e304edd7] Counters: { Errors: 0 CurrentSessionLifetimeMs: 2988 BytesRead: 24 MessagesRead: 3 BytesReadCompressed: 84 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-11-03T16:53:15.697785Z :NOTICE: [/Root] [/Root] [e2eb6d3e-aba9aae3-4ac69078-e304edd7] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
2025-11-03T16:53:15.696552Z node 13 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_13_1_9377515094832883100_v1 grpc read done: success# 1, data# { read { } }
2025-11-03T16:53:15.696682Z node 13 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_13_1_9377515094832883100_v1 got read request: guid# 3329cdbb-ab7886b4-dec0f497-7f4c90f0
2025-11-03T16:53:15.697082Z node 13 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_13_1_9377515094832883100_v1 grpc read done: success# 1, data# { commit { cookies { assign_id: 1 partition_cookie: 2 } } }
2025-11-03T16:53:15.697245Z node 13 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1449: session cookie 1 consumer shared/user session shared/user_13_1_9377515094832883100_v1 commit request from client for 2 in TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-11-03T16:53:15.698302Z node 13 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_13_1_9377515094832883100_v1 grpc read done: success# 0, data# {  }
2025-11-03T16:53:15.698337Z node 13 :PQ_READ_PROXY INFO: read_session_actor.cpp:125: session cookie 1 consumer shared/user session shared/user_13_1_9377515094832883100_v1 grpc read failed
2025-11-03T16:53:15.698412Z node 13 :PQ_READ_PROXY INFO: read_session_actor.cpp:92: session cookie 1 consumer shared/user session shared/user_13_1_9377515094832883100_v1 grpc closed
2025-11-03T16:53:15.698507Z node 13 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 1 consumer shared/user session shared/user_13_1_9377515094832883100_v1 is DEAD
2025-11-03T16:53:15.700970Z node 13 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1659: [72075186224037893][rt3.dc1--test-topic] pipe [13:7568543232197952941:2480] disconnected.
2025-11-03T16:53:15.701049Z node 13 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1670: [72075186224037893][rt3.dc1--test-topic] pipe [13:7568543232197952941:2480] disconnected; active server actors: 1
2025-11-03T16:53:15.701097Z node 13 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1679: [72075186224037893][rt3.dc1--test-topic] pipe [13:7568543232197952941:2480] client user disconnected session shared/user_13_1_9377515094832883100_v1
2025-11-03T16:53:15.702155Z node 14 :PERSQUEUE DEBUG: pq_impl.cpp:2258: [PQ: 72075186224037892] Destroy direct read session shared/user_13_1_9377515094832883100_v1
2025-11-03T16:53:15.702241Z node 14 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [13:7568543232197952944:2483] destroyed
2025-11-03T16:53:15.702321Z node 14 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_13_1_9377515094832883100_v1
2025-11-03T16:53:15.788134Z node 14 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:53:15.788180Z node 14 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:53:15.788202Z node 14 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:53:15.888234Z node 14 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:53:15.888270Z node 14 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:53:15.888290Z node 14 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:53:15.992582Z node 14 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:53:15.992612Z node 14 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:53:15.992629Z node 14 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:53:19.302938Z :ClosesAfterFailedConnectionToCds INFO: Random seed for debugging is 1762188799302913
2025-11-03T16:53:20.872348Z node 15 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[15:7568543269350237375:2080];send_to=[0:7307199536658146131:7762515];
2025-11-03T16:53:20.872443Z node 15 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
2025-11-03T16:53:21.029115Z node 15 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:123: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, got undelivered to scheme cache: ActorUnknown
test_client.cpp: SetPath # /home/runner/.ya/build/build_root/7jz3/001998/r3tmp/tmpfO64xG/pdisk_1.dat
2025-11-03T16:53:21.040152Z node 15 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-11-03T16:53:21.151747Z node 15 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-11-03T16:53:21.203895Z node 16 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-11-03T16:53:21.240407Z node 16 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-11-03T16:53:21.240592Z node 16 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=incorrect path status: LookupError;
2025-11-03T16:53:21.394601Z node 15 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-11-03T16:53:21.456497Z node 16 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-11-03T16:53:21.464570Z node 15 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
2025-11-03T16:53:21.507357Z node 15 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(15, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-11-03T16:53:21.507489Z node 15 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(15, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-11-03T16:53:21.509593Z node 15 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(16, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-11-03T16:53:21.509716Z node 15 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(16, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-11-03T16:53:21.525926Z node 15 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(15, (0,0,0,0)) VolatileState: Connecting -> Connected
2025-11-03T16:53:21.531677Z node 15 :HIVE WARN: hive_impl.cpp:811: HIVE#72057594037968897 Handle TEvInterconnect::TEvNodeConnected, NodeId 16 Cookie 16
2025-11-03T16:53:21.545110Z node 15 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(16, (0,0,0,0)) VolatileState: Connecting -> Connected
TServer::EnableGrpc on GrpcPort 5660, node 15
2025-11-03T16:53:21.700453Z node 16 :BS_NODE WARN: {NWDC01@distconf.cpp:397} StateFunc too long Type# 268639238 Duration# 0.008901s
2025-11-03T16:53:21.750368Z node 16 :BS_NODE WARN: {NWDC01@distconf.cpp:397} StateFunc too long Type# 268639239 Duration# 0.037691s
2025-11-03T16:53:21.885312Z node 15 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-11-03T16:53:21.886529Z node 15 :NET_CLASSIFIER WARN: net_classifier.cpp:190: distributable config is empty, broken or outdated, will use file: /home/runner/.ya/build/build_root/7jz3/001998/r3tmp/yandexPnrtmS.tmp
2025-11-03T16:53:21.886562Z node 15 :NET_CLASSIFIER WARN: net_classifier.cpp:196: will try to initialize from file: /home/runner/.ya/build/build_root/7jz3/001998/r3tmp/yandexPnrtmS.tmp
2025-11-03T16:53:21.886777Z node 15 :NET_CLASSIFIER WARN: net_classifier.cpp:202: successfully initialized from file: /home/runner/.ya/build/build_root/7jz3/001998/r3tmp/yandexPnrtmS.tmp
2025-11-03T16:53:21.887044Z node 15 :NET_CLASSIFIER ERROR: net_classifier.cpp:228: got bad distributable configuration
2025-11-03T16:53:21.926910Z node 16 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-11-03T16:53:21.950550Z INFO: TTestServer started on Port 17628 GrpcPort 5660
2025-11-03T16:53:21.951484Z node 15 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-11-03T16:53:22.193434Z node 16 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
TClient is connected to server localhost:17628
PQClient connected to localhost:5660
WaitRootIsUp 'Root'...
TClient::Ls request: Root
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "Root"
    PathId: 1
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 1
    CreateStep: 0
    ParentPathId: 1
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 1
      SubDomainVersion: 0
      SecurityStateVersion: 0
    }
    ChildrenExist: false
  }
  Children {
    Name: ".sys"
    PathId: 18446744073709551615
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 0
    CreateStep: 0
    ParentPathId: 18446744073709551615
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 0
      Pl...
(TRUNCATED)
WaitRootIsUp 'Root' success.
2025-11-03T16:53:22.570175Z node 15 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpAlterSubDomain, opId: 281474976710657:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_alter_subdomain.cpp:311)
waiting...
waiting...
waiting...
waiting...
2025-11-03T16:53:25.872870Z node 15 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[15:7568543269350237375:2080];send_to=[0:7307199536658146131:7762515];
2025-11-03T16:53:25.872952Z node 15 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
2025-11-03T16:53:29.532211Z node 16 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [16:7568543308177537026:2307], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-03T16:53:29.534067Z node 16 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [16:7568543308177536999:2304], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-03T16:53:29.534189Z node 16 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-03T16:53:29.540403Z node 16 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [16:7568543308177537045:2309], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-03T16:53:29.540577Z node 16 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-03T16:53:29.549380Z node 15 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateResourcePool, opId: 281474976720657:3, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_resource_pool.cpp:179)
2025-11-03T16:53:29.616233Z node 16 :KQP_WORKLOAD_SERVICE WARN: helpers.h:73: [WorkloadService] [TPoolCreatorActor] ActorId: [16:7568543308177537028:2308], DatabaseId: /Root, PoolId: default, Scheduled retry for error: { <main>: Error: Transaction 281474976720657 completed, doublechecking }
2025-11-03T16:53:29.726035Z node 16 :TX_PROXY ERROR: schemereq.cpp:593: Actor# [16:7568543308177537058:2150] txid# 281474976720658, issues: { message: "Check failed: path: \'/Root/.metadata/workload_manager/pools/default\', error: path exist, request accepts it (id: [OwnerId: 72057594046644480, LocalPathId: 8], type: EPathTypeResourcePool, state: EPathStateNoChanges)" severity: 1 }
2025-11-03T16:53:29.850687Z node 16 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:570: Compilation failed, self: [16:7568543308177537065:2313], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-11-03T16:53:29.850962Z node 16 :KQP_SESSION WARN: kqp_session_actor.cpp:2506: SessionId: ydb://session/3?node_id=16&id=NTcyMzQ1ZmYtMzFhYzA0MzQtOTc2MjQ3MWMtN2FmZjAyZTc=, ActorId: [16:7568543308177536996:2302], ActorState: ExecuteState, TraceId: 01k95a6n9fa3565z8v4anz3ngz, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-11-03T16:53:29.851529Z node 16 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-11-03T16:53:29.869243Z node 15 :KQP_PROXY ERROR: kqp_proxy_service.cpp:1316: TraceId: "01k95a6esgcq813xdj2k6h7b9n", Request deadline has expired for 2.016231s seconds
2025-11-03T16:53:29.968863Z node 15 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710661:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:690)
2025-11-03T16:53:29.986448Z node 15 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:570: Compilation failed, self: [15:7568543308004944145:2343], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-11-03T16:53:29.986772Z node 15 :KQP_SESSION WARN: kqp_session_actor.cpp:2506: SessionId: ydb://session/3?node_id=15&id=YjViZTc1YzYtODIzYmM0MzQtOTY3ODk1YzUtNWUzZmUyNGQ=, ActorId: [15:7568543308004944103:2336], ActorState: ExecuteState, TraceId: 01k95a6nmd6qxrf92xdry8v4tp, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-11-03T16:53:29.987342Z node 15 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-11-03T16:53:30.196862Z node 15 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710662:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:690)
2025-11-03T16:53:30.575924Z node 15 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710663:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:690)
=== Init DC: UPSERT INTO `/Root/PQ/Config/V2/Cluster` (name, balancer, local, enabled, weight) VALUES ("dc1", "localhost:5660", true, true, 1000);
2025-11-03T16:53:31.229000Z node 15 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976710664. Ctx: { TraceId: 01k95a6pjvep0451t3gssrh91h, Database: , SessionId: ydb://session/3?node_id=15&id=ZjVkZDIxNWItOWM5NmVjODctMzk1YzJhNGMtODA0MmNmNWQ=, PoolId: default, DatabaseId: /Root}. Database not set, use /Root
=== CheckClustersList. Subcribe to ClusterTracker from [15:7568543316594879176:3015] 
2025-11-03T16:53:36.393537Z node 15 :FLAT_TX_SCHEMESHARD WARN: schemeshard_impl.cpp:7727: Cannot get console configs
2025-11-03T16:53:36.393578Z node 15 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
=== CheckClustersList. Ok
2025-11-03T16:53:40.460854Z node 15 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710669:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:690)
waiting...
PQ Client: create topic: rt3.dc1--test-topic with 1 partitions
CallPersQueueGRPC request to localhost:5660
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
CallPersQueueGRPC request to localhost:5660
MetaRequest {
  CmdCreateTopic {
    Topic: "rt3.dc1--test-topic"
    NumPartitions: 1
    Config {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
  }
}
2025-11-03T16:53:40.605113Z node 15 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
Status: 129
ProxyErrorCode: 53
SchemeStatus: 1
FlatTxId {
  TxId: 281474976710670
  SchemeShardTabletId: 72057594046644480
  PathId: 13
}
ErrorCode: OK
AddTopic: rt3.dc1--test-topic
===Run query:``DECLARE $version as Int64; DECLARE $path AS Utf8; DECLARE $cluster as Utf8; UPSERT INTO `/Root/PQ/Config/V2/Topics` (path, dc) VALUES ($path, $cluster); UPSERT INTO `/Root/PQ/Config/V2/Versions` (name, version) VALUES ("Topics", $version);`` with topic = test-topic, dc = dc1
2025-11-03T16:53:40.692650Z node 15 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1655: [72075186224037893][] pipe [15:7568543355249585286:3296] connected; active server actors: 1
2025-11-03T16:53:40.692861Z node 15 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1519: [72075186224037893][rt3.dc1--test-topic] updating configuration. Deleted partitions []. Added partitions [0]
2025-11-03T16:53:40.694344Z node 16 :PERSQUEUE DEBUG: pq_impl.cpp:2960: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-11-03T16:53:40.698226Z node 15 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:971: [72075186224037893][rt3.dc1--test-topic] Discovered subdomain [OwnerId: 72057594046644480, LocalPathId: 1] state, outOfSpace = 0 at RB 72075186224037893
2025-11-03T16:53:40.701073Z node 15 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:140: [72075186224037893][rt3.dc1--test-topic] BALANCER INIT DONE for rt3.dc1--test-topic: (0, 72075186224037892) 
2025-11-03T16:53:40.702007Z node 16 :PERSQUEUE DEBUG: pq_impl.cpp:2992: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-11-03T16:53:40.702420Z node 16 :PERSQUEUE DEBUG: pq_impl.cpp:787: [PQ: 72075186224037892] no config, start with empty partitions and default config
2025-11-03T16:53:40.702463Z node 16 :PERSQUEUE NOTICE: pq_impl.cpp:913: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-11-03T16:53:40.702519Z node 16 :PERSQUEUE INFO: pq_impl.cpp:612: [PQ: 72075186224037892] doesn't have tx writes info
2025-11-03T16:53:40.704121Z node 15 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:404: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 16, Generation 1
2025-11-03T16:53:40.703439Z node 16 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [15:7568543355249585319:2455], now have 1 active actors on pipe
2025-11-03T16:53:40.703470Z node 16 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [15:7568543355249585285:3295], now have 1 active actors on pipe
2025-11-03T16:53:40.705792Z node 16 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-03T16:53:40.719959Z node 16 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-03T16:53:40.738835Z node 16 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [15:7568543355249585345:3342], now have 1 active actors on pipe
2025-11-03T16:53:40.739193Z node 16 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-03T16:53:40.755036Z node 16 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-03T16:53:40.756358Z node 16 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-11-03T16:53:40.756437Z node 16 :PERSQUEUE DEBUG: partition.cpp:1312: [72075186224037892][Partition][0][StateInit] HandleOnInit TEvPQ::TEvProposePartitionConfig
2025-11-03T16:53:40.756836Z node 16 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-11-03T16:53:40.757109Z node 16 :PERSQUEUE INFO: partition_init.cpp:1101: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [16:7568543355422177789:2393]
2025-11-03T16:53:40.762910Z node 16 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-11-03T16:53:40.762960Z node 16 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-11-03T16:53:40.762995Z node 16 :PERSQUEUE INFO: partition.cpp:707: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1 [16:7568543355422177789:2393]
2025-11-03T16:53:40.763035Z node 16 :PERSQUEUE DEBUG: partition.cpp:727: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 0 Head Offset 0 PartNo 0 PackedSize 0 count 0 nextOffset 0 batches 0
2025-11-03T16:53:40.763086Z node 16 :PERSQUEUE DEBUG: partition_mlp.cpp:83: [72075186224037892][Partition][0][StateIdle] Initializing MLP Consumers: 0
2025-11-03T16:53:40.767385Z node 16 :PERSQUEUE DEBUG: partition.cpp:4273: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 1
2025-11-03T16:53:40.767448Z node 16 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:53:40.767575Z node 16 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:53:40.767594Z node 16 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-03T16:53:40.767625Z node 16 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-11-03T16:53:40.767645Z node 16 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-11-03T16:53:40.767663Z node 16 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:53:40.767682Z node 16 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-11-03T16:53:40.767723Z node 16 :PERSQUEUE DEBUG: partition_read.cpp:923: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-11-03T16:53:40.767776Z node 16 :PERSQUEUE DEBUG: partition_mlp.cpp:60: [72075186224037892][Partition][0][StateIdle] Process MLP pending events. Count 0
2025-11-03T16:53:40.768264Z node 16 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-03T16:53:40.768454Z node 16 :PERSQUEUE DEBUG: partition_compaction.cpp:183: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:53:40.785271Z node 16 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-03T16:53:40.785449Z node 16 :PERSQUEUE DEBUG: partition.cpp:1416: [72075186224037892][Partition][0][StateIdle] Handle TEvPQ::TEvTxCommit Step 1762188820777, TxId 281474976710670
2025-11-03T16:53:40.785483Z node 16 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-11-03T16:53:40.785500Z node 16 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:53:40.785660Z node 16 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:53:40.785938Z node 16 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-03T16:53:40.794192Z node 16 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-03T16:53:40.794424Z node 16 :PERSQUEUE DEBUG: partition_mlp.cpp:83: [72075186224037892][Partition][0][StateIdle] Initializing MLP Consumers: 0
2025-11-03T16:53:40.794574Z node 16 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-11-03T16:53:40.794606Z node 16 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:53:40.794621Z node 16 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:53:40.794639Z node 16 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:53:40.794678Z node 16 :PERSQUEUE DEBUG: partition_compaction.cpp:183: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:53:40.795087Z node 16 :PERSQUEUE DEBUG: pq_impl.cpp:398: [PQ: 72075186224037892] Apply new config PartitionConfig { LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 } PartitionIds: 0 TopicName: "rt3.dc1--test-topic" Version: 0 LocalDC: true Codecs { Ids: 0 Ids: 1 Ids: 2 Codecs: "raw" Codecs: "gzip" Codecs: "lzop" } TopicPath: "/Root/PQ/rt3.dc1--test-topic" YcCloudId: "" YcFolderId: "" YdbDatabaseId: "" YdbDatabasePath: "/Root" Partitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } AllPartitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } Consumers { Name: "user" ReadFromTimestampsMs: 0 FormatVersion: 0 Version: 0 Generation: 0 } MonitoringProjectId: ""
2025-11-03T16:53:40.795212Z node 16 :PERSQUEUE NOTICE: pq_impl.cpp:913: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-11-03T16:53:40.795537Z node 16 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-03T16:53:40.813397Z node 16 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-03T16:53:40.813538Z node 16 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-03T16:53:40.830911Z node 16 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-03T16:53:40.845894Z node 15 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976710671. Ctx: { TraceId: 01k95a7060ecvqpv5wc17fxxcv, Database: , SessionId: ydb://session/3?node_id=15&id=OGIwNDFiNTYtOGQyMDEyZjAtMmYzZGUwYTYtOWE3Yzg3ZGM=, PoolId: default, DatabaseId: /Root}. Database not set, use /Root
2025-11-03T16:53:40.867697Z node 16 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:53:40.867735Z node 16 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:53:40.867756Z node 16 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
===Query complete
TClient::Ls request: /Root/PQ/rt3.dc1--test-topic
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976710670
    CreateStep: 1762188820777
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts...
(TRUNCATED)
GetTopicVersionFromPath:  record Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976710670
    CreateStep: 1762188820777
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      YdbDatabasePath: "/Root"
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
    Partitions {
      PartitionId: 0
      TabletId: 72075186224037892
      Status: Active
    }
    AlterVersion: 1
    BalancerTabletID: 72075186224037893
    NextPartitionId: 1
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 1
      PlanResolution: 7
      Coordinators: 72057594046316545
      TimeCastBucketsPerMediator: 2
      Mediators: 72057594046382081
    }
    DomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    PathsInside: 12
    PathsLimit: 10000
    ShardsInside: 6
    ShardsLimit: 200000
    ResourcesDomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    DiskSpaceUsage {
      Tables {
        TotalSize: 1312
        DataSize: 1312
        IndexSize: 0
      }
      Topics {
        ReserveSize: 0
        AccountSize: 0
        DataSize: 0
        UsedReserveSize: 0
      }
    }
    PQPartitionsInside: 1
    PQPartitionsLimit: 1000000
    SchemeLimits {
      MaxDepth: 32
      MaxPaths: 10000
      MaxChildrenInDir: 100000
      MaxAclBytesSize: 10240
      MaxTableColumns: 200
      MaxTableColumnNameLength: 255
      MaxTableKeyColumns: 30
      MaxTableIndices: 20
      MaxShards: 200000
      MaxShardsInPath: 35000
      MaxConsistentCopyTargets: 10000
      MaxPathElementLength: 255
      ExtraPathSymbolsAllowed: "!\"#$%&\'()*+,-.:;<=>?@[\\]^_`{|}~"
      MaxPQPartitions: 1000000
      MaxTableCdcStreams: 5
      MaxExports: 10
      MaxImports: 10
      MaxColumnTableColumns: 10000
    }
  }
}
Path: "/Root/PQ/rt3.dc1--test-topic"
 name rt3.dc1--test-topic version1
CallPersQueueGRPC request to localhost:5660
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-11-03T16:53:40.920489Z node 15 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
MetaResponse {
  CmdGetTopicMetadataResult {
    TopicInfo {
      Topic: "rt3.dc1--test-topic"
      NumPartitions: 1
      Config {
        PartitionConfig {
          LifetimeSeconds: 86400
          LowWatermark: 8388608
          SourceIdLifetimeSeconds: 86400
          WriteSpeedInBytesPerSecond: 20000000
          BurstSize: 20000000
          SourceIdMaxCounts: 6000000
        }
        Version: 1
        LocalDC: true
        Codecs {
          Ids: 0
          Ids: 1
          Ids: 2
          Codecs: "raw"
          Codecs: "gzip"
          Codecs: "lzop"
        }
        TopicPath: "/Root/PQ/rt3.dc1--test-topic"
        YdbDatabasePath: "/Root"
        Consumers {
          Name: "user"
          ReadFromTimestampsMs: 0
          FormatVersion: 0
          Version: 0
        }
      }
      ErrorCode: OK
    }
  }
}
=== Topic created, have version: 1
2025-11-03T16:53:40.950917Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: try to update token
2025-11-03T16:53:40.951386Z :INFO: [] MessageGroupId [src] SessionId [] Write session: Do CDS request
2025-11-03T16:53:40.951430Z :INFO: [] MessageGroupId [src] SessionId [] Start write session. Will connect to endpoint: localhost:5660
2025-11-03T16:53:40.968221Z node 16 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:53:40.968266Z node 16 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:53:40.968292Z node 16 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:53:40.990543Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src" }
2025-11-03T16:53:40.993356Z node 15 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-11-03T16:53:40.993398Z node 15 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1
2025-11-03T16:53:40.994054Z node 15 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src" }
2025-11-03T16:53:40.994192Z node 15 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1 topic: "test-topic" message_group_id: "src" from ipv6:[::1]:38774
2025-11-03T16:53:40.994213Z node 15 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:38774 proto=v1  topic=test-topic durationSec=0
2025-11-03T16:53:40.994224Z node 15 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-11-03T16:53:40.996501Z node 15 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1 sessionId:  describe result for acl check
2025-11-03T16:53:40.996660Z node 15 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-11-03T16:53:40.996676Z node 15 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-11-03T16:53:40.996691Z node 15 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-11-03T16:53:40.996715Z node 15 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [15:7568543355249585434:2474] (SourceId=src, PreferedPartition=(NULL)) StartKqpSession
2025-11-03T16:53:41.007198Z node 15 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [15:7568543355249585434:2474] (SourceId=src, PreferedPartition=(NULL)) Select from the table
2025-11-03T16:53:41.071210Z node 16 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:53:41.071256Z node 16 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:53:41.071278Z node 16 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:53:41.172173Z node 16 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:53:41.172218Z node 16 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:53:41.172249Z node 16 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:53:41.273004Z node 16 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:53:41.273057Z node 16 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:53:41.273078Z node 16 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:53:41.377670Z node 16 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:53:41.377710Z node 16 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:53:41.377730Z node 16 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:53:41.439889Z node 15 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [15:7568543355249585434:2474] (SourceId=src, PreferedPartition=(NULL)) RequestPQRB
2025-11-03T16:53:41.440624Z node 15 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1655: [72075186224037893][rt3.dc1--test-topic] pipe [15:7568543359544552775:2474] connected; active server actors: 1
2025-11-03T16:53:41.440683Z node 15 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [15:7568543355249585434:2474] (SourceId=src, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=src
2025-11-03T16:53:41.440708Z node 15 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [15:7568543355249585434:2474] (SourceId=src, PreferedPartition=(NULL)) Update the table
2025-11-03T16:53:41.441157Z node 15 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1659: [72075186224037893][rt3.dc1--test-topic] pipe [15:7568543359544552775:2474] disconnected.
2025-11-03T16:53:41.441189Z node 15 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1670: [72075186224037893][rt3.dc1--test-topic] pipe [15:7568543359544552775:2474] disconnected; active server actors: 1
2025-11-03T16:53:41.441213Z node 15 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1695: [72075186224037893][rt3.dc1--test-topic] pipe [15:7568543359544552775:2474] disconnected no session
2025-11-03T16:53:41.478766Z node 16 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:53:41.478810Z node 16 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:53:41.478831Z node 16 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:53:41.581121Z node 16 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:53:41.581159Z node 16 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:53:41.581179Z node 16 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:53:41.682600Z node 16 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:53:41.682640Z node 16 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:53:41.682659Z node 16 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:53:41.683036Z node 15 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [15:7568543355249585434:2474] (SourceId=src, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-11-03T16:53:41.683090Z node 15 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [15:7568543355249585434:2474] (SourceId=src, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-11-03T16:53:41.683113Z node 15 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [15:7568543355249585434:2474] (SourceId=src, PreferedPartition=(NULL)) Start idle
2025-11-03T16:53:41.683150Z node 15 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-11-03T16:53:41.690122Z node 16 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [15:7568543359544552813:2474], now have 1 active actors on pipe
2025-11-03T16:53:41.690531Z node 15 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 16, Generation: 1
2025-11-03T16:53:41.690947Z node 16 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:53:41.690988Z node 16 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:53:41.691084Z node 16 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src|29171cf8-8fc76f47-4822d80e-4e017628_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src
2025-11-03T16:53:41.691133Z node 16 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:53:41.691164Z node 16 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:53:41.691181Z node 16 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-03T16:53:41.691231Z node 16 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:53:41.691280Z node 16 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-03T16:53:41.691342Z node 16 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-03T16:53:41.701864Z node 16 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:53:41.701920Z node 16 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:53:41.702030Z node 16 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-03T16:53:41.704368Z node 15 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1 partition: 0 MaxSeqNo: 0 sessionId: src|29171cf8-8fc76f47-4822d80e-4e017628_0
2025-11-03T16:53:41.709529Z :INFO: [] MessageGroupId [src] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1762188821709 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-11-03T16:53:41.709695Z :INFO: [] MessageGroupId [src] SessionId [] Write session established. Init response: session_id: "src|29171cf8-8fc76f47-4822d80e-4e017628_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-11-03T16:53:41.709952Z :INFO: [] MessageGroupId [src] SessionId [src|29171cf8-8fc76f47-4822d80e-4e017628_0] Write session: close. Timeout = 0 ms
2025-11-03T16:53:41.710011Z :INFO: [] MessageGroupId [src] SessionId [src|29171cf8-8fc76f47-4822d80e-4e017628_0] Write session will now close
2025-11-03T16:53:41.710064Z :DEBUG: [] MessageGroupId [src] SessionId [src|29171cf8-8fc76f47-4822d80e-4e017628_0] Write session: aborting
2025-11-03T16:53:41.710656Z :INFO: [] MessageGroupId [src] SessionId [src|29171cf8-8fc76f47-4822d80e-4e017628_0] Write session: gracefully shut down, all writes complete
2025-11-03T16:53:41.710710Z :DEBUG: [] MessageGroupId [src] SessionId [src|29171cf8-8fc76f47-4822d80e-4e017628_0] Write session: destroy
2025-11-03T16:53:41.712123Z node 15 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId: src|29171cf8-8fc76f47-4822d80e-4e017628_0 grpc read done: success: 0 data: 
2025-11-03T16:53:41.720645Z node 16 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [15:7568543359544552813:2474] destroyed
2025-11-03T16:53:41.720705Z node 16 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-11-03T16:53:41.720741Z node 16 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:53:41.720759Z node 16 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:53:41.720775Z node 16 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:53:41.712158Z node 15 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 1 sessionId: src|29171cf8-8fc76f47-4822d80e-4e017628_0 grpc read failed
2025-11-03T16:53:41.712197Z node 15 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 1 sessionId: src|29171cf8-8fc76f47-4822d80e-4e017628_0 grpc closed
2025-11-03T16:53:41.712222Z node 15 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1 sessionId: src|29171cf8-8fc76f47-4822d80e-4e017628_0 is DEAD
2025-11-03T16:53:41.718848Z node 15 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-11-03T16:53:41.783593Z node 16 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:53:41.783635Z node 16 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:53:41.783654Z node 16 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:53:41.844316Z :INFO: [/Root] [/Root] [758cc37a-b6fc4a25-25d59c3b-3f920b07] Starting read session
2025-11-03T16:53:41.844372Z :DEBUG: [/Root] [/Root] [758cc37a-b6fc4a25-25d59c3b-3f920b07] Starting cluster discovery
2025-11-03T16:53:41.844647Z :INFO: [/Root] [/Root] [758cc37a-b6fc4a25-25d59c3b-3f920b07] Cluster discovery request failed. Status: TRANSPORT_UNAVAILABLE. Issues: "<main>: Error: GRpc error: (14): connections to all backends failing; last error: UNKNOWN: ipv4:127.0.0.1:5660: Failed to connect to remote host: Connection refused <main>: Error: Grpc error response on endpoint localhost:5660 <main>: Error: Endpoint list is empty for database /Root, cluster endpoint localhost:5660. "
2025-11-03T16:53:41.844697Z :DEBUG: [/Root] [/Root] [758cc37a-b6fc4a25-25d59c3b-3f920b07] Restart cluster discovery in 0.007634s
2025-11-03T16:53:41.855593Z :DEBUG: [/Root] [/Root] [758cc37a-b6fc4a25-25d59c3b-3f920b07] Starting cluster discovery
2025-11-03T16:53:41.856003Z :INFO: [/Root] [/Root] [758cc37a-b6fc4a25-25d59c3b-3f920b07] Cluster discovery request failed. Status: TRANSPORT_UNAVAILABLE. Issues: "<main>: Error: GRpc error: (14): connections to all backends failing; last error: UNKNOWN: ipv4:127.0.0.1:5660: Failed to connect to remote host: Connection refused <main>: Error: Grpc error response on endpoint localhost:5660 <main>: Error: Endpoint list is empty for database /Root, cluster endpoint localhost:5660. "
2025-11-03T16:53:41.856067Z :DEBUG: [/Root] [/Root] [758cc37a-b6fc4a25-25d59c3b-3f920b07] Restart cluster discovery in 0.019448s
2025-11-03T16:53:41.877271Z :DEBUG: [/Root] [/Root] [758cc37a-b6fc4a25-25d59c3b-3f920b07] Starting cluster discovery
2025-11-03T16:53:41.877527Z :INFO: [/Root] [/Root] [758cc37a-b6fc4a25-25d59c3b-3f920b07] Cluster discovery request failed. Status: TRANSPORT_UNAVAILABLE. Issues: "<main>: Error: GRpc error: (14): connections to all backends failing; last error: UNKNOWN: ipv4:127.0.0.1:5660: Failed to connect to remote host: Connection refused <main>: Error: Grpc error response on endpoint localhost:5660 <main>: Error: Endpoint list is empty for database /Root, cluster endpoint localhost:5660. "
2025-11-03T16:53:41.877568Z :DEBUG: [/Root] [/Root] [758cc37a-b6fc4a25-25d59c3b-3f920b07] Restart cluster discovery in 0.035510s
2025-11-03T16:53:41.888149Z node 16 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:53:41.888189Z node 16 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:53:41.888208Z node 16 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:53:41.914466Z :DEBUG: [/Root] [/Root] [758cc37a-b6fc4a25-25d59c3b-3f920b07] Starting cluster discovery
2025-11-03T16:53:41.914839Z :NOTICE: [/Root] [/Root] [758cc37a-b6fc4a25-25d59c3b-3f920b07] Aborting read session. Description: SessionClosed { Status: TRANSPORT_UNAVAILABLE Issues: "<main>: Error: Failed to discover clusters     <main>: Error: GRpc error: (14): connections to all backends failing; last error: UNKNOWN: ipv4:127.0.0.1:5660: Failed to connect to remote host: Connection refused     <main>: Error: Grpc error response on endpoint localhost:5660     <main>: Error: Endpoint list is empty for database /Root, cluster endpoint localhost:5660. " }
2025-11-03T16:53:41.916124Z :NOTICE: [/Root] [/Root] [758cc37a-b6fc4a25-25d59c3b-3f920b07] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
SessionClosed { Status: TRANSPORT_UNAVAILABLE Issues: "<main>: Error: Failed to discover clusters     <main>: Error: GRpc error: (14): connections to all backends failing; last error: UNKNOWN: ipv4:127.0.0.1:5660: Failed to connect to remote host: Connection refused     <main>: Error: Grpc error response on endpoint localhost:5660     <main>: Error: Endpoint list is empty for database /Root, cluster endpoint localhost:5660. " }
2025-11-03T16:53:41.916278Z :INFO: [/Root] [/Root] [758cc37a-b6fc4a25-25d59c3b-3f920b07] Closing read session. Close timeout: 0.000000s
2025-11-03T16:53:41.916402Z :NOTICE: [/Root] [/Root] [758cc37a-b6fc4a25-25d59c3b-3f920b07] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
2025-11-03T16:53:41.989155Z node 16 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:53:41.989196Z node 16 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:53:41.989218Z node 16 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:53:42.092569Z node 16 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:53:42.092608Z node 16 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:53:42.092629Z node 16 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:13.642447Z :ReadSession INFO: Random seed for debugging is 1762188673642411
2025-11-03T16:51:14.166438Z node 1 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[1:7568542724227415053:2074];send_to=[0:7307199536658146131:7762515];
2025-11-03T16:51:14.166487Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
2025-11-03T16:51:14.281947Z node 1 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-11-03T16:51:14.321515Z node 2 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[2:7568542725514997072:2087];send_to=[0:7307199536658146131:7762515];
2025-11-03T16:51:14.323406Z node 2 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
2025-11-03T16:51:14.342357Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-11-03T16:51:14.342676Z node 2 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:123: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, got undelivered to scheme cache: ActorUnknown
test_client.cpp: SetPath # /home/runner/.ya/build/build_root/7jz3/00197c/r3tmp/tmpgCsCMN/pdisk_1.dat
2025-11-03T16:51:14.650100Z node 2 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-11-03T16:51:14.656101Z node 1 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-11-03T16:51:14.724511Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(1, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-11-03T16:51:14.724613Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(1, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-11-03T16:51:14.725325Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(2, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-11-03T16:51:14.725389Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(2, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-11-03T16:51:14.747080Z node 1 :HIVE WARN: hive_impl.cpp:811: HIVE#72057594037968897 Handle TEvInterconnect::TEvNodeConnected, NodeId 2 Cookie 2
2025-11-03T16:51:14.747246Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(1, (0,0,0,0)) VolatileState: Connecting -> Connected
2025-11-03T16:51:14.752500Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(2, (0,0,0,0)) VolatileState: Connecting -> Connected
2025-11-03T16:51:14.852285Z node 1 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
TServer::EnableGrpc on GrpcPort 21237, node 1
2025-11-03T16:51:14.900464Z node 2 :BS_NODE WARN: {NWDC01@distconf.cpp:397} StateFunc too long Type# 268639238 Duration# 0.007326s
2025-11-03T16:51:14.917841Z node 1 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-11-03T16:51:15.053253Z node 2 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-11-03T16:51:15.083450Z node 1 :NET_CLASSIFIER WARN: net_classifier.cpp:190: distributable config is empty, broken or outdated, will use file: /home/runner/.ya/build/build_root/7jz3/00197c/r3tmp/yandexuElzgh.tmp
2025-11-03T16:51:15.083474Z node 1 :NET_CLASSIFIER WARN: net_classifier.cpp:196: will try to initialize from file: /home/runner/.ya/build/build_root/7jz3/00197c/r3tmp/yandexuElzgh.tmp
2025-11-03T16:51:15.106903Z node 1 :NET_CLASSIFIER WARN: net_classifier.cpp:202: successfully initialized from file: /home/runner/.ya/build/build_root/7jz3/00197c/r3tmp/yandexuElzgh.tmp
2025-11-03T16:51:15.112238Z node 1 :NET_CLASSIFIER ERROR: net_classifier.cpp:228: got bad distributable configuration
2025-11-03T16:51:15.169929Z INFO: TTestServer started on Port 18912 GrpcPort 21237
2025-11-03T16:51:15.219855Z node 1 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-11-03T16:51:15.328900Z node 2 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
TClient is connected to server localhost:18912
PQClient connected to localhost:21237
WaitRootIsUp 'Root'...
TClient::Ls request: Root
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "Root"
    PathId: 1
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 1
    CreateStep: 0
    ParentPathId: 1
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 1
      SubDomainVersion: 0
      SecurityStateVersion: 0
    }
    ChildrenExist: false
  }
  Children {
    Name: ".sys"
    PathId: 18446744073709551615
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 0
    CreateStep: 0
    ParentPathId: 18446744073709551615
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 0
      Pl...
(TRUNCATED)
WaitRootIsUp 'Root' success.
2025-11-03T16:51:15.701857Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpAlterSubDomain, opId: 281474976720657:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_alter_subdomain.cpp:311)
waiting...
waiting...
waiting...
2025-11-03T16:51:15.843482Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__notify.cpp:122: NotifyTxCompletion, unknown transaction, txId: 281474976720659, at schemeshard: 72057594046644480
waiting...
2025-11-03T16:51:18.786851Z node 2 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [2:7568542742694866558:2300], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-03T16:51:18.786902Z node 2 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [2:7568542742694866569:2303], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-03T16:51:18.786948Z node 2 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-03T16:51:18.787385Z node 2 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [2:7568542742694866573:2305], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-03T16:51:18.786667Z node 1 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [1:7568542741407285226:2331], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-03T16:51:18.787438Z node 2 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-03T16:51:18.786744Z node 1 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [1:7568542741407285213:2328], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-03T16:51:18.787019Z node 1 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-03T16:51:18.787704Z node 1 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [1:7568542741407285233:2334], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-03T16:51:18.787756Z node 1 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-03T16:51:18.790800Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateResourcePool, opId: 281474976720661:3, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_resource_pool.cpp:179)
2025-11-03T16:51:18.813646Z node 2 :TX_PROXY ERROR: schemereq.cpp:593: Actor# [2:7568542742694866575:2134] txid# 281474976715657, issues: { message: "Check failed: path: \'/Root/.metadata/workload_manager/pools/default\', error: path exists but creating right now (id: [OwnerId: 72057594046644480, LocalPathId: 8], type: EPathTypeResourcePool, state: EPathStateCreate)" severity: 1 }
2025-11-03T16:51:18.830402Z node 1 :KQP_WORKLOAD_SERVICE WARN: helpers.h:73: [WorkloadService] [TPoolCreatorActor] ActorId: [1:7568542741407285230:2332], DatabaseId: /Root, PoolId: default, Scheduled retry for error: { <main>: Error: Transaction 281474976720661 completed, doublechecking }
2025-11-03T16:51:18.832149Z node 2 :KQP_WORKLOAD_SERVICE WARN: helpers.h:73: [WorkloadService] [TPoolCreatorActor] ActorId: [2:7568542742694866572:2304], DatabaseId: /Root, PoolId: default, Scheduled retry for error: { <main>: Error: Transaction 281474976720661 completed, doublechecking }
2025-11-03T16:51:18.917180Z node 1 :TX_PROXY ERROR: schemereq.cpp:593: Actor# [1:7568542741407285321:2677] txid# 281474976720662, issues: { message: "Check failed: path: \'/Root/.metadata/workload_manager/pools/default\', error: path exist, request accepts it (id: [OwnerId: 72057594046644480, LocalPathId: 8], type: EPathTypeResourcePool, state: EPathStateNoChanges)" severity: 1 }
2025-11-03T16:51:18.933235Z node 2 :TX_PROXY ERROR: schemereq.cpp:593: Actor# [2:7568542742694866602:2140] txid# 281474976715658, issues: { message: "Check failed: path: \'/Root/.metadata/workload_manager/pools/default\', error: path exist, request accepts it (id: [OwnerId: 72057594046644480, LocalPathId: 8], type: EPathTypeResourcePool, state: EPathStateNoChanges)" severity: 1 }
2025-11-03T16:51:19.173308Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[1:7568542724227415053:2074];send_to=[0:7307199536658146131:7762515];
2025-11-03T16:51:19.173395Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
2025-11-03T16:51:19.175618Z node 1 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:570: Compilation failed, self: [1:7568542741407285331:2340], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-11-03T16:51:19.178042Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720663:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:690)
2025-11-03T16:51:19.178427Z node 1 :KQP_SESSION WARN: kqp_session_actor.cpp:2506: SessionId: ydb://session/3?node_id=1&id=OGZmMzRhMi1iYTllZmQ1LWU0M2JiMjFhLWMyMzlkZWVm, ActorId: [1:7568542741407285194:2327], ActorState: ExecuteState, TraceId: 01k95a2nm16h946rnexwm9sa02, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-11-03T16:51:19.176541Z node 2 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:570: Compilation failed, self: [2:7568542742694866609:2309], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-11-03T16:51:19.178629Z node 2 :KQP_SESSION WARN: kqp_session_actor.cpp:2506: SessionId: ydb://session/3?node_id=2&id=MjAyYjM5YjQtZGQyOWE4ZDUtYzc2MjI5NzgtYzFhOTdlNTE=, ActorId: [2:7568542742694866556:2299], ActorState: ExecuteState, TraceId: 01k95a2nm1a09mah7xkwm4c4gv, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-11-03T16:51:19.181476Z node 1 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-11-03T16:51:19.181755Z node 2 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-11-03T16:51:19.312066Z node 2 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[2:7568542725514997072:2087];send_to=[0:7307199536658146131:7762515];
2025-11-03T16:51:19.312141Z node 2 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
2025-11-03T16:51:19.366402Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720664:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:690)
2025-11-03T16:51:19.568265Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720665:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:690)
=== Init DC: UPSERT INTO `/Root/PQ/Config/V2/Cluster` (name, balancer, local, enabled, weight) VALUES ("dc1", "localhost:21237", true, true, 1000);
2025-11-03T16:51:19.836418Z node 1 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976720666. Ctx: { TraceId: 01k95a2pg8bs89145jr31463xz, Database: , SessionId: ydb://session/3?node_id=1&id=M2RlZjRlNDMtZGY1ZDJjZGYtNzhmNjU4ZjgtYzZhN2Y5ZGQ=, PoolId: default, DatabaseId: /Root}. Database not set, use /Root
=== CheckClustersList. Subcribe to ClusterTracker from [1:7568542745702253044:2984] 
=== CheckClustersList. Ok
2025-11-03T16:51:25.758447Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720671:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:690)
waiting...
PQ Client: create topic: rt3.dc1--test-topic with 1 partitions
CallPersQueueGRPC request to localhost:21237
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-11-03T16:51:25.908804Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
CallPersQueueGRPC request to localhost:21237
MetaRequest {
  CmdCreateTopic {
    Topic: "rt3.dc1--test-topic"
    NumPartitions: 1
    Config {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
  }
}
CallPersQueueGRPC response:
Status: 129
ProxyErrorCode: 53
SchemeStatus: 1
FlatTxId {
  TxId: 281474976720672
  SchemeShardTabletId: 72057594046644480
  PathId: 13
}
ErrorCode: OK
AddTopic: rt3.dc1--test-topic
===Run query:``DECLARE $version as Int64; DECLARE $path AS Utf8; DECLARE $cluster as Utf8; UPSERT INTO `/Root/PQ/Config/V2/Topics` (path, dc) VALUES ($path, $cluster); UPSERT INTO `/Root/PQ/Config/V2/Versions` (name, version) VALUES ("Topics", $version);`` with topic = test-topic, dc = dc1
2025-11-03T16:51:25.980830Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1655: [72075186224037893][] pipe [1:7568542771472057227:3247] connected; active server actors: 1
2025-11-03T16:51:25.981097Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1519: [72075186224037893][rt3.dc1--test-topic] updating configuration. Deleted partitions []. Added partitions [0]
2025-11-03T16:51:25.983951Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:971: [72075186224037893][rt3.dc1--test-topic] Discovered subdomain [OwnerId: 72057594046644480, LocalPathId: 1] state, outOfSpace = 0 at RB 72075186224037893
2025-11-03T16:51:25.988859Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:140: [72075186224037893][rt3.dc1--test-topic] BALANCER INIT DONE for rt3.dc1--test-topic: (0, 72075186224037892) 
2025-11-03T16:51:26.016093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2960: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-11-03T16:51:26.019443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2992: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-11-03T16:51:26.019743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:787: [PQ: 72075186224037892] no config, start with empty partitions and default config
2025-11-03T16:51:26.019792Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:913: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-11-03T16:51:26.019836Z node 2 :PERSQUEUE INFO: pq_impl.cpp:612: [PQ: 72075186224037892] doesn't have tx writes info
2025-11-03T16:51:26.021017Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:404: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1
2025-11-03T16:51:26.021133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [1:7568542771472057226:3246], now have 1 active actors on pipe
2025-11-03T16:51:26.021169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [1:7568542771472057238:2434], now have 1 active actors on pipe
2025-11-03T16:51:26.023143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-03T16:51:26.026688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-03T16:51:26.041372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [1:7568542775767024570:3285], now have 1 active actors on pipe
2025-11-03T16:51:26.043015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-03T16:51:26.048511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-03T16:51:26.049711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-11-03T16:51:26.049788Z node 2 :PERSQUEUE DEBUG: partition.cpp:1312: [72075186224037892][Partition][0][StateInit] HandleOnInit TEvPQ::TEvProposePartitionConfig
2025-11-03T16:51:26.050123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-11-03T16:51:26.050522Z node 2 :PERSQUEUE INFO: partition_init.cpp:1101: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7568542777054605431:2389]
2025-11-03T16:51:26.055784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-11-03T16:51:26.055818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-11-03T16:51:26.055845Z node 2 :PERSQUEUE INFO: partition.cpp:707: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1 [2:7568542777054605431:2389]
2025-11-03T16:51:26.055881Z node 2 :PERSQUEUE DEBUG: partition.cpp:727: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 0 Head Offset 0 PartNo 0 PackedSize 0 count 0 nextOffset 0 batches 0
2025-11-03T16:51:26.055919Z node 2 :PERSQUEUE DEBUG: partition_mlp.cpp:83: [72075186224037892][Partition][0][StateIdle] Initializing MLP Consumers: 0
2025-11-03T16:51:26.057447Z node 2 :PERSQUEUE DEBUG: partition.cpp:4273: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 1
2025-11-03T16:51:26.057499Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:26.057624Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:26.057636Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-03T16:51:26.057659Z node 2 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-11-03T16:51:26.057675Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:26.057691Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:26.057702Z node 2 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-11-03T16:51:26.057738Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:923: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-11-03T16:51:26.057782Z node 2 :PERSQUEUE DEBUG: partition_mlp.cpp:60: [72075186224037892][Partition][0][StateIdle] Process MLP pending events. Count 0
2025-11-03T16:51:26.058404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-03T16:51:26.058578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:183: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:51:26.072602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-03T16:51:26.072773Z node 2 :PERSQUEUE DEBUG: partition.cpp:1416: [72075186224037892][Partition][0][StateIdle] Handle TEvPQ::TEvTxCommit Step 1762188686076, TxId 281474976720672
2025-11-03T16:51:26.072798Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:26.072813Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:26.072959Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:26.073221Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-03T16:51:26.082455Z node 2 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-03T16:51:26.082675Z node 2 :PERSQUEUE DEBUG: partition_mlp.cpp:83: [72075186224037892][Partition][0][StateIdle] Initializing MLP Consumers: 0
2025-11-03T16:51:26.082825Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-11-03T16:51:26.082851Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:26.082865Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:26.082879Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:26.082915Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:183: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:51:26.083297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:398: [PQ: 72075186224037892] Apply new config PartitionConfig { LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 } PartitionIds: 0 TopicName: "rt3.dc1--test-topic" Version: 0 LocalDC: true Codecs { Ids: 0 Ids: 1 Ids: 2 Codecs: "raw" Codecs: "gzip" Codecs: "lzop" } TopicPath: "/Root/PQ/rt3.dc1--test-topic" YcCloudId: "" YcFolderId: "" YdbDatabaseId: "" YdbDatabasePath: "/Root" Partitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } AllPartitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } Consumers { Name: "user" ReadFromTimestampsMs: 0 FormatVersion: 0 Version: 0 Generation: 0 } MonitoringProjectId: ""
2025-11-03T16:51:26.083438Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:913: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-11-03T16:51:26.083749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-03T16:51:26.097687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-03T16:51:26.097816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-03T16:51:26.101558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-03T16:51:26.122576Z node 1 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976720673. Ctx: { TraceId: 01k95a2wn662gxmh1pcncc733k, Database: , SessionId: ydb://session/3?node_id=1&id=NGM5NmUzYjAtZmNiNDg2YjAtYWI4ODQ5NjMtZTY5MDk0NTY=, PoolId: default, DatabaseId: /Root}. Database not set, use /Root
===Query complete
TClient::Ls request: /Root/PQ/rt3.dc1--test-topic
2025-11-03T16:51:26.160422Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:26.160456Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:26.160473Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976720672
    CreateStep: 1762188686076
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts...
(TRUNCATED)
GetTopicVersionFromPath:  record Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976720672
    CreateStep: 1762188686076
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      YdbDatabasePath: "/Root"
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
    Partitions {
      PartitionId: 0
      TabletId: 72075186224037892
      Status: Active
    }
    AlterVersion: 1
    BalancerTabletID: 72075186224037893
    NextPartitionId: 1
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 1
      PlanResolution: 7
      Coordinators: 72057594046316545
      TimeCastBucketsPerMediator: 2
      Mediators: 72057594046382081
    }
    DomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    PathsInside: 12
    PathsLimit: 10000
    ShardsInside: 6
    ShardsLimit: 200000
    ResourcesDomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    DiskSpaceUsage {
      Tables {
        TotalSize: 0
        DataSize: 0
        IndexSize: 0
      }
      Topics {
        ReserveSize: 0
        AccountSize: 0
        DataSize: 0
        UsedReserveSize: 0
      }
    }
    PQPartitionsInside: 1
    PQPartitionsLimit: 1000000
    SchemeLimits {
      MaxDepth: 32
      MaxPaths: 10000
      MaxChildrenInDir: 100000
      MaxAclBytesSize: 10240
      MaxTableColumns: 200
      MaxTableColumnNameLength: 255
      MaxTableKeyColumns: 30
      MaxTableIndices: 20
      MaxShards: 200000
      MaxShardsInPath: 35000
      MaxConsistentCopyTargets: 10000
      MaxPathElementLength: 255
      ExtraPathSymbolsAllowed: "!\"#$%&\'()*+,-.:;<=>?@[\\]^_`{|}~"
      MaxPQPartitions: 1000000
      MaxTableCdcStreams: 5
      MaxExports: 10
      MaxImports: 10
      MaxColumnTableColumns: 10000
    }
  }
}
Path: "/Root/PQ/rt3.dc1--test-topic"
 name rt3.dc1--test-topic version1
CallPersQueueGRPC request to localhost:21237
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-11-03T16:51:26.168475Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
MetaResponse {
  CmdGetTopicMetadataResult {
    TopicInfo {
      Topic: "rt3.dc1--test-topic"
      NumPartitions: 1
      Config {
        PartitionConfig {
          LifetimeSeconds: 86400
          LowWatermark: 8388608
          SourceIdLifetimeSeconds: 86400
          WriteSpeedInBytesPerSecond: 20000000
          BurstSize: 20000000
          SourceIdMaxCounts: 6000000
        }
        Version: 1
        LocalDC: true
        Codecs {
          Ids: 0
          Ids: 1
          Ids: 2
          Codecs: "raw"
          Codecs: "gzip"
          Codecs: "lzop"
        }
        TopicPath: "/Root/PQ/rt3.dc1--test-topic"
        YdbDatabasePath: "/Root"
        Consumers {
          Name: "user"
          ReadFromTimestampsMs: 0
          FormatVersion: 0
          Version: 0
        }
      }
      ErrorCode: OK
    }
  }
}
=== Topic created, have version: 1
2025-11-03T16:51:26.182944Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: try to update token
2025-11-03T16:51:26.183826Z :INFO: [] MessageGroupId [src] SessionId [] Write session: Do CDS request
2025-11-03T16:51:26.183877Z :INFO: [] MessageGroupId [src] SessionId [] Start write session. Will connect to endpoint: localhost:21237
2025-11-03T16:51:26.204128Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-11-03T16:51:26.204172Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1
2025-11-03T16:51:26.211045Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src" }
2025-11-03T16:51:26.211859Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src" }
2025-11-03T16:51:26.212071Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1 topic: "test-topic" message_group_id: "src" from ipv6:[::1]:48616
2025-11-03T16:51:26.212097Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:48616 proto=v1  topic=test-topic durationSec=0
2025-11-03T16:51:26.212111Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-11-03T16:51:26.214088Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1 sessionId:  describe result for acl check
2025-11-03T16:51:26.214265Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-11-03T16:51:26.214295Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-11-03T16:51:26.214307Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-11-03T16:51:26.214377Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7568542775767024652:2452] (SourceId=src, PreferedPartition=(NULL)) StartKqpSession
2025-11-03T16:51:26.216867Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7568542775767024652:2452] (SourceId=src, PreferedPartition=(NULL)) Select from the table
2025-11-03T16:51:26.262029Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:26.262056Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:26.262075Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:26.365262Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:26.365296Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:26.365309Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:26.449106Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [1:7568542775767024652:2452] (SourceId=src, PreferedPartition=(NULL)) RequestPQRB
2025-11-03T16:51:26.449755Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1655: [72075186224037893][rt3.dc1--test-topic] pipe [1:7568542775767024690:2452] connected; active server actors: 1
2025-11-03T16:51:26.449868Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [1:7568542775767024652:2452] (SourceId=src, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=src
2025-11-03T16:51:26.449898Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7568542775767024652:2452] (SourceId=src, PreferedPartition=(NULL)) Update the table
2025-11-03T16:51:26.450298Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1659: [72075186224037893][rt3.dc1--test-topic] pipe [1:7568542775767024690:2452] disconnected.
2025-11-03T16:51:26.450327Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1670: [72075186224037893][rt3.dc1--test-topic] pipe [1:7568542775767024690:2452] disconnected; active server actors: 1
2025-11-03T16:51:26.450348Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1695: [72075186224037893][rt3.dc1--test-topic] pipe [1:7568542775767024690:2452] disconnected no session
2025-11-03T16:51:26.468109Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:26.468140Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:26.468152Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:26.567251Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:26.567288Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:26.567301Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:26.569985Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7568542775767024652:2452] (SourceId=src, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-11-03T16:51:26.570030Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7568542775767024652:2452] (SourceId=src, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-11-03T16:51:26.570052Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7568542775767024652:2452] (SourceId=src, PreferedPartition=(NULL)) Start idle
2025-11-03T16:51:26.570084Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-11-03T16:51:26.571066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [1:7568542775767024714:2452], now have 1 active actors on pipe
2025-11-03T16:51:26.571178Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1
2025-11-03T16:51:26.571406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:26.571450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:26.571544Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src|44fd90-b22ba2bb-fc52cb92-f3d2093f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src
2025-11-03T16:51:26.571602Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:26.571630Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:26.571644Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-03T16:51:26.571692Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:26.571743Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-03T16:51:26.571818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-03T16:51:26.572397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:26.572425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:26.572517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-03T16:51:26.572854Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1 partition: 0 MaxSeqNo: 0 sessionId: src|44fd90-b22ba2bb-fc52cb92-f3d2093f_0
2025-11-03T16:51:26.573787Z :INFO: [] MessageGroupId [src] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1762188686573 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-11-03T16:51:26.573928Z :INFO: [] MessageGroupId [src] SessionId [] Write session established. Init response: session_id: "src|44fd90-b22ba2bb-fc52cb92-f3d2093f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-11-03T16:51:26.574133Z :INFO: [] MessageGroupId [src] SessionId [src|44fd90-b22ba2bb-fc52cb92-f3d2093f_0] Write session: close. Timeout = 0 ms
2025-11-03T16:51:26.574167Z :INFO: [] MessageGroupId [src] SessionId [src|44fd90-b22ba2bb-fc52cb92-f3d2093f_0] Write session will now close
2025-11-03T16:51:26.574197Z :DEBUG: [] MessageGroupId [src] SessionId [src|44fd90-b22ba2bb-fc52cb92-f3d2093f_0] Write session: aborting
2025-11-03T16:51:26.574563Z :INFO: [] MessageGroupId [src] SessionId [src|44fd90-b22ba2bb-fc52cb92-f3d2093f_0] Write session: gracefully shut down, all writes complete
2025-11-03T16:51:26.574601Z :DEBUG: [] MessageGroupId [src] SessionId [src|44fd90-b22ba2bb-fc52cb92-f3d2093f_0] Write session: destroy
2025-11-03T16:51:26.575828Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId: src|44fd90-b22ba2bb-fc52cb92-f3d2093f_0 grpc read done: success: 0 data: 
2025-11-03T16:51:26.575854Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 1 sessionId: src|44fd90-b22ba2bb-fc52cb92-f3d2093f_0 grpc read failed
2025-11-03T16:51:26.575882Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 1 sessionId: src|44fd90-b22ba2bb-fc52cb92-f3d2093f_0 grpc closed
2025-11-03T16:51:26.575904Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1 sessionId: src|44fd90-b22ba2bb-fc52cb92-f3d2093f_0 is DEAD
2025-11-03T16:51:26.576759Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-11-03T16:51:26.577392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [1:7568542775767024714:2452] destroyed
2025-11-03T16:51:26.577446Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-11-03T16:51:26.577479Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:26.577495Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:26.577512Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:26.599066Z :DEBUG: [] MessageGroupId [test-message-group-id] SessionId [] Write session: try to update token
2025-11-03T16:51:26.599444Z :INFO: [] MessageGroupId [test-message-group-id] SessionId [] Write session: Do CDS request
2025-11-03T16:51:26.599528Z :INFO: [] MessageGroupId [test-message-group-id] SessionId [] Start write session. Will connect to endpoint: localhost:21237
2025-11-03T16:51:26.607519Z :ReadSession INFO: WriteToTopic: message1
2025-11-03T16:51:26.608979Z :DEBUG: [] MessageGroupId [test-message-group-id] SessionId [] Write session: send init request: init_request { topic: "test-topic" message_group_id: "test-message-group-id" }
2025-11-03T16:51:26.609489Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-11-03T16:51:26.609519Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2
2025-11-03T16:51:26.610326Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "test-message-group-id" }
2025-11-03T16:51:26.610438Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2 topic: "test-topic" message_group_id: "test-message-group-id" from ipv6:[::1]:48632
2025-11-03T16:51:26.610452Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:48632 proto=v1  topic=test-topic durationSec=0
2025-11-03T16:51:26.610462Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-11-03T16:51:26.611859Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2 sessionId:  describe result for acl check
2025-11-03T16:51:26.612000Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-11-03T16:51:26.612009Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-11-03T16:51:26.612017Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-11-03T16:51:26.612035Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7568542775767024725:2466] (SourceId=test-message-group-id, PreferedPartition=(NULL)) StartKqpSession
2025-11-03T16:51:26.614513Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7568542775767024725:2466] (SourceId=test-message-group-id, PreferedPartition=(NULL)) Select from the table
2025-11-03T16:51:26.622494Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [1:7568542775767024725:2466] (SourceId=test-message-group-id, PreferedPartition=(NULL)) RequestPQRB
2025-11-03T16:51:26.623004Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1655: [72075186224037893][rt3.dc1--test-topic] pipe [1:7568542775767024744:2466] connected; active server actors: 1
2025-11-03T16:51:26.623110Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [1:7568542775767024725:2466] (SourceId=test-message-group-id, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=test-message-group-id
2025-11-03T16:51:26.623125Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7568542775767024725:2466] (SourceId=test-message-group-id, PreferedPartition=(NULL)) Update the table
2025-11-03T16:51:26.623870Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1659: [72075186224037893][rt3.dc1--test-topic] pipe [1:7568542775767024744:2466] disconnected.
2025-11-03T16:51:26.623885Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1670: [72075186224037893][rt3.dc1--test-topic] pipe [1:7568542775767024744:2466] disconnected; active server actors: 1
2025-11-03T16:51:26.623898Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1695: [72075186224037893][rt3.dc1--test-topic] pipe [1:7568542775767024744:2466] disconnected no session
2025-11-03T16:51:26.634231Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7568542775767024725:2466] (SourceId=test-message-group-id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-11-03T16:51:26.634262Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7568542775767024725:2466] (SourceId=test-message-group-id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-11-03T16:51:26.634278Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7568542775767024725:2466] (SourceId=test-message-group-id, PreferedPartition=(NULL)) Start idle
2025-11-03T16:51:26.634301Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-11-03T16:51:26.635857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [1:7568542775767024761:2466], now have 1 active actors on pipe
2025-11-03T16:51:26.636065Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1
2025-11-03T16:51:26.636336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:26.636369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:26.636427Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie test-message-group-id|8177040c-7c172cfb-cd36cc20-97bd7714_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner test-message-group-id
2025-11-03T16:51:26.636459Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:26.636473Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:26.636482Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-03T16:51:26.636515Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:26.636560Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-03T16:51:26.636603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-03T16:51:26.637303Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2 partition: 0 MaxSeqNo: 0 sessionId: test-message-group-id|8177040c-7c172cfb-cd36cc20-97bd7714_0
2025-11-03T16:51:26.637017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:26.637044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:26.638017Z :INFO: [] MessageGroupId [test-message-group-id] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1762188686637 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-11-03T16:51:26.637087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-03T16:51:26.638118Z :INFO: [] MessageGroupId [test-message-group-id] SessionId [] Write session established. Init response: session_id: "test-message-group-id|8177040c-7c172cfb-cd36cc20-97bd7714_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-11-03T16:51:26.638366Z :DEBUG: [] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|8177040c-7c172cfb-cd36cc20-97bd7714_0] Write 1 messages with Id from 1 to 1
2025-11-03T16:51:26.638487Z :ReadSession INFO: WriteToTopic: message2
2025-11-03T16:51:26.638551Z :DEBUG: [] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|8177040c-7c172cfb-cd36cc20-97bd7714_0] Write 1 messages with Id from 2 to 2
2025-11-03T16:51:26.638602Z :INFO: [] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|8177040c-7c172cfb-cd36cc20-97bd7714_0] Write session: close. Timeout = 18446744073709551 ms
2025-11-03T16:51:26.638947Z :DEBUG: [] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|8177040c-7c172cfb-cd36cc20-97bd7714_0] Write session: try to update token
2025-11-03T16:51:26.638997Z :DEBUG: [] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|8177040c-7c172cfb-cd36cc20-97bd7714_0] Send 1 message(s) (1 left), first sequence number is 1
2025-11-03T16:51:26.639420Z :DEBUG: [] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|8177040c-7c172cfb-cd36cc20-97bd7714_0] Write session: try to update token
2025-11-03T16:51:26.639445Z :DEBUG: [] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|8177040c-7c172cfb-cd36cc20-97bd7714_0] Send 1 message(s) (0 left), first sequence number is 2
2025-11-03T16:51:26.640449Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: test-message-group-id|8177040c-7c172cfb-cd36cc20-97bd7714_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:51:26.640743Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:51:26.641264Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: test-message-group-id|8177040c-7c172cfb-cd36cc20-97bd7714_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:51:26.641450Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:51:26.641543Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:26.641253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:26.641286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:26.641367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-11-03T16:51:26.641805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:26.641821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:26.641887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1  requestId: <none> cookie: 2
2025-11-03T16:51:26.642289Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:26.642507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:26.642529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:26.642889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0test-message-group-id' SeqNo: 1 partNo : 0 messageNo: 2 size 99 offset: -1
2025-11-03T16:51:26.642936Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:51:26.642984Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:26.643015Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:26.643032Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-03T16:51:26.643149Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0test-message-group-id' seqNo 1 partNo 0
2025-11-03T16:51:26.644084Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0test-message-group-id' seqNo 1 partNo 0 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 188 count 1 nextOffset 1 batches 1
2025-11-03T16:51:26.644129Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:26.644713Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 0,1 HeadOffset 0 endOffset 0 curOffset 1 d0000000000_00000000000000000000_00000_0000000001_00000? size 176 WTime 1762188686643
2025-11-03T16:51:26.644862Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-03T16:51:26.644984Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 0 partNo 0 count 1 size 176
2025-11-03T16:51:26.646099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:26.646123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:26.646168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0test-message-group-id' SeqNo: 2 partNo : 0 messageNo: 3 size 99 offset: -1
2025-11-03T16:51:26.646197Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:51:26.646239Z node 2 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:51:26.647995Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 0 count 1 size 176 actorID [2:7568542777054605414:2389]
2025-11-03T16:51:26.648055Z node 2 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-03T16:51:26.648094Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 0 suffix '63' size 176
2025-11-03T16:51:26.648107Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 121 WriteNewSizeFromSupportivePartitions# 0
2025-11-03T16:51:26.648144Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:51:26.648201Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0test-message-group-id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 1, partNo: 0, Offset: 0 is stored on disk
2025-11-03T16:51:26.648756Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:923: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-11-03T16:51:26.648799Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:965: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-11-03T16:51:26.648822Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:26.648848Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:26.648860Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-03T16:51:26.648972Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0test-message-group-id' seqNo 2 partNo 0
2025-11-03T16:51:26.649898Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0test-message-group-id' seqNo 2 partNo 0 FormedBlobsCount 0 NewHead: Offset 1 PartNo 0 PackedSize 188 count 1 nextOffset 2 batches 1
2025-11-03T16:51:26.649932Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:26.650489Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 1,1 HeadOffset 1 endOffset 1 curOffset 2 d0000000000_00000000000000000001_00000_0000000001_00000? size 176 WTime 1762188686650
2025-11-03T16:51:26.650638Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:51:26.651136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 2  requestId: <none> cookie: 1
2025-11-03T16:51:26.651227Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-03T16:51:26.651324Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 1 partNo 0 count 1 size 176
2025-11-03T16:51:26.651527Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:880: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 partno 0 count 1 size 1024000 endOffset 1 max time lag 0ms effective offset 0
2025-11-03T16:51:26.651732Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1105: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 176 count 1 last offset 0, current partition end offset: 1
2025-11-03T16:51:26.651753Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1121: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-11-03T16:51:26.651827Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 0 partno 0 count 1 parts_count 0 source 1 size 176 accessed 0 times before, last time 2025-11-03T16:51:26.000000Z
2025-11-03T16:51:26.651865Z node 2 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 3. All 1 blobs are from cache.
2025-11-03T16:51:26.651966Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 0 suffix '63'
2025-11-03T16:51:26.652265Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:572: FormAnswer for 1 blobs
2025-11-03T16:51:26.652413Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 0 totakecount 1 count 1 size 156 from pos 0 cbcount 1
2025-11-03T16:51:26.652493Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1015: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1762188686642 queuesize 0 startOffset 0
2025-11-03T16:51:26.652122Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:26.652921Z :DEBUG: [] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|8177040c-7c172cfb-cd36cc20-97bd7714_0] Write session got write response: sequence_numbers: 1 offsets: 0 already_written: false write_statistics { persist_duration_ms: 4 }
2025-11-03T16:51:26.652966Z :DEBUG: [] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|8177040c-7c172cfb-cd36cc20-97bd7714_0] Write session: acknoledged message 1
2025-11-03T16:51:26.655701Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 1 count 1 size 176 actorID [2:7568542777054605414:2389]
2025-11-03T16:51:26.655772Z node 2 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-03T16:51:26.655782Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 1 partno 0 count 1 parts 0 suffix '63' size 176
2025-11-03T16:51:26.655820Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 121 WriteNewSizeFromSupportivePartitions# 0
2025-11-03T16:51:26.655858Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:51:26.655897Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0test-message-group-id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 2, partNo: 0, Offset: 1 is stored on disk
2025-11-03T16:51:26.656088Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:26.656102Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:26.656113Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:26.656147Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:51:26.656180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 3  requestId: <none> cookie: 2
2025-11-03T16:51:26.656412Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:26.657358Z :DEBUG: [] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|8177040c-7c172cfb-cd36cc20-97bd7714_0] Write session got write response: sequence_numbers: 2 offsets: 1 already_written: false write_statistics { persist_duration_ms: 6 queued_in_partition_duration_ms: 3 }
2025-11-03T16:51:26.657402Z :DEBUG: [] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|8177040c-7c172cfb-cd36cc20-97bd7714_0] Write session: acknoledged message 2
2025-11-03T16:51:26.671280Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:26.671321Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:26.671334Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:26.740302Z :INFO: [] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|8177040c-7c172cfb-cd36cc20-97bd7714_0] Write session will now close
2025-11-03T16:51:26.740382Z :DEBUG: [] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|8177040c-7c172cfb-cd36cc20-97bd7714_0] Write session: aborting
2025-11-03T16:51:26.740938Z :INFO: [] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|8177040c-7c172cfb-cd36cc20-97bd7714_0] Write session: gracefully shut down, all writes complete
2025-11-03T16:51:26.740985Z :DEBUG: [] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|8177040c-7c172cfb-cd36cc20-97bd7714_0] Write session: destroy
2025-11-03T16:51:26.742596Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: test-message-group-id|8177040c-7c172cfb-cd36cc20-97bd7714_0 grpc read done: success: 0 data: 
2025-11-03T16:51:26.742626Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 2 sessionId: test-message-group-id|8177040c-7c172cfb-cd36cc20-97bd7714_0 grpc read failed
2025-11-03T16:51:26.742662Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 2 sessionId: test-message-group-id|8177040c-7c172cfb-cd36cc20-97bd7714_0 grpc closed
2025-11-03T16:51:26.742677Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2 sessionId: test-message-group-id|8177040c-7c172cfb-cd36cc20-97bd7714_0 is DEAD
2025-11-03T16:51:26.743480Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-11-03T16:51:26.744622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [1:7568542775767024761:2466] destroyed
2025-11-03T16:51:26.744678Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-11-03T16:51:26.744717Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:26.744737Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:26.744750Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:26.755831Z :INFO: [/Root] [/Root] [4d81d045-44ded3c-93b48ce1-e2fea051] Starting read session
2025-11-03T16:51:26.755883Z :DEBUG: [/Root] [/Root] [4d81d045-44ded3c-93b48ce1-e2fea051] Starting cluster discovery
2025-11-03T16:51:26.772073Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:26.772103Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:26.772115Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:26.777154Z :DEBUG: [/Root] [/Root] [4d81d045-44ded3c-93b48ce1-e2fea051] Cluster discovery request succeeded
2025-11-03T16:51:26.777235Z :DEBUG: [/Root] [/Root] [4d81d045-44ded3c-93b48ce1-e2fea051] Starting session to cluster dc1 (localhost:21237)
2025-11-03T16:51:26.786346Z :DEBUG: [/Root] [/Root] [4d81d045-44ded3c-93b48ce1-e2fea051] [dc1] In Reconnect, ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:51:26.786407Z :DEBUG: [/Root] [/Root] [4d81d045-44ded3c-93b48ce1-e2fea051] [dc1] New values: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:51:26.786459Z :DEBUG: [/Root] [/Root] [4d81d045-44ded3c-93b48ce1-e2fea051] [dc1] Reconnecting session to cluster dc1 in 0.000000s
2025-11-03T16:51:26.801531Z :DEBUG: [/Root] [/Root] [4d81d045-44ded3c-93b48ce1-e2fea051] [dc1] Successfully connected. Initializing session
2025-11-03T16:51:26.803020Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:109: new grpc connection
2025-11-03T16:51:26.803046Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:131: new session created cookie 1
2025-11-03T16:51:26.804000Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { topic: "test-topic" partition_group_ids: 1 } read_only_original: true consumer: "shared/user" read_params { max_read_size: 104857600 } } }
2025-11-03T16:51:26.806981Z :INFO: [/Root] [/Root] [4d81d045-44ded3c-93b48ce1-e2fea051] [dc1] Server session id: shared/user_1_1_1352388560113682053_v1
2025-11-03T16:51:26.807202Z :DEBUG: [/Root] [/Root] [4d81d045-44ded3c-93b48ce1-e2fea051] [dc1] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:51:26.804235Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 1 consumer shared/user session shared/user_1_1_1352388560113682053_v1 read init: from# ipv6:[::1]:48674, request# { init_request { topics_read_settings { topic: "test-topic" partition_group_ids: 1 } read_only_original: true consumer: "shared/user" read_params { max_read_size: 104857600 } } }
2025-11-03T16:51:26.804660Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 1 consumer shared/user session shared/user_1_1_1352388560113682053_v1 auth for : user
2025-11-03T16:51:26.805155Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 1 consumer shared/user session shared/user_1_1_1352388560113682053_v1 Handle describe topics response
2025-11-03T16:51:26.805261Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 1 consumer shared/user session shared/user_1_1_1352388560113682053_v1 auth is DEAD
2025-11-03T16:51:26.805327Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 1 consumer shared/user session shared/user_1_1_1352388560113682053_v1 auth ok: topics# 1, initDone# 0
2025-11-03T16:51:26.807477Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 1 consumer shared/user session shared/user_1_1_1352388560113682053_v1 register session: topic# rt3.dc1--test-topic
2025-11-03T16:51:26.808111Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_1_1_1352388560113682053_v1 grpc read done: success# 1, data# { read { } }
2025-11-03T16:51:26.808174Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_1_1_1352388560113682053_v1 got read request: guid# 72238051-18183298-7df1c6e-b4320736
2025-11-03T16:51:26.808412Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1655: [72075186224037893][rt3.dc1--test-topic] pipe [1:7568542775767024792:2482] connected; active server actors: 1
2025-11-03T16:51:26.808532Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1706: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [1:7568542775767024792:2482] session shared/user_1_1_1352388560113682053_v1
2025-11-03T16:51:26.808597Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:639: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-11-03T16:51:26.808666Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:669: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-11-03T16:51:26.808708Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:871: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_1_1_1352388560113682053_v1" (Sender=[1:7568542775767024788:2482], Pipe=[1:7568542775767024792:2482], Partitions=[0], ActiveFamilyCount=0)
2025-11-03T16:51:26.808740Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1186: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-11-03T16:51:26.808836Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1258: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=1 [1 (0), ]
2025-11-03T16:51:26.808930Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1305: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0], SpecialSessions=1) for ReadingSession "shared/user_1_1_1352388560113682053_v1" (Sender=[1:7568542775767024788:2482], Pipe=[1:7568542775767024792:2482], Partitions=[0], ActiveFamilyCount=0)
2025-11-03T16:51:26.809008Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:549: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_1_1_1352388560113682053_v1" sender [1:7568542775767024788:2482] lock partition 0 for ReadingSession "shared/user_1_1_1352388560113682053_v1" (Sender=[1:7568542775767024788:2482], Pipe=[1:7568542775767024792:2482], Partitions=[0], ActiveFamilyCount=1) generation 1 step 1
2025-11-03T16:51:26.809092Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1366: [72075186224037893][rt3.dc1--test-topic] consumer user skip balancing family=1 (Status=Active, Partitions=[0], SpecialSessions=1, Session=ReadingSession "shared/user_1_1_1352388560113682053_v1" (Sender=[1:7568542775767024788:2482], Pipe=[1:7568542775767024792:2482], Partitions=[0], ActiveFamilyCount=1)) because it is considered a session that does not read anything else.
2025-11-03T16:51:26.809113Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1402: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000255s
2025-11-03T16:51:26.810183Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 1 consumer shared/user session shared/user_1_1_1352388560113682053_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 1 Session: "shared/user_1_1_1352388560113682053_v1" ClientId: "user" PipeClient { RawX1: 7568542775767024792 RawX2: 4503603922340274 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-11-03T16:51:26.810270Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 1 consumer shared/user session shared/user_1_1_1352388560113682053_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-11-03T16:51:26.811768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [1:7568542775767024797:2486], now have 1 active actors on pipe
2025-11-03T16:51:26.812075Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_1352388560113682053_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 1, pipe: [1:7568542775767024797:2486]
2025-11-03T16:51:26.812363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:26.812389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:26.812425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1748: [PQ: 72075186224037892] Created session shared/user_1_1_1352388560113682053_v1 on pipe: [1:7568542775767024797:2486]
2025-11-03T16:51:26.812496Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:26.812514Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:26.812522Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-03T16:51:26.812581Z node 2 :PERSQUEUE DEBUG: partition.cpp:3666: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_1_1_1352388560113682053_v1
2025-11-03T16:51:26.812593Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:26.812705Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-03T16:51:26.813063Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_1_1352388560113682053_v1:1 with generation 1
2025-11-03T16:51:26.815883Z node 2 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-03T16:51:26.815936Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-11-03T16:51:26.815955Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:26.815963Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:26.815971Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:26.816008Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:51:26.816035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-11-03T16:51:26.818363Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_1_1_1352388560113682053_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 2 WriteTimestampMS: 1762188686642 CreateTimestampMS: 1762188686638 SizeLag: 352 WriteTimestampEstimateMS: 1762188686771 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-11-03T16:51:26.818418Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 1 consumer shared/user session shared/user_1_1_1352388560113682053_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 2 readOffset 0 committedOffset 0
2025-11-03T16:51:26.818470Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 1 consumer shared/user session shared/user_1_1_1352388560113682053_v1 sending to client partition status
2025-11-03T16:51:26.819494Z :INFO: [/Root] [/Root] [4d81d045-44ded3c-93b48ce1-e2fea051] [dc1] Confirm partition stream create. Partition stream id: 1. Cluster: "dc1". Topic: "test-topic". Partition: 0. Read offset: (NULL)
create event CreatePartitionStream { PartitionStreamId: 1 TopicPath: test-topic Cluster: dc1 PartitionId: 0 CommittedOffset: 0 EndOffset: 2 }
2025-11-03T16:51:26.821190Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_1_1_1352388560113682053_v1 grpc read done: success# 1, data# { start_read { topic { path: "test-topic" } cluster: "dc1" assign_id: 1 } }
2025-11-03T16:51:26.821335Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:539: session cookie 1 consumer shared/user session shared/user_1_1_1352388560113682053_v1 got StartRead from client: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 0, commitOffset# 0
2025-11-03T16:51:26.821387Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1023: session cookie 1 consumer shared/user session shared/user_1_1_1352388560113682053_v1 Start reading TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 2 readOffset 0 committedOffset 0 clientCommitOffset 0 clientReadOffset 0
2025-11-03T16:51:26.821418Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_1_1_1352388560113682053_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 0 endOffset 2
2025-11-03T16:51:26.821474Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_1_1_1352388560113682053_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 0, endOffset# 2, WTime# 1762188686642, sizeLag# 352
2025-11-03T16:51:26.821491Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_1_1_1352388560113682053_v1TEvPartitionReady. Aval parts: 1
2025-11-03T16:51:26.821533Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_1_1_1352388560113682053_v1 performing read request: guid# 72238051-18183298-7df1c6e-b4320736, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 2, size# 422, partitionsAsked# 1, maxTimeLag# 0ms
2025-11-03T16:51:26.821605Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_1_1_1352388560113682053_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 2 maxSize 422 maxTimeLagMs 0 readTimestampMs 0 readOffset 0 EndOffset 2 ClientCommitOffset 0 committedOffset 0 Guid 72238051-18183298-7df1c6e-b4320736
2025-11-03T16:51:26.822480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:26.822532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:26.822656Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:880: [72075186224037892][Partition][0][StateIdle] read cookie 4 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 partno 0 count 2 size 422 endOffset 2 max time lag 0ms effective offset 0
2025-11-03T16:51:26.823030Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1105: [72075186224037892][Partition][0][StateIdle] read cookie 4 added 2 blobs, size 352 count 2 last offset 1, current partition end offset: 2
2025-11-03T16:51:26.823048Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1121: [72075186224037892][Partition][0][StateIdle] Reading cookie 4. Send blob request.
2025-11-03T16:51:26.823103Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 0 partno 0 count 1 parts_count 0 source 1 size 176 accessed 1 times before, last time 2025-11-03T16:51:26.000000Z
2025-11-03T16:51:26.823124Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 1 partno 0 count 1 parts_count 0 source 1 size 176 accessed 0 times before, last time 2025-11-03T16:51:26.000000Z
2025-11-03T16:51:26.823162Z node 2 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 4. All 2 blobs are from cache.
2025-11-03T16:51:26.823215Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:572: FormAnswer for 2 blobs
2025-11-03T16:51:26.823312Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 0 totakecount 1 count 1 size 156 from pos 0 cbcount 1
2025-11-03T16:51:26.823356Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 1 totakecount 1 count 1 size 156 from pos 0 cbcount 1
2025-11-03T16:51:26.823418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-03T16:51:26.823434Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 0 suffix '63'
2025-11-03T16:51:26.823458Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 1 partno 0 count 1 parts 0 suffix '63'
2025-11-03T16:51:26.823884Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_1_1_1352388560113682053_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 2 Result { Offset: 0 Data: "... 99 bytes ..." SourceId: "\000test-message-group-id" SeqNo: 1 WriteTimestampMS: 1762188686642 CreateTimestampMS: 1762188686638 UncompressedSize: 8 PartitionKey: "" ExplicitHash: "" } Result { Offset: 1 Data: "... 99 bytes ..." SourceId: "\000test-message-group-id" SeqNo: 2 WriteTimestampMS: 1762188686648 CreateTimestampMS: 1762188686638 UncompressedSize: 8 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 2 SizeLag: 40 RealReadOffset: 1 WaitQuotaTimeMs: 0 EndOffset: 2 StartOffset: 0 } Cookie: 0 }
2025-11-03T16:51:26.824064Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_1_1_1352388560113682053_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 1 from offset 2
2025-11-03T16:51:26.824108Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_1_1_1352388560113682053_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 2 ReadOffset 2 ReadGuid 72238051-18183298-7df1c6e-b4320736 has messages 1
2025-11-03T16:51:26.824226Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_1_1_1352388560113682053_v1 read done: guid# 72238051-18183298-7df1c6e-b4320736, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 382
2025-11-03T16:51:26.824251Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_1_1_1352388560113682053_v1 response to read: guid# 72238051-18183298-7df1c6e-b4320736
2025-11-03T16:51:26.824469Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_1_1_1352388560113682053_v1 Process answer. Aval parts: 0
2025-11-03T16:51:26.825400Z :DEBUG: [/Root] [/Root] [4d81d045-44ded3c-93b48ce1-e2fea051] [dc1] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:51:26.825837Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 0 (0-1)
2025-11-03T16:51:26.825997Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (0-0)
2025-11-03T16:51:26.826040Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 0} (1-1)
2025-11-03T16:51:26.826088Z :DEBUG: [/Root] [/Root] [4d81d045-44ded3c-93b48ce1-e2fea051] [dc1] The application data is transferred to the client. Number of messages 2, size 16 bytes
data event DataReceived { PartitionStreamId: 1 PartitionId: 0 Message { Data: ..8 bytes.. Partition stream id: 1 Cluster: "dc1". Topic: "test-topic" Partition: 0 PartitionKey: "" Information: { Offset: 0 SeqNo: 1 MessageGroupId: "test-message-group-id" CreateTime: 2025-11-03T16:51:26.638000Z WriteTime: 2025-11-03T16:51:26.642000Z Ip: "ipv6:[::1]:48632" UncompressedSize: 8 Meta: { "logtype": "unknown", "ident": "unknown", "server": "ipv6:[::1]:48632" } } } Message { Data: ..8 bytes.. Partition stream id: 1 Cluster: "dc1". Topic: "test-topic" Partition: 0 PartitionKey: "" Information: { Offset: 1 SeqNo: 2 MessageGroupId: "test-message-group-id" CreateTime: 2025-11-03T16:51:26.638000Z WriteTime: 2025-11-03T16:51:26.648000Z Ip: "ipv6:[::1]:48632" UncompressedSize: 8 Meta: { "logtype": "unknown", "ident": "unknown", "server": "ipv6:[::1]:48632" } } } }
2025-11-03T16:51:26.834282Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_1_1_1352388560113682053_v1 grpc read done: success# 1, data# { read { } }
2025-11-03T16:51:26.834428Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_1_1_1352388560113682053_v1 got read request: guid# b715df11-8d0e96e1-9eabba4b-ba19d884
2025-11-03T16:51:26.840587Z :DEBUG: [] MessageGroupId [test-message-group-id] SessionId [] Write session: try to update token
2025-11-03T16:51:26.841121Z :INFO: [] MessageGroupId [test-message-group-id] SessionId [] Write session: Do CDS request
2025-11-03T16:51:26.841169Z :INFO: [] MessageGroupId [test-message-group-id] SessionId [] Start write session. Will connect to endpoint: localhost:21237
2025-11-03T16:51:26.857696Z :ReadSession INFO: WriteToTopic: message3
2025-11-03T16:51:26.858898Z :DEBUG: [] MessageGroupId [test-message-group-id] SessionId [] Write session: send init request: init_request { topic: "test-topic" message_group_id: "test-message-group-id" }
2025-11-03T16:51:26.860427Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-11-03T16:51:26.860451Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3
2025-11-03T16:51:26.861485Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "test-message-group-id" }
2025-11-03T16:51:26.861581Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3 topic: "test-topic" message_group_id: "test-message-group-id" from ipv6:[::1]:48692
2025-11-03T16:51:26.861596Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:48692 proto=v1  topic=test-topic durationSec=0
2025-11-03T16:51:26.861606Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-11-03T16:51:26.863949Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3 sessionId:  describe result for acl check
2025-11-03T16:51:26.864083Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-11-03T16:51:26.864117Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-11-03T16:51:26.864127Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-11-03T16:51:26.864141Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7568542775767024808:2491] (SourceId=test-message-group-id, PreferedPartition=(NULL)) StartKqpSession
2025-11-03T16:51:26.866333Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7568542775767024808:2491] (SourceId=test-message-group-id, PreferedPartition=(NULL)) Select from the table
2025-11-03T16:51:26.878680Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:26.878708Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:26.878733Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:26.879318Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7568542775767024808:2491] (SourceId=test-message-group-id, PreferedPartition=(NULL)) Update the table
2025-11-03T16:51:26.893160Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7568542775767024808:2491] (SourceId=test-message-group-id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-11-03T16:51:26.893195Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7568542775767024808:2491] (SourceId=test-message-group-id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-11-03T16:51:26.893210Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7568542775767024808:2491] (SourceId=test-message-group-id, PreferedPartition=(NULL)) Start idle
2025-11-03T16:51:26.893233Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-11-03T16:51:26.899457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [1:7568542775767024841:2491], now have 1 active actors on pipe
2025-11-03T16:51:26.899475Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1
2025-11-03T16:51:26.904468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:26.904508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:26.904585Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie test-message-group-id|907cf3ac-1427dd91-b1f0be5f-f15b24e8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner test-message-group-id
2025-11-03T16:51:26.904615Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:26.904630Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:26.904639Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-03T16:51:26.904679Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:26.904720Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-03T16:51:26.904764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-03T16:51:26.908872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:26.908903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:26.908973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-03T16:51:26.909417Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3 partition: 0 MaxSeqNo: 2 sessionId: test-message-group-id|907cf3ac-1427dd91-b1f0be5f-f15b24e8_0
2025-11-03T16:51:26.910248Z :INFO: [] MessageGroupId [test-message-group-id] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1762188686910 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-11-03T16:51:26.910369Z :INFO: [] MessageGroupId [test-message-group-id] SessionId [] Write session established. Init response: last_sequence_number: 2 session_id: "test-message-group-id|907cf3ac-1427dd91-b1f0be5f-f15b24e8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-11-03T16:51:26.911293Z :DEBUG: [] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|907cf3ac-1427dd91-b1f0be5f-f15b24e8_0] Write 1 messages with Id from 1 to 1
2025-11-03T16:51:26.911400Z :INFO: [] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|907cf3ac-1427dd91-b1f0be5f-f15b24e8_0] Write session: close. Timeout = 18446744073709551 ms
2025-11-03T16:51:26.912074Z :DEBUG: [] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|907cf3ac-1427dd91-b1f0be5f-f15b24e8_0] Write session: try to update token
2025-11-03T16:51:26.912139Z :DEBUG: [] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|907cf3ac-1427dd91-b1f0be5f-f15b24e8_0] Send 1 message(s) (0 left), first sequence number is 3
2025-11-03T16:51:26.914160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:26.914190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:26.914252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-11-03T16:51:26.913425Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3 sessionId: test-message-group-id|907cf3ac-1427dd91-b1f0be5f-f15b24e8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:51:26.913675Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:51:26.914663Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:26.915000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:26.915020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:26.915075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0test-message-group-id' SeqNo: 3 partNo : 0 messageNo: 1 size 99 offset: -1
2025-11-03T16:51:26.915111Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:51:26.915148Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:26.915169Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:26.915178Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-03T16:51:26.915263Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0test-message-group-id' seqNo 3 partNo 0
2025-11-03T16:51:26.916128Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0test-message-group-id' seqNo 3 partNo 0 FormedBlobsCount 0 NewHead: Offset 2 PartNo 0 PackedSize 188 count 1 nextOffset 3 batches 1
2025-11-03T16:51:26.916168Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:26.916499Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 2,1 HeadOffset 2 endOffset 2 curOffset 3 d0000000000_00000000000000000002_00000_0000000001_00000? size 176 WTime 1762188686916
2025-11-03T16:51:26.916609Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-03T16:51:26.916696Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 2 partNo 0 count 1 size 176
2025-11-03T16:51:26.924232Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 2 count 1 size 176 actorID [2:7568542777054605414:2389]
2025-11-03T16:51:26.924297Z node 2 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-03T16:51:26.924339Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 121 WriteNewSizeFromSupportivePartitions# 0
2025-11-03T16:51:26.924370Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:51:26.924404Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0test-message-group-id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 3, partNo: 0, Offset: 2 is stored on disk
2025-11-03T16:51:26.924587Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:26.924598Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:26.924607Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:26.924637Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:51:26.924673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1  requestId: <none> cookie: 1
2025-11-03T16:51:26.924856Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 2 partno 0 count 1 parts 0 suffix '63' size 176
2025-11-03T16:51:26.925293Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 1 consumer shared/user session shared/user_1_1_1352388560113682053_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 2 EndOffset 2 newEndOffset 3 commitOffset 0 clientCommitOffset 0 cookie 1 readingFinished 0 firstRead 0
2025-11-03T16:51:26.925334Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_1_1_1352388560113682053_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 2 endOffset 3
2025-11-03T16:51:26.925384Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:26.925770Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_1_1_1352388560113682053_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 2, endOffset# 3, WTime# 1762188686648, sizeLag# 176
2025-11-03T16:51:26.925785Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_1_1_1352388560113682053_v1TEvPartitionReady. Aval parts: 1
2025-11-03T16:51:26.925819Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_1_1_1352388560113682053_v1 performing read request: guid# b715df11-8d0e96e1-9eabba4b-ba19d884, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 1, size# 211, partitionsAsked# 1, maxTimeLag# 0ms
2025-11-03T16:51:26.925858Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_1_1_1352388560113682053_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 1 maxSize 211 maxTimeLagMs 0 readTimestampMs 0 readOffset 2 EndOffset 3 ClientCommitOffset 0 committedOffset 0 Guid b715df11-8d0e96e1-9eabba4b-ba19d884
2025-11-03T16:51:26.926910Z :DEBUG: [] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|907cf3ac-1427dd91-b1f0be5f-f15b24e8_0] Write session got write response: sequence_numbers: 3 offsets: 2 already_written: false write_statistics { persist_duration_ms: 11 }
2025-11-03T16:51:26.926954Z :DEBUG: [] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|907cf3ac-1427dd91-b1f0be5f-f15b24e8_0] Write session: acknoledged message 1
2025-11-03T16:51:26.926565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:26.926594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:26.926684Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:880: [72075186224037892][Partition][0][StateIdle] read cookie 5 Topic 'rt3.dc1--test-topic' partition 0 user user offset 2 partno 0 count 1 size 211 endOffset 3 max time lag 0ms effective offset 2
2025-11-03T16:51:26.926805Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1105: [72075186224037892][Partition][0][StateIdle] read cookie 5 added 1 blobs, size 176 count 1 last offset 2, current partition end offset: 3
2025-11-03T16:51:26.926814Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1121: [72075186224037892][Partition][0][StateIdle] Reading cookie 5. Send blob request.
2025-11-03T16:51:26.926837Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 2 partno 0 count 1 parts_count 0 source 1 size 176 accessed 0 times before, last time 2025-11-03T16:51:26.000000Z
2025-11-03T16:51:26.926855Z node 2 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 5. All 1 blobs are from cache.
2025-11-03T16:51:26.926880Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:572: FormAnswer for 1 blobs
2025-11-03T16:51:26.926941Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 2 totakecount 1 count 1 size 156 from pos 0 cbcount 1
2025-11-03T16:51:26.926988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 2
2025-11-03T16:51:26.927107Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 2 partno 0 count 1 parts 0 suffix '63'
2025-11-03T16:51:26.927680Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_1_1_1352388560113682053_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 3 Result { Offset: 2 Data: "... 99 bytes ..." SourceId: "\000test-message-group-id" SeqNo: 3 WriteTimestampMS: 1762188686912 CreateTimestampMS: 1762188686911 UncompressedSize: 8 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 20 RealReadOffset: 2 WaitQuotaTimeMs: 0 EndOffset: 3 StartOffset: 0 } Cookie: 2 }
2025-11-03T16:51:26.927767Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_1_1_1352388560113682053_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 2 from offset 3
2025-11-03T16:51:26.927795Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_1_1_1352388560113682053_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 3 ReadOffset 3 ReadGuid b715df11-8d0e96e1-9eabba4b-ba19d884 has messages 1
2025-11-03T16:51:26.927892Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_1_1_1352388560113682053_v1 read done: guid# b715df11-8d0e96e1-9eabba4b-ba19d884, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 220
2025-11-03T16:51:26.927910Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_1_1_1352388560113682053_v1 response to read: guid# b715df11-8d0e96e1-9eabba4b-ba19d884
2025-11-03T16:51:26.928102Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_1_1_1352388560113682053_v1 Process answer. Aval parts: 0
2025-11-03T16:51:26.928989Z :DEBUG: [/Root] [/Root] [4d81d045-44ded3c-93b48ce1-e2fea051] [dc1] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:51:26.929244Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 0 (2-2)
2025-11-03T16:51:26.929641Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_1_1_1352388560113682053_v1 grpc read done: success# 1, data# { read { } }
2025-11-03T16:51:26.929732Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_1_1_1352388560113682053_v1 got read request: guid# 933f5917-6f6a1d00-6f382bb9-1c097942
2025-11-03T16:51:26.978312Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:26.978340Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:26.978351Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:27.012053Z :INFO: [] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|907cf3ac-1427dd91-b1f0be5f-f15b24e8_0] Write session will now close
2025-11-03T16:51:27.012135Z :DEBUG: [] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|907cf3ac-1427dd91-b1f0be5f-f15b24e8_0] Write session: aborting
2025-11-03T16:51:27.012635Z :INFO: [] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|907cf3ac-1427dd91-b1f0be5f-f15b24e8_0] Write session: gracefully shut down, all writes complete
2025-11-03T16:51:27.012681Z :DEBUG: [] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|907cf3ac-1427dd91-b1f0be5f-f15b24e8_0] Write session: destroy
2025-11-03T16:51:27.013261Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3 sessionId: test-message-group-id|907cf3ac-1427dd91-b1f0be5f-f15b24e8_0 grpc read done: success: 0 data: 
2025-11-03T16:51:27.013284Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 3 sessionId: test-message-group-id|907cf3ac-1427dd91-b1f0be5f-f15b24e8_0 grpc read failed
2025-11-03T16:51:27.013315Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 3 sessionId: test-message-group-id|907cf3ac-1427dd91-b1f0be5f-f15b24e8_0 grpc closed
2025-11-03T16:51:27.013330Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3 sessionId: test-message-group-id|907cf3ac-1427dd91-b1f0be5f-f15b24e8_0 is DEAD
2025-11-03T16:51:27.014037Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-11-03T16:51:27.014593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [1:7568542775767024841:2491] destroyed
2025-11-03T16:51:27.015370Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (2-2)
2025-11-03T16:51:27.015431Z :DEBUG: [/Root] [/Root] [4d81d045-44ded3c-93b48ce1-e2fea051] [dc1] The application data is transferred to the client. Number of messages 1, size 8 bytes
data event DataReceived { PartitionStreamId: 1 PartitionId: 0 Message { Data: ..8 bytes.. Partition stream id: 1 Cluster: "dc1". Topic: "test-topic" Partition: 0 PartitionKey: "" Information: { Offset: 2 SeqNo: 3 MessageGroupId: "test-message-group-id" CreateTime: 2025-11-03T16:51:26.911000Z WriteTime: 2025-11-03T16:51:26.912000Z Ip: "ipv6:[::1]:48692" UncompressedSize: 8 Meta: { "logtype": "unknown", "ident": "unknown", "server": "ipv6:[::1]:48692" } } } }
2025-11-03T16:51:27.015590Z :DEBUG: [/Root] [/Root] [4d81d045-44ded3c-93b48ce1-e2fea051] [dc1] Commit offsets [2, 3). Partition stream id: 1
2025-11-03T16:51:27.014631Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-11-03T16:51:27.014658Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:27.014668Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:27.014680Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:27.017343Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_1_1_1352388560113682053_v1 grpc read done: success# 1, data# { commit { cookies { assign_id: 1 partition_cookie: 2 } } }
2025-11-03T16:51:27.017557Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1449: session cookie 1 consumer shared/user session shared/user_1_1_1352388560113682053_v1 commit request from client for 2 in TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-11-03T16:51:27.017895Z :DEBUG: [/Root] [/Root] [4d81d045-44ded3c-93b48ce1-e2fea051] [dc1] Commit offsets [0, 2). Partition stream id: 1
2025-11-03T16:51:27.017960Z :INFO: [/Root] [/Root] [4d81d045-44ded3c-93b48ce1-e2fea051] Closing read session. Close timeout: 30.000000s
2025-11-03T16:51:27.018003Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): dc1:test-topic:0:1:2:0
2025-11-03T16:51:27.018045Z :INFO: [/Root] [/Root] [4d81d045-44ded3c-93b48ce1-e2fea051] Counters: { Errors: 0 CurrentSessionLifetimeMs: 262 BytesRead: 24 MessagesRead: 3 BytesReadCompressed: 84 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-11-03T16:51:27.018508Z :NOTICE: [/Root] [/Root] [4d81d045-44ded3c-93b48ce1-e2fea051] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
commit ack or close event SessionClosed { Status: SUCCESS Issues: "<main>: Error: Session was gracefully closed " }
2025-11-03T16:51:27.018586Z :INFO: [/Root] [/Root] [4d81d045-44ded3c-93b48ce1-e2fea051] Closing read session. Close timeout: 0.000000s
2025-11-03T16:51:27.018621Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): dc1:test-topic:0:1:2:0
2025-11-03T16:51:27.018658Z :INFO: [/Root] [/Root] [4d81d045-44ded3c-93b48ce1-e2fea051] Counters: { Errors: 0 CurrentSessionLifetimeMs: 262 BytesRead: 24 MessagesRead: 3 BytesReadCompressed: 84 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-11-03T16:51:27.018743Z :NOTICE: [/Root] [/Root] [4d81d045-44ded3c-93b48ce1-e2fea051] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
2025-11-03T16:51:27.021332Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_1_1_1352388560113682053_v1 grpc read done: success# 0, data# {  }
2025-11-03T16:51:27.021360Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:125: session cookie 1 consumer shared/user session shared/user_1_1_1352388560113682053_v1 grpc read failed
2025-11-03T16:51:27.021393Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:92: session cookie 1 consumer shared/user session shared/user_1_1_1352388560113682053_v1 grpc closed
2025-11-03T16:51:27.021525Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 1 consumer shared/user session shared/user_1_1_1352388560113682053_v1 is DEAD
2025-11-03T16:51:27.023016Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1659: [72075186224037893][rt3.dc1--test-topic] pipe [1:7568542775767024792:2482] disconnected.
2025-11-03T16:51:27.023050Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1670: [72075186224037893][rt3.dc1--test-topic] pipe [1:7568542775767024792:2482] disconnected; active server actors: 1
2025-11-03T16:51:27.023071Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1679: [72075186224037893][rt3.dc1--test-topic] pipe [1:7568542775767024792:2482] client user disconnected session shared/user_1_1_1352388560113682053_v1
2025-11-03T16:51:27.023347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2258: [PQ: 72075186224037892] Destroy direct read session shared/user_1_1_1352388560113682053_v1
2025-11-03T16:51:27.023388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [1:7568542775767024797:2486] destroyed
2025-11-03T16:51:27.023651Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_1_1352388560113682053_v1
2025-11-03T16:51:27.079605Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:27.079638Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:27.079647Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:27.179622Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:27.179657Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:27.179667Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:28.402319Z :SettingsValidation INFO: Random seed for debugging is 1762188688402300
2025-11-03T16:51:29.009336Z node 3 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[3:7568542791942041931:2089];send_to=[0:7307199536658146131:7762515];
2025-11-03T16:51:29.036652Z node 3 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
2025-11-03T16:51:29.089545Z node 4 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[4:7568542788996974508:2077];send_to=[0:7307199536658146131:7762515];
2025-11-03T16:51:29.091835Z node 4 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
2025-11-03T16:51:29.099202Z node 3 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-11-03T16:51:29.099606Z node 3 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
test_client.cpp: SetPath # /home/runner/.ya/build/build_root/7jz3/00197c/r3tmp/tmpu7NpOg/pdisk_1.dat
2025-11-03T16:51:29.109686Z node 4 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-11-03T16:51:29.110824Z node 4 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-11-03T16:51:29.271657Z node 3 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
2025-11-03T16:51:29.302814Z node 4 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-11-03T16:51:29.302026Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(3, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-11-03T16:51:29.302134Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(3, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-11-03T16:51:29.303451Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(4, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-11-03T16:51:29.303525Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(4, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-11-03T16:51:29.303891Z node 3 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-11-03T16:51:29.314226Z node 3 :HIVE WARN: hive_impl.cpp:811: HIVE#72057594037968897 Handle TEvInterconnect::TEvNodeConnected, NodeId 4 Cookie 4
2025-11-03T16:51:29.314407Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(3, (0,0,0,0)) VolatileState: Connecting -> Connected
2025-11-03T16:51:29.316790Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(4, (0,0,0,0)) VolatileState: Connecting -> Connected
TServer::EnableGrpc on GrpcPort 19748, node 3
2025-11-03T16:51:29.480816Z node 3 :NET_CLASSIFIER WARN: net_classifier.cpp:190: distributable config is empty, broken or outdated, will use file: /home/runner/.ya/build/build_root/7jz3/00197c/r3tmp/yandexXl3Rz3.tmp
2025-11-03T16:51:29.480871Z node 3 :NET_CLASSIFIER WARN: net_classifier.cpp:196: will try to initialize from file: /home/runner/.ya/build/build_root/7jz3/00197c/r3tmp/yandexXl3Rz3.tmp
2025-11-03T16:51:29.481064Z node 3 :NET_CLASSIFIER WARN: net_classifier.cpp:202: successfully initialized from file: /home/runner/.ya/build/build_root/7jz3/00197c/r3tmp/yandexXl3Rz3.tmp
2025-11-03T16:51:29.481285Z node 3 :NET_CLASSIFIER ERROR: net_classifier.cpp:228: got bad distributable configuration
2025-11-03T16:51:29.529230Z INFO: TTestServer started on Port 27790 GrpcPort 19748
2025-11-03T16:51:29.733146Z node 4 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
TClient is connected to server localhost:27790
PQClient connected to localhost:19748
WaitRootIsUp 'Root'...
TClient::Ls request: Root
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "Root"
    PathId: 1
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 1
    CreateStep: 0
    ParentPathId: 1
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 1
      SubDomainVersion: 0
      SecurityStateVersion: 0
    }
    ChildrenExist: false
  }
  Children {
    Name: ".sys"
    PathId: 18446744073709551615
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 0
    CreateStep: 0
    ParentPathId: 18446744073709551615
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 0
      Pl...
(TRUNCATED)
WaitRootIsUp 'Root' success.
2025-11-03T16:51:29.768427Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpAlterSubDomain, opId: 281474976710657:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_alter_subdomain.cpp:311)
waiting...
waiting...
waiting...
waiting...
2025-11-03T16:51:29.888433Z node 3 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-11-03T16:51:30.050920Z node 3 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-11-03T16:51:30.099063Z node 4 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-11-03T16:51:33.193684Z node 3 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [3:7568542809121912082:2332], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-03T16:51:33.193724Z node 3 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [3:7568542809121912057:2328], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-03T16:51:33.193797Z node 3 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-03T16:51:33.194041Z node 3 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [3:7568542809121912086:2334], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-03T16:51:33.194130Z node 3 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-03T16:51:33.198203Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateResourcePool, opId: 281474976710661:3, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_resource_pool.cpp:179)
2025-11-03T16:51:33.220608Z node 3 :KQP_WORKLOAD_SERVICE WARN: helpers.h:73: [WorkloadService] [TPoolCreatorActor] ActorId: [3:7568542809121912085:2333], DatabaseId: /Root, PoolId: default, Scheduled retry for error: { <main>: Error: Transaction 281474976710661 completed, doublechecking }
2025-11-03T16:51:33.281574Z node 3 :TX_PROXY ERROR: schemereq.cpp:593: Actor# [3:7568542809121912172:2681] txid# 281474976710662, issues: { message: "Check failed: path: \'/Root/.metadata/workload_manager/pools/default\', error: path exist, request accepts it (id: [OwnerId: 72057594046644480, LocalPathId: 8], type: EPathTypeResourcePool, state: EPathStateNoChanges)" severity: 1 }
2025-11-03T16:51:33.327627Z node 3 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:570: Compilation failed, self: [3:7568542809121912182:2340], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-11-03T16:51:33.328347Z node 3 :KQP_SESSION WARN: kqp_session_actor.cpp:2506: SessionId: ydb://session/3?node_id=3&id=ZmM5YjhiMjctN2M3YmM5MjAtODFmM2Y2MjgtNmMwOTE5Y2Y=, ActorId: [3:7568542809121912052:2326], ActorState: ExecuteState, TraceId: 01k95a33p7agkf3cym6s3qxwxq, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-11-03T16:51:33.328825Z node 3 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-11-03T16:51:33.332156Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710663:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:690)
2025-11-03T16:51:33.366316Z node 4 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:570: Compilation failed, self: [4:7568542806176844034:2305], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-11-03T16:51:33.368325Z node 4 :KQP_SESSION WARN: kqp_session_actor.cpp:2506: SessionId: ydb://session/3?node_id=4&id=NzM0MjA2MjEtNTQwM2UwN2QtYTFiNGYxYWItYmUyODhkZDY=, ActorId: [4:7568542806176844007:2299], ActorState: ExecuteState, TraceId: 01k95a33tdf8stff37n579bqfk, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-11-03T16:51:33.368929Z node 4 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-11-03T16:51:33.437298Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710664:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:690)
2025-11-03T16:51:33.594894Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710665:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:690)
=== Init DC: UPSERT INTO `/Root/PQ/Config/V2/Cluster` (name, balancer, local, enabled, weight) VALUES ("dc1", "localhost:19748", true, true, 1000);
2025-11-03T16:51:33.928309Z node 3 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976710666. Ctx: { TraceId: 01k95a347m6s7twshc533sarzz, Database: , SessionId: ydb://session/3?node_id=3&id=Yzc0OTE0ZTUtMWMxNDRlYmUtODdlZGVmMDQtZTZiNWRiZjc=, PoolId: default, DatabaseId: /Root}. Database not set, use /Root
=== CheckClustersList. Subcribe to ClusterTracker from [3:7568542809121912580:2974] 
2025-11-03T16:51:34.008672Z node 3 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[3:7568542791942041931:2089];send_to=[0:7307199536658146131:7762515];
2025-11-03T16:51:34.008766Z node 3 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
2025-11-03T16:51:34.082925Z node 4 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[4:7568542788996974508:2077];send_to=[0:7307199536658146131:7762515];
2025-11-03T16:51:34.083024Z node 4 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
=== CheckClustersList. Ok
2025-11-03T16:51:41.059641Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710671:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:690)
waiting...
PQ Client: create topic: rt3.dc1--test-topic with 1 partitions
CallPersQueueGRPC request to localhost:19748
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-11-03T16:51:41.258988Z node 3 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
CallPersQueueGRPC request to localhost:19748
MetaRequest {
  CmdCreateTopic {
    Topic: "rt3.dc1--test-topic"
    NumPartitions: 1
    Config {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
  }
}
CallPersQueueGRPC response:
Status: 129
ProxyErrorCode: 53
SchemeStatus: 1
FlatTxId {
  TxId: 281474976710672
  SchemeShardTabletId: 72057594046644480
  PathId: 13
}
ErrorCode: OK
AddTopic: rt3.dc1--test-topic
===Run query:``DECLARE $version as Int64; DECLARE $path AS Utf8; DECLARE $cluster as Utf8; UPSERT INTO `/Root/PQ/Config/V2/Topics` (path, dc) VALUES ($path, $cluster); UPSERT INTO `/Root/PQ/Config/V2/Versions` (name, version) VALUES ("Topics", $version);`` with topic = test-topic, dc = dc1
2025-11-03T16:51:41.309390Z node 3 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1655: [72075186224037893][] pipe [3:7568542843481651382:3255] connected; active server actors: 1
2025-11-03T16:51:41.309592Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1519: [72075186224037893][rt3.dc1--test-topic] updating configuration. Deleted partitions []. Added partitions [0]
2025-11-03T16:51:41.313756Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:971: [72075186224037893][rt3.dc1--test-topic] Discovered subdomain [OwnerId: 72057594046644480, LocalPathId: 1] state, outOfSpace = 0 at RB 72075186224037893
2025-11-03T16:51:41.313868Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:140: [72075186224037893][rt3.dc1--test-topic] BALANCER INIT DONE for rt3.dc1--test-topic: (0, 72075186224037892) 
2025-11-03T16:51:41.332717Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2960: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-11-03T16:51:41.336786Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2992: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-11-03T16:51:41.337119Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:787: [PQ: 72075186224037892] no config, start with empty partitions and default config
2025-11-03T16:51:41.337156Z node 4 :PERSQUEUE NOTICE: pq_impl.cpp:913: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-11-03T16:51:41.337194Z node 4 :PERSQUEUE INFO: pq_impl.cpp:612: [PQ: 72075186224037892] doesn't have tx writes info
2025-11-03T16:51:41.338023Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [3:7568542843481651413:2438], now have 1 active actors on pipe
2025-11-03T16:51:41.338053Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [3:7568542843481651381:3254], now have 1 active actors on pipe
2025-11-03T16:51:41.338685Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-03T16:51:41.340137Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:404: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 4, Generation 1
2025-11-03T16:51:41.355363Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-03T16:51:41.366034Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [3:7568542843481651444:3302], now have 1 active actors on pipe
2025-11-03T16:51:41.367052Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-03T16:51:41.377278Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-03T16:51:41.378260Z node 4 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-11-03T16:51:41.378312Z node 4 :PERSQUEUE DEBUG: partition.cpp:1312: [72075186224037892][Partition][0][StateInit] HandleOnInit TEvPQ::TEvProposePartitionConfig
2025-11-03T16:51:41.378623Z node 4 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-11-03T16:51:41.378820Z node 4 :PERSQUEUE INFO: partition_init.cpp:1101: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [4:7568542840536582842:2380]
2025-11-03T16:51:41.381844Z node 4 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-11-03T16:51:41.381871Z node 4 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-11-03T16:51:41.381897Z node 4 :PERSQUEUE INFO: partition.cpp:707: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1 [4:7568542840536582842:2380]
2025-11-03T16:51:41.381929Z node 4 :PERSQUEUE DEBUG: partition.cpp:727: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 0 Head Offset 0 PartNo 0 PackedSize 0 count 0 nextOffset 0 batches 0
2025-11-03T16:51:41.381967Z node 4 :PERSQUEUE DEBUG: partition_mlp.cpp:83: [72075186224037892][Partition][0][StateIdle] Initializing MLP Consumers: 0
2025-11-03T16:51:41.383347Z node 4 :PERSQUEUE DEBUG: partition.cpp:4273: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 1
2025-11-03T16:51:41.383385Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:41.383471Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:41.383486Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-03T16:51:41.383509Z node 4 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-11-03T16:51:41.383526Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:41.383540Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:41.383555Z node 4 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-11-03T16:51:41.383592Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:923: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-11-03T16:51:41.383633Z node 4 :PERSQUEUE DEBUG: partition_mlp.cpp:60: [72075186224037892][Partition][0][StateIdle] Process MLP pending events. Count 0
2025-11-03T16:51:41.390078Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-03T16:51:41.396261Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:183: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:51:41.407570Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-03T16:51:41.407735Z node 4 :PERSQUEUE DEBUG: partition.cpp:1416: [72075186224037892][Partition][0][StateIdle] Handle TEvPQ::TEvTxCommit Step 1762188701406, TxId 281474976710672
2025-11-03T16:51:41.407761Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:41.407774Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:41.407898Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:41.408162Z node 4 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-03T16:51:41.411520Z node 4 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-03T16:51:41.411714Z node 4 :PERSQUEUE DEBUG: partition_mlp.cpp:83: [72075186224037892][Partition][0][StateIdle] Initializing MLP Consumers: 0
2025-11-03T16:51:41.411840Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-11-03T16:51:41.411870Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:41.411885Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:41.411899Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:41.411937Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:183: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:51:41.412320Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:398: [PQ: 72075186224037892] Apply new config PartitionConfig { LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 } PartitionIds: 0 TopicName: "rt3.dc1--test-topic" Version: 0 LocalDC: true Codecs { Ids: 0 Ids: 1 Ids: 2 Codecs: "raw" Codecs: "gzip" Codecs: "lzop" } TopicPath: "/Root/PQ/rt3.dc1--test-topic" YcCloudId: "" YcFolderId: "" YdbDatabaseId: "" YdbDatabasePath: "/Root" Partitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } AllPartitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } Consumers { Name: "user" ReadFromTimestampsMs: 0 FormatVersion: 0 Version: 0 Generation: 0 } MonitoringProjectId: ""
2025-11-03T16:51:41.412418Z node 4 :PERSQUEUE NOTICE: pq_impl.cpp:913: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-11-03T16:51:41.412702Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-03T16:51:41.425582Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-03T16:51:41.425697Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-03T16:51:41.428917Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-03T16:51:41.484082Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:41.484119Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:41.484135Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:41.503685Z node 3 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976710673. Ctx: { TraceId: 01k95a3bmqe5rxzh0hcgvw7hns, Database: , SessionId: ydb://session/3?node_id=3&id=NzdlOTQ0ZmYtMzNmYTQxMTktYzhiYWYwNzgtOTBmMzUyMTk=, PoolId: default, DatabaseId: /Root}. Database not set, use /Root
===Query complete
TClient::Ls request: /Root/PQ/rt3.dc1--test-topic
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976710672
    CreateStep: 1762188701406
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts...
(TRUNCATED)
GetTopicVersionFromPath:  record Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976710672
    CreateStep: 1762188701406
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      YdbDatabasePath: "/Root"
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
    Partitions {
      PartitionId: 0
      TabletId: 72075186224037892
      Status: Active
    }
    AlterVersion: 1
    BalancerTabletID: 72075186224037893
    NextPartitionId: 1
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 1
      PlanResolution: 7
      Coordinators: 72057594046316545
      TimeCastBucketsPerMediator: 2
      Mediators: 72057594046382081
    }
    DomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    PathsInside: 12
    PathsLimit: 10000
    ShardsInside: 6
    ShardsLimit: 200000
    ResourcesDomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    DiskSpaceUsage {
      Tables {
        TotalSize: 0
        DataSize: 0
        IndexSize: 0
      }
      Topics {
        ReserveSize: 0
        AccountSize: 0
        DataSize: 0
        UsedReserveSize: 0
      }
    }
    PQPartitionsInside: 1
    PQPartitionsLimit: 1000000
    SchemeLimits {
      MaxDepth: 32
      MaxPaths: 10000
      MaxChildrenInDir: 100000
      MaxAclBytesSize: 10240
      MaxTableColumns: 200
      MaxTableColumnNameLength: 255
      MaxTableKeyColumns: 30
      MaxTableIndices: 20
      MaxShards: 200000
      MaxShardsInPath: 35000
      MaxConsistentCopyTargets: 10000
      MaxPathElementLength: 255
      ExtraPathSymbolsAllowed: "!\"#$%&\'()*+,-.:;<=>?@[\\]^_`{|}~"
      MaxPQPartitions: 1000000
      MaxTableCdcStreams: 5
      MaxExports: 10
      MaxImports: 10
      MaxColumnTableColumns: 10000
    }
  }
}
Path: "/Root/PQ/rt3.dc1--test-topic"
 name rt3.dc1--test-topic version1
CallPersQueueGRPC request to localhost:19748
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-11-03T16:51:41.550243Z node 3 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
MetaResponse {
  CmdGetTopicMetadataResult {
    TopicInfo {
      Topic: "rt3.dc1--test-topic"
      NumPartitions: 1
      Config {
        PartitionConfig {
          LifetimeSeconds: 86400
          LowWatermark: 8388608
          SourceIdLifetimeSeconds: 86400
          WriteSpeedInBytesPerSecond: 20000000
          BurstSize: 20000000
          SourceIdMaxCounts: 6000000
        }
        Version: 1
        LocalDC: true
        Codecs {
          Ids: 0
          Ids: 1
          Ids: 2
          Codecs: "raw"
          Codecs: "gzip"
          Codecs: "lzop"
        }
        TopicPath: "/Root/PQ/rt3.dc1--test-topic"
        YdbDatabasePath: "/Root"
        Consumers {
          Name: "user"
          ReadFromTimestampsMs: 0
          FormatVersion: 0
          Version: 0
        }
      }
      ErrorCode: OK
    }
  }
}
=== Topic created, have version: 1
2025-11-03T16:51:41.584902Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:41.584945Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:41.584964Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:41.608017Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: try to update token
2025-11-03T16:51:41.616190Z :INFO: [] MessageGroupId [src] SessionId [] Write session: Do CDS request
2025-11-03T16:51:41.616268Z :INFO: [] MessageGroupId [src] SessionId [] Start write session. Will connect to endpoint: localhost:19748
2025-11-03T16:51:41.628898Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src" }
2025-11-03T16:51:41.634243Z node 3 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-11-03T16:51:41.634279Z node 3 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1
2025-11-03T16:51:41.634833Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src" }
2025-11-03T16:51:41.634952Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1 topic: "test-topic" message_group_id: "src" from ipv6:[::1]:42506
2025-11-03T16:51:41.634968Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:42506 proto=v1  topic=test-topic durationSec=0
2025-11-03T16:51:41.634978Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-11-03T16:51:41.637505Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1 sessionId:  describe result for acl check
2025-11-03T16:51:41.637628Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-11-03T16:51:41.637638Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-11-03T16:51:41.637648Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-11-03T16:51:41.637663Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [3:7568542843481651529:2457] (SourceId=src, PreferedPartition=(NULL)) StartKqpSession
2025-11-03T16:51:41.640975Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [3:7568542843481651529:2457] (SourceId=src, PreferedPartition=(NULL)) Select from the table
2025-11-03T16:51:41.684571Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:41.684601Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:41.684614Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:41.785952Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:41.785982Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:41.785994Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:41.857276Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [3:7568542843481651529:2457] (SourceId=src, PreferedPartition=(NULL)) RequestPQRB
2025-11-03T16:51:41.860481Z node 3 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1655: [72075186224037893][rt3.dc1--test-topic] pipe [3:7568542843481651568:2457] connected; active server actors: 1
2025-11-03T16:51:41.860587Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [3:7568542843481651529:2457] (SourceId=src, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=src
2025-11-03T16:51:41.860609Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [3:7568542843481651529:2457] (SourceId=src, PreferedPartition=(NULL)) Update the table
2025-11-03T16:51:41.860969Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1659: [72075186224037893][rt3.dc1--test-topic] pipe [3:7568542843481651568:2457] disconnected.
2025-11-03T16:51:41.860997Z node 3 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1670: [72075186224037893][rt3.dc1--test-topic] pipe [3:7568542843481651568:2457] disconnected; active server actors: 1
2025-11-03T16:51:41.861016Z node 3 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1695: [72075186224037893][rt3.dc1--test-topic] pipe [3:7568542843481651568:2457] disconnected no session
2025-11-03T16:51:41.888375Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:41.888417Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:41.888432Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:41.973257Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [3:7568542843481651529:2457] (SourceId=src, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-11-03T16:51:41.973301Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [3:7568542843481651529:2457] (SourceId=src, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-11-03T16:51:41.973319Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [3:7568542843481651529:2457] (SourceId=src, PreferedPartition=(NULL)) Start idle
2025-11-03T16:51:41.973350Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-11-03T16:51:41.976203Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 4, Generation: 1
2025-11-03T16:51:41.975927Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [3:7568542843481651591:2457], now have 1 active actors on pipe
2025-11-03T16:51:41.977820Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1 partition: 0 MaxSeqNo: 0 sessionId: src|49b18b53-68335e3e-3325dd74-64e1156c_0
2025-11-03T16:51:41.976590Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:41.976627Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:41.976709Z node 4 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src|49b18b53-68335e3e-3325dd74-64e1156c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src
2025-11-03T16:51:41.976744Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:41.976768Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:41.976797Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-03T16:51:41.976833Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:41.976871Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-03T16:51:41.976930Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-03T16:51:41.977455Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:41.977471Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:41.977539Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-03T16:51:41.982566Z :INFO: [] MessageGroupId [src] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1762188701982 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-11-03T16:51:41.982717Z :INFO: [] MessageGroupId [src] SessionId [] Write session established. Init response: session_id: "src|49b18b53-68335e3e-3325dd74-64e1156c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-11-03T16:51:41.988117Z :INFO: [] MessageGroupId [src] SessionId [src|49b18b53-68335e3e-3325dd74-64e1156c_0] Write session: close. Timeout = 0 ms
2025-11-03T16:51:41.988182Z :INFO: [] MessageGroupId [src] SessionId [src|49b18b53-68335e3e-3325dd74-64e1156c_0] Write session will now close
2025-11-03T16:51:41.988240Z :DEBUG: [] MessageGroupId [src] SessionId [src|49b18b53-68335e3e-3325dd74-64e1156c_0] Write session: aborting
2025-11-03T16:51:41.988776Z :INFO: [] MessageGroupId [src] SessionId [src|49b18b53-68335e3e-3325dd74-64e1156c_0] Write session: gracefully shut down, all writes complete
2025-11-03T16:51:41.988819Z :DEBUG: [] MessageGroupId [src] SessionId [src|49b18b53-68335e3e-3325dd74-64e1156c_0] Write session: destroy
2025-11-03T16:51:41.992083Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:41.992134Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:41.992161Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:41.992991Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId: src|49b18b53-68335e3e-3325dd74-64e1156c_0 grpc read done: success: 0 data: 
2025-11-03T16:51:41.993019Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 1 sessionId: src|49b18b53-68335e3e-3325dd74-64e1156c_0 grpc read failed
2025-11-03T16:51:41.993054Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 1 sessionId: src|49b18b53-68335e3e-3325dd74-64e1156c_0 grpc closed
2025-11-03T16:51:41.993071Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1 sessionId: src|49b18b53-68335e3e-3325dd74-64e1156c_0 is DEAD
2025-11-03T16:51:41.993723Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-11-03T16:51:42.007078Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [3:7568542843481651591:2457] destroyed
2025-11-03T16:51:42.007135Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-11-03T16:51:42.007162Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:42.007176Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:42.007187Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:42.020336Z :NOTICE: [/Root] [/Root] [faaf8a9b-5ad613d6-78cfc3e1-603dbe59] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
2025-11-03T16:51:42.020441Z :NOTICE: [/Root] [/Root] [faaf8a9b-5ad613d6-78cfc3e1-603dbe59] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
SessionClosed { Status: BAD_REQUEST Issues: "<main>: Error: Invalid read session settings     <main>: Error: Empty topics list. " }
2025-11-03T16:51:42.020543Z :INFO: [/Root] [/Root] [faaf8a9b-5ad613d6-78cfc3e1-603dbe59] Closing read session. Close timeout: 0.000000s
2025-11-03T16:51:42.020638Z :NOTICE: [/Root] [/Root] [faaf8a9b-5ad613d6-78cfc3e1-603dbe59] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
2025-11-03T16:51:42.020873Z :NOTICE: [/Root] [/Root] [6d64dacc-d49c64c8-36aa7545-ac3eddf7] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
2025-11-03T16:51:42.020948Z :NOTICE: [/Root] [/Root] [6d64dacc-d49c64c8-36aa7545-ac3eddf7] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
SessionClosed { Status: BAD_REQUEST Issues: "<main>: Error: Invalid read session settings     <main>: Error: No consumer specified. " }
2025-11-03T16:51:42.021016Z :INFO: [/Root] [/Root] [6d64dacc-d49c64c8-36aa7545-ac3eddf7] Closing read session. Close timeout: 0.000000s
2025-11-03T16:51:42.021126Z :NOTICE: [/Root] [/Root] [6d64dacc-d49c64c8-36aa7545-ac3eddf7] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
2025-11-03T16:51:42.021439Z :NOTICE: [/Root] [/Root] [f87f558f-4c74f63-d37400a6-44ec1535] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
2025-11-03T16:51:42.021513Z :NOTICE: [/Root] [/Root] [f87f558f-4c74f63-d37400a6-44ec1535] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
SessionClosed { Status: BAD_REQUEST Issues: "<main>: Error: Invalid read session settings     <main>: Error: Too small max memory usage. Valid values start from 1 megabyte. " }
2025-11-03T16:51:42.021595Z :INFO: [/Root] [/Root] [f87f558f-4c74f63-d37400a6-44ec1535] Closing read session. Close timeout: 0.000000s
2025-11-03T16:51:42.021677Z :NOTICE: [/Root] [/Root] [f87f558f-4c74f63-d37400a6-44ec1535] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
2025-11-03T16:51:42.091198Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:42.091228Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:42.091240Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:42.512960Z node 3 :KQP_EXECUTER ERROR: kqp_executer_impl.h:1006: ActorId: [3:7568542847776618924:2471] TxId: 281474976710676. Ctx: { TraceId: 01k95a3cbg4wsa25ypdty460a8, Database: /Root, SessionId: ydb://session/3?node_id=3&id=ZTgwM2U5OGQtMTRkNjlhNTQtYTE0NWU1ZTMtMzJjNjQyNjI=, PoolId: default}. UNAVAILABLE: Failed to send EvStartKqpTasksRequest because node is unavailable: 4
2025-11-03T16:51:42.513713Z node 3 :KQP_COMPUTE ERROR: dq_compute_actor_impl.h:1210: SelfId: [3:7568542847776618933:2471], TxId: 281474976710676, task: 3. Ctx: { CheckpointId : .  TraceId : 01k95a3cbg4wsa25ypdty460a8.  CustomerSuppliedId : .  RunScriptActorId : [0:0:0].  PoolId : default.  SessionId : ydb://session/3?node_id=3&id=ZTgwM2U5OGQtMTRkNjlhNTQtYTE0NWU1ZTMtMzJjNjQyNjI=.  CurrentExecutionId : .  Database : /Root.  DatabaseId : /Root. }. Handle abort execution event from: [3:7568542847776618924:2471], status: UNAVAILABLE, reason: { <main>: Error: Terminate execution }
2025-11-03T16:51:44.312111Z :SpecifyClustersExplicitly INFO: Random seed for debugging is 1762188704312093
2025-11-03T16:51:45.084118Z node 6 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[6:7568542857703833029:2086];send_to=[0:7307199536658146131:7762515];
2025-11-03T16:51:45.097800Z node 6 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:123: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, got undelivered to scheme cache: ActorUnknown
2025-11-03T16:51:45.098343Z node 6 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-11-03T16:51:45.098907Z node 6 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
test_client.cpp: SetPath # /home/runner/.ya/build/build_root/7jz3/00197c/r3tmp/tmpBxz4Dh/pdisk_1.dat
2025-11-03T16:51:45.111239Z node 5 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-11-03T16:51:45.111660Z node 5 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:123: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, got undelivered to scheme cache: ActorUnknown
2025-11-03T16:51:45.152841Z node 5 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=incorrect path status: LookupError;
2025-11-03T16:51:45.177855Z node 6 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-11-03T16:51:45.177720Z node 5 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-11-03T16:51:45.324319Z node 5 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
2025-11-03T16:51:45.365550Z node 5 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(5, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-11-03T16:51:45.365673Z node 5 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(5, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-11-03T16:51:45.373567Z node 5 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(6, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-11-03T16:51:45.373677Z node 5 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(6, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-11-03T16:51:45.384246Z node 5 :HIVE WARN: hive_impl.cpp:811: HIVE#72057594037968897 Handle TEvInterconnect::TEvNodeConnected, NodeId 6 Cookie 6
2025-11-03T16:51:45.384460Z node 5 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(5, (0,0,0,0)) VolatileState: Connecting -> Connected
2025-11-03T16:51:45.385799Z node 5 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(6, (0,0,0,0)) VolatileState: Connecting -> Connected
2025-11-03T16:51:45.399788Z node 5 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
TServer::EnableGrpc on GrpcPort 62855, node 5
2025-11-03T16:51:45.624927Z node 6 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-11-03T16:51:45.672703Z node 5 :NET_CLASSIFIER WARN: net_classifier.cpp:190: distributable config is empty, broken or outdated, will use file: /home/runner/.ya/build/build_root/7jz3/00197c/r3tmp/yandexQEzwEE.tmp
2025-11-03T16:51:45.672732Z node 5 :NET_CLASSIFIER WARN: net_classifier.cpp:196: will try to initialize from file: /home/runner/.ya/build/build_root/7jz3/00197c/r3tmp/yandexQEzwEE.tmp
2025-11-03T16:51:45.672876Z node 5 :NET_CLASSIFIER WARN: net_classifier.cpp:202: successfully initialized from file: /home/runner/.ya/build/build_root/7jz3/00197c/r3tmp/yandexQEzwEE.tmp
2025-11-03T16:51:45.673026Z node 5 :NET_CLASSIFIER ERROR: net_classifier.cpp:228: got bad distributable configuration
2025-11-03T16:51:45.788260Z INFO: TTestServer started on Port 20755 GrpcPort 62855
2025-11-03T16:51:46.056304Z node 5 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-11-03T16:51:46.083618Z node 6 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
TClient is connected to server localhost:20755
PQClient connected to localhost:62855
WaitRootIsUp 'Root'...
TClient::Ls request: Root
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "Root"
    PathId: 1
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 1
    CreateStep: 0
    ParentPathId: 1
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 1
      SubDomainVersion: 0
      SecurityStateVersion: 0
    }
    ChildrenExist: false
  }
  Children {
    Name: ".sys"
    PathId: 18446744073709551615
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 0
    CreateStep: 0
    ParentPathId: 18446744073709551615
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 0
      Pl...
(TRUNCATED)
WaitRootIsUp 'Root' success.
2025-11-03T16:51:46.470674Z node 5 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpAlterSubDomain, opId: 281474976710657:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_alter_subdomain.cpp:311)
waiting...
waiting...
waiting...
waiting...
2025-11-03T16:51:50.067970Z node 6 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[6:7568542857703833029:2086];send_to=[0:7307199536658146131:7762515];
2025-11-03T16:51:50.068080Z node 6 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
2025-11-03T16:51:50.891399Z node 6 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [6:7568542879178669809:2301], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-03T16:51:50.891410Z node 6 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [6:7568542879178669822:2304], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-03T16:51:50.891507Z node 6 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-03T16:51:50.891910Z node 6 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [6:7568542879178669826:2306], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-03T16:51:50.891970Z node 6 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-03T16:51:50.899082Z node 5 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateResourcePool, opId: 281474976720657:3, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_resource_pool.cpp:179)
2025-11-03T16:51:50.939757Z node 6 :KQP_WORKLOAD_SERVICE WARN: helpers.h:73: [WorkloadService] [TPoolCreatorActor] ActorId: [6:7568542879178669825:2305], DatabaseId: /Root, PoolId: default, Scheduled retry for error: { <main>: Error: Transaction 281474976720657 completed, doublechecking }
2025-11-03T16:51:51.045684Z node 6 :TX_PROXY ERROR: schemereq.cpp:593: Actor# [6:7568542883473637151:2141] txid# 281474976720658, issues: { message: "Check failed: path: \'/Root/.metadata/workload_manager/pools/default\', error: path exist, request accepts it (id: [OwnerId: 72057594046644480, LocalPathId: 8], type: EPathTypeResourcePool, state: EPathStateNoChanges)" severity: 1 }
2025-11-03T16:51:51.089178Z node 6 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:570: Compilation failed, self: [6:7568542883473637158:2310], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-11-03T16:51:51.092485Z node 6 :KQP_SESSION WARN: kqp_session_actor.cpp:2506: SessionId: ydb://session/3?node_id=6&id=ZDQ2YjNjNWMtOTFjMzFlYWItZGQ5YzgzNTMtM2I3YjM2MDY=, ActorId: [6:7568542879178669789:2300], ActorState: ExecuteState, TraceId: 01k95a3mz68jfvzh6gee1sbzyz, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-11-03T16:51:51.092957Z node 6 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-11-03T16:51:51.313205Z node 5 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:570: Compilation failed, self: [5:7568542886062990968:2336], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-11-03T16:51:51.326559Z node 5 :KQP_SESSION WARN: kqp_session_actor.cpp:2506: SessionId: ydb://session/3?node_id=5&id=OWVkOWM0NzItOThkZTYwNGItYmRkNTllMWYtZTgxZWNkZmM=, ActorId: [5:7568542886062990942:2329], ActorState: ExecuteState, TraceId: 01k95a3nah4cjs87v2a3vmn7bz, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-11-03T16:51:51.327309Z node 5 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-11-03T16:51:51.332871Z node 5 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710661:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:690)
2025-11-03T16:51:51.471910Z node 5 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710662:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:690)
2025-11-03T16:51:51.676844Z node 5 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710663:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:690)
=== Init DC: UPSERT INTO `/Root/PQ/Config/V2/Cluster` (name, balancer, local, enabled, weight) VALUES ("dc1", "localhost:62855", true, true, 1000);
2025-11-03T16:51:52.111298Z node 5 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976710664. Ctx: { TraceId: 01k95a3ny60sqae17s6nr0hzg3, Database: , SessionId: ydb://session/3?node_id=5&id=NjY4MWFkYjQtMzFlNWY2YzAtODdiMmE0ODgtMmE3MzQ3MDc=, PoolId: default, DatabaseId: /Root}. Database not set, use /Root
=== CheckClustersList. Subcribe to ClusterTracker from [5:7568542890357958669:2970] 
2025-11-03T16:52:00.280059Z node 5 :FLAT_TX_SCHEMESHARD WARN: schemeshard_impl.cpp:7727: Cannot get console configs
2025-11-03T16:52:00.280094Z node 5 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
=== CheckClustersList. Ok
2025-11-03T16:52:01.500392Z node 5 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710669:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:690)
waiting...
PQ Client: create topic: rt3.dc1--test-topic with 1 partitions
CallPersQueueGRPC request to localhost:62855
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-11-03T16:52:01.660987Z node 5 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
CallPersQueueGRPC request to localhost:62855
MetaRequest {
  CmdCreateTopic {
    Topic: "rt3.dc1--test-topic"
    NumPartitions: 1
    Config {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
  }
}
CallPersQueueGRPC response:
Status: 129
ProxyErrorCode: 53
SchemeStatus: 1
FlatTxId {
  TxId: 281474976710670
  SchemeShardTabletId: 72057594046644480
  PathId: 13
}
ErrorCode: OK
AddTopic: rt3.dc1--test-topic
===Run query:``DECLARE $version as Int64; DECLARE $path AS Utf8; DECLARE $cluster as Utf8; UPSERT INTO `/Root/PQ/Config/V2/Topics` (path, dc) VALUES ($path, $cluster); UPSERT INTO `/Root/PQ/Config/V2/Versions` (name, version) VALUES ("Topics", $version);`` with topic = test-topic, dc = dc1
2025-11-03T16:52:01.753451Z node 5 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1655: [72075186224037893][] pipe [5:7568542929012664778:3252] connected; active server actors: 1
2025-11-03T16:52:01.753708Z node 5 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1519: [72075186224037893][rt3.dc1--test-topic] updating configuration. Deleted partitions []. Added partitions [0]
2025-11-03T16:52:01.756192Z node 5 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:971: [72075186224037893][rt3.dc1--test-topic] Discovered subdomain [OwnerId: 72057594046644480, LocalPathId: 1] state, outOfSpace = 0 at RB 72075186224037893
2025-11-03T16:52:01.764163Z node 5 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:140: [72075186224037893][rt3.dc1--test-topic] BALANCER INIT DONE for rt3.dc1--test-topic: (0, 72075186224037892) 
2025-11-03T16:52:01.764094Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2960: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-11-03T16:52:01.789316Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2992: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-11-03T16:52:01.789593Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:787: [PQ: 72075186224037892] no config, start with empty partitions and default config
2025-11-03T16:52:01.789626Z node 6 :PERSQUEUE NOTICE: pq_impl.cpp:913: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-11-03T16:52:01.789664Z node 6 :PERSQUEUE INFO: pq_impl.cpp:612: [PQ: 72075186224037892] doesn't have tx writes info
2025-11-03T16:52:01.790902Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [5:7568542929012664777:3251], now have 1 active actors on pipe
2025-11-03T16:52:01.790924Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [5:7568542929012664814:2437], now have 1 active actors on pipe
2025-11-03T16:52:01.791458Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-03T16:52:01.792274Z node 5 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:404: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 6, Generation 1
2025-11-03T16:52:01.811044Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-03T16:52:01.838623Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [5:7568542929012664851:3308], now have 1 active actors on pipe
2025-11-03T16:52:01.839467Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-03T16:52:01.854520Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-03T16:52:01.855548Z node 6 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-11-03T16:52:01.855605Z node 6 :PERSQUEUE DEBUG: partition.cpp:1312: [72075186224037892][Partition][0][StateInit] HandleOnInit TEvPQ::TEvProposePartitionConfig
2025-11-03T16:52:01.855938Z node 6 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-11-03T16:52:01.856195Z node 6 :PERSQUEUE INFO: partition_init.cpp:1101: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [6:7568542926423310588:2394]
2025-11-03T16:52:01.863896Z node 6 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-11-03T16:52:01.863939Z node 6 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-11-03T16:52:01.863972Z node 6 :PERSQUEUE INFO: partition.cpp:707: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1 [6:7568542926423310588:2394]
2025-11-03T16:52:01.864024Z node 6 :PERSQUEUE DEBUG: partition.cpp:727: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 0 Head Offset 0 PartNo 0 PackedSize 0 count 0 nextOffset 0 batches 0
2025-11-03T16:52:01.864066Z node 6 :PERSQUEUE DEBUG: partition_mlp.cpp:83: [72075186224037892][Partition][0][StateIdle] Initializing MLP Consumers: 0
2025-11-03T16:52:01.865994Z node 6 :PERSQUEUE DEBUG: partition.cpp:4273: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 1
2025-11-03T16:52:01.866039Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:01.866135Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:01.866151Z node 6 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-03T16:52:01.866178Z node 6 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-11-03T16:52:01.866196Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:01.866208Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:01.866513Z node 6 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-11-03T16:52:01.866577Z node 6 :PERSQUEUE DEBUG: partition_read.cpp:923: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-11-03T16:52:01.866624Z node 6 :PERSQUEUE DEBUG: partition_mlp.cpp:60: [72075186224037892][Partition][0][StateIdle] Process MLP pending events. Count 0
2025-11-03T16:52:01.867270Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-03T16:52:01.867408Z node 6 :PERSQUEUE DEBUG: partition_compaction.cpp:183: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:52:01.882749Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-03T16:52:01.882924Z node 6 :PERSQUEUE DEBUG: partition.cpp:1416: [72075186224037892][Partition][0][StateIdle] Handle TEvPQ::TEvTxCommit Step 1762188721874, TxId 281474976710670
2025-11-03T16:52:01.882957Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:01.882975Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:01.883131Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:01.883400Z node 6 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-03T16:52:01.890670Z node 6 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-03T16:52:01.890848Z node 6 :PERSQUEUE DEBUG: partition_mlp.cpp:83: [72075186224037892][Partition][0][StateIdle] Initializing MLP Consumers: 0
2025-11-03T16:52:01.890973Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-11-03T16:52:01.890999Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:01.891012Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:01.891026Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:01.891061Z node 6 :PERSQUEUE DEBUG: partition_compaction.cpp:183: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:52:01.891394Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:398: [PQ: 72075186224037892] Apply new config PartitionConfig { LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 } PartitionIds: 0 TopicName: "rt3.dc1--test-topic" Version: 0 LocalDC: true Codecs { Ids: 0 Ids: 1 Ids: 2 Codecs: "raw" Codecs: "gzip" Codecs: "lzop" } TopicPath: "/Root/PQ/rt3.dc1--test-topic" YcCloudId: "" YcFolderId: "" YdbDatabaseId: "" YdbDatabasePath: "/Root" Partitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } AllPartitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } Consumers { Name: "user" ReadFromTimestampsMs: 0 FormatVersion: 0 Version: 0 Generation: 0 } MonitoringProjectId: ""
2025-11-03T16:52:01.891486Z node 6 :PERSQUEUE NOTICE: pq_impl.cpp:913: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-11-03T16:52:01.891770Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-03T16:52:01.910095Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-03T16:52:01.910195Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-03T16:52:01.916254Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-03T16:52:01.964981Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:01.965012Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:01.965028Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:02.065239Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:02.065270Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:02.065283Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:02.096630Z node 5 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976710671. Ctx: { TraceId: 01k95a3zjzeehd171xy7sx8396, Database: , SessionId: ydb://session/3?node_id=5&id=ZjY2YjY5YzktM2Y3NTRjZS1jZGI0MTNkNi1lNmQ4YTYyMg==, PoolId: default, DatabaseId: /Root}. Database not set, use /Root
===Query complete
TClient::Ls request: /Root/PQ/rt3.dc1--test-topic
2025-11-03T16:52:02.172111Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:02.172155Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:02.172177Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976710670
    CreateStep: 1762188721874
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts...
(TRUNCATED)
GetTopicVersionFromPath:  record Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976710670
    CreateStep: 1762188721874
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      YdbDatabasePath: "/Root"
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
    Partitions {
      PartitionId: 0
      TabletId: 72075186224037892
      Status: Active
    }
    AlterVersion: 1
    BalancerTabletID: 72075186224037893
    NextPartitionId: 1
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 1
      PlanResolution: 7
      Coordinators: 72057594046316545
      TimeCastBucketsPerMediator: 2
      Mediators: 72057594046382081
    }
    DomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    PathsInside: 12
    PathsLimit: 10000
    ShardsInside: 6
    ShardsLimit: 200000
    ResourcesDomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    DiskSpaceUsage {
      Tables {
        TotalSize: 1328
        DataSize: 1328
        IndexSize: 0
      }
      Topics {
        ReserveSize: 0
        AccountSize: 0
        DataSize: 0
        UsedReserveSize: 0
      }
    }
    PQPartitionsInside: 1
    PQPartitionsLimit: 1000000
    SchemeLimits {
      MaxDepth: 32
      MaxPaths: 10000
      MaxChildrenInDir: 100000
      MaxAclBytesSize: 10240
      MaxTableColumns: 200
      MaxTableColumnNameLength: 255
      MaxTableKeyColumns: 30
      MaxTableIndices: 20
      MaxShards: 200000
      MaxShardsInPath: 35000
      MaxConsistentCopyTargets: 10000
      MaxPathElementLength: 255
      ExtraPathSymbolsAllowed: "!\"#$%&\'()*+,-.:;<=>?@[\\]^_`{|}~"
      MaxPQPartitions: 1000000
      MaxTableCdcStreams: 5
      MaxExports: 10
      MaxImports: 10
      MaxColumnTableColumns: 10000
    }
  }
}
Path: "/Root/PQ/rt3.dc1--test-topic"
 name rt3.dc1--test-topic version1
CallPersQueueGRPC request to localhost:62855
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-11-03T16:52:02.248495Z node 5 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
MetaResponse {
  CmdGetTopicMetadataResult {
    TopicInfo {
      Topic: "rt3.dc1--test-topic"
      NumPartitions: 1
      Config {
        PartitionConfig {
          LifetimeSeconds: 86400
          LowWatermark: 8388608
          SourceIdLifetimeSeconds: 86400
          WriteSpeedInBytesPerSecond: 20000000
          BurstSize: 20000000
          SourceIdMaxCounts: 6000000
        }
        Version: 1
        LocalDC: true
        Codecs {
          Ids: 0
          Ids: 1
          Ids: 2
          Codecs: "raw"
          Codecs: "gzip"
          Codecs: "lzop"
        }
        TopicPath: "/Root/PQ/rt3.dc1--test-topic"
        YdbDatabasePath: "/Root"
        Consumers {
          Name: "user"
          ReadFromTimestampsMs: 0
          FormatVersion: 0
          Version: 0
        }
      }
      ErrorCode: OK
    }
  }
}
=== Topic created, have version: 1
2025-11-03T16:52:02.264365Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: try to update token
2025-11-03T16:52:02.264859Z :INFO: [] MessageGroupId [src] SessionId [] Write session: Do CDS request
2025-11-03T16:52:02.264902Z :INFO: [] MessageGroupId [src] SessionId [] Start write session. Will connect to endpoint: localhost:62855
2025-11-03T16:52:02.273937Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:02.273978Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:02.273995Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:02.286294Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src" }
2025-11-03T16:52:02.287066Z node 5 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-11-03T16:52:02.287106Z node 5 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1
2025-11-03T16:52:02.288068Z node 5 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src" }
2025-11-03T16:52:02.288222Z node 5 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1 topic: "test-topic" message_group_id: "src" from ipv6:[::1]:47660
2025-11-03T16:52:02.288242Z node 5 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:47660 proto=v1  topic=test-topic durationSec=0
2025-11-03T16:52:02.288254Z node 5 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-11-03T16:52:02.291046Z node 5 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1 sessionId:  describe result for acl check
2025-11-03T16:52:02.291202Z node 5 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-11-03T16:52:02.291217Z node 5 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-11-03T16:52:02.291230Z node 5 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-11-03T16:52:02.291252Z node 5 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [5:7568542933307632235:2454] (SourceId=src, PreferedPartition=(NULL)) StartKqpSession
2025-11-03T16:52:02.294876Z node 5 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [5:7568542933307632235:2454] (SourceId=src, PreferedPartition=(NULL)) Select from the table
2025-11-03T16:52:02.376737Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:02.376779Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:02.376799Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:02.476977Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:02.477008Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:02.477026Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:02.568994Z node 5 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [5:7568542933307632235:2454] (SourceId=src, PreferedPartition=(NULL)) RequestPQRB
2025-11-03T16:52:02.576413Z node 5 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1655: [72075186224037893][rt3.dc1--test-topic] pipe [5:7568542933307632286:2454] connected; active server actors: 1
2025-11-03T16:52:02.576673Z node 5 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [5:7568542933307632235:2454] (SourceId=src, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=src
2025-11-03T16:52:02.576698Z node 5 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [5:7568542933307632235:2454] (SourceId=src, PreferedPartition=(NULL)) Update the table
2025-11-03T16:52:02.584081Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:02.584120Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:02.584136Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:02.629628Z node 5 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1659: [72075186224037893][rt3.dc1--test-topic] pipe [5:7568542933307632286:2454] disconnected.
2025-11-03T16:52:02.629673Z node 5 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1670: [72075186224037893][rt3.dc1--test-topic] pipe [5:7568542933307632286:2454] disconnected; active server actors: 1
2025-11-03T16:52:02.629693Z node 5 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1695: [72075186224037893][rt3.dc1--test-topic] pipe [5:7568542933307632286:2454] disconnected no session
2025-11-03T16:52:02.688178Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:02.688216Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:02.688229Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:02.792022Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:02.792060Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:02.792074Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:02.875367Z node 5 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [5:7568542933307632235:2454] (SourceId=src, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-11-03T16:52:02.875411Z node 5 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [5:7568542933307632235:2454] (SourceId=src, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-11-03T16:52:02.875429Z node 5 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [5:7568542933307632235:2454] (SourceId=src, PreferedPartition=(NULL)) Start idle
2025-11-03T16:52:02.875460Z node 5 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-11-03T16:52:02.880704Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 6, Generation: 1
2025-11-03T16:52:02.883467Z :INFO: [] MessageGroupId [src] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1762188722883 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-11-03T16:52:02.883607Z :INFO: [] MessageGroupId [src] SessionId [] Write session established. Init response: session_id: "src|8c4f7df7-8d4d85ea-28b96339-d3a1f2cd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-11-03T16:52:02.883806Z :INFO: [] MessageGroupId [src] SessionId [src|8c4f7df7-8d4d85ea-28b96339-d3a1f2cd_0] Write session: close. Timeout = 0 ms
2025-11-03T16:52:02.882457Z node 5 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1 partition: 0 MaxSeqNo: 0 sessionId: src|8c4f7df7-8d4d85ea-28b96339-d3a1f2cd_0
2025-11-03T16:52:02.883857Z :INFO: [] MessageGroupId [src] SessionId [src|8c4f7df7-8d4d85ea-28b96339-d3a1f2cd_0] Write session will now close
2025-11-03T16:52:02.883905Z :DEBUG: [] MessageGroupId [src] SessionId [src|8c4f7df7-8d4d85ea-28b96339-d3a1f2cd_0] Write session: aborting
2025-11-03T16:52:02.880431Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [5:7568542933307632315:2454], now have 1 active actors on pipe
2025-11-03T16:52:02.881092Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:02.881123Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:02.881216Z node 6 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src|8c4f7df7-8d4d85ea-28b96339-d3a1f2cd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src
2025-11-03T16:52:02.881259Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:02.881285Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:02.884339Z :INFO: [] MessageGroupId [src] SessionId [src|8c4f7df7-8d4d85ea-28b96339-d3a1f2cd_0] Write session: gracefully shut down, all writes complete
2025-11-03T16:52:02.884381Z :DEBUG: [] MessageGroupId [src] SessionId [src|8c4f7df7-8d4d85ea-28b96339-d3a1f2cd_0] Write session: destroy
2025-11-03T16:52:02.881300Z node 6 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-03T16:52:02.881346Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:02.881393Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-03T16:52:02.881449Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-03T16:52:02.882032Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:02.882052Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:02.882116Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-03T16:52:02.888604Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:02.888633Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:02.888650Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:02.890059Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [5:7568542933307632315:2454] destroyed
2025-11-03T16:52:02.890097Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-11-03T16:52:02.890124Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:02.890139Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:02.890152Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:02.888320Z node 5 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId: src|8c4f7df7-8d4d85ea-28b96339-d3a1f2cd_0 grpc read done: success: 0 data: 
2025-11-03T16:52:02.888346Z node 5 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 1 sessionId: src|8c4f7df7-8d4d85ea-28b96339-d3a1f2cd_0 grpc read failed
2025-11-03T16:52:02.888377Z node 5 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 1 sessionId: src|8c4f7df7-8d4d85ea-28b96339-d3a1f2cd_0 grpc closed
2025-11-03T16:52:02.888395Z node 5 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1 sessionId: src|8c4f7df7-8d4d85ea-28b96339-d3a1f2cd_0 is DEAD
2025-11-03T16:52:02.889136Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-11-03T16:52:02.928249Z :INFO: [/Root] [/Root] [152d0c48-71e84a-9cbbbfc1-a9992672] Starting read session
2025-11-03T16:52:02.928308Z :DEBUG: [/Root] [/Root] [152d0c48-71e84a-9cbbbfc1-a9992672] Starting cluster discovery
2025-11-03T16:52:02.946822Z :DEBUG: [/Root] [/Root] [152d0c48-71e84a-9cbbbfc1-a9992672] Cluster discovery request succeeded
2025-11-03T16:52:02.946921Z :DEBUG: [/Root] [/Root] [152d0c48-71e84a-9cbbbfc1-a9992672] Starting session to cluster dc1 (localhost:62855)
2025-11-03T16:52:02.984720Z :DEBUG: [/Root] [/Root] [152d0c48-71e84a-9cbbbfc1-a9992672] [dc1] In Reconnect, ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:52:02.990264Z :DEBUG: [/Root] [/Root] [152d0c48-71e84a-9cbbbfc1-a9992672] [dc1] New values: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:52:02.990310Z :DEBUG: [/Root] [/Root] [152d0c48-71e84a-9cbbbfc1-a9992672] [dc1] Reconnecting session to cluster dc1 in 0.000000s
2025-11-03T16:52:02.989886Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:02.989917Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:02.989942Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:03.025428Z node 5 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:109: new grpc connection
2025-11-03T16:52:03.025453Z node 5 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:131: new session created cookie 1
2025-11-03T16:52:03.027281Z :DEBUG: [/Root] [/Root] [152d0c48-71e84a-9cbbbfc1-a9992672] [dc1] Successfully connected. Initializing session
2025-11-03T16:52:03.032574Z node 5 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { topic: "test-topic" } read_only_original: true consumer: "shared/user" read_params { max_read_size: 104857600 } } }
2025-11-03T16:52:03.032842Z node 5 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 1 consumer shared/user session shared/user_5_1_9837774242656528350_v1 read init: from# ipv6:[::1]:47698, request# { init_request { topics_read_settings { topic: "test-topic" } read_only_original: true consumer: "shared/user" read_params { max_read_size: 104857600 } } }
2025-11-03T16:52:03.033350Z node 5 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 1 consumer shared/user session shared/user_5_1_9837774242656528350_v1 auth for : user
2025-11-03T16:52:03.034679Z node 5 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 1 consumer shared/user session shared/user_5_1_9837774242656528350_v1 Handle describe topics response
2025-11-03T16:52:03.034889Z node 5 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 1 consumer shared/user session shared/user_5_1_9837774242656528350_v1 auth is DEAD
2025-11-03T16:52:03.035042Z node 5 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 1 consumer shared/user session shared/user_5_1_9837774242656528350_v1 auth ok: topics# 1, initDone# 0
2025-11-03T16:52:03.040636Z node 5 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 1 consumer shared/user session shared/user_5_1_9837774242656528350_v1 register session: topic# rt3.dc1--test-topic
2025-11-03T16:52:03.041661Z :INFO: [/Root] [/Root] [152d0c48-71e84a-9cbbbfc1-a9992672] [dc1] Server session id: shared/user_5_1_9837774242656528350_v1
2025-11-03T16:52:03.041898Z :DEBUG: [/Root] [/Root] [152d0c48-71e84a-9cbbbfc1-a9992672] [dc1] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:52:03.042347Z node 5 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_5_1_9837774242656528350_v1 grpc read done: success# 1, data# { read { } }
2025-11-03T16:52:03.042452Z node 5 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_5_1_9837774242656528350_v1 got read request: guid# bb4c5111-e820a14c-9a4ffbd9-6ddf260c
2025-11-03T16:52:03.048297Z node 5 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1655: [72075186224037893][rt3.dc1--test-topic] pipe [5:7568542937602599630:2477] connected; active server actors: 1
2025-11-03T16:52:03.048970Z node 5 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1706: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [5:7568542937602599630:2477] session shared/user_5_1_9837774242656528350_v1
2025-11-03T16:52:03.049030Z node 5 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:639: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-11-03T16:52:03.049098Z node 5 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:669: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-11-03T16:52:03.049148Z node 5 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:871: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_5_1_9837774242656528350_v1" (Sender=[5:7568542937602599626:2477], Pipe=[5:7568542937602599630:2477], Partitions=[], ActiveFamilyCount=0)
2025-11-03T16:52:03.049179Z node 5 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1186: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-11-03T16:52:03.049234Z node 5 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1258: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-11-03T16:52:03.049300Z node 5 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1305: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_5_1_9837774242656528350_v1" (Sender=[5:7568542937602599626:2477], Pipe=[5:7568542937602599630:2477], Partitions=[], ActiveFamilyCount=0)
2025-11-03T16:52:03.049370Z node 5 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:549: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_5_1_9837774242656528350_v1" sender [5:7568542937602599626:2477] lock partition 0 for ReadingSession "shared/user_5_1_9837774242656528350_v1" (Sender=[5:7568542937602599626:2477], Pipe=[5:7568542937602599630:2477], Partitions=[], ActiveFamilyCount=1) generation 1 step 1
2025-11-03T16:52:03.049438Z node 5 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1325: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-11-03T16:52:03.049470Z node 5 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1402: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000211s
2025-11-03T16:52:03.050601Z node 5 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 1 consumer shared/user session shared/user_5_1_9837774242656528350_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 1 Session: "shared/user_5_1_9837774242656528350_v1" ClientId: "user" PipeClient { RawX1: 7568542937602599630 RawX2: 4503621102209453 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-11-03T16:52:03.051237Z node 5 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 1 consumer shared/user session shared/user_5_1_9837774242656528350_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-11-03T16:52:03.056755Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [5:7568542937602599637:2480], now have 1 active actors on pipe
2025-11-03T16:52:03.057141Z node 5 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_5_1_9837774242656528350_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 1, pipe: [5:7568542937602599637:2480]
2025-11-03T16:52:03.057513Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:03.057556Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:03.057599Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:1748: [PQ: 72075186224037892] Created session shared/user_5_1_9837774242656528350_v1 on pipe: [5:7568542937602599637:2480]
2025-11-03T16:52:03.057667Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:03.057695Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:03.057711Z node 6 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-03T16:52:03.057785Z node 6 :PERSQUEUE DEBUG: partition.cpp:3666: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_5_1_9837774242656528350_v1
2025-11-03T16:52:03.057803Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:03.057969Z node 6 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-03T16:52:03.058483Z node 6 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_5_1_9837774242656528350_v1:1 with generation 1
2025-11-03T16:52:03.062498Z node 6 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-03T16:52:03.062608Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-11-03T16:52:03.062642Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:03.062658Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:03.062674Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:03.062715Z node 6 :PERSQUEUE DEBUG: partition_compaction.cpp:183: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:52:03.062759Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-11-03T16:52:03.068245Z node 5 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_5_1_9837774242656528350_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 0 SizeLag: 0 WriteTimestampEstimateMS: 1762188722989 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-11-03T16:52:03.068309Z node 5 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 1 consumer shared/user session shared/user_5_1_9837774242656528350_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 0 readOffset 0 committedOffset 0
2025-11-03T16:52:03.068422Z node 5 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 1 consumer shared/user session shared/user_5_1_9837774242656528350_v1 sending to client partition status
CreatePartitionStream { PartitionStreamId: 1 TopicPath: test-topic Cluster: dc1 PartitionId: 0 CommittedOffset: 0 EndOffset: 0 }
2025-11-03T16:52:03.072631Z :INFO: [/Root] [/Root] [152d0c48-71e84a-9cbbbfc1-a9992672] Closing read session. Close timeout: 0.000000s
2025-11-03T16:52:03.072708Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): dc1:test-topic:0:1:0:0
2025-11-03T16:52:03.072762Z :INFO: [/Root] [/Root] [152d0c48-71e84a-9cbbbfc1-a9992672] Counters: { Errors: 0 CurrentSessionLifetimeMs: 144 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-11-03T16:52:03.072874Z :NOTICE: [/Root] [/Root] [152d0c48-71e84a-9cbbbfc1-a9992672] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Close with zero timeout " }
2025-11-03T16:52:03.072947Z :DEBUG: [/Root] [/Root] [152d0c48-71e84a-9cbbbfc1-a9992672] [dc1] Abort session to cluster
2025-11-03T16:52:03.073539Z :NOTICE: [/Root] [/Root] [152d0c48-71e84a-9cbbbfc1-a9992672] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
2025-11-03T16:52:03.073883Z :INFO: [/Root] [/Root] [c836251e-203c858d-9415a368-922f03eb] Starting read session
2025-11-03T16:52:03.073921Z :DEBUG: [/Root] [/Root] [c836251e-203c858d-9415a368-922f03eb] Starting cluster discovery
2025-11-03T16:52:03.080767Z node 5 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_5_1_9837774242656528350_v1 grpc read done: success# 0, data# {  }
2025-11-03T16:52:03.080795Z node 5 :PQ_READ_PROXY INFO: read_session_actor.cpp:125: session cookie 1 consumer shared/user session shared/user_5_1_9837774242656528350_v1 grpc read failed
2025-11-03T16:52:03.080836Z node 5 :PQ_READ_PROXY INFO: read_session_actor.cpp:1666: session cookie 1 consumer shared/user session shared/user_5_1_9837774242656528350_v1 closed
2025-11-03T16:52:03.080904Z node 5 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 1 consumer shared/user session shared/user_5_1_9837774242656528350_v1 is DEAD
2025-11-03T16:52:03.081605Z node 5 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1659: [72075186224037893][rt3.dc1--test-topic] pipe [5:7568542937602599630:2477] disconnected.
2025-11-03T16:52:03.081642Z node 5 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1670: [72075186224037893][rt3.dc1--test-topic] pipe [5:7568542937602599630:2477] disconnected; active server actors: 1
2025-11-03T16:52:03.081662Z node 5 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1679: [72075186224037893][rt3.dc1--test-topic] pipe [5:7568542937602599630:2477] client user disconnected session shared/user_5_1_9837774242656528350_v1
2025-11-03T16:52:03.095458Z :DEBUG: [/Root] [/Root] [c836251e-203c858d-9415a368-922f03eb] Cluster discovery request succeeded
2025-11-03T16:52:03.095608Z :NOTICE: [/Root] [/Root] [c836251e-203c858d-9415a368-922f03eb] Aborting read session. Description: SessionClosed { Status: BAD_REQUEST Issues: "<main>: Error: Unsupported cluster: unknown_cluster " }
2025-11-03T16:52:03.082151Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2258: [PQ: 72075186224037892] Destroy direct read session shared/user_5_1_9837774242656528350_v1
2025-11-03T16:52:03.082198Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [5:7568542937602599637:2480] destroyed
2025-11-03T16:52:03.082702Z node 6 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_5_1_9837774242656528350_v1
2025-11-03T16:52:03.096093Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:03.096118Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:03.096135Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:03.097710Z :NOTICE: [/Root] [/Root] [c836251e-203c858d-9415a368-922f03eb] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
SessionClosed { Status: BAD_REQUEST Issues: "<main>: Error: Unsupported cluster: unknown_cluster " }
2025-11-03T16:52:03.097821Z :INFO: [/Root] [/Root] [c836251e-203c858d-9415a368-922f03eb] Closing read session. Close timeout: 0.000000s
2025-11-03T16:52:03.097952Z :NOTICE: [/Root] [/Root] [c836251e-203c858d-9415a368-922f03eb] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
2025-11-03T16:52:03.098217Z :INFO: [/Root] [/Root] [13341e41-22af379-39ca5f56-272d245f] Starting read session
2025-11-03T16:52:03.098254Z :DEBUG: [/Root] [/Root] [13341e41-22af379-39ca5f56-272d245f] Starting cluster discovery
2025-11-03T16:52:03.113521Z :DEBUG: [/Root] [/Root] [13341e41-22af379-39ca5f56-272d245f] Cluster discovery request succeeded
2025-11-03T16:52:03.113645Z :NOTICE: [/Root] [/Root] [13341e41-22af379-39ca5f56-272d245f] Aborting read session. Description: SessionClosed { Status: BAD_REQUEST Issues: "<main>: Error: Unsupported cluster: unknown_cluster " }
2025-11-03T16:52:03.114248Z :NOTICE: [/Root] [/Root] [13341e41-22af379-39ca5f56-272d245f] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
SessionClosed { Status: BAD_REQUEST Issues: "<main>: Error: Unsupported cluster: unknown_cluster " }
2025-11-03T16:52:03.114362Z :INFO: [/Root] [/Root] [13341e41-22af379-39ca5f56-272d245f] Closing read session. Close timeout: 0.000000s
2025-11-03T16:52:03.114465Z :NOTICE: [/Root] [/Root] [13341e41-22af379-39ca5f56-272d245f] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
2025-11-03T16:52:03.200118Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:03.200160Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:03.200178Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:03.308189Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:03.308227Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:03.308244Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:03.412165Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:03.412204Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:03.412222Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:06.016105Z :ReadSession INFO: Random seed for debugging is 1762188726016078
2025-11-03T16:52:06.834037Z node 7 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[7:7568542948069510563:2196];send_to=[0:7307199536658146131:7762515];
2025-11-03T16:52:06.834272Z node 7 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
2025-11-03T16:52:06.877241Z node 8 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[8:7568542947581113793:2078];send_to=[0:7307199536658146131:7762515];
2025-11-03T16:52:06.877299Z node 8 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
2025-11-03T16:52:06.915666Z node 7 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-11-03T16:52:06.923784Z node 7 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
test_client.cpp: SetPath # /home/runner/.ya/build/build_root/7jz3/00197c/r3tmp/tmp6M52Or/pdisk_1.dat
2025-11-03T16:52:06.950573Z node 8 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-11-03T16:52:06.951404Z node 8 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-11-03T16:52:07.168323Z node 7 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-11-03T16:52:07.176525Z node 8 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-11-03T16:52:07.219485Z node 7 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
2025-11-03T16:52:07.298468Z node 7 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(7, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-11-03T16:52:07.298588Z node 7 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(7, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-11-03T16:52:07.303617Z node 7 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(8, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-11-03T16:52:07.303709Z node 7 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(8, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-11-03T16:52:07.310455Z node 7 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(7, (0,0,0,0)) VolatileState: Connecting -> Connected
2025-11-03T16:52:07.313083Z node 7 :HIVE WARN: hive_impl.cpp:811: HIVE#72057594037968897 Handle TEvInterconnect::TEvNodeConnected, NodeId 8 Cookie 8
2025-11-03T16:52:07.317663Z node 7 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(8, (0,0,0,0)) VolatileState: Connecting -> Connected
TServer::EnableGrpc on GrpcPort 64953, node 7
2025-11-03T16:52:07.518138Z node 8 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-11-03T16:52:07.545739Z node 7 :NET_CLASSIFIER WARN: net_classifier.cpp:190: distributable config is empty, broken or outdated, will use file: /home/runner/.ya/build/build_root/7jz3/00197c/r3tmp/yandexpLrLFb.tmp
2025-11-03T16:52:07.545776Z node 7 :NET_CLASSIFIER WARN: net_classifier.cpp:196: will try to initialize from file: /home/runner/.ya/build/build_root/7jz3/00197c/r3tmp/yandexpLrLFb.tmp
2025-11-03T16:52:07.545934Z node 7 :NET_CLASSIFIER WARN: net_classifier.cpp:202: successfully initialized from file: /home/runner/.ya/build/build_root/7jz3/00197c/r3tmp/yandexpLrLFb.tmp
2025-11-03T16:52:07.546127Z node 7 :NET_CLASSIFIER ERROR: net_classifier.cpp:228: got bad distributable configuration
2025-11-03T16:52:07.595324Z INFO: TTestServer started on Port 9413 GrpcPort 64953
2025-11-03T16:52:07.675678Z node 7 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-11-03T16:52:07.852148Z node 7 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
TClient is connected to server localhost:9413
PQClient connected to localhost:64953
WaitRootIsUp 'Root'...
TClient::Ls request: Root
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "Root"
    PathId: 1
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 1
    CreateStep: 0
    ParentPathId: 1
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 1
      SubDomainVersion: 0
      SecurityStateVersion: 0
    }
    ChildrenExist: false
  }
  Children {
    Name: ".sys"
    PathId: 18446744073709551615
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 0
    CreateStep: 0
    ParentPathId: 18446744073709551615
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 0
      Pl...
(TRUNCATED)
WaitRootIsUp 'Root' success.
2025-11-03T16:52:07.924248Z node 8 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-11-03T16:52:07.926392Z node 7 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpAlterSubDomain, opId: 281474976715657:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_alter_subdomain.cpp:311)
waiting...
waiting...
2025-11-03T16:52:08.040524Z node 7 :FLAT_TX_SCHEMESHARD WARN: schemeshard__notify.cpp:122: NotifyTxCompletion, unknown transaction, txId: 281474976715658, at schemeshard: 72057594046644480
waiting...
waiting...
2025-11-03T16:52:11.833454Z node 7 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[7:7568542948069510563:2196];send_to=[0:7307199536658146131:7762515];
2025-11-03T16:52:11.833518Z node 7 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
2025-11-03T16:52:11.880252Z node 8 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[8:7568542947581113793:2078];send_to=[0:7307199536658146131:7762515];
2025-11-03T16:52:11.880325Z node 8 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
2025-11-03T16:52:12.510241Z node 7 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [7:7568542973839315188:2332], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-03T16:52:12.510314Z node 7 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [7:7568542973839315174:2329], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-03T16:52:12.510455Z node 7 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-03T16:52:12.514832Z node 7 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateResourcePool, opId: 281474976715661:3, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_resource_pool.cpp:179)
2025-11-03T16:52:12.516149Z node 7 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [7:7568542973839315213:2335], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-03T16:52:12.516263Z node 7 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-03T16:52:12.561255Z node 7 :KQP_WORKLOAD_SERVICE WARN: helpers.h:73: [WorkloadService] [TPoolCreatorActor] ActorId: [7:7568542973839315212:2334], DatabaseId: /Root, PoolId: default, Scheduled retry for error: { <main>: Error: Transaction 281474976715661 completed, doublechecking }
2025-11-03T16:52:12.577627Z node 7 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976715662:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:690)
2025-11-03T16:52:12.604118Z node 8 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:570: Compilation failed, self: [8:7568542973350917911:2306], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-11-03T16:52:12.607657Z node 8 :KQP_SESSION WARN: kqp_session_actor.cpp:2506: SessionId: ydb://session/3?node_id=8&id=N2VjYzQxMTAtNDZjMjQyYi1kM2JlNTJhNS01MmQxMGE0OQ==, ActorId: [8:7568542973350917887:2300], ActorState: ExecuteState, TraceId: 01k95a4a3vbwagdthmsa3r2kk9, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-11-03T16:52:12.609307Z node 8 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-11-03T16:52:12.645717Z node 7 :TX_PROXY ERROR: schemereq.cpp:593: Actor# [7:7568542973839315368:2729] txid# 281474976715663, issues: { message: "Check failed: path: \'/Root/.metadata/workload_manager/pools/default\', error: path exist, request accepts it (id: [OwnerId: 72057594046644480, LocalPathId: 8], type: EPathTypeResourcePool, state: EPathStateNoChanges)" severity: 1 }
2025-11-03T16:52:12.728622Z node 7 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976715664:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:690)
2025-11-03T16:52:12.768187Z node 7 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:570: Compilation failed, self: [7:7568542973839315385:2346], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-11-03T16:52:12.771617Z node 7 :KQP_SESSION WARN: kqp_session_actor.cpp:2506: SessionId: ydb://session/3?node_id=7&id=YzJiOTAyNjItYWIyZWYzMjAtNzNmZGIyNjctYzVjMThmNzY=, ActorId: [7:7568542973839315172:2328], ActorState: ExecuteState, TraceId: 01k95a4a2v9gb4ptaakra5hk3f, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-11-03T16:52:12.776206Z node 7 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-11-03T16:52:12.935489Z node 7 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976715665:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:690)
=== Init DC: UPSERT INTO `/Root/PQ/Config/V2/Cluster` (name, balancer, local, enabled, weight) VALUES ("dc1", "localhost:64953", true, true, 1000);
2025-11-03T16:52:13.386005Z node 7 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976715666. Ctx: { TraceId: 01k95a4apnbspgm89vjbtv97hm, Database: , SessionId: ydb://session/3?node_id=7&id=NGIxY2Q0NDEtNWRhZDhmZDUtNTE5ZDZiOTgtZTFmOWM5NTY=, PoolId: default, DatabaseId: /Root}. Database not set, use /Root
=== CheckClustersList. Subcribe to ClusterTracker from [7:7568542978134283021:2990] 
=== CheckClustersList. Ok
2025-11-03T16:52:21.909989Z node 7 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976715671:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:690)
waiting...
PQ Client: create topic: rt3.dc1--test-topic with 1 partitions
CallPersQueueGRPC request to localhost:64953
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-11-03T16:52:22.052428Z node 7 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
CallPersQueueGRPC request to localhost:64953
MetaRequest {
  CmdCreateTopic {
    Topic: "rt3.dc1--test-topic"
    NumPartitions: 1
    Config {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
  }
}
CallPersQueueGRPC response:
Status: 129
ProxyErrorCode: 53
SchemeStatus: 1
FlatTxId {
  TxId: 281474976715672
  SchemeShardTabletId: 72057594046644480
  PathId: 13
}
ErrorCode: OK
AddTopic: rt3.dc1--test-topic
===Run query:``DECLARE $version as Int64; DECLARE $path AS Utf8; DECLARE $cluster as Utf8; UPSERT INTO `/Root/PQ/Config/V2/Topics` (path, dc) VALUES ($path, $cluster); UPSERT INTO `/Root/PQ/Config/V2/Versions` (name, version) VALUES ("Topics", $version);`` with topic = test-topic, dc = dc1
2025-11-03T16:52:22.112483Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1655: [72075186224037893][] pipe [7:7568543016788989098:3246] connected; active server actors: 1
2025-11-03T16:52:22.112719Z node 7 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1519: [72075186224037893][rt3.dc1--test-topic] updating configuration. Deleted partitions []. Added partitions [0]
2025-11-03T16:52:22.115914Z node 7 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:971: [72075186224037893][rt3.dc1--test-topic] Discovered subdomain [OwnerId: 72057594046644480, LocalPathId: 1] state, outOfSpace = 0 at RB 72075186224037893
2025-11-03T16:52:22.123171Z node 7 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:140: [72075186224037893][rt3.dc1--test-topic] BALANCER INIT DONE for rt3.dc1--test-topic: (0, 72075186224037892) 
2025-11-03T16:52:22.125732Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2960: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-11-03T16:52:22.165990Z node 7 :FLAT_TX_SCHEMESHARD WARN: schemeshard_impl.cpp:7727: Cannot get console configs
2025-11-03T16:52:22.166024Z node 7 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
2025-11-03T16:52:22.177397Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2992: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-11-03T16:52:22.177760Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:787: [PQ: 72075186224037892] no config, start with empty partitions and default config
2025-11-03T16:52:22.177802Z node 8 :PERSQUEUE NOTICE: pq_impl.cpp:913: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-11-03T16:52:22.177854Z node 8 :PERSQUEUE INFO: pq_impl.cpp:612: [PQ: 72075186224037892] doesn't have tx writes info
2025-11-03T16:52:22.178950Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [7:7568543016788989147:2447], now have 1 active actors on pipe
2025-11-03T16:52:22.178977Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [7:7568543016788989097:3245], now have 1 active actors on pipe
2025-11-03T16:52:22.181038Z node 7 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:404: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 8, Generation 1
2025-11-03T16:52:22.181947Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-03T16:52:22.194192Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-03T16:52:22.212052Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [7:7568543016788989183:3306], now have 1 active actors on pipe
2025-11-03T16:52:22.214769Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-03T16:52:22.224174Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-03T16:52:22.225120Z node 8 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-11-03T16:52:22.225169Z node 8 :PERSQUEUE DEBUG: partition.cpp:1312: [72075186224037892][Partition][0][StateInit] HandleOnInit TEvPQ::TEvProposePartitionConfig
2025-11-03T16:52:22.225494Z node 8 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-11-03T16:52:22.225714Z node 8 :PERSQUEUE INFO: partition_init.cpp:1101: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [8:7568543016300591340:2390]
2025-11-03T16:52:22.232064Z node 8 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-11-03T16:52:22.232095Z node 8 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-11-03T16:52:22.232124Z node 8 :PERSQUEUE INFO: partition.cpp:707: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1 [8:7568543016300591340:2390]
2025-11-03T16:52:22.232154Z node 8 :PERSQUEUE DEBUG: partition.cpp:727: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 0 Head Offset 0 PartNo 0 PackedSize 0 count 0 nextOffset 0 batches 0
2025-11-03T16:52:22.232193Z node 8 :PERSQUEUE DEBUG: partition_mlp.cpp:83: [72075186224037892][Partition][0][StateIdle] Initializing MLP Consumers: 0
2025-11-03T16:52:22.233650Z node 8 :PERSQUEUE DEBUG: partition.cpp:4273: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 1
2025-11-03T16:52:22.233691Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:22.233785Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:22.233799Z node 8 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-03T16:52:22.233821Z node 8 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-11-03T16:52:22.233838Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:22.233850Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:22.233867Z node 8 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-11-03T16:52:22.233902Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:923: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-11-03T16:52:22.233947Z node 8 :PERSQUEUE DEBUG: partition_mlp.cpp:60: [72075186224037892][Partition][0][StateIdle] Process MLP pending events. Count 0
2025-11-03T16:52:22.234594Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-03T16:52:22.234733Z node 8 :PERSQUEUE DEBUG: partition_compaction.cpp:183: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:52:22.261911Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-03T16:52:22.262085Z node 8 :PERSQUEUE DEBUG: partition.cpp:1416: [72075186224037892][Partition][0][StateIdle] Handle TEvPQ::TEvTxCommit Step 1762188742251, TxId 281474976715672
2025-11-03T16:52:22.262113Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:22.262133Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:22.262288Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:22.262560Z node 8 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-03T16:52:22.268317Z node 7 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976715673. Ctx: { TraceId: 01k95a4kfa5zpv0yce7hdp1chv, Database: , SessionId: ydb://session/3?node_id=7&id=YzE3MDQ5ZTctMjhmYWYzMjctZTY4Mjg2YWItNzdlMWFlMzU=, PoolId: default, DatabaseId: /Root}. Database not set, use /Root
2025-11-03T16:52:22.269045Z node 8 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-03T16:52:22.269240Z node 8 :PERSQUEUE DEBUG: partition_mlp.cpp:83: [72075186224037892][Partition][0][StateIdle] Initializing MLP Consumers: 0
2025-11-03T16:52:22.269383Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-11-03T16:52:22.269410Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:22.269426Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:22.269440Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:22.269476Z node 8 :PERSQUEUE DEBUG: partition_compaction.cpp:183: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:52:22.269851Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:398: [PQ: 72075186224037892] Apply new config PartitionConfig { LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 } PartitionIds: 0 TopicName: "rt3.dc1--test-topic" Version: 0 LocalDC: true Codecs { Ids: 0 Ids: 1 Ids: 2 Codecs: "raw" Codecs: "gzip" Codecs: "lzop" } TopicPath: "/Root/PQ/rt3.dc1--test-topic" YcCloudId: "" YcFolderId: "" YdbDatabaseId: "" YdbDatabasePath: "/Root" Partitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } AllPartitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } Consumers { Name: "user" ReadFromTimestampsMs: 0 FormatVersion: 0 Version: 0 Generation: 0 } MonitoringProjectId: ""
2025-11-03T16:52:22.269960Z node 8 :PERSQUEUE NOTICE: pq_impl.cpp:913: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-11-03T16:52:22.270279Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-03T16:52:22.287888Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-03T16:52:22.288031Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-03T16:52:22.297486Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
===Query complete
TClient::Ls request: /Root/PQ/rt3.dc1--test-topic
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976715672
    CreateStep: 1762188742251
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts...
(TRUNCATED)
GetTopicVersionFromPath:  record Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976715672
    CreateStep: 1762188742251
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      YdbDatabasePath: "/Root"
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
    Partitions {
      PartitionId: 0
      TabletId: 72075186224037892
      Status: Active
    }
    AlterVersion: 1
    BalancerTabletID: 72075186224037893
    NextPartitionId: 1
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 1
      PlanResolution: 7
      Coordinators: 72057594046316545
      TimeCastBucketsPerMediator: 2
      Mediators: 72057594046382081
    }
    DomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    PathsInside: 12
    PathsLimit: 10000
    ShardsInside: 6
    ShardsLimit: 200000
    ResourcesDomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    DiskSpaceUsage {
      Tables {
        TotalSize: 0
        DataSize: 0
        IndexSize: 0
      }
      Topics {
        ReserveSize: 0
        AccountSize: 0
        DataSize: 0
        UsedReserveSize: 0
      }
    }
    PQPartitionsInside: 1
    PQPartitionsLimit: 1000000
    SchemeLimits {
      MaxDepth: 32
      MaxPaths: 10000
      MaxChildrenInDir: 100000
      MaxAclBytesSize: 10240
      MaxTableColumns: 200
      MaxTableColumnNameLength: 255
      MaxTableKeyColumns: 30
      MaxTableIndices: 20
      MaxShards: 200000
      MaxShardsInPath: 35000
      MaxConsistentCopyTargets: 10000
      MaxPathElementLength: 255
      ExtraPathSymbolsAllowed: "!\"#$%&\'()*+,-.:;<=>?@[\\]^_`{|}~"
      MaxPQPartitions: 1000000
      MaxTableCdcStreams: 5
      MaxExports: 10
      MaxImports: 10
      MaxColumnTableColumns: 10000
    }
  }
}
Path: "/Root/PQ/rt3.dc1--test-topic"
 name rt3.dc1--test-topic version1
CallPersQueueGRPC request to localhost:64953
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-11-03T16:52:22.334991Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:22.335031Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:22.335047Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:22.337598Z node 7 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
MetaResponse {
  CmdGetTopicMetadataResult {
    TopicInfo {
      Topic: "rt3.dc1--test-topic"
      NumPartitions: 1
      Config {
        PartitionConfig {
          LifetimeSeconds: 86400
          LowWatermark: 8388608
          SourceIdLifetimeSeconds: 86400
          WriteSpeedInBytesPerSecond: 20000000
          BurstSize: 20000000
          SourceIdMaxCounts: 6000000
        }
        Version: 1
        LocalDC: true
        Codecs {
          Ids: 0
          Ids: 1
          Ids: 2
          Codecs: "raw"
          Codecs: "gzip"
          Codecs: "lzop"
        }
        TopicPath: "/Root/PQ/rt3.dc1--test-topic"
        YdbDatabasePath: "/Root"
        Consumers {
          Name: "user"
          ReadFromTimestampsMs: 0
          FormatVersion: 0
          Version: 0
        }
      }
      ErrorCode: OK
    }
  }
}
=== Topic created, have version: 1
2025-11-03T16:52:22.354467Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: try to update token
2025-11-03T16:52:22.357029Z :INFO: [] MessageGroupId [src] SessionId [] Write session: Do CDS request
2025-11-03T16:52:22.357100Z :INFO: [] MessageGroupId [src] SessionId [] Start write session. Will connect to endpoint: localhost:64953
2025-11-03T16:52:22.372916Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src" }
2025-11-03T16:52:22.376968Z node 7 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-11-03T16:52:22.377006Z node 7 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1
2025-11-03T16:52:22.377524Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src" }
2025-11-03T16:52:22.377647Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1 topic: "test-topic" message_group_id: "src" from ipv6:[::1]:59240
2025-11-03T16:52:22.377667Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:59240 proto=v1  topic=test-topic durationSec=0
2025-11-03T16:52:22.377677Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-11-03T16:52:22.379385Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1 sessionId:  describe result for acl check
2025-11-03T16:52:22.379500Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-11-03T16:52:22.379510Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-11-03T16:52:22.379523Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-11-03T16:52:22.379542Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [7:7568543016788989256:2464] (SourceId=src, PreferedPartition=(NULL)) StartKqpSession
2025-11-03T16:52:22.382704Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [7:7568543016788989256:2464] (SourceId=src, PreferedPartition=(NULL)) Select from the table
2025-11-03T16:52:22.436088Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:22.436127Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:22.436141Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:22.540088Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:22.540125Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:22.540137Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:22.578549Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [7:7568543016788989256:2464] (SourceId=src, PreferedPartition=(NULL)) RequestPQRB
2025-11-03T16:52:22.580623Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1655: [72075186224037893][rt3.dc1--test-topic] pipe [7:7568543016788989300:2464] connected; active server actors: 1
2025-11-03T16:52:22.580815Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [7:7568543016788989256:2464] (SourceId=src, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=src
2025-11-03T16:52:22.580838Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [7:7568543016788989256:2464] (SourceId=src, PreferedPartition=(NULL)) Update the table
2025-11-03T16:52:22.584417Z node 7 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1659: [72075186224037893][rt3.dc1--test-topic] pipe [7:7568543016788989300:2464] disconnected.
2025-11-03T16:52:22.584450Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1670: [72075186224037893][rt3.dc1--test-topic] pipe [7:7568543016788989300:2464] disconnected; active server actors: 1
2025-11-03T16:52:22.584470Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1695: [72075186224037893][rt3.dc1--test-topic] pipe [7:7568543016788989300:2464] disconnected no session
2025-11-03T16:52:22.644094Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:22.644131Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:22.644145Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:22.731824Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [7:7568543016788989256:2464] (SourceId=src, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-11-03T16:52:22.731871Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [7:7568543016788989256:2464] (SourceId=src, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-11-03T16:52:22.731890Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [7:7568543016788989256:2464] (SourceId=src, PreferedPartition=(NULL)) Start idle
2025-11-03T16:52:22.731924Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-11-03T16:52:22.734480Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [7:7568543016788989325:2464], now have 1 active actors on pipe
2025-11-03T16:52:22.734831Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 8, Generation: 1
2025-11-03T16:52:22.735146Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:22.735178Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:22.735261Z node 8 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src|bf4c8d43-8bc60060-47414d1c-1d5f8418_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src
2025-11-03T16:52:22.735301Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:22.735325Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:22.735340Z node 8 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-03T16:52:22.735379Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:22.735419Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-03T16:52:22.735486Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-03T16:52:22.736972Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:22.737004Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:22.737082Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-03T16:52:22.737623Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1 partition: 0 MaxSeqNo: 0 sessionId: src|bf4c8d43-8bc60060-47414d1c-1d5f8418_0
2025-11-03T16:52:22.738564Z :INFO: [] MessageGroupId [src] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1762188742738 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-11-03T16:52:22.738724Z :INFO: [] MessageGroupId [src] SessionId [] Write session established. Init response: session_id: "src|bf4c8d43-8bc60060-47414d1c-1d5f8418_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-11-03T16:52:22.739016Z :INFO: [] MessageGroupId [src] SessionId [src|bf4c8d43-8bc60060-47414d1c-1d5f8418_0] Write session: close. Timeout = 0 ms
2025-11-03T16:52:22.739066Z :INFO: [] MessageGroupId [src] SessionId [src|bf4c8d43-8bc60060-47414d1c-1d5f8418_0] Write session will now close
2025-11-03T16:52:22.739111Z :DEBUG: [] MessageGroupId [src] SessionId [src|bf4c8d43-8bc60060-47414d1c-1d5f8418_0] Write session: aborting
2025-11-03T16:52:22.739483Z :INFO: [] MessageGroupId [src] SessionId [src|bf4c8d43-8bc60060-47414d1c-1d5f8418_0] Write session: gracefully shut down, all writes complete
2025-11-03T16:52:22.739527Z :DEBUG: [] MessageGroupId [src] SessionId [src|bf4c8d43-8bc60060-47414d1c-1d5f8418_0] Write session: destroy
2025-11-03T16:52:22.744690Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:22.744721Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:22.744737Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:22.779269Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId: src|bf4c8d43-8bc60060-47414d1c-1d5f8418_0 grpc read done: success: 0 data: 
2025-11-03T16:52:22.779300Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 1 sessionId: src|bf4c8d43-8bc60060-47414d1c-1d5f8418_0 grpc read failed
2025-11-03T16:52:22.779341Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 1 sessionId: src|bf4c8d43-8bc60060-47414d1c-1d5f8418_0 grpc closed
2025-11-03T16:52:22.779359Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1 sessionId: src|bf4c8d43-8bc60060-47414d1c-1d5f8418_0 is DEAD
2025-11-03T16:52:22.779947Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-11-03T16:52:22.781107Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [7:7568543016788989325:2464] destroyed
2025-11-03T16:52:22.781156Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-11-03T16:52:22.781188Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:22.781208Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:22.781222Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:22.809134Z :DEBUG: [] MessageGroupId [test-message-group-id] SessionId [] Write session: try to update token
2025-11-03T16:52:22.809462Z :INFO: [] MessageGroupId [test-message-group-id] SessionId [] Write session: Do CDS request
2025-11-03T16:52:22.809737Z :INFO: [] MessageGroupId [test-message-group-id] SessionId [] Start write session. Will connect to endpoint: localhost:64953
2025-11-03T16:52:22.817761Z :ReadSession INFO: WriteToTopic: message1
2025-11-03T16:52:22.820569Z :DEBUG: [] MessageGroupId [test-message-group-id] SessionId [] Write session: send init request: init_request { topic: "test-topic" message_group_id: "test-message-group-id" }
2025-11-03T16:52:22.820880Z node 7 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-11-03T16:52:22.820914Z node 7 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2
2025-11-03T16:52:22.821929Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "test-message-group-id" }
2025-11-03T16:52:22.822064Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2 topic: "test-topic" message_group_id: "test-message-group-id" from ipv6:[::1]:59248
2025-11-03T16:52:22.822085Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:59248 proto=v1  topic=test-topic durationSec=0
2025-11-03T16:52:22.822096Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-11-03T16:52:22.823297Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2 sessionId:  describe result for acl check
2025-11-03T16:52:22.823406Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-11-03T16:52:22.823418Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-11-03T16:52:22.823426Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-11-03T16:52:22.823440Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [7:7568543016788989341:2480] (SourceId=test-message-group-id, PreferedPartition=(NULL)) StartKqpSession
2025-11-03T16:52:22.827230Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [7:7568543016788989341:2480] (SourceId=test-message-group-id, PreferedPartition=(NULL)) Select from the table
2025-11-03T16:52:22.837971Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [7:7568543016788989341:2480] (SourceId=test-message-group-id, PreferedPartition=(NULL)) RequestPQRB
2025-11-03T16:52:22.838607Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1655: [72075186224037893][rt3.dc1--test-topic] pipe [7:7568543016788989360:2480] connected; active server actors: 1
2025-11-03T16:52:22.838644Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [7:7568543016788989341:2480] (SourceId=test-message-group-id, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=test-message-group-id
2025-11-03T16:52:22.838658Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [7:7568543016788989341:2480] (SourceId=test-message-group-id, PreferedPartition=(NULL)) Update the table
2025-11-03T16:52:22.838952Z node 7 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1659: [72075186224037893][rt3.dc1--test-topic] pipe [7:7568543016788989360:2480] disconnected.
2025-11-03T16:52:22.838970Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1670: [72075186224037893][rt3.dc1--test-topic] pipe [7:7568543016788989360:2480] disconnected; active server actors: 1
2025-11-03T16:52:22.838987Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1695: [72075186224037893][rt3.dc1--test-topic] pipe [7:7568543016788989360:2480] disconnected no session
2025-11-03T16:52:22.844999Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:22.845039Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:22.845056Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:22.847295Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [7:7568543016788989341:2480] (SourceId=test-message-group-id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-11-03T16:52:22.847326Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [7:7568543016788989341:2480] (SourceId=test-message-group-id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-11-03T16:52:22.847339Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [7:7568543016788989341:2480] (SourceId=test-message-group-id, PreferedPartition=(NULL)) Start idle
2025-11-03T16:52:22.847366Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-11-03T16:52:22.849186Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 8, Generation: 1
2025-11-03T16:52:22.850304Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [7:7568543016788989377:2480], now have 1 active actors on pipe
2025-11-03T16:52:22.850406Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:22.850436Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:22.850537Z node 8 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie test-message-group-id|5854c919-35847cca-dd1466f1-c53f42fe_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner test-message-group-id
2025-11-03T16:52:22.850581Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:22.850604Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:22.850624Z node 8 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-03T16:52:22.850673Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:22.850718Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-03T16:52:22.850769Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-03T16:52:22.855120Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:22.855169Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:22.855262Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-03T16:52:22.855972Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2 partition: 0 MaxSeqNo: 0 sessionId: test-message-group-id|5854c919-35847cca-dd1466f1-c53f42fe_0
2025-11-03T16:52:22.859434Z :INFO: [] MessageGroupId [test-message-group-id] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1762188742859 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-11-03T16:52:22.859592Z :INFO: [] MessageGroupId [test-message-group-id] SessionId [] Write session established. Init response: session_id: "test-message-group-id|5854c919-35847cca-dd1466f1-c53f42fe_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-11-03T16:52:22.859973Z :DEBUG: [] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|5854c919-35847cca-dd1466f1-c53f42fe_0] Write 1 messages with Id from 1 to 1
2025-11-03T16:52:22.860118Z :INFO: [] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|5854c919-35847cca-dd1466f1-c53f42fe_0] Write session: close. Timeout = 18446744073709551 ms
2025-11-03T16:52:22.864485Z :DEBUG: [] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|5854c919-35847cca-dd1466f1-c53f42fe_0] Write session: try to update token
2025-11-03T16:52:22.864556Z :DEBUG: [] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|5854c919-35847cca-dd1466f1-c53f42fe_0] Send 1 message(s) (0 left), first sequence number is 1
2025-11-03T16:52:22.869310Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: test-message-group-id|5854c919-35847cca-dd1466f1-c53f42fe_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:52:22.869635Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:52:22.870119Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:22.870168Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:22.870251Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-11-03T16:52:22.871330Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:22.871926Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:22.871964Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:22.872363Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0test-message-group-id' SeqNo: 1 partNo : 0 messageNo: 1 size 99 offset: -1
2025-11-03T16:52:22.872419Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:52:22.872469Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:22.872501Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:22.872519Z node 8 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-03T16:52:22.872642Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0test-message-group-id' seqNo 1 partNo 0
2025-11-03T16:52:22.939232Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0test-message-group-id' seqNo 1 partNo 0 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 188 count 1 nextOffset 1 batches 1
2025-11-03T16:52:22.939309Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:22.939864Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 0,1 HeadOffset 0 endOffset 0 curOffset 1 d0000000000_00000000000000000000_00000_0000000001_00000? size 176 WTime 1762188742937
2025-11-03T16:52:22.940168Z node 8 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-03T16:52:22.940317Z node 8 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 0 partNo 0 count 1 size 176
2025-11-03T16:52:22.946688Z node 8 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:52:22.948610Z node 8 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 0 count 1 size 176 actorID [8:7568543016300591319:2390]
2025-11-03T16:52:22.948679Z node 8 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-03T16:52:22.948743Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 121 WriteNewSizeFromSupportivePartitions# 0
2025-11-03T16:52:22.948781Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:52:22.948835Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0test-message-group-id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 1, partNo: 0, Offset: 0 is stored on disk
2025-11-03T16:52:22.949051Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:923: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-11-03T16:52:22.949074Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:965: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-11-03T16:52:22.949099Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:22.949115Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:22.949129Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:22.949165Z node 8 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:52:22.949212Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1  requestId: <none> cookie: 1
2025-11-03T16:52:22.949343Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:880: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 partno 0 count 1 size 1024000 endOffset 1 max time lag 0ms effective offset 0
2025-11-03T16:52:22.949584Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:1105: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 176 count 1 last offset 0, current partition end offset: 1
2025-11-03T16:52:22.949605Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:1121: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-11-03T16:52:22.949656Z node 8 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 0 partno 0 count 1 parts_count 0 source 1 size 176 accessed 0 times before, last time 2025-11-03T16:52:22.000000Z
2025-11-03T16:52:22.949684Z node 8 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 3. All 1 blobs are from cache.
2025-11-03T16:52:22.949732Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:572: FormAnswer for 1 blobs
2025-11-03T16:52:22.949875Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 0 totakecount 1 count 1 size 156 from pos 0 cbcount 1
2025-11-03T16:52:22.949942Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:1015: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1762188742870 queuesize 0 startOffset 0
2025-11-03T16:52:22.950141Z node 8 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 0 suffix '63' size 176
2025-11-03T16:52:22.950208Z node 8 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 0 suffix '63'
2025-11-03T16:52:22.953259Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:22.956423Z :DEBUG: [] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|5854c919-35847cca-dd1466f1-c53f42fe_0] Write session got write response: sequence_numbers: 1 offsets: 0 already_written: false write_statistics { persist_duration_ms: 9 queued_in_partition_duration_ms: 67 }
2025-11-03T16:52:22.956489Z :DEBUG: [] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|5854c919-35847cca-dd1466f1-c53f42fe_0] Write session: acknoledged message 1
2025-11-03T16:52:22.960683Z :INFO: [] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|5854c919-35847cca-dd1466f1-c53f42fe_0] Write session will now close
2025-11-03T16:52:22.960750Z :DEBUG: [] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|5854c919-35847cca-dd1466f1-c53f42fe_0] Write session: aborting
2025-11-03T16:52:22.961312Z :INFO: [] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|5854c919-35847cca-dd1466f1-c53f42fe_0] Write session: gracefully shut down, all writes complete
2025-11-03T16:52:22.961372Z :DEBUG: [] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|5854c919-35847cca-dd1466f1-c53f42fe_0] Write session: destroy
2025-11-03T16:52:22.970804Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [7:7568543016788989377:2480] destroyed
2025-11-03T16:52:22.970861Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-11-03T16:52:22.970898Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:22.970916Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:22.970929Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:22.969147Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: test-message-group-id|5854c919-35847cca-dd1466f1-c53f42fe_0 grpc read done: success: 0 data: 
2025-11-03T16:52:22.969182Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 2 sessionId: test-message-group-id|5854c919-35847cca-dd1466f1-c53f42fe_0 grpc read failed
2025-11-03T16:52:22.969223Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 2 sessionId: test-message-group-id|5854c919-35847cca-dd1466f1-c53f42fe_0 grpc closed
2025-11-03T16:52:22.969245Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2 sessionId: test-message-group-id|5854c919-35847cca-dd1466f1-c53f42fe_0 is DEAD
2025-11-03T16:52:22.970098Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-11-03T16:52:23.002509Z :INFO: [/Root] [/Root] [a86c1bae-1f18fcf1-25e9ba67-2cda801f] Starting read session
2025-11-03T16:52:23.002564Z :DEBUG: [/Root] [/Root] [a86c1bae-1f18fcf1-25e9ba67-2cda801f] Starting cluster discovery
2025-11-03T16:52:23.024136Z :DEBUG: [/Root] [/Root] [a86c1bae-1f18fcf1-25e9ba67-2cda801f] Cluster discovery request succeeded
2025-11-03T16:52:23.024239Z :DEBUG: [/Root] [/Root] [a86c1bae-1f18fcf1-25e9ba67-2cda801f] Starting session to cluster dc1 (localhost:64953)
2025-11-03T16:52:23.048190Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:23.048230Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:23.048245Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:23.059008Z :DEBUG: [/Root] [/Root] [a86c1bae-1f18fcf1-25e9ba67-2cda801f] [dc1] In Reconnect, ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:52:23.059061Z :DEBUG: [/Root] [/Root] [a86c1bae-1f18fcf1-25e9ba67-2cda801f] [dc1] New values: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:52:23.060415Z :DEBUG: [/Root] [/Root] [a86c1bae-1f18fcf1-25e9ba67-2cda801f] [dc1] Reconnecting session to cluster dc1 in 0.000000s
2025-11-03T16:52:23.074168Z :DEBUG: [/Root] [/Root] [a86c1bae-1f18fcf1-25e9ba67-2cda801f] [dc1] Successfully connected. Initializing session
2025-11-03T16:52:23.076513Z node 7 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:109: new grpc connection
2025-11-03T16:52:23.076541Z node 7 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:131: new session created cookie 1
2025-11-03T16:52:23.080568Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { topic: "test-topic" } read_only_original: true consumer: "shared/user" read_params { max_read_size: 104857600 } } }
2025-11-03T16:52:23.080821Z node 7 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 1 consumer shared/user session shared/user_7_1_14578359413573699089_v1 read init: from# ipv6:[::1]:59282, request# { init_request { topics_read_settings { topic: "test-topic" } read_only_original: true consumer: "shared/user" read_params { max_read_size: 104857600 } } }
2025-11-03T16:52:23.081306Z node 7 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 1 consumer shared/user session shared/user_7_1_14578359413573699089_v1 auth for : user
2025-11-03T16:52:23.082213Z node 7 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 1 consumer shared/user session shared/user_7_1_14578359413573699089_v1 Handle describe topics response
2025-11-03T16:52:23.082339Z node 7 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 1 consumer shared/user session shared/user_7_1_14578359413573699089_v1 auth is DEAD
2025-11-03T16:52:23.082420Z node 7 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 1 consumer shared/user session shared/user_7_1_14578359413573699089_v1 auth ok: topics# 1, initDone# 0
2025-11-03T16:52:23.083706Z node 7 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 1 consumer shared/user session shared/user_7_1_14578359413573699089_v1 register session: topic# rt3.dc1--test-topic
2025-11-03T16:52:23.086736Z :INFO: [/Root] [/Root] [a86c1bae-1f18fcf1-25e9ba67-2cda801f] [dc1] Server session id: shared/user_7_1_14578359413573699089_v1
2025-11-03T16:52:23.087038Z :DEBUG: [/Root] [/Root] [a86c1bae-1f18fcf1-25e9ba67-2cda801f] [dc1] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:52:23.088440Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_7_1_14578359413573699089_v1 grpc read done: success# 1, data# { read { } }
2025-11-03T16:52:23.088556Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_7_1_14578359413573699089_v1 got read request: guid# 40bb4e80-5983c881-526dc06-664c7d51
2025-11-03T16:52:23.088972Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1655: [72075186224037893][rt3.dc1--test-topic] pipe [7:7568543021083956710:2498] connected; active server actors: 1
2025-11-03T16:52:23.089120Z node 7 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1706: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [7:7568543021083956710:2498] session shared/user_7_1_14578359413573699089_v1
2025-11-03T16:52:23.089176Z node 7 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:639: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-11-03T16:52:23.089238Z node 7 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:669: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-11-03T16:52:23.089286Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:871: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_7_1_14578359413573699089_v1" (Sender=[7:7568543021083956707:2498], Pipe=[7:7568543021083956710:2498], Partitions=[], ActiveFamilyCount=0)
2025-11-03T16:52:23.089317Z node 7 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1186: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-11-03T16:52:23.089373Z node 7 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1258: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-11-03T16:52:23.089434Z node 7 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1305: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_7_1_14578359413573699089_v1" (Sender=[7:7568543021083956707:2498], Pipe=[7:7568543021083956710:2498], Partitions=[], ActiveFamilyCount=0)
2025-11-03T16:52:23.089530Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:549: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_7_1_14578359413573699089_v1" sender [7:7568543021083956707:2498] lock partition 0 for ReadingSession "shared/user_7_1_14578359413573699089_v1" (Sender=[7:7568543021083956707:2498], Pipe=[7:7568543021083956710:2498], Partitions=[], ActiveFamilyCount=1) generation 1 step 1
2025-11-03T16:52:23.089583Z node 7 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1325: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-11-03T16:52:23.089616Z node 7 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1402: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000217s
2025-11-03T16:52:23.090667Z node 7 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 1 consumer shared/user session shared/user_7_1_14578359413573699089_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 1 Session: "shared/user_7_1_14578359413573699089_v1" ClientId: "user" PipeClient { RawX1: 7568543021083956710 RawX2: 4503629692144066 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-11-03T16:52:23.090755Z node 7 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 1 consumer shared/user session shared/user_7_1_14578359413573699089_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-11-03T16:52:23.091884Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [7:7568543021083956713:2501], now have 1 active actors on pipe
2025-11-03T16:52:23.092281Z node 7 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_7_1_14578359413573699089_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 1, pipe: [7:7568543021083956713:2501]
2025-11-03T16:52:23.092636Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:23.092672Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:23.092710Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:1748: [PQ: 72075186224037892] Created session shared/user_7_1_14578359413573699089_v1 on pipe: [7:7568543021083956713:2501]
2025-11-03T16:52:23.092773Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:23.092801Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:23.092815Z node 8 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-03T16:52:23.092885Z node 8 :PERSQUEUE DEBUG: partition.cpp:3666: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_7_1_14578359413573699089_v1
2025-11-03T16:52:23.092903Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:23.093055Z node 8 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-03T16:52:23.093565Z node 8 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_7_1_14578359413573699089_v1:1 with generation 1
2025-11-03T16:52:23.101223Z node 8 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-03T16:52:23.101313Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-11-03T16:52:23.101347Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:23.101363Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:23.101381Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:23.101425Z node 8 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:52:23.101464Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-11-03T16:52:23.102149Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_7_1_14578359413573699089_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 1 WriteTimestampMS: 1762188742870 CreateTimestampMS: 1762188742859 SizeLag: 176 WriteTimestampEstimateMS: 1762188743047 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-11-03T16:52:23.102203Z node 7 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 1 consumer shared/user session shared/user_7_1_14578359413573699089_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 1 readOffset 0 committedOffset 0
2025-11-03T16:52:23.102257Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 1 consumer shared/user session shared/user_7_1_14578359413573699089_v1 sending to client partition status
2025-11-03T16:52:23.104499Z :INFO: [/Root] [/Root] [a86c1bae-1f18fcf1-25e9ba67-2cda801f] [dc1] Confirm partition stream create. Partition stream id: 1. Cluster: "dc1". Topic: "test-topic". Partition: 0. Read offset: (NULL)
CreatePartitionStream { PartitionStreamId: 1 TopicPath: test-topic Cluster: dc1 PartitionId: 0 CommittedOffset: 0 EndOffset: 1 }
2025-11-03T16:52:23.109939Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_7_1_14578359413573699089_v1 grpc read done: success# 1, data# { start_read { topic { path: "test-topic" } cluster: "dc1" assign_id: 1 } }
2025-11-03T16:52:23.110120Z node 7 :PQ_READ_PROXY INFO: read_session_actor.cpp:539: session cookie 1 consumer shared/user session shared/user_7_1_14578359413573699089_v1 got StartRead from client: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 0, commitOffset# 0
2025-11-03T16:52:23.110176Z node 7 :PQ_READ_PROXY INFO: partition_actor.cpp:1023: session cookie 1 consumer shared/user session shared/user_7_1_14578359413573699089_v1 Start reading TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 1 readOffset 0 committedOffset 0 clientCommitOffset 0 clientReadOffset 0
2025-11-03T16:52:23.110206Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_7_1_14578359413573699089_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 0 endOffset 1
2025-11-03T16:52:23.110268Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_7_1_14578359413573699089_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 0, endOffset# 1, WTime# 1762188742870, sizeLag# 176
2025-11-03T16:52:23.110288Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_7_1_14578359413573699089_v1TEvPartitionReady. Aval parts: 1
2025-11-03T16:52:23.110334Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_7_1_14578359413573699089_v1 performing read request: guid# 40bb4e80-5983c881-526dc06-664c7d51, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 1, size# 211, partitionsAsked# 1, maxTimeLag# 0ms
2025-11-03T16:52:23.110422Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_7_1_14578359413573699089_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 1 maxSize 211 maxTimeLagMs 0 readTimestampMs 0 readOffset 0 EndOffset 1 ClientCommitOffset 0 committedOffset 0 Guid 40bb4e80-5983c881-526dc06-664c7d51
2025-11-03T16:52:23.111661Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:23.111701Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:23.111821Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:880: [72075186224037892][Partition][0][StateIdle] read cookie 4 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 partno 0 count 1 size 211 endOffset 1 max time lag 0ms effective offset 0
2025-11-03T16:52:23.112101Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:1105: [72075186224037892][Partition][0][StateIdle] read cookie 4 added 1 blobs, size 176 count 1 last offset 0, current partition end offset: 1
2025-11-03T16:52:23.112121Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:1121: [72075186224037892][Partition][0][StateIdle] Reading cookie 4. Send blob request.
2025-11-03T16:52:23.112176Z node 8 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 0 partno 0 count 1 parts_count 0 source 1 size 176 accessed 1 times before, last time 2025-11-03T16:52:22.000000Z
2025-11-03T16:52:23.112216Z node 8 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 4. All 1 blobs are from cache.
2025-11-03T16:52:23.112268Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:572: FormAnswer for 1 blobs
2025-11-03T16:52:23.112418Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 0 totakecount 1 count 1 size 156 from pos 0 cbcount 1
2025-11-03T16:52:23.112516Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-03T16:52:23.113119Z node 8 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 0 suffix '63'
2025-11-03T16:52:23.113729Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_7_1_14578359413573699089_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 1 Result { Offset: 0 Data: "... 99 bytes ..." SourceId: "\000test-message-group-id" SeqNo: 1 WriteTimestampMS: 1762188742870 CreateTimestampMS: 1762188742859 UncompressedSize: 8 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 20 RealReadOffset: 0 WaitQuotaTimeMs: 0 EndOffset: 1 StartOffset: 0 } Cookie: 0 }
2025-11-03T16:52:23.113870Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_7_1_14578359413573699089_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 1 from offset 1
2025-11-03T16:52:23.113916Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_7_1_14578359413573699089_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 1 ReadOffset 1 ReadGuid 40bb4e80-5983c881-526dc06-664c7d51 has messages 1
2025-11-03T16:52:23.114056Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_7_1_14578359413573699089_v1 read done: guid# 40bb4e80-5983c881-526dc06-664c7d51, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 218
2025-11-03T16:52:23.114089Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_7_1_14578359413573699089_v1 response to read: guid# 40bb4e80-5983c881-526dc06-664c7d51
2025-11-03T16:52:23.114329Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_7_1_14578359413573699089_v1 Process answer. Aval parts: 0
2025-11-03T16:52:23.116667Z :DEBUG: [/Root] [/Root] [a86c1bae-1f18fcf1-25e9ba67-2cda801f] [dc1] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:52:23.120181Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 0 (0-0)
2025-11-03T16:52:23.120213Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_7_1_14578359413573699089_v1 grpc read done: success# 1, data# { read { } }
2025-11-03T16:52:23.120381Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_7_1_14578359413573699089_v1 got read request: guid# 632a40c0-c7326db4-45f1a1a5-7cb74c68
2025-11-03T16:52:23.124098Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (0-0)
2025-11-03T16:52:23.124188Z :DEBUG: [/Root] [/Root] [a86c1bae-1f18fcf1-25e9ba67-2cda801f] [dc1] The application data is transferred to the client. Number of messages 1, size 8 bytes
DataReceived { PartitionStreamId: 1 PartitionId: 0 Message { Data: ..8 bytes.. Partition stream id: 1 Cluster: "dc1". Topic: "test-topic" Partition: 0 PartitionKey: "" Information: { Offset: 0 SeqNo: 1 MessageGroupId: "test-message-group-id" CreateTime: 2025-11-03T16:52:22.859000Z WriteTime: 2025-11-03T16:52:22.870000Z Ip: "ipv6:[::1]:59248" UncompressedSize: 8 Meta: { "logtype": "unknown", "ident": "unknown", "server": "ipv6:[::1]:59248" } } } }
2025-11-03T16:52:23.124414Z :INFO: [/Root] [/Root] [a86c1bae-1f18fcf1-25e9ba67-2cda801f] Stop reading data
2025-11-03T16:52:23.136842Z :DEBUG: [] MessageGroupId [test-message-group-id] SessionId [] Write session: try to update token
2025-11-03T16:52:23.137341Z :INFO: [] MessageGroupId [test-message-group-id] SessionId [] Write session: Do CDS request
2025-11-03T16:52:23.137418Z :INFO: [] MessageGroupId [test-message-group-id] SessionId [] Start write session. Will connect to endpoint: localhost:64953
2025-11-03T16:52:23.150848Z :ReadSession INFO: WriteToTopic: message2
2025-11-03T16:52:23.151901Z :DEBUG: [] MessageGroupId [test-message-group-id] SessionId [] Write session: send init request: init_request { topic: "test-topic" message_group_id: "test-message-group-id" }
2025-11-03T16:52:23.152466Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:23.152501Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:23.152516Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:23.154251Z node 7 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-11-03T16:52:23.154289Z node 7 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3
2025-11-03T16:52:23.156249Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "test-message-group-id" }
2025-11-03T16:52:23.156418Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3 topic: "test-topic" message_group_id: "test-message-group-id" from ipv6:[::1]:59290
2025-11-03T16:52:23.156439Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:59290 proto=v1  topic=test-topic durationSec=0
2025-11-03T16:52:23.156450Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-11-03T16:52:23.158321Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3 sessionId:  describe result for acl check
2025-11-03T16:52:23.158468Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-11-03T16:52:23.158477Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-11-03T16:52:23.158505Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-11-03T16:52:23.158524Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [7:7568543021083956724:2506] (SourceId=test-message-group-id, PreferedPartition=(NULL)) StartKqpSession
2025-11-03T16:52:23.161941Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [7:7568543021083956724:2506] (SourceId=test-message-group-id, PreferedPartition=(NULL)) Select from the table
2025-11-03T16:52:23.170432Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [7:7568543021083956724:2506] (SourceId=test-message-group-id, PreferedPartition=(NULL)) Update the table
2025-11-03T16:52:23.182180Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [7:7568543021083956724:2506] (SourceId=test-message-group-id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-11-03T16:52:23.182231Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [7:7568543021083956724:2506] (SourceId=test-message-group-id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-11-03T16:52:23.182253Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [7:7568543021083956724:2506] (SourceId=test-message-group-id, PreferedPartition=(NULL)) Start idle
2025-11-03T16:52:23.182292Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-11-03T16:52:23.184479Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [7:7568543021083956757:2506], now have 1 active actors on pipe
2025-11-03T16:52:23.184937Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 8, Generation: 1
2025-11-03T16:52:23.185582Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:23.185618Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:23.185702Z node 8 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie test-message-group-id|d47ddde3-9b733200-8608ac54-ab506cf1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner test-message-group-id
2025-11-03T16:52:23.185749Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:23.185770Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:23.185788Z node 8 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-03T16:52:23.185838Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:23.185888Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-03T16:52:23.185943Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-03T16:52:23.186533Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:23.186559Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:23.186629Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-03T16:52:23.186968Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3 partition: 0 MaxSeqNo: 1 sessionId: test-message-group-id|d47ddde3-9b733200-8608ac54-ab506cf1_0
2025-11-03T16:52:23.192163Z :INFO: [] MessageGroupId [test-message-group-id] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1762188743192 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-11-03T16:52:23.192332Z :INFO: [] MessageGroupId [test-message-group-id] SessionId [] Write session established. Init response: last_sequence_number: 1 session_id: "test-message-group-id|d47ddde3-9b733200-8608ac54-ab506cf1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-11-03T16:52:23.192805Z :DEBUG: [] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|d47ddde3-9b733200-8608ac54-ab506cf1_0] Write 1 messages with Id from 1 to 1
2025-11-03T16:52:23.192912Z :INFO: [] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|d47ddde3-9b733200-8608ac54-ab506cf1_0] Write session: close. Timeout = 18446744073709551 ms
2025-11-03T16:52:23.194245Z :DEBUG: [] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|d47ddde3-9b733200-8608ac54-ab506cf1_0] Write session: try to update token
2025-11-03T16:52:23.194314Z :DEBUG: [] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|d47ddde3-9b733200-8608ac54-ab506cf1_0] Send 1 message(s) (0 left), first sequence number is 2
2025-11-03T16:52:23.195031Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3 sessionId: test-message-group-id|d47ddde3-9b733200-8608ac54-ab506cf1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:52:23.195301Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:52:23.195825Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:23.195885Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:23.195998Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-11-03T16:52:23.202330Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:23.203065Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:23.203109Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:23.203189Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0test-message-group-id' SeqNo: 2 partNo : 0 messageNo: 1 size 99 offset: -1
2025-11-03T16:52:23.203239Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:52:23.203298Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:23.203356Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:23.203380Z node 8 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-03T16:52:23.205211Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0test-message-group-id' seqNo 2 partNo 0
2025-11-03T16:52:23.266182Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0test-message-group-id' seqNo 2 partNo 0 FormedBlobsCount 0 NewHead: Offset 1 PartNo 0 PackedSize 188 count 1 nextOffset 2 batches 1
2025-11-03T16:52:23.266264Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:23.266843Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 1,1 HeadOffset 1 endOffset 1 curOffset 2 d0000000000_00000000000000000001_00000_0000000001_00000? size 176 WTime 1762188743266
2025-11-03T16:52:23.267135Z node 8 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:52:23.267156Z node 8 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-03T16:52:23.267283Z node 8 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 1 partNo 0 count 1 size 176
2025-11-03T16:52:23.277549Z node 8 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 1 count 1 size 176 actorID [8:7568543016300591319:2390]
2025-11-03T16:52:23.277627Z node 8 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-03T16:52:23.277691Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 121 WriteNewSizeFromSupportivePartitions# 0
2025-11-03T16:52:23.277736Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:52:23.277785Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0test-message-group-id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 2, partNo: 0, Offset: 1 is stored on disk
2025-11-03T16:52:23.278045Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:23.278063Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:23.278077Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:23.278117Z node 8 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:52:23.278166Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1  requestId: <none> cookie: 1
2025-11-03T16:52:23.280960Z node 8 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 1 partno 0 count 1 parts 0 suffix '63' size 176
2025-11-03T16:52:23.281669Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 1 consumer shared/user session shared/user_7_1_14578359413573699089_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 1 EndOffset 1 newEndOffset 2 commitOffset 0 clientCommitOffset 0 cookie 1 readingFinished 0 firstRead 0
2025-11-03T16:52:23.281719Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_7_1_14578359413573699089_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 1 endOffset 2
2025-11-03T16:52:23.281785Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:23.282248Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_7_1_14578359413573699089_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 1, endOffset# 2, WTime# 1762188742870, sizeLag# 176
2025-11-03T16:52:23.282282Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_7_1_14578359413573699089_v1TEvPartitionReady. Aval parts: 1
2025-11-03T16:52:23.282333Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_7_1_14578359413573699089_v1 performing read request: guid# 632a40c0-c7326db4-45f1a1a5-7cb74c68, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 1, size# 211, partitionsAsked# 1, maxTimeLag# 0ms
2025-11-03T16:52:23.282389Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_7_1_14578359413573699089_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 1 maxSize 211 maxTimeLagMs 0 readTimestampMs 0 readOffset 1 EndOffset 2 ClientCommitOffset 0 committedOffset 0 Guid 632a40c0-c7326db4-45f1a1a5-7cb74c68
2025-11-03T16:52:23.283154Z :DEBUG: [] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|d47ddde3-9b733200-8608ac54-ab506cf1_0] Write session got write response: sequence_numbers: 2 offsets: 1 already_written: false write_statistics { persist_duration_ms: 11 queued_in_partition_duration_ms: 67 }
2025-11-03T16:52:23.283211Z :DEBUG: [] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|d47ddde3-9b733200-8608ac54-ab506cf1_0] Write session: acknoledged message 1
2025-11-03T16:52:23.283658Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:23.283698Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:23.283829Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:880: [72075186224037892][Partition][0][StateIdle] read cookie 5 Topic 'rt3.dc1--test-topic' partition 0 user user offset 1 partno 0 count 1 size 211 endOffset 2 max time lag 0ms effective offset 1
2025-11-03T16:52:23.284086Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:1105: [72075186224037892][Partition][0][StateIdle] read cookie 5 added 1 blobs, size 176 count 1 last offset 1, current partition end offset: 2
2025-11-03T16:52:23.284103Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:1121: [72075186224037892][Partition][0][StateIdle] Reading cookie 5. Send blob request.
2025-11-03T16:52:23.284151Z node 8 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 1 partno 0 count 1 parts_count 0 source 1 size 176 accessed 0 times before, last time 2025-11-03T16:52:23.000000Z
2025-11-03T16:52:23.284192Z node 8 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 5. All 1 blobs are from cache.
2025-11-03T16:52:23.284241Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:572: FormAnswer for 1 blobs
2025-11-03T16:52:23.284282Z node 8 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 1 partno 0 count 1 parts 0 suffix '63'
2025-11-03T16:52:23.284388Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 1 totakecount 1 count 1 size 156 from pos 0 cbcount 1
2025-11-03T16:52:23.284486Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-11-03T16:52:23.284973Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_7_1_14578359413573699089_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 2 Result { Offset: 1 Data: "... 99 bytes ..." SourceId: "\000test-message-group-id" SeqNo: 2 WriteTimestampMS: 1762188743205 CreateTimestampMS: 1762188743192 UncompressedSize: 8 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 20 RealReadOffset: 1 WaitQuotaTimeMs: 0 EndOffset: 2 StartOffset: 0 } Cookie: 1 }
2025-11-03T16:52:23.285104Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_7_1_14578359413573699089_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 2 from offset 2
2025-11-03T16:52:23.285146Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_7_1_14578359413573699089_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 2 ReadOffset 2 ReadGuid 632a40c0-c7326db4-45f1a1a5-7cb74c68 has messages 1
2025-11-03T16:52:23.285288Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_7_1_14578359413573699089_v1 read done: guid# 632a40c0-c7326db4-45f1a1a5-7cb74c68, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 220
2025-11-03T16:52:23.285321Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_7_1_14578359413573699089_v1 response to read: guid# 632a40c0-c7326db4-45f1a1a5-7cb74c68
2025-11-03T16:52:23.285531Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_7_1_14578359413573699089_v1 Process answer. Aval parts: 0
2025-11-03T16:52:23.287967Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 0 (1-1)
2025-11-03T16:52:23.295065Z :INFO: [] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|d47ddde3-9b733200-8608ac54-ab506cf1_0] Write session will now close
2025-11-03T16:52:23.295145Z :DEBUG: [] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|d47ddde3-9b733200-8608ac54-ab506cf1_0] Write session: aborting
2025-11-03T16:52:23.295696Z :INFO: [] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|d47ddde3-9b733200-8608ac54-ab506cf1_0] Write session: gracefully shut down, all writes complete
2025-11-03T16:52:23.295751Z :DEBUG: [] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|d47ddde3-9b733200-8608ac54-ab506cf1_0] Write session: destroy
2025-11-03T16:52:23.299521Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3 sessionId: test-message-group-id|d47ddde3-9b733200-8608ac54-ab506cf1_0 grpc read done: success: 0 data: 
2025-11-03T16:52:23.299549Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 3 sessionId: test-message-group-id|d47ddde3-9b733200-8608ac54-ab506cf1_0 grpc read failed
2025-11-03T16:52:23.300053Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:824: session v1 closed cookie: 3 sessionId: test-message-group-id|d47ddde3-9b733200-8608ac54-ab506cf1_0
2025-11-03T16:52:23.300085Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3 sessionId: test-message-group-id|d47ddde3-9b733200-8608ac54-ab506cf1_0 is DEAD
2025-11-03T16:52:23.300439Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-11-03T16:52:23.300862Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [7:7568543021083956757:2506] destroyed
2025-11-03T16:52:23.300917Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-11-03T16:52:23.312264Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (1-1)
2025-11-03T16:52:23.316159Z :DEBUG: [/Root] [/Root] [a86c1bae-1f18fcf1-25e9ba67-2cda801f] [dc1] The application data is transferred to the client. Number of messages 1, size 8 bytes
DataReceived { PartitionStreamId: 1 PartitionId: 0 Message { Data: ..8 bytes.. Partition stream id: 1 Cluster: "dc1". Topic: "test-topic" Partition: 0 PartitionKey: "" Information: { Offset: 1 SeqNo: 2 MessageGroupId: "test-message-group-id" CreateTime: 2025-11-03T16:52:23.192000Z WriteTime: 2025-11-03T16:52:23.205000Z Ip: "ipv6:[::1]:59290" UncompressedSize: 8 Meta: { "logtype": "unknown", "ident": "unknown", "server": "ipv6:[::1]:59290" } } } }
2025-11-03T16:52:23.300955Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:23.300970Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:23.300985Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:23.331253Z :DEBUG: [] MessageGroupId [test-message-group-id] SessionId [] Write session: try to update token
2025-11-03T16:52:23.331677Z :INFO: [] MessageGroupId [test-message-group-id] SessionId [] Write session: Do CDS request
2025-11-03T16:52:23.334627Z :INFO: [] MessageGroupId [test-message-group-id] SessionId [] Start write session. Will connect to endpoint: localhost:64953
2025-11-03T16:52:23.344429Z :ReadSession INFO: WriteToTopic: message3
2025-11-03T16:52:23.344543Z :DEBUG: [] MessageGroupId [test-message-group-id] SessionId [] Write session: send init request: init_request { topic: "test-topic" message_group_id: "test-message-group-id" }
2025-11-03T16:52:23.346326Z node 7 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-11-03T16:52:23.346363Z node 7 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 4
2025-11-03T16:52:23.346924Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 4 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "test-message-group-id" }
2025-11-03T16:52:23.347062Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 4 topic: "test-topic" message_group_id: "test-message-group-id" from ipv6:[::1]:59308
2025-11-03T16:52:23.347087Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=4 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:59308 proto=v1  topic=test-topic durationSec=0
2025-11-03T16:52:23.347100Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-11-03T16:52:23.349559Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 4 sessionId:  describe result for acl check
2025-11-03T16:52:23.349704Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-11-03T16:52:23.349722Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-11-03T16:52:23.349734Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-11-03T16:52:23.349753Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [7:7568543021083956774:2514] (SourceId=test-message-group-id, PreferedPartition=(NULL)) StartKqpSession
2025-11-03T16:52:23.353225Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [7:7568543021083956774:2514] (SourceId=test-message-group-id, PreferedPartition=(NULL)) Select from the table
2025-11-03T16:52:23.364581Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [7:7568543021083956774:2514] (SourceId=test-message-group-id, PreferedPartition=(NULL)) Update the table
2025-11-03T16:52:23.368136Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:23.368171Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:23.368187Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:23.375022Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [7:7568543021083956774:2514] (SourceId=test-message-group-id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-11-03T16:52:23.375066Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [7:7568543021083956774:2514] (SourceId=test-message-group-id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-11-03T16:52:23.375086Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [7:7568543021083956774:2514] (SourceId=test-message-group-id, PreferedPartition=(NULL)) Start idle
2025-11-03T16:52:23.375123Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 4 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-11-03T16:52:23.376578Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 8, Generation: 1
2025-11-03T16:52:23.376764Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [7:7568543021083956814:2514], now have 1 active actors on pipe
2025-11-03T16:52:23.376841Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:23.376866Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:23.376960Z node 8 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie test-message-group-id|33260fc-f0c6d835-29d6b794-3f1863b8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner test-message-group-id
2025-11-03T16:52:23.377009Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:23.377028Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:23.377043Z node 8 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-03T16:52:23.377095Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:23.377146Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-03T16:52:23.377209Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-03T16:52:23.379592Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:23.379636Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:23.379731Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-03T16:52:23.380090Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 4 partition: 0 MaxSeqNo: 2 sessionId: test-message-group-id|33260fc-f0c6d835-29d6b794-3f1863b8_0
2025-11-03T16:52:23.380952Z :INFO: [] MessageGroupId [test-message-group-id] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1762188743380 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-11-03T16:52:23.381118Z :INFO: [] MessageGroupId [test-message-group-id] SessionId [] Write session established. Init response: last_sequence_number: 2 session_id: "test-message-group-id|33260fc-f0c6d835-29d6b794-3f1863b8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-11-03T16:52:23.381411Z :DEBUG: [] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|33260fc-f0c6d835-29d6b794-3f1863b8_0] Write 1 messages with Id from 1 to 1
2025-11-03T16:52:23.381513Z :INFO: [] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|33260fc-f0c6d835-29d6b794-3f1863b8_0] Write session: close. Timeout = 18446744073709551 ms
2025-11-03T16:52:23.381914Z :DEBUG: [] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|33260fc-f0c6d835-29d6b794-3f1863b8_0] Write session: try to update token
2025-11-03T16:52:23.381966Z :DEBUG: [] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|33260fc-f0c6d835-29d6b794-3f1863b8_0] Send 1 message(s) (0 left), first sequence number is 3
2025-11-03T16:52:23.385626Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 4 sessionId: test-message-group-id|33260fc-f0c6d835-29d6b794-3f1863b8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:52:23.385952Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:52:23.386569Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:23.386612Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:23.386698Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-11-03T16:52:23.387025Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:23.387477Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:23.387506Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:23.387577Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0test-message-group-id' SeqNo: 3 partNo : 0 messageNo: 1 size 99 offset: -1
2025-11-03T16:52:23.387617Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:52:23.387663Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:23.387694Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:23.387712Z node 8 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-03T16:52:23.387850Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0test-message-group-id' seqNo 3 partNo 0
2025-11-03T16:52:23.388781Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0test-message-group-id' seqNo 3 partNo 0 FormedBlobsCount 0 NewHead: Offset 2 PartNo 0 PackedSize 188 count 1 nextOffset 3 batches 1
2025-11-03T16:52:23.388841Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:23.389474Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 2,1 HeadOffset 2 endOffset 2 curOffset 3 d0000000000_00000000000000000002_00000_0000000001_00000? size 176 WTime 1762188743389
2025-11-03T16:52:23.389651Z node 8 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-03T16:52:23.389791Z node 8 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 2 partNo 0 count 1 size 176
2025-11-03T16:52:23.402410Z node 8 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 2 count 1 size 176 actorID [8:7568543016300591319:2390]
2025-11-03T16:52:23.402521Z node 8 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-03T16:52:23.402595Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 121 WriteNewSizeFromSupportivePartitions# 0
2025-11-03T16:52:23.402644Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:52:23.402704Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0test-message-group-id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 3, partNo: 0, Offset: 2 is stored on disk
2025-11-03T16:52:23.402996Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:23.403014Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:23.403032Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:23.403076Z node 8 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:52:23.403132Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1  requestId: <none> cookie: 1
2025-11-03T16:52:23.403913Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 1 consumer shared/user session shared/user_7_1_14578359413573699089_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 2 EndOffset 2 newEndOffset 3 commitOffset 0 clientCommitOffset 0 cookie 2 readingFinished 0 firstRead 0
2025-11-03T16:52:23.403955Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_7_1_14578359413573699089_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 2 endOffset 3
2025-11-03T16:52:23.404034Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:52:23.404085Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_7_1_14578359413573699089_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 2, endOffset# 3, WTime# 1762188743205, sizeLag# 176
2025-11-03T16:52:23.404113Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_7_1_14578359413573699089_v1TEvPartitionReady. Aval parts: 1
2025-11-03T16:52:23.405087Z :DEBUG: [] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|33260fc-f0c6d835-29d6b794-3f1863b8_0] Write session got write response: sequence_numbers: 3 offsets: 2 already_written: false write_statistics { persist_duration_ms: 13 queued_in_partition_duration_ms: 1 }
2025-11-03T16:52:23.405151Z :DEBUG: [] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|33260fc-f0c6d835-29d6b794-3f1863b8_0] Write session: acknoledged message 1
2025-11-03T16:52:23.403591Z node 8 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 2 partno 0 count 1 parts 0 suffix '63' size 176
2025-11-03T16:52:23.471443Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:23.471484Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:23.471502Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:23.489876Z :INFO: [] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|33260fc-f0c6d835-29d6b794-3f1863b8_0] Write session will now close
2025-11-03T16:52:23.489976Z :DEBUG: [] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|33260fc-f0c6d835-29d6b794-3f1863b8_0] Write session: aborting
2025-11-03T16:52:23.490631Z :INFO: [] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|33260fc-f0c6d835-29d6b794-3f1863b8_0] Write session: gracefully shut down, all writes complete
2025-11-03T16:52:23.490701Z :DEBUG: [] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|33260fc-f0c6d835-29d6b794-3f1863b8_0] Write session: destroy
2025-11-03T16:52:23.492500Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 4 sessionId: test-message-group-id|33260fc-f0c6d835-29d6b794-3f1863b8_0 grpc closed
2025-11-03T16:52:23.492541Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 4 sessionId: test-message-group-id|33260fc-f0c6d835-29d6b794-3f1863b8_0 is DEAD
2025-11-03T16:52:23.493583Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-11-03T16:52:23.514268Z :DEBUG: [/Root] [/Root] [a86c1bae-1f18fcf1-25e9ba67-2cda801f] [dc1] Commit offsets [0, 1). Partition stream id: 1
2025-11-03T16:52:23.502959Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [7:7568543021083956814:2514] destroyed
2025-11-03T16:52:23.503016Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-11-03T16:52:23.503060Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:23.503081Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:23.503095Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:23.520632Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_7_1_14578359413573699089_v1 grpc read done: success# 1, data# { commit { cookies { assign_id: 1 partition_cookie: 1 } } }
2025-11-03T16:52:23.520824Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1449: session cookie 1 consumer shared/user session shared/user_7_1_14578359413573699089_v1 commit request from client for 1 in TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-11-03T16:52:23.520879Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:129: session cookie 1 consumer shared/user session shared/user_7_1_14578359413573699089_v1 commit request from 1 to 1 in TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-11-03T16:52:23.521261Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:203: session cookie 1 consumer shared/user session shared/user_7_1_14578359413573699089_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) committing to position 1 prev 0 end 3 by cookie 1
2025-11-03T16:52:23.522070Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:23.522129Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:23.522221Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:23.522254Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:23.522269Z node 8 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-03T16:52:23.522340Z node 8 :PERSQUEUE DEBUG: partition.cpp:3666: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user offset is set to 1 (startOffset 0) session shared/user_7_1_14578359413573699089_v1
2025-11-03T16:52:23.522361Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:23.522562Z node 8 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-03T16:52:23.530751Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_7_1_14578359413573699089_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { Cookie: 1 }
2025-11-03T16:52:23.530841Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:961: session cookie 1 consumer shared/user session shared/user_7_1_14578359413573699089_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) commit done to position 1 endOffset 3 with cookie 1
2025-11-03T16:52:23.530898Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:707: session cookie 1 consumer shared/user session shared/user_7_1_14578359413573699089_v1 replying for commits: assignId# 1, from# 1, to# 1, offset# 1
2025-11-03T16:52:23.529808Z node 8 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-03T16:52:23.529921Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-11-03T16:52:23.529959Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:23.529977Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:23.529995Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:23.530039Z node 8 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:52:23.530074Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-11-03T16:52:23.533186Z :DEBUG: [/Root] [/Root] [a86c1bae-1f18fcf1-25e9ba67-2cda801f] [dc1] Committed response: cookies { assign_id: 1 partition_cookie: 1 }
CommitAcknowledgement { PartitionStreamId: 1 PartitionId: 0 CommittedOffset: 1 }
2025-11-03T16:52:23.533573Z :DEBUG: [/Root] [/Root] [a86c1bae-1f18fcf1-25e9ba67-2cda801f] [dc1] Commit offsets [1, 2). Partition stream id: 1
2025-11-03T16:52:23.534391Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_7_1_14578359413573699089_v1 grpc read done: success# 1, data# { commit { cookies { assign_id: 1 partition_cookie: 2 } } }
2025-11-03T16:52:23.534634Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1449: session cookie 1 consumer shared/user session shared/user_7_1_14578359413573699089_v1 commit request from client for 2 in TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-11-03T16:52:23.534672Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:129: session cookie 1 consumer shared/user session shared/user_7_1_14578359413573699089_v1 commit request from 2 to 2 in TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-11-03T16:52:23.534718Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:203: session cookie 1 consumer shared/user session shared/user_7_1_14578359413573699089_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) committing to position 2 prev 1 end 3 by cookie 2
2025-11-03T16:52:23.535306Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:23.535351Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:23.535415Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:23.535449Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:23.535464Z node 8 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-03T16:52:23.535532Z node 8 :PERSQUEUE DEBUG: partition.cpp:3666: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user offset is set to 2 (startOffset 0) session shared/user_7_1_14578359413573699089_v1
2025-11-03T16:52:23.535553Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:23.535713Z node 8 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-03T16:52:23.545730Z node 8 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-03T16:52:23.545812Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:923: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 2 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-11-03T16:52:23.545853Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:965: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 2 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-11-03T16:52:23.545924Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-11-03T16:52:23.545961Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:23.545983Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:23.546002Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:23.546042Z node 8 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:52:23.546094Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 2
2025-11-03T16:52:23.546192Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:880: [72075186224037892][Partition][0][StateIdle] read cookie 6 Topic 'rt3.dc1--test-topic' partition 0 user user offset 2 partno 0 count 1 size 1024000 endOffset 3 max time lag 0ms effective offset 2
2025-11-03T16:52:23.546459Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:1105: [72075186224037892][Partition][0][StateIdle] read cookie 6 added 1 blobs, size 176 count 1 last offset 2, current partition end offset: 3
2025-11-03T16:52:23.546501Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:1121: [72075186224037892][Partition][0][StateIdle] Reading cookie 6. Send blob request.
2025-11-03T16:52:23.546555Z node 8 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 2 partno 0 count 1 parts_count 0 source 1 size 176 accessed 0 times before, last time 2025-11-03T16:52:23.000000Z
2025-11-03T16:52:23.546588Z node 8 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 6. All 1 blobs are from cache.
2025-11-03T16:52:23.546642Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:572: FormAnswer for 1 blobs
2025-11-03T16:52:23.546798Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 2 totakecount 1 count 1 size 156 from pos 0 cbcount 1
2025-11-03T16:52:23.546874Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:1015: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1762188743386 queuesize 0 startOffset 0
2025-11-03T16:52:23.547050Z node 8 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 2 partno 0 count 1 parts 0 suffix '63'
2025-11-03T16:52:23.547369Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_7_1_14578359413573699089_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { Cookie: 2 }
2025-11-03T16:52:23.547434Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:961: session cookie 1 consumer shared/user session shared/user_7_1_14578359413573699089_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) commit done to position 2 endOffset 3 with cookie 2
2025-11-03T16:52:23.547475Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:707: session cookie 1 consumer shared/user session shared/user_7_1_14578359413573699089_v1 replying for commits: assignId# 1, from# 2, to# 2, offset# 2
2025-11-03T16:52:23.548161Z :DEBUG: [/Root] [/Root] [a86c1bae-1f18fcf1-25e9ba67-2cda801f] [dc1] Committed response: cookies { assign_id: 1 partition_cookie: 2 }
CommitAcknowledgement { PartitionStreamId: 1 PartitionId: 0 CommittedOffset: 2 }
2025-11-03T16:52:23.571847Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:23.571891Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:23.571909Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:23.673429Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:23.673472Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:23.673492Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:23.773579Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:23.773630Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:23.773645Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:23.876075Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:23.876113Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:23.876128Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:23.979150Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:23.979191Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:23.979209Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:24.042598Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): dc1:test-topic:0:1:1:2
2025-11-03T16:52:24.042721Z :INFO: [/Root] [/Root] [a86c1bae-1f18fcf1-25e9ba67-2cda801f] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1040 BytesRead: 16 MessagesRead: 2 BytesReadCompressed: 56 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-11-03T16:52:24.080161Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:24.080202Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:24.080218Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:24.181066Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:24.181107Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:24.181125Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:24.284123Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:24.284157Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:24.284172Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:24.387152Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:24.387183Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:24.387196Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:24.488254Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:24.488291Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:24.488305Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:24.552050Z :INFO: [/Root] [/Root] [a86c1bae-1f18fcf1-25e9ba67-2cda801f] Resume reading data
2025-11-03T16:52:24.552436Z :DEBUG: [/Root] [/Root] [a86c1bae-1f18fcf1-25e9ba67-2cda801f] [dc1] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:52:24.558709Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_7_1_14578359413573699089_v1 grpc read done: success# 1, data# { read { } }
2025-11-03T16:52:24.558884Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_7_1_14578359413573699089_v1 got read request: guid# 9188f05e-4fcfad32-b2dc9fbb-244a757c
2025-11-03T16:52:24.558982Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_7_1_14578359413573699089_v1 performing read request: guid# 9188f05e-4fcfad32-b2dc9fbb-244a757c, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 1, size# 211, partitionsAsked# 1, maxTimeLag# 0ms
2025-11-03T16:52:24.559083Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_7_1_14578359413573699089_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 1 maxSize 211 maxTimeLagMs 0 readTimestampMs 0 readOffset 2 EndOffset 3 ClientCommitOffset 2 committedOffset 2 Guid 9188f05e-4fcfad32-b2dc9fbb-244a757c
2025-11-03T16:52:24.563579Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:24.563628Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:24.563757Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:880: [72075186224037892][Partition][0][StateIdle] read cookie 7 Topic 'rt3.dc1--test-topic' partition 0 user user offset 2 partno 0 count 1 size 211 endOffset 3 max time lag 0ms effective offset 2
2025-11-03T16:52:24.564042Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:1105: [72075186224037892][Partition][0][StateIdle] read cookie 7 added 1 blobs, size 176 count 1 last offset 2, current partition end offset: 3
2025-11-03T16:52:24.564063Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:1121: [72075186224037892][Partition][0][StateIdle] Reading cookie 7. Send blob request.
2025-11-03T16:52:24.564125Z node 8 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 2 partno 0 count 1 parts_count 0 source 1 size 176 accessed 1 times before, last time 2025-11-03T16:52:23.000000Z
2025-11-03T16:52:24.564175Z node 8 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 7. All 1 blobs are from cache.
2025-11-03T16:52:24.564226Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:572: FormAnswer for 1 blobs
2025-11-03T16:52:24.564367Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 2 totakecount 1 count 1 size 156 from pos 0 cbcount 1
2025-11-03T16:52:24.564510Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 2
2025-11-03T16:52:24.564940Z node 8 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 2 partno 0 count 1 parts 0 suffix '63'
2025-11-03T16:52:24.565438Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_7_1_14578359413573699089_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 3 Result { Offset: 2 Data: "... 99 bytes ..." SourceId: "\000test-message-group-id" SeqNo: 3 WriteTimestampMS: 1762188743386 CreateTimestampMS: 1762188743381 UncompressedSize: 8 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 20 RealReadOffset: 2 WaitQuotaTimeMs: 0 EndOffset: 3 StartOffset: 0 } Cookie: 2 }
2025-11-03T16:52:24.565584Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_7_1_14578359413573699089_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 3 from offset 3
2025-11-03T16:52:24.565628Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_7_1_14578359413573699089_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 3 ReadOffset 3 ReadGuid 9188f05e-4fcfad32-b2dc9fbb-244a757c has messages 1
2025-11-03T16:52:24.565772Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_7_1_14578359413573699089_v1 read done: guid# 9188f05e-4fcfad32-b2dc9fbb-244a757c, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 220
2025-11-03T16:52:24.565799Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_7_1_14578359413573699089_v1 response to read: guid# 9188f05e-4fcfad32-b2dc9fbb-244a757c
2025-11-03T16:52:24.566100Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_7_1_14578359413573699089_v1 Process answer. Aval parts: 0
2025-11-03T16:52:24.568930Z :DEBUG: [/Root] [/Root] [a86c1bae-1f18fcf1-25e9ba67-2cda801f] [dc1] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:52:24.572139Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 0 (2-2)
2025-11-03T16:52:24.569501Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_7_1_14578359413573699089_v1 grpc read done: success# 1, data# { read { } }
2025-11-03T16:52:24.569648Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_7_1_14578359413573699089_v1 got read request: guid# 8c53ab0e-a44e5fb4-aa645b3a-6e768456
2025-11-03T16:52:24.576117Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (2-2)
2025-11-03T16:52:24.576216Z :DEBUG: [/Root] [/Root] [a86c1bae-1f18fcf1-25e9ba67-2cda801f] [dc1] The application data is transferred to the client. Number of messages 1, size 8 bytes
DataReceived { PartitionStreamId: 1 PartitionId: 0 Message { Data: ..8 bytes.. Partition stream id: 1 Cluster: "dc1". Topic: "test-topic" Partition: 0 PartitionKey: "" Information: { Offset: 2 SeqNo: 3 MessageGroupId: "test-message-group-id" CreateTime: 2025-11-03T16:52:23.381000Z WriteTime: 2025-11-03T16:52:23.386000Z Ip: "ipv6:[::1]:59308" UncompressedSize: 8 Meta: { "logtype": "unknown", "ident": "unknown", "server": "ipv6:[::1]:59308" } } } }
2025-11-03T16:52:24.576451Z :INFO: [/Root] [/Root] [a86c1bae-1f18fcf1-25e9ba67-2cda801f] Closing read session. Close timeout: 3.000000s
2025-11-03T16:52:24.576508Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): dc1:test-topic:0:1:2:2
2025-11-03T16:52:24.576560Z :INFO: [/Root] [/Root] [a86c1bae-1f18fcf1-25e9ba67-2cda801f] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1574 BytesRead: 24 MessagesRead: 3 BytesReadCompressed: 84 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-11-03T16:52:24.577310Z :INFO: [/Root] [/Root] [a86c1bae-1f18fcf1-25e9ba67-2cda801f] Closing read session. Close timeout: 0.000000s
2025-11-03T16:52:24.577368Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): dc1:test-topic:0:1:2:2
2025-11-03T16:52:24.577420Z :INFO: [/Root] [/Root] [a86c1bae-1f18fcf1-25e9ba67-2cda801f] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1574 BytesRead: 24 MessagesRead: 3 BytesReadCompressed: 84 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-11-03T16:52:24.577545Z :NOTICE: [/Root] [/Root] [a86c1bae-1f18fcf1-25e9ba67-2cda801f] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
2025-11-03T16:52:24.582285Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2258: [PQ: 72075186224037892] Destroy direct read session shared/user_7_1_14578359413573699089_v1
2025-11-03T16:52:24.582346Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [7:7568543021083956713:2501] destroyed
2025-11-03T16:52:24.582406Z node 8 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_7_1_14578359413573699089_v1
2025-11-03T16:52:24.579950Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_7_1_14578359413573699089_v1 grpc read done: success# 0, data# {  }
2025-11-03T16:52:24.580001Z node 7 :PQ_READ_PROXY INFO: read_session_actor.cpp:125: session cookie 1 consumer shared/user session shared/user_7_1_14578359413573699089_v1 grpc read failed
2025-11-03T16:52:24.594380Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:24.594419Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:24.594436Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:24.580036Z node 7 :PQ_READ_PROXY INFO: read_session_actor.cpp:1666: session cookie 1 consumer shared/user session shared/user_7_1_14578359413573699089_v1 closed
2025-11-03T16:52:24.580552Z node 7 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 1 consumer shared/user session shared/user_7_1_14578359413573699089_v1 is DEAD
2025-11-03T16:52:24.582098Z node 7 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1659: [72075186224037893][rt3.dc1--test-topic] pipe [7:7568543021083956710:2498] disconnected.
2025-11-03T16:52:24.582128Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1670: [72075186224037893][rt3.dc1--test-topic] pipe [7:7568543021083956710:2498] disconnected; active server actors: 1
2025-11-03T16:52:24.582149Z node 7 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1679: [72075186224037893][rt3.dc1--test-topic] pipe [7:7568543021083956710:2498] client user disconnected session shared/user_7_1_14578359413573699089_v1
2025-11-03T16:52:24.696176Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:24.696213Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:24.696231Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:24.800174Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:24.800218Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:24.800239Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:24.901703Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:24.901742Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:24.901756Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:26.795784Z :DEBUG: [db] [sessionid] [cluster] In Reconnect, ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:52:26.795821Z :DEBUG: [db] [sessionid] [cluster] New values: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:52:26.795882Z :DEBUG: [db] [sessionid] [cluster] Reconnecting session to cluster cluster in 0.000000s
2025-11-03T16:52:26.796213Z :DEBUG: [db] [sessionid] [cluster] Successfully connected. Initializing session
2025-11-03T16:52:26.796680Z :INFO: [db] [sessionid] [cluster] Server session id: 123-session-id-321
2025-11-03T16:52:26.796909Z :DEBUG: [db] [sessionid] [cluster] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:52:26.797304Z :INFO: [db] [sessionid] [cluster] Confirm partition stream create. Partition stream id: 1. Cluster: "TestCluster". Topic: "TestTopic". Partition: 1. Read offset: 13. Commit offset: 31
2025-11-03T16:52:26.799119Z :DEBUG: [db] [sessionid] [cluster] In Reconnect, ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:52:26.799166Z :DEBUG: [db] [sessionid] [cluster] New values: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:52:26.799212Z :DEBUG: [db] [sessionid] [cluster] Reconnecting session to cluster cluster in 0.000000s
2025-11-03T16:52:26.799492Z :DEBUG: [db] [sessionid] [cluster] Successfully connected. Initializing session
2025-11-03T16:52:26.799821Z :INFO: [db] [sessionid] [cluster] Server session id: 123-session-id-321
2025-11-03T16:52:26.799987Z :DEBUG: [db] [sessionid] [cluster] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:52:26.800214Z :INFO: [db] [sessionid] [cluster] Confirm partition stream create. Partition stream id: 1. Cluster: "TestCluster". Topic: "TestTopic". Partition: 1. Read offset: (NULL)
2025-11-03T16:52:26.801404Z :DEBUG: [db] [sessionid] [cluster] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
Post function
2025-11-03T16:52:26.801829Z :INFO: Error decompressing data: (TZLibDecompressorError) util/stream/zlib.cpp:143: inflate error(incorrect header check)
2025-11-03T16:52:26.801918Z :DEBUG: Decompression task done. Partition/PartitionSessionId: 1 (1-3)
2025-11-03T16:52:26.802056Z :DEBUG: Take Data. Partition 1. Read: {0, 0} (1-1)
2025-11-03T16:52:26.802110Z :DEBUG: Take Data. Partition 1. Read: {0, 1} (2-2)
2025-11-03T16:52:26.802142Z :DEBUG: Take Data. Partition 1. Read: {0, 2} (3-3)
2025-11-03T16:52:26.802185Z :DEBUG: [db] [sessionid] [cluster] The application data is transferred to the client. Number of messages 3, size 57 bytes
DataReceived { PartitionStreamId: 1 PartitionId: 1 Message { DataDecompressionError: "(TZLibDecompressorError) util/stream/zlib.cpp:143: inflate error(incorrect header check)" Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 1 SeqNo: 1 MessageGroupId: "src_id" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:00:00.042000Z Ip: "::1" UncompressedSize: 0 Meta: { } } } Message { Data: ..8 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 2 SeqNo: 1 MessageGroupId: "src_id" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:00:00.042000Z Ip: "::1" UncompressedSize: 0 Meta: { } } } Message { Data: ..8 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 3 SeqNo: 1 MessageGroupId: "src_id" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:00:00.042000Z Ip: "::1" UncompressedSize: 0 Meta: { } } } }
2025-11-03T16:52:26.804169Z :DEBUG: [db] [sessionid] [cluster] In Reconnect, ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:52:26.804224Z :DEBUG: [db] [sessionid] [cluster] New values: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:52:26.804261Z :DEBUG: [db] [sessionid] [cluster] Reconnecting session to cluster cluster in 0.000000s
2025-11-03T16:52:26.804601Z :DEBUG: [db] [sessionid] [cluster] Successfully connected. Initializing session
2025-11-03T16:52:26.805022Z :INFO: [db] [sessionid] [cluster] Server session id: 123-session-id-321
2025-11-03T16:52:26.805223Z :DEBUG: [db] [sessionid] [cluster] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:52:26.805458Z :INFO: [db] [sessionid] [cluster] Confirm partition stream create. Partition stream id: 1. Cluster: "TestCluster". Topic: "TestTopic". Partition: 1. Read offset: (NULL)
2025-11-03T16:52:26.806307Z :DEBUG: [db] [sessionid] [cluster] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:52:26.806506Z :DEBUG: Decompression task done. Partition/PartitionSessionId: 1 (1-1)
2025-11-03T16:52:26.806671Z :DEBUG: Take Data. Partition 1. Read: {0, 0} (1-1)
2025-11-03T16:52:26.806734Z :DEBUG: [db] [sessionid] [cluster] The application data is transferred to the client. Number of messages 1, size 8 bytes
2025-11-03T16:52:26.806832Z :DEBUG: [db] [sessionid] [cluster] Commit offsets [1, 2). Partition stream id: 1
2025-11-03T16:52:26.808494Z :DEBUG: [db] [sessionid] [cluster] In Reconnect, ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:52:26.808551Z :DEBUG: [db] [sessionid] [cluster] New values: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:52:26.808591Z :DEBUG: [db] [sessionid] [cluster] Reconnecting session to cluster cluster in 0.000000s
2025-11-03T16:52:26.809061Z :DEBUG: [db] [sessionid] [cluster] Successfully connected. Initializing session
2025-11-03T16:52:26.809579Z :INFO: [db] [sessionid] [cluster] Server session id: 123-session-id-321
2025-11-03T16:52:26.809864Z :DEBUG: [db] [sessionid] [cluster] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:52:26.810851Z :DEBUG: [db] [sessionid] [cluster] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:52:26.811020Z :DEBUG: Decompression task done. Partition/PartitionSessionId: 1 (1-1)
2025-11-03T16:52:26.811140Z :DEBUG: Take Data. Partition 1. Read: {0, 0} (1-1)
2025-11-03T16:52:26.811262Z :DEBUG: [db] [sessionid] [cluster] The application data is transferred to the client. Number of messages 1, size 8 bytes
2025-11-03T16:51:11.397233Z :DEBUG: [db] [sessionid] [cluster] In Reconnect, ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:51:11.397285Z :DEBUG: [db] [sessionid] [cluster] New values: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:51:11.397315Z :DEBUG: [db] [sessionid] [cluster] Reconnecting session to cluster cluster in 0.000000s
2025-11-03T16:51:11.399835Z :DEBUG: [db] [sessionid] [cluster] Successfully connected. Initializing session
2025-11-03T16:51:11.420247Z :INFO: [db] [sessionid] [cluster] Server session id: 123-session-id-321
2025-11-03T16:51:11.420549Z :DEBUG: [db] [sessionid] [cluster] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:51:11.424275Z :INFO: [db] [sessionid] [cluster] Confirm partition stream create. Partition stream id: 1. Cluster: "TestCluster". Topic: "TestTopic". Partition: 1. Read offset: (NULL)
2025-11-03T16:51:11.424891Z :DEBUG: [db] [sessionid] [cluster] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:51:11.425790Z :DEBUG: Decompression task done. Partition/PartitionSessionId: 1 (1-1)
2025-11-03T16:51:11.425913Z :DEBUG: Take Data. Partition 1. Read: {0, 0} (1-1)
2025-11-03T16:51:11.425961Z :DEBUG: [db] [sessionid] [cluster] The application data is transferred to the client. Number of messages 1, size 3 bytes
2025-11-03T16:51:11.426883Z :DEBUG: [db] [sessionid] [cluster] In Reconnect, ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:51:11.426912Z :DEBUG: [db] [sessionid] [cluster] New values: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:51:11.426934Z :DEBUG: [db] [sessionid] [cluster] Reconnecting session to cluster cluster in 0.000000s
2025-11-03T16:51:11.436293Z :DEBUG: [db] [sessionid] [cluster] Successfully connected. Initializing session
2025-11-03T16:51:11.437228Z :INFO: [db] [sessionid] [cluster] Server session id: 123-session-id-321
2025-11-03T16:51:11.439476Z :DEBUG: [db] [sessionid] [cluster] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:51:11.439815Z :INFO: [db] [sessionid] [cluster] Confirm partition stream create. Partition stream id: 1. Cluster: "TestCluster". Topic: "TestTopic". Partition: 1. Read offset: (NULL)
2025-11-03T16:51:11.440377Z :DEBUG: [db] [sessionid] [cluster] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:51:11.440521Z :DEBUG: Decompression task done. Partition/PartitionSessionId: 1 (1-1)
2025-11-03T16:51:11.440846Z :DEBUG: Take Data. Partition 1. Read: {0, 0} (1-1)
2025-11-03T16:51:11.440904Z :DEBUG: [db] [sessionid] [cluster] The application data is transferred to the client. Number of messages 1, size 3 bytes
2025-11-03T16:51:11.442068Z :DEBUG: [db] [sessionid] [cluster] In Reconnect, ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:51:11.442100Z :DEBUG: [db] [sessionid] [cluster] New values: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:51:11.442128Z :DEBUG: [db] [sessionid] [cluster] Reconnecting session to cluster cluster in 0.000000s
2025-11-03T16:51:11.456222Z :DEBUG: [db] [sessionid] [cluster] Successfully connected. Initializing session
2025-11-03T16:51:11.472410Z :INFO: [db] [sessionid] [cluster] Server session id: 123-session-id-321
2025-11-03T16:51:11.472638Z :DEBUG: [db] [sessionid] [cluster] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:51:11.476288Z :INFO: [db] [sessionid] [cluster] Confirm partition stream create. Partition stream id: 1. Cluster: "TestCluster". Topic: "TestTopic". Partition: 1. Read offset: (NULL)
2025-11-03T16:51:11.477208Z :DEBUG: [db] [sessionid] [cluster] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:51:11.477421Z :DEBUG: Decompression task done. Partition/PartitionSessionId: 1 (1-1)
2025-11-03T16:51:11.477539Z :DEBUG: Take Data. Partition 1. Read: {0, 0} (1-1)
2025-11-03T16:51:11.477586Z :DEBUG: [db] [sessionid] [cluster] The application data is transferred to the client. Number of messages 1, size 3 bytes
2025-11-03T16:51:11.478667Z :DEBUG: [db] [sessionid] [cluster] In Reconnect, ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:51:11.478691Z :DEBUG: [db] [sessionid] [cluster] New values: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:51:11.478714Z :DEBUG: [db] [sessionid] [cluster] Reconnecting session to cluster cluster in 0.000000s
2025-11-03T16:51:11.479198Z :DEBUG: [db] [sessionid] [cluster] Successfully connected. Initializing session
2025-11-03T16:51:11.504268Z :INFO: [db] [sessionid] [cluster] Server session id: 123-session-id-321
2025-11-03T16:51:11.504467Z :DEBUG: [db] [sessionid] [cluster] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:51:11.508239Z :INFO: [db] [sessionid] [cluster] Confirm partition stream create. Partition stream id: 1. Cluster: "TestCluster". Topic: "TestTopic". Partition: 1. Read offset: (NULL)
2025-11-03T16:51:11.510101Z :DEBUG: [db] [sessionid] [cluster] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:51:11.510773Z :DEBUG: Decompression task done. Partition/PartitionSessionId: 1 (1-1)
2025-11-03T16:51:11.510894Z :DEBUG: Take Data. Partition 1. Read: {0, 0} (1-1)
2025-11-03T16:51:11.510943Z :DEBUG: [db] [sessionid] [cluster] The application data is transferred to the client. Number of messages 1, size 3 bytes
2025-11-03T16:51:11.515871Z :DEBUG: [db] [sessionid] [cluster] In Reconnect, ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:51:11.515895Z :DEBUG: [db] [sessionid] [cluster] New values: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:51:11.516157Z :DEBUG: [db] [sessionid] [cluster] Reconnecting session to cluster cluster in 0.000000s
2025-11-03T16:51:11.528238Z :DEBUG: [db] [sessionid] [cluster] Successfully connected. Initializing session
2025-11-03T16:51:11.528977Z :INFO: [db] [sessionid] [cluster] Server session id: 123-session-id-321
2025-11-03T16:51:11.529132Z :DEBUG: [db] [sessionid] [cluster] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:51:11.532190Z :INFO: [db] [sessionid] [cluster] Confirm partition stream create. Partition stream id: 1. Cluster: "TestCluster". Topic: "TestTopic". Partition: 1. Read offset: (NULL)
2025-11-03T16:51:11.532672Z :DEBUG: [db] [sessionid] [cluster] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:51:11.532799Z :DEBUG: Decompression task done. Partition/PartitionSessionId: 1 (1-1)
2025-11-03T16:51:11.536078Z :DEBUG: Take Data. Partition 1. Read: {0, 0} (1-1)
2025-11-03T16:51:11.536139Z :DEBUG: [db] [sessionid] [cluster] The application data is transferred to the client. Number of messages 1, size 0 bytes
2025-11-03T16:51:11.537018Z :DEBUG: [db] [sessionid] [cluster] In Reconnect, ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:51:11.537498Z :DEBUG: [db] [sessionid] [cluster] New values: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:51:11.537548Z :DEBUG: [db] [sessionid] [cluster] Reconnecting session to cluster cluster in 0.000000s
2025-11-03T16:51:11.537866Z :DEBUG: [db] [sessionid] [cluster] Successfully connected. Initializing session
2025-11-03T16:51:11.538528Z :INFO: [db] [sessionid] [cluster] Server session id: 123-session-id-321
2025-11-03T16:51:11.538656Z :DEBUG: [db] [sessionid] [cluster] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:51:11.539844Z :INFO: [db] [sessionid] [cluster] Confirm partition stream create. Partition stream id: 1. Cluster: "TestCluster". Topic: "TestTopic". Partition: 1. Read offset: (NULL)
2025-11-03T16:51:11.540300Z :DEBUG: [db] [sessionid] [cluster] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:51:11.540397Z :DEBUG: Decompression task done. Partition/PartitionSessionId: 1 (1-1)
2025-11-03T16:51:11.540579Z :DEBUG: Take Data. Partition 1. Read: {0, 0} (1-1)
2025-11-03T16:51:11.540620Z :DEBUG: [db] [sessionid] [cluster] The application data is transferred to the client. Number of messages 1, size 0 bytes
2025-11-03T16:51:11.541523Z :DEBUG: [db] [sessionid] [cluster] In Reconnect, ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:51:11.541683Z :DEBUG: [db] [sessionid] [cluster] New values: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:51:11.541705Z :DEBUG: [db] [sessionid] [cluster] Reconnecting session to cluster cluster in 0.000000s
2025-11-03T16:51:11.542050Z :DEBUG: [db] [sessionid] [cluster] Successfully connected. Initializing session
2025-11-03T16:51:11.542526Z :INFO: [db] [sessionid] [cluster] Server session id: 123-session-id-321
2025-11-03T16:51:11.542725Z :DEBUG: [db] [sessionid] [cluster] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:51:11.542975Z :INFO: [db] [sessionid] [cluster] Confirm partition stream create. Partition stream id: 1. Cluster: "TestCluster". Topic: "TestTopic". Partition: 1. Read offset: (NULL)
2025-11-03T16:51:11.543683Z :DEBUG: [db] [sessionid] [cluster] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:51:11.544515Z :DEBUG: Decompression task done. Partition/PartitionSessionId: 1 (1-1)
2025-11-03T16:51:11.544753Z :DEBUG: Take Data. Partition 1. Read: {0, 0} (1-1)
2025-11-03T16:51:11.544802Z :DEBUG: [db] [sessionid] [cluster] The application data is transferred to the client. Number of messages 1, size 0 bytes
2025-11-03T16:51:11.545928Z :DEBUG: [db] [sessionid] [cluster] In Reconnect, ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:51:11.545966Z :DEBUG: [db] [sessionid] [cluster] New values: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:51:11.545996Z :DEBUG: [db] [sessionid] [cluster] Reconnecting session to cluster cluster in 0.000000s
2025-11-03T16:51:11.546262Z :DEBUG: [db] [sessionid] [cluster] Successfully connected. Initializing session
2025-11-03T16:51:11.546929Z :INFO: [db] [sessionid] [cluster] Server session id: 123-session-id-321
2025-11-03T16:51:11.547067Z :DEBUG: [db] [sessionid] [cluster] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:51:11.547331Z :INFO: [db] [sessionid] [cluster] Confirm partition stream create. Partition stream id: 1. Cluster: "TestCluster". Topic: "TestTopic". Partition: 1. Read offset: (NULL)
2025-11-03T16:51:11.548898Z :DEBUG: [db] [sessionid] [cluster] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:51:11.549288Z :DEBUG: Decompression task done. Partition/PartitionSessionId: 1 (1-1)
2025-11-03T16:51:11.549378Z :DEBUG: Take Data. Partition 1. Read: {0, 0} (1-1)
2025-11-03T16:51:11.549419Z :DEBUG: [db] [sessionid] [cluster] The application data is transferred to the client. Number of messages 1, size 3 bytes
2025-11-03T16:51:11.588985Z :ReadSession INFO: Random seed for debugging is 1762188671588947
2025-11-03T16:51:12.090468Z node 1 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[1:7568542718527651326:2175];send_to=[0:7307199536658146131:7762515];
2025-11-03T16:51:12.090576Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
2025-11-03T16:51:12.165964Z node 1 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-11-03T16:51:12.184644Z node 2 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[2:7568542719671249659:2264];send_to=[0:7307199536658146131:7762515];
2025-11-03T16:51:12.184690Z node 2 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
test_client.cpp: SetPath # /home/runner/.ya/build/build_root/7jz3/0019a6/r3tmp/tmpAvhZa6/pdisk_1.dat
2025-11-03T16:51:12.214313Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-11-03T16:51:12.452352Z node 2 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-11-03T16:51:12.480307Z node 1 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-11-03T16:51:12.518311Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(1, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-11-03T16:51:12.518453Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(1, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-11-03T16:51:12.520967Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(2, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-11-03T16:51:12.521047Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(2, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-11-03T16:51:12.527488Z node 1 :HIVE WARN: hive_impl.cpp:811: HIVE#72057594037968897 Handle TEvInterconnect::TEvNodeConnected, NodeId 2 Cookie 2
2025-11-03T16:51:12.527777Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(1, (0,0,0,0)) VolatileState: Connecting -> Connected
2025-11-03T16:51:12.530057Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(2, (0,0,0,0)) VolatileState: Connecting -> Connected
2025-11-03T16:51:12.618832Z node 1 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
TServer::EnableGrpc on GrpcPort 28979, node 1
2025-11-03T16:51:12.670080Z node 2 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-11-03T16:51:12.723448Z node 1 :NET_CLASSIFIER WARN: net_classifier.cpp:190: distributable config is empty, broken or outdated, will use file: /home/runner/.ya/build/build_root/7jz3/0019a6/r3tmp/yandexECj015.tmp
2025-11-03T16:51:12.723475Z node 1 :NET_CLASSIFIER WARN: net_classifier.cpp:196: will try to initialize from file: /home/runner/.ya/build/build_root/7jz3/0019a6/r3tmp/yandexECj015.tmp
2025-11-03T16:51:12.723621Z node 1 :NET_CLASSIFIER WARN: net_classifier.cpp:202: successfully initialized from file: /home/runner/.ya/build/build_root/7jz3/0019a6/r3tmp/yandexECj015.tmp
2025-11-03T16:51:12.723772Z node 1 :NET_CLASSIFIER ERROR: net_classifier.cpp:228: got bad distributable configuration
2025-11-03T16:51:12.755578Z INFO: TTestServer started on Port 8436 GrpcPort 28979
2025-11-03T16:51:12.763464Z node 1 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
TClient is connected to server localhost:8436
PQClient connected to localhost:28979
WaitRootIsUp 'Root'...
TClient::Ls request: Root
2025-11-03T16:51:13.110595Z node 1 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
TClient::Ls response: 2025-11-03T16:51:13.188135Z node 2 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "Root"
    PathId: 1
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 1
    CreateStep: 0
    ParentPathId: 1
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 1
      SubDomainVersion: 0
      SecurityStateVersion: 0
    }
    ChildrenExist: false
  }
  Children {
    Name: ".sys"
    PathId: 18446744073709551615
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 0
    CreateStep: 0
    ParentPathId: 18446744073709551615
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 0
      Pl...
(TRUNCATED)
WaitRootIsUp 'Root' success.
2025-11-03T16:51:13.275566Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpAlterSubDomain, opId: 281474976715657:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_alter_subdomain.cpp:311)
waiting...
waiting...
waiting...
waiting...
2025-11-03T16:51:16.117062Z node 1 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [1:7568542735707521381:2327], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-03T16:51:16.117194Z node 1 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-03T16:51:16.117521Z node 1 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [1:7568542735707521393:2330], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-03T16:51:16.117567Z node 1 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [1:7568542735707521394:2331], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-03T16:51:16.117709Z node 1 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-03T16:51:16.121558Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateResourcePool, opId: 281474976715661:3, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_resource_pool.cpp:179)
2025-11-03T16:51:16.154456Z node 1 :KQP_WORKLOAD_SERVICE WARN: helpers.h:73: [WorkloadService] [TPoolCreatorActor] ActorId: [1:7568542735707521397:2332], DatabaseId: /Root, PoolId: default, Scheduled retry for error: { <main>: Error: Transaction 281474976715661 completed, doublechecking }
2025-11-03T16:51:16.249885Z node 1 :TX_PROXY ERROR: schemereq.cpp:593: Actor# [1:7568542735707521483:2682] txid# 281474976715662, issues: { message: "Check failed: path: \'/Root/.metadata/workload_manager/pools/default\', error: path exist, request accepts it (id: [OwnerId: 72057594046644480, LocalPathId: 8], type: EPathTypeResourcePool, state: EPathStateNoChanges)" severity: 1 }
2025-11-03T16:51:16.648488Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976715663:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:690)
2025-11-03T16:51:16.650167Z node 1 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:570: Compilation failed, self: [1:7568542735707521493:2340], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-11-03T16:51:16.652226Z node 1 :KQP_SESSION WARN: kqp_session_actor.cpp:2506: SessionId: ydb://session/3?node_id=1&id=YmEzMTk2Ni00OGE3MzE5LThmNmZmNzk5LTQ4ZWQ4YTNh, ActorId: [1:7568542735707521371:2326], ActorState: ExecuteState, TraceId: 01k95a2k0j6jq1xtxf4bfz92rp, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-11-03T16:51:16.653447Z node 2 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:570: Compilation failed, self: [2:7568542736851118994:2305], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-11-03T16:51:16.654696Z node 1 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-11-03T16:51:16.654446Z node 2 :KQP_SESSION WARN: kqp_session_actor.cpp:2506: SessionId: ydb://session/3?node_id=2&id=MWRkZTE1NjgtMTQwZDY5N2UtOGU3ZmQzNzEtNzI3Nzk2Yjg=, ActorId: [2:7568542736851118945:2298], ActorState: ExecuteState, TraceId: 01k95a2k5ve8f118mjdqdmyyt2, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-11-03T16:51:16.654812Z node 2 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-11-03T16:51:16.854207Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976715664:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:690)
2025-11-03T16:51:17.006881Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976715665:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:690)
2025-11-03T16:51:17.090598Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[1:7568542718527651326:2175];send_to=[0:7307199536658146131:7762515];
2025-11-03T16:51:17.090703Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
=== Init DC: UPSERT INTO `/Root/PQ/Config/V2/Cluster` (name, balancer, local, enabled, weight) VALUES ("dc1", "localhost:28979", true, true, 1000);
2025-11-03T16:51:17.182512Z node 2 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[2:7568542719671249659:2264];send_to=[0:7307199536658146131:7762515];
2025-11-03T16:51:17.182577Z node 2 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
2025-11-03T16:51:17.295101Z node 1 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976715666. Ctx: { TraceId: 01k95a2m0qa3csz5zkkxsn6p16, Database: , SessionId: ydb://session/3?node_id=1&id=NmE0MTk3NzQtOWYzNDNhMTMtY2U0YzQwYWYtZDNjNTMxMTQ=, PoolId: default, DatabaseId: /Root}. Database not set, use /Root
=== CheckClustersList. Subcribe to ClusterTracker from [1:7568542740002489193:2981] 
=== CheckClustersList. Ok
2025-11-03T16:51:23.830829Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976715671:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:690)
waiting...
PQ Client: create topic: rt3.dc1--test-topic with 1 partitions
CallPersQueueGRPC request to localhost:28979
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-11-03T16:51:23.981809Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
CallPersQueueGRPC request to localhost:28979
MetaRequest {
  CmdCreateTopic {
    Topic: "rt3.dc1--test-topic"
    NumPartitions: 1
    Config {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
  }
}
CallPersQueueGRPC response:
Status: 129
ProxyErrorCode: 53
SchemeStatus: 1
FlatTxId {
  TxId: 281474976715672
  SchemeShardTabletId: 72057594046644480
  PathId: 13
}
ErrorCode: OK
AddTopic: rt3.dc1--test-topic
===Run query:``DECLARE $version as Int64; DECLARE $path AS Utf8; DECLARE $cluster as Utf8; UPSERT INTO `/Root/PQ/Config/V2/Topics` (path, dc) VALUES ($path, $cluster); UPSERT INTO `/Root/PQ/Config/V2/Versions` (name, version) VALUES ("Topics", $version);`` with topic = test-topic, dc = dc1
2025-11-03T16:51:24.017463Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1655: [72075186224037893][] pipe [1:7568542770067260680:3250] connected; active server actors: 1
2025-11-03T16:51:24.017696Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1519: [72075186224037893][rt3.dc1--test-topic] updating configuration. Deleted partitions []. Added partitions [0]
2025-11-03T16:51:24.019270Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:971: [72075186224037893][rt3.dc1--test-topic] Discovered subdomain [OwnerId: 72057594046644480, LocalPathId: 1] state, outOfSpace = 0 at RB 72075186224037893
2025-11-03T16:51:24.021026Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:140: [72075186224037893][rt3.dc1--test-topic] BALANCER INIT DONE for rt3.dc1--test-topic: (0, 72075186224037892) 
2025-11-03T16:51:24.031166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2960: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-11-03T16:51:24.035028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2992: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-11-03T16:51:24.035327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:787: [PQ: 72075186224037892] no config, start with empty partitions and default config
2025-11-03T16:51:24.035389Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:913: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-11-03T16:51:24.035440Z node 2 :PERSQUEUE INFO: pq_impl.cpp:612: [PQ: 72075186224037892] doesn't have tx writes info
2025-11-03T16:51:24.035960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [1:7568542770067260702:2437], now have 1 active actors on pipe
2025-11-03T16:51:24.035998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [1:7568542770067260678:3249], now have 1 active actors on pipe
2025-11-03T16:51:24.038687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-03T16:51:24.037992Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:404: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1
2025-11-03T16:51:24.043185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-03T16:51:24.054409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [1:7568542770067260742:3296], now have 1 active actors on pipe
2025-11-03T16:51:24.054939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-03T16:51:24.059638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-03T16:51:24.060878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-11-03T16:51:24.060963Z node 2 :PERSQUEUE DEBUG: partition.cpp:1312: [72075186224037892][Partition][0][StateInit] HandleOnInit TEvPQ::TEvProposePartitionConfig
2025-11-03T16:51:24.061252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-11-03T16:51:24.061610Z node 2 :PERSQUEUE INFO: partition_init.cpp:1101: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7568542771210857798:2379]
2025-11-03T16:51:24.068221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-11-03T16:51:24.068259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-11-03T16:51:24.068288Z node 2 :PERSQUEUE INFO: partition.cpp:707: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1 [2:7568542771210857798:2379]
2025-11-03T16:51:24.068325Z node 2 :PERSQUEUE DEBUG: partition.cpp:727: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 0 Head Offset 0 PartNo 0 PackedSize 0 count 0 nextOffset 0 batches 0
2025-11-03T16:51:24.068370Z node 2 :PERSQUEUE DEBUG: partition_mlp.cpp:83: [72075186224037892][Partition][0][StateIdle] Initializing MLP Consumers: 0
2025-11-03T16:51:24.069813Z node 2 :PERSQUEUE DEBUG: partition.cpp:4273: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 1
2025-11-03T16:51:24.069853Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:24.069963Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:24.069975Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-03T16:51:24.070020Z node 2 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-11-03T16:51:24.070037Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:24.070053Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:24.070065Z node 2 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-11-03T16:51:24.070114Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:923: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-11-03T16:51:24.070151Z node 2 :PERSQUEUE DEBUG: partition_mlp.cpp:60: [72075186224037892][Partition][0][StateIdle] Process MLP pending events. Count 0
2025-11-03T16:51:24.070772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-03T16:51:24.070881Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:183: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:51:24.076021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-03T16:51:24.076171Z node 2 :PERSQUEUE DEBUG: partition.cpp:1416: [72075186224037892][Partition][0][StateIdle] Handle TEvPQ::TEvTxCommit Step 1762188684102, TxId 281474976715672
2025-11-03T16:51:24.076193Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:24.076209Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:24.076338Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:24.076607Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-03T16:51:24.081464Z node 2 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-03T16:51:24.081652Z node 2 :PERSQUEUE DEBUG: partition_mlp.cpp:83: [72075186224037892][Partition][0][StateIdle] Initializing MLP Consumers: 0
2025-11-03T16:51:24.081765Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-11-03T16:51:24.081790Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:24.081802Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:24.081814Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:24.081840Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:183: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:51:24.082530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:398: [PQ: 72075186224037892] Apply new config PartitionConfig { LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 } PartitionIds: 0 TopicName: "rt3.dc1--test-topic" Version: 0 LocalDC: true Codecs { Ids: 0 Ids: 1 Ids: 2 Codecs: "raw" Codecs: "gzip" Codecs: "lzop" } TopicPath: "/Root/PQ/rt3.dc1--test-topic" YcCloudId: "" YcFolderId: "" YdbDatabaseId: "" YdbDatabasePath: "/Root" Partitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } AllPartitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } Consumers { Name: "user" ReadFromTimestampsMs: 0 FormatVersion: 0 Version: 0 Generation: 0 } MonitoringProjectId: ""
2025-11-03T16:51:24.082631Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:913: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-11-03T16:51:24.082928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-03T16:51:24.091576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-03T16:51:24.091687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-03T16:51:24.100034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-03T16:51:24.121658Z node 1 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976715673. Ctx: { TraceId: 01k95a2tqnf2wpchhbxxwq9mac, Database: , SessionId: ydb://session/3?node_id=1&id=ODg3YWQ1Y2UtMjk4Nzg3MDEtNjY3OGVjY2QtM2NiOTVlOTM=, PoolId: default, DatabaseId: /Root}. Database not set, use /Root
===Query complete
TClient::Ls request: /Root/PQ/rt3.dc1--test-topic
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976715672
    CreateStep: 1762188684102
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts...
(TRUNCATED)
GetTopicVersionFromPath:  record Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976715672
    CreateStep: 1762188684102
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      YdbDatabasePath: "/Root"
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
    Partitions {
      PartitionId: 0
      TabletId: 72075186224037892
      Status: Active
    }
    AlterVersion: 1
    BalancerTabletID: 72075186224037893
    NextPartitionId: 1
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 1
      PlanResolution: 7
      Coordinators: 72057594046316545
      TimeCastBucketsPerMediator: 2
      Mediators: 72057594046382081
    }
    DomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    PathsInside: 12
    PathsLimit: 10000
    ShardsInside: 6
    ShardsLimit: 200000
    ResourcesDomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    DiskSpaceUsage {
      Tables {
        TotalSize: 0
        DataSize: 0
        IndexSize: 0
      }
      Topics {
        ReserveSize: 0
        AccountSize: 0
        DataSize: 0
        UsedReserveSize: 0
      }
    }
    PQPartitionsInside: 1
    PQPartitionsLimit: 1000000
    SchemeLimits {
      MaxDepth: 32
      MaxPaths: 10000
      MaxChildrenInDir: 100000
      MaxAclBytesSize: 10240
      MaxTableColumns: 200
      MaxTableColumnNameLength: 255
      MaxTableKeyColumns: 30
      MaxTableIndices: 20
      MaxShards: 200000
      MaxShardsInPath: 35000
      MaxConsistentCopyTargets: 10000
      MaxPathElementLength: 255
      ExtraPathSymbolsAllowed: "!\"#$%&\'()*+,-.:;<=>?@[\\]^_`{|}~"
      MaxPQPartitions: 1000000
      MaxTableCdcStreams: 5
      MaxExports: 10
      MaxImports: 10
      MaxColumnTableColumns: 10000
    }
  }
}
Path: "/Root/PQ/rt3.dc1--test-topic"
 name rt3.dc1--test-topic version1
CallPersQueueGRPC request to localhost:28979
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-11-03T16:51:24.154900Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
MetaResponse {
  CmdGetTopicMetadataResult {
    TopicInfo {
      Topic: "rt3.dc1--test-topic"
      NumPartitions: 1
      Config {
        PartitionConfig {
          LifetimeSeconds: 86400
          LowWatermark: 8388608
          SourceIdLifetimeSeconds: 86400
          WriteSpeedInBytesPerSecond: 20000000
          BurstSize: 20000000
          SourceIdMaxCounts: 6000000
        }
        Version: 1
        LocalDC: true
        Codecs {
          Ids: 0
          Ids: 1
          Ids: 2
          Codecs: "raw"
          Codecs: "gzip"
          Codecs: "lzop"
        }
        TopicPath: "/Root/PQ/rt3.dc1--test-topic"
        YdbDatabasePath: "/Root"
        Consumers {
          Name: "user"
          ReadFromTimestampsMs: 0
          FormatVersion: 0
          Version: 0
        }
      }
      ErrorCode: OK
    }
  }
}
=== Topic created, have version: 1
2025-11-03T16:51:24.171281Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: try to update token
2025-11-03T16:51:24.171999Z :INFO: [] MessageGroupId [src] SessionId [] Write session: Do CDS request
2025-11-03T16:51:24.172037Z :INFO: [] MessageGroupId [src] SessionId [] Start write session. Will connect to endpoint: localhost:28979
2025-11-03T16:51:24.168328Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:24.168363Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:24.168377Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:24.180619Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src" }
2025-11-03T16:51:24.180988Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-11-03T16:51:24.181038Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1
2025-11-03T16:51:24.186889Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src" }
2025-11-03T16:51:24.187068Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1 topic: "test-topic" message_group_id: "src" from ipv6:[::1]:46230
2025-11-03T16:51:24.187095Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:46230 proto=v1  topic=test-topic durationSec=0
2025-11-03T16:51:24.187105Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-11-03T16:51:24.188851Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1 sessionId:  describe result for acl check
2025-11-03T16:51:24.189011Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-11-03T16:51:24.189031Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-11-03T16:51:24.189045Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-11-03T16:51:24.189064Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7568542770067260818:2457] (SourceId=src, PreferedPartition=(NULL)) StartKqpSession
2025-11-03T16:51:24.192070Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7568542770067260818:2457] (SourceId=src, PreferedPartition=(NULL)) Select from the table
2025-11-03T16:51:24.268651Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:24.268675Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:24.268686Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:24.369407Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:24.369433Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:24.369443Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:24.372873Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [1:7568542770067260818:2457] (SourceId=src, PreferedPartition=(NULL)) RequestPQRB
2025-11-03T16:51:24.373522Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1655: [72075186224037893][rt3.dc1--test-topic] pipe [1:7568542770067260855:2457] connected; active server actors: 1
2025-11-03T16:51:24.373733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [1:7568542770067260818:2457] (SourceId=src, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=src
2025-11-03T16:51:24.373754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7568542770067260818:2457] (SourceId=src, PreferedPartition=(NULL)) Update the table
2025-11-03T16:51:24.379107Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1659: [72075186224037893][rt3.dc1--test-topic] pipe [1:7568542770067260855:2457] disconnected.
2025-11-03T16:51:24.379139Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1670: [72075186224037893][rt3.dc1--test-topic] pipe [1:7568542770067260855:2457] disconnected; active server actors: 1
2025-11-03T16:51:24.379156Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1695: [72075186224037893][rt3.dc1--test-topic] pipe [1:7568542770067260855:2457] disconnected no session
2025-11-03T16:51:24.464332Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7568542770067260818:2457] (SourceId=src, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-11-03T16:51:24.464383Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7568542770067260818:2457] (SourceId=src, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-11-03T16:51:24.464410Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7568542770067260818:2457] (SourceId=src, PreferedPartition=(NULL)) Start idle
2025-11-03T16:51:24.464443Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-11-03T16:51:24.465539Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1
2025-11-03T16:51:24.465390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [1:7568542770067260879:2457], now have 1 active actors on pipe
2025-11-03T16:51:24.468848Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1 partition: 0 MaxSeqNo: 0 sessionId: src|76666c0e-bb726106-a6764738-fc5a4d46_0
2025-11-03T16:51:24.469831Z :INFO: [] MessageGroupId [src] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1762188684469 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-11-03T16:51:24.467376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:24.469981Z :INFO: [] MessageGroupId [src] SessionId [] Write session established. Init response: session_id: "src|76666c0e-bb726106-a6764738-fc5a4d46_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-11-03T16:51:24.467412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:24.467499Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src|76666c0e-bb726106-a6764738-fc5a4d46_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src
2025-11-03T16:51:24.467541Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:24.467567Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:24.467580Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-03T16:51:24.467631Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:24.467674Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-03T16:51:24.467727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-03T16:51:24.468484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:24.468501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:24.470219Z :INFO: [] MessageGroupId [src] SessionId [src|76666c0e-bb726106-a6764738-fc5a4d46_0] Write session: close. Timeout = 0 ms
2025-11-03T16:51:24.468575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-03T16:51:24.470278Z :INFO: [] MessageGroupId [src] SessionId [src|76666c0e-bb726106-a6764738-fc5a4d46_0] Write session will now close
2025-11-03T16:51:24.469808Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:24.469822Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:24.470336Z :DEBUG: [] MessageGroupId [src] SessionId [src|76666c0e-bb726106-a6764738-fc5a4d46_0] Write session: aborting
2025-11-03T16:51:24.469833Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:24.471083Z :INFO: [] MessageGroupId [src] SessionId [src|76666c0e-bb726106-a6764738-fc5a4d46_0] Write session: gracefully shut down, all writes complete
2025-11-03T16:51:24.471144Z :DEBUG: [] MessageGroupId [src] SessionId [src|76666c0e-bb726106-a6764738-fc5a4d46_0] Write session is aborting and will not restart
2025-11-03T16:51:24.471197Z :DEBUG: [] MessageGroupId [src] SessionId [src|76666c0e-bb726106-a6764738-fc5a4d46_0] Write session: destroy
2025-11-03T16:51:24.474053Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId: src|76666c0e-bb726106-a6764738-fc5a4d46_0 grpc read done: success: 0 data: 
2025-11-03T16:51:24.474076Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 1 sessionId: src|76666c0e-bb726106-a6764738-fc5a4d46_0 grpc read failed
2025-11-03T16:51:24.474102Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 1 sessionId: src|76666c0e-bb726106-a6764738-fc5a4d46_0 grpc closed
2025-11-03T16:51:24.474115Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1 sessionId: src|76666c0e-bb726106-a6764738-fc5a4d46_0 is DEAD
2025-11-03T16:51:24.474895Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-11-03T16:51:24.475561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [1:7568542770067260879:2457] destroyed
2025-11-03T16:51:24.475603Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-11-03T16:51:24.475632Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:24.475647Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:24.475664Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:24.517974Z :INFO: [/Root] [/Root] [6dfadd2-2c0c6aa5-4afb4003-eaa400d7] Starting read session
2025-11-03T16:51:24.518014Z :DEBUG: [/Root] [/Root] [6dfadd2-2c0c6aa5-4afb4003-eaa400d7] Starting cluster discovery
2025-11-03T16:51:24.526101Z :DEBUG: [/Root] [/Root] [6dfadd2-2c0c6aa5-4afb4003-eaa400d7] Cluster discovery request succeeded
2025-11-03T16:51:24.526208Z :DEBUG: [/Root] [/Root] [6dfadd2-2c0c6aa5-4afb4003-eaa400d7] Starting session to cluster dc1 (localhost:28979)
2025-11-03T16:51:24.532155Z :DEBUG: [/Root] [/Root] [6dfadd2-2c0c6aa5-4afb4003-eaa400d7] [dc1] In Reconnect, ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:51:24.536149Z :DEBUG: [/Root] [/Root] [6dfadd2-2c0c6aa5-4afb4003-eaa400d7] [dc1] New values: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:51:24.540174Z :DEBUG: [/Root] [/Root] [6dfadd2-2c0c6aa5-4afb4003-eaa400d7] [dc1] Reconnecting session to cluster dc1 in 0.000000s
2025-11-03T16:51:24.552804Z :DEBUG: [/Root] [/Root] [6dfadd2-2c0c6aa5-4afb4003-eaa400d7] [dc1] Successfully connected. Initializing session
2025-11-03T16:51:24.553670Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:109: new grpc connection
2025-11-03T16:51:24.553701Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:131: new session created cookie 1
2025-11-03T16:51:24.554322Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { topic: "test-topic" } read_only_original: true consumer: "shared/user" read_params { max_read_size: 104857600 } } }
2025-11-03T16:51:24.554616Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 1 consumer shared/user session shared/user_1_1_13281759793747835520_v1 read init: from# ipv6:[::1]:46252, request# { init_request { topics_read_settings { topic: "test-topic" } read_only_original: true consumer: "shared/user" read_params { max_read_size: 104857600 } } }
2025-11-03T16:51:24.555008Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 1 consumer shared/user session shared/user_1_1_13281759793747835520_v1 auth for : user
2025-11-03T16:51:24.555620Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 1 consumer shared/user session shared/user_1_1_13281759793747835520_v1 Handle describe topics response
2025-11-03T16:51:24.555762Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 1 consumer shared/user session shared/user_1_1_13281759793747835520_v1 auth is DEAD
2025-11-03T16:51:24.555836Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 1 consumer shared/user session shared/user_1_1_13281759793747835520_v1 auth ok: topics# 1, initDone# 0
2025-11-03T16:51:24.556946Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 1 consumer shared/user session shared/user_1_1_13281759793747835520_v1 register session: topic# rt3.dc1--test-topic
2025-11-03T16:51:24.557244Z :INFO: [/Root] [/Root] [6dfadd2-2c0c6aa5-4afb4003-eaa400d7] [dc1] Server session id: shared/user_1_1_13281759793747835520_v1
2025-11-03T16:51:24.557410Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1655: [72075186224037893][rt3.dc1--test-topic] pipe [1:7568542770067260893:2473] connected; active server actors: 1
2025-11-03T16:51:24.557452Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1706: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [1:7568542770067260893:2473] session shared/user_1_1_13281759793747835520_v1
2025-11-03T16:51:24.557527Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:639: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-11-03T16:51:24.557575Z :DEBUG: [/Root] [/Root] [6dfadd2-2c0c6aa5-4afb4003-eaa400d7] [dc1] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:51:24.557606Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:669: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-11-03T16:51:24.557675Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:871: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_1_1_13281759793747835520_v1" (Sender=[1:7568542770067260890:2473], Pipe=[1:7568542770067260893:2473], Partitions=[], ActiveFamilyCount=0)
2025-11-03T16:51:24.557708Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1186: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-11-03T16:51:24.557774Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1258: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-11-03T16:51:24.557841Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1305: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_1_13281759793747835520_v1" (Sender=[1:7568542770067260890:2473], Pipe=[1:7568542770067260893:2473], Partitions=[], ActiveFamilyCount=0)
2025-11-03T16:51:24.557910Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:549: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_1_1_13281759793747835520_v1" sender [1:7568542770067260890:2473] lock partition 0 for ReadingSession "shared/user_1_1_13281759793747835520_v1" (Sender=[1:7568542770067260890:2473], Pipe=[1:7568542770067260893:2473], Partitions=[], ActiveFamilyCount=1) generation 1 step 1
2025-11-03T16:51:24.557971Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1325: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-11-03T16:51:24.558002Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1402: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000201s
2025-11-03T16:51:24.558027Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_1_1_13281759793747835520_v1 grpc read done: success# 1, data# { read { } }
2025-11-03T16:51:24.558975Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 1 consumer shared/user session shared/user_1_1_13281759793747835520_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 1 Session: "shared/user_1_1_13281759793747835520_v1" ClientId: "user" PipeClient { RawX1: 7568542770067260893 RawX2: 4503603922340265 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-11-03T16:51:24.559072Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 1 consumer shared/user session shared/user_1_1_13281759793747835520_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-11-03T16:51:24.559094Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_1_1_13281759793747835520_v1 got read request: guid# 8d9531dd-57acdbb-b28022fe-22562875
2025-11-03T16:51:24.559858Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_13281759793747835520_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 1, pipe: [1:7568542770067260896:2476]
2025-11-03T16:51:24.560112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [1:7568542770067260896:2476], now have 1 active actors on pipe
2025-11-03T16:51:24.560198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:24.560220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:24.560266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1748: [PQ: 72075186224037892] Created session shared/user_1_1_13281759793747835520_v1 on pipe: [1:7568542770067260896:2476]
2025-11-03T16:51:24.560355Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:24.560384Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:24.560396Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-03T16:51:24.560465Z node 2 :PERSQUEUE DEBUG: partition.cpp:3666: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_1_1_13281759793747835520_v1
2025-11-03T16:51:24.560485Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:24.560630Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-03T16:51:24.561077Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_1_13281759793747835520_v1:1 with generation 1
2025-11-03T16:51:24.563461Z node 2 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-03T16:51:24.563536Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-11-03T16:51:24.563563Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:24.563574Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:24.563586Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:24.563616Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:183: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:51:24.563648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-11-03T16:51:24.564031Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_1_1_13281759793747835520_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 0 SizeLag: 0 WriteTimestampEstimateMS: 1762188684472 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-11-03T16:51:24.564085Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 1 consumer shared/user session shared/user_1_1_13281759793747835520_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 0 readOffset 0 committedOffset 0
2025-11-03T16:51:24.564143Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 1 consumer shared/user session shared/user_1_1_13281759793747835520_v1 sending to client partition status
2025-11-03T16:51:24.565094Z :INFO: [/Root] [/Root] [6dfadd2-2c0c6aa5-4afb4003-eaa400d7] [dc1] Confirm partition stream create. Partition stream id: 1. Cluster: "dc1". Topic: "test-topic". Partition: 0. Read offset: (NULL)
2025-11-03T16:51:24.565955Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_1_1_13281759793747835520_v1 grpc read done: success# 1, data# { start_read { topic { path: "test-topic" } cluster: "dc1" assign_id: 1 } }
2025-11-03T16:51:24.566104Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:539: session cookie 1 consumer shared/user session shared/user_1_1_13281759793747835520_v1 got StartRead from client: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 0, commitOffset# 0
2025-11-03T16:51:24.566168Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1023: session cookie 1 consumer shared/user session shared/user_1_1_13281759793747835520_v1 Start reading TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 0 readOffset 0 committedOffset 0 clientCommitOffset 0 clientReadOffset 0
2025-11-03T16:51:24.566210Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_1_1_13281759793747835520_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 1 from offset 0
2025-11-03T16:51:24.572233Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:24.572262Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:24.572277Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:24.673832Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:24.673862Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:24.673875Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:24.776768Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:24.776802Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:24.776813Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:24.876909Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:24.876936Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:24.876947Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:24.980087Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:24.980123Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:24.980134Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:25.080597Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:25.080628Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:25.080639Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:25.181878Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:25.181911Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:25.181924Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:25.281368Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:25.281403Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:25.281417Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:25.384100Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:25.384132Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:25.384146Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:25.483594Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:25.483625Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:25.483638Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:25.536186Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): dc1:test-topic:0:1:0:0
2025-11-03T16:51:25.536269Z :INFO: [/Root] [/Root] [6dfadd2-2c0c6aa5-4afb4003-eaa400d7] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1018 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-11-03T16:51:25.584099Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:25.584130Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:25.584143Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:25.692098Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:25.692132Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:25.692144Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:25.792365Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:25.792396Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:25.792407Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:25.895182Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:25.895215Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:25.895226Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:25.996339Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:25.996369Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:25.996380Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:26.100201Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:26.100228Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:26.100241Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:26.208100Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:26.208125Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:26.208136Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:26.312259Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:26.312283Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:26.312294Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:26.416305Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:26.416331Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:26.416352Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:26.516938Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:26.516967Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:26.516978Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:26.617382Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:26.617414Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:26.617429Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:26.717982Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:26.718011Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:26.718032Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:26.820902Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:26.820942Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:26.820953Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:26.922378Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:26.922401Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:26.922411Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:27.024114Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:27.024138Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:27.024149Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:27.128171Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:27.128198Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:27.128208Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:27.229814Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:27.229844Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:27.229854Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:27.330311Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:27.330337Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:27.330347Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:27.430497Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:27.430528Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:27.430541Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:27.456395Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard_impl.cpp:7727: Cannot get console configs
2025-11-03T16:51:27.456434Z node 1 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
2025-11-03T16:51:27.530624Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:27.530651Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:27.530663Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:27.635711Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:27.635749Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:27.635761Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:27.736345Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:27.736368Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:27.736379Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:27.837708Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:27.837738Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:27.837750Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:27.938343Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:27.938369Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:27.938387Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:28.038511Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:28.038538Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:28.038550Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:28.140229Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:28.140261Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:28.140274Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:28.240164Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:28.240194Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:28.240207Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:28.342034Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:28.342061Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:28.342075Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:28.442988Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:28.443012Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:28.443027Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:28.543391Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:28.543416Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:28.543429Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:28.644256Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:28.644286Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:28.644300Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:28.748093Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:28.748128Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:28.748141Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:28.848765Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:28.848793Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:28.848805Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:28.949878Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:28.949901Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:28.949911Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:29.052087Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:29.052118Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:29.052132Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:29.072226Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:183: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:51:29.153895Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:29.153920Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:29.153930Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:29.256108Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:29.256151Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:29.256164Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:29.356135Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:29.356174Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:29.356186Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:29.459658Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:29.459709Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:29.459722Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:29.544571Z :DEBUG: [] MessageGroupId [test-message-group-id] SessionId [] Write session: try to update token
2025-11-03T16:51:29.545066Z :INFO: [] MessageGroupId [test-message-group-id] SessionId [] Write session: Do CDS request
2025-11-03T16:51:29.545128Z :INFO: [] MessageGroupId [test-message-group-id] SessionId [] Start write session. Will connect to endpoint: localhost:28979
2025-11-03T16:51:29.551503Z :ReadSession INFO: WriteToTopic: message1
2025-11-03T16:51:29.558128Z :DEBUG: [] MessageGroupId [test-message-group-id] SessionId [] Write session: send init request: init_request { topic: "test-topic" message_group_id: "test-message-group-id" }
2025-11-03T16:51:29.559867Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:29.559894Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:29.559906Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:29.561454Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-11-03T16:51:29.561489Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2
2025-11-03T16:51:29.561790Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "test-message-group-id" }
2025-11-03T16:51:29.561892Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2 topic: "test-topic" message_group_id: "test-message-group-id" from ipv6:[::1]:46264
2025-11-03T16:51:29.561913Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:46264 proto=v1  topic=test-topic durationSec=0
2025-11-03T16:51:29.561923Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-11-03T16:51:29.563511Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2 sessionId:  describe result for acl check
2025-11-03T16:51:29.563621Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-11-03T16:51:29.563628Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-11-03T16:51:29.563636Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-11-03T16:51:29.563651Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7568542791542097609:2525] (SourceId=test-message-group-id, PreferedPartition=(NULL)) StartKqpSession
2025-11-03T16:51:29.565900Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7568542791542097609:2525] (SourceId=test-message-group-id, PreferedPartition=(NULL)) Select from the table
2025-11-03T16:51:29.577017Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [1:7568542791542097609:2525] (SourceId=test-message-group-id, PreferedPartition=(NULL)) RequestPQRB
2025-11-03T16:51:29.584421Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1655: [72075186224037893][rt3.dc1--test-topic] pipe [1:7568542791542097629:2525] connected; active server actors: 1
2025-11-03T16:51:29.584726Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [1:7568542791542097609:2525] (SourceId=test-message-group-id, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=test-message-group-id
2025-11-03T16:51:29.584762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7568542791542097609:2525] (SourceId=test-message-group-id, PreferedPartition=(NULL)) Update the table
2025-11-03T16:51:29.585882Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1659: [72075186224037893][rt3.dc1--test-topic] pipe [1:7568542791542097629:2525] disconnected.
2025-11-03T16:51:29.585906Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1670: [72075186224037893][rt3.dc1--test-topic] pipe [1:7568542791542097629:2525] disconnected; active server actors: 1
2025-11-03T16:51:29.585922Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1695: [72075186224037893][rt3.dc1--test-topic] pipe [1:7568542791542097629:2525] disconnected no session
2025-11-03T16:51:29.594347Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7568542791542097609:2525] (SourceId=test-message-group-id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-11-03T16:51:29.594384Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7568542791542097609:2525] (SourceId=test-message-group-id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-11-03T16:51:29.594415Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7568542791542097609:2525] (SourceId=test-message-group-id, PreferedPartition=(NULL)) Start idle
2025-11-03T16:51:29.594446Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-11-03T16:51:29.595577Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1
2025-11-03T16:51:29.598565Z :INFO: [] MessageGroupId [test-message-group-id] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1762188689598 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-11-03T16:51:29.598680Z :INFO: [] MessageGroupId [test-message-group-id] SessionId [] Write session established. Init response: session_id: "test-message-group-id|29f96faf-7ea17ff9-5428e5c3-5df0da79_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-11-03T16:51:29.598967Z :DEBUG: [] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|29f96faf-7ea17ff9-5428e5c3-5df0da79_0] Write 1 messages with Id from 1 to 1
2025-11-03T16:51:29.597825Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2 partition: 0 MaxSeqNo: 0 sessionId: test-message-group-id|29f96faf-7ea17ff9-5428e5c3-5df0da79_0
2025-11-03T16:51:29.599099Z :DEBUG: [] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|29f96faf-7ea17ff9-5428e5c3-5df0da79_0] Write session: try to update token
2025-11-03T16:51:29.595390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [1:7568542791542097645:2525], now have 1 active actors on pipe
2025-11-03T16:51:29.599138Z :DEBUG: [] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|29f96faf-7ea17ff9-5428e5c3-5df0da79_0] Send 1 message(s) (0 left), first sequence number is 1
2025-11-03T16:51:29.595851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:29.595874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:29.595939Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie test-message-group-id|29f96faf-7ea17ff9-5428e5c3-5df0da79_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner test-message-group-id
2025-11-03T16:51:29.595970Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:29.596007Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:29.596017Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-03T16:51:29.596052Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:29.596088Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-03T16:51:29.596126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-03T16:51:29.597487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:29.599337Z :INFO: [] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|29f96faf-7ea17ff9-5428e5c3-5df0da79_0] Write session: close. Timeout = 18446744073709551 ms
2025-11-03T16:51:29.597505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:29.597562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-03T16:51:29.601940Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: test-message-group-id|29f96faf-7ea17ff9-5428e5c3-5df0da79_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:51:29.602206Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:51:29.602640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:29.602666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:29.602752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-11-03T16:51:29.603025Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:29.603378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:29.603395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:29.603676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0test-message-group-id' SeqNo: 1 partNo : 0 messageNo: 1 size 79 offset: -1
2025-11-03T16:51:29.603726Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:51:29.603779Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:29.603806Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:29.603820Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-03T16:51:29.603928Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0test-message-group-id' seqNo 1 partNo 0
2025-11-03T16:51:29.622244Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0test-message-group-id' seqNo 1 partNo 0 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 168 count 1 nextOffset 1 batches 1
2025-11-03T16:51:29.622313Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:29.622906Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 0,1 HeadOffset 0 endOffset 0 curOffset 1 d0000000000_00000000000000000000_00000_0000000001_00000? size 156 WTime 1762188689622
2025-11-03T16:51:29.623095Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-03T16:51:29.623224Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 0 partNo 0 count 1 size 156
2025-11-03T16:51:29.629182Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 0 count 1 size 156 actorID [2:7568542771210857782:2379]
2025-11-03T16:51:29.629258Z node 2 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-03T16:51:29.629315Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 101 WriteNewSizeFromSupportivePartitions# 0
2025-11-03T16:51:29.629348Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 0 suffix '63' size 156
2025-11-03T16:51:29.629355Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:51:29.629408Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0test-message-group-id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 1, partNo: 0, Offset: 0 is stored on disk
2025-11-03T16:51:29.629646Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:923: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-11-03T16:51:29.629668Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:965: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-11-03T16:51:29.629698Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:29.629711Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:29.629721Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:29.629754Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:51:29.629799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1186: [PQ: 72075186224037892] Topic 'rt3.dc1--test-topic' counters. CacheSize 156 CachedBlobs 1
2025-11-03T16:51:29.629824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1  requestId: <none> cookie: 1
2025-11-03T16:51:29.629943Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:880: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 partno 0 count 1 size 1024000 endOffset 1 max time lag 0ms effective offset 0
2025-11-03T16:51:29.630274Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 1 consumer shared/user session shared/user_1_1_13281759793747835520_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 0 EndOffset 0 newEndOffset 1 commitOffset 0 clientCommitOffset 0 cookie 1 readingFinished 0 firstRead 1
2025-11-03T16:51:29.630308Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_1_1_13281759793747835520_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 0 endOffset 1
2025-11-03T16:51:29.630347Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:29.630662Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_1_1_13281759793747835520_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 0, endOffset# 1, WTime# 0, sizeLag# 156
2025-11-03T16:51:29.630672Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_1_1_13281759793747835520_v1TEvPartitionReady. Aval parts: 1
2025-11-03T16:51:29.630722Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_1_1_13281759793747835520_v1 performing read request: guid# 8d9531dd-57acdbb-b28022fe-22562875, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 1, size# 187, partitionsAsked# 1, maxTimeLag# 0ms
2025-11-03T16:51:29.630784Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_1_1_13281759793747835520_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 1 maxSize 187 maxTimeLagMs 0 readTimestampMs 0 readOffset 0 EndOffset 1 ClientCommitOffset 0 committedOffset 0 Guid 8d9531dd-57acdbb-b28022fe-22562875
2025-11-03T16:51:29.630179Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1105: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 156 count 1 last offset 0, current partition end offset: 1
2025-11-03T16:51:29.630203Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1121: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-11-03T16:51:29.630251Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 0 partno 0 count 1 parts_count 0 source 1 size 156 accessed 0 times before, last time 2025-11-03T16:51:29.000000Z
2025-11-03T16:51:29.630283Z node 2 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 3. All 1 blobs are from cache.
2025-11-03T16:51:29.630326Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:572: FormAnswer for 1 blobs
2025-11-03T16:51:29.630450Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 0 totakecount 1 count 1 size 136 from pos 0 cbcount 1
2025-11-03T16:51:29.630519Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1015: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1762188689603 queuesize 0 startOffset 0
2025-11-03T16:51:29.630972Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 0 suffix '63'
2025-11-03T16:51:29.631201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:29.631220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:29.631301Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:880: [72075186224037892][Partition][0][StateIdle] read cookie 4 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 partno 0 count 1 size 187 endOffset 1 max time lag 0ms effective offset 0
2025-11-03T16:51:29.631437Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1105: [72075186224037892][Partition][0][StateIdle] read cookie 4 added 1 blobs, size 156 count 1 last offset 0, current partition end offset: 1
2025-11-03T16:51:29.631448Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1121: [72075186224037892][Partition][0][StateIdle] Reading cookie 4. Send blob request.
2025-11-03T16:51:29.631476Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 0 partno 0 count 1 parts_count 0 source 1 size 156 accessed 1 times before, last time 2025-11-03T16:51:29.000000Z
2025-11-03T16:51:29.631506Z node 2 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 4. All 1 blobs are from cache.
2025-11-03T16:51:29.631548Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:572: FormAnswer for 1 blobs
2025-11-03T16:51:29.631563Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 0 suffix '63'
2025-11-03T16:51:29.631627Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 0 totakecount 1 count 1 size 136 from pos 0 cbcount 1
2025-11-03T16:51:29.631715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-03T16:51:29.632278Z :DEBUG: [] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|29f96faf-7ea17ff9-5428e5c3-5df0da79_0] Write session got write response: sequence_numbers: 1 offsets: 0 already_written: false write_statistics { persist_duration_ms: 7 queued_in_partition_duration_ms: 18 }
2025-11-03T16:51:29.632358Z :DEBUG: [] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|29f96faf-7ea17ff9-5428e5c3-5df0da79_0] Write session: acknoledged message 1
2025-11-03T16:51:29.632192Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_1_1_13281759793747835520_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 1 Result { Offset: 0 Data: "... 79 bytes ..." SourceId: "\000test-message-group-id" SeqNo: 1 WriteTimestampMS: 1762188689603 CreateTimestampMS: 1762188689598 UncompressedSize: 8 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 20 RealReadOffset: 0 WaitQuotaTimeMs: 0 EndOffset: 1 StartOffset: 0 } Cookie: 0 }
2025-11-03T16:51:29.632358Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_1_1_13281759793747835520_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 2 from offset 1
2025-11-03T16:51:29.632400Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_1_1_13281759793747835520_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 1 ReadOffset 1 ReadGuid 8d9531dd-57acdbb-b28022fe-22562875 has messages 1
2025-11-03T16:51:29.632496Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_1_1_13281759793747835520_v1 read done: guid# 8d9531dd-57acdbb-b28022fe-22562875, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 198
2025-11-03T16:51:29.632532Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_1_1_13281759793747835520_v1 response to read: guid# 8d9531dd-57acdbb-b28022fe-22562875
2025-11-03T16:51:29.632751Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_1_1_13281759793747835520_v1 Process answer. Aval parts: 0
2025-11-03T16:51:29.633336Z :DEBUG: [/Root] [/Root] [6dfadd2-2c0c6aa5-4afb4003-eaa400d7] [dc1] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:51:29.633964Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 0 (0-0)
2025-11-03T16:51:29.634062Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (0-0)
GOT MESSAGE: Message { Data: "message1" Partition stream id: 1 Cluster: "dc1". Topic: "test-topic" Partition: 0 PartitionKey: "" Information: { Offset: 0 SeqNo: 1 MessageGroupId: "test-message-group-id" CreateTime: 2025-11-03T16:51:29.598000Z WriteTime: 2025-11-03T16:51:29.603000Z Ip: "ipv6:[::1]:46264" UncompressedSize: 8 Meta: { "logtype": "unknown", "ident": "unknown", "server": "ipv6:[::1]:46264" } } }
2025-11-03T16:51:29.634568Z :DEBUG: [/Root] [/Root] [6dfadd2-2c0c6aa5-4afb4003-eaa400d7] [dc1] Commit offsets [0, 1). Partition stream id: 1
2025-11-03T16:51:29.634728Z :DEBUG: [/Root] [/Root] [6dfadd2-2c0c6aa5-4afb4003-eaa400d7] [dc1] The application data is transferred to the client. Number of messages 1, size 8 bytes
2025-11-03T16:51:29.639685Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_1_1_13281759793747835520_v1 grpc read done: success# 1, data# { read { } }
2025-11-03T16:51:29.639883Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_1_1_13281759793747835520_v1 got read request: guid# 9f9e90b5-fb049d24-e7c1e37e-7abcb653
2025-11-03T16:51:29.640112Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_1_1_13281759793747835520_v1 grpc read done: success# 1, data# { commit { cookies { assign_id: 1 partition_cookie: 1 } } }
2025-11-03T16:51:29.640326Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1449: session cookie 1 consumer shared/user session shared/user_1_1_13281759793747835520_v1 commit request from client for 1 in TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-11-03T16:51:29.640368Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:129: session cookie 1 consumer shared/user session shared/user_1_1_13281759793747835520_v1 commit request from 1 to 1 in TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-11-03T16:51:29.640433Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:203: session cookie 1 consumer shared/user session shared/user_1_1_13281759793747835520_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) committing to position 1 prev 0 end 1 by cookie 1
2025-11-03T16:51:29.641584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:29.641620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:29.641674Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:29.641693Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:29.641704Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-03T16:51:29.641760Z node 2 :PERSQUEUE DEBUG: partition.cpp:3666: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user offset is set to 1 (startOffset 0) session shared/user_1_1_13281759793747835520_v1
2025-11-03T16:51:29.641775Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:29.641878Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-03T16:51:29.645734Z node 2 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-03T16:51:29.645798Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:923: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 1 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-11-03T16:51:29.645840Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-11-03T16:51:29.645873Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:29.645887Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:29.645898Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:29.645925Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:51:29.645949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-11-03T16:51:29.646239Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_1_1_13281759793747835520_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { Cookie: 1 }
2025-11-03T16:51:29.646305Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:961: session cookie 1 consumer shared/user session shared/user_1_1_13281759793747835520_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) commit done to position 1 endOffset 1 with cookie 1
2025-11-03T16:51:29.646346Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:707: session cookie 1 consumer shared/user session shared/user_1_1_13281759793747835520_v1 replying for commits: assignId# 1, from# 1, to# 1, offset# 1
2025-11-03T16:51:29.647194Z :DEBUG: [/Root] [/Root] [6dfadd2-2c0c6aa5-4afb4003-eaa400d7] [dc1] Committed response: cookies { assign_id: 1 partition_cookie: 1 }
2025-11-03T16:51:29.663688Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:29.663723Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:29.663735Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:29.700133Z :INFO: [] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|29f96faf-7ea17ff9-5428e5c3-5df0da79_0] Write session will now close
2025-11-03T16:51:29.700234Z :DEBUG: [] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|29f96faf-7ea17ff9-5428e5c3-5df0da79_0] Write session: aborting
2025-11-03T16:51:29.700797Z :INFO: [] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|29f96faf-7ea17ff9-5428e5c3-5df0da79_0] Write session: gracefully shut down, all writes complete
2025-11-03T16:51:29.700847Z :DEBUG: [] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|29f96faf-7ea17ff9-5428e5c3-5df0da79_0] Write session: destroy
2025-11-03T16:51:29.704075Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: test-message-group-id|29f96faf-7ea17ff9-5428e5c3-5df0da79_0 grpc read done: success: 0 data: 
2025-11-03T16:51:29.704100Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 2 sessionId: test-message-group-id|29f96faf-7ea17ff9-5428e5c3-5df0da79_0 grpc read failed
2025-11-03T16:51:29.704133Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 2 sessionId: test-message-group-id|29f96faf-7ea17ff9-5428e5c3-5df0da79_0 grpc closed
2025-11-03T16:51:29.704149Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2 sessionId: test-message-group-id|29f96faf-7ea17ff9-5428e5c3-5df0da79_0 is DEAD
2025-11-03T16:51:29.704707Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-11-03T16:51:29.705352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [1:7568542791542097645:2525] destroyed
2025-11-03T16:51:29.705395Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-11-03T16:51:29.705422Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:29.705436Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:29.705447Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:29.729775Z :DEBUG: [] MessageGroupId [test-message-group-id] SessionId [] Write session: try to update token
2025-11-03T16:51:29.730131Z :INFO: [] MessageGroupId [test-message-group-id] SessionId [] Write session: Do CDS request
2025-11-03T16:51:29.730177Z :INFO: [] MessageGroupId [test-message-group-id] SessionId [] Start write session. Will connect to endpoint: localhost:28979
2025-11-03T16:51:29.738913Z :ReadSession INFO: WriteToTopic: message2
2025-11-03T16:51:29.741877Z :DEBUG: [] MessageGroupId [test-message-group-id] SessionId [] Write session: send init request: init_request { topic: "test-topic" message_group_id: "test-message-group-id" }
2025-11-03T16:51:29.744843Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-11-03T16:51:29.744871Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3
2025-11-03T16:51:29.745522Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "test-message-group-id" }
2025-11-03T16:51:29.745630Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3 topic: "test-topic" message_group_id: "test-message-group-id" from ipv6:[::1]:46284
2025-11-03T16:51:29.745644Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:46284 proto=v1  topic=test-topic durationSec=0
2025-11-03T16:51:29.745652Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-11-03T16:51:29.746868Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3 sessionId:  describe result for acl check
2025-11-03T16:51:29.746974Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-11-03T16:51:29.746982Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-11-03T16:51:29.746990Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-11-03T16:51:29.747002Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7568542791542097662:2531] (SourceId=test-message-group-id, PreferedPartition=(NULL)) StartKqpSession
2025-11-03T16:51:29.749203Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7568542791542097662:2531] (SourceId=test-message-group-id, PreferedPartition=(NULL)) Select from the table
2025-11-03T16:51:29.756694Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7568542791542097662:2531] (SourceId=test-message-group-id, PreferedPartition=(NULL)) Update the table
2025-11-03T16:51:29.760834Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:29.760860Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:29.760870Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:29.765406Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7568542791542097662:2531] (SourceId=test-message-group-id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-11-03T16:51:29.765440Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7568542791542097662:2531] (SourceId=test-message-group-id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-11-03T16:51:29.765455Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7568542791542097662:2531] (SourceId=test-message-group-id, PreferedPartition=(NULL)) Start idle
2025-11-03T16:51:29.765480Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-11-03T16:51:29.766933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [1:7568542791542097695:2531], now have 1 active actors on pipe
2025-11-03T16:51:29.767098Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1
2025-11-03T16:51:29.767318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:29.767346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:29.767404Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie test-message-group-id|d52c3e64-c57ea4b0-809c993f-caee98e2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner test-message-group-id
2025-11-03T16:51:29.767423Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:29.767433Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:29.767442Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-03T16:51:29.767473Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:29.767500Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-03T16:51:29.767528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-03T16:51:29.768115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:29.768141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:29.768199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-03T16:51:29.769007Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3 partition: 0 MaxSeqNo: 1 sessionId: test-message-group-id|d52c3e64-c57ea4b0-809c993f-caee98e2_0
2025-11-03T16:51:29.769676Z :INFO: [] MessageGroupId [test-message-group-id] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1762188689769 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-11-03T16:51:29.769761Z :INFO: [] MessageGroupId [test-message-group-id] SessionId [] Write session established. Init response: last_sequence_number: 1 session_id: "test-message-group-id|d52c3e64-c57ea4b0-809c993f-caee98e2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-11-03T16:51:29.772135Z :DEBUG: [] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|d52c3e64-c57ea4b0-809c993f-caee98e2_0] Write 1 messages with Id from 1 to 1
2025-11-03T16:51:29.772282Z :DEBUG: [] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|d52c3e64-c57ea4b0-809c993f-caee98e2_0] Write session: try to update token
2025-11-03T16:51:29.772325Z :DEBUG: [] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|d52c3e64-c57ea4b0-809c993f-caee98e2_0] Send 1 message(s) (0 left), first sequence number is 2
2025-11-03T16:51:29.772695Z :INFO: [] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|d52c3e64-c57ea4b0-809c993f-caee98e2_0] Write session: close. Timeout = 18446744073709551 ms
2025-11-03T16:51:29.776432Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3 sessionId: test-message-group-id|d52c3e64-c57ea4b0-809c993f-caee98e2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:51:29.776668Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:51:29.777169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:29.777199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:29.777247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-11-03T16:51:29.777485Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:29.777784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:29.777806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:29.777854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0test-message-group-id' SeqNo: 2 partNo : 0 messageNo: 1 size 79 offset: -1
2025-11-03T16:51:29.777902Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:51:29.777948Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:29.777974Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:29.777997Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-03T16:51:29.778101Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0test-message-group-id' seqNo 2 partNo 0
2025-11-03T16:51:29.779047Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0test-message-group-id' seqNo 2 partNo 0 FormedBlobsCount 0 NewHead: Offset 1 PartNo 0 PackedSize 168 count 1 nextOffset 2 batches 1
2025-11-03T16:51:29.779096Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:29.779477Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 1,1 HeadOffset 1 endOffset 1 curOffset 2 d0000000000_00000000000000000001_00000_0000000001_00000? size 156 WTime 1762188689779
2025-11-03T16:51:29.779609Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-03T16:51:29.779711Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 1 partNo 0 count 1 size 156
2025-11-03T16:51:29.782341Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 1 count 1 size 156 actorID [2:7568542771210857782:2379]
2025-11-03T16:51:29.782394Z node 2 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-03T16:51:29.782435Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 101 WriteNewSizeFromSupportivePartitions# 0
2025-11-03T16:51:29.782466Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:51:29.782500Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0test-message-group-id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 2, partNo: 0, Offset: 1 is stored on disk
2025-11-03T16:51:29.782679Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:923: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 1 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-11-03T16:51:29.782718Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:965: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 1 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-11-03T16:51:29.782737Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:29.782749Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:29.782762Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:29.782789Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:51:29.782829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1  requestId: <none> cookie: 1
2025-11-03T16:51:29.782905Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:880: [72075186224037892][Partition][0][StateIdle] read cookie 5 Topic 'rt3.dc1--test-topic' partition 0 user user offset 1 partno 0 count 1 size 1024000 endOffset 2 max time lag 0ms effective offset 1
2025-11-03T16:51:29.783074Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1105: [72075186224037892][Partition][0][StateIdle] read cookie 5 added 1 blobs, size 156 count 1 last offset 1, current partition end offset: 2
2025-11-03T16:51:29.783096Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1121: [72075186224037892][Partition][0][StateIdle] Reading cookie 5. Send blob request.
2025-11-03T16:51:29.783135Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 1 partno 0 count 1 parts_count 0 source 1 size 156 accessed 0 times before, last time 2025-11-03T16:51:29.000000Z
2025-11-03T16:51:29.783156Z node 2 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 5. All 1 blobs are from cache.
2025-11-03T16:51:29.783189Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:572: FormAnswer for 1 blobs
2025-11-03T16:51:29.783287Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 1 totakecount 1 count 1 size 136 from pos 0 cbcount 1
2025-11-03T16:51:29.783337Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1015: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1762188689777 queuesize 0 startOffset 0
2025-11-03T16:51:29.783459Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 1 partno 0 count 1 parts 0 suffix '63' size 156
2025-11-03T16:51:29.783502Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 1 partno 0 count 1 parts 0 suffix '63'
2025-11-03T16:51:29.783715Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 1 consumer shared/user session shared/user_1_1_13281759793747835520_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 1 EndOffset 1 newEndOffset 2 commitOffset 1 clientCommitOffset 1 cookie 2 readingFinished 0 firstRead 0
2025-11-03T16:51:29.783746Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_1_1_13281759793747835520_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 1 endOffset 2
2025-11-03T16:51:29.783791Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:29.784205Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_1_1_13281759793747835520_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 1, endOffset# 2, WTime# 1762188689603, sizeLag# 156
2025-11-03T16:51:29.784222Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_1_1_13281759793747835520_v1TEvPartitionReady. Aval parts: 1
2025-11-03T16:51:29.784266Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_1_1_13281759793747835520_v1 performing read request: guid# 9f9e90b5-fb049d24-e7c1e37e-7abcb653, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 1, size# 187, partitionsAsked# 1, maxTimeLag# 0ms
2025-11-03T16:51:29.784312Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_1_1_13281759793747835520_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 1 maxSize 187 maxTimeLagMs 0 readTimestampMs 0 readOffset 1 EndOffset 2 ClientCommitOffset 1 committedOffset 1 Guid 9f9e90b5-fb049d24-e7c1e37e-7abcb653
2025-11-03T16:51:29.784890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:29.784917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:29.784992Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:880: [72075186224037892][Partition][0][StateIdle] read cookie 6 Topic 'rt3.dc1--test-topic' partition 0 user user offset 1 partno 0 count 1 size 187 endOffset 2 max time lag 0ms effective offset 1
2025-11-03T16:51:29.785113Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1105: [72075186224037892][Partition][0][StateIdle] read cookie 6 added 1 blobs, size 156 count 1 last offset 1, current partition end offset: 2
2025-11-03T16:51:29.785125Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1121: [72075186224037892][Partition][0][StateIdle] Reading cookie 6. Send blob request.
2025-11-03T16:51:29.785149Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 1 partno 0 count 1 parts_count 0 source 1 size 156 accessed 1 times before, last time 2025-11-03T16:51:29.000000Z
2025-11-03T16:51:29.785165Z node 2 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 6. All 1 blobs are from cache.
2025-11-03T16:51:29.785185Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:572: FormAnswer for 1 blobs
2025-11-03T16:51:29.785243Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 1 totakecount 1 count 1 size 136 from pos 0 cbcount 1
2025-11-03T16:51:29.785297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-11-03T16:51:29.785427Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 1 partno 0 count 1 parts 0 suffix '63'
2025-11-03T16:51:29.785798Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_1_1_13281759793747835520_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 2 Result { Offset: 1 Data: "... 79 bytes ..." SourceId: "\000test-message-group-id" SeqNo: 2 WriteTimestampMS: 1762188689777 CreateTimestampMS: 1762188689772 UncompressedSize: 8 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 20 RealReadOffset: 1 WaitQuotaTimeMs: 0 EndOffset: 2 StartOffset: 0 } Cookie: 1 }
2025-11-03T16:51:29.785897Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_1_1_13281759793747835520_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 3 from offset 2
2025-11-03T16:51:29.785925Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_1_1_13281759793747835520_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 2 ReadOffset 2 ReadGuid 9f9e90b5-fb049d24-e7c1e37e-7abcb653 has messages 1
2025-11-03T16:51:29.786014Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_1_1_13281759793747835520_v1 read done: guid# 9f9e90b5-fb049d24-e7c1e37e-7abcb653, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 200
2025-11-03T16:51:29.786037Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_1_1_13281759793747835520_v1 response to read: guid# 9f9e90b5-fb049d24-e7c1e37e-7abcb653
2025-11-03T16:51:29.786261Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_1_1_13281759793747835520_v1 Process answer. Aval parts: 0
2025-11-03T16:51:29.788633Z :DEBUG: [] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|d52c3e64-c57ea4b0-809c993f-caee98e2_0] Write session got write response: sequence_numbers: 2 offsets: 1 already_written: false write_statistics { persist_duration_ms: 2 queued_in_partition_duration_ms: 1 }
2025-11-03T16:51:29.788678Z :DEBUG: [] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|d52c3e64-c57ea4b0-809c993f-caee98e2_0] Write session: acknoledged message 1
2025-11-03T16:51:29.789648Z :DEBUG: [/Root] [/Root] [6dfadd2-2c0c6aa5-4afb4003-eaa400d7] [dc1] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:51:29.792128Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 0 (1-1)
2025-11-03T16:51:29.792239Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (1-1)
GOT MESSAGE: Message { Data: "message2" Partition stream id: 1 Cluster: "dc1". Topic: "test-topic" Partition: 0 PartitionKey: "" Information: { Offset: 1 SeqNo: 2 MessageGroupId: "test-message-group-id" CreateTime: 2025-11-03T16:51:29.772000Z WriteTime: 2025-11-03T16:51:29.777000Z Ip: "ipv6:[::1]:46284" UncompressedSize: 8 Meta: { "logtype": "unknown", "ident": "unknown", "server": "ipv6:[::1]:46284" } } }
2025-11-03T16:51:29.792164Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_1_1_13281759793747835520_v1 grpc read done: success# 1, data# { read { } }
2025-11-03T16:51:29.792412Z :DEBUG: [/Root] [/Root] [6dfadd2-2c0c6aa5-4afb4003-eaa400d7] [dc1] Commit offsets [1, 2). Partition stream id: 1
2025-11-03T16:51:29.792291Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_1_1_13281759793747835520_v1 got read request: guid# 532e78f8-77c00df8-69bd157-386996f0
2025-11-03T16:51:29.792796Z :DEBUG: [/Root] [/Root] [6dfadd2-2c0c6aa5-4afb4003-eaa400d7] [dc1] The application data is transferred to the client. Number of messages 1, size 8 bytes
2025-11-03T16:51:29.793267Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_1_1_13281759793747835520_v1 grpc read done: success# 1, data# { commit { cookies { assign_id: 1 partition_cookie: 2 } } }
2025-11-03T16:51:29.793444Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1449: session cookie 1 consumer shared/user session shared/user_1_1_13281759793747835520_v1 commit request from client for 2 in TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-11-03T16:51:29.793470Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:129: session cookie 1 consumer shared/user session shared/user_1_1_13281759793747835520_v1 commit request from 2 to 2 in TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-11-03T16:51:29.793513Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:203: session cookie 1 consumer shared/user session shared/user_1_1_13281759793747835520_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) committing to position 2 prev 1 end 2 by cookie 2
2025-11-03T16:51:29.793922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:29.793955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:29.794005Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:29.794024Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:29.794035Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-03T16:51:29.794083Z node 2 :PERSQUEUE DEBUG: partition.cpp:3666: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user offset is set to 2 (startOffset 0) session shared/user_1_1_13281759793747835520_v1
2025-11-03T16:51:29.794098Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:29.794198Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-03T16:51:29.796744Z node 2 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-03T16:51:29.796785Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:923: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 2 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-11-03T16:51:29.796820Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-11-03T16:51:29.796842Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:29.796853Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:29.796863Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:29.796889Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:51:29.796909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 2
2025-11-03T16:51:29.798774Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_1_1_13281759793747835520_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { Cookie: 2 }
2025-11-03T16:51:29.798840Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:961: session cookie 1 consumer shared/user session shared/user_1_1_13281759793747835520_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) commit done to position 2 endOffset 2 with cookie 2
2025-11-03T16:51:29.798894Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:707: session cookie 1 consumer shared/user session shared/user_1_1_13281759793747835520_v1 replying for commits: assignId# 1, from# 2, to# 2, offset# 2
2025-11-03T16:51:29.799543Z :DEBUG: [/Root] [/Root] [6dfadd2-2c0c6aa5-4afb4003-eaa400d7] [dc1] Committed response: cookies { assign_id: 1 partition_cookie: 2 }
2025-11-03T16:51:29.862101Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:29.862133Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:29.862147Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:29.876069Z :INFO: [] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|d52c3e64-c57ea4b0-809c993f-caee98e2_0] Write session will now close
2025-11-03T16:51:29.876138Z :DEBUG: [] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|d52c3e64-c57ea4b0-809c993f-caee98e2_0] Write session: aborting
2025-11-03T16:51:29.876628Z :INFO: [] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|d52c3e64-c57ea4b0-809c993f-caee98e2_0] Write session: gracefully shut down, all writes complete
2025-11-03T16:51:29.876677Z :DEBUG: [] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|d52c3e64-c57ea4b0-809c993f-caee98e2_0] Write session: destroy
2025-11-03T16:51:29.881221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [1:7568542791542097695:2531] destroyed
2025-11-03T16:51:29.881270Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-11-03T16:51:29.881299Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:29.881312Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:29.881324Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:29.877504Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3 sessionId: test-message-group-id|d52c3e64-c57ea4b0-809c993f-caee98e2_0 grpc read done: success: 0 data: 
2025-11-03T16:51:29.877537Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 3 sessionId: test-message-group-id|d52c3e64-c57ea4b0-809c993f-caee98e2_0 grpc read failed
2025-11-03T16:51:29.877569Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 3 sessionId: test-message-group-id|d52c3e64-c57ea4b0-809c993f-caee98e2_0 grpc closed
2025-11-03T16:51:29.877584Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3 sessionId: test-message-group-id|d52c3e64-c57ea4b0-809c993f-caee98e2_0 is DEAD
2025-11-03T16:51:29.878283Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-11-03T16:51:29.962088Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:29.962130Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:29.962145Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:30.062463Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:30.062490Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:30.062506Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:30.163996Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:30.164030Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:30.164042Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:30.267007Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:30.267040Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:30.267052Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:30.367908Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:30.367937Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:30.367947Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:30.467424Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:30.467444Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:30.467450Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:30.570561Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:30.570589Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:30.570600Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:30.673027Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:30.673060Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:30.673072Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:30.772528Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:30.772563Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:30.772575Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:30.873362Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:30.873388Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:30.873399Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:30.915793Z :DEBUG: [] MessageGroupId [test-message-group-id] SessionId [] Write session: try to update token
2025-11-03T16:51:30.916152Z :INFO: [] MessageGroupId [test-message-group-id] SessionId [] Write session: Do CDS request
2025-11-03T16:51:30.916194Z :INFO: [] MessageGroupId [test-message-group-id] SessionId [] Start write session. Will connect to endpoint: localhost:28979
2025-11-03T16:51:30.922568Z :ReadSession INFO: WriteToTopic: message3
2025-11-03T16:51:30.936164Z :DEBUG: [] MessageGroupId [test-message-group-id] SessionId [] Write session: send init request: init_request { topic: "test-topic" message_group_id: "test-message-group-id" }
2025-11-03T16:51:30.933148Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-11-03T16:51:30.933186Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 4
2025-11-03T16:51:30.944680Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 4 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "test-message-group-id" }
2025-11-03T16:51:30.944826Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 4 topic: "test-topic" message_group_id: "test-message-group-id" from ipv6:[::1]:46290
2025-11-03T16:51:30.944841Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=4 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:46290 proto=v1  topic=test-topic durationSec=0
2025-11-03T16:51:30.944851Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-11-03T16:51:30.953400Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 4 sessionId:  describe result for acl check
2025-11-03T16:51:30.953532Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-11-03T16:51:30.953547Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-11-03T16:51:30.953555Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-11-03T16:51:30.953585Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7568542795837065058:2549] (SourceId=test-message-group-id, PreferedPartition=(NULL)) StartKqpSession
2025-11-03T16:51:30.955890Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7568542795837065058:2549] (SourceId=test-message-group-id, PreferedPartition=(NULL)) Select from the table
2025-11-03T16:51:30.974206Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7568542795837065058:2549] (SourceId=test-message-group-id, PreferedPartition=(NULL)) Update the table
2025-11-03T16:51:30.976069Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:30.976096Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:30.976106Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:30.983689Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7568542795837065058:2549] (SourceId=test-message-group-id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-11-03T16:51:30.983738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7568542795837065058:2549] (SourceId=test-message-group-id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-11-03T16:51:30.983754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7568542795837065058:2549] (SourceId=test-message-group-id, PreferedPartition=(NULL)) Start idle
2025-11-03T16:51:30.983778Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 4 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-11-03T16:51:30.989265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [1:7568542795837065089:2549], now have 1 active actors on pipe
2025-11-03T16:51:30.992229Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1
2025-11-03T16:51:30.993745Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 4 partition: 0 MaxSeqNo: 2 sessionId: test-message-group-id|be4c26c0-485a578a-d7ed7de1-a01f171c_0
2025-11-03T16:51:30.992584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:30.992617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:30.992686Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie test-message-group-id|be4c26c0-485a578a-d7ed7de1-a01f171c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner test-message-group-id
2025-11-03T16:51:30.992714Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:30.992730Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:30.992741Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-03T16:51:30.992776Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:30.992810Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-03T16:51:30.992849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-03T16:51:30.993462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:30.993476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:30.993522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-03T16:51:31.000166Z :INFO: [] MessageGroupId [test-message-group-id] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1762188691000 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-11-03T16:51:31.000320Z :INFO: [] MessageGroupId [test-message-group-id] SessionId [] Write session established. Init response: last_sequence_number: 2 session_id: "test-message-group-id|be4c26c0-485a578a-d7ed7de1-a01f171c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-11-03T16:51:31.002296Z :DEBUG: [] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|be4c26c0-485a578a-d7ed7de1-a01f171c_0] Write 1 messages with Id from 1 to 1
2025-11-03T16:51:31.002434Z :DEBUG: [] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|be4c26c0-485a578a-d7ed7de1-a01f171c_0] Write session: try to update token
2025-11-03T16:51:31.002472Z :DEBUG: [] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|be4c26c0-485a578a-d7ed7de1-a01f171c_0] Send 1 message(s) (0 left), first sequence number is 3
2025-11-03T16:51:31.002823Z :INFO: [] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|be4c26c0-485a578a-d7ed7de1-a01f171c_0] Write session: close. Timeout = 18446744073709551 ms
2025-11-03T16:51:31.003243Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 4 sessionId: test-message-group-id|be4c26c0-485a578a-d7ed7de1-a01f171c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:51:31.003487Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:51:31.004530Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:31.004178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:31.004216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:31.004282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-11-03T16:51:31.008108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:31.008140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:31.008199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0test-message-group-id' SeqNo: 3 partNo : 0 messageNo: 1 size 79 offset: -1
2025-11-03T16:51:31.008238Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:51:31.008276Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:31.008295Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:31.008306Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-03T16:51:31.008394Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0test-message-group-id' seqNo 3 partNo 0
2025-11-03T16:51:31.087400Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0test-message-group-id' seqNo 3 partNo 0 FormedBlobsCount 0 NewHead: Offset 2 PartNo 0 PackedSize 168 count 1 nextOffset 3 batches 1
2025-11-03T16:51:31.087454Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:31.087829Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 2,1 HeadOffset 2 endOffset 2 curOffset 3 d0000000000_00000000000000000002_00000_0000000001_00000? size 156 WTime 1762188691087
2025-11-03T16:51:31.092053Z node 2 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:51:31.092100Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-03T16:51:31.092231Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 2 partNo 0 count 1 size 156
2025-11-03T16:51:31.100256Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 2 count 1 size 156 actorID [2:7568542771210857782:2379]
2025-11-03T16:51:31.100323Z node 2 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-03T16:51:31.100380Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 101 WriteNewSizeFromSupportivePartitions# 0
2025-11-03T16:51:31.100417Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:51:31.100454Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0test-message-group-id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 3, partNo: 0, Offset: 2 is stored on disk
2025-11-03T16:51:31.100635Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:923: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 2 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-11-03T16:51:31.100654Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:965: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 2 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-11-03T16:51:31.100673Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:31.100686Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:31.100697Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:31.100723Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:51:31.100728Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 2 partno 0 count 1 parts 0 suffix '63' size 156
2025-11-03T16:51:31.100754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1  requestId: <none> cookie: 1
2025-11-03T16:51:31.100824Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:880: [72075186224037892][Partition][0][StateIdle] read cookie 7 Topic 'rt3.dc1--test-topic' partition 0 user user offset 2 partno 0 count 1 size 1024000 endOffset 3 max time lag 0ms effective offset 2
2025-11-03T16:51:31.100971Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1105: [72075186224037892][Partition][0][StateIdle] read cookie 7 added 1 blobs, size 156 count 1 last offset 2, current partition end offset: 3
2025-11-03T16:51:31.100985Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1121: [72075186224037892][Partition][0][StateIdle] Reading cookie 7. Send blob request.
2025-11-03T16:51:31.101020Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 2 partno 0 count 1 parts_count 0 source 1 size 156 accessed 0 times before, last time 2025-11-03T16:51:31.000000Z
2025-11-03T16:51:31.101046Z node 2 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 7. All 1 blobs are from cache.
2025-11-03T16:51:31.101090Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:572: FormAnswer for 1 blobs
2025-11-03T16:51:31.101093Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 2 partno 0 count 1 parts 0 suffix '63'
2025-11-03T16:51:31.101184Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 2 totakecount 1 count 1 size 136 from pos 0 cbcount 1
2025-11-03T16:51:31.101228Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1015: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1762188691007 queuesize 0 startOffset 0
2025-11-03T16:51:31.102220Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 1 consumer shared/user session shared/user_1_1_13281759793747835520_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 2 EndOffset 2 newEndOffset 3 commitOffset 2 clientCommitOffset 2 cookie 3 readingFinished 0 firstRead 0
2025-11-03T16:51:31.102257Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_1_1_13281759793747835520_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 2 endOffset 3
2025-11-03T16:51:31.102314Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:31.102781Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_1_1_13281759793747835520_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 2, endOffset# 3, WTime# 1762188689777, sizeLag# 156
2025-11-03T16:51:31.102798Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_1_1_13281759793747835520_v1TEvPartitionReady. Aval parts: 1
2025-11-03T16:51:31.102844Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_1_1_13281759793747835520_v1 performing read request: guid# 532e78f8-77c00df8-69bd157-386996f0, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 1, size# 187, partitionsAsked# 1, maxTimeLag# 0ms
2025-11-03T16:51:31.102889Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_1_1_13281759793747835520_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 1 maxSize 187 maxTimeLagMs 0 readTimestampMs 0 readOffset 2 EndOffset 3 ClientCommitOffset 2 committedOffset 2 Guid 532e78f8-77c00df8-69bd157-386996f0
2025-11-03T16:51:31.104122Z :DEBUG: [] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|be4c26c0-485a578a-d7ed7de1-a01f171c_0] Write session got write response: sequence_numbers: 3 offsets: 2 already_written: false write_statistics { persist_duration_ms: 12 queued_in_partition_duration_ms: 79 }
2025-11-03T16:51:31.104173Z :DEBUG: [] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|be4c26c0-485a578a-d7ed7de1-a01f171c_0] Write session: acknoledged message 1
2025-11-03T16:51:31.105208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:31.105239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:31.105329Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:880: [72075186224037892][Partition][0][StateIdle] read cookie 8 Topic 'rt3.dc1--test-topic' partition 0 user user offset 2 partno 0 count 1 size 187 endOffset 3 max time lag 0ms effective offset 2
2025-11-03T16:51:31.105506Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1105: [72075186224037892][Partition][0][StateIdle] read cookie 8 added 1 blobs, size 156 count 1 last offset 2, current partition end offset: 3
2025-11-03T16:51:31.105520Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1121: [72075186224037892][Partition][0][StateIdle] Reading cookie 8. Send blob request.
2025-11-03T16:51:31.105560Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 2 partno 0 count 1 parts_count 0 source 1 size 156 accessed 1 times before, last time 2025-11-03T16:51:31.000000Z
2025-11-03T16:51:31.105589Z node 2 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 8. All 1 blobs are from cache.
2025-11-03T16:51:31.105623Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:572: FormAnswer for 1 blobs
2025-11-03T16:51:31.105717Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 2 totakecount 1 count 1 size 136 from pos 0 cbcount 1
2025-11-03T16:51:31.105790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 2
2025-11-03T16:51:31.105854Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 2 partno 0 count 1 parts 0 suffix '63'
2025-11-03T16:51:31.106568Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_1_1_13281759793747835520_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 3 Result { Offset: 2 Data: "... 79 bytes ..." SourceId: "\000test-message-group-id" SeqNo: 3 WriteTimestampMS: 1762188691007 CreateTimestampMS: 1762188691002 UncompressedSize: 8 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 20 RealReadOffset: 2 WaitQuotaTimeMs: 0 EndOffset: 3 StartOffset: 0 } Cookie: 2 }
2025-11-03T16:51:31.106678Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_1_1_13281759793747835520_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 4 from offset 3
2025-11-03T16:51:31.106734Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_1_1_13281759793747835520_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 3 ReadOffset 3 ReadGuid 532e78f8-77c00df8-69bd157-386996f0 has messages 1
2025-11-03T16:51:31.106838Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_1_1_13281759793747835520_v1 read done: guid# 532e78f8-77c00df8-69bd157-386996f0, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 200
2025-11-03T16:51:31.106862Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_1_1_13281759793747835520_v1 response to read: guid# 532e78f8-77c00df8-69bd157-386996f0
2025-11-03T16:51:31.107116Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_1_1_13281759793747835520_v1 Process answer. Aval parts: 0
2025-11-03T16:51:31.110431Z :DEBUG: [/Root] [/Root] [6dfadd2-2c0c6aa5-4afb4003-eaa400d7] [dc1] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:51:31.111026Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_1_1_13281759793747835520_v1 grpc read done: success# 1, data# { read { } }
2025-11-03T16:51:31.111122Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_1_1_13281759793747835520_v1 got read request: guid# 84096a65-674a7a-ec166c6-ba7c5bf2
2025-11-03T16:51:31.116055Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 0 (2-2)
2025-11-03T16:51:31.116164Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (2-2)
GOT MESSAGE: Message { Data: "message3" Partition stream id: 1 Cluster: "dc1". Topic: "test-topic" Partition: 0 PartitionKey: "" Information: { Offset: 2 SeqNo: 3 MessageGroupId: "test-message-group-id" CreateTime: 2025-11-03T16:51:31.002000Z WriteTime: 2025-11-03T16:51:31.007000Z Ip: "ipv6:[::1]:46290" UncompressedSize: 8 Meta: { "logtype": "unknown", "ident": "unknown", "server": "ipv6:[::1]:46290" } } }
2025-11-03T16:51:31.116343Z :DEBUG: [/Root] [/Root] [6dfadd2-2c0c6aa5-4afb4003-eaa400d7] [dc1] Commit offsets [2, 3). Partition stream id: 1
2025-11-03T16:51:31.116663Z :DEBUG: [/Root] [/Root] [6dfadd2-2c0c6aa5-4afb4003-eaa400d7] [dc1] The application data is transferred to the client. Number of messages 1, size 8 bytes
2025-11-03T16:51:31.118571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:31.117325Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_1_1_13281759793747835520_v1 grpc read done: success# 1, data# { commit { cookies { assign_id: 1 partition_cookie: 3 } } }
2025-11-03T16:51:31.118614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:31.117563Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1449: session cookie 1 consumer shared/user session shared/user_1_1_13281759793747835520_v1 commit request from client for 3 in TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-11-03T16:51:31.118672Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:31.117594Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:129: session cookie 1 consumer shared/user session shared/user_1_1_13281759793747835520_v1 commit request from 3 to 3 in TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-11-03T16:51:31.118716Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:31.118727Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-03T16:51:31.117639Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:203: session cookie 1 consumer shared/user session shared/user_1_1_13281759793747835520_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) committing to position 3 prev 2 end 3 by cookie 3
2025-11-03T16:51:31.118792Z node 2 :PERSQUEUE DEBUG: partition.cpp:3666: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user offset is set to 3 (startOffset 0) session shared/user_1_1_13281759793747835520_v1
2025-11-03T16:51:31.118805Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:31.118913Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-03T16:51:31.124494Z node 2 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-03T16:51:31.124558Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:923: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 3 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-11-03T16:51:31.124604Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-11-03T16:51:31.124634Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:31.124646Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:31.124658Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:31.124691Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:51:31.124718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 3
2025-11-03T16:51:31.126828Z :DEBUG: [/Root] [/Root] [6dfadd2-2c0c6aa5-4afb4003-eaa400d7] [dc1] Committed response: cookies { assign_id: 1 partition_cookie: 3 }
2025-11-03T16:51:31.125051Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_1_1_13281759793747835520_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { Cookie: 3 }
2025-11-03T16:51:31.125105Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:961: session cookie 1 consumer shared/user session shared/user_1_1_13281759793747835520_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) commit done to position 3 endOffset 3 with cookie 3
2025-11-03T16:51:31.125145Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:707: session cookie 1 consumer shared/user session shared/user_1_1_13281759793747835520_v1 replying for commits: assignId# 1, from# 3, to# 3, offset# 3
2025-11-03T16:51:31.188281Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:31.188318Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:31.188330Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:31.204227Z :INFO: [] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|be4c26c0-485a578a-d7ed7de1-a01f171c_0] Write session will now close
2025-11-03T16:51:31.204292Z :DEBUG: [] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|be4c26c0-485a578a-d7ed7de1-a01f171c_0] Write session: aborting
2025-11-03T16:51:31.204837Z :INFO: [] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|be4c26c0-485a578a-d7ed7de1-a01f171c_0] Write session: gracefully shut down, all writes complete
2025-11-03T16:51:31.204884Z :DEBUG: [] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|be4c26c0-485a578a-d7ed7de1-a01f171c_0] Write session: destroy
2025-11-03T16:51:31.207765Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 4 sessionId: test-message-group-id|be4c26c0-485a578a-d7ed7de1-a01f171c_0 grpc read done: success: 0 data: 
2025-11-03T16:51:31.207791Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 4 sessionId: test-message-group-id|be4c26c0-485a578a-d7ed7de1-a01f171c_0 grpc read failed
2025-11-03T16:51:31.207818Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 4 sessionId: test-message-group-id|be4c26c0-485a578a-d7ed7de1-a01f171c_0 grpc closed
2025-11-03T16:51:31.207834Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 4 sessionId: test-message-group-id|be4c26c0-485a578a-d7ed7de1-a01f171c_0 is DEAD
2025-11-03T16:51:31.208942Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-11-03T16:51:31.212212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [1:7568542795837065089:2549] destroyed
2025-11-03T16:51:31.212262Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-11-03T16:51:31.212291Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:31.212305Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:31.212318Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:31.292114Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:31.292143Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:31.292156Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:31.392133Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:31.392164Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:31.392177Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:31.494242Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:31.494280Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:31.494295Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:31.596139Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:31.596171Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:31.596184Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:31.700059Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:31.700083Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:31.700094Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:31.802567Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:31.802612Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:31.802623Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:31.902616Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:31.902651Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:31.902665Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:32.004489Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:32.004517Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:32.004529Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:32.107632Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:32.107670Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:32.107684Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:32.208106Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:32.208146Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:32.208158Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:32.308125Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:32.308159Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:32.308172Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:32.412134Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:32.412162Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:32.412172Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:32.519716Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:32.519750Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:32.519762Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:32.619360Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:32.619384Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:32.619394Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:32.720085Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:32.720117Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:32.720130Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:32.820090Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:32.820123Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:32.820137Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:32.920456Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:32.920486Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:32.920499Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:33.020740Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:33.020769Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:33.020780Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:33.121103Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:33.121130Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:33.121141Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:33.221477Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:33.221504Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:33.221514Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:33.323278Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:33.323305Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:33.323319Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:33.423389Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:33.423422Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:33.423435Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:33.524359Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:33.524389Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:33.524401Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:33.559072Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_1_1_13281759793747835520_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 5 from offset 3
2025-11-03T16:51:33.624575Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:33.624605Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:33.624617Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:33.734949Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:33.734991Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:33.735004Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:33.835332Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:33.835365Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:33.835377Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:33.935699Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:33.935726Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:33.935740Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:34.036045Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:34.036074Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:34.036087Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:34.072125Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:51:34.137597Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:34.137630Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:34.137644Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:34.238104Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:34.238138Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:34.238151Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:34.338136Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:34.338169Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:34.338179Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:34.441723Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:34.441752Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:34.441763Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:34.543559Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:34.543583Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:34.543593Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:34.648141Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:34.648166Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:34.648178Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:34.748063Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:34.748088Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:34.748106Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:34.848120Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:34.848146Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:34.848158Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:34.959786Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:34.959813Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:34.959825Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:35.059507Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:35.059532Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:35.059542Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:35.160099Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:35.160134Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:35.160147Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:35.260258Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:35.260287Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:35.260299Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:35.360626Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:35.360663Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:35.360674Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:35.461612Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:35.461640Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:35.461653Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:35.562187Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:35.562222Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:35.562237Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:35.662786Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:35.662814Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:35.662827Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:35.764099Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:35.764131Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:35.764144Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:35.868133Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:35.868160Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:35.868172Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:35.968464Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:35.968487Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:35.968499Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:36.068861Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:36.068889Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:36.068903Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:36.170918Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:36.170949Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:36.170962Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:36.280112Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:36.280143Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:36.280155Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:36.384137Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:36.384166Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:36.384183Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:36.488088Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:36.488120Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:36.488134Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:36.588438Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:36.588464Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:36.588477Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:36.688752Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:36.688780Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:36.688792Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:36.792093Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:36.792124Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:36.792135Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:36.896380Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:36.896411Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:36.896424Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:37.000176Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:37.000202Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:37.000216Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:37.101967Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:37.101999Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:37.102013Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:37.202619Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:37.202675Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:37.202686Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:37.303145Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:37.303178Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:37.303227Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:37.404116Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:37.404145Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:37.404157Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:37.504385Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:37.504414Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:37.504425Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:37.608608Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:37.608639Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:37.608651Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:37.710788Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:37.710820Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:37.710832Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:37.813002Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:37.813031Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:37.813043Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:37.918566Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:37.918597Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:37.918611Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:38.017959Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:38.017987Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:38.018001Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:38.120208Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:38.120237Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:38.120249Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:38.225066Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:38.225098Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:38.225112Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:38.323079Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:38.323114Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:38.323125Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:38.424487Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:38.424530Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:38.424542Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:38.528431Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:38.528461Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:38.528474Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:38.629486Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:38.629514Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:38.629527Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:38.733236Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:38.733266Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:38.733278Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:38.832451Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:38.832498Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:38.832514Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:38.936169Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:38.936206Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:38.936217Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:39.036293Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:39.036328Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:39.036340Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:39.076295Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:51:39.137578Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:39.137612Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:39.137624Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:39.238081Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:39.238112Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:39.238124Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:39.338355Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:39.338387Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:39.338401Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:39.440161Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:39.440194Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:39.440209Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:39.540675Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:39.540700Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:39.540710Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:39.641511Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:39.641538Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:39.641560Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:39.744122Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:39.744150Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:39.744164Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:39.848363Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:39.848397Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:39.848409Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:39.952070Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:39.952102Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:39.952114Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:40.055527Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:40.055561Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:40.055574Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:40.156248Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:40.156274Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:40.156285Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:40.256991Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:40.257017Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:40.257029Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:40.360259Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:40.360285Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:40.360297Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:40.463588Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:40.463616Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:40.463629Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:40.564707Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:40.564737Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:40.564750Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:40.668612Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:40.668642Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:40.668656Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:40.773397Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:40.773429Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:40.773442Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:40.876483Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:40.876514Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:40.876527Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:40.981301Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:40.981333Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:40.981347Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:41.084601Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:41.084632Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:41.084647Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:41.112106Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_1_1_13281759793747835520_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 6 from offset 3
2025-11-03T16:51:41.187564Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:41.187599Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:41.187611Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:41.216081Z :INFO: [/Root] [/Root] [6dfadd2-2c0c6aa5-4afb4003-eaa400d7] Closing read session. Close timeout: 0.000000s
2025-11-03T16:51:41.216173Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): dc1:test-topic:0:1:2:3
2025-11-03T16:51:41.216229Z :INFO: [/Root] [/Root] [6dfadd2-2c0c6aa5-4afb4003-eaa400d7] Counters: { Errors: 0 CurrentSessionLifetimeMs: 16698 BytesRead: 24 MessagesRead: 3 BytesReadCompressed: 24 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-11-03T16:51:41.216343Z :NOTICE: [/Root] [/Root] [6dfadd2-2c0c6aa5-4afb4003-eaa400d7] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Close with zero timeout " }
2025-11-03T16:51:41.216408Z :DEBUG: [/Root] [/Root] [6dfadd2-2c0c6aa5-4afb4003-eaa400d7] [dc1] Abort session to cluster
2025-11-03T16:51:41.217600Z :NOTICE: [/Root] [/Root] [6dfadd2-2c0c6aa5-4afb4003-eaa400d7] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
2025-11-03T16:51:41.219867Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_1_1_13281759793747835520_v1 grpc read done: success# 0, data# {  }
2025-11-03T16:51:41.219900Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:125: session cookie 1 consumer shared/user session shared/user_1_1_13281759793747835520_v1 grpc read failed
2025-11-03T16:51:41.219936Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:92: session cookie 1 consumer shared/user session shared/user_1_1_13281759793747835520_v1 grpc closed
2025-11-03T16:51:41.219989Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 1 consumer shared/user session shared/user_1_1_13281759793747835520_v1 is DEAD
2025-11-03T16:51:41.224750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2258: [PQ: 72075186224037892] Destroy direct read session shared/user_1_1_13281759793747835520_v1
2025-11-03T16:51:41.224802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [1:7568542770067260896:2476] destroyed
2025-11-03T16:51:41.224954Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_1_13281759793747835520_v1
2025-11-03T16:51:41.225048Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1659: [72075186224037893][rt3.dc1--test-topic] pipe [1:7568542770067260893:2473] disconnected.
2025-11-03T16:51:41.225081Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1670: [72075186224037893][rt3.dc1--test-topic] pipe [1:7568542770067260893:2473] disconnected; active server actors: 1
2025-11-03T16:51:41.225108Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1679: [72075186224037893][rt3.dc1--test-topic] pipe [1:7568542770067260893:2473] client user disconnected session shared/user_1_1_13281759793747835520_v1
2025-11-03T16:51:41.287544Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:41.287572Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:41.287584Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:41.396091Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:41.396122Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:41.396136Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:41.494294Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:41.494331Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:41.494342Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:41.925341Z node 1 :KQP_EXECUTER ERROR: kqp_executer_impl.h:1006: ActorId: [1:7568542843081705780:2638] TxId: 281474976715694. Ctx: { TraceId: 01k95a3bp6fgn3tyms4vrjym2q, Database: /Root, SessionId: ydb://session/3?node_id=1&id=NzFmZTc0ZDAtNTlmNGI0MGQtYTdiODVjMy0zNGJlZmI3, PoolId: default}. UNAVAILABLE: Failed to send EvStartKqpTasksRequest because node is unavailable: 2
2025-11-03T16:51:41.926018Z node 1 :KQP_COMPUTE ERROR: dq_compute_actor_impl.h:1210: SelfId: [1:7568542843081705791:2638], TxId: 281474976715694, task: 3. Ctx: { TraceId : 01k95a3bp6fgn3tyms4vrjym2q.  CheckpointId : .  CustomerSuppliedId : .  RunScriptActorId : [0:0:0].  PoolId : default.  SessionId : ydb://session/3?node_id=1&id=NzFmZTc0ZDAtNTlmNGI0MGQtYTdiODVjMy0zNGJlZmI3.  CurrentExecutionId : .  Database : /Root.  DatabaseId : /Root. }. Handle abort execution event from: [1:7568542843081705780:2638], status: UNAVAILABLE, reason: { <main>: Error: Terminate execution }
2025-11-03T16:51:43.486948Z :DEBUG: [db] [sessionid] [cluster] In Reconnect, ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:51:43.487004Z :DEBUG: [db] [sessionid] [cluster] New values: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:51:43.487037Z :DEBUG: [db] [sessionid] [cluster] Reconnecting session to cluster cluster in 0.000000s
2025-11-03T16:51:43.487403Z :DEBUG: [db] [sessionid] [cluster] Successfully connected. Initializing session
2025-11-03T16:51:43.488025Z :INFO: [db] [sessionid] [cluster] Server session id: 123-session-id-321
2025-11-03T16:51:43.488258Z :DEBUG: [db] [sessionid] [cluster] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:51:43.488514Z :INFO: [db] [sessionid] [cluster] Confirm partition stream create. Partition stream id: 1. Cluster: "TestCluster". Topic: "TestTopic". Partition: 1. Read offset: (NULL)
2025-11-03T16:51:43.489416Z :DEBUG: [db] [sessionid] [cluster] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
Post function
2025-11-03T16:51:43.489871Z :DEBUG: [db] [sessionid] [cluster] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
Post function
2025-11-03T16:51:43.490081Z :DEBUG: Decompression task done. Partition/PartitionSessionId: 1 (2-2)
2025-11-03T16:51:43.490200Z :DEBUG: Decompression task done. Partition/PartitionSessionId: 1 (1-1)
2025-11-03T16:51:43.490279Z :DEBUG: Take Data. Partition 1. Read: {0, 0} (1-1)
2025-11-03T16:51:43.490318Z :DEBUG: Take Data. Partition 1. Read: {0, 0} (2-2)
2025-11-03T16:51:43.490488Z :DEBUG: [db] [sessionid] [cluster] The application data is transferred to the client. Number of messages 1, size 8 bytes
2025-11-03T16:51:43.490544Z :DEBUG: [db] [sessionid] [cluster] The application data is transferred to the client. Number of messages 1, size 8 bytes
2025-11-03T16:51:14.865443Z :DEBUG: [db] [sessionid] [cluster] In Reconnect, ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:51:14.865482Z :DEBUG: [db] [sessionid] [cluster] New values: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:51:14.865502Z :DEBUG: [db] [sessionid] [cluster] Reconnecting session to cluster cluster in 0.000000s
2025-11-03T16:51:14.880288Z :DEBUG: [db] [sessionid] [cluster] Successfully connected. Initializing session
2025-11-03T16:51:14.885796Z :INFO: [db] [sessionid] [cluster] Server session id: 123-session-id-321
2025-11-03T16:51:14.902699Z :DEBUG: [db] [sessionid] [cluster] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:51:14.904194Z :INFO: [db] [sessionid] [cluster] Confirm partition stream create. Partition stream id: 1. Cluster: "TestCluster". Topic: "TestTopic". Partition: 1. Read offset: (NULL)
2025-11-03T16:51:14.908828Z :DEBUG: [db] [sessionid] [cluster] In Reconnect, ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:51:14.908849Z :DEBUG: [db] [sessionid] [cluster] New values: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:51:14.908867Z :DEBUG: [db] [sessionid] [cluster] Reconnecting session to cluster cluster in 0.000000s
2025-11-03T16:51:14.912407Z :DEBUG: [db] [sessionid] [cluster] Successfully connected. Initializing session
2025-11-03T16:51:14.913406Z :INFO: [db] [sessionid] [cluster] Server session id: 123-session-id-321
2025-11-03T16:51:14.913604Z :DEBUG: [db] [sessionid] [cluster] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:51:14.916119Z :INFO: [db] [sessionid] [cluster] Confirm partition stream create. Partition stream id: 1. Cluster: "TestCluster". Topic: "TestTopic". Partition: 1. Read offset: (NULL)
2025-11-03T16:51:14.916459Z :INFO: [db] [sessionid] [cluster] Confirm partition stream destroy. Partition stream id: 1. Cluster: "TestCluster". Topic: "TestTopic". Partition: 1
2025-11-03T16:51:14.920830Z :DEBUG: [db] [sessionid] [cluster] In Reconnect, ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:51:14.924039Z :DEBUG: [db] [sessionid] [cluster] New values: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:51:14.924080Z :DEBUG: [db] [sessionid] [cluster] Reconnecting session to cluster cluster in 0.000000s
2025-11-03T16:51:14.924448Z :DEBUG: [db] [sessionid] [cluster] Successfully connected. Initializing session
2025-11-03T16:51:14.925150Z :INFO: [db] [sessionid] [cluster] Server session id: 123-session-id-321
2025-11-03T16:51:14.925283Z :DEBUG: [db] [sessionid] [cluster] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:51:14.928140Z :INFO: [db] [sessionid] [cluster] Confirm partition stream create. Partition stream id: 1. Cluster: "TestCluster". Topic: "TestTopic". Partition: 1. Read offset: (NULL)
2025-11-03T16:51:14.928740Z :DEBUG: [db] [sessionid] [cluster] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:51:14.929026Z :DEBUG: Decompression task done. Partition/PartitionSessionId: 1 (1-1)
2025-11-03T16:51:14.932060Z :DEBUG: Take Data. Partition 1. Read: {0, 0} (1-1)
2025-11-03T16:51:14.932128Z :DEBUG: [db] [sessionid] [cluster] The application data is transferred to the client. Number of messages 1, size 0 bytes
2025-11-03T16:51:14.952064Z :DEBUG: [db] [sessionid] [cluster] In Reconnect, ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:51:14.952096Z :DEBUG: [db] [sessionid] [cluster] New values: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:51:14.952136Z :DEBUG: [db] [sessionid] [cluster] Reconnecting session to cluster cluster in 0.000000s
2025-11-03T16:51:14.952513Z :DEBUG: [db] [sessionid] [cluster] Successfully connected. Initializing session
2025-11-03T16:51:14.960245Z :INFO: [db] [sessionid] [cluster] Server session id: 123-session-id-321
2025-11-03T16:51:14.960447Z :DEBUG: [db] [sessionid] [cluster] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:51:14.960766Z :INFO: [db] [sessionid] [cluster] Confirm partition stream create. Partition stream id: 1. Cluster: "TestCluster". Topic: "TestTopic". Partition: 1. Read offset: (NULL)
Message data size: 11
Compressed message data size: 31
2025-11-03T16:51:14.961689Z :DEBUG: [db] [sessionid] [cluster] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
Post function
2025-11-03T16:51:14.961916Z :DEBUG: [db] [sessionid] [cluster] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
Post function
Getting new event
2025-11-03T16:51:14.964319Z :DEBUG: Decompression task done. Partition/PartitionSessionId: 1 (5-8)
2025-11-03T16:51:14.964564Z :DEBUG: Decompression task done. Partition/PartitionSessionId: 1 (1-4)
2025-11-03T16:51:14.968061Z :DEBUG: Take Data. Partition 1. Read: {0, 0} (1-1)
2025-11-03T16:51:14.968109Z :DEBUG: Take Data. Partition 1. Read: {0, 1} (2-2)
2025-11-03T16:51:14.968145Z :DEBUG: [db] [sessionid] [cluster] The application data is transferred to the client. Number of messages 2, size 22 bytes
DataReceived { PartitionStreamId: 1 PartitionId: 1 Message { Data: ..11 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 1 SeqNo: 42 MessageGroupId: "src_id" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:02:03.000000Z Ip: "127.0.0.1" UncompressedSize: 0 Meta: { "k1": "v1", "k": "v" } } } Message { Data: ..11 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 2 SeqNo: 43 MessageGroupId: "src_id" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:02:03.000000Z Ip: "127.0.0.1" UncompressedSize: 0 Meta: { "k1": "v1", "k": "v" } } } }
2025-11-03T16:51:14.968274Z :DEBUG: [db] [sessionid] [cluster] Commit offsets [1, 3). Partition stream id: 1
Getting new event
2025-11-03T16:51:14.968314Z :DEBUG: Take Data. Partition 1. Read: {0, 2} (3-3)
2025-11-03T16:51:14.968338Z :DEBUG: Take Data. Partition 1. Read: {1, 0} (4-4)
2025-11-03T16:51:14.968357Z :DEBUG: [db] [sessionid] [cluster] The application data is transferred to the client. Number of messages 2, size 22 bytes
DataReceived { PartitionStreamId: 1 PartitionId: 1 Message { Data: ..11 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 3 SeqNo: 44 MessageGroupId: "src_id" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:02:03.000000Z Ip: "127.0.0.1" UncompressedSize: 0 Meta: { "k1": "v1", "k": "v" } } } Message { Data: ..11 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 4 SeqNo: 45 MessageGroupId: "src_id_2" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:05:21.000000Z Ip: "1.0.0.127" UncompressedSize: 0 Meta: { "v1": "k1", "v": "k" } } } }
2025-11-03T16:51:14.968495Z :DEBUG: [db] [sessionid] [cluster] Commit offsets [3, 5). Partition stream id: 1
Getting new event
2025-11-03T16:51:14.968595Z :DEBUG: Take Data. Partition 1. Read: {0, 0} (5-5)
2025-11-03T16:51:14.968615Z :DEBUG: Take Data. Partition 1. Read: {0, 1} (6-6)
2025-11-03T16:51:14.968634Z :DEBUG: [db] [sessionid] [cluster] The application data is transferred to the client. Number of messages 2, size 22 bytes
DataReceived { PartitionStreamId: 1 PartitionId: 1 Message { Data: ..11 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 5 SeqNo: 46 MessageGroupId: "src_id" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:02:03.000000Z Ip: "127.0.0.1" UncompressedSize: 0 Meta: { "k1": "v1", "k": "v" } } } Message { Data: ..11 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 6 SeqNo: 47 MessageGroupId: "src_id" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:02:03.000000Z Ip: "127.0.0.1" UncompressedSize: 0 Meta: { "k1": "v1", "k": "v" } } } }
2025-11-03T16:51:14.968716Z :DEBUG: [db] [sessionid] [cluster] Commit offsets [5, 7). Partition stream id: 1
Getting new event
2025-11-03T16:51:14.968761Z :DEBUG: Take Data. Partition 1. Read: {0, 2} (7-7)
2025-11-03T16:51:14.968786Z :DEBUG: Take Data. Partition 1. Read: {1, 0} (8-8)
2025-11-03T16:51:14.968815Z :DEBUG: [db] [sessionid] [cluster] The application data is transferred to the client. Number of messages 2, size 22 bytes
DataReceived { PartitionStreamId: 1 PartitionId: 1 Message { Data: ..11 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 7 SeqNo: 48 MessageGroupId: "src_id" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:02:03.000000Z Ip: "127.0.0.1" UncompressedSize: 0 Meta: { "k1": "v1", "k": "v" } } } Message { Data: ..11 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 8 SeqNo: 49 MessageGroupId: "src_id_2" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:05:21.000000Z Ip: "1.0.0.127" UncompressedSize: 0 Meta: { "v1": "k1", "v": "k" } } } }
2025-11-03T16:51:14.968913Z :DEBUG: [db] [sessionid] [cluster] Commit offsets [7, 9). Partition stream id: 1
2025-11-03T16:51:14.980124Z :DEBUG: [db] [sessionid] [cluster] In Reconnect, ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:51:14.984074Z :DEBUG: [db] [sessionid] [cluster] New values: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:51:14.984101Z :DEBUG: [db] [sessionid] [cluster] Reconnecting session to cluster cluster in 0.000000s
2025-11-03T16:51:14.984571Z :DEBUG: [db] [sessionid] [cluster] Successfully connected. Initializing session
2025-11-03T16:51:14.985507Z :INFO: [db] [sessionid] [cluster] Server session id: 123-session-id-321
2025-11-03T16:51:14.985710Z :DEBUG: [db] [sessionid] [cluster] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:51:14.988164Z :INFO: [db] [sessionid] [cluster] Confirm partition stream create. Partition stream id: 1. Cluster: "TestCluster". Topic: "TestTopic". Partition: 1. Read offset: (NULL)
Message data size: 10
Compressed message data size: 30
2025-11-03T16:51:14.989151Z :DEBUG: [db] [sessionid] [cluster] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
Post function
2025-11-03T16:51:14.989376Z :DEBUG: [db] [sessionid] [cluster] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
Post function
Getting new event
2025-11-03T16:51:14.989655Z :DEBUG: Decompression task done. Partition/PartitionSessionId: 1 (5-8)
2025-11-03T16:51:14.989856Z :DEBUG: Decompression task done. Partition/PartitionSessionId: 1 (1-4)
2025-11-03T16:51:14.989956Z :DEBUG: Take Data. Partition 1. Read: {0, 0} (1-1)
2025-11-03T16:51:14.989983Z :DEBUG: Take Data. Partition 1. Read: {0, 1} (2-2)
2025-11-03T16:51:14.990007Z :DEBUG: Take Data. Partition 1. Read: {0, 2} (3-3)
2025-11-03T16:51:14.990035Z :DEBUG: Take Data. Partition 1. Read: {1, 0} (4-4)
2025-11-03T16:51:14.990069Z :DEBUG: [db] [sessionid] [cluster] The application data is transferred to the client. Number of messages 4, size 40 bytes
DataReceived { PartitionStreamId: 1 PartitionId: 1 Message { Data: ..10 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 1 SeqNo: 42 MessageGroupId: "src_id" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:02:03.000000Z Ip: "127.0.0.1" UncompressedSize: 0 Meta: { "k1": "v1", "k": "v" } } } Message { Data: ..10 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 2 SeqNo: 43 MessageGroupId: "src_id" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:02:03.000000Z Ip: "127.0.0.1" UncompressedSize: 0 Meta: { "k1": "v1", "k": "v" } } } Message { Data: ..10 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 3 SeqNo: 44 MessageGroupId: "src_id" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:02:03.000000Z Ip: "127.0.0.1" UncompressedSize: 0 Meta: { "k1": "v1", "k": "v" } } } Message { Data: ..10 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 4 SeqNo: 45 MessageGroupId: "src_id_2" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:05:21.000000Z Ip: "1.0.0.127" UncompressedSize: 0 Meta: { "v1": "k1", "v": "k" } } } }
2025-11-03T16:51:14.990270Z :DEBUG: [db] [sessionid] [cluster] Commit offsets [1, 5). Partition stream id: 1
Getting new event
2025-11-03T16:51:14.990351Z :DEBUG: Take Data. Partition 1. Read: {0, 0} (5-5)
2025-11-03T16:51:14.990372Z :DEBUG: Take Data. Partition 1. Read: {0, 1} (6-6)
2025-11-03T16:51:14.990389Z :DEBUG: Take Data. Partition 1. Read: {0, 2} (7-7)
2025-11-03T16:51:14.990406Z :DEBUG: Take Data. Partition 1. Read: {1, 0} (8-8)
2025-11-03T16:51:14.990427Z :DEBUG: [db] [sessionid] [cluster] The application data is transferred to the client. Number of messages 4, size 40 bytes
DataReceived { PartitionStreamId: 1 PartitionId: 1 Message { Data: ..10 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 5 SeqNo: 46 MessageGroupId: "src_id" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:02:03.000000Z Ip: "127.0.0.1" UncompressedSize: 0 Meta: { "k1": "v1", "k": "v" } } } Message { Data: ..10 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 6 SeqNo: 47 MessageGroupId: "src_id" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:02:03.000000Z Ip: "127.0.0.1" UncompressedSize: 0 Meta: { "k1": "v1", "k": "v" } } } Message { Data: ..10 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 7 SeqNo: 48 MessageGroupId: "src_id" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:02:03.000000Z Ip: "127.0.0.1" UncompressedSize: 0 Meta: { "k1": "v1", "k": "v" } } } Message { Data: ..10 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 8 SeqNo: 49 MessageGroupId: "src_id_2" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:05:21.000000Z Ip: "1.0.0.127" UncompressedSize: 0 Meta: { "v1": "k1", "v": "k" } } } }
2025-11-03T16:51:14.990545Z :DEBUG: [db] [sessionid] [cluster] Commit offsets [5, 9). Partition stream id: 1
2025-11-03T16:51:14.991775Z :DEBUG: [db] [sessionid] [cluster] In Reconnect, ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:51:14.991796Z :DEBUG: [db] [sessionid] [cluster] New values: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:51:14.991826Z :DEBUG: [db] [sessionid] [cluster] Reconnecting session to cluster cluster in 0.000000s
2025-11-03T16:51:15.002587Z :DEBUG: [db] [sessionid] [cluster] Successfully connected. Initializing session
2025-11-03T16:51:15.002990Z :INFO: [db] [sessionid] [cluster] Server session id: 123-session-id-321
2025-11-03T16:51:15.003161Z :DEBUG: [db] [sessionid] [cluster] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:51:15.003892Z :INFO: [db] [sessionid] [cluster] Confirm partition stream create. Partition stream id: 1. Cluster: "TestCluster". Topic: "TestTopic". Partition: 1. Read offset: (NULL)
2025-11-03T16:51:15.004912Z :DEBUG: [db] [sessionid] [cluster] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
Post function
2025-11-03T16:51:15.005620Z :DEBUG: [db] [sessionid] [cluster] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
Post function
2025-11-03T16:51:15.005992Z :DEBUG: Decompression task done. Partition/PartitionSessionId: 1 (10-11)
2025-11-03T16:51:15.006099Z :DEBUG: Decompression task done. Partition/PartitionSessionId: 1 (1-2)
2025-11-03T16:51:15.010171Z :DEBUG: Take Data. Partition 1. Read: {0, 0} (1-1)
2025-11-03T16:51:15.010209Z :DEBUG: Take Data. Partition 1. Read: {0, 1} (2-2)
2025-11-03T16:51:15.010231Z :DEBUG: Take Data. Partition 1. Read: {0, 0} (10-10)
2025-11-03T16:51:15.010249Z :DEBUG: Take Data. Partition 1. Read: {0, 1} (11-11)
2025-11-03T16:51:15.010286Z :DEBUG: [db] [sessionid] [cluster] The application data is transferred to the client. Number of messages 2, size 16 bytes
2025-11-03T16:51:15.010320Z :DEBUG: [db] [sessionid] [cluster] The application data is transferred to the client. Number of messages 2, size 16 bytes
got data event: DataReceived { PartitionStreamId: 1 PartitionId: 1 Message { Data: ..8 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 1 SeqNo: 1 MessageGroupId: "src_id" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:00:00.042000Z Ip: "::1" UncompressedSize: 0 Meta: { } } } Message { Data: ..8 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 2 SeqNo: 1 MessageGroupId: "src_id" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:00:00.042000Z Ip: "::1" UncompressedSize: 0 Meta: { } } } Message { Data: ..8 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 10 SeqNo: 1 MessageGroupId: "src_id" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:00:00.042000Z Ip: "::1" UncompressedSize: 0 Meta: { } } } Message { Data: ..8 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 11 SeqNo: 1 MessageGroupId: "src_id" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:00:00.042000Z Ip: "::1" UncompressedSize: 0 Meta: { } } } }
2025-11-03T16:51:15.010488Z :DEBUG: [db] [sessionid] [cluster] Commit offsets [1, 3). Partition stream id: 1
Got commit req { cookies { assign_id: 1 partition_cookie: 1 } }
2025-11-03T16:51:15.010601Z :DEBUG: [db] [sessionid] [cluster] Commit offsets [10, 12). Partition stream id: 1
Got commit req { cookies { assign_id: 1 partition_cookie: 2 } }
2025-11-03T16:51:11.535526Z :DEBUG: [db] [sessionid] [cluster] In Reconnect, ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:51:11.535581Z :DEBUG: [db] [sessionid] [cluster] New values: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:51:11.535625Z :DEBUG: [db] [sessionid] [cluster] Reconnecting session to cluster cluster in 0.000000s
2025-11-03T16:51:11.536195Z :DEBUG: [db] [sessionid] [cluster] Successfully connected. Initializing session
2025-11-03T16:51:11.538082Z :INFO: [db] [sessionid] [cluster] Server session id: 123-session-id-321
2025-11-03T16:51:11.549935Z :DEBUG: [db] [sessionid] [cluster] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:51:11.550273Z :INFO: [db] [sessionid] [cluster] Confirm partition stream create. Partition stream id: 1. Cluster: "TestCluster". Topic: "TestTopic". Partition: 1. Read offset: (NULL)
2025-11-03T16:51:11.551199Z :DEBUG: [db] [sessionid] [cluster] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
Post function
2025-11-03T16:51:11.551661Z :DEBUG: [db] [sessionid] [cluster] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
Post function
2025-11-03T16:51:11.552090Z :DEBUG: Decompression task done. Partition/PartitionSessionId: 1 (2-2)
2025-11-03T16:51:11.552224Z :DEBUG: Decompression task done. Partition/PartitionSessionId: 1 (1-1)
2025-11-03T16:51:11.553437Z :DEBUG: Take Data. Partition 1. Read: {0, 0} (1-1)
2025-11-03T16:51:11.553493Z :DEBUG: Take Data. Partition 1. Read: {0, 0} (2-2)
2025-11-03T16:51:11.553543Z :DEBUG: [db] [sessionid] [cluster] The application data is transferred to the client. Number of messages 1, size 8 bytes
2025-11-03T16:51:11.553578Z :DEBUG: [db] [sessionid] [cluster] The application data is transferred to the client. Number of messages 1, size 8 bytes
2025-11-03T16:51:11.555837Z :DEBUG: [db] [sessionid] [cluster] In Reconnect, ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:51:11.555874Z :DEBUG: [db] [sessionid] [cluster] New values: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:51:11.555926Z :DEBUG: [db] [sessionid] [cluster] Reconnecting session to cluster cluster in 0.000000s
2025-11-03T16:51:11.572168Z :DEBUG: [db] [sessionid] [cluster] Successfully connected. Initializing session
2025-11-03T16:51:11.572642Z :INFO: [db] [sessionid] [cluster] Server session id: 123-session-id-321
2025-11-03T16:51:11.588408Z :DEBUG: [db] [sessionid] [cluster] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:51:11.592239Z :INFO: [db] [sessionid] [cluster] Confirm partition stream create. Partition stream id: 1. Cluster: "TestCluster". Topic: "TestTopic". Partition: 1. Read offset: (NULL)
Message data size: 10
Compressed message data size: 30
2025-11-03T16:51:11.593387Z :DEBUG: [db] [sessionid] [cluster] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
Post function
2025-11-03T16:51:11.593616Z :DEBUG: [db] [sessionid] [cluster] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
Post function
Getting new event
2025-11-03T16:51:11.593974Z :DEBUG: Decompression task done. Partition/PartitionSessionId: 1 (5-8)
2025-11-03T16:51:11.594201Z :DEBUG: Decompression task done. Partition/PartitionSessionId: 1 (1-4)
2025-11-03T16:51:11.597752Z :DEBUG: Take Data. Partition 1. Read: {0, 0} (1-1)
2025-11-03T16:51:11.597825Z :DEBUG: Take Data. Partition 1. Read: {0, 1} (2-2)
2025-11-03T16:51:11.597870Z :DEBUG: [db] [sessionid] [cluster] The application data is transferred to the client. Number of messages 2, size 20 bytes
DataReceived { PartitionStreamId: 1 PartitionId: 1 Message { Data: ..10 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 1 SeqNo: 42 MessageGroupId: "src_id" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:02:03.000000Z Ip: "127.0.0.1" UncompressedSize: 0 Meta: { "k1": "v1", "k": "v" } } } Message { Data: ..10 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 2 SeqNo: 43 MessageGroupId: "src_id" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:02:03.000000Z Ip: "127.0.0.1" UncompressedSize: 0 Meta: { "k1": "v1", "k": "v" } } } }
2025-11-03T16:51:11.598047Z :DEBUG: [db] [sessionid] [cluster] Commit offsets [1, 3). Partition stream id: 1
Getting new event
2025-11-03T16:51:11.598096Z :DEBUG: Take Data. Partition 1. Read: {0, 2} (3-3)
2025-11-03T16:51:11.598122Z :DEBUG: Take Data. Partition 1. Read: {1, 0} (4-4)
2025-11-03T16:51:11.598144Z :DEBUG: [db] [sessionid] [cluster] The application data is transferred to the client. Number of messages 2, size 20 bytes
DataReceived { PartitionStreamId: 1 PartitionId: 1 Message { Data: ..10 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 3 SeqNo: 44 MessageGroupId: "src_id" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:02:03.000000Z Ip: "127.0.0.1" UncompressedSize: 0 Meta: { "k1": "v1", "k": "v" } } } Message { Data: ..10 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 4 SeqNo: 45 MessageGroupId: "src_id_2" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:05:21.000000Z Ip: "1.0.0.127" UncompressedSize: 0 Meta: { "v1": "k1", "v": "k" } } } }
2025-11-03T16:51:11.598309Z :DEBUG: [db] [sessionid] [cluster] Commit offsets [3, 5). Partition stream id: 1
Getting new event
2025-11-03T16:51:11.598420Z :DEBUG: Take Data. Partition 1. Read: {0, 0} (5-5)
2025-11-03T16:51:11.598442Z :DEBUG: Take Data. Partition 1. Read: {0, 1} (6-6)
2025-11-03T16:51:11.598471Z :DEBUG: [db] [sessionid] [cluster] The application data is transferred to the client. Number of messages 2, size 20 bytes
DataReceived { PartitionStreamId: 1 PartitionId: 1 Message { Data: ..10 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 5 SeqNo: 46 MessageGroupId: "src_id" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:02:03.000000Z Ip: "127.0.0.1" UncompressedSize: 0 Meta: { "k1": "v1", "k": "v" } } } Message { Data: ..10 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 6 SeqNo: 47 MessageGroupId: "src_id" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:02:03.000000Z Ip: "127.0.0.1" UncompressedSize: 0 Meta: { "k1": "v1", "k": "v" } } } }
2025-11-03T16:51:11.598580Z :DEBUG: [db] [sessionid] [cluster] Commit offsets [5, 7). Partition stream id: 1
Getting new event
2025-11-03T16:51:11.598617Z :DEBUG: Take Data. Partition 1. Read: {0, 2} (7-7)
2025-11-03T16:51:11.598640Z :DEBUG: Take Data. Partition 1. Read: {1, 0} (8-8)
2025-11-03T16:51:11.598668Z :DEBUG: [db] [sessionid] [cluster] The application data is transferred to the client. Number of messages 2, size 20 bytes
DataReceived { PartitionStreamId: 1 PartitionId: 1 Message { Data: ..10 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 7 SeqNo: 48 MessageGroupId: "src_id" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:02:03.000000Z Ip: "127.0.0.1" UncompressedSize: 0 Meta: { "k1": "v1", "k": "v" } } } Message { Data: ..10 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 8 SeqNo: 49 MessageGroupId: "src_id_2" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:05:21.000000Z Ip: "1.0.0.127" UncompressedSize: 0 Meta: { "v1": "k1", "v": "k" } } } }
2025-11-03T16:51:11.598818Z :DEBUG: [db] [sessionid] [cluster] Commit offsets [7, 9). Partition stream id: 1
2025-11-03T16:51:11.606615Z :DEBUG: [db] [sessionid] [cluster] In Reconnect, ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:51:11.606700Z :DEBUG: [db] [sessionid] [cluster] New values: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:51:11.606730Z :DEBUG: [db] [sessionid] [cluster] Reconnecting session to cluster cluster in 0.000000s
2025-11-03T16:51:11.607080Z :DEBUG: [db] [sessionid] [cluster] Successfully connected. Initializing session
2025-11-03T16:51:11.607598Z :INFO: [db] [sessionid] [cluster] Server session id: 123-session-id-321
2025-11-03T16:51:11.607804Z :DEBUG: [db] [sessionid] [cluster] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:51:11.608027Z :INFO: [db] [sessionid] [cluster] Confirm partition stream create. Partition stream id: 1. Cluster: "TestCluster". Topic: "TestTopic". Partition: 1. Read offset: (NULL)
Message data size: 100
Compressed message data size: 91
2025-11-03T16:51:11.609094Z :DEBUG: [db] [sessionid] [cluster] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
Post function
2025-11-03T16:51:11.609313Z :DEBUG: [db] [sessionid] [cluster] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
Post function
Getting new event
2025-11-03T16:51:11.609667Z :DEBUG: Decompression task done. Partition/PartitionSessionId: 1 (5-8)
2025-11-03T16:51:11.609911Z :DEBUG: Decompression task done. Partition/PartitionSessionId: 1 (1-4)
2025-11-03T16:51:11.610029Z :DEBUG: Take Data. Partition 1. Read: {0, 0} (1-1)
2025-11-03T16:51:11.610073Z :DEBUG: [db] [sessionid] [cluster] The application data is transferred to the client. Number of messages 1, size 100 bytes
DataReceived { PartitionStreamId: 1 PartitionId: 1 Message { Data: ..100 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 1 SeqNo: 42 MessageGroupId: "src_id" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:02:03.000000Z Ip: "127.0.0.1" UncompressedSize: 0 Meta: { "k1": "v1", "k": "v" } } } }
2025-11-03T16:51:11.610201Z :DEBUG: [db] [sessionid] [cluster] Commit offsets [1, 2). Partition stream id: 1
Getting new event
2025-11-03T16:51:11.610263Z :DEBUG: Take Data. Partition 1. Read: {0, 1} (2-2)
2025-11-03T16:51:11.610292Z :DEBUG: [db] [sessionid] [cluster] The application data is transferred to the client. Number of messages 1, size 100 bytes
DataReceived { PartitionStreamId: 1 PartitionId: 1 Message { Data: ..100 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 2 SeqNo: 43 MessageGroupId: "src_id" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:02:03.000000Z Ip: "127.0.0.1" UncompressedSize: 0 Meta: { "k1": "v1", "k": "v" } } } }
2025-11-03T16:51:11.610360Z :DEBUG: [db] [sessionid] [cluster] Commit offsets [2, 3). Partition stream id: 1
Getting new event
2025-11-03T16:51:11.610388Z :DEBUG: Take Data. Partition 1. Read: {0, 2} (3-3)
2025-11-03T16:51:11.610407Z :DEBUG: [db] [sessionid] [cluster] The application data is transferred to the client. Number of messages 1, size 100 bytes
DataReceived { PartitionStreamId: 1 PartitionId: 1 Message { Data: ..100 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 3 SeqNo: 44 MessageGroupId: "src_id" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:02:03.000000Z Ip: "127.0.0.1" UncompressedSize: 0 Meta: { "k1": "v1", "k": "v" } } } }
2025-11-03T16:51:11.610455Z :DEBUG: [db] [sessionid] [cluster] Commit offsets [3, 4). Partition stream id: 1
Getting new event
2025-11-03T16:51:11.610489Z :DEBUG: Take Data. Partition 1. Read: {1, 0} (4-4)
2025-11-03T16:51:11.610507Z :DEBUG: [db] [sessionid] [cluster] The application data is transferred to the client. Number of messages 1, size 100 bytes
DataReceived { PartitionStreamId: 1 PartitionId: 1 Message { Data: ..100 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 4 SeqNo: 45 MessageGroupId: "src_id_2" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:05:21.000000Z Ip: "1.0.0.127" UncompressedSize: 0 Meta: { "v1": "k1", "v": "k" } } } }
2025-11-03T16:51:11.610623Z :DEBUG: [db] [sessionid] [cluster] Commit offsets [4, 5). Partition stream id: 1
Getting new event
2025-11-03T16:51:11.610701Z :DEBUG: Take Data. Partition 1. Read: {0, 0} (5-5)
2025-11-03T16:51:11.610726Z :DEBUG: [db] [sessionid] [cluster] The application data is transferred to the client. Number of messages 1, size 100 bytes
DataReceived { PartitionStreamId: 1 PartitionId: 1 Message { Data: ..100 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 5 SeqNo: 46 MessageGroupId: "src_id" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:02:03.000000Z Ip: "127.0.0.1" UncompressedSize: 0 Meta: { "k1": "v1", "k": "v" } } } }
2025-11-03T16:51:11.610779Z :DEBUG: [db] [sessionid] [cluster] Commit offsets [5, 6). Partition stream id: 1
Getting new event
2025-11-03T16:51:11.610822Z :DEBUG: Take Data. Partition 1. Read: {0, 1} (6-6)
2025-11-03T16:51:11.610853Z :DEBUG: [db] [sessionid] [cluster] The application data is transferred to the client. Number of messages 1, size 100 bytes
DataReceived { PartitionStreamId: 1 PartitionId: 1 Message { Data: ..100 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 6 SeqNo: 47 MessageGroupId: "src_id" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:02:03.000000Z Ip: "127.0.0.1" UncompressedSize: 0 Meta: { "k1": "v1", "k": "v" } } } }
2025-11-03T16:51:11.610932Z :DEBUG: [db] [sessionid] [cluster] Commit offsets [6, 7). Partition stream id: 1
Getting new event
2025-11-03T16:51:11.610959Z :DEBUG: Take Data. Partition 1. Read: {0, 2} (7-7)
2025-11-03T16:51:11.610979Z :DEBUG: [db] [sessionid] [cluster] The application data is transferred to the client. Number of messages 1, size 100 bytes
DataReceived { PartitionStreamId: 1 PartitionId: 1 Message { Data: ..100 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 7 SeqNo: 48 MessageGroupId: "src_id" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:02:03.000000Z Ip: "127.0.0.1" UncompressedSize: 0 Meta: { "k1": "v1", "k": "v" } } } }
2025-11-03T16:51:11.611033Z :DEBUG: [db] [sessionid] [cluster] Commit offsets [7, 8). Partition stream id: 1
Getting new event
2025-11-03T16:51:11.611059Z :DEBUG: Take Data. Partition 1. Read: {1, 0} (8-8)
2025-11-03T16:51:11.611081Z :DEBUG: [db] [sessionid] [cluster] The application data is transferred to the client. Number of messages 1, size 100 bytes
DataReceived { PartitionStreamId: 1 PartitionId: 1 Message { Data: ..100 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 8 SeqNo: 49 MessageGroupId: "src_id_2" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:05:21.000000Z Ip: "1.0.0.127" UncompressedSize: 0 Meta: { "v1": "k1", "v": "k" } } } }
2025-11-03T16:51:11.611163Z :DEBUG: [db] [sessionid] [cluster] Commit offsets [8, 9). Partition stream id: 1
2025-11-03T16:51:11.612665Z :DEBUG: [db] [sessionid] [cluster] In Reconnect, ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:51:11.612710Z :DEBUG: [db] [sessionid] [cluster] New values: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:51:11.612734Z :DEBUG: [db] [sessionid] [cluster] Reconnecting session to cluster cluster in 0.000000s
2025-11-03T16:51:11.613203Z :DEBUG: [db] [sessionid] [cluster] Successfully connected. Initializing session
2025-11-03T16:51:11.613678Z :INFO: [db] [sessionid] [cluster] Server session id: 123-session-id-321
2025-11-03T16:51:11.613837Z :DEBUG: [db] [sessionid] [cluster] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:51:11.614180Z :INFO: [db] [sessionid] [cluster] Confirm partition stream create. Partition stream id: 1. Cluster: "TestCluster". Topic: "TestTopic". Partition: 1. Read offset: (NULL)
Message data size: 1000000
Compressed message data size: 3028
2025-11-03T16:51:11.648769Z :DEBUG: [db] [sessionid] [cluster] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
Post function
Post function
Getting new event
2025-11-03T16:51:11.891833Z :DEBUG: Decompression task done. Partition/PartitionSessionId: 1 (175-200)
2025-11-03T16:51:13.322555Z :DEBUG: Decompression task done. Partition/PartitionSessionId: 1 (1-174)
2025-11-03T16:51:13.324182Z :DEBUG: Take Data. Partition 1. Read: {0, 0} (1-1)
2025-11-03T16:51:13.326371Z :DEBUG: Take Data. Partition 1. Read: {0, 1} (2-2)
2025-11-03T16:51:13.329346Z :DEBUG: Take Data. Partition 1. Read: {0, 2} (3-3)
2025-11-03T16:51:13.330310Z :DEBUG: Take Data. Partition 1. Read: {0, 3} (4-4)
2025-11-03T16:51:13.336734Z :DEBUG: Take Data. Partition 1. Read: {0, 4} (5-5)
2025-11-03T16:51:13.337658Z :DEBUG: Take Data. Partition 1. Read: {0, 5} (6-6)
2025-11-03T16:51:13.338594Z :DEBUG: Take Data. Partition 1. Read: {0, 6} (7-7)
2025-11-03T16:51:13.339505Z :DEBUG: Take Data. Partition 1. Read: {0, 7} (8-8)
2025-11-03T16:51:13.348824Z :DEBUG: Take Data. Partition 1. Read: {0, 8} (9-9)
2025-11-03T16:51:13.349718Z :DEBUG: Take Data. Partition 1. Read: {0, 9} (10-10)
2025-11-03T16:51:13.350574Z :DEBUG: Take Data. Partition 1. Read: {0, 10} (11-11)
2025-11-03T16:51:13.351281Z :DEBUG: Take Data. Partition 1. Read: {0, 11} (12-12)
2025-11-03T16:51:13.352003Z :DEBUG: Take Data. Partition 1. Read: {0, 12} (13-13)
2025-11-03T16:51:13.352875Z :DEBUG: Take Data. Partition 1. Read: {0, 13} (14-14)
2025-11-03T16:51:13.354248Z :DEBUG: Take Data. Partition 1. Read: {0, 14} (15-15)
2025-11-03T16:51:13.355264Z :DEBUG: Take Data. Partition 1. Read: {0, 15} (16-16)
2025-11-03T16:51:13.376275Z :DEBUG: Take Data. Partition 1. Read: {0, 16} (17-17)
2025-11-03T16:51:13.377216Z :DEBUG: Take Data. Partition 1. Read: {0, 17} (18-18)
2025-11-03T16:51:13.378149Z :DEBUG: Take Data. Partition 1. Read: {0, 18} (19-19)
2025-11-03T16:51:13.379033Z :DEBUG: Take Data. Partition 1. Read: {0, 19} (20-20)
2025-11-03T16:51:13.379922Z :DEBUG: Take Data. Partition 1. Read: {0, 20} (21-21)
2025-11-03T16:51:13.380861Z :DEBUG: Take Data. Partition 1. Read: {0, 21} (22-22)
2025-11-03T16:51:13.381766Z :DEBUG: Take Data. Partition 1. Read: {0, 22} (23-23)
2025-11-03T16:51:13.382819Z :DEBUG: Take Data. Partition 1. Read: {0, 23} (24-24)
2025-11-03T16:51:13.383943Z :DEBUG: Take Data. Partition 1. Read: {0, 24} (25-25)
2025-11-03T16:51:13.384859Z :DEBUG: Take Data. Partition 1. Read: {0, 25} (26-26)
2025-11-03T16:51:13.385756Z :DEBUG: Take Data. Partition 1. Read: {0, 26} (27-27)
2025-11-03T16:51:13.386768Z :DEBUG: Take Data. Partition 1. Read: {0, 27} (28-28)
2025-11-03T16:51:13.387706Z :DEBUG: Take Data. Partition 1. Read: {0, 28} (29-29)
2025-11-03T16:51:13.390088Z :DEBUG: Take Data. Partition 1. Read: {0, 29} (30-30)
2025-11-03T16:51:13.390748Z :DEBUG: Take Data. Partition 1. Read: {0, 30} (31-31)
2025-11-03T16:51:13.391418Z :DEBUG: Take Data. Partition 1. Read: {0, 31} (32-32)
2025-11-03T16:51:13.429369Z :DEBUG: Take Data. Partition 1. Read: {0, 32} (33-33)
2025-11-03T16:51:13.430066Z :DEBUG: Take Data. Partition 1. Read: {0, 33} (34-34)
2025-11-03T16:51:13.430864Z :DEBUG: Take Data. Partition 1. Read: {0, 34} (35-35)
2025-11-03T16:51:13.431649Z :DEBUG: Take Data. Partition 1. Read: {0, 35} (36-36)
2025-11-03T16:51:13.432446Z :DEBUG: Take Data. Partition 1. Read: {0, 36} (37-37)
2025-11-03T16:51:13.433324Z :DEBUG: Take Data. Partition 1. Read: {0, 37} (38-38)
2025-11-03T16:51:13.434255Z :DEBUG: Take Data. Partition 1. Read: {0, 38} (39-39)
2025-11-03T16:51:13.435345Z :DEBUG: Take Data. Partition 1. Read: {0, 39} (40-40)
2025-11-03T16:51:13.436224Z :DEBUG: Take Data. Partition 1. Read: {0, 40} (41-41)
2025-11-03T16:51:13.436968Z :DEBUG: Take Data. Partition 1. Read: {0, 41} (42-42)
2025-11-03T16:51:13.437681Z :DEBUG: Take Data. Partition 1. Read: {0, 42} (43-43)
2025-11-03T16:51:13.438356Z :DEBUG: Take Data. Partition 1. Read: {0, 43} (44-44)
2025-11-03T16:51:13.439242Z :DEBUG: Take Data. Partition 1. Read: {0, 44} (45-45)
2025-11-03T16:51:13.440088Z :DEBUG: Take Data. Partition 1. Read: {0, 45} (46-46)
2025-11-03T16:51:13.441000Z :DEBUG: Take Data. Partition 1. Read: {0, 46} (47-47)
2025-11-03T16:51:13.442045Z :DEBUG: Take Data. Partition 1. Read: {0, 47} (48-48)
2025-11-03T16:51:13.443129Z :DEBUG: Take Data. Partition 1. Read: {0, 48} (49-49)
2025-11-03T16:51:13.444182Z :DEBUG: Take Data. Partition 1. Read: {0, 49} (50-50)
2025-11-03T16:51:13.445209Z :DEBUG: Take Data. Partition 1. Read: {0, 50} (51-51)
2025-11-03T16:51:13.446089Z :DEBUG: Take Data. Partition 1. Read: {0, 51} (52-52)
2025-11-03T16:51:13.447011Z :DEBUG: Take Data. Partition 1. Read: {0, 52} (53-53)
2025-11-03T16:51:13.447888Z :DEBUG: Take Data. Partition 1. Read: {0, 53} (54-54)
2025-11-03T16:51:13.448778Z :DEBUG: Take Data. Partition 1. Read: {0, 54} (55-55)
2025-11-03T16:51:13.449641Z :DEBUG: Take Data. Partition 1. Read: {0, 55} (56-56)
2025-11-03T16:51:13.451006Z :DEBUG: Take Data. Partition 1. Read: {0, 56} (57-57)
2025-11-03T16:51:13.451868Z :DEBUG: Take Data. Partition 1. Read: {0, 57} (58-58)
2025-11-03T16:51:13.452730Z :DEBUG: Take Data. Partition 1. Read: {0, 58} (59-59)
2025-11-03T16:51:13.453544Z :DEBUG: Take Data. Partition 1. Read: {0, 59} (60-60)
2025-11-03T16:51:13.454358Z :DEBUG: Take Data. Partition 1. Read: {0, 60} (61-61)
2025-11-03T16:51:13.455231Z :DEBUG: Take Data. Partition 1. Read: {0, 61} (62-62)
2025-11-03T16:51:13.456095Z :DEBUG: Take Data. Partition 1. Read: {0, 62} (63-63)
2025-11-03T16:51:13.456964Z :DEBUG: Take Data. Partition 1. Read: {0, 63} (64-64)
2025-11-03T16:51:13.532312Z :DEBUG: Take Data. Partition 1. Read: {0, 64} (65-65)
2025-11-03T16:51:13.533264Z :DEBUG: Take Data. Partition 1. Read: {0, 65} (66-66)
2025-11-03T16:51:13.534165Z :DEBUG: Take Data. Partition 1. Read: {0, 66} (67-67)
2025-11-03T16:51:13.535087Z :DEBUG: Take Data. Partition 1. Read: {0, 67} (68-68)
2025-11-03T16:51:13.536198Z :DEBUG: Take Data. Partition 1. Read: {0, 68} (69-69)
2025-11-03T16:51:13.537116Z :DEBUG: Take Data. Partition 1. Read: {0, 69} (70-70)
2025-11-03T16:51:13.538041Z :DEBUG: Take Data. Partition 1. Read: {0, 70} (71-71)
2025-11-03T16:51:13.538980Z :DEBUG: Take Data. Partition 1. Read: {0, 71} (72-72)
2025-11-03T16:51:13.539822Z :DEBUG: Take Data. Partition 1. Read: {0, 72} (73-73)
2025-11-03T16:51:13.540685Z :DEBUG: Take Data. Partition 1. Read: {0, 73} (74-74)
2025-11-03T16:51:13.541525Z :DEBUG: Take Data. Partition 1. Read: {0, 74} (75-75)
2025-11-03T16:51:13.542419Z :DEBUG: Take Data. Partition 1. Read: {0, 75} (76-76)
2025-11-03T16:51:13.543262Z :DEBUG: Take Data. Partition 1. Read: {0, 76} (77-77)
2025-11-03T16:51:13.544101Z :DEBUG: Take Data. Partition 1. Read: {0, 77} (78-78)
2025-11-03T16:51:13.544940Z :DEBUG: Take Data. Partition 1. Read: {0, 78} (79-79)
2025-11-03T16:51:13.545736Z :DEBUG: Take Data. Partition 1. Read: {0, 79} (80-80)
2025-11-03T16:51:13.546539Z :DEBUG: Take Data. Partition 1. Read: {0, 80} (81-81)
2025-11-03T16:51:13.547372Z :DEBUG: Take Data. Partition 1. Read: {0, 81} (82-82)
2025-11-03T16:51:13.548221Z :DEBUG: Take Data. Partition 1. Read: {0, 82} (83-83)
2025-11-03T16:51:13.549020Z :DEBUG: Take Data. Partition 1. Read: {0, 83} (84-84)
2025-11-03T16:51:13.549832Z :DEBUG: Take Data. Partition 1. Read: {0, 84} (85-85)
2025-11-03T16:51:13.550655Z :DEBUG: Take Data. Partition 1. Read: {0, 85} (86-86)
2025-11-03T16:51:13.551532Z :DEBUG: Take Data. Partition 1. Read: {0, 86} (87-87)
2025-11-03T16:51:13.552362Z :DEBUG: Take Data. Partition 1. Read: {0, 87} (88-88)
2025-11-03T16:51:13.553142Z :DEBUG: Take Data. Partition 1. Read: {0, 88} (89-89)
2025-11-03T16:51:13.553929Z :DEBUG: Take Data. Partition 1. Read: {0, 89} (90-90)
2025-11-03T16:51:13.554684Z :DEBUG: Take Data. Partition 1. Read: {0, 90} (91-91)
2025-11-03T16:51:13.555434Z :DEBUG: Take Data. Partition 1. Read: {0, 91} (92-92)
2025-11-03T16:51:13.556139Z :DEBUG: Take Data. Partition 1. Read: {0, 92} (93-93)
2025-11-03T16:51:13.557002Z :DEBUG: Take Data. Partition 1. Read: {0, 93} (94-94)
2025-11-03T16:51:13.557928Z :DEBUG: Take Data. Partition 1. Read: {0, 94} (95-95)
2025-11-03T16:51:13.558865Z :DEBUG: Take Data. Partition 1. Read: {0, 95} (96-96)
2025-11-03T16:51:13.559768Z :DEBUG: Take Data. Partition 1. Read: {0, 96} (97-97)
2025-11-03T16:51:13.560866Z :DEBUG: Take Data. Partition 1. Read: {0, 97} (98-98)
2025-11-03T16:51:13.561554Z :DEBUG: Take Data. Partition 1. Read: {0, 98} (99-99)
2025-11-03T16:51:13.562226Z :DEBUG: Take Data. Partition 1. Read: {0, 99} (100-100)
2025-11-03T16:51:13.562888Z :DEBUG: Take Data. Partition 1. Read: {0, 100} (101-101)
2025-11-03T16:51:13.563496Z :DEBUG: Take Data. Partition 1. Read: {1, 0} (102-102)
2025-11-03T16:51:13.564098Z :DEBUG: Take Data. Partition 1. Read: {1, 1} (103-103)
2025-11-03T16:51:13.564681Z :DEBUG: Take Data. Partition 1. Read: {1, 2} (104-104)
2025-11-03T16:51:13.565318Z :DEBUG: Take Data. Partition 1. Read: {1, 3} (105-105)
2025-11-03T16:51:13.565907Z :DEBUG: Take Data. Partition 1. Read: {1, 4} (106-106)
2025-11-03T16:51:13.566492Z :DEBUG: Take Data. Partition 1. Read: {1, 5} (107-107)
2025-11-03T16:51:13.567152Z :DEBUG: Take Data. Partition 1. Read: {1, 6} (108-108)
2025-11-03T16:51:13.567942Z :DEBUG: Take Data. Partition 1. Read: {1, 7} (109-109)
2025-11-03T16:51:13.568775Z :DEBUG: Take Data. Partition 1. Read: {1, 8} (110-110)
2025-11-03T16:51:13.569600Z :DEBUG: Take Data. Partition 1. Read: {1, 9} (111-111)
2025-11-03T16:51:13.570408Z :DEBUG: Take Data. Partition 1. Read: {1, 10} (112-112)
2025-11-03T16:51:13.571261Z :DEBUG: Take Data. Partition 1. Read: {1, 11} (113-113)
2025-11-03T16:51:13.572119Z :DEBUG: Take Data. Partition 1. Read: {1, 12} (114-114)
2025-11-03T16:51:13.572851Z :DEBUG: Take Data. Partition 1. Read: {1, 13} (115-115)
2025-11-03T16:51:13.573713Z :DEBUG: Take Data. Partition 1. Read: {1, 14} (116-116)
2025-11-03T16:51:13.574517Z :DEBUG: Take Data. Partition 1. Read: {1, 15} (117-117)
2025-11-03T16:51:13.575341Z :DEBUG: Take Data. Partition 1. Read: {1, 16} (118-118)
2025-11-03T16:51:13.576175Z :DEBUG: Take Data. Partition 1. Read: {1, 17} (119-119)
2025-11-03T16:51:13.576986Z :DEBUG: Take Data. Partition 1. Read: {1, 18} (120-120)
2025-11-03T16:51:13.577741Z :DEBUG: Take Data. Partition 1. Read: {1, 19} (121-121)
2025-11-03T16:51:13.578479Z :DEBUG: Take Data. Partition 1. Read: {1, 20} (122-122)
2025-11-03T16:51:13.579256Z :DEBUG: Take Data. Partition 1. Read: {1, 21} (123-123)
2025-11-03T16:51:13.580065Z :DEBUG: Take Data. Partition 1. Read: {1, 22} (124-124)
2025-11-03T16:51:13.580800Z :DEBUG: Take Data. Partition 1. Read: {1, 23} (125-125)
2025-11-03T16:51:13.581569Z :DEBUG: Take Data. Partition 1. Read: {1, 24} (126-126)
2025-11-03T16:51:13.582345Z :DEBUG: Take Data. Partition 1. Read: {1, 25} (127-127)
2025-11-03T16:51:13.583142Z :DEBUG: Take Data. Partition 1. Read: {1, 26} (128-128)
2025-11-03T16:51:13.790029Z :DEBUG: Take Data. Partition 1. Read: {1, 27} (129-129)
2025-11-03T16:51:13.791317Z :DEBUG: Take Data. Partition 1. Read: {1, 28} (130-130)
2025-11-03T16:51:13.795080Z :DEBUG: Take Data. Partition 1. Read: {1, 29} (131-131)
2025-11-03T16:51:13.797397Z :DEBUG: Take Data. Partition 1. Read: {1, 30} (132-132)
2025-11-03T16:51:13.798464Z :DEBUG: Take Data. Partition 1. Read: {1, 31} (133-133)
2025-11-03T16:51:13.799513Z :DEBUG: Take Data. Partition 1. Read: {1, 32} (134-134)
2025-11-03T16:51:13.800593Z :DEBUG: Take Data. Partition 1. Read: {1, 33} (135-135)
2025-11-03T16:51:13.801624Z :DEBUG: Take Data. Partition 1. Read: {1, 34} (136-136)
2025-11-03T16:51:13.802737Z :DEBUG: Take Data. Partition 1. Read: {1, 35} (137-137)
2025-11-03T16:51:13.803851Z :DEBUG: Take Data. Partition 1. Read: {1, 36} (138-138)
2025-11-03T16:51:13.811444Z :DEBUG: Take Data. Partition 1. Read: {1, 37} (139-139)
2025-11-03T16:51:13.812704Z :DEBUG: Take Data. Partition 1. Read: {1, 38} (140-140)
2025-11-03T16:51:13.814058Z :DEBUG: Take Data. Partition 1. Read: {1, 39} (141-141)
2025-11-03T16:51:13.815428Z :DEBUG: Take Data. Partition 1. Read: {1, 40} (142-142)
2025-11-03T16:51:13.816949Z :DEBUG: Take Data. Partition 1. Read: {1, 41} (143-143)
2025-11-03T16:51:13.818167Z :DEBUG: Take Data. Partition 1. Read: {1, 42} (144-144)
2025-11-03T16:51:13.819377Z :DEBUG: Take Data. Partition 1. Read: {1, 43} (145-145)
2025-11-03T16:51:13.820610Z :DEBUG: Take Data. Partition 1. Read: {1, 44} (146-146)
2025-11-03T16:51:13.821836Z :DEBUG: Take Data. Partition 1. Read: {1, 45} (147-147)
2025-11-03T16:51:13.823038Z :DEBUG: Take Data. Partition 1. Read: {1, 46} (148-148)
2025-11-03T16:51:13.824256Z :DEBUG: Take Data. Partition 1. Read: {1, 47} (149-149)
2025-11-03T16:51:13.825130Z :DEBUG: Take Data. Partition 1. Read: {1, 48} (150-150)
2025-11-03T16:51:13.825941Z :DEBUG: Take Data. Partition 1. Read: {1, 49} (151-151)
2025-11-03T16:51:13.826852Z :DEBUG: Take Data. Partition 1. Read: {1, 50} (152-152)
2025-11-03T16:51:13.827645Z :DEBUG: Take Data. Partition 1. Read: {1, 51} (153-153)
2025-11-03T16:51:13.828436Z :DEBUG: Take Data. Partition 1. Read: {1, 52} (154-154)
2025-11-03T16:51:13.829207Z :DEBUG: Take Data. Partition 1. Read: {1, 53} (155-155)
2025-11-03T16:51:13.829931Z :DEBUG: Take Data. Partition 1. Read: {1, 54} (156-156)
2025-11-03T16:51:13.830721Z :DEBUG: Take Data. Partition 1. Read: {1, 55} (157-157)
2025-11-03T16:51:13.831616Z :DEBUG: Take Data. Partition 1. Read: {1, 56} (158-158)
2025-11-03T16:51:13.832595Z :DEBUG: Take Data. Partition 1. Read: {1, 57} (159-159)
2025-11-03T16:51:13.833508Z :DEBUG: Take Data. Partition 1. Read: {1, 58} (160-160)
2025-11-03T16:51:13.834386Z :DEBUG: Take Data. Partition 1. Read: {1, 59} (161-161)
2025-11-03T16:51:13.835252Z :DEBUG: Take Data. Partition 1. Read: {1, 60} (162-162)
2025-11-03T16:51:13.836189Z :DEBUG: Take Data. Partition 1. Read: {1, 61} (163-163)
2025-11-03T16:51:13.837067Z :DEBUG: Take Data. Partition 1. Read: {1, 62} (164-164)
2025-11-03T16:51:13.837938Z :DEBUG: Take Data. Partition 1. Read: {1, 63} (165-165)
2025-11-03T16:51:13.838813Z :DEBUG: Take Data. Partition 1. Read: {1, 64} (166-166)
2025-11-03T16:51:13.839674Z :DEBUG: Take Data. Partition 1. Read: {1, 65} (167-167)
2025-11-03T16:51:13.840726Z :DEBUG: Take Data. Partition 1. Read: {1, 66} (168-168)
2025-11-03T16:51:13.841602Z :DEBUG: Take Data. Partition 1. Read: {1, 67} (169-169)
2025-11-03T16:51:13.842459Z :DEBUG: Take Data. Partition 1. Read: {1, 68} (170-170)
2025-11-03T16:51:13.843318Z :DEBUG: Take Data. Partition 1. Read: {1, 69} (171-171)
2025-11-03T16:51:13.844206Z :DEBUG: Take Data. Partition 1. Read: {1, 70} (172-172)
2025-11-03T16:51:13.845210Z :DEBUG: Take Data. Partition 1. Read: {1, 71} (173-173)
2025-11-03T16:51:13.846144Z :DEBUG: Take Data. Partition 1. Read: {1, 72} (174-174)
2025-11-03T16:51:13.847117Z :DEBUG: Take Data. Partition 1. Read: {1, 73} (175-175)
2025-11-03T16:51:13.847994Z :DEBUG: Take Data. Partition 1. Read: {1, 74} (176-176)
2025-11-03T16:51:13.848858Z :DEBUG: Take Data. Partition 1. Read: {1, 75} (177-177)
2025-11-03T16:51:13.849721Z :DEBUG: Take Data. Partition 1. Read: {1, 76} (178-178)
2025-11-03T16:51:13.850555Z :DEBUG: Take Data. Partition 1. Read: {1, 77} (179-179)
2025-11-03T16:51:13.851489Z :DEBUG: Take Data. Partition 1. Read: {1, 78} (180-180)
2025-11-03T16:51:13.852478Z :DEBUG: Take Data. Partition 1. Read: {1, 79} (181-181)
2025-11-03T16:51:13.853402Z :DEBUG: Take Data. Partition 1. Read: {1, 80} (182-182)
2025-11-03T16:51:13.854401Z :DEBUG: Take Data. Partition 1. Read: {1, 81} (183-183)
2025-11-03T16:51:13.855495Z :DEBUG: Take Data. Partition 1. Read: {1, 82} (184-184)
2025-11-03T16:51:13.856644Z :DEBUG: Take Data. Partition 1. Read: {1, 83} (185-185)
2025-11-03T16:51:13.857730Z :DEBUG: Take Data. Partition 1. Read: {1, 84} (186-186)
2025-11-03T16:51:13.858725Z :DEBUG: Take Data. Partition 1. Read: {1, 85} (187-187)
2025-11-03T16:51:13.859797Z :DEBUG: Take Data. Partition 1. Read: {1, 86} (188-188)
2025-11-03T16:51:13.860904Z :DEBUG: Take Data. Partition 1. Read: {1, 87} (189-189)
2025-11-03T16:51:13.861978Z :DEBUG: Take Data. Partition 1. Read: {1, 88} (190-190)
2025-11-03T16:51:13.862988Z :DEBUG: Take Data. Partition 1. Read: {1, 89} (191-191)
2025-11-03T16:51:13.863992Z :DEBUG: Take Data. Partition 1. Read: {1, 90} (192-192)
2025-11-03T16:51:13.864952Z :DEBUG: Take Data. Partition 1. Read: {1, 91} (193-193)
2025-11-03T16:51:13.865988Z :DEBUG: Take Data. Partition 1. Read: {1, 92} (194-194)
2025-11-03T16:51:13.867087Z :DEBUG: Take Data. Partition 1. Read: {1, 93} (195-195)
2025-11-03T16:51:13.868080Z :DEBUG: Take Data. Partition 1. Read: {1, 94} (196-196)
2025-11-03T16:51:13.869074Z :DEBUG: Take Data. Partition 1. Read: {1, 95} (197-197)
2025-11-03T16:51:13.871106Z :DEBUG: Take Data. Partition 1. Read: {1, 96} (198-198)
2025-11-03T16:51:13.872102Z :DEBUG: Take Data. Partition 1. Read: {1, 97} (199-199)
2025-11-03T16:51:13.872967Z :DEBUG: Take Data. Partition 1. Read: {1, 98} (200-200)
2025-11-03T16:51:13.873093Z :DEBUG: [db] [sessionid] [cluster] The application data is transferred to the client. Number of messages 200, size 200000000 bytes
DataReceived { PartitionStreamId: 1 PartitionId: 1 Message { Data: ..1000000 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 1 SeqNo: 42 MessageGroupId: "src_id" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:02:03.000000Z Ip: "127.0.0.1" UncompressedSize: 0 Meta: { "k1": "v1", "k": "v" } } } Message { Data: ..1000000 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 2 SeqNo: 43 MessageGroupId: "src_id" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:02:03.000000Z Ip: "127.0.0.1" UncompressedSize: 0 Meta: { "k1": "v1", "k": "v" } } } Message { Data: ..1000000 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 3 SeqNo: 44 MessageGroupId: "src_id" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:02:03.000000Z Ip: "127.0.0.1" UncompressedSize: 0 Meta: { "k1": "v1", "k": "v" } } } Message { Data: ..1000000 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 4 SeqNo: 45 MessageGroupId: "src_id" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:02:03.000000Z Ip: "127.0.0.1" UncompressedSize: 0 Meta: { "k1": "v1", "k": "v" } } } Message { Data: ..1000000 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 5 SeqNo: 46 MessageGroupId: "src_id" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:02:03.000000Z Ip: "127.0.0.1" UncompressedSize: 0 Meta: { "k1": "v1", "k": "v" } } } Message { Data: ..1000000 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 6 SeqNo: 47 MessageGroupId: "src_id" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:02:03.000000Z Ip: "127.0.0.1" UncompressedSize: 0 Meta: { "k1": "v1", "k": "v" } } } Message { Data: ..1000000 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 7 SeqNo: 48 MessageGroupId: "src_id" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:02:03.000000Z Ip: "127.0.0.1" UncompressedSize: 0 Meta: { "k1": "v1", "k": "v" } } } Message { Data: ..1000000 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 8 SeqNo: 49 MessageGroupId: "src_id" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:02:03.000000Z Ip: "127.0.0.1" UncompressedSize: 0 Meta: { "k1": "v1", "k": "v" } } } Message { Data: ..1000000 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 9 SeqNo: 50 MessageGroupId: "src_id" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:02:03.000000Z Ip: "127.0.0.1" UncompressedSize: 0 Meta: { "k1": "v1", "k": "v" } } } Message { Data: ..1000000 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 10 SeqNo: 51 MessageGroupId: "src_id" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:02:03.000000Z Ip: "127.0.0.1" UncompressedSize: 0 Meta: { "k1": "v1", "k": "v" } } } Message { Data: ..1000000 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 11 SeqNo: 52 MessageGroupId: "src_id" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:02:03.000000Z Ip: "127.0.0.1" UncompressedSize: 0 Meta: { "k1": "v1", "k": "v" } } } Message { Data: ..1000000 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 12 SeqNo: 53 MessageGroupId: "src_id" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:02:03.000000Z Ip: "127.0.0.1" UncompressedSize: 0 Meta: { "k1": "v1", "k": "v" } } } Message { Data: ..1000000 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 13 SeqNo: 54 MessageGroupId: "src_id" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:02:03.000000Z Ip: "127.0.0.1" UncompressedSize: 0 Meta: { "k1": "v1", "k": "v" } } } Message { Data: ..1000000 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 14 SeqNo: 55 MessageGroupId: "src_id" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:02:03.000000Z Ip: "127.0.0.1" UncompressedSize: 0 Meta: { "k1": "v1", "k": "v" } } } Message { Data: ..1000000 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 15 SeqNo: 56 MessageGroupId: "src_id" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:02:03.000000Z Ip: "127.0.0.1" UncompressedSize: 0 Meta: { "k1": "v1", "k": "v" } } } Message { Data: ..1000000 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 16 SeqNo: 57 MessageGroupId: "src_id" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:02:03.000000Z Ip: "127.0.0.1" UncompressedSize: 0 Meta: { "k1": "v1", "k": "v" } } } Message { Data: ..1000000 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 17 SeqNo: 58 MessageGroupId: "src_id" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:02:03.000000Z Ip: "127.0.0.1" UncompressedSize: 0 Meta: { "k1": "v1", "k": "v" } } } Message { Data: ..1000000 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 18 SeqNo: 59 MessageGroupId: "src_id" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:02:03.000000Z Ip: "127.0.0.1" UncompressedSize: 0 Meta: { "k1": "v1", "k": "v" } } } Message { Data: ..1000000 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 19 SeqNo: 60 MessageGroupId: "src_id" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:02:03.000000Z Ip: "127.0.0.1" UncompressedSize: 0 Meta: { "k1": "v1", "k": "v" } } } Message { Data: ..1000000 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 20 SeqNo: 61 MessageGroupId: "src_id" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:02:03.000000Z Ip: "127.0.0.1" UncompressedSize: 0 Meta: { "k1": "v1", "k": "v" } } } Message { Data: ..1000000 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 21 SeqNo: 62 MessageGroupId: "src_id" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:02:03.000000Z Ip: "127.0.0.1" UncompressedSize: 0 Meta: { "k1": "v1", "k": "v" } } } Message { Data: ..1000000 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 22 SeqNo: 63 MessageGroupId: "src_id" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:02:03.000000Z Ip: "127.0.0.1" UncompressedSize: 0 Meta: { "k1": "v1", "k": "v" } } } Message { Data: ..1000000 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 23 SeqNo: 64 MessageGroupId: "src_id" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:02:03.000000Z Ip: "127.0.0.1" UncompressedSize: 0 Meta: { "k1": "v1", "k": "v" } } } Message { Data: ..1000000 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 24 SeqNo: 65 MessageGroupId: "src_id" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:02:03.000000Z Ip: "127.0.0.1" UncompressedSize: 0 Meta: { "k1": "v1", "k": "v" } } } Message { Data: ..1000000 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 25 SeqNo: 66 MessageGroupId: "src_id" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:02:03.000000Z Ip: "127.0.0.1" UncompressedSize: 0 Meta: { "k1": "v1", "k": "v" } } } Message { Data: ..1000000 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 26 SeqNo: 67 MessageGroupId: "src_id" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:02:03.000000Z Ip: "127.0.0.1" UncompressedSize: 0 Meta: { "k1": "v1", "k": "v" } } } Message { Data: ..1000000 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 27 SeqNo: 68 MessageGroupId: "src_id" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:02:03.000000Z Ip: "127.0.0.1" UncompressedSize: 0 Meta: { "k1": "v1", "k": "v" } } } Message { Data: ..1000000 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 28 SeqNo: 69 MessageGroupId: "src_id" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:02:03.000000Z Ip: "127.0.0.1" UncompressedSize: 0 Meta: { "k1": "v1", "k": "v" } } } Message { Data: ..1000000 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 29 SeqNo: 70 MessageGroupId: "src_id" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:02:03.000000Z Ip: "127.0.0.1" UncompressedSize: 0 Meta: { "k1": "v1", "k": "v" } } } Message { Data: ..1000000 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 30 SeqNo: 71 MessageGroupId: "src_id" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:02:03.000000Z Ip: "127.0.0.1" UncompressedSize: 0 Meta: { "k1": "v1", "k": "v" } } } Message { Data: ..1000000 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 31 SeqNo: 72 MessageGroupId: "src_id" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:02:03.000000Z Ip: "127.0.0.1" UncompressedSize: 0 Meta: { "k1": "v1", "k": "v" } } } Message { Data: ..1000000 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 32 SeqNo: 73 MessageGroupId: "src_id" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:02:03.000000Z Ip: "127.0.0.1" UncompressedSize: 0 Meta: { "k1": "v1", "k": "v" } } } Message { Data: ..1000000 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 33 SeqNo: 74 MessageGroupId: "src_id" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:02:03.000000Z Ip: "127.0.0.1" UncompressedSize: 0 Meta: { "k1": "v1", "k": "v" } } } Message { Data: ..1000000 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 34 SeqNo: 75 MessageGroupId: "src_id" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:02:03.000000Z Ip: "127.0.0.1" UncompressedSize: 0 Meta: { "k1": "v1", "k": "v" } } } Message { Data: ..1000000 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 35 SeqNo: 76 MessageGroupId: "src_id" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:02:03.000000Z Ip: "127.0.0.1" UncompressedSize: 0 Meta: { "k1": "v1", "k": "v" } } } Message { Data: ..1000000 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 36 SeqNo: 77 MessageGroupId: "src_id" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:02:03.000000Z Ip: "127.0.0.1" UncompressedSize: 0 Meta: { "k1": "v1", "k": "v" } } } Message { Data: ..1000000 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 37 SeqNo: 78 MessageGroupId: "src_id" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:02:03.000000Z Ip: "127.0.0.1" UncompressedSize: 0 Meta: { "k1": "v1", "k": "v" } } } Message { Data: ..1000000 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 38 SeqNo: 79 MessageGroupId: "src_id" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:02:03.000000Z Ip: "127.0.0.1" UncompressedSize: 0 Meta: { "k1": "v1", "k": "v" } } } Message { Data: ..1000000 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 39 SeqNo: 80 MessageGroupId: "src_id" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:02:03.000000Z Ip: "127.0.0.1" UncompressedSize: 0 Meta: { "k1": "v1", "k": "v" } } } Message { Data: ..1000000 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 40 SeqNo: 81 MessageGroupId: "src_id" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:02:03.000000Z Ip: "127.0.0.1" UncompressedSize: 0 Meta: { "k1": "v1", "k": "v" } } } Message { Data: ..1000000 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 41 SeqNo: 82 MessageGroupId: "src_id" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:02:03.000000Z Ip: "127.0.0.1" UncompressedSize: 0 Meta: { "k1": "v1", "k": "v" } } } Message { Data: ..1000000 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 42 SeqNo: 83 MessageGroupId: "src_id" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:02:03.000000Z Ip: "127.0.0.1" UncompressedSize: 0 Meta: { "k1": "v1", "k": "v" } } } Message { Data: ..1000000 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 43 SeqNo: 84 MessageGroupId: "src_id" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:02:03.000000Z Ip: "127.0.0.1" UncompressedSize: 0 Meta: { "k1": "v1", "k": "v" } } } Message { Data: ..1000000 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 44 SeqNo: 85 MessageGroupId: "src_id" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:02:03.000000Z Ip: "127.0.0.1" UncompressedSize: 0 Meta: { "k1": "v1", "k": "v" } } } Message { Data: ..1000000 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 45 SeqNo: 86 MessageGroupId: "src_id" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:02:03.000000Z Ip: "127.0.0.1" UncompressedSize: 0 Meta: { "k1": "v1", "k": "v" } } } Message { Data: ..1000000 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 46 SeqNo: 87 MessageGroupId: "src_id" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:02:03.000000Z Ip: "127.0.0.1" UncompressedSize: 0 Meta: { "k1": "v1", "k": "v" } } } Message { Data: ..1000000 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 47 SeqNo: 88 MessageGroupId: "src_id" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:02:03.000000Z Ip: "127.0.0.1" UncompressedSize: 0 Meta: { "k1": "v1", "k": "v" } } } Message { Data: ..1000000 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 48 SeqNo: 89 MessageGroupId: "src_id" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:02:03.000000Z Ip: "127.0.0.1" UncompressedSize: 0 Meta: { "k1": "v1", "k": "v" } } } Message { Data: ..1000000 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 49 SeqNo: 90 MessageGroupId: "src_id" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:02:03.000000Z Ip: "127.0.0.1" UncompressedSize: 0 Meta: { "k1": "v1", "k": "v" } } } Message { Data: ..1000000 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 50 SeqNo: 91 MessageGroupId: "src_id" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:02:03.000000Z Ip: "127.0.0.1" UncompressedSize: 0 Meta: { "k1": "v1", "k": "v" } } } Message { Data: ..1000000 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 51 SeqNo: 92 MessageGroupId: "src_id" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:02:03.000000Z Ip: "127.0.0.1" UncompressedSize: 0 Meta: { "k1": "v1", "k": "v" } } } Message { Data: ..1000000 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 52 SeqNo: 93 MessageGroupId: "src_id" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:02:03.000000Z Ip: "127.0.0.1" UncompressedSize: 0 Meta: { "k1": "v1", "k": "v" } } } Message { Data: ..1000000 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 53 SeqNo: 94 MessageGroupId: "src_id" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:02:03.000000Z Ip: "127.0.0.1" UncompressedSize: 0 Meta: { "k1": "v1", "k": "v" } } } Message { Data: ..1000000 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 54 SeqNo: 95 MessageGroupId: "src_id" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:02:03.000000Z Ip: "127.0.0.1" UncompressedSize: 0 Meta: { "k1": "v1", "k": "v" } } } Message { Data: ..1000000 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 55 SeqNo: 96 MessageGroupId: "src_id" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:02:03.000000Z Ip: "127.0.0.1" UncompressedSize: 0 Meta: { "k1": "v1", "k": "v" } } } Message { Data: ..1000000 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 56 SeqNo: 97 MessageGroupId: "src_id" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:02:03.000000Z Ip: "127.0.0.1" UncompressedSize: 0 Meta: { "k1": "v1", "k": "v" } } } Message { Data: ..1000000 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 57 SeqNo: 98 MessageGroupId: "src_id" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:02:03.000000Z Ip: "127.0.0.1" UncompressedSize: 0 Meta: { "k1": "v1", "k": "v" } } } Message { Data: ..1000000 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 58 SeqNo: 99 MessageGroupId: "src_id" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:02:03.000000Z Ip: "127.0.0.1" UncompressedSize: 0 Meta: { "k1": "v1", "k": "v" } } } Message { Data: ..1000000 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 59 SeqNo: 100 MessageGroupId: "src_id" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:02:03.000000Z Ip: "127.0.0.1" UncompressedSize: 0 Meta: { "k1": "v1", "k": "v" } } } Message { Data: ..1000000 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 60 SeqNo: 101 MessageGroupId: "src_id" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:02:03.000000Z Ip: "127.0.0.1" UncompressedSize: 0 Meta: { "k1": "v1", "k": "v" } } } Message { Data: ..1000000 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 61 SeqNo: 102 MessageGroupId: "src_id" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:02:03.000000Z Ip: "127.0.0.1" UncompressedSize: 0 Meta: { "k1": "v1", "k": "v" } } } Message { Data: ..1000000 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 62 SeqNo: 103 MessageGroupId: "src_id" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:02:03.000000Z Ip: "127.0.0.1" UncompressedSize: 0 Meta: { "k1": "v1", "k": "v" } } } Message { Data: ..1000000 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 63 SeqNo: 104 MessageGroupId: "src_id" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:02:03.000000Z Ip: "127.0.0.1" UncompressedSize: 0 Meta: { "k1": "v1", "k": "v" } } } Message { Data: ..1000000 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 64 SeqNo: 105 MessageGroupId: "src_id" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:02:03.000000Z Ip: "127.0.0.1" UncompressedSize: 0 Meta: { "k1": "v1", "k": "v" } } } Message { Data: ..1000000 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 65 SeqNo: 106 MessageGroupId: "src_id" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:02:03.000000Z Ip: "127.0.0.1" UncompressedSize: 0 Meta: { "k1": "v1", "k": "v" } } } Message { Data: ..1000000 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 66 SeqNo: 107 MessageGroupId: "src_id" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:02:03.000000Z Ip: "127.0.0.1" UncompressedSize: 0 Meta: { "k1": "v1", "k": "v" } } } Message { Data: ..1000000 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 67 SeqNo: 108 MessageGroupId: "src_id" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:02:03.000000Z Ip: "127.0.0.1" UncompressedSize: 0 Meta: { "k1": "v1", "k": "v" } } } Message { Data: ..1000000 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 68 SeqNo: 109 MessageGroupId: "src_id" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:02:03.000000Z Ip: "127.0.0.1" UncompressedSize: 0 Meta: { "k1": "v1", "k": "v" } } } Message { Data: ..1000000 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 69 SeqNo: 110 MessageGroupId: "src_id" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:02:03.000000Z Ip: "127.0.0.1" UncompressedSize: 0 Meta: { "k1": "v1", "k": "v" } } } Message { Data: ..1000000 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 70 SeqNo: 111 MessageGroupId: "src_id" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:02:03.000000Z Ip: "127.0.0.1" UncompressedSize: 0 Meta: { "k1": "v1", "k": "v" } } } Message { Data: ..1000000 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 71 SeqNo: 112 MessageGroupId: "src_id" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:02:03.000000Z Ip: "127.0.0.1" UncompressedSize: 0 Meta: { "k1": "v1", "k": "v" } } } Message { Data: ..1000000 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 72 SeqNo: 113 MessageGroupId: "src_id" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:02:03.000000Z Ip: "127.0.0.1" UncompressedSize: 0 Meta: { "k1": "v1", "k": "v" } } } Message { Data: ..1000000 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 73 SeqNo: 114 MessageGroupId: "src_id" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:02:03.000000Z Ip: "127.0.0.1" UncompressedSize: 0 Meta: { "k1": "v1", "k": "v" } } } Message { Data: ..1000000 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 74 SeqNo: 115 MessageGroupId: "src_id" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:02:03.000000Z Ip: "127.0.0.1" UncompressedSize: 0 Meta: { "k1": "v1", "k": "v" } } } Message { Data: ..1000000 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 75 SeqNo: 116 MessageGroupId: "src_id" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:02:03.000000Z Ip: "127.0.0.1" UncompressedSize: 0 Meta: { "k1": "v1", "k": "v" } } } Message { Data: ..1000000 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 76 SeqNo: 117 MessageGroupId: "src_id" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:02:03.000000Z Ip: "127.0.0.1" UncompressedSize: 0 Meta: { "k1": "v1", "k": "v" } } } Message { Data: ..1000000 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 77 SeqNo: 118 MessageGroupId: "src_id" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:02:03.000000Z Ip: "127.0.0.1" UncompressedSize: 0 Meta: { "k1": "v1", "k": "v" } } } Message { Data: ..1000000 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 78 SeqNo: 119 MessageGroupId: "src_id" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:02:03.000000Z Ip: "127.0.0.1" UncompressedSize: 0 Meta: { "k1": "v1", "k": "v" } } } Message { Data: ..1000000 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 79 SeqNo: 120 MessageGroupId: "src_id" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:02:03.000000Z Ip: "127.0.0.1" UncompressedSize: 0 Meta: { "k1": "v1", "k": "v" } } } Message { Data: ..1000000 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 80 SeqNo: 121 MessageGroupId: "src_id" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:02:03.000000Z Ip: "127.0.0.1" UncompressedSize: 0 Meta: { "k1": "v1", "k": "v" } } } Message { Data: ..1000000 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 81 SeqNo: 122 MessageGroupId: "src_id" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:02:03.000000Z Ip: "127.0.0.1" UncompressedSize: 0 Meta: { "k1": "v1", "k": "v" } } } Message { Data: ..1000000 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 82 SeqNo: 123 MessageGroupId: "src_id" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:02:03.000000Z Ip: "127.0.0.1" UncompressedSize: 0 Meta: { "k1": "v1", "k": "v" } } } Message { Data: ..1000000 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 83 SeqNo: 124 MessageGroupId: "src_id" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:02:03.000000Z Ip: "127.0.0.1" UncompressedSize: 0 Meta: { "k1": "v1", "k": "v" } } } Message { Data: ..1000000 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 84 SeqNo: 125 MessageGroupId: "src_id" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:02:03.000000Z Ip: "127.0.0.1" UncompressedSize: 0 Meta: { "k1": "v1", "k": "v" } } } Message { Data: ..1000000 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 85 SeqNo: 126 MessageGroupId: "src_id" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:02:03.000000Z Ip: "127.0.0.1" UncompressedSize: 0 Meta: { "k1": "v1", "k": "v" } } } Message { Data: ..1000000 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 86 SeqNo: 127 MessageGroupId: "src_id" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:02:03.000000Z Ip: "127.0.0.1" UncompressedSize: 0 Meta: { "k1": "v1", "k": "v" } } } Message { Data: ..1000000 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 87 SeqNo: 128 MessageGroupId: "src_id" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:02:03.000000Z Ip: "127.0.0.1" UncompressedSize: 0 Meta: { "k1": "v1", "k": "v" } } } Message { Data: ..1000000 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 88 SeqNo: 129 MessageGroupId: "src_id" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:02:03.000000Z Ip: "127.0.0.1" UncompressedSize: 0 Meta: { "k1": "v1", "k": "v" } } } Message { Data: ..1000000 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 89 SeqNo: 130 MessageGroupId: "src_id" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:02:03.000000Z Ip: "127.0.0.1" UncompressedSize: 0 Meta: { "k1": "v1", "k": "v" } } } Message { Data: ..1000000 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 90 SeqNo: 131 MessageGroupId: "src_id" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:02:03.000000Z Ip: "127.0.0.1" UncompressedSize: 0 Meta: { "k1": "v1", "k": "v" } } } Message { Data: ..1000000 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 91 SeqNo: 132 MessageGroupId: "src_id" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:02:03.000000Z Ip: "127.0.0.1" UncompressedSize: 0 Meta: { "k1": "v1", "k": "v" } } } Message { Data: ..1000000 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 92 SeqNo: 133 MessageGroupId: "src_id" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:02:03.000000Z Ip: "127.0.0.1" UncompressedSize: 0 Meta: { "k1": "v1", "k": "v" } } } Message { Data: ..1000000 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 93 SeqNo: 134 MessageGroupId: "src_id" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:02:03.000000Z Ip: "127.0.0.1" UncompressedSize: 0 Meta: { "k1": "v1", "k": "v" } } } Message { Data: ..1000000 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 94 SeqNo: 135 MessageGroupId: "src_id" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:02:03.000000Z Ip: "127.0.0.1" UncompressedSize: 0 Meta: { "k1": "v1", "k": "v" } } } Message { Data: ..1000000 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 95 SeqNo: 136 MessageGroupId: "src_id" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:02:03.000000Z Ip: "127.0.0.1" UncompressedSize: 0 Meta: { "k1": "v1", "k": "v" } } } Message { Data: ..1000000 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 96 SeqNo: 137 MessageGroupId: "src_id" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:02:03.000000Z Ip: "127.0.0.1" UncompressedSize: 0 Meta: { "k1": "v1", "k": "v" } } } Message { Data: ..1000000 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 97 SeqNo: 138 MessageGroupId: "src_id" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:02:03.000000Z Ip: "127.0.0.1" UncompressedSize: 0 Meta: { "k1": "v1", "k": "v" } } } Message { Data: ..1000000 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 98 SeqNo: 139 MessageGroupId: "src_id" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:02:03.000000Z Ip: "127.0.0.1" UncompressedSize: 0 Meta: { "k1": "v1", "k": "v" } } } Message { Data: ..1000000 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 99 SeqNo: 140 MessageGroupId: "src_id" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:02:03.000000Z Ip: "127.0.0.1" UncompressedSize: 0 Meta: { "k1": "v1", "k": "v" } } } Message { Data: ..1000000 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 100 SeqNo: 141 MessageGroupId: "src_id" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:02:03.000000Z Ip: "127.0.0.1" UncompressedSize: 0 Meta: { "k1": "v1", "k": "v" } } } Message { Data: ..1000000 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 101 SeqNo: 142 MessageGroupId: "src_id" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:02:03.000000Z Ip: "127.0.0.1" UncompressedSize: 0 Meta: { "k1": "v1", "k": "v" } } } Message { Data: ..1000000 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 102 SeqNo: 143 MessageGroupId: "src_id_2" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:05:21.000000Z Ip: "1.0.0.127" UncompressedSize: 0 Meta: { "v1": "k1", "v": "k" } } } Message { Data: ..1000000 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 103 SeqNo: 144 MessageGroupId: "src_id_2" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:05:21.000000Z Ip: "1.0.0.127" UncompressedSize: 0 Meta: { "v1": "k1", "v": "k" } } } Message { Data: ..1000000 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 104 SeqNo: 145 MessageGroupId: "src_id_2" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:05:21.000000Z Ip: "1.0.0.127" UncompressedSize: 0 Meta: { "v1": "k1", "v": "k" } } } Message { Data: ..1000000 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 105 SeqNo: 146 MessageGroupId: "src_id_2" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:05:21.000000Z Ip: "1.0.0.127" UncompressedSize: 0 Meta: { "v1": "k1", "v": "k" } } } Message { Data: ..1000000 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 106 SeqNo: 147 MessageGroupId: "src_id_2" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:05:21.000000Z Ip: "1.0.0.127" UncompressedSize: 0 Meta: { "v1": "k1", "v": "k" } } } Message { Data: ..1000000 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 107 SeqNo: 148 MessageGroupId: "src_id_2" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:05:21.000000Z Ip: "1.0.0.127" UncompressedSize: 0 Meta: { "v1": "k1", "v": "k" } } } Message { Data: ..1000000 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 108 SeqNo: 149 MessageGroupId: "src_id_2" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:05:21.000000Z Ip: "1.0.0.127" UncompressedSize: 0 Meta: { "v1": "k1", "v": "k" } } } Message { Data: ..1000000 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 109 SeqNo: 150 MessageGroupId: "src_id_2" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:05:21.000000Z Ip: "1.0.0.127" UncompressedSize: 0 Meta: { "v1": "k1", "v": "k" } } } Message { Data: ..1000000 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 110 SeqNo: 151 MessageGroupId: "src_id_2" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:05:21.000000Z Ip: "1.0.0.127" UncompressedSize: 0 Meta: { "v1": "k1", "v": "k" } } } Message { Data: ..1000000 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 111 SeqNo: 152 MessageGroupId: "src_id_2" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:05:21.000000Z Ip: "1.0.0.127" UncompressedSize: 0 Meta: { "v1": "k1", "v": "k" } } } Message { Data: ..1000000 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 112 SeqNo: 153 MessageGroupId: "src_id_2" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:05:21.000000Z Ip: "1.0.0.127" UncompressedSize: 0 Meta: { "v1": "k1", "v": "k" } } } Message { Data: ..1000000 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 113 SeqNo: 154 MessageGroupId: "src_id_2" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:05:21.000000Z Ip: "1.0.0.127" UncompressedSize: 0 Meta: { "v1": "k1", "v": "k" } } } Message { Data: ..1000000 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 114 SeqNo: 155 MessageGroupId: "src_id_2" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:05:21.000000Z Ip: "1.0.0.127" UncompressedSize: 0 Meta: { "v1": "k1", "v": "k" } } } Message { Data: ..1000000 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 115 SeqNo: 156 MessageGroupId: "src_id_2" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:05:21.000000Z Ip: "1.0.0.127" UncompressedSize: 0 Meta: { "v1": "k1", "v": "k" } } } Message { Data: ..1000000 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 116 SeqNo: 157 MessageGroupId: "src_id_2" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:05:21.000000Z Ip: "1.0.0.127" UncompressedSize: 0 Meta: { "v1": "k1", "v": "k" } } } Message { Data: ..1000000 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 117 SeqNo: 158 MessageGroupId: "src_id_2" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:05:21.000000Z Ip: "1.0.0.127" UncompressedSize: 0 Meta: { "v1": "k1", "v": "k" } } } Message { Data: ..1000000 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 118 SeqNo: 159 MessageGroupId: "src_id_2" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:05:21.000000Z Ip: "1.0.0.127" UncompressedSize: 0 Meta: { "v1": "k1", "v": "k" } } } Message { Data: ..1000000 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 119 SeqNo: 160 MessageGroupId: "src_id_2" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:05:21.000000Z Ip: "1.0.0.127" UncompressedSize: 0 Meta: { "v1": "k1", "v": "k" } } } Message { Data: ..1000000 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 120 SeqNo: 161 MessageGroupId: "src_id_2" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:05:21.000000Z Ip: "1.0.0.127" UncompressedSize: 0 Meta: { "v1": "k1", "v": "k" } } } Message { Data: ..1000000 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 121 SeqNo: 162 MessageGroupId: "src_id_2" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:05:21.000000Z Ip: "1.0.0.127" UncompressedSize: 0 Meta: { "v1": "k1", "v": "k" } } } Message { Data: ..1000000 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 122 SeqNo: 163 MessageGroupId: "src_id_2" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:05:21.000000Z Ip: "1.0.0.127" UncompressedSize: 0 Meta: { "v1": "k1", "v": "k" } } } Message { Data: ..1000000 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 123 SeqNo: 164 MessageGroupId: "src_id_2" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:05:21.000000Z Ip: "1.0.0.127" UncompressedSize: 0 Meta: { "v1": "k1", "v": "k" } } } Message { Data: ..1000000 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 124 SeqNo: 165 MessageGroupId: "src_id_2" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:05:21.000000Z Ip: "1.0.0.127" UncompressedSize: 0 Meta: { "v1": "k1", "v": "k" } } } Message { Data: ..1000000 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 125 SeqNo: 166 MessageGroupId: "src_id_2" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:05:21.000000Z Ip: "1.0.0.127" UncompressedSize: 0 Meta: { "v1": "k1", "v": "k" } } } Message { Data: ..1000000 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 126 SeqNo: 167 MessageGroupId: "src_id_2" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:05:21.000000Z Ip: "1.0.0.127" UncompressedSize: 0 Meta: { "v1": "k1", "v": "k" } } } Message { Data: ..1000000 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 127 SeqNo: 168 MessageGroupId: "src_id_2" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:05:21.000000Z Ip: "1.0.0.127" UncompressedSize: 0 Meta: { "v1": "k1", "v": "k" } } } Message { Data: ..1000000 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 128 SeqNo: 169 MessageGroupId: "src_id_2" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:05:21.000000Z Ip: "1.0.0.127" UncompressedSize: 0 Meta: { "v1": "k1", "v": "k" } } } Message { Data: ..1000000 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 129 SeqNo: 170 MessageGroupId: "src_id_2" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:05:21.000000Z Ip: "1.0.0.127" UncompressedSize: 0 Meta: { "v1": "k1", "v": "k" } } } Message { Data: ..1000000 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 130 SeqNo: 171 MessageGroupId: "src_id_2" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:05:21.000000Z Ip: "1.0.0.127" UncompressedSize: 0 Meta: { "v1": "k1", "v": "k" } } } Message { Data: ..1000000 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 131 SeqNo: 172 MessageGroupId: "src_id_2" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:05:21.000000Z Ip: "1.0.0.127" UncompressedSize: 0 Meta: { "v1": "k1", "v": "k" } } } Message { Data: ..1000000 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 132 SeqNo: 173 MessageGroupId: "src_id_2" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:05:21.000000Z Ip: "1.0.0.127" UncompressedSize: 0 Meta: { "v1": "k1", "v": "k" } } } Message { Data: ..1000000 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 133 SeqNo: 174 MessageGroupId: "src_id_2" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:05:21.000000Z Ip: "1.0.0.127" UncompressedSize: 0 Meta: { "v1": "k1", "v": "k" } } } Message { Data: ..1000000 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 134 SeqNo: 175 MessageGroupId: "src_id_2" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:05:21.000000Z Ip: "1.0.0.127" UncompressedSize: 0 Meta: { "v1": "k1", "v": "k" } } } Message { Data: ..1000000 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 135 SeqNo: 176 MessageGroupId: "src_id_2" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:05:21.000000Z Ip: "1.0.0.127" UncompressedSize: 0 Meta: { "v1": "k1", "v": "k" } } } Message { Data: ..1000000 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 136 SeqNo: 177 MessageGroupId: "src_id_2" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:05:21.000000Z Ip: "1.0.0.127" UncompressedSize: 0 Meta: { "v1": "k1", "v": "k" } } } Message { Data: ..1000000 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 137 SeqNo: 178 MessageGroupId: "src_id_2" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:05:21.000000Z Ip: "1.0.0.127" UncompressedSize: 0 Meta: { "v1": "k1", "v": "k" } } } Message { Data: ..1000000 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 138 SeqNo: 179 MessageGroupId: "src_id_2" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:05:21.000000Z Ip: "1.0.0.127" UncompressedSize: 0 Meta: { "v1": "k1", "v": "k" } } } Message { Data: ..1000000 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 139 SeqNo: 180 MessageGroupId: "src_id_2" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:05:21.000000Z Ip: "1.0.0.127" UncompressedSize: 0 Meta: { "v1": "k1", "v": "k" } } } Message { Data: ..1000000 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 140 SeqNo: 181 MessageGroupId: "src_id_2" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:05:21.000000Z Ip: "1.0.0.127" UncompressedSize: 0 Meta: { "v1": "k1", "v": "k" } } } Message { Data: ..1000000 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 141 SeqNo: 182 MessageGroupId: "src_id_2" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:05:21.000000Z Ip: "1.0.0.127" UncompressedSize: 0 Meta: { "v1": "k1", "v": "k" } } } Message { Data: ..1000000 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 142 SeqNo: 183 MessageGroupId: "src_id_2" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:05:21.000000Z Ip: "1.0.0.127" UncompressedSize: 0 Meta: { "v1": "k1", "v": "k" } } } Message { Data: ..1000000 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 143 SeqNo: 184 MessageGroupId: "src_id_2" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:05:21.000000Z Ip: "1.0.0.127" UncompressedSize: 0 Meta: { "v1": "k1", "v": "k" } } } Message { Data: ..1000000 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 144 SeqNo: 185 MessageGroupId: "src_id_2" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:05:21.000000Z Ip: "1.0.0.127" UncompressedSize: 0 Meta: { "v1": "k1", "v": "k" } } } Message { Data: ..1000000 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 145 SeqNo: 186 MessageGroupId: "src_id_2" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:05:21.000000Z Ip: "1.0.0.127" UncompressedSize: 0 Meta: { "v1": "k1", "v": "k" } } } Message { Data: ..1000000 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 146 SeqNo: 187 MessageGroupId: "src_id_2" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:05:21.000000Z Ip: "1.0.0.127" UncompressedSize: 0 Meta: { "v1": "k1", "v": "k" } } } Message { Data: ..1000000 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 147 SeqNo: 188 MessageGroupId: "src_id_2" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:05:21.000000Z Ip: "1.0.0.127" UncompressedSize: 0 Meta: { "v1": "k1", "v": "k" } } } Message { Data: ..1000000 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 148 SeqNo: 189 MessageGroupId: "src_id_2" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:05:21.000000Z Ip: "1.0.0.127" UncompressedSize: 0 Meta: { "v1": "k1", "v": "k" } } } Message { Data: ..1000000 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 149 SeqNo: 190 MessageGroupId: "src_id_2" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:05:21.000000Z Ip: "1.0.0.127" UncompressedSize: 0 Meta: { "v1": "k1", "v": "k" } } } Message { Data: ..1000000 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 150 SeqNo: 191 MessageGroupId: "src_id_2" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:05:21.000000Z Ip: "1.0.0.127" UncompressedSize: 0 Meta: { "v1": "k1", "v": "k" } } } Message { Data: ..1000000 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 151 SeqNo: 192 MessageGroupId: "src_id_2" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:05:21.000000Z Ip: "1.0.0.127" UncompressedSize: 0 Meta: { "v1": "k1", "v": "k" } } } Message { Data: ..1000000 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 152 SeqNo: 193 MessageGroupId: "src_id_2" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:05:21.000000Z Ip: "1.0.0.127" UncompressedSize: 0 Meta: { "v1": "k1", "v": "k" } } } Message { Data: ..1000000 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 153 SeqNo: 194 MessageGroupId: "src_id_2" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:05:21.000000Z Ip: "1.0.0.127" UncompressedSize: 0 Meta: { "v1": "k1", "v": "k" } } } Message { Data: ..1000000 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 154 SeqNo: 195 MessageGroupId: "src_id_2" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:05:21.000000Z Ip: "1.0.0.127" UncompressedSize: 0 Meta: { "v1": "k1", "v": "k" } } } Message { Data: ..1000000 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 155 SeqNo: 196 MessageGroupId: "src_id_2" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:05:21.000000Z Ip: "1.0.0.127" UncompressedSize: 0 Meta: { "v1": "k1", "v": "k" } } } Message { Data: ..1000000 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 156 SeqNo: 197 MessageGroupId: "src_id_2" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:05:21.000000Z Ip: "1.0.0.127" UncompressedSize: 0 Meta: { "v1": "k1", "v": "k" } } } Message { Data: ..1000000 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 157 SeqNo: 198 MessageGroupId: "src_id_2" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:05:21.000000Z Ip: "1.0.0.127" UncompressedSize: 0 Meta: { "v1": "k1", "v": "k" } } } Message { Data: ..1000000 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 158 SeqNo: 199 MessageGroupId: "src_id_2" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:05:21.000000Z Ip: "1.0.0.127" UncompressedSize: 0 Meta: { "v1": "k1", "v": "k" } } } Message { Data: ..1000000 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 159 SeqNo: 200 MessageGroupId: "src_id_2" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:05:21.000000Z Ip: "1.0.0.127" UncompressedSize: 0 Meta: { "v1": "k1", "v": "k" } } } Message { Data: ..1000000 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 160 SeqNo: 201 MessageGroupId: "src_id_2" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:05:21.000000Z Ip: "1.0.0.127" UncompressedSize: 0 Meta: { "v1": "k1", "v": "k" } } } Message { Data: ..1000000 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 161 SeqNo: 202 MessageGroupId: "src_id_2" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:05:21.000000Z Ip: "1.0.0.127" UncompressedSize: 0 Meta: { "v1": "k1", "v": "k" } } } Message { Data: ..1000000 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 162 SeqNo: 203 MessageGroupId: "src_id_2" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:05:21.000000Z Ip: "1.0.0.127" UncompressedSize: 0 Meta: { "v1": "k1", "v": "k" } } } Message { Data: ..1000000 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 163 SeqNo: 204 MessageGroupId: "src_id_2" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:05:21.000000Z Ip: "1.0.0.127" UncompressedSize: 0 Meta: { "v1": "k1", "v": "k" } } } Message { Data: ..1000000 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 164 SeqNo: 205 MessageGroupId: "src_id_2" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:05:21.000000Z Ip: "1.0.0.127" UncompressedSize: 0 Meta: { "v1": "k1", "v": "k" } } } Message { Data: ..1000000 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 165 SeqNo: 206 MessageGroupId: "src_id_2" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:05:21.000000Z Ip: "1.0.0.127" UncompressedSize: 0 Meta: { "v1": "k1", "v": "k" } } } Message { Data: ..1000000 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 166 SeqNo: 207 MessageGroupId: "src_id_2" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:05:21.000000Z Ip: "1.0.0.127" UncompressedSize: 0 Meta: { "v1": "k1", "v": "k" } } } Message { Data: ..1000000 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 167 SeqNo: 208 MessageGroupId: "src_id_2" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:05:21.000000Z Ip: "1.0.0.127" UncompressedSize: 0 Meta: { "v1": "k1", "v": "k" } } } Message { Data: ..1000000 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 168 SeqNo: 209 MessageGroupId: "src_id_2" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:05:21.000000Z Ip: "1.0.0.127" UncompressedSize: 0 Meta: { "v1": "k1", "v": "k" } } } Message { Data: ..1000000 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 169 SeqNo: 210 MessageGroupId: "src_id_2" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:05:21.000000Z Ip: "1.0.0.127" UncompressedSize: 0 Meta: { "v1": "k1", "v": "k" } } } Message { Data: ..1000000 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 170 SeqNo: 211 MessageGroupId: "src_id_2" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:05:21.000000Z Ip: "1.0.0.127" UncompressedSize: 0 Meta: { "v1": "k1", "v": "k" } } } Message { Data: ..1000000 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 171 SeqNo: 212 MessageGroupId: "src_id_2" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:05:21.000000Z Ip: "1.0.0.127" UncompressedSize: 0 Meta: { "v1": "k1", "v": "k" } } } Message { Data: ..1000000 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 172 SeqNo: 213 MessageGroupId: "src_id_2" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:05:21.000000Z Ip: "1.0.0.127" UncompressedSize: 0 Meta: { "v1": "k1", "v": "k" } } } Message { Data: ..1000000 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 173 SeqNo: 214 MessageGroupId: "src_id_2" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:05:21.000000Z Ip: "1.0.0.127" UncompressedSize: 0 Meta: { "v1": "k1", "v": "k" } } } Message { Data: ..1000000 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 174 SeqNo: 215 MessageGroupId: "src_id_2" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:05:21.000000Z Ip: "1.0.0.127" UncompressedSize: 0 Meta: { "v1": "k1", "v": "k" } } } Message { Data: ..1000000 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 175 SeqNo: 216 MessageGroupId: "src_id_2" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:05:21.000000Z Ip: "1.0.0.127" UncompressedSize: 0 Meta: { "v1": "k1", "v": "k" } } } Message { Data: ..1000000 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 176 SeqNo: 217 MessageGroupId: "src_id_2" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:05:21.000000Z Ip: "1.0.0.127" UncompressedSize: 0 Meta: { "v1": "k1", "v": "k" } } } Message { Data: ..1000000 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 177 SeqNo: 218 MessageGroupId: "src_id_2" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:05:21.000000Z Ip: "1.0.0.127" UncompressedSize: 0 Meta: { "v1": "k1", "v": "k" } } } Message { Data: ..1000000 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 178 SeqNo: 219 MessageGroupId: "src_id_2" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:05:21.000000Z Ip: "1.0.0.127" UncompressedSize: 0 Meta: { "v1": "k1", "v": "k" } } } Message { Data: ..1000000 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 179 SeqNo: 220 MessageGroupId: "src_id_2" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:05:21.000000Z Ip: "1.0.0.127" UncompressedSize: 0 Meta: { "v1": "k1", "v": "k" } } } Message { Data: ..1000000 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 180 SeqNo: 221 MessageGroupId: "src_id_2" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:05:21.000000Z Ip: "1.0.0.127" UncompressedSize: 0 Meta: { "v1": "k1", "v": "k" } } } Message { Data: ..1000000 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 181 SeqNo: 222 MessageGroupId: "src_id_2" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:05:21.000000Z Ip: "1.0.0.127" UncompressedSize: 0 Meta: { "v1": "k1", "v": "k" } } } Message { Data: ..1000000 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 182 SeqNo: 223 MessageGroupId: "src_id_2" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:05:21.000000Z Ip: "1.0.0.127" UncompressedSize: 0 Meta: { "v1": "k1", "v": "k" } } } Message { Data: ..1000000 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 183 SeqNo: 224 MessageGroupId: "src_id_2" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:05:21.000000Z Ip: "1.0.0.127" UncompressedSize: 0 Meta: { "v1": "k1", "v": "k" } } } Message { Data: ..1000000 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 184 SeqNo: 225 MessageGroupId: "src_id_2" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:05:21.000000Z Ip: "1.0.0.127" UncompressedSize: 0 Meta: { "v1": "k1", "v": "k" } } } Message { Data: ..1000000 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 185 SeqNo: 226 MessageGroupId: "src_id_2" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:05:21.000000Z Ip: "1.0.0.127" UncompressedSize: 0 Meta: { "v1": "k1", "v": "k" } } } Message { Data: ..1000000 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 186 SeqNo: 227 MessageGroupId: "src_id_2" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:05:21.000000Z Ip: "1.0.0.127" UncompressedSize: 0 Meta: { "v1": "k1", "v": "k" } } } Message { Data: ..1000000 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 187 SeqNo: 228 MessageGroupId: "src_id_2" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:05:21.000000Z Ip: "1.0.0.127" UncompressedSize: 0 Meta: { "v1": "k1", "v": "k" } } } Message { Data: ..1000000 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 188 SeqNo: 229 MessageGroupId: "src_id_2" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:05:21.000000Z Ip: "1.0.0.127" UncompressedSize: 0 Meta: { "v1": "k1", "v": "k" } } } Message { Data: ..1000000 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 189 SeqNo: 230 MessageGroupId: "src_id_2" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:05:21.000000Z Ip: "1.0.0.127" UncompressedSize: 0 Meta: { "v1": "k1", "v": "k" } } } Message { Data: ..1000000 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 190 SeqNo: 231 MessageGroupId: "src_id_2" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:05:21.000000Z Ip: "1.0.0.127" UncompressedSize: 0 Meta: { "v1": "k1", "v": "k" } } } Message { Data: ..1000000 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 191 SeqNo: 232 MessageGroupId: "src_id_2" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:05:21.000000Z Ip: "1.0.0.127" UncompressedSize: 0 Meta: { "v1": "k1", "v": "k" } } } Message { Data: ..1000000 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 192 SeqNo: 233 MessageGroupId: "src_id_2" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:05:21.000000Z Ip: "1.0.0.127" UncompressedSize: 0 Meta: { "v1": "k1", "v": "k" } } } Message { Data: ..1000000 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 193 SeqNo: 234 MessageGroupId: "src_id_2" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:05:21.000000Z Ip: "1.0.0.127" UncompressedSize: 0 Meta: { "v1": "k1", "v": "k" } } } Message { Data: ..1000000 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 194 SeqNo: 235 MessageGroupId: "src_id_2" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:05:21.000000Z Ip: "1.0.0.127" UncompressedSize: 0 Meta: { "v1": "k1", "v": "k" } } } Message { Data: ..1000000 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 195 SeqNo: 236 MessageGroupId: "src_id_2" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:05:21.000000Z Ip: "1.0.0.127" UncompressedSize: 0 Meta: { "v1": "k1", "v": "k" } } } Message { Data: ..1000000 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 196 SeqNo: 237 MessageGroupId: "src_id_2" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:05:21.000000Z Ip: "1.0.0.127" UncompressedSize: 0 Meta: { "v1": "k1", "v": "k" } } } Message { Data: ..1000000 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 197 SeqNo: 238 MessageGroupId: "src_id_2" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:05:21.000000Z Ip: "1.0.0.127" UncompressedSize: 0 Meta: { "v1": "k1", "v": "k" } } } Message { Data: ..1000000 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 198 SeqNo: 239 MessageGroupId: "src_id_2" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:05:21.000000Z Ip: "1.0.0.127" UncompressedSize: 0 Meta: { "v1": "k1", "v": "k" } } } Message { Data: ..1000000 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 199 SeqNo: 240 MessageGroupId: "src_id_2" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:05:21.000000Z Ip: "1.0.0.127" UncompressedSize: 0 Meta: { "v1": "k1", "v": "k" } } } Message { Data: ..1000000 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 200 SeqNo: 241 MessageGroupId: "src_id_2" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:05:21.000000Z Ip: "1.0.0.127" UncompressedSize: 0 Meta: { "v1": "k1", "v": "k" } } } }
2025-11-03T16:51:13.971272Z :DEBUG: [db] [sessionid] [cluster] Commit offsets [1, 201). Partition stream id: 1
2025-11-03T16:51:14.040940Z :DEBUG: [db] [sessionid] [cluster] In Reconnect, ReadSizeBudget = 5, ReadSizeServerDelta = 0
2025-11-03T16:51:14.041021Z :DEBUG: [db] [sessionid] [cluster] New values: ReadSizeBudget = 5, ReadSizeServerDelta = 0
2025-11-03T16:51:14.041078Z :DEBUG: [db] [sessionid] [cluster] Reconnecting session to cluster cluster in 0.000000s
2025-11-03T16:51:14.041623Z :DEBUG: [db] [sessionid] [cluster] Successfully connected. Initializing session
2025-11-03T16:51:14.042556Z :INFO: [db] [sessionid] [cluster] Server session id: 123-session-id-321
2025-11-03T16:51:14.043096Z :DEBUG: [db] [sessionid] [cluster] After sending read request: ReadSizeBudget = 5, ReadSizeServerDelta = 0
2025-11-03T16:51:14.043642Z :INFO: [db] [sessionid] [cluster] Confirm partition stream create. Partition stream id: 1. Cluster: "TestCluster". Topic: "TestTopic". Partition: 1. Read offset: (NULL)
Message data size: 1000000
Compressed message data size: 3028
Post function
Getting new event
2025-11-03T16:51:14.165132Z :DEBUG: Decompression task done. Partition/PartitionSessionId: 1 (1-10)
2025-11-03T16:51:14.168851Z :DEBUG: Take Data. Partition 1. Read: {0, 0} (1-1)
2025-11-03T16:51:14.170645Z :DEBUG: Take Data. Partition 1. Read: {0, 1} (2-2)
2025-11-03T16:51:14.173331Z :DEBUG: Take Data. Partition 1. Read: {0, 2} (3-3)
2025-11-03T16:51:14.174164Z :DEBUG: Take Data. Partition 1. Read: {0, 3} (4-4)
2025-11-03T16:51:14.178662Z :DEBUG: Take Data. Partition 1. Read: {0, 4} (5-5)
2025-11-03T16:51:14.179492Z :DEBUG: Take Data. Partition 1. Read: {0, 5} (6-6)
2025-11-03T16:51:14.180330Z :DEBUG: Take Data. Partition 1. Read: {1, 0} (7-7)
2025-11-03T16:51:14.181190Z :DEBUG: Take Data. Partition 1. Read: {1, 1} (8-8)
2025-11-03T16:51:14.191599Z :DEBUG: Take Data. Partition 1. Read: {1, 2} (9-9)
2025-11-03T16:51:14.192524Z :DEBUG: Take Data. Partition 1. Read: {1, 3} (10-10)
2025-11-03T16:51:14.192603Z :DEBUG: [db] [sessionid] [cluster] The application data is transferred to the client. Number of messages 10, size 10000000 bytes
2025-11-03T16:51:14.192792Z :DEBUG: [db] [sessionid] [cluster] After sending read request: ReadSizeBudget = 5, ReadSizeServerDelta = 0
DataReceived { PartitionStreamId: 1 PartitionId: 1 Message { Data: ..1000000 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 1 SeqNo: 42 MessageGroupId: "src_id" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:02:03.000000Z Ip: "127.0.0.1" UncompressedSize: 0 Meta: { "k1": "v1", "k": "v" } } } Message { Data: ..1000000 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 2 SeqNo: 43 MessageGroupId: "src_id" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:02:03.000000Z Ip: "127.0.0.1" UncompressedSize: 0 Meta: { "k1": "v1", "k": "v" } } } Message { Data: ..1000000 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 3 SeqNo: 44 MessageGroupId: "src_id" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:02:03.000000Z Ip: "127.0.0.1" UncompressedSize: 0 Meta: { "k1": "v1", "k": "v" } } } Message { Data: ..1000000 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 4 SeqNo: 45 MessageGroupId: "src_id" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:02:03.000000Z Ip: "127.0.0.1" UncompressedSize: 0 Meta: { "k1": "v1", "k": "v" } } } Message { Data: ..1000000 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 5 SeqNo: 46 MessageGroupId: "src_id" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:02:03.000000Z Ip: "127.0.0.1" UncompressedSize: 0 Meta: { "k1": "v1", "k": "v" } } } Message { Data: ..1000000 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 6 SeqNo: 47 MessageGroupId: "src_id" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:02:03.000000Z Ip: "127.0.0.1" UncompressedSize: 0 Meta: { "k1": "v1", "k": "v" } } } Message { Data: ..1000000 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 7 SeqNo: 48 MessageGroupId: "src_id_2" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:05:21.000000Z Ip: "1.0.0.127" UncompressedSize: 0 Meta: { "v1": "k1", "v": "k" } } } Message { Data: ..1000000 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 8 SeqNo: 49 MessageGroupId: "src_id_2" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:05:21.000000Z Ip: "1.0.0.127" UncompressedSize: 0 Meta: { "v1": "k1", "v": "k" } } } Message { Data: ..1000000 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 9 SeqNo: 50 MessageGroupId: "src_id_2" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:05:21.000000Z Ip: "1.0.0.127" UncompressedSize: 0 Meta: { "v1": "k1", "v": "k" } } } Message { Data: ..1000000 bytes.. Partition stream id: 1 Cluster: "TestCluster". Topic: "TestTopic" Partition: 1 PartitionKey: "" Information: { Offset: 10 SeqNo: 51 MessageGroupId: "src_id_2" CreateTime: 1970-01-01T00:00:00.042000Z WriteTime: 1970-01-01T00:05:21.000000Z Ip: "1.0.0.127" UncompressedSize: 0 Meta: { "v1": "k1", "v": "k" } } } }
2025-11-03T16:51:14.197095Z :DEBUG: [db] [sessionid] [cluster] Commit offsets [1, 11). Partition stream id: 1
2025-11-03T16:51:14.209431Z :DEBUG: [db] [sessionid] [cluster] In Reconnect, ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:51:14.209505Z :DEBUG: [db] [sessionid] [cluster] New values: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:51:14.209545Z :DEBUG: [db] [sessionid] [cluster] Reconnecting session to cluster cluster in 0.000000s
2025-11-03T16:51:14.209889Z :DEBUG: [db] [sessionid] [cluster] Successfully connected. Initializing session
2025-11-03T16:51:14.210413Z :INFO: [db] [sessionid] [cluster] Server session id: 123-session-id-321
2025-11-03T16:51:14.210568Z :DEBUG: [db] [sessionid] [cluster] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:51:14.210873Z :INFO: [db] [sessionid] [cluster] Confirm partition stream create. Partition stream id: 1. Cluster: "TestCluster". Topic: "TestTopic". Partition: 1. Read offset: (NULL)
2025-11-03T16:51:14.211273Z :DEBUG: [db] [sessionid] [cluster] Requesting status for partition stream id: 1
2025-11-03T16:51:14.212417Z :DEBUG: [db] [sessionid] [cluster] In Reconnect, ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:51:14.212477Z :DEBUG: [db] [sessionid] [cluster] New values: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:51:14.212516Z :DEBUG: [db] [sessionid] [cluster] Reconnecting session to cluster cluster in 0.000000s
2025-11-03T16:51:14.212791Z :DEBUG: [db] [sessionid] [cluster] Successfully connected. Initializing session
2025-11-03T16:51:14.213390Z :INFO: [db] [sessionid] [cluster] Server session id: 123-session-id-321
2025-11-03T16:51:14.213551Z :DEBUG: [db] [sessionid] [cluster] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:51:14.214069Z :DEBUG: [db] [sessionid] [cluster] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:51:14.214291Z :DEBUG: Decompression task done. Partition/PartitionSessionId: 1 (1-1)
2025-11-03T16:51:14.214417Z :DEBUG: Take Data. Partition 1. Read: {0, 0} (1-1)
2025-11-03T16:51:14.214465Z :DEBUG: [db] [sessionid] [cluster] The application data is transferred to the client. Number of messages 1, size 8 bytes
2025-11-03T16:51:14.214617Z :INFO: [db] [sessionid] [cluster] Confirm partition stream destroy. Partition stream id: 1. Cluster: "TestCluster". Topic: "TestTopic". Partition: 1
2025-11-03T16:51:11.621354Z :DEBUG: [db] [sessionid] [cluster] In Reconnect, ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:51:11.621401Z :DEBUG: [db] [sessionid] [cluster] New values: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:51:11.621425Z :DEBUG: [db] [sessionid] [cluster] Reconnecting session to cluster cluster in 0.000000s
2025-11-03T16:51:11.622086Z :ERROR: [db] [sessionid] [cluster] Got error. Status: INTERNAL_ERROR. Description: 
2025-11-03T16:51:11.622138Z :DEBUG: [db] [sessionid] [cluster] In Reconnect, ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:51:11.622172Z :DEBUG: [db] [sessionid] [cluster] New values: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:51:11.623278Z :DEBUG: [db] [sessionid] [cluster] Reconnecting session to cluster cluster in 0.007994s
2025-11-03T16:51:11.625264Z :DEBUG: [db] [sessionid] [cluster] Successfully connected. Initializing session
2025-11-03T16:51:11.625831Z :INFO: [db] [sessionid] [cluster] Server session id: session id
2025-11-03T16:51:11.626014Z :DEBUG: [db] [sessionid] [cluster] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:51:11.627055Z :DEBUG: [db] [sessionid] [cluster] In Reconnect, ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:51:11.627076Z :DEBUG: [db] [sessionid] [cluster] New values: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:51:11.627108Z :DEBUG: [db] [sessionid] [cluster] Reconnecting session to cluster cluster in 0.000000s
2025-11-03T16:51:11.627459Z :ERROR: [db] [sessionid] [cluster] Got error. Status: INTERNAL_ERROR. Description: 
2025-11-03T16:51:11.627500Z :DEBUG: [db] [sessionid] [cluster] In Reconnect, ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:51:11.627522Z :DEBUG: [db] [sessionid] [cluster] New values: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:51:11.627578Z :DEBUG: [db] [sessionid] [cluster] Reconnecting session to cluster cluster in 0.008887s
2025-11-03T16:51:11.627995Z :DEBUG: [db] [sessionid] [cluster] Successfully connected. Initializing session
2025-11-03T16:51:11.628428Z :INFO: [db] [sessionid] [cluster] Server session id: session id
2025-11-03T16:51:11.628548Z :DEBUG: [db] [sessionid] [cluster] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:51:11.629433Z :DEBUG: [db] [sessionid] [cluster] In Reconnect, ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:51:11.629450Z :DEBUG: [db] [sessionid] [cluster] New values: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:51:11.629483Z :DEBUG: [db] [sessionid] [cluster] Reconnecting session to cluster cluster in 0.000000s
2025-11-03T16:51:11.629874Z :ERROR: [db] [sessionid] [cluster] Got error. Status: TIMEOUT. Description: <main>: Error: Failed to establish connection to server. Attempts done: 1 
2025-11-03T16:51:11.630005Z :DEBUG: [db] [sessionid] [cluster] In Reconnect, ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:51:11.630025Z :DEBUG: [db] [sessionid] [cluster] New values: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:51:11.630088Z :DEBUG: [db] [sessionid] [cluster] Reconnecting session to cluster cluster in 0.272366s
2025-11-03T16:51:11.630506Z :DEBUG: [db] [sessionid] [cluster] Successfully connected. Initializing session
2025-11-03T16:51:11.631101Z :INFO: [db] [sessionid] [cluster] Server session id: session id
2025-11-03T16:51:11.631207Z :DEBUG: [db] [sessionid] [cluster] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:51:11.632014Z :DEBUG: [db] [sessionid] [cluster] In Reconnect, ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:51:11.632032Z :DEBUG: [db] [sessionid] [cluster] New values: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:51:11.632047Z :DEBUG: [db] [sessionid] [cluster] Reconnecting session to cluster cluster in 0.000000s
2025-11-03T16:51:11.632474Z :ERROR: [db] [sessionid] [cluster] Got error. Status: TIMEOUT. Description: <main>: Error: Failed to establish connection to server. Attempts done: 1 
2025-11-03T16:51:11.632515Z :DEBUG: [db] [sessionid] [cluster] In Reconnect, ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:51:11.632534Z :DEBUG: [db] [sessionid] [cluster] New values: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:51:11.632596Z :DEBUG: [db] [sessionid] [cluster] Reconnecting session to cluster cluster in 0.164251s
2025-11-03T16:51:11.633012Z :DEBUG: [db] [sessionid] [cluster] Successfully connected. Initializing session
2025-11-03T16:51:11.633413Z :INFO: [db] [sessionid] [cluster] Server session id: session id
2025-11-03T16:51:11.633469Z :DEBUG: [db] [sessionid] [cluster] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:51:11.634299Z :DEBUG: [db] [sessionid] [cluster] In Reconnect, ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:51:11.634320Z :DEBUG: [db] [sessionid] [cluster] New values: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:51:11.634342Z :DEBUG: [db] [sessionid] [cluster] Reconnecting session to cluster cluster in 0.000000s
2025-11-03T16:51:11.634626Z :DEBUG: [db] [sessionid] [cluster] Successfully connected. Initializing session
2025-11-03T16:51:11.635031Z :INFO: [db] [sessionid] [cluster] Server session id: 123-session-id-321
2025-11-03T16:51:11.647910Z :DEBUG: [db] [sessionid] [cluster] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:51:11.648919Z :ERROR: [db] [sessionid] [cluster] Got error. Status: TRANSPORT_UNAVAILABLE. Description: <main>: Error: GRpc error: (14):  
2025-11-03T16:51:11.648951Z :DEBUG: [db] [sessionid] [cluster] In Reconnect, ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:51:11.648973Z :DEBUG: [db] [sessionid] [cluster] New values: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:51:11.649028Z :DEBUG: [db] [sessionid] [cluster] Reconnecting session to cluster cluster in 0.298906s
2025-11-03T16:51:11.649184Z :DEBUG: [db] [sessionid] [cluster] Abort session to cluster
2025-11-03T16:51:11.650547Z :DEBUG: [db] [sessionid] [cluster] In Reconnect, ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:51:11.650572Z :DEBUG: [db] [sessionid] [cluster] New values: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:51:11.650597Z :DEBUG: [db] [sessionid] [cluster] Reconnecting session to cluster cluster in 0.000000s
2025-11-03T16:51:11.650969Z :DEBUG: [db] [sessionid] [cluster] Successfully connected. Initializing session
2025-11-03T16:51:11.651566Z :INFO: [db] [sessionid] [cluster] Server session id: 123-session-id-321
2025-11-03T16:51:11.651712Z :DEBUG: [db] [sessionid] [cluster] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:51:11.652150Z :INFO: [db] [sessionid] [cluster] Confirm partition stream create. Partition stream id: 1. Cluster: "TestCluster". Topic: "TestTopic". Partition: 1. Read offset: (NULL)
2025-11-03T16:51:11.758518Z :DEBUG: [db] [sessionid] [cluster] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:51:11.760197Z :DEBUG: Decompression task done. Partition/PartitionSessionId: 1 (1-2)
2025-11-03T16:51:11.760270Z :DEBUG: Take Data. Partition 1. Read: {0, 0} (1-1)
2025-11-03T16:51:11.760319Z :DEBUG: Take Data. Partition 1. Read: {1, 0} (2-2)
2025-11-03T16:51:11.760428Z :DEBUG: [db] [sessionid] [cluster] The application data is transferred to the client. Number of messages 2, size 6 bytes
2025-11-03T16:51:11.864192Z :INFO: [db] [sessionid] [cluster] Confirm partition stream destroy. Partition stream id: 1. Cluster: "TestCluster". Topic: "TestTopic". Partition: 1
2025-11-03T16:51:11.864352Z :DEBUG: [db] [sessionid] [cluster] Abort session to cluster
2025-11-03T16:51:11.865458Z :DEBUG: [db] [sessionid] [cluster] In Reconnect, ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:51:11.865494Z :DEBUG: [db] [sessionid] [cluster] New values: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:51:11.865515Z :DEBUG: [db] [sessionid] [cluster] Reconnecting session to cluster cluster in 0.000000s
2025-11-03T16:51:11.865781Z :DEBUG: [db] [sessionid] [cluster] Successfully connected. Initializing session
2025-11-03T16:51:11.866189Z :INFO: [db] [sessionid] [cluster] Server session id: 123-session-id-321
2025-11-03T16:51:11.866297Z :DEBUG: [db] [sessionid] [cluster] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:51:11.872403Z :INFO: [db] [sessionid] [cluster] Confirm partition stream create. Partition stream id: 1. Cluster: "TestCluster". Topic: "TestTopic". Partition: 1. Read offset: (NULL)
2025-11-03T16:51:11.976401Z :DEBUG: [db] [sessionid] [cluster] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:51:11.979123Z :DEBUG: Decompression task done. Partition/PartitionSessionId: 1 (1-2)
2025-11-03T16:51:11.979190Z :DEBUG: Take Data. Partition 1. Read: {0, 0} (1-1)
2025-11-03T16:51:11.979237Z :DEBUG: Take Data. Partition 1. Read: {1, 0} (2-2)
2025-11-03T16:51:11.979314Z :DEBUG: [db] [sessionid] [cluster] Commit offsets [1, 3). Partition stream id: 1
2025-11-03T16:51:11.979429Z :DEBUG: [db] [sessionid] [cluster] The application data is transferred to the client. Number of messages 2, size 6 bytes
2025-11-03T16:51:11.979912Z :DEBUG: [db] [sessionid] [cluster] Committed response: cookies { assign_id: 1 partition_cookie: 1 }
2025-11-03T16:51:11.980045Z :INFO: [db] [sessionid] [cluster] Confirm partition stream destroy. Partition stream id: 1. Cluster: "TestCluster". Topic: "TestTopic". Partition: 1
2025-11-03T16:51:11.980208Z :DEBUG: [db] [sessionid] [cluster] Abort session to cluster
2025-11-03T16:51:12.300870Z :DEBUG: [db] [sessionid] [cluster] In Reconnect, ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:51:12.300913Z :DEBUG: [db] [sessionid] [cluster] New values: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:51:12.300936Z :DEBUG: [db] [sessionid] [cluster] Reconnecting session to cluster cluster in 0.000000s
2025-11-03T16:51:12.301485Z :DEBUG: [db] [sessionid] [cluster] Successfully connected. Initializing session
2025-11-03T16:51:12.301941Z :INFO: [db] [sessionid] [cluster] Server session id: session id
2025-11-03T16:51:12.301994Z :DEBUG: [db] [sessionid] [cluster] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:51:12.302916Z :DEBUG: [db] [sessionid] [cluster] In Reconnect, ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:51:12.302930Z :DEBUG: [db] [sessionid] [cluster] New values: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:51:12.302943Z :DEBUG: [db] [sessionid] [cluster] Reconnecting session to cluster cluster in 0.000000s
2025-11-03T16:51:12.303350Z :DEBUG: [db] [sessionid] [cluster] Successfully connected. Initializing session
2025-11-03T16:51:12.303844Z :INFO: [db] [sessionid] [cluster] Server session id: session id
2025-11-03T16:51:12.303883Z :DEBUG: [db] [sessionid] [cluster] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:51:12.304674Z :DEBUG: [db] [sessionid] [cluster] In Reconnect, ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:51:12.304743Z :DEBUG: [db] [sessionid] [cluster] New values: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:51:12.304767Z :DEBUG: [db] [sessionid] [cluster] Reconnecting session to cluster cluster in 0.000000s
2025-11-03T16:51:12.305053Z :ERROR: [db] [sessionid] [cluster] Got error. Status: INTERNAL_ERROR. Description: 
2025-11-03T16:51:12.305090Z :DEBUG: [db] [sessionid] [cluster] In Reconnect, ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:51:12.305110Z :DEBUG: [db] [sessionid] [cluster] New values: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:51:12.305248Z :INFO: [db] [sessionid] [cluster] Closing session to cluster: SessionClosed { Status: INTERNAL_ERROR Issues: "<main>: Error: Failed to establish connection to server "" ( cluster cluster). Attempts done: 1 " }
2025-11-03T16:51:12.306014Z :DEBUG: [db] [sessionid] [cluster] In Reconnect, ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:51:12.306038Z :DEBUG: [db] [sessionid] [cluster] New values: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:51:12.306054Z :DEBUG: [db] [sessionid] [cluster] Reconnecting session to cluster cluster in 0.000000s
2025-11-03T16:51:12.306390Z :ERROR: [db] [sessionid] [cluster] Got error. Status: TIMEOUT. Description: <main>: Error: Failed to establish connection to server. Attempts done: 1 
2025-11-03T16:51:12.306426Z :DEBUG: [db] [sessionid] [cluster] In Reconnect, ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:51:12.306449Z :DEBUG: [db] [sessionid] [cluster] New values: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:51:12.306509Z :INFO: [db] [sessionid] [cluster] Closing session to cluster: SessionClosed { Status: TIMEOUT Issues: "<main>: Error: Failed to establish connection to server. Attempts done: 1 " }
2025-11-03T16:51:12.307223Z :DEBUG: [db] [sessionid] [cluster] In Reconnect, ReadSizeBudget = 2500, ReadSizeServerDelta = 0
2025-11-03T16:51:12.307261Z :DEBUG: [db] [sessionid] [cluster] New values: ReadSizeBudget = 2500, ReadSizeServerDelta = 0
2025-11-03T16:51:12.307298Z :DEBUG: [db] [sessionid] [cluster] Reconnecting session to cluster cluster in 0.000000s
2025-11-03T16:51:12.307577Z :DEBUG: [db] [sessionid] [cluster] Successfully connected. Initializing session
2025-11-03T16:51:12.308012Z :INFO: [db] [sessionid] [cluster] Server session id: 123-session-id-321
2025-11-03T16:51:12.352524Z :DEBUG: [db] [sessionid] [cluster] After sending read request: ReadSizeBudget = 2500, ReadSizeServerDelta = 0
2025-11-03T16:51:12.353972Z :INFO: [db] [sessionid] [cluster] Confirm partition stream create. Partition stream id: 1. Cluster: "TestCluster". Topic: "TestTopic". Partition: 1. Read offset: (NULL)
2025-11-03T16:51:12.354313Z :INFO: [db] [sessionid] [cluster] Confirm partition stream create. Partition stream id: 2. Cluster: "TestCluster". Topic: "TestTopic". Partition: 2. Read offset: (NULL)
2025-11-03T16:51:12.358047Z :DEBUG: Decompression task done. Partition/PartitionSessionId: 1 (1-50)
2025-11-03T16:51:12.358470Z :DEBUG: Take Data. Partition 1. Read: {0, 0} (1-1)
2025-11-03T16:51:12.358515Z :DEBUG: Take Data. Partition 1. Read: {0, 1} (2-2)
2025-11-03T16:51:12.358545Z :DEBUG: Take Data. Partition 1. Read: {0, 2} (3-3)
2025-11-03T16:51:12.358566Z :DEBUG: Take Data. Partition 1. Read: {0, 3} (4-4)
2025-11-03T16:51:12.358601Z :DEBUG: Take Data. Partition 1. Read: {0, 4} (5-5)
2025-11-03T16:51:12.358621Z :DEBUG: Take Data. Partition 1. Read: {0, 5} (6-6)
2025-11-03T16:51:12.358641Z :DEBUG: Take Data. Partition 1. Read: {0, 6} (7-7)
2025-11-03T16:51:12.358665Z :DEBUG: Take Data. Partition 1. Read: {0, 7} (8-8)
2025-11-03T16:51:12.358702Z :DEBUG: Take Data. Partition 1. Read: {0, 8} (9-9)
2025-11-03T16:51:12.358722Z :DEBUG: Take Data. Partition 1. Read: {0, 9} (10-10)
2025-11-03T16:51:12.358742Z :DEBUG: Take Data. Partition 1. Read: {0, 10} (11-11)
2025-11-03T16:51:12.358775Z :DEBUG: Take Data. Partition 1. Read: {0, 11} (12-12)
2025-11-03T16:51:12.358797Z :DEBUG: Take Data. Partition 1. Read: {0, 12} (13-13)
2025-11-03T16:51:12.358831Z :DEBUG: Take Data. Partition 1. Read: {0, 13} (14-14)
2025-11-03T16:51:12.358850Z :DEBUG: Take Data. Partition 1. Read: {0, 14} (15-15)
2025-11-03T16:51:12.358887Z :DEBUG: Take Data. Partition 1. Read: {0, 15} (16-16)
2025-11-03T16:51:12.358946Z :DEBUG: Take Data. Partition 1. Read: {0, 16} (17-17)
2025-11-03T16:51:12.358967Z :DEBUG: Take Data. Partition 1. Read: {0, 17} (18-18)
2025-11-03T16:51:12.358986Z :DEBUG: Take Data. Partition 1. Read: {0, 18} (19-19)
2025-11-03T16:51:12.359005Z :DEBUG: Take Data. Partition 1. Read: {0, 19} (20-20)
2025-11-03T16:51:12.359029Z :DEBUG: Take Data. Partition 1. Read: {0, 20} (21-21)
2025-11-03T16:51:12.359048Z :DEBUG: Take Data. Partition 1. Read: {0, 21} (22-22)
2025-11-03T16:51:12.359067Z :DEBUG: Take Data. Partition 1. Read: {1, 0} (23-23)
2025-11-03T16:51:12.359082Z :DEBUG: Take Data. Partition 1. Read: {1, 1} (24-24)
2025-11-03T16:51:12.359097Z :DEBUG: Take Data. Partition 1. Read: {1, 2} (25-25)
2025-11-03T16:51:12.359122Z :DEBUG: Take Data. Partition 1. Read: {1, 3} (26-26)
2025-11-03T16:51:12.359144Z :DEBUG: Take Data. Partition 1. Read: {1, 4} (27-27)
2025-11-03T16:51:12.359159Z :DEBUG: Take Data. Partition 1. Read: {1, 5} (28-28)
2025-11-03T16:51:12.359179Z :DEBUG: Take Data. Partition 1. Read: {1, 6} (29-29)
2025-11-03T16:51:12.359196Z :DEBUG: Take Data. Partition 1. Read: {1, 7} (30-30)
2025-11-03T16:51:12.359216Z :DEBUG: Take Data. Partition 1. Read: {1, 8} (31-31)
2025-11-03T16:51:12.359244Z :DEBUG: Take Data. Partition 1. Read: {1, 9} (32-32)
2025-11-03T16:51:12.359319Z :DEBUG: Take Data. Partition 1. Read: {1, 10} (33-33)
2025-11-03T16:51:12.359345Z :DEBUG: Take Data. Partition 1. Read: {1, 11} (34-34)
2025-11-03T16:51:12.359366Z :DEBUG: Take Data. Partition 1. Read: {1, 12} (35-35)
2025-11-03T16:51:12.359383Z :DEBUG: Take Data. Partition 1. Read: {1, 13} (36-36)
2025-11-03T16:51:12.359403Z :DEBUG: Take Data. Partition 1. Read: {1, 14} (37-37)
2025-11-03T16:51:12.359420Z :DEBUG: Take Data. Partition 1. Read: {1, 15} (38-38)
2025-11-03T16:51:12.359436Z :DEBUG: Take Data. Partition 1. Read: {1, 16} (39-39)
2025-11-03T16:51:12.359471Z :DEBUG: Take Data. Partition 1. Read: {1, 17} (40-40)
2025-11-03T16:51:12.359491Z :DEBUG: Take Data. Partition 1. Read: {1, 18} (41-41)
2025-11-03T16:51:12.359514Z :DEBUG: Take Data. Partition 1. Read: {1, 19} (42-42)
2025-11-03T16:51:12.359532Z :DEBUG: Take Data. Partition 1. Read: {1, 20} (43-43)
2025-11-03T16:51:12.359554Z :DEBUG: Take Data. Partition 1. Read: {1, 21} (44-44)
2025-11-03T16:51:12.359572Z :DEBUG: Take Data. Partition 1. Read: {1, 22} (45-45)
2025-11-03T16:51:12.359589Z :DEBUG: Take Data. Partition 1. Read: {1, 23} (46-46)
2025-11-03T16:51:12.359606Z :DEBUG: Take Data. Partition 1. Read: {1, 24} (47-47)
2025-11-03T16:51:12.359636Z :DEBUG: Take Data. Partition 1. Read: {1, 25} (48-48)
2025-11-03T16:51:12.359655Z :DEBUG: Take Data. Partition 1. Read: {1, 26} (49-49)
2025-11-03T16:51:12.359680Z :DEBUG: Take Data. Partition 1. Read: {1, 27} (50-50)
2025-11-03T16:51:12.359735Z :DEBUG: [db] [sessionid] [cluster] The application data is transferred to the client. Number of messages 50, size 5000 bytes
2025-11-03T16:51:12.362856Z :DEBUG: Decompression task done. Partition/PartitionSessionId: 2 (51-100)
2025-11-03T16:51:12.363249Z :DEBUG: Take Data. Partition 2. Read: {0, 0} (51-51)
2025-11-03T16:51:12.363314Z :DEBUG: Take Data. Partition 2. Read: {0, 1} (52-52)
2025-11-03T16:51:12.363344Z :DEBUG: Take Data. Partition 2. Read: {0, 2} (53-53)
2025-11-03T16:51:12.363365Z :DEBUG: Take Data. Partition 2. Read: {0, 3} (54-54)
2025-11-03T16:51:12.363390Z :DEBUG: Take Data. Partition 2. Read: {0, 4} (55-55)
2025-11-03T16:51:12.363410Z :DEBUG: Take Data. Partition 2. Read: {0, 5} (56-56)
2025-11-03T16:51:12.363434Z :DEBUG: Take Data. Partition 2. Read: {0, 6} (57-57)
2025-11-03T16:51:12.363457Z :DEBUG: Take Data. Partition 2. Read: {0, 7} (58-58)
2025-11-03T16:51:12.363493Z :DEBUG: Take Data. Partition 2. Read: {0, 8} (59-59)
2025-11-03T16:51:12.363515Z :DEBUG: Take Data. Partition 2. Read: {0, 9} (60-60)
2025-11-03T16:51:12.363535Z :DEBUG: Take Data. Partition 2. Read: {0, 10} (61-61)
2025-11-03T16:51:12.363554Z :DEBUG: Take Data. Partition 2. Read: {0, 11} (62-62)
2025-11-03T16:51:12.363578Z :DEBUG: Take Data. Partition 2. Read: {0, 12} (63-63)
2025-11-03T16:51:12.363596Z :DEBUG: Take Data. Partition 2. Read: {0, 13} (64-64)
2025-11-03T16:51:12.363631Z :DEBUG: Take Data. Partition 2. Read: {0, 14} (65-65)
2025-11-03T16:51:12.363665Z :DEBUG: Take Data. Partition 2. Read: {0, 15} (66-66)
2025-11-03T16:51:12.363712Z :DEBUG: Take Data. Partition 2. Read: {0, 16} (67-67)
2025-11-03T16:51:12.363746Z :DEBUG: Take Data. Partition 2. Read: {0, 17} (68-68)
2025-11-03T16:51:12.363764Z :DEBUG: Take Data. Partition 2. Read: {0, 18} (69-69)
2025-11-03T16:51:12.363781Z :DEBUG: Take Data. Partition 2. Read: {0, 19} (70-70)
2025-11-03T16:51:12.363801Z :DEBUG: Take Data. Partition 2. Read: {0, 20} (71-71)
2025-11-03T16:51:12.363872Z :DEBUG: Take Data. Partition 2. Read: {0, 21} (72-72)
2025-11-03T16:51:12.363910Z :DEBUG: Take Data. Partition 2. Read: {1, 0} (73-73)
2025-11-03T16:51:12.363941Z :DEBUG: Take Data. Partition 2. Read: {1, 1} (74-74)
2025-11-03T16:51:12.363967Z :DEBUG: Take Data. Partition 2. Read: {1, 2} (75-75)
2025-11-03T16:51:12.364002Z :DEBUG: Take Data. Partition 2. Read: {1, 3} (76-76)
2025-11-03T16:51:12.364022Z :DEBUG: Take Data. Partition 2. Read: {1, 4} (77-77)
2025-11-03T16:51:12.364040Z :DEBUG: Take Data. Partition 2. Read: {1, 5} (78-78)
2025-11-03T16:51:12.364078Z :DEBUG: Take Data. Partition 2. Read: {1, 6} (79-79)
2025-11-03T16:51:12.364097Z :DEBUG: Take Data. Partition 2. Read: {1, 7} (80-80)
2025-11-03T16:51:12.364117Z :DEBUG: Take Data. Partition 2. Read: {1, 8} (81-81)
2025-11-03T16:51:12.364151Z :DEBUG: Take Data. Partition 2. Read: {1, 9} (82-82)
2025-11-03T16:51:12.364250Z :DEBUG: Take Data. Partition 2. Read: {1, 10} (83-83)
2025-11-03T16:51:12.364273Z :DEBUG: Take Data. Partition 2. Read: {1, 11} (84-84)
2025-11-03T16:51:12.364292Z :DEBUG: Take Data. Partition 2. Read: {1, 12} (85-85)
2025-11-03T16:51:12.364311Z :DEBUG: Take Data. Partition 2. Read: {1, 13} (86-86)
2025-11-03T16:51:12.364343Z :DEBUG: Take Data. Partition 2. Read: {1, 14} (87-87)
2025-11-03T16:51:12.364362Z :DEBUG: Take Data. Partition 2. Read: {1, 15} (88-88)
2025-11-03T16:51:12.364388Z :DEBUG: Take Data. Partition 2. Read: {1, 16} (89-89)
2025-11-03T16:51:12.364407Z :DEBUG: Take Data. Partition 2. Read: {1, 17} (90-90)
2025-11-03T16:51:12.364428Z :DEBUG: Take Data. Partition 2. Read: {1, 18} (91-91)
2025-11-03T16:51:12.364445Z :DEBUG: Take Data. Partition 2. Read: {1, 19} (92-92)
2025-11-03T16:51:12.364464Z :DEBUG: Take Data. Partition 2. Read: {1, 20} (93-93)
2025-11-03T16:51:12.364481Z :DEBUG: Take Data. Partition 2. Read: {1, 21} (94-94)
2025-11-03T16:51:12.364518Z :DEBUG: Take Data. Partition 2. Read: {1, 22} (95-95)
2025-11-03T16:51:12.364539Z :DEBUG: Take Data. Partition 2. Read: {1, 23} (96-96)
2025-11-03T16:51:12.364557Z :DEBUG: Take Data. Partition 2. Read: {1, 24} (97-97)
2025-11-03T16:51:12.364585Z :DEBUG: Take Data. Partition 2. Read: {1, 25} (98-98)
2025-11-03T16:51:12.364610Z :DEBUG: Take Data. Partition 2. Read: {1, 26} (99-99)
2025-11-03T16:51:12.364629Z :DEBUG: Take Data. Partition 2. Read: {1, 27} (100-100)
2025-11-03T16:51:12.364679Z :DEBUG: [db] [sessionid] [cluster] The application data is transferred to the client. Number of messages 50, size 5000 bytes
2025-11-03T16:51:12.385265Z :DEBUG: [db] [sessionid] [cluster] After sending read request: ReadSizeBudget = 2500, ReadSizeServerDelta = 0
2025-11-03T16:51:12.386907Z :DEBUG: [db] [sessionid] [cluster] In Reconnect, ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:51:12.386944Z :DEBUG: [db] [sessionid] [cluster] New values: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:51:12.386967Z :DEBUG: [db] [sessionid] [cluster] Reconnecting session to cluster cluster in 0.000000s
2025-11-03T16:51:12.399495Z :DEBUG: [db] [sessionid] [cluster] Successfully connected. Initializing session
2025-11-03T16:51:12.400288Z :INFO: [db] [sessionid] [cluster] Server session id: 123-session-id-321
2025-11-03T16:51:12.400538Z :DEBUG: [db] [sessionid] [cluster] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:51:12.404904Z :INFO: [db] [sessionid] [cluster] Confirm partition stream create. Partition stream id: 1. Cluster: "TestCluster". Topic: "TestTopic". Partition: 1. Read offset: (NULL)
2025-11-03T16:51:12.508931Z :DEBUG: [db] [sessionid] [cluster] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:51:12.509160Z :DEBUG: Decompression task done. Partition/PartitionSessionId: 1 (1-2)
2025-11-03T16:51:12.509226Z :DEBUG: Take Data. Partition 1. Read: {0, 0} (1-1)
2025-11-03T16:51:12.509265Z :DEBUG: Take Data. Partition 1. Read: {1, 0} (2-2)
2025-11-03T16:51:12.509333Z :DEBUG: [db] [sessionid] [cluster] The application data is transferred to the client. Number of messages 2, size 6 bytes
2025-11-03T16:51:12.720090Z :DEBUG: [db] [sessionid] [cluster] Commit offsets [1, 3). Partition stream id: 1
2025-11-03T16:51:12.820572Z :DEBUG: [db] [sessionid] [cluster] Committed response: cookies { assign_id: 1 partition_cookie: 1 }
2025-11-03T16:51:12.820706Z :INFO: [db] [sessionid] [cluster] Confirm partition stream destroy. Partition stream id: 1. Cluster: "TestCluster". Topic: "TestTopic". Partition: 1
2025-11-03T16:51:12.820851Z :DEBUG: [db] [sessionid] [cluster] Abort session to cluster
2025-11-03T16:51:12.821960Z :DEBUG: [db] [sessionid] [cluster] In Reconnect, ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:51:12.821989Z :DEBUG: [db] [sessionid] [cluster] New values: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:51:12.822012Z :DEBUG: [db] [sessionid] [cluster] Reconnecting session to cluster cluster in 0.000000s
2025-11-03T16:51:12.822334Z :DEBUG: [db] [sessionid] [cluster] Successfully connected. Initializing session
2025-11-03T16:51:12.822779Z :INFO: [db] [sessionid] [cluster] Server session id: 123-session-id-321
2025-11-03T16:51:12.822963Z :DEBUG: [db] [sessionid] [cluster] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:51:12.823289Z :INFO: [db] [sessionid] [cluster] Confirm partition stream create. Partition stream id: 1. Cluster: "TestCluster". Topic: "TestTopic". Partition: 1. Read offset: (NULL)
2025-11-03T16:51:12.924875Z :DEBUG: [db] [sessionid] [cluster] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:51:12.925094Z :DEBUG: Decompression task done. Partition/PartitionSessionId: 1 (1-2)
2025-11-03T16:51:12.925146Z :DEBUG: Take Data. Partition 1. Read: {0, 0} (1-1)
2025-11-03T16:51:12.925182Z :DEBUG: Take Data. Partition 1. Read: {1, 0} (2-2)
2025-11-03T16:51:12.925246Z :DEBUG: [db] [sessionid] [cluster] Commit offsets [1, 3). Partition stream id: 1
2025-11-03T16:51:12.925332Z :DEBUG: [db] [sessionid] [cluster] The application data is transferred to the client. Number of messages 2, size 6 bytes
2025-11-03T16:51:12.925501Z :DEBUG: [db] [sessionid] [cluster] Committed response: cookies { assign_id: 1 partition_cookie: 1 }
2025-11-03T16:51:12.925567Z :INFO: [db] [sessionid] [cluster] Confirm partition stream destroy. Partition stream id: 1. Cluster: "TestCluster". Topic: "TestTopic". Partition: 1
2025-11-03T16:51:12.925663Z :DEBUG: [db] [sessionid] [cluster] Abort session to cluster
2025-11-03T16:51:14.902666Z :DEBUG: [db] [sessionid] [cluster] In Reconnect, ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:51:14.902709Z :DEBUG: [db] [sessionid] [cluster] New values: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:51:14.903673Z :DEBUG: [db] [sessionid] [cluster] Reconnecting session to cluster cluster in 0.000000s
2025-11-03T16:51:14.904289Z :ERROR: [db] [sessionid] [cluster] Got error. Status: INTERNAL_ERROR. Description: 
2025-11-03T16:51:14.904350Z :DEBUG: [db] [sessionid] [cluster] In Reconnect, ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:51:14.904381Z :DEBUG: [db] [sessionid] [cluster] New values: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:51:14.905561Z :DEBUG: [db] [sessionid] [cluster] Reconnecting session to cluster cluster in 0.006116s
2025-11-03T16:51:14.906327Z :ERROR: [db] [sessionid] [cluster] Got error. Status: INTERNAL_ERROR. Description: 
2025-11-03T16:51:14.906364Z :DEBUG: [db] [sessionid] [cluster] In Reconnect, ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:51:14.906398Z :DEBUG: [db] [sessionid] [cluster] New values: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:51:14.906468Z :DEBUG: [db] [sessionid] [cluster] Reconnecting session to cluster cluster in 0.006475s
2025-11-03T16:51:14.906983Z :ERROR: [db] [sessionid] [cluster] Got error. Status: INTERNAL_ERROR. Description: 
2025-11-03T16:51:14.907024Z :DEBUG: [db] [sessionid] [cluster] In Reconnect, ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:51:14.907047Z :DEBUG: [db] [sessionid] [cluster] New values: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-03T16:51:14.907127Z :DEBUG: [db] [sessionid] [cluster] Reconnecting session to cluster cluster in 0.006323s
2025-11-03T16:51:14.947972Z :TWriteSession_TestPolicy INFO: Random seed for debugging is 1762188674947935
2025-11-03T16:51:15.713449Z node 1 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[1:7568542730727198944:2158];send_to=[0:7307199536658146131:7762515];
2025-11-03T16:51:15.713947Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
test_client.cpp: SetPath # /home/runner/.ya/build/build_root/7jz3/00196f/r3tmp/tmpkI3wZ5/pdisk_1.dat
2025-11-03T16:51:15.769776Z node 2 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[2:7568542730724745854:2190];send_to=[0:7307199536658146131:7762515];
2025-11-03T16:51:15.805583Z node 1 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-11-03T16:51:15.831266Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-11-03T16:51:15.831615Z node 2 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
2025-11-03T16:51:16.256242Z node 2 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-11-03T16:51:16.295771Z node 1 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-11-03T16:51:16.345999Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(1, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-11-03T16:51:16.346132Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(1, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-11-03T16:51:16.348736Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(2, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-11-03T16:51:16.348799Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(2, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-11-03T16:51:16.367195Z node 1 :HIVE WARN: hive_impl.cpp:811: HIVE#72057594037968897 Handle TEvInterconnect::TEvNodeConnected, NodeId 2 Cookie 2
2025-11-03T16:51:16.367391Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(1, (0,0,0,0)) VolatileState: Connecting -> Connected
2025-11-03T16:51:16.367918Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(2, (0,0,0,0)) VolatileState: Connecting -> Connected
2025-11-03T16:51:16.460343Z node 1 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
2025-11-03T16:51:16.490060Z node 2 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-11-03T16:51:16.490730Z node 1 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
TServer::EnableGrpc on GrpcPort 1567, node 1
2025-11-03T16:51:16.711469Z node 1 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-11-03T16:51:16.720811Z node 1 :NET_CLASSIFIER WARN: net_classifier.cpp:190: distributable config is empty, broken or outdated, will use file: /home/runner/.ya/build/build_root/7jz3/00196f/r3tmp/yandexWpc9xy.tmp
2025-11-03T16:51:16.720836Z node 1 :NET_CLASSIFIER WARN: net_classifier.cpp:196: will try to initialize from file: /home/runner/.ya/build/build_root/7jz3/00196f/r3tmp/yandexWpc9xy.tmp
2025-11-03T16:51:16.720972Z node 1 :NET_CLASSIFIER WARN: net_classifier.cpp:202: successfully initialized from file: /home/runner/.ya/build/build_root/7jz3/00196f/r3tmp/yandexWpc9xy.tmp
2025-11-03T16:51:16.721103Z node 1 :NET_CLASSIFIER ERROR: net_classifier.cpp:228: got bad distributable configuration
2025-11-03T16:51:16.792273Z node 2 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-11-03T16:51:16.804335Z INFO: TTestServer started on Port 3435 GrpcPort 1567
TClient is connected to server localhost:3435
PQClient connected to localhost:1567
WaitRootIsUp 'Root'...
TClient::Ls request: Root
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "Root"
    PathId: 1
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 1
    CreateStep: 0
    ParentPathId: 1
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 1
      SubDomainVersion: 0
      SecurityStateVersion: 0
    }
    ChildrenExist: false
  }
  Children {
    Name: ".sys"
    PathId: 18446744073709551615
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 0
    CreateStep: 0
    ParentPathId: 18446744073709551615
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 0
      Pl...
(TRUNCATED)
WaitRootIsUp 'Root' success.
2025-11-03T16:51:17.206826Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpAlterSubDomain, opId: 281474976715657:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_alter_subdomain.cpp:311)
waiting...
waiting...
waiting...
waiting...
2025-11-03T16:51:20.034199Z node 2 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [2:7568542752199582521:2303], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-03T16:51:20.034237Z node 2 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [2:7568542752199582514:2300], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-03T16:51:20.034337Z node 2 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-03T16:51:20.034603Z node 2 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [2:7568542752199582544:2305], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-03T16:51:20.034660Z node 2 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-03T16:51:20.034503Z node 1 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [1:7568542752202036302:2329], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-03T16:51:20.034585Z node 1 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [1:7568542752202036314:2332], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-03T16:51:20.034623Z node 1 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-03T16:51:20.035940Z node 1 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [1:7568542752202036317:2334], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-03T16:51:20.036022Z node 1 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-03T16:51:20.042985Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateResourcePool, opId: 281474976715661:3, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_resource_pool.cpp:179)
2025-11-03T16:51:20.050125Z node 1 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [1:7568542752202036354:2336], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-03T16:51:20.050211Z node 1 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-03T16:51:20.050514Z node 1 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [1:7568542752202036356:2337], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-03T16:51:20.050600Z node 1 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-03T16:51:20.053487Z node 2 :TX_PROXY ERROR: schemereq.cpp:593: Actor# [2:7568542752199582546:2134] txid# 281474976720657, issues: { message: "Check failed: path: \'/Root/.metadata/workload_manager/pools/default\', error: path exists but creating right now (id: [OwnerId: 72057594046644480, LocalPathId: 8], type: EPathTypeResourcePool, state: EPathStateCreate)" severity: 1 }
2025-11-03T16:51:20.093495Z node 2 :KQP_WORKLOAD_SERVICE WARN: helpers.h:73: [WorkloadService] [TPoolCreatorActor] ActorId: [2:7568542752199582543:2304], DatabaseId: /Root, PoolId: default, Scheduled retry for error: { <main>: Error: Transaction 281474976715661 completed, doublechecking }
2025-11-03T16:51:20.092179Z node 1 :KQP_WORKLOAD_SERVICE WARN: helpers.h:73: [WorkloadService] [TPoolCreatorActor] ActorId: [1:7568542752202036316:2333], DatabaseId: /Root, PoolId: default, Scheduled retry for error: { <main>: Error: Transaction 281474976715661 completed, doublechecking }
2025-11-03T16:51:20.167080Z node 2 :TX_PROXY ERROR: schemereq.cpp:593: Actor# [2:7568542752199582573:2140] txid# 281474976720658, issues: { message: "Check failed: path: \'/Root/.metadata/workload_manager/pools/default\', error: path exist, request accepts it (id: [OwnerId: 72057594046644480, LocalPathId: 8], type: EPathTypeResourcePool, state: EPathStateNoChanges)" severity: 1 }
2025-11-03T16:51:20.199766Z node 1 :TX_PROXY ERROR: schemereq.cpp:593: Actor# [1:7568542752202036403:2692] txid# 281474976715662, issues: { message: "Check failed: path: \'/Root/.metadata/workload_manager/pools/default\', error: path exist, request accepts it (id: [OwnerId: 72057594046644480, LocalPathId: 8], type: EPathTypeResourcePool, state: EPathStateNoChanges)" severity: 1 }
2025-11-03T16:51:20.387823Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976715663:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:690)
2025-11-03T16:51:20.394543Z node 1 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:570: Compilation failed, self: [1:7568542752202036420:2341], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-11-03T16:51:20.394881Z node 1 :KQP_SESSION WARN: kqp_session_actor.cpp:2506: SessionId: ydb://session/3?node_id=1&id=OTdiN2JkOWItMTU4MGIyMWUtYTI2YjE1NGYtNDllYmI4Y2U=, ActorId: [1:7568542752202036299:2327], ActorState: ExecuteState, TraceId: 01k95a2ptjfza4jtctzk7k34ps, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-11-03T16:51:20.394540Z node 2 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:570: Compilation failed, self: [2:7568542752199582580:2309], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-11-03T16:51:20.396178Z node 2 :KQP_SESSION WARN: kqp_session_actor.cpp:2506: SessionId: ydb://session/3?node_id=2&id=M2UxZTQ5NDctNDI2OGUwYjMtMmRmYmY0M2UtMzQxYjY3NmY=, ActorId: [2:7568542752199582511:2298], ActorState: ExecuteState, TraceId: 01k95a2ptw50e8dwak3fvc3vp4, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-11-03T16:51:20.397813Z node 2 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-11-03T16:51:20.397585Z node 1 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-11-03T16:51:20.578383Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976715664:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:690)
2025-11-03T16:51:20.710570Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[1:7568542730727198944:2158];send_to=[0:7307199536658146131:7762515];
2025-11-03T16:51:20.710634Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
2025-11-03T16:51:20.762565Z node 2 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[2:7568542730724745854:2190];send_to=[0:7307199536658146131:7762515];
2025-11-03T16:51:20.762638Z node 2 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
2025-11-03T16:51:20.793381Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976715665:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:690)
=== Init DC: UPSERT INTO `/Root/PQ/Config/V2/Cluster` (name, balancer, local, enabled, weight) VALUES ("dc1", "localhost:1567", true, true, 1000);
2025-11-03T16:51:21.029571Z node 1 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976715666. Ctx: { TraceId: 01k95a2qnkd0hk9g0t93030vws, Database: , SessionId: ydb://session/3?node_id=1&id=OGY0ZDdlMDItNTY0MTM0ZjEtZWZlZGMzM2ItYjEwNGI3ODU=, PoolId: default, DatabaseId: /Root}. Database not set, use /Root
=== CheckClustersList. Subcribe to ClusterTracker from [1:7568542756497004117:2988] 
=== CheckClustersList. Ok
2025-11-03T16:51:27.506831Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976715671:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:690)
waiting...
PQ Client: create topic: rt3.dc1--test-topic with 1 partitions
CallPersQueueGRPC request to localhost:1567
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
CallPersQueueGRPC request to localhost:1567
MetaRequest {
  CmdCreateTopic {
    Topic: "rt3.dc1--test-topic"
    NumPartitions: 1
    Config {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
  }
}
2025-11-03T16:51:27.665753Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
Status: 129
ProxyErrorCode: 53
SchemeStatus: 1
FlatTxId {
  TxId: 281474976715672
  SchemeShardTabletId: 72057594046644480
  PathId: 13
}
ErrorCode: OK
AddTopic: rt3.dc1--test-topic
===Run query:``DECLARE $version as Int64; DECLARE $path AS Utf8; DECLARE $cluster as Utf8; UPSERT INTO `/Root/PQ/Config/V2/Topics` (path, dc) VALUES ($path, $cluster); UPSERT INTO `/Root/PQ/Config/V2/Versions` (name, version) VALUES ("Topics", $version);`` with topic = test-topic, dc = dc1
2025-11-03T16:51:27.699965Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1655: [72075186224037893][] pipe [1:7568542782266808283:3231] connected; active server actors: 1
2025-11-03T16:51:27.700190Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1519: [72075186224037893][rt3.dc1--test-topic] updating configuration. Deleted partitions []. Added partitions [0]
2025-11-03T16:51:27.701789Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:971: [72075186224037893][rt3.dc1--test-topic] Discovered subdomain [OwnerId: 72057594046644480, LocalPathId: 1] state, outOfSpace = 0 at RB 72075186224037893
2025-11-03T16:51:27.702567Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:140: [72075186224037893][rt3.dc1--test-topic] BALANCER INIT DONE for rt3.dc1--test-topic: (0, 72075186224037892) 
2025-11-03T16:51:27.727326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2960: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-11-03T16:51:27.730449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2992: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-11-03T16:51:27.730675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:787: [PQ: 72075186224037892] no config, start with empty partitions and default config
2025-11-03T16:51:27.730724Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:913: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-11-03T16:51:27.730760Z node 2 :PERSQUEUE INFO: pq_impl.cpp:612: [PQ: 72075186224037892] doesn't have tx writes info
2025-11-03T16:51:27.731250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [1:7568542782266808282:3230], now have 1 active actors on pipe
2025-11-03T16:51:27.731273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [1:7568542782266808310:2437], now have 1 active actors on pipe
2025-11-03T16:51:27.731655Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:404: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1
2025-11-03T16:51:27.732275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-03T16:51:27.736328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-03T16:51:27.763886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [1:7568542782266808354:3285], now have 1 active actors on pipe
2025-11-03T16:51:27.764401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-03T16:51:27.767711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-03T16:51:27.768649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-11-03T16:51:27.768729Z node 2 :PERSQUEUE DEBUG: partition.cpp:1312: [72075186224037892][Partition][0][StateInit] HandleOnInit TEvPQ::TEvProposePartitionConfig
2025-11-03T16:51:27.769020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-11-03T16:51:27.769321Z node 2 :PERSQUEUE INFO: partition_init.cpp:1101: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7568542782264354108:2388]
2025-11-03T16:51:27.771098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-11-03T16:51:27.771128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-11-03T16:51:27.771148Z node 2 :PERSQUEUE INFO: partition.cpp:707: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1 [2:7568542782264354108:2388]
2025-11-03T16:51:27.771185Z node 2 :PERSQUEUE DEBUG: partition.cpp:727: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 0 Head Offset 0 PartNo 0 PackedSize 0 count 0 nextOffset 0 batches 0
2025-11-03T16:51:27.771221Z node 2 :PERSQUEUE DEBUG: partition_mlp.cpp:83: [72075186224037892][Partition][0][StateIdle] Initializing MLP Consumers: 0
2025-11-03T16:51:27.772745Z node 2 :PERSQUEUE DEBUG: partition.cpp:4273: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 1
2025-11-03T16:51:27.772789Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:27.772906Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:27.772922Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-03T16:51:27.772940Z node 2 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-11-03T16:51:27.772952Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:27.772967Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:27.772979Z node 2 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-11-03T16:51:27.773040Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:923: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-11-03T16:51:27.773073Z node 2 :PERSQUEUE DEBUG: partition_mlp.cpp:60: [72075186224037892][Partition][0][StateIdle] Process MLP pending events. Count 0
2025-11-03T16:51:27.773343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-03T16:51:27.773433Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:183: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:51:27.777297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-03T16:51:27.777412Z node 2 :PERSQUEUE DEBUG: partition.cpp:1416: [72075186224037892][Partition][0][StateIdle] Handle TEvPQ::TEvTxCommit Step 1762188687798, TxId 281474976715672
2025-11-03T16:51:27.777431Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:27.777443Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:27.777559Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:27.777808Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-03T16:51:27.781462Z node 2 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-03T16:51:27.781696Z node 2 :PERSQUEUE DEBUG: partition_mlp.cpp:83: [72075186224037892][Partition][0][StateIdle] Initializing MLP Consumers: 0
2025-11-03T16:51:27.781848Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-11-03T16:51:27.781879Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:27.781893Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:27.781914Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:27.781949Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:183: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:51:27.782318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:398: [PQ: 72075186224037892] Apply new config PartitionConfig { LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 } PartitionIds: 0 TopicName: "rt3.dc1--test-topic" Version: 0 LocalDC: true Codecs { Ids: 0 Ids: 1 Ids: 2 Codecs: "raw" Codecs: "gzip" Codecs: "lzop" } TopicPath: "/Root/PQ/rt3.dc1--test-topic" YcCloudId: "" YcFolderId: "" YdbDatabaseId: "" YdbDatabasePath: "/Root" Partitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } AllPartitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } Consumers { Name: "user" ReadFromTimestampsMs: 0 FormatVersion: 0 Version: 0 Generation: 0 } MonitoringProjectId: ""
2025-11-03T16:51:27.782418Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:913: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-11-03T16:51:27.782700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-03T16:51:27.789706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-03T16:51:27.789777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-03T16:51:27.791871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-03T16:51:27.815777Z node 1 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976715673. Ctx: { TraceId: 01k95a2yb23dx1hf0cngwe3chx, Database: , SessionId: ydb://session/3?node_id=1&id=MjAyYjM4YjMtOGNhZDE2MDgtNzU2NjhjOWYtNWU4N2NlZTk=, PoolId: default, DatabaseId: /Root}. Database not set, use /Root
===Query complete
TClient::Ls request: /Root/PQ/rt3.dc1--test-topic
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976715672
    CreateStep: 1762188687798
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts...
(TRUNCATED)
GetTopicVersionFromPath:  record Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976715672
    CreateStep: 1762188687798
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      YdbDatabasePath: "/Root"
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
    Partitions {
      PartitionId: 0
      TabletId: 72075186224037892
      Status: Active
    }
    AlterVersion: 1
    BalancerTabletID: 72075186224037893
    NextPartitionId: 1
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 1
      PlanResolution: 7
      Coordinators: 72057594046316545
      TimeCastBucketsPerMediator: 2
      Mediators: 72057594046382081
    }
    DomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    PathsInside: 12
    PathsLimit: 10000
    ShardsInside: 6
    ShardsLimit: 200000
    ResourcesDomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    DiskSpaceUsage {
      Tables {
        TotalSize: 0
        DataSize: 0
        IndexSize: 0
      }
      Topics {
        ReserveSize: 0
        AccountSize: 0
        DataSize: 0
        UsedReserveSize: 0
      }
    }
    PQPartitionsInside: 1
    PQPartitionsLimit: 1000000
    SchemeLimits {
      MaxDepth: 32
      MaxPaths: 10000
      MaxChildrenInDir: 100000
      MaxAclBytesSize: 10240
      MaxTableColumns: 200
      MaxTableColumnNameLength: 255
      MaxTableKeyColumns: 30
      MaxTableIndices: 20
      MaxShards: 200000
      MaxShardsInPath: 35000
      MaxConsistentCopyTargets: 10000
      MaxPathElementLength: 255
      ExtraPathSymbolsAllowed: "!\"#$%&\'()*+,-.:;<=>?@[\\]^_`{|}~"
      MaxPQPartitions: 1000000
      MaxTableCdcStreams: 5
      MaxExports: 10
      MaxImports: 10
      MaxColumnTableColumns: 10000
    }
  }
}
Path: "/Root/PQ/rt3.dc1--test-topic"
 name rt3.dc1--test-topic version1
CallPersQueueGRPC request to localhost:1567
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-11-03T16:51:27.848196Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
MetaResponse {
  CmdGetTopicMetadataResult {
    TopicInfo {
      Topic: "rt3.dc1--test-topic"
      NumPartitions: 1
      Config {
        PartitionConfig {
          LifetimeSeconds: 86400
          LowWatermark: 8388608
          SourceIdLifetimeSeconds: 86400
          WriteSpeedInBytesPerSecond: 20000000
          BurstSize: 20000000
          SourceIdMaxCounts: 6000000
        }
        Version: 1
        LocalDC: true
        Codecs {
          Ids: 0
          Ids: 1
          Ids: 2
          Codecs: "raw"
          Codecs: "gzip"
          Codecs: "lzop"
        }
        TopicPath: "/Root/PQ/rt3.dc1--test-topic"
        YdbDatabasePath: "/Root"
        Consumers {
          Name: "user"
          ReadFromTimestampsMs: 0
          FormatVersion: 0
          Version: 0
        }
      }
      ErrorCode: OK
    }
  }
}
=== Topic created, have version: 1
2025-11-03T16:51:27.864038Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: try to update token
2025-11-03T16:51:27.865398Z :INFO: [] MessageGroupId [src] SessionId [] Write session: Do CDS request
2025-11-03T16:51:27.865447Z :INFO: [] MessageGroupId [src] SessionId [] Start write session. Will connect to endpoint: localhost:1567
2025-11-03T16:51:27.874645Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:27.874677Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:27.874691Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:27.875993Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-11-03T16:51:27.876049Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1
2025-11-03T16:51:27.889949Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src" }
2025-11-03T16:51:27.893219Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src" }
2025-11-03T16:51:27.893422Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1 topic: "test-topic" message_group_id: "src" from ipv6:[::1]:34436
2025-11-03T16:51:27.893440Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:34436 proto=v1  topic=test-topic durationSec=0
2025-11-03T16:51:27.893451Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-11-03T16:51:27.895592Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1 sessionId:  describe result for acl check
2025-11-03T16:51:27.895745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-11-03T16:51:27.895757Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-11-03T16:51:27.895768Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-11-03T16:51:27.895786Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7568542782266808423:2458] (SourceId=src, PreferedPartition=(NULL)) StartKqpSession
2025-11-03T16:51:27.898089Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7568542782266808423:2458] (SourceId=src, PreferedPartition=(NULL)) Select from the table
2025-11-03T16:51:27.974864Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:27.974893Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:27.974903Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:28.075190Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:28.075215Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:28.075226Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:28.088206Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [1:7568542782266808423:2458] (SourceId=src, PreferedPartition=(NULL)) RequestPQRB
2025-11-03T16:51:28.091065Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1655: [72075186224037893][rt3.dc1--test-topic] pipe [1:7568542786561775760:2458] connected; active server actors: 1
2025-11-03T16:51:28.091164Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [1:7568542782266808423:2458] (SourceId=src, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=src
2025-11-03T16:51:28.091191Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7568542782266808423:2458] (SourceId=src, PreferedPartition=(NULL)) Update the table
2025-11-03T16:51:28.095404Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1659: [72075186224037893][rt3.dc1--test-topic] pipe [1:7568542786561775760:2458] disconnected.
2025-11-03T16:51:28.095445Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1670: [72075186224037893][rt3.dc1--test-topic] pipe [1:7568542786561775760:2458] disconnected; active server actors: 1
2025-11-03T16:51:28.095461Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1695: [72075186224037893][rt3.dc1--test-topic] pipe [1:7568542786561775760:2458] disconnected no session
2025-11-03T16:51:28.176208Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:28.176237Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:28.176248Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:28.197594Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7568542782266808423:2458] (SourceId=src, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-11-03T16:51:28.197628Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7568542782266808423:2458] (SourceId=src, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-11-03T16:51:28.197654Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7568542782266808423:2458] (SourceId=src, PreferedPartition=(NULL)) Start idle
2025-11-03T16:51:28.197681Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-11-03T16:51:28.199347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [1:7568542786561775784:2458], now have 1 active actors on pipe
2025-11-03T16:51:28.199403Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1
2025-11-03T16:51:28.199720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:28.199767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:28.199849Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src|8bd0f6f7-6635b3eb-cfaaa4fa-4ad8c1ba_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src
2025-11-03T16:51:28.199894Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:28.199925Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:28.199943Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-03T16:51:28.200002Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:28.200048Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-03T16:51:28.200103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-03T16:51:28.201313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:28.201339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:28.201419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-03T16:51:28.201752Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1 partition: 0 MaxSeqNo: 0 sessionId: src|8bd0f6f7-6635b3eb-cfaaa4fa-4ad8c1ba_0
2025-11-03T16:51:28.208201Z :INFO: [] MessageGroupId [src] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1762188688208 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-11-03T16:51:28.208332Z :INFO: [] MessageGroupId [src] SessionId [] Write session established. Init response: session_id: "src|8bd0f6f7-6635b3eb-cfaaa4fa-4ad8c1ba_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-11-03T16:51:28.208613Z :INFO: [] MessageGroupId [src] SessionId [src|8bd0f6f7-6635b3eb-cfaaa4fa-4ad8c1ba_0] Write session: close. Timeout = 0 ms
2025-11-03T16:51:28.208655Z :INFO: [] MessageGroupId [src] SessionId [src|8bd0f6f7-6635b3eb-cfaaa4fa-4ad8c1ba_0] Write session will now close
2025-11-03T16:51:28.208695Z :DEBUG: [] MessageGroupId [src] SessionId [src|8bd0f6f7-6635b3eb-cfaaa4fa-4ad8c1ba_0] Write session: aborting
2025-11-03T16:51:28.209125Z :INFO: [] MessageGroupId [src] SessionId [src|8bd0f6f7-6635b3eb-cfaaa4fa-4ad8c1ba_0] Write session: gracefully shut down, all writes complete
2025-11-03T16:51:28.209165Z :DEBUG: [] MessageGroupId [src] SessionId [src|8bd0f6f7-6635b3eb-cfaaa4fa-4ad8c1ba_0] Write session: destroy
2025-11-03T16:51:28.210055Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId: src|8bd0f6f7-6635b3eb-cfaaa4fa-4ad8c1ba_0 grpc read done: success: 0 data: 
2025-11-03T16:51:28.210081Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 1 sessionId: src|8bd0f6f7-6635b3eb-cfaaa4fa-4ad8c1ba_0 grpc read failed
2025-11-03T16:51:28.210108Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 1 sessionId: src|8bd0f6f7-6635b3eb-cfaaa4fa-4ad8c1ba_0 grpc closed
2025-11-03T16:51:28.210126Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1 sessionId: src|8bd0f6f7-6635b3eb-cfaaa4fa-4ad8c1ba_0 is DEAD
2025-11-03T16:51:28.210880Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-11-03T16:51:28.215340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [1:7568542786561775784:2458] destroyed
2025-11-03T16:51:28.215405Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-11-03T16:51:28.215445Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:28.215460Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:28.216198Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
====TYdbPqTestRetryPolicy()
2025-11-03T16:51:28.224510Z :TWriteSession_TestPolicy INFO: Enqueue message with sequence number 1
2025-11-03T16:51:28.256396Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [] Write session: try to update token
2025-11-03T16:51:28.257211Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [] Write session: Do CDS request
2025-11-03T16:51:28.258987Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [] Do schedule cds request after 0 ms
2025-11-03T16:51:28.262161Z :TWriteSession_TestPolicy INFO: Wait for writer event
2025-11-03T16:51:28.262263Z :INFO: [/Root] MessageGroupId [test-message-group-id] Running cds request ms
2025-11-03T16:51:28.272968Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [] Got CDS response: 
write_sessions_clusters { clusters { endpoint: "localhost:1567" name: "dc1" available: true } primary_cluster_selection_reason: CLIENT_LOCATION } version: 1
2025-11-03T16:51:28.273060Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [] Start write session. Will connect to endpoint: localhost:1567
2025-11-03T16:51:28.277106Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:28.277130Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:28.277140Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:28.291192Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-11-03T16:51:28.291223Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2
2025-11-03T16:51:28.292774Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [] Write session: send init request: init_request { topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" }
2025-11-03T16:51:28.293543Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" }
2025-11-03T16:51:28.293694Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2 topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" from ipv6:[::1]:34482
2025-11-03T16:51:28.293708Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:34482 proto=v1  topic=test-topic durationSec=0
2025-11-03T16:51:28.293717Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-11-03T16:51:28.295142Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2 sessionId:  describe result for acl check
2025-11-03T16:51:28.295275Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-11-03T16:51:28.295285Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-11-03T16:51:28.295294Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-11-03T16:51:28.295311Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7568542786561775797:2475] (SourceId=test-message-group-id, PreferedPartition=(NULL)) StartKqpSession
2025-11-03T16:51:28.297716Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7568542786561775797:2475] (SourceId=test-message-group-id, PreferedPartition=(NULL)) Select from the table
2025-11-03T16:51:28.312714Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [1:7568542786561775797:2475] (SourceId=test-message-group-id, PreferedPartition=(NULL)) RequestPQRB
2025-11-03T16:51:28.313005Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1655: [72075186224037893][rt3.dc1--test-topic] pipe [1:7568542786561775816:2475] connected; active server actors: 1
2025-11-03T16:51:28.313063Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [1:7568542786561775797:2475] (SourceId=test-message-group-id, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=test-message-group-id
2025-11-03T16:51:28.313078Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7568542786561775797:2475] (SourceId=test-message-group-id, PreferedPartition=(NULL)) Update the table
2025-11-03T16:51:28.313364Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1659: [72075186224037893][rt3.dc1--test-topic] pipe [1:7568542786561775816:2475] disconnected.
2025-11-03T16:51:28.313392Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1670: [72075186224037893][rt3.dc1--test-topic] pipe [1:7568542786561775816:2475] disconnected; active server actors: 1
2025-11-03T16:51:28.313422Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1695: [72075186224037893][rt3.dc1--test-topic] pipe [1:7568542786561775816:2475] disconnected no session
2025-11-03T16:51:28.320311Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7568542786561775797:2475] (SourceId=test-message-group-id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-11-03T16:51:28.320346Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7568542786561775797:2475] (SourceId=test-message-group-id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-11-03T16:51:28.320364Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7568542786561775797:2475] (SourceId=test-message-group-id, PreferedPartition=(NULL)) Start idle
2025-11-03T16:51:28.320393Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-11-03T16:51:28.321703Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1
2025-11-03T16:51:28.321364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [1:7568542786561775833:2475], now have 1 active actors on pipe
2025-11-03T16:51:28.321949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:28.321972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:28.322036Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner test-message-group-id
2025-11-03T16:51:28.322084Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:28.324183Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1762188688324 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-11-03T16:51:28.322100Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:28.322111Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-03T16:51:28.322146Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:28.324303Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [] Write session established. Init response: session_id: "test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-11-03T16:51:28.322182Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-03T16:51:28.322224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-03T16:51:28.322747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:28.322764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:28.322812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-03T16:51:28.323137Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2 partition: 0 MaxSeqNo: 0 sessionId: test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0
2025-11-03T16:51:28.324480Z :TWriteSession_TestPolicy INFO: Got new continue token
2025-11-03T16:51:28.324518Z :TWriteSession_TestPolicy INFO: [] Write messages with sequence numbers 1
2025-11-03T16:51:28.324557Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Write 1 messages with Id from 1 to 1
2025-11-03T16:51:28.324625Z :TWriteSession_TestPolicy INFO: Wait for writer event
2025-11-03T16:51:28.324646Z :TWriteSession_TestPolicy INFO: Got new continue token
2025-11-03T16:51:28.328258Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Write session: try to update token
2025-11-03T16:51:28.328319Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Send 1 message(s) (0 left), first sequence number is 1
2025-11-03T16:51:28.332336Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:51:28.332689Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:51:28.333314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:28.333349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:28.333421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-11-03T16:51:28.333799Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:28.334254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:51:28.334279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:51:28.334589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0test-message-group-id' SeqNo: 1 partNo : 0 messageNo: 1 size 98 offset: -1
2025-11-03T16:51:28.334629Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:51:28.334673Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:28.334700Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:28.334727Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-03T16:51:28.334832Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0test-message-group-id' seqNo 1 partNo 0
2025-11-03T16:51:28.335641Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0test-message-group-id' seqNo 1 partNo 0 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 187 count 1 nextOffset 1 batches 1
2025-11-03T16:51:28.335683Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:28.336251Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 0,1 HeadOffset 0 endOffset 0 curOffset 1 d0000000000_00000000000000000000_00000_0000000001_00000? size 175 WTime 1762188688333
2025-11-03T16:51:28.336396Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-03T16:51:28.336527Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 0 partNo 0 count 1 size 175
2025-11-03T16:51:28.339038Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 0 count 1 size 175 actorID [2:7568542782264354091:2388]
2025-11-03T16:51:28.339086Z node 2 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-03T16:51:28.339125Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 120 WriteNewSizeFromSupportivePartitions# 0
2025-11-03T16:51:28.339155Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:51:28.339199Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0test-message-group-id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 1, partNo: 0, Offset: 0 is stored on disk
2025-11-03T16:51:28.339302Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 0 suffix '63' size 175
2025-11-03T16:51:28.339395Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:923: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-11-03T16:51:28.339435Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:965: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-11-03T16:51:28.339451Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:51:28.339461Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:51:28.339470Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:51:28.339501Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:51:28.339538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1  requestId: <none> cookie: 1
2025-11-03T16:51:28.339648Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:880: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 partno 0 count 1 size 1024000 endOffset 1 max time lag 0ms effective offset 0
2025-11-03T16:51:28.339788Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:51:28.339864Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1105: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 175 count 1 last offset 0, current partition end offset: 1
2025-11-03T16:51:28.339890Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1121: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-11-03T16:51:28.339930Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 0 partno 0 count 1 parts_count 0 source 1 size 175 accessed 0 times before, last time 2025-11-03T16:51:28.000000Z
2025-11-03T16:51:28.339959Z node 2 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 3. All 1 blobs are from cache.
2025-11-03T16:51:28.340505Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Write session got write response: sequence_numbers: 1 offsets: 0 already_written: false write_statistics { persist_duration_ms: 4 }
2025-11-03T16:51:28.340018Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:572: FormAnswer for 1 blobs
2025-11-03T16:51:28.340552Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Write session: acknoledged message 1
2025-11-03T16:51:28.340146Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 0 totakecount 1 count 1 size 155 from pos 0 cbcount 1
2025-11-03T16:51:28.340214Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1015: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1762188688333 queuesize 0 startOffset 0
2025-11-03T16:51:28.340681Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 0 suffix '63'
====ExpectBreakDown
WAIT for retries...
KICK tablets
{"NodeId":1,"Down":true}
{"NodeId":2,"Down":true}
{"TabletsKicked":3}
{"TabletsKicked":3}
2025-11-03T16:51:28.359141Z :TWriteSession_TestPolicy INFO: Enqueue message with sequence number 2
2025-11-03T16:51:28.359194Z :TWriteSession_TestPolicy INFO: Enqueue message with sequence number 3
2025-11-03T16:51:28.359201Z :TWriteSession_TestPolicy INFO: [] Write messages with sequence numbers 2
2025-11-03T16:51:28.359275Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Write 1 messages with Id from 2 to 2
2025-11-03T16:51:28.359360Z :TWriteSession_TestPolicy INFO: Wait for writer event
2025-11-03T16:51:28.359393Z :TWriteSession_TestPolicy INFO: Got new continue token
2025-11-03T16:51:28.359464Z :TWriteSession_TestPolicy INFO: [] Write messages with sequence numbers 3
2025-11-03T16:51:28.359497Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Write 1 messages with Id from 3 to 3
2025-11-03T16:51:28.360071Z :TWriteSession_TestPolicy INFO: Wait for writer event
2025-11-03T16:51:28.360120Z :TWriteSession_TestPolicy INFO: Got new continue token
2025-11-03T16:51:28.360530Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Write session: try to update token
2025-11-03T16:51:28.360592Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Send 1 message(s) (1 left), first sequence number is 2
2025-11-03T16:51:28.361235Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Write session: try to update token
2025-11-03T16:51:28.361280Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Send 1 message(s) (0 left), first sequence number is 3
2025-11-03T16:51:28.363964Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:51:28.364033Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-11-03T16:51:28.364045Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-11-03T16:51:28.364265Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2 reason: pipe to partition's 0 tablet is dead #2 sessionId: test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0
2025-11-03T16:51:28.364482Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2 sessionId: test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0 is DEAD
====CreateRetryState
====CreateRetryState Initialized
Test retry state: get retry delay
2025-11-03T16:51:28.366068Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: pipe to partition's 0 tablet is dead #2, code: 500027 
2025-11-03T16:51:28.366103Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Write session will restart in 2.000000s
2025-11-03T16:51:28.366198Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Write session: Do CDS request
2025-11-03T16:51:28.366240Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Do schedule cds request after 2000 ms
2025-11-03T16:51:29.586149Z node 1 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976715678. Failed to resolve tablet: 72075186224037890 after several retries.
2025-11-03T16:51:29.586273Z node 1 :KQP_EXECUTER WARN: kqp_executer_impl.h:245: ActorId: [1:7568542786561775870:2479] TxId: 281474976715678. Ctx: { TraceId: 01k95a2z3v08xbnc3c6pnjnx6y, Database: /Root, SessionId: ydb://session/3?node_id=1&id=ZmI1MWE2NzUtNTVhOWNhZjEtMzVhOTQ1MDAtZGZhZWMwNzk=, PoolId: default}. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037890 after several retries.
2025-11-03T16:51:29.586530Z node 1 :KQP_SESSION WARN: kqp_session_actor.cpp:2987: SessionId: ydb://session/3?node_id=1&id=ZmI1MWE2NzUtNTVhOWNhZjEtMzVhOTQ1MDAtZGZhZWMwNzk=, ActorId: [1:7568542786561775846:2479], ActorState: ExecuteState, TraceId: 01k95a2z3v08xbnc3c6pnjnx6y, Create QueryResponse for error on request, msg: 
2025-11-03T16:51:29.587749Z node 1 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Failed to resolve tablet: 72075186224037890 after several retries." severity: 1 } TxMeta { id: "01k95a2zds3ptxgtxd2tgbt4bj" } } YdbStatus: UNAVAILABLE ConsumedRu: 208 }
2025-11-03T16:51:29.602542Z node 2 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976720663. Failed to resolve tablet: 72075186224037890 after several retries.
2025-11-03T16:51:29.602644Z node 2 :KQP_EXECUTER WARN: kqp_executer_impl.h:245: ActorId: [2:7568542786559321471:2396] TxId: 281474976720663. Ctx: { TraceId: 01k95a2z3n34axjtg4tsxzvfgr, Database: /Root, SessionId: ydb://session/3?node_id=2&id=YmZkMzQ4YTQtNTdiOTU3ZDYtZDM3NzgyMGYtM2JiODEzMDM=, PoolId: default}. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037890 after several retries.
2025-11-03T16:51:29.602887Z node 2 :KQP_SESSION WARN: kqp_session_actor.cpp:2987: SessionId: ydb://session/3?node_id=2&id=YmZkMzQ4YTQtNTdiOTU3ZDYtZDM3NzgyMGYtM2JiODEzMDM=, ActorId: [2:7568542786559321458:2396], ActorState: ExecuteState, TraceId: 01k95a2z3n34axjtg4tsxzvfgr, Create QueryResponse for error on request, msg: 
2025-11-03T16:51:29.603895Z node 2 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Failed to resolve tablet: 72075186224037890 after several retries." severity: 1 } TxMeta { id: "01k95a2zdzdpaq283h6rqssseb" } } YdbStatus: UNAVAILABLE ConsumedRu: 214 }
2025-11-03T16:51:30.372262Z :INFO: [/Root] MessageGroupId [test-message-group-id] Running cds request ms
2025-11-03T16:51:30.383740Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Got CDS response: 
write_sessions_clusters { clusters { endpoint: "localhost:1567" name: "dc1" available: true } primary_cluster_selection_reason: CLIENT_LOCATION } version: 1
2025-11-03T16:51:30.383813Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Start write session. Will connect to endpoint: localhost:1567
2025-11-03T16:51:30.389236Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" }
2025-11-03T16:51:30.389120Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-11-03T16:51:30.389148Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3
2025-11-03T16:51:30.389803Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" }
2025-11-03T16:51:30.389929Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3 topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" from ipv6:[::1]:34482
2025-11-03T16:51:30.389943Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:34482 proto=v1  topic=test-topic durationSec=0
2025-11-03T16:51:30.389952Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-11-03T16:51:30.391396Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3 sessionId:  describe result for acl check
2025-11-03T16:51:30.391504Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-11-03T16:51:30.391514Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-11-03T16:51:30.391521Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-11-03T16:51:30.391536Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7568542795151710546:2492] (SourceId=test-message-group-id, PreferedPartition=(NULL)) StartKqpSession
2025-11-03T16:51:30.393827Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7568542795151710546:2492] (SourceId=test-message-group-id, PreferedPartition=(NULL)) Select from the table
2025-11-03T16:51:31.172688Z node 1 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976715680. Failed to resolve tablet: 72075186224037891 after several retries.
2025-11-03T16:51:31.172792Z node 1 :KQP_EXECUTER WARN: kqp_executer_impl.h:245: ActorId: [1:7568542795151710557:2494] TxId: 281474976715680. Ctx: { TraceId: 01k95a30yt1gdxjsx5w7cjhm6w, Database: /Root, SessionId: ydb://session/3?node_id=1&id=MjIzYWYwOS05YmQ4N2NmNS1lZTgwOGZlYS03YmM4ODE4Nw==, PoolId: default}. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037891 after several retries.
2025-11-03T16:51:31.172988Z node 1 :KQP_SESSION WARN: kqp_session_actor.cpp:2987: SessionId: ydb://session/3?node_id=1&id=MjIzYWYwOS05YmQ4N2NmNS1lZTgwOGZlYS03YmM4ODE4Nw==, ActorId: [1:7568542795151710547:2494], ActorState: ExecuteState, TraceId: 01k95a30yt1gdxjsx5w7cjhm6w, Create QueryResponse for error on request, msg: 
2025-11-03T16:51:31.174958Z node 1 :PQ_PARTITION_CHOOSER INFO: partition_chooser_impl__abstract_chooser_actor.h:312: TPartitionChooser [1:7568542795151710546:2492] (SourceId=test-message-group-id, PreferedPartition=(NULL)) ReplyError: kqp error Marker# PQ50 : Response {
  SessionId: "ydb://session/3?node_id=1&id=MjIzYWYwOS05YmQ4N2NmNS1lZTgwOGZlYS03YmM4ODE4Nw=="
  QueryIssues {
    message: "Failed to resolve tablet: 72075186224037891 after several retries."
    severity: 1
  }
  TxMeta {
    id: "01k95a30yt1gdxjsx5wa1v4s6e"
  }
}
YdbStatus: UNAVAILABLE
ConsumedRu: 1
2025-11-03T16:51:31.175055Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3 reason: kqp error Marker# PQ50 : Response {
  SessionId: "ydb://session/3?node_id=1&id=MjIzYWYwOS05YmQ4N2NmNS1lZTgwOGZlYS03YmM4ODE4Nw=="
  QueryIssues {
    message: "Failed to resolve tablet: 72075186224037891 after several retries."
    severity: 1
  }
  TxMeta {
    id: "01k95a30yt1gdxjsx5wa1v4s6e"
  }
}
YdbStatus: UNAVAILABLE
ConsumedRu: 1
 sessionId: 
2025-11-03T16:51:31.175424Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3 sessionId:  is DEAD
Test retry state: get retry delay
2025-11-03T16:51:31.180218Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: kqp error Marker# PQ50 : Response {   SessionId: "ydb://session/3?node_id=1&id=MjIzYWYwOS05YmQ4N2NmNS1lZTgwOGZlYS03YmM4ODE4Nw=="   QueryIssues {     message: "Failed to resolve tablet: 72075186224037891 after several retries."     severity: 1   }   TxMeta {     id: "01k95a30yt1gdxjsx5wa1v4s6e"   } } YdbStatus: UNAVAILABLE ConsumedRu: 1 , code: 500001 
2025-11-03T16:51:31.180262Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Write session will restart in 2.000000s
2025-11-03T16:51:31.180371Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Write session: Do CDS request
2025-11-03T16:51:31.180414Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Do schedule cds request after 2000 ms
2025-11-03T16:51:31.284276Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard_impl.cpp:7727: Cannot get console configs
2025-11-03T16:51:31.284312Z node 1 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
2025-11-03T16:51:31.960303Z node 1 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976715681. Failed to resolve tablet: 72075186224037888 after several retries.
2025-11-03T16:51:31.960421Z node 1 :KQP_EXECUTER WARN: kqp_executer_impl.h:245: ActorId: [1:7568542795151710609:2496] TxId: 281474976715681. Ctx: { TraceId: 01k95a31500pd8t53e7a9qa88p, Database: /Root, SessionId: ydb://session/3?node_id=1&id=OTcwMzAyYmYtYTEwYzY0ZmQtZTZjN2MyM2YtMjgyMzYwN2Y=, PoolId: default}. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037888 after several retries.
2025-11-03T16:51:31.960667Z node 1 :KQP_SESSION WARN: kqp_session_actor.cpp:2987: SessionId: ydb://session/3?node_id=1&id=OTcwMzAyYmYtYTEwYzY0ZmQtZTZjN2MyM2YtMjgyMzYwN2Y=, ActorId: [1:7568542795151710575:2496], ActorState: ExecuteState, TraceId: 01k95a31500pd8t53e7a9qa88p, Create QueryResponse for error on request, msg: 
2025-11-03T16:51:31.961555Z node 1 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Failed to resolve tablet: 72075186224037888 after several retries." severity: 1 } TxMeta { id: "01k95a31hadab3abhvwt19cb69" } } YdbStatus: UNAVAILABLE ConsumedRu: 257 }
2025-11-03T16:51:32.000412Z node 2 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976720665. Failed to resolve tablet: 72075186224037890 after several retries.
2025-11-03T16:51:32.000551Z node 2 :KQP_EXECUTER WARN: kqp_executer_impl.h:245: ActorId: [2:7568542799444223438:2406] TxId: 281474976720665. Ctx: { TraceId: 01k95a315e6tqdem899w66kbre, Database: /Root, SessionId: ydb://session/3?node_id=2&id=ODRlMjMxMmEtNzhmMDA5M2EtNTMyMmFmNTYtZTk5MTE5NDU=, PoolId: default}. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037890 after several retries.
2025-11-03T16:51:32.000800Z node 2 :KQP_SESSION WARN: kqp_session_actor.cpp:2987: SessionId: ydb://session/3?node_id=2&id=ODRlMjMxMmEtNzhmMDA5M2EtNTMyMmFmNTYtZTk5MTE5NDU=, ActorId: [2:7568542795149256129:2406], ActorState: ExecuteState, TraceId: 01k95a315e6tqdem899w66kbre, Create QueryResponse for error on request, msg: 
2025-11-03T16:51:32.001905Z node 2 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Failed to resolve tablet: 72075186224037890 after several retries." severity: 1 } TxMeta { id: "01k95a31hy0tz885hqr6775cg1" } } YdbStatus: UNAVAILABLE ConsumedRu: 261 }
2025-11-03T16:51:33.183283Z :INFO: [/Root] MessageGroupId [test-message-group-id] Running cds request ms
2025-11-03T16:51:33.194239Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Got CDS response: 
write_sessions_clusters { clusters { endpoint: "localhost:1567" name: "dc1" available: true } primary_cluster_selection_reason: CLIENT_LOCATION } version: 1
2025-11-03T16:51:33.194283Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Start write session. Will connect to endpoint: localhost:1567
2025-11-03T16:51:33.197312Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" }
2025-11-03T16:51:33.198413Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-11-03T16:51:33.198442Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 4
2025-11-03T16:51:33.198864Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 4 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" }
2025-11-03T16:51:33.198979Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 4 topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" from ipv6:[::1]:34482
2025-11-03T16:51:33.198992Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=4 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:34482 proto=v1  topic=test-topic durationSec=0
2025-11-03T16:51:33.199003Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-11-03T16:51:33.200378Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 4 sessionId:  describe result for acl check
2025-11-03T16:51:33.200483Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-11-03T16:51:33.200493Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-11-03T16:51:33.200501Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-11-03T16:51:33.200516Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7568542808036612626:2518] (SourceId=test-message-group-id, PreferedPartition=(NULL)) StartKqpSession
2025-11-03T16:51:33.202829Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7568542808036612626:2518] (SourceId=test-message-group-id, PreferedPartition=(NULL)) Select from the table
2025-11-03T16:51:34.169960Z node 1 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976715684. Failed to resolve tablet: 72075186224037891 after several retries.
2025-11-03T16:51:34.170092Z node 1 :KQP_EXECUTER WARN: kqp_executer_impl.h:245: ActorId: [1:7568542808036612637:2520] TxId: 281474976715684. Ctx: { TraceId: 01k95a33pkek88ndy7c34xb8ry, Database: /Root, SessionId: ydb://session/3?node_id=1&id=ODMyM2NhMTItZmRiYWM4ZTAtZTMwMGZlZjAtYTI2N2VlNzQ=, PoolId: default}. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037891 after several retries.
2025-11-03T16:51:34.170299Z node 1 :KQP_SESSION WARN: kqp_session_actor.cpp:2987: SessionId: ydb://session/3?node_id=1&id=ODMyM2NhMTItZmRiYWM4ZTAtZTMwMGZlZjAtYTI2N2VlNzQ=, ActorId: [1:7568542808036612627:2520], ActorState: ExecuteState, TraceId: 01k95a33pkek88ndy7c34xb8ry, Create QueryResponse for error on request, msg: 
2025-11-03T16:51:34.171288Z node 1 :PQ_PARTITION_CHOOSER INFO: partition_chooser_impl__abstract_chooser_actor.h:312: TPartitionChooser [1:7568542808036612626:2518] (SourceId=test-message-group-id, PreferedPartition=(NULL)) ReplyError: kqp error Marker# PQ50 : Response {
  SessionId: "ydb://session/3?node_id=1&id=ODMyM2NhMTItZmRiYWM4ZTAtZTMwMGZlZjAtYTI2N2VlNzQ="
  QueryIssues {
    message: "Failed to resolve tablet: 72075186224037891 after several retries."
    severity: 1
  }
  TxMeta {
    id: "01k95a33pmc5p70vszdavxbdsn"
  }
}
YdbStatus: UNAVAILABLE
ConsumedRu: 1
2025-11-03T16:51:34.171344Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 4 reason: kqp error Marker# PQ50 : Response {
  SessionId: "ydb://session/3?node_id=1&id=ODMyM2NhMTItZmRiYWM4ZTAtZTMwMGZlZjAtYTI2N2VlNzQ="
  QueryIssues {
    message: "Failed to resolve tablet: 72075186224037891 after several retries."
    severity: 1
  }
  TxMeta {
    id: "01k95a33pmc5p70vszdavxbdsn"
  }
}
YdbStatus: UNAVAILABLE
ConsumedRu: 1
 sessionId: 
2025-11-03T16:51:34.171675Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 4 sessionId:  is DEAD
Test retry state: get retry delay
2025-11-03T16:51:34.173357Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: kqp error Marker# PQ50 : Response {   SessionId: "ydb://session/3?node_id=1&id=ODMyM2NhMTItZmRiYWM4ZTAtZTMwMGZlZjAtYTI2N2VlNzQ="   QueryIssues {     message: "Failed to resolve tablet: 72075186224037891 after several retries."     severity: 1   }   TxMeta {     id: "01k95a33pmc5p70vszdavxbdsn"   } } YdbStatus: UNAVAILABLE ConsumedRu: 1 , code: 500001 
2025-11-03T16:51:34.173394Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Write session will restart in 2.000000s
2025-11-03T16:51:34.173462Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Write session: Do CDS request
2025-11-03T16:51:34.173485Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Do schedule cds request after 2000 ms
2025-11-03T16:51:34.252118Z node 1 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976715685. Failed to resolve tablet: 72075186224037890 after several retries.
2025-11-03T16:51:34.252243Z node 1 :KQP_EXECUTER WARN: kqp_executer_impl.h:245: ActorId: [1:7568542808036612644:2510] TxId: 281474976715685. Ctx: { TraceId: 01k95a33f49qvsphsxbmvyd6ys, Database: /Root, SessionId: ydb://session/3?node_id=1&id=NjI2Yzk4NjQtYTY0ZGQ4NjktMTE3NmE0Zi1lODkxMjky, PoolId: default}. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037890 after several retries.
2025-11-03T16:51:34.252470Z node 1 :KQP_SESSION WARN: kqp_session_actor.cpp:2987: SessionId: ydb://session/3?node_id=1&id=NjI2Yzk4NjQtYTY0ZGQ4NjktMTE3NmE0Zi1lODkxMjky, ActorId: [1:7568542803741645312:2510], ActorState: ExecuteState, TraceId: 01k95a33f49qvsphsxbmvyd6ys, Create QueryResponse for error on request, msg: 
2025-11-03T16:51:34.253180Z node 1 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Failed to resolve tablet: 72075186224037890 after several retries." severity: 1 } TxMeta { id: "01k95a33s18jvye9mdckw8n6ev" } } YdbStatus: UNAVAILABLE ConsumedRu: 209 }
2025-11-03T16:51:34.316213Z node 2 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976720667. Failed to resolve tablet: 72075186224037888 after several retries.
2025-11-03T16:51:34.316334Z node 2 :KQP_EXECUTER WARN: kqp_executer_impl.h:245: ActorId: [2:7568542808034158110:2416] TxId: 281474976720667. Ctx: { TraceId: 01k95a33ge9xxpnkvwv9nwqrts, Database: /Root, SessionId: ydb://session/3?node_id=2&id=MjJkODcyMy1iNzA4ZGI1NS00MzY0MzFhYi1hNDdhZGNi, PoolId: default}. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037888 after several retries.
2025-11-03T16:51:34.316594Z node 2 :KQP_SESSION WARN: kqp_session_actor.cpp:2987: SessionId: ydb://session/3?node_id=2&id=MjJkODcyMy1iNzA4ZGI1NS00MzY0MzFhYi1hNDdhZGNi, ActorId: [2:7568542808034158097:2416], ActorState: ExecuteState, TraceId: 01k95a33ge9xxpnkvwv9nwqrts, Create QueryResponse for error on request, msg: 
2025-11-03T16:51:34.317416Z node 2 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Failed to resolve tablet: 72075186224037888 after several retries." severity: 1 } TxMeta { id: "01k95a33tb62yjpds6fzha186k" } } YdbStatus: UNAVAILABLE ConsumedRu: 203 }
2025-11-03T16:51:36.176195Z :INFO: [/Root] MessageGroupId [test-message-group-id] Running cds request ms
2025-11-03T16:51:36.183524Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Got CDS response: 
write_sessions_clusters { clusters { endpoint: "localhost:1567" name: "dc1" available: true } primary_cluster_selection_reason: CLIENT_LOCATION } version: 1
2025-11-03T16:51:36.183582Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Start write session. Will connect to endpoint: localhost:1567
2025-11-03T16:51:36.188624Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-11-03T16:51:36.188653Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 5
2025-11-03T16:51:36.189498Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" }
2025-11-03T16:51:36.190163Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 5 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" }
2025-11-03T16:51:36.190287Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 5 topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" from ipv6:[::1]:34482
2025-11-03T16:51:36.190302Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=5 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:34482 proto=v1  topic=test-topic durationSec=0
2025-11-03T16:51:36.190311Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-11-03T16:51:36.191819Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 5 sessionId:  describe result for acl check
2025-11-03T16:51:36.191931Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-11-03T16:51:36.191939Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-11-03T16:51:36.191948Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-11-03T16:51:36.191962Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7568542820921514723:2538] (SourceId=test-message-group-id, PreferedPartition=(NULL)) StartKqpSession
2025-11-03T16:51:36.195464Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7568542820921514723:2538] (SourceId=test-message-group-id, PreferedPartition=(NULL)) Select from the table
2025-11-03T16:51:36.543209Z node 1 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976715688. Failed to resolve tablet: 72075186224037888 after several retries.
2025-11-03T16:51:36.543317Z node 1 :KQP_EXECUTER WARN: kqp_executer_impl.h:245: ActorId: [1:7568542816626547369:2528] TxId: 281474976715688. Ctx: { TraceId: 01k95a35prepdpz54cq9mg42y4, Database: /Root, SessionId: ydb://session/3?node_id=1&id=MTExZDU5ZmUtNTJmMzRmYWEtZmMxNTg5ZTgtMmM4YTc0MWQ=, PoolId: default}. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037888 after several retries.
2025-11-03T16:51:36.543533Z node 1 :KQP_SESSION WARN: kqp_session_actor.cpp:2987: SessionId: ydb://session/3?node_id=1&id=MTExZDU5ZmUtNTJmMzRmYWEtZmMxNTg5ZTgtMmM4YTc0MWQ=, ActorId: [1:7568542816626547354:2528], ActorState: ExecuteState, TraceId: 01k95a35prepdpz54cq9mg42y4, Create QueryResponse for error on request, msg: 
2025-11-03T16:51:36.545816Z node 1 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Failed to resolve tablet: 72075186224037888 after several retries." severity: 1 } TxMeta { id: "01k95a36005farrk992fzmb9nw" } } YdbStatus: UNAVAILABLE ConsumedRu: 194 }
2025-11-03T16:51:36.660472Z node 2 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976720669. Failed to resolve tablet: 72075186224037888 after several retries.
2025-11-03T16:51:36.660610Z node 2 :KQP_EXECUTER WARN: kqp_executer_impl.h:245: ActorId: [2:7568542816624092786:2426] TxId: 281474976720669. Ctx: { TraceId: 01k95a35rrd23xcpm8mrz9fdhy, Database: /Root, SessionId: ydb://session/3?node_id=2&id=MzIwMTMxNzItOTFhN2RhZDQtMmZkZWI3YS1iNTVjOGUzZQ==, PoolId: default}. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037888 after several retries.
2025-11-03T16:51:36.660903Z node 2 :KQP_SESSION WARN: kqp_session_actor.cpp:2987: SessionId: ydb://session/3?node_id=2&id=MzIwMTMxNzItOTFhN2RhZDQtMmZkZWI3YS1iNTVjOGUzZQ==, ActorId: [2:7568542816624092768:2426], ActorState: ExecuteState, TraceId: 01k95a35rrd23xcpm8mrz9fdhy, Create QueryResponse for error on request, msg: 
2025-11-03T16:51:36.663674Z node 2 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Failed to resolve tablet: 72075186224037888 after several retries." severity: 1 } TxMeta { id: "01k95a362s3xdv071bv3qjc9v4" } } YdbStatus: UNAVAILABLE ConsumedRu: 208 }
2025-11-03T16:51:37.186648Z node 1 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976715689. Failed to resolve tablet: 72075186224037891 after several retries.
2025-11-03T16:51:37.186816Z node 1 :KQP_EXECUTER WARN: kqp_executer_impl.h:245: ActorId: [1:7568542820921514736:2540] TxId: 281474976715689. Ctx: { TraceId: 01k95a36m33a6x1r9nwk2y6vve, Database: /Root, SessionId: ydb://session/3?node_id=1&id=ZDRmNTQyZTctNmNiNmQxNjctZjkwMjNjOTItOTkzYjFhMjQ=, PoolId: default}. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037891 after several retries.
2025-11-03T16:51:37.187189Z node 1 :KQP_SESSION WARN: kqp_session_actor.cpp:2987: SessionId: ydb://session/3?node_id=1&id=ZDRmNTQyZTctNmNiNmQxNjctZjkwMjNjOTItOTkzYjFhMjQ=, ActorId: [1:7568542820921514724:2540], ActorState: ExecuteState, TraceId: 01k95a36m33a6x1r9nwk2y6vve, Create QueryResponse for error on request, msg: 
2025-11-03T16:51:37.188492Z node 1 :PQ_PARTITION_CHOOSER INFO: partition_chooser_impl__abstract_chooser_actor.h:312: TPartitionChooser [1:7568542820921514723:2538] (SourceId=test-message-group-id, PreferedPartition=(NULL)) ReplyError: kqp error Marker# PQ50 : Response {
  SessionId: "ydb://session/3?node_id=1&id=ZDRmNTQyZTctNmNiNmQxNjctZjkwMjNjOTItOTkzYjFhMjQ="
  QueryIssues {
    message: "Failed to resolve tablet: 72075186224037891 after several retries."
    severity: 1
  }
  TxMeta {
    id: "01k95a36m5feczyqmqnd8nrvdk"
  }
}
YdbStatus: UNAVAILABLE
ConsumedRu: 1
2025-11-03T16:51:37.188565Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 5 reason: kqp error Marker# PQ50 : Response {
  SessionId: "ydb://session/3?node_id=1&id=ZDRmNTQyZTctNmNiNmQxNjctZjkwMjNjOTItOTkzYjFhMjQ="
  QueryIssues {
    message: "Failed to resolve tablet: 72075186224037891 after several retries."
    severity: 1
  }
  TxMeta {
    id: "01k95a36m5feczyqmqnd8nrvdk"
  }
}
YdbStatus: UNAVAILABLE
ConsumedRu: 1
 sessionId: 
2025-11-03T16:51:37.188876Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 5 sessionId:  is DEAD
Test retry state: get retry delay
2025-11-03T16:51:37.196264Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: kqp error Marker# PQ50 : Response {   SessionId: "ydb://session/3?node_id=1&id=ZDRmNTQyZTctNmNiNmQxNjctZjkwMjNjOTItOTkzYjFhMjQ="   QueryIssues {     message: "Failed to resolve tablet: 72075186224037891 after several retries."     severity: 1   }   TxMeta {     id: "01k95a36m5feczyqmqnd8nrvdk"   } } YdbStatus: UNAVAILABLE ConsumedRu: 1 , code: 500001 
2025-11-03T16:51:37.196313Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Write session will restart in 2.000000s
2025-11-03T16:51:37.196414Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Write session: Do CDS request
2025-11-03T16:51:37.196447Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Do schedule cds request after 2000 ms
2025-11-03T16:51:38.918935Z node 1 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976715692. Failed to resolve tablet: 72075186224037888 after several retries.
2025-11-03T16:51:38.919053Z node 1 :KQP_EXECUTER WARN: kqp_executer_impl.h:245: ActorId: [1:7568542825216482131:2545] TxId: 281474976715692. Ctx: { TraceId: 01k95a37yefvz6s3snn51zqjp6, Database: /Root, SessionId: ydb://session/3?node_id=1&id=NGE4ZDE1ZTYtYzc2YjljMDQtYjIxZWMyMjctNjA0ZTJkMzQ=, PoolId: default}. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037888 after several retries.
2025-11-03T16:51:38.919297Z node 1 :KQP_SESSION WARN: kqp_session_actor.cpp:2987: SessionId: ydb://session/3?node_id=1&id=NGE4ZDE1ZTYtYzc2YjljMDQtYjIxZWMyMjctNjA0ZTJkMzQ=, ActorId: [1:7568542825216482105:2545], ActorState: ExecuteState, TraceId: 01k95a37yefvz6s3snn51zqjp6, Create QueryResponse for error on request, msg: 
2025-11-03T16:51:38.920589Z node 1 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Failed to resolve tablet: 72075186224037888 after several retries." severity: 1 } TxMeta { id: "01k95a38ac7jdv7c6htfb25yeg" } } YdbStatus: UNAVAILABLE ConsumedRu: 245 }
2025-11-03T16:51:39.120163Z node 2 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976720671. Failed to resolve tablet: 72075186224037888 after several retries.
2025-11-03T16:51:39.120286Z node 2 :KQP_EXECUTER WARN: kqp_executer_impl.h:245: ActorId: [2:7568542829508994754:2438] TxId: 281474976720671. Ctx: { TraceId: 01k95a381zc7jw1bezn61ayc20, Database: /Root, SessionId: ydb://session/3?node_id=2&id=ZDZiMmE0ZWUtZTVhMzdhZTgtYWE3NDU2YjctZTFmNWIwMDU=, PoolId: default}. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037888 after several retries.
2025-11-03T16:51:39.120547Z node 2 :KQP_SESSION WARN: kqp_session_actor.cpp:2987: SessionId: ydb://session/3?node_id=2&id=ZDZiMmE0ZWUtZTVhMzdhZTgtYWE3NDU2YjctZTFmNWIwMDU=, ActorId: [2:7568542825214027445:2438], ActorState: ExecuteState, TraceId: 01k95a381zc7jw1bezn61ayc20, Create QueryResponse for error on request, msg: 
2025-11-03T16:51:39.121920Z node 2 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Failed to resolve tablet: 72075186224037888 after several retries." severity: 1 } TxMeta { id: "01k95a38erfy51nfw4kr7cfera" } } YdbStatus: UNAVAILABLE ConsumedRu: 266 }
2025-11-03T16:51:39.200290Z :INFO: [/Root] MessageGroupId [test-message-group-id] Running cds request ms
2025-11-03T16:51:39.210535Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Got CDS response: 
write_sessions_clusters { clusters { endpoint: "localhost:1567" name: "dc1" available: true } primary_cluster_selection_reason: CLIENT_LOCATION } version: 1
2025-11-03T16:51:39.210588Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Start write session. Will connect to endpoint: localhost:1567
2025-11-03T16:51:39.214228Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" }
2025-11-03T16:51:39.215070Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-11-03T16:51:39.215099Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 6
2025-11-03T16:51:39.215513Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 6 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" }
2025-11-03T16:51:39.215626Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 6 topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" from ipv6:[::1]:34482
2025-11-03T16:51:39.215640Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=6 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:34482 proto=v1  topic=test-topic durationSec=0
2025-11-03T16:51:39.215650Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-11-03T16:51:39.217087Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 6 sessionId:  describe result for acl check
2025-11-03T16:51:39.217204Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-11-03T16:51:39.217212Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-11-03T16:51:39.217221Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-11-03T16:51:39.217234Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7568542833806416810:2558] (SourceId=test-message-group-id, PreferedPartition=(NULL)) StartKqpSession
2025-11-03T16:51:39.219443Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7568542833806416810:2558] (SourceId=test-message-group-id, PreferedPartition=(NULL)) Select from the table
2025-11-03T16:51:40.239024Z node 1 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976715694. Failed to resolve tablet: 72075186224037891 after several retries.
2025-11-03T16:51:40.239139Z node 1 :KQP_EXECUTER WARN: kqp_executer_impl.h:245: ActorId: [1:7568542833806416821:2560] TxId: 281474976715694. Ctx: { TraceId: 01k95a39jkct5c5eqvgbwdc0hy, Database: /Root, SessionId: ydb://session/3?node_id=1&id=MjM0ODQ5OTItMjQxYzFlZDQtZmFjZGI5YmQtNWM5NDAyNzg=, PoolId: default}. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037891 after several retries.
2025-11-03T16:51:40.239406Z node 1 :KQP_SESSION WARN: kqp_session_actor.cpp:2987: SessionId: ydb://session/3?node_id=1&id=MjM0ODQ5OTItMjQxYzFlZDQtZmFjZGI5YmQtNWM5NDAyNzg=, ActorId: [1:7568542833806416811:2560], ActorState: ExecuteState, TraceId: 01k95a39jkct5c5eqvgbwdc0hy, Create QueryResponse for error on request, msg: 
2025-11-03T16:51:40.244795Z node 1 :PQ_PARTITION_CHOOSER INFO: partition_chooser_impl__abstract_chooser_actor.h:312: TPartitionChooser [1:7568542833806416810:2558] (SourceId=test-message-group-id, PreferedPartition=(NULL)) ReplyError: kqp error Marker# PQ50 : Response {
  SessionId: "ydb://session/3?node_id=1&id=MjM0ODQ5OTItMjQxYzFlZDQtZmFjZGI5YmQtNWM5NDAyNzg="
  QueryIssues {
    message: "Failed to resolve tablet: 72075186224037891 after several retries."
    severity: 1
  }
  TxMeta {
    id: "01k95a39jrdgvk4bwy7p4yycsj"
  }
}
YdbStatus: UNAVAILABLE
ConsumedRu: 1
2025-11-03T16:51:40.244877Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 6 reason: kqp error Marker# PQ50 : Response {
  SessionId: "ydb://session/3?node_id=1&id=MjM0ODQ5OTItMjQxYzFlZDQtZmFjZGI5YmQtNWM5NDAyNzg="
  QueryIssues {
    message: "Failed to resolve tablet: 72075186224037891 after several retries."
    severity: 1
  }
  TxMeta {
    id: "01k95a39jrdgvk4bwy7p4yycsj"
  }
}
YdbStatus: UNAVAILABLE
ConsumedRu: 1
 sessionId: 
2025-11-03T16:51:40.245214Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 6 sessionId:  is DEAD
Test retry state: get retry delay
2025-11-03T16:51:40.252285Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: kqp error Marker# PQ50 : Response {   SessionId: "ydb://session/3?node_id=1&id=MjM0ODQ5OTItMjQxYzFlZDQtZmFjZGI5YmQtNWM5NDAyNzg="   QueryIssues {     message: "Failed to resolve tablet: 72075186224037891 after several retries."     severity: 1   }   TxMeta {     id: "01k95a39jrdgvk4bwy7p4yycsj"   } } YdbStatus: UNAVAILABLE ConsumedRu: 1 , code: 500001 
2025-11-03T16:51:40.252325Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Write session will restart in 2.000000s
2025-11-03T16:51:40.252409Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Write session: Do CDS request
2025-11-03T16:51:40.252448Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Do schedule cds request after 2000 ms
2025-11-03T16:51:41.316869Z node 1 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976715696. Failed to resolve tablet: 72075186224037890 after several retries.
2025-11-03T16:51:41.316986Z node 1 :KQP_EXECUTER WARN: kqp_executer_impl.h:245: ActorId: [1:7568542838101384181:2564] TxId: 281474976715696. Ctx: { TraceId: 01k95a3a8k0hw5y59p8gdjwn5h, Database: /Root, SessionId: ydb://session/3?node_id=1&id=OTZhNTU2MzgtOTNkZWM2ODItZTE1Y2Q3OTEtMjI2ZDEwYTA=, PoolId: default}. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037890 after several retries.
2025-11-03T16:51:41.317234Z node 1 :KQP_SESSION WARN: kqp_session_actor.cpp:2987: SessionId: ydb://session/3?node_id=1&id=OTZhNTU2MzgtOTNkZWM2ODItZTE1Y2Q3OTEtMjI2ZDEwYTA=, ActorId: [1:7568542833806416854:2564], ActorState: ExecuteState, TraceId: 01k95a3a8k0hw5y59p8gdjwn5h, Create QueryResponse for error on request, msg: 
2025-11-03T16:51:41.318572Z node 1 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Failed to resolve tablet: 72075186224037890 after several retries." severity: 1 } TxMeta { id: "01k95a3an48237hnb48f1harp9" } } YdbStatus: UNAVAILABLE ConsumedRu: 260 }
2025-11-03T16:51:41.577862Z node 2 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976720673. Failed to resolve tablet: 72075186224037890 after several retries.
2025-11-03T16:51:41.577974Z node 2 :KQP_EXECUTER WARN: kqp_executer_impl.h:245: ActorId: [2:7568542838098929426:2448] TxId: 281474976720673. Ctx: { TraceId: 01k95a3aey6w9wbkhcev2d3rtx, Database: /Root, SessionId: ydb://session/3?node_id=2&id=YTVkMWM4MmYtN2NlMDkwY2QtMTg5ZDBiODQtMTMxMWZlMjY=, PoolId: default}. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037890 after several retries.
2025-11-03T16:51:41.578228Z node 2 :KQP_SESSION WARN: kqp_session_actor.cpp:2987: SessionId: ydb://session/3?node_id=2&id=YTVkMWM4MmYtN2NlMDkwY2QtMTg5ZDBiODQtMTMxMWZlMjY=, ActorId: [2:7568542838098929412:2448], ActorState: ExecuteState, TraceId: 01k95a3aey6w9wbkhcev2d3rtx, Create QueryResponse for error on request, msg: 
2025-11-03T16:51:41.579470Z node 2 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Failed to resolve tablet: 72075186224037890 after several retries." severity: 1 } TxMeta { id: "01k95a3avw84jsbfrectv59dxv" } } YdbStatus: UNAVAILABLE ConsumedRu: 262 }
2025-11-03T16:51:42.256217Z :INFO: [/Root] MessageGroupId [test-message-group-id] Running cds request ms
2025-11-03T16:51:42.266501Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Got CDS response: 
write_sessions_clusters { clusters { endpoint: "localhost:1567" name: "dc1" available: true } primary_cluster_selection_reason: CLIENT_LOCATION } version: 1
2025-11-03T16:51:42.266555Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Start write session. Will connect to endpoint: localhost:1567
2025-11-03T16:51:42.270328Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" }
2025-11-03T16:51:42.271259Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-11-03T16:51:42.271291Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 7
2025-11-03T16:51:42.272560Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 7 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" }
2025-11-03T16:51:42.272681Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 7 topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" from ipv6:[::1]:34482
2025-11-03T16:51:42.272694Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=7 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:34482 proto=v1  topic=test-topic durationSec=0
2025-11-03T16:51:42.272702Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-11-03T16:51:42.274212Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 7 sessionId:  describe result for acl check
2025-11-03T16:51:42.274320Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-11-03T16:51:42.274329Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-11-03T16:51:42.274337Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-11-03T16:51:42.274351Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7568542846691318868:2578] (SourceId=test-message-group-id, PreferedPartition=(NULL)) StartKqpSession
2025-11-03T16:51:42.276554Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7568542846691318868:2578] (SourceId=test-message-group-id, PreferedPartition=(NULL)) Select from the table
2025-11-03T16:51:43.272561Z node 1 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976715698. Failed to resolve tablet: 72075186224037891 after several retries.
2025-11-03T16:51:43.272684Z node 1 :KQP_EXECUTER WARN: kqp_executer_impl.h:245: ActorId: [1:7568542846691318879:2580] TxId: 281474976715698. Ctx: { TraceId: 01k95a3cj4bcspwjeskhy8k12x, Database: /Root, SessionId: ydb://session/3?node_id=1&id=Y2M3ZmM5MGItYmYyN2VmZjAtYmU3NTQ0NTItNGQxMWZlOTg=, PoolId: default}. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037891 after several retries.
2025-11-03T16:51:43.272921Z node 1 :KQP_SESSION WARN: kqp_session_actor.cpp:2987: SessionId: ydb://session/3?node_id=1&id=Y2M3ZmM5MGItYmYyN2VmZjAtYmU3NTQ0NTItNGQxMWZlOTg=, ActorId: [1:7568542846691318869:2580], ActorState: ExecuteState, TraceId: 01k95a3cj4bcspwjeskhy8k12x, Create QueryResponse for error on request, msg: 
2025-11-03T16:51:43.276914Z node 1 :PQ_PARTITION_CHOOSER INFO: partition_chooser_impl__abstract_chooser_actor.h:312: TPartitionChooser [1:7568542846691318868:2578] (SourceId=test-message-group-id, PreferedPartition=(NULL)) ReplyError: kqp error Marker# PQ50 : Response {
  SessionId: "ydb://session/3?node_id=1&id=Y2M3ZmM5MGItYmYyN2VmZjAtYmU3NTQ0NTItNGQxMWZlOTg="
  QueryIssues {
    message: "Failed to resolve tablet: 72075186224037891 after several retries."
    severity: 1
  }
  TxMeta {
    id: "01k95a3cj53r90ka88etked4nf"
  }
}
YdbStatus: UNAVAILABLE
ConsumedRu: 1
2025-11-03T16:51:43.277009Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 7 reason: kqp error Marker# PQ50 : Response {
  SessionId: "ydb://session/3?node_id=1&id=Y2M3ZmM5MGItYmYyN2VmZjAtYmU3NTQ0NTItNGQxMWZlOTg="
  QueryIssues {
    message: "Failed to resolve tablet: 72075186224037891 after several retries."
    severity: 1
  }
  TxMeta {
    id: "01k95a3cj53r90ka88etked4nf"
  }
}
YdbStatus: UNAVAILABLE
ConsumedRu: 1
 sessionId: 
Test retry state: get retry delay
2025-11-03T16:51:43.277296Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 7 sessionId:  is DEAD
2025-11-03T16:51:43.280237Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: kqp error Marker# PQ50 : Response {   SessionId: "ydb://session/3?node_id=1&id=Y2M3ZmM5MGItYmYyN2VmZjAtYmU3NTQ0NTItNGQxMWZlOTg="   QueryIssues {     message: "Failed to resolve tablet: 72075186224037891 after several retries."     severity: 1   }   TxMeta {     id: "01k95a3cj53r90ka88etked4nf"   } } YdbStatus: UNAVAILABLE ConsumedRu: 1 , code: 500001 
2025-11-03T16:51:43.280283Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Write session will restart in 2.000000s
2025-11-03T16:51:43.280371Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Write session: Do CDS request
2025-11-03T16:51:43.280405Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Do schedule cds request after 2000 ms
2025-11-03T16:51:43.724706Z node 1 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976715699. Failed to resolve tablet: 72075186224037888 after several retries.
2025-11-03T16:51:43.724828Z node 1 :KQP_EXECUTER WARN: kqp_executer_impl.h:245: ActorId: [1:7568542846691318915:2582] TxId: 281474976715699. Ctx: { TraceId: 01k95a3ckr7rvs8ff2cfhnnc77, Database: /Root, SessionId: ydb://session/3?node_id=1&id=NWM1ZDc2N2YtZDk0MTExMmYtYzk5MGVmOTktYWI1MjU0YjM=, PoolId: default}. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037888 after several retries.
2025-11-03T16:51:43.725060Z node 1 :KQP_SESSION WARN: kqp_session_actor.cpp:2987: SessionId: ydb://session/3?node_id=1&id=NWM1ZDc2N2YtZDk0MTExMmYtYzk5MGVmOTktYWI1MjU0YjM=, ActorId: [1:7568542846691318885:2582], ActorState: ExecuteState, TraceId: 01k95a3ckr7rvs8ff2cfhnnc77, Create QueryResponse for error on request, msg: 
2025-11-03T16:51:43.726128Z node 1 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Failed to resolve tablet: 72075186224037888 after several retries." severity: 1 } TxMeta { id: "01k95a3d0m3nw3mp6w68dfw7g8" } } YdbStatus: UNAVAILABLE ConsumedRu: 268 }
2025-11-03T16:51:43.929343Z node 2 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976720675. Failed to resolve tablet: 72075186224037890 after several retries.
2025-11-03T16:51:43.929470Z node 2 :KQP_EXECUTER WARN: kqp_executer_impl.h:245: ActorId: [2:7568542846688864101:2460] TxId: 281474976720675. Ctx: { TraceId: 01k95a3cvpenpm5twant61t4zd, Database: /Root, SessionId: ydb://session/3?node_id=2&id=YzIyZjdhNTUtZTBhNTJhN2QtNzNhYmM2NTUtYWRiZmJlNmM=, PoolId: default}. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037890 after several retries.
2025-11-03T16:51:43.929701Z node 2 :KQP_SESSION WARN: kqp_session_actor.cpp:2987: SessionId: ydb://session/3?node_id=2&id=YzIyZjdhNTUtZTBhNTJhN2QtNzNhYmM2NTUtYWRiZmJlNmM=, ActorId: [2:7568542846688864088:2460], ActorState: ExecuteState, TraceId: 01k95a3cvpenpm5twant61t4zd, Create QueryResponse for error on request, msg: 
2025-11-03T16:51:43.930742Z node 2 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Failed to resolve tablet: 72075186224037890 after several retries." severity: 1 } TxMeta { id: "01k95a3d683p3bdsx37dymxj95" } } YdbStatus: UNAVAILABLE ConsumedRu: 221 }
2025-11-03T16:51:45.284229Z :INFO: [/Root] MessageGroupId [test-message-group-id] Running cds request ms
2025-11-03T16:51:45.289101Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Got CDS response: 
write_sessions_clusters { clusters { endpoint: "localhost:1567" name: "dc1" available: true } primary_cluster_selection_reason: CLIENT_LOCATION } version: 1
2025-11-03T16:51:45.289150Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Start write session. Will connect to endpoint: localhost:1567
2025-11-03T16:51:45.292356Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-11-03T16:51:45.292402Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 8
2025-11-03T16:51:45.293313Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" }
2025-11-03T16:51:45.293996Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 8 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" }
2025-11-03T16:51:45.294119Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 8 topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" from ipv6:[::1]:34482
2025-11-03T16:51:45.294135Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=8 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:34482 proto=v1  topic=test-topic durationSec=0
2025-11-03T16:51:45.294144Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-11-03T16:51:45.300268Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 8 sessionId:  describe result for acl check
2025-11-03T16:51:45.300392Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-11-03T16:51:45.300401Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-11-03T16:51:45.300408Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-11-03T16:51:45.300424Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7568542859576220960:2604] (SourceId=test-message-group-id, PreferedPartition=(NULL)) StartKqpSession
2025-11-03T16:51:45.302706Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7568542859576220960:2604] (SourceId=test-message-group-id, PreferedPartition=(NULL)) Select from the table
2025-11-03T16:51:46.113862Z node 1 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976715702. Failed to resolve tablet: 72075186224037888 after several retries.
2025-11-03T16:51:46.113970Z node 1 :KQP_EXECUTER WARN: kqp_executer_impl.h:245: ActorId: [1:7568542859576220940:2594] TxId: 281474976715702. Ctx: { TraceId: 01k95a3eysbemhw58n9vy8txbm, Database: /Root, SessionId: ydb://session/3?node_id=1&id=ZjMzYWJlN2ItZjZmOTViZTAtNWEyYTkyNjgtMmY4ZDJiMGQ=, PoolId: default}. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037888 after several retries.
2025-11-03T16:51:46.114228Z node 1 :KQP_SESSION WARN: kqp_session_actor.cpp:2987: SessionId: ydb://session/3?node_id=1&id=ZjMzYWJlN2ItZjZmOTViZTAtNWEyYTkyNjgtMmY4ZDJiMGQ=, ActorId: [1:7568542855281253618:2594], ActorState: ExecuteState, TraceId: 01k95a3eysbemhw58n9vy8txbm, Create QueryResponse for error on request, msg: 
2025-11-03T16:51:46.115655Z node 1 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Failed to resolve tablet: 72075186224037888 after several retries." severity: 1 } TxMeta { id: "01k95a3faq44kjyqz02cj4v71t" } } YdbStatus: UNAVAILABLE ConsumedRu: 251 }
2025-11-03T16:51:46.330590Z node 1 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976715703. Failed to resolve tablet: 72075186224037891 after several retries.
2025-11-03T16:51:46.330730Z node 1 :KQP_EXECUTER WARN: kqp_executer_impl.h:245: ActorId: [1:7568542859576220973:2606] TxId: 281474976715703. Ctx: { TraceId: 01k95a3fgp4nteg3n19kd34hb4, Database: /Root, SessionId: ydb://session/3?node_id=1&id=Y2FiNzlmMTgtN2FiYTNiMjQtZWRkOWFlMy0xZWY4MjQxYw==, PoolId: default}. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037891 after several retries.
2025-11-03T16:51:46.330948Z node 1 :KQP_SESSION WARN: kqp_session_actor.cpp:2987: SessionId: ydb://session/3?node_id=1&id=Y2FiNzlmMTgtN2FiYTNiMjQtZWRkOWFlMy0xZWY4MjQxYw==, ActorId: [1:7568542859576220961:2606], ActorState: ExecuteState, TraceId: 01k95a3fgp4nteg3n19kd34hb4, Create QueryResponse for error on request, msg: 
Test retry state: get retry delay
2025-11-03T16:51:46.347921Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: kqp error Marker# PQ50 : Response {   SessionId: "ydb://session/3?node_id=1&id=Y2FiNzlmMTgtN2FiYTNiMjQtZWRkOWFlMy0xZWY4MjQxYw=="   QueryIssues {     message: "Failed to resolve tablet: 72075186224037891 after several retries."     severity: 1   }   TxMeta {     id: "01k95a3fgwca9erkberttcwqjp"   } } YdbStatus: UNAVAILABLE ConsumedRu: 1 , code: 500001 
2025-11-03T16:51:46.347998Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Write session will restart in 2.000000s
2025-11-03T16:51:46.348098Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Write session: Do CDS request
2025-11-03T16:51:46.348150Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Do schedule cds request after 2000 ms
2025-11-03T16:51:46.347029Z node 1 :PQ_PARTITION_CHOOSER INFO: partition_chooser_impl__abstract_chooser_actor.h:312: TPartitionChooser [1:7568542859576220960:2604] (SourceId=test-message-group-id, PreferedPartition=(NULL)) ReplyError: kqp error Marker# PQ50 : Response {
  SessionId: "ydb://session/3?node_id=1&id=Y2FiNzlmMTgtN2FiYTNiMjQtZWRkOWFlMy0xZWY4MjQxYw=="
  QueryIssues {
    message: "Failed to resolve tablet: 72075186224037891 after several retries."
    severity: 1
  }
  TxMeta {
    id: "01k95a3fgwca9erkberttcwqjp"
  }
}
YdbStatus: UNAVAILABLE
ConsumedRu: 1
2025-11-03T16:51:46.347119Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 8 reason: kqp error Marker# PQ50 : Response {
  SessionId: "ydb://session/3?node_id=1&id=Y2FiNzlmMTgtN2FiYTNiMjQtZWRkOWFlMy0xZWY4MjQxYw=="
  QueryIssues {
    message: "Failed to resolve tablet: 72075186224037891 after several retries."
    severity: 1
  }
  TxMeta {
    id: "01k95a3fgwca9erkberttcwqjp"
  }
}
YdbStatus: UNAVAILABLE
ConsumedRu: 1
 sessionId: 
2025-11-03T16:51:46.347463Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 8 sessionId:  is DEAD
2025-11-03T16:51:46.373173Z node 2 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976720677. Failed to resolve tablet: 72075186224037888 after several retries.
2025-11-03T16:51:46.373291Z node 2 :KQP_EXECUTER WARN: kqp_executer_impl.h:245: ActorId: [2:7568542859573766068:2470] TxId: 281474976720677. Ctx: { TraceId: 01k95a3f552rgn7mn839e8t4pp, Database: /Root, SessionId: ydb://session/3?node_id=2&id=MmQ1NmVlNTYtNDA5YzA4MDMtODc2ODJmZjAtOWYxNDYxMTE=, PoolId: default}. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037888 after several retries.
2025-11-03T16:51:46.373525Z node 2 :KQP_SESSION WARN: kqp_session_actor.cpp:2987: SessionId: ydb://session/3?node_id=2&id=MmQ1NmVlNTYtNDA5YzA4MDMtODc2ODJmZjAtOWYxNDYxMTE=, ActorId: [2:7568542855278798759:2470], ActorState: ExecuteState, TraceId: 01k95a3f552rgn7mn839e8t4pp, Create QueryResponse for error on request, msg: 
2025-11-03T16:51:46.374811Z node 2 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Failed to resolve tablet: 72075186224037888 after several retries." severity: 1 } TxMeta { id: "01k95a3fg93vtaq083000napxm" } } YdbStatus: UNAVAILABLE ConsumedRu: 232 }
2025-11-03T16:51:48.356054Z :INFO: [/Root] MessageGroupId [test-message-group-id] Running cds request ms
2025-11-03T16:51:48.376220Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Got CDS response: 
write_sessions_clusters { clusters { endpoint: "localhost:1567" name: "dc1" available: true } primary_cluster_selection_reason: CLIENT_LOCATION } version: 1
2025-11-03T16:51:48.376284Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Start write session. Will connect to endpoint: localhost:1567
2025-11-03T16:51:48.382951Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" }
2025-11-03T16:51:48.382605Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-11-03T16:51:48.382651Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 9
2025-11-03T16:51:48.388255Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 9 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" }
2025-11-03T16:51:48.388405Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 9 topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" from ipv6:[::1]:34482
2025-11-03T16:51:48.388420Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=9 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:34482 proto=v1  topic=test-topic durationSec=0
2025-11-03T16:51:48.388430Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-11-03T16:51:48.389775Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 9 sessionId:  describe result for acl check
2025-11-03T16:51:48.389871Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-11-03T16:51:48.389880Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-11-03T16:51:48.389888Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-11-03T16:51:48.389902Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7568542872461123059:2624] (SourceId=test-message-group-id, PreferedPartition=(NULL)) StartKqpSession
2025-11-03T16:51:48.392296Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7568542872461123059:2624] (SourceId=test-message-group-id, PreferedPartition=(NULL)) Select from the table
2025-11-03T16:51:48.432782Z node 1 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976715706. Failed to resolve tablet: 72075186224037890 after several retries.
2025-11-03T16:51:48.432895Z node 1 :KQP_EXECUTER WARN: kqp_executer_impl.h:245: ActorId: [1:7568542868166155691:2614] TxId: 281474976715706. Ctx: { TraceId: 01k95a3h9da8ean50kdzcmvfy9, Database: /Root, SessionId: ydb://session/3?node_id=1&id=MzUxNTIwM2ItYjdjYjQ3ZjktYmJiNzlmN2YtYWE5ODljOGY=, PoolId: default}. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037890 after several retries.
2025-11-03T16:51:48.433130Z node 1 :KQP_SESSION WARN: kqp_session_actor.cpp:2987: SessionId: ydb://session/3?node_id=1&id=MzUxNTIwM2ItYjdjYjQ3ZjktYmJiNzlmN2YtYWE5ODljOGY=, ActorId: [1:7568542868166155677:2614], ActorState: ExecuteState, TraceId: 01k95a3h9da8ean50kdzcmvfy9, Create QueryResponse for error on request, msg: 
2025-11-03T16:51:48.434251Z node 1 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Failed to resolve tablet: 72075186224037890 after several retries." severity: 1 } TxMeta { id: "01k95a3hkge1fak8c7gxg3c9vy" } } YdbStatus: UNAVAILABLE ConsumedRu: 211 }
2025-11-03T16:51:48.773086Z node 2 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976720679. Failed to resolve tablet: 72075186224037888 after several retries.
2025-11-03T16:51:48.773199Z node 2 :KQP_EXECUTER WARN: kqp_executer_impl.h:245: ActorId: [2:7568542868163700746:2480] TxId: 281474976720679. Ctx: { TraceId: 01k95a3hhjfvv81mfqb24vwpvy, Database: /Root, SessionId: ydb://session/3?node_id=2&id=MzFlMTg5ZDAtZmE2MTk1ZmItNWNmZmI5Ni0yZGFjMzRkMg==, PoolId: default}. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037888 after several retries.
2025-11-03T16:51:48.773439Z node 2 :KQP_SESSION WARN: kqp_session_actor.cpp:2987: SessionId: ydb://session/3?node_id=2&id=MzFlMTg5ZDAtZmE2MTk1ZmItNWNmZmI5Ni0yZGFjMzRkMg==, ActorId: [2:7568542868163700728:2480], ActorState: ExecuteState, TraceId: 01k95a3hhjfvv81mfqb24vwpvy, Create QueryResponse for error on request, msg: 
2025-11-03T16:51:48.774602Z node 2 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Failed to resolve tablet: 72075186224037888 after several retries." severity: 1 } TxMeta { id: "01k95a3hxwa56q8sb0dg9k26qd" } } YdbStatus: UNAVAILABLE ConsumedRu: 256 }
2025-11-03T16:51:49.399408Z node 1 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976715707. Failed to resolve tablet: 72075186224037891 after several retries.
2025-11-03T16:51:49.399532Z node 1 :KQP_EXECUTER WARN: kqp_executer_impl.h:245: ActorId: [1:7568542872461123070:2626] TxId: 281474976715707. Ctx: { TraceId: 01k95a3jh8cajyrtax0jrp1qmn, Database: /Root, SessionId: ydb://session/3?node_id=1&id=YTNmZTQwODAtOWQ1ODRjZjktNzA4ZDJiNTUtYWNiZWRjMWY=, PoolId: default}. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037891 after several retries.
2025-11-03T16:51:49.399800Z node 1 :KQP_SESSION WARN: kqp_session_actor.cpp:2987: SessionId: ydb://session/3?node_id=1&id=YTNmZTQwODAtOWQ1ODRjZjktNzA4ZDJiNTUtYWNiZWRjMWY=, ActorId: [1:7568542872461123060:2626], ActorState: ExecuteState, TraceId: 01k95a3jh8cajyrtax0jrp1qmn, Create QueryResponse for error on request, msg: 
2025-11-03T16:51:49.401143Z node 1 :PQ_PARTITION_CHOOSER INFO: partition_chooser_impl__abstract_chooser_actor.h:312: TPartitionChooser [1:7568542872461123059:2624] (SourceId=test-message-group-id, PreferedPartition=(NULL)) ReplyError: kqp error Marker# PQ50 : Response {
  SessionId: "ydb://session/3?node_id=1&id=YTNmZTQwODAtOWQ1ODRjZjktNzA4ZDJiNTUtYWNiZWRjMWY="
  QueryIssues {
    message: "Failed to resolve tablet: 72075186224037891 after several retries."
    severity: 1
  }
  TxMeta {
    id: "01k95a3jh8cajyrtax0mwv52n2"
  }
}
YdbStatus: UNAVAILABLE
ConsumedRu: 1
2025-11-03T16:51:49.401233Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 9 reason: kqp error Marker# PQ50 : Response {
  SessionId: "ydb://session/3?node_id=1&id=YTNmZTQwODAtOWQ1ODRjZjktNzA4ZDJiNTUtYWNiZWRjMWY="
  QueryIssues {
    message: "Failed to resolve tablet: 72075186224037891 after several retries."
    severity: 1
  }
  TxMeta {
    id: "01k95a3jh8cajyrtax0mwv52n2"
  }
}
YdbStatus: UNAVAILABLE
ConsumedRu: 1
 sessionId: 
2025-11-03T16:51:49.401645Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 9 sessionId:  is DEAD
Test retry state: get retry delay
2025-11-03T16:51:49.404585Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: kqp error Marker# PQ50 : Response {   SessionId: "ydb://session/3?node_id=1&id=YTNmZTQwODAtOWQ1ODRjZjktNzA4ZDJiNTUtYWNiZWRjMWY="   QueryIssues {     message: "Failed to resolve tablet: 72075186224037891 after several retries."     severity: 1   }   TxMeta {     id: "01k95a3jh8cajyrtax0mwv52n2"   } } YdbStatus: UNAVAILABLE ConsumedRu: 1 , code: 500001 
2025-11-03T16:51:49.404624Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Write session will restart in 2.000000s
2025-11-03T16:51:49.404712Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Write session: Do CDS request
2025-11-03T16:51:49.404749Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Do schedule cds request after 2000 ms
2025-11-03T16:51:50.765028Z node 1 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976715710. Failed to resolve tablet: 72075186224037888 after several retries.
2025-11-03T16:51:50.765137Z node 1 :KQP_EXECUTER WARN: kqp_executer_impl.h:245: ActorId: [1:7568542876756090442:2631] TxId: 281474976715710. Ctx: { TraceId: 01k95a3khw85yg42a3166hefmc, Database: /Root, SessionId: ydb://session/3?node_id=1&id=MzJlNThkYi1iMmNiZDg2Ny1jN2MzYjFmOC0yOGZhMzJjZg==, PoolId: default}. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037888 after several retries.
2025-11-03T16:51:50.765375Z node 1 :KQP_SESSION WARN: kqp_session_actor.cpp:2987: SessionId: ydb://session/3?node_id=1&id=MzJlNThkYi1iMmNiZDg2Ny1jN2MzYjFmOC0yOGZhMzJjZg==, ActorId: [1:7568542876756090422:2631], ActorState: ExecuteState, TraceId: 01k95a3khw85yg42a3166hefmc, Create QueryResponse for error on request, msg: 
2025-11-03T16:51:50.767276Z node 1 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Failed to resolve tablet: 72075186224037888 after several retries." severity: 1 } TxMeta { id: "01k95a3kw8cgdt9qv18ptczepe" } } YdbStatus: UNAVAILABLE ConsumedRu: 217 }
2025-11-03T16:51:51.256316Z node 2 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976720681. Failed to resolve tablet: 72075186224037888 after several retries.
2025-11-03T16:51:51.256459Z node 2 :KQP_EXECUTER WARN: kqp_executer_impl.h:245: ActorId: [2:7568542881048602713:2492] TxId: 281474976720681. Ctx: { TraceId: 01k95a3kwe2abqy5c4yxtecszg, Database: /Root, SessionId: ydb://session/3?node_id=2&id=MTU4ZmEwYWQtOGEwN2JmMDItODE3ZTc5N2ItY2MxYjM4MTI=, PoolId: default}. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037888 after several retries.
2025-11-03T16:51:51.256720Z node 2 :KQP_SESSION WARN: kqp_session_actor.cpp:2987: SessionId: ydb://session/3?node_id=2&id=MTU4ZmEwYWQtOGEwN2JmMDItODE3ZTc5N2ItY2MxYjM4MTI=, ActorId: [2:7568542876753635404:2492], ActorState: ExecuteState, TraceId: 01k95a3kwe2abqy5c4yxtecszg, Create QueryResponse for error on request, msg: 
2025-11-03T16:51:51.258054Z node 2 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Failed to resolve tablet: 72075186224037888 after several retries." severity: 1 } TxMeta { id: "01k95a3m80101gb66shfvgxygs" } } YdbStatus: UNAVAILABLE ConsumedRu: 234 }
2025-11-03T16:51:51.405300Z :INFO: [/Root] MessageGroupId [test-message-group-id] Running cds request ms
2025-11-03T16:51:51.416172Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Got CDS response: 
write_sessions_clusters { clusters { endpoint: "localhost:1567" name: "dc1" available: true } primary_cluster_selection_reason: CLIENT_LOCATION } version: 1
2025-11-03T16:51:51.416224Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Start write session. Will connect to endpoint: localhost:1567
2025-11-03T16:51:51.421589Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-11-03T16:51:51.421619Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 10
2025-11-03T16:51:51.426263Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" }
2025-11-03T16:51:51.430731Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 10 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" }
2025-11-03T16:51:51.430929Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 10 topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" from ipv6:[::1]:34482
2025-11-03T16:51:51.430963Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=10 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:34482 proto=v1  topic=test-topic durationSec=0
2025-11-03T16:51:51.430976Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-11-03T16:51:51.432903Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 10 sessionId:  describe result for acl check
2025-11-03T16:51:51.433024Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-11-03T16:51:51.433034Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-11-03T16:51:51.433043Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-11-03T16:51:51.433059Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7568542885346025128:2644] (SourceId=test-message-group-id, PreferedPartition=(NULL)) StartKqpSession
2025-11-03T16:51:51.436129Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7568542885346025128:2644] (SourceId=test-message-group-id, PreferedPartition=(NULL)) Select from the table
2025-11-03T16:51:52.443585Z node 1 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976715712. Failed to resolve tablet: 72075186224037891 after several retries.
2025-11-03T16:51:52.443707Z node 1 :KQP_EXECUTER WARN: kqp_executer_impl.h:245: ActorId: [1:7568542885346025139:2646] TxId: 281474976715712. Ctx: { TraceId: 01k95a3ngcdq2rzc88nt6q007k, Database: /Root, SessionId: ydb://session/3?node_id=1&id=MmQ2ZDM2ZjctZGFiYTY1ZjYtNzM3ZGYwOTMtNTgyNTJjNjM=, PoolId: default}. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037891 after several retries.
2025-11-03T16:51:52.443917Z node 1 :KQP_SESSION WARN: kqp_session_actor.cpp:2987: SessionId: ydb://session/3?node_id=1&id=MmQ2ZDM2ZjctZGFiYTY1ZjYtNzM3ZGYwOTMtNTgyNTJjNjM=, ActorId: [1:7568542885346025129:2646], ActorState: ExecuteState, TraceId: 01k95a3ngcdq2rzc88nt6q007k, Create QueryResponse for error on request, msg: 
2025-11-03T16:51:52.446368Z node 1 :PQ_PARTITION_CHOOSER INFO: partition_chooser_impl__abstract_chooser_actor.h:312: TPartitionChooser [1:7568542885346025128:2644] (SourceId=test-message-group-id, PreferedPartition=(NULL)) ReplyError: kqp error Marker# PQ50 : Response {
  SessionId: "ydb://session/3?node_id=1&id=MmQ2ZDM2ZjctZGFiYTY1ZjYtNzM3ZGYwOTMtNTgyNTJjNjM="
  QueryIssues {
    message: "Failed to resolve tablet: 72075186224037891 after several retries."
    severity: 1
  }
  TxMeta {
    id: "01k95a3ngd02y0qbhd48ypymp7"
  }
}
YdbStatus: UNAVAILABLE
ConsumedRu: 1
2025-11-03T16:51:52.446456Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 10 reason: kqp error Marker# PQ50 : Response {
  SessionId: "ydb://session/3?node_id=1&id=MmQ2ZDM2ZjctZGFiYTY1ZjYtNzM3ZGYwOTMtNTgyNTJjNjM="
  QueryIssues {
    message: "Failed to resolve tablet: 72075186224037891 after several retries."
    severity: 1
  }
  TxMeta {
    id: "01k95a3ngd02y0qbhd48ypymp7"
  }
}
YdbStatus: UNAVAILABLE
ConsumedRu: 1
 sessionId: 
2025-11-03T16:51:52.446805Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 10 sessionId:  is DEAD
Test retry state: get retry delay
2025-11-03T16:51:52.448149Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: kqp error Marker# PQ50 : Response {   SessionId: "ydb://session/3?node_id=1&id=MmQ2ZDM2ZjctZGFiYTY1ZjYtNzM3ZGYwOTMtNTgyNTJjNjM="   QueryIssues {     message: "Failed to resolve tablet: 72075186224037891 after several retries."     severity: 1   }   TxMeta {     id: "01k95a3ngd02y0qbhd48ypymp7"   } } YdbStatus: UNAVAILABLE ConsumedRu: 1 , code: 500001 
2025-11-03T16:51:52.448176Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Write session will restart in 2.000000s
2025-11-03T16:51:52.448239Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Write session: Do CDS request
2025-11-03T16:51:52.448270Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Do schedule cds request after 2000 ms
2025-11-03T16:51:53.228857Z node 1 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976715713. Failed to resolve tablet: 72075186224037888 after several retries.
2025-11-03T16:51:53.228978Z node 1 :KQP_EXECUTER WARN: kqp_executer_impl.h:245: ActorId: [1:7568542889640992488:2648] TxId: 281474976715713. Ctx: { TraceId: 01k95a3ntyak7fv6f0z0ch1y2t, Database: /Root, SessionId: ydb://session/3?node_id=1&id=YTBhNDMwZGItYjJjNjEwMGMtYmE2NGI1YWEtYWRlNWEwNmY=, PoolId: default}. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037888 after several retries.
2025-11-03T16:51:53.229215Z node 1 :KQP_SESSION WARN: kqp_session_actor.cpp:2987: SessionId: ydb://session/3?node_id=1&id=YTBhNDMwZGItYjJjNjEwMGMtYmE2NGI1YWEtYWRlNWEwNmY=, ActorId: [1:7568542885346025159:2648], ActorState: ExecuteState, TraceId: 01k95a3ntyak7fv6f0z0ch1y2t, Create QueryResponse for error on request, msg: 
2025-11-03T16:51:53.230609Z node 1 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Failed to resolve tablet: 72075186224037888 after several retries." severity: 1 } TxMeta { id: "01k95a3p8hc5jkrg66r9qr8xm3" } } YdbStatus: UNAVAILABLE ConsumedRu: 284 }
2025-11-03T16:51:53.661105Z node 2 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976720683. Failed to resolve tablet: 72075186224037888 after several retries.
2025-11-03T16:51:53.661232Z node 2 :KQP_EXECUTER WARN: kqp_executer_impl.h:245: ActorId: [2:7568542889638537389:2502] TxId: 281474976720683. Ctx: { TraceId: 01k95a3paacmjdjedvv4jmhqsd, Database: /Root, SessionId: ydb://session/3?node_id=2&id=MzI5NzVjZTYtNTJlZDA0MGUtYWJjMDc5ZGMtMzc4OWYyOGY=, PoolId: default}. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037888 after several retries.
2025-11-03T16:51:53.661480Z node 2 :KQP_SESSION WARN: kqp_session_actor.cpp:2987: SessionId: ydb://session/3?node_id=2&id=MzI5NzVjZTYtNTJlZDA0MGUtYWJjMDc5ZGMtMzc4OWYyOGY=, ActorId: [2:7568542889638537372:2502], ActorState: ExecuteState, TraceId: 01k95a3paacmjdjedvv4jmhqsd, Create QueryResponse for error on request, msg: 
2025-11-03T16:51:53.662889Z node 2 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Failed to resolve tablet: 72075186224037888 after several retries." severity: 1 } TxMeta { id: "01k95a3pn4dgeqr8emmab35w98" } } YdbStatus: UNAVAILABLE ConsumedRu: 232 }
2025-11-03T16:51:54.452208Z :INFO: [/Root] MessageGroupId [test-message-group-id] Running cds request ms
2025-11-03T16:51:54.459972Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Got CDS response: 
write_sessions_clusters { clusters { endpoint: "localhost:1567" name: "dc1" available: true } primary_cluster_selection_reason: CLIENT_LOCATION } version: 1
2025-11-03T16:51:54.460042Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Start write session. Will connect to endpoint: localhost:1567
2025-11-03T16:51:54.466255Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" }
2025-11-03T16:51:54.472797Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-11-03T16:51:54.472835Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 11
2025-11-03T16:51:54.476918Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 11 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" }
2025-11-03T16:51:54.477094Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 11 topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" from ipv6:[::1]:34482
2025-11-03T16:51:54.477110Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=11 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:34482 proto=v1  topic=test-topic durationSec=0
2025-11-03T16:51:54.477121Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-11-03T16:51:54.478926Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 11 sessionId:  describe result for acl check
2025-11-03T16:51:54.479062Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-11-03T16:51:54.479072Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-11-03T16:51:54.479082Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-11-03T16:51:54.479099Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7568542898230927199:2670] (SourceId=test-message-group-id, PreferedPartition=(NULL)) StartKqpSession
2025-11-03T16:51:54.481704Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7568542898230927199:2670] (SourceId=test-message-group-id, PreferedPartition=(NULL)) Select from the table
2025-11-03T16:51:55.492079Z node 1 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976715716. Failed to resolve tablet: 72075186224037891 after several retries.
2025-11-03T16:51:55.492207Z node 1 :KQP_EXECUTER WARN: kqp_executer_impl.h:245: ActorId: [1:7568542898230927210:2672] TxId: 281474976715716. Ctx: { TraceId: 01k95a3rfhdkdtsm50tg41e98x, Database: /Root, SessionId: ydb://session/3?node_id=1&id=NDRiOTEzOWMtMjY2ZTdmMzQtMzRkNTcxZGYtNDM2NDA5YzU=, PoolId: default}. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037891 after several retries.
2025-11-03T16:51:55.492416Z node 1 :KQP_SESSION WARN: kqp_session_actor.cpp:2987: SessionId: ydb://session/3?node_id=1&id=NDRiOTEzOWMtMjY2ZTdmMzQtMzRkNTcxZGYtNDM2NDA5YzU=, ActorId: [1:7568542898230927200:2672], ActorState: ExecuteState, TraceId: 01k95a3rfhdkdtsm50tg41e98x, Create QueryResponse for error on request, msg: 
2025-11-03T16:51:55.493752Z node 1 :PQ_PARTITION_CHOOSER INFO: partition_chooser_impl__abstract_chooser_actor.h:312: TPartitionChooser [1:7568542898230927199:2670] (SourceId=test-message-group-id, PreferedPartition=(NULL)) ReplyError: kqp error Marker# PQ50 : Response {
  SessionId: "ydb://session/3?node_id=1&id=NDRiOTEzOWMtMjY2ZTdmMzQtMzRkNTcxZGYtNDM2NDA5YzU="
  QueryIssues {
    message: "Failed to resolve tablet: 72075186224037891 after several retries."
    severity: 1
  }
  TxMeta {
    id: "01k95a3rfm7s5ca7wsnzx238fv"
  }
}
YdbStatus: UNAVAILABLE
ConsumedRu: 2
2025-11-03T16:51:55.493825Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 11 reason: kqp error Marker# PQ50 : Response {
  SessionId: "ydb://session/3?node_id=1&id=NDRiOTEzOWMtMjY2ZTdmMzQtMzRkNTcxZGYtNDM2NDA5YzU="
  QueryIssues {
    message: "Failed to resolve tablet: 72075186224037891 after several retries."
    severity: 1
  }
  TxMeta {
    id: "01k95a3rfm7s5ca7wsnzx238fv"
  }
}
YdbStatus: UNAVAILABLE
ConsumedRu: 2
 sessionId: 
2025-11-03T16:51:55.494166Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 11 sessionId:  is DEAD
Test retry state: get retry delay
2025-11-03T16:51:55.499803Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: kqp error Marker# PQ50 : Response {   SessionId: "ydb://session/3?node_id=1&id=NDRiOTEzOWMtMjY2ZTdmMzQtMzRkNTcxZGYtNDM2NDA5YzU="   QueryIssues {     message: "Failed to resolve tablet: 72075186224037891 after several retries."     severity: 1   }   TxMeta {     id: "01k95a3rfm7s5ca7wsnzx238fv"   } } YdbStatus: UNAVAILABLE ConsumedRu: 2 , code: 500001 
2025-11-03T16:51:55.499860Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Write session will restart in 2.000000s
2025-11-03T16:51:55.499950Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Write session: Do CDS request
2025-11-03T16:51:55.500002Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Do schedule cds request after 2000 ms
2025-11-03T16:51:56.208913Z node 1 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976715717. Failed to resolve tablet: 72075186224037890 after several retries.
2025-11-03T16:51:56.209030Z node 1 :KQP_EXECUTER WARN: kqp_executer_impl.h:245: ActorId: [1:7568542902525894544:2663] TxId: 281474976715717. Ctx: { TraceId: 01k95a3r7pa7yabh6zvqzzycsg, Database: /Root, SessionId: ydb://session/3?node_id=1&id=M2FlMmQxMjEtYjVhZjg2ODEtZjU2MjMzZTctZDJmMDEwMjk=, PoolId: default}. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037890 after several retries.
2025-11-03T16:51:56.209267Z node 1 :KQP_SESSION WARN: kqp_session_actor.cpp:2987: SessionId: ydb://session/3?node_id=1&id=M2FlMmQxMjEtYjVhZjg2ODEtZjU2MjMzZTctZDJmMDEwMjk=, ActorId: [1:7568542898230927182:2663], ActorState: ExecuteState, TraceId: 01k95a3r7pa7yabh6zvqzzycsg, Create QueryResponse for error on request, msg: 
2025-11-03T16:51:56.210518Z node 1 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Failed to resolve tablet: 72075186224037890 after several retries." severity: 1 } TxMeta { id: "01k95a3s6c2kmj355yby6h4vkp" } } YdbStatus: UNAVAILABLE ConsumedRu: 648 }
2025-11-03T16:51:56.268703Z node 2 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976720685. Failed to resolve tablet: 72075186224037890 after several retries.
2025-11-03T16:51:56.268823Z node 2 :KQP_EXECUTER WARN: kqp_executer_impl.h:245: ActorId: [2:7568542902523439356:2514] TxId: 281474976720685. Ctx: { TraceId: 01k95a3rnacfjfbb5cv0hd98bw, Database: /Root, SessionId: ydb://session/3?node_id=2&id=MjExY2Q1MjYtMmRhN2FjYzgtMzEzZjliNDEtNmZkMGIzNTA=, PoolId: default}. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037890 after several retries.
2025-11-03T16:51:56.269067Z node 2 :KQP_SESSION WARN: kqp_session_actor.cpp:2987: SessionId: ydb://session/3?node_id=2&id=MjExY2Q1MjYtMmRhN2FjYzgtMzEzZjliNDEtNmZkMGIzNTA=, ActorId: [2:7568542898228472047:2514], ActorState: ExecuteState, TraceId: 01k95a3rnacfjfbb5cv0hd98bw, Create QueryResponse for error on request, msg: 
2025-11-03T16:51:56.270293Z node 2 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Failed to resolve tablet: 72075186224037890 after several retries." severity: 1 } TxMeta { id: "01k95a3s74f6b4emgk3cywfj5k" } } YdbStatus: UNAVAILABLE ConsumedRu: 367 }
2025-11-03T16:51:57.506724Z :INFO: [/Root] MessageGroupId [test-message-group-id] Running cds request ms
2025-11-03T16:51:57.516045Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Got CDS response: 
write_sessions_clusters { clusters { endpoint: "localhost:1567" name: "dc1" available: true } primary_cluster_selection_reason: CLIENT_LOCATION } version: 1
2025-11-03T16:51:57.516101Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Start write session. Will connect to endpoint: localhost:1567
2025-11-03T16:51:57.519322Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" }
2025-11-03T16:51:57.520263Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-11-03T16:51:57.520294Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 12
2025-11-03T16:51:57.520694Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 12 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" }
2025-11-03T16:51:57.520810Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 12 topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" from ipv6:[::1]:34482
2025-11-03T16:51:57.520825Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=12 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:34482 proto=v1  topic=test-topic durationSec=0
2025-11-03T16:51:57.520835Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-11-03T16:51:57.522249Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 12 sessionId:  describe result for acl check
2025-11-03T16:51:57.522358Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-11-03T16:51:57.522369Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-11-03T16:51:57.522376Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-11-03T16:51:57.522391Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7568542911115829268:2690] (SourceId=test-message-group-id, PreferedPartition=(NULL)) StartKqpSession
2025-11-03T16:51:57.524727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7568542911115829268:2690] (SourceId=test-message-group-id, PreferedPartition=(NULL)) Select from the table
2025-11-03T16:51:58.556791Z node 1 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976715720. Failed to resolve tablet: 72075186224037891 after several retries.
2025-11-03T16:51:58.556908Z node 1 :KQP_EXECUTER WARN: kqp_executer_impl.h:245: ActorId: [1:7568542911115829279:2692] TxId: 281474976715720. Ctx: { TraceId: 01k95a3vem09440mptte06dr95, Database: /Root, SessionId: ydb://session/3?node_id=1&id=NzVkMDUxODItMjNiMGZhMGYtMzYzMjJiMDctOWQxNDI2NGU=, PoolId: default}. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037891 after several retries.
2025-11-03T16:51:58.557112Z node 1 :KQP_SESSION WARN: kqp_session_actor.cpp:2987: SessionId: ydb://session/3?node_id=1&id=NzVkMDUxODItMjNiMGZhMGYtMzYzMjJiMDctOWQxNDI2NGU=, ActorId: [1:7568542911115829269:2692], ActorState: ExecuteState, TraceId: 01k95a3vem09440mptte06dr95, Create QueryResponse for error on request, msg: 
Test retry state: get retry delay
2025-11-03T16:51:58.562204Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: kqp error Marker# PQ50 : Response {   SessionId: "ydb://session/3?node_id=1&id=NzVkMDUxODItMjNiMGZhMGYtMzYzMjJiMDctOWQxNDI2NGU="   QueryIssues {     message: "Failed to resolve tablet: 72075186224037891 after several retries."     severity: 1   }   TxMeta {     id: "01k95a3venexy2t0n67fhskqw3"   } } YdbStatus: UNAVAILABLE ConsumedRu: 1 , code: 500001 
2025-11-03T16:51:58.562249Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Write session will restart in 2.000000s
2025-11-03T16:51:58.562330Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Write session: Do CDS request
2025-11-03T16:51:58.562365Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Do schedule cds request after 2000 ms
2025-11-03T16:51:58.558310Z node 1 :PQ_PARTITION_CHOOSER INFO: partition_chooser_impl__abstract_chooser_actor.h:312: TPartitionChooser [1:7568542911115829268:2690] (SourceId=test-message-group-id, PreferedPartition=(NULL)) ReplyError: kqp error Marker# PQ50 : Response {
  SessionId: "ydb://session/3?node_id=1&id=NzVkMDUxODItMjNiMGZhMGYtMzYzMjJiMDctOWQxNDI2NGU="
  QueryIssues {
    message: "Failed to resolve tablet: 72075186224037891 after several retries."
    severity: 1
  }
  TxMeta {
    id: "01k95a3venexy2t0n67fhskqw3"
  }
}
YdbStatus: UNAVAILABLE
ConsumedRu: 1
2025-11-03T16:51:58.558394Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 12 reason: kqp error Marker# PQ50 : Response {
  SessionId: "ydb://session/3?node_id=1&id=NzVkMDUxODItMjNiMGZhMGYtMzYzMjJiMDctOWQxNDI2NGU="
  QueryIssues {
    message: "Failed to resolve tablet: 72075186224037891 after several retries."
    severity: 1
  }
  TxMeta {
    id: "01k95a3venexy2t0n67fhskqw3"
  }
}
YdbStatus: UNAVAILABLE
ConsumedRu: 1
 sessionId: 
2025-11-03T16:51:58.558804Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 12 sessionId:  is DEAD
2025-11-03T16:51:58.941934Z node 1 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976715721. Failed to resolve tablet: 72075186224037888 after several retries.
2025-11-03T16:51:58.942071Z node 1 :KQP_EXECUTER WARN: kqp_executer_impl.h:245: ActorId: [1:7568542911115829305:2683] TxId: 281474976715721. Ctx: { TraceId: 01k95a3v668j6h05jy8jz3mcx0, Database: /Root, SessionId: ydb://session/3?node_id=1&id=ZTFiODNkZjYtNWU5NzAyNGYtYTY3OGFkNjEtZmFjMTMzYTM=, PoolId: default}. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037888 after several retries.
2025-11-03T16:51:58.942330Z node 1 :KQP_SESSION WARN: kqp_session_actor.cpp:2987: SessionId: ydb://session/3?node_id=1&id=ZTFiODNkZjYtNWU5NzAyNGYtYTY3OGFkNjEtZmFjMTMzYTM=, ActorId: [1:7568542911115829251:2683], ActorState: ExecuteState, TraceId: 01k95a3v668j6h05jy8jz3mcx0, Create QueryResponse for error on request, msg: 
2025-11-03T16:51:58.948910Z node 1 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Failed to resolve tablet: 72075186224037888 after several retries." severity: 1 } TxMeta { id: "01k95a3vvbf92g3reg8b3n3f2s" } } YdbStatus: UNAVAILABLE ConsumedRu: 423 }
2025-11-03T16:51:59.112108Z node 2 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976720687. Failed to resolve tablet: 72075186224037890 after several retries.
2025-11-03T16:51:59.112252Z node 2 :KQP_EXECUTER WARN: kqp_executer_impl.h:245: ActorId: [2:7568542915408341329:2524] TxId: 281474976720687. Ctx: { TraceId: 01k95a3v6peravk1h9jm9nz1k7, Database: /Root, SessionId: ydb://session/3?node_id=2&id=YWJlM2MxNjktZmQ2MDI4YjctMTgwNzQ5MmUtZTM1MWI0NzM=, PoolId: default}. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037890 after several retries.
2025-11-03T16:51:59.112532Z node 2 :KQP_SESSION WARN: kqp_session_actor.cpp:2987: SessionId: ydb://session/3?node_id=2&id=YWJlM2MxNjktZmQ2MDI4YjctMTgwNzQ5MmUtZTM1MWI0NzM=, ActorId: [2:7568542911113374016:2524], ActorState: ExecuteState, TraceId: 01k95a3v6peravk1h9jm9nz1k7, Create QueryResponse for error on request, msg: 
2025-11-03T16:51:59.117210Z node 2 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Failed to resolve tablet: 72075186224037890 after several retries." severity: 1 } TxMeta { id: "01k95a3w082c88ym4ndpeqm2ft" } } YdbStatus: UNAVAILABLE ConsumedRu: 536 }
2025-11-03T16:52:00.567998Z :INFO: [/Root] MessageGroupId [test-message-group-id] Running cds request ms
2025-11-03T16:52:00.580177Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Got CDS response: 
write_sessions_clusters { clusters { endpoint: "localhost:1567" name: "dc1" available: true } primary_cluster_selection_reason: CLIENT_LOCATION } version: 1
2025-11-03T16:52:00.580233Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Start write session. Will connect to endpoint: localhost:1567
2025-11-03T16:52:00.586339Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" }
2025-11-03T16:52:00.588814Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-11-03T16:52:00.588848Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 13
2025-11-03T16:52:00.589298Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 13 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" }
2025-11-03T16:52:00.589420Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 13 topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" from ipv6:[::1]:34482
2025-11-03T16:52:00.589436Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=13 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:34482 proto=v1  topic=test-topic durationSec=0
2025-11-03T16:52:00.589446Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-11-03T16:52:00.591004Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 13 sessionId:  describe result for acl check
2025-11-03T16:52:00.591139Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-11-03T16:52:00.591150Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-11-03T16:52:00.591158Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-11-03T16:52:00.591173Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7568542924000731335:2710] (SourceId=test-message-group-id, PreferedPartition=(NULL)) StartKqpSession
2025-11-03T16:52:00.593753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7568542924000731335:2710] (SourceId=test-message-group-id, PreferedPartition=(NULL)) Select from the table
2025-11-03T16:52:01.515817Z node 1 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976715724. Failed to resolve tablet: 72075186224037890 after several retries.
2025-11-03T16:52:01.515950Z node 1 :KQP_EXECUTER WARN: kqp_executer_impl.h:245: ActorId: [1:7568542924000731322:2702] TxId: 281474976715724. Ctx: { TraceId: 01k95a3xtffjet15s4113qydvn, Database: /Root, SessionId: ydb://session/3?node_id=1&id=OWQzMzhlOGEtZGMwYjkzZDctYzczMjFiNWMtOWM5MWUyMjY=, PoolId: default}. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037890 after several retries.
2025-11-03T16:52:01.516225Z node 1 :KQP_SESSION WARN: kqp_session_actor.cpp:2987: SessionId: ydb://session/3?node_id=1&id=OWQzMzhlOGEtZGMwYjkzZDctYzczMjFiNWMtOWM5MWUyMjY=, ActorId: [1:7568542919705764007:2702], ActorState: ExecuteState, TraceId: 01k95a3xtffjet15s4113qydvn, Create QueryResponse for error on request, msg: 
2025-11-03T16:52:01.517546Z node 1 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Failed to resolve tablet: 72075186224037890 after several retries." severity: 1 } TxMeta { id: "01k95a3yc349hjgzrfn1ap6m5w" } } YdbStatus: UNAVAILABLE ConsumedRu: 365 }
2025-11-03T16:52:01.604101Z node 1 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976715725. Failed to resolve tablet: 72075186224037891 after several retries.
2025-11-03T16:52:01.604232Z node 1 :KQP_EXECUTER WARN: kqp_executer_impl.h:245: ActorId: [1:7568542924000731346:2712] TxId: 281474976715725. Ctx: { TraceId: 01k95a3yej7b61g9njhpwf0kem, Database: /Root, SessionId: ydb://session/3?node_id=1&id=ZjRiZGQ2MzItMjJlM2ZjZWMtNWMxNjBlY2MtODAxZTM1Mw==, PoolId: default}. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037891 after several retries.
2025-11-03T16:52:01.604449Z node 1 :KQP_SESSION WARN: kqp_session_actor.cpp:2987: SessionId: ydb://session/3?node_id=1&id=ZjRiZGQ2MzItMjJlM2ZjZWMtNWMxNjBlY2MtODAxZTM1Mw==, ActorId: [1:7568542924000731336:2712], ActorState: ExecuteState, TraceId: 01k95a3yej7b61g9njhpwf0kem, Create QueryResponse for error on request, msg: 
2025-11-03T16:52:01.612769Z node 1 :PQ_PARTITION_CHOOSER INFO: partition_chooser_impl__abstract_chooser_actor.h:312: TPartitionChooser [1:7568542924000731335:2710] (SourceId=test-message-group-id, PreferedPartition=(NULL)) ReplyError: kqp error Marker# PQ50 : Response {
  SessionId: "ydb://session/3?node_id=1&id=ZjRiZGQ2MzItMjJlM2ZjZWMtNWMxNjBlY2MtODAxZTM1Mw=="
  QueryIssues {
    message: "Failed to resolve tablet: 72075186224037891 after several retries."
    severity: 1
  }
  TxMeta {
    id: "01k95a3yepbvdwvsbrr4a4r8ky"
  }
}
YdbStatus: UNAVAILABLE
ConsumedRu: 3
2025-11-03T16:52:01.612862Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 13 reason: kqp error Marker# PQ50 : Response {
  SessionId: "ydb://session/3?node_id=1&id=ZjRiZGQ2MzItMjJlM2ZjZWMtNWMxNjBlY2MtODAxZTM1Mw=="
  QueryIssues {
    message: "Failed to resolve tablet: 72075186224037891 after several retries."
    severity: 1
  }
  TxMeta {
    id: "01k95a3yepbvdwvsbrr4a4r8ky"
  }
}
YdbStatus: UNAVAILABLE
ConsumedRu: 3
 sessionId: 
2025-11-03T16:52:01.613260Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 13 sessionId:  is DEAD
Test retry state: get retry delay
2025-11-03T16:52:01.623959Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: kqp error Marker# PQ50 : Response {   SessionId: "ydb://session/3?node_id=1&id=ZjRiZGQ2MzItMjJlM2ZjZWMtNWMxNjBlY2MtODAxZTM1Mw=="   QueryIssues {     message: "Failed to resolve tablet: 72075186224037891 after several retries."     severity: 1   }   TxMeta {     id: "01k95a3yepbvdwvsbrr4a4r8ky"   } } YdbStatus: UNAVAILABLE ConsumedRu: 3 , code: 500001 
2025-11-03T16:52:01.624025Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Write session will restart in 2.000000s
2025-11-03T16:52:01.624117Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Write session: Do CDS request
2025-11-03T16:52:01.624155Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Do schedule cds request after 2000 ms
2025-11-03T16:52:01.705366Z node 2 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976720689. Failed to resolve tablet: 72075186224037890 after several retries.
2025-11-03T16:52:01.705482Z node 2 :KQP_EXECUTER WARN: kqp_executer_impl.h:245: ActorId: [2:7568542923998276004:2536] TxId: 281474976720689. Ctx: { TraceId: 01k95a3xzt5z84ejrs91brjg9d, Database: /Root, SessionId: ydb://session/3?node_id=2&id=ZDA3NzUzMjEtNjg5MDA5NmQtM2FjMGI3ODAtNzQxMzkyMGU=, PoolId: default}. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037890 after several retries.
2025-11-03T16:52:01.705756Z node 2 :KQP_SESSION WARN: kqp_session_actor.cpp:2987: SessionId: ydb://session/3?node_id=2&id=ZDA3NzUzMjEtNjg5MDA5NmQtM2FjMGI3ODAtNzQxMzkyMGU=, ActorId: [2:7568542923998275987:2536], ActorState: ExecuteState, TraceId: 01k95a3xzt5z84ejrs91brjg9d, Create QueryResponse for error on request, msg: 
2025-11-03T16:52:01.706988Z node 2 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Failed to resolve tablet: 72075186224037890 after several retries." severity: 1 } TxMeta { id: "01k95a3yh44xq29vjh2317r9rh" } } YdbStatus: UNAVAILABLE ConsumedRu: 362 }
2025-11-03T16:52:03.632280Z :INFO: [/Root] MessageGroupId [test-message-group-id] Running cds request ms
2025-11-03T16:52:03.636735Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Got CDS response: 
write_sessions_clusters { clusters { endpoint: "localhost:1567" name: "dc1" available: true } primary_cluster_selection_reason: CLIENT_LOCATION } version: 1
2025-11-03T16:52:03.636816Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Start write session. Will connect to endpoint: localhost:1567
2025-11-03T16:52:03.643406Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" }
2025-11-03T16:52:03.644105Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-11-03T16:52:03.644137Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 14
2025-11-03T16:52:03.652272Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 14 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" }
2025-11-03T16:52:03.652440Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 14 topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" from ipv6:[::1]:34482
2025-11-03T16:52:03.652455Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=14 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:34482 proto=v1  topic=test-topic durationSec=0
2025-11-03T16:52:03.652466Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-11-03T16:52:03.653928Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 14 sessionId:  describe result for acl check
2025-11-03T16:52:03.654057Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-11-03T16:52:03.654066Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-11-03T16:52:03.654074Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-11-03T16:52:03.654090Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7568542936885633425:2729] (SourceId=test-message-group-id, PreferedPartition=(NULL)) StartKqpSession
2025-11-03T16:52:03.656988Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7568542936885633425:2729] (SourceId=test-message-group-id, PreferedPartition=(NULL)) Select from the table
2025-11-03T16:52:03.970145Z node 1 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976715728. Failed to resolve tablet: 72075186224037890 after several retries.
2025-11-03T16:52:03.970269Z node 1 :KQP_EXECUTER WARN: kqp_executer_impl.h:245: ActorId: [1:7568542932590666083:2720] TxId: 281474976715728. Ctx: { TraceId: 01k95a40bhf2grt220ejcp5gz2, Database: /Root, SessionId: ydb://session/3?node_id=1&id=NDBmMGEzODUtMTY5NjE5YzctOTNiNzFkYmQtNmY1ZmMyODI=, PoolId: default}. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037890 after several retries.
2025-11-03T16:52:03.970519Z node 1 :KQP_SESSION WARN: kqp_session_actor.cpp:2987: SessionId: ydb://session/3?node_id=1&id=NDBmMGEzODUtMTY5NjE5YzctOTNiNzFkYmQtNmY1ZmMyODI=, ActorId: [1:7568542932590666056:2720], ActorState: ExecuteState, TraceId: 01k95a40bhf2grt220ejcp5gz2, Create QueryResponse for error on request, msg: 
2025-11-03T16:52:03.972203Z node 1 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Failed to resolve tablet: 72075186224037890 after several retries." severity: 1 } TxMeta { id: "01k95a40rc2070cqmgqp7065xh" } } YdbStatus: UNAVAILABLE ConsumedRu: 270 }
2025-11-03T16:52:04.569259Z node 2 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976720691. Failed to resolve tablet: 72075186224037888 after several retries.
2025-11-03T16:52:04.569370Z node 2 :KQP_EXECUTER WARN: kqp_executer_impl.h:245: ActorId: [2:7568542936883177972:2548] TxId: 281474976720691. Ctx: { TraceId: 01k95a40gq37jvk15dq3p74f1e, Database: /Root, SessionId: ydb://session/3?node_id=2&id=N2VlMDRkNGItZDMxZGJiYmEtZWRhMjk3MGItZWI4NDMyNzA=, PoolId: default}. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037888 after several retries.
2025-11-03T16:52:04.569607Z node 2 :KQP_SESSION WARN: kqp_session_actor.cpp:2987: SessionId: ydb://session/3?node_id=2&id=N2VlMDRkNGItZDMxZGJiYmEtZWRhMjk3MGItZWI4NDMyNzA=, ActorId: [2:7568542932588210663:2548], ActorState: ExecuteState, TraceId: 01k95a40gq37jvk15dq3p74f1e, Create QueryResponse for error on request, msg: 
2025-11-03T16:52:04.570959Z node 2 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Failed to resolve tablet: 72075186224037888 after several retries." severity: 1 } TxMeta { id: "01k95a41a0e80vrqa829fxdaqm" } } YdbStatus: UNAVAILABLE ConsumedRu: 527 }
2025-11-03T16:52:04.692125Z node 1 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976715729. Failed to resolve tablet: 72075186224037891 after several retries.
2025-11-03T16:52:04.692259Z node 1 :KQP_EXECUTER WARN: kqp_executer_impl.h:245: ActorId: [1:7568542936885633439:2731] TxId: 281474976715729. Ctx: { TraceId: 01k95a41e91jcmktsx86nawt1f, Database: /Root, SessionId: ydb://session/3?node_id=1&id=ZWE0ZDVjYjgtMzdmMDAyOTAtZWUwZTIxZDktY2ZkYmMwZTc=, PoolId: default}. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037891 after several retries.
2025-11-03T16:52:04.692483Z node 1 :KQP_SESSION WARN: kqp_session_actor.cpp:2987: SessionId: ydb://session/3?node_id=1&id=ZWE0ZDVjYjgtMzdmMDAyOTAtZWUwZTIxZDktY2ZkYmMwZTc=, ActorId: [1:7568542936885633429:2731], ActorState: ExecuteState, TraceId: 01k95a41e91jcmktsx86nawt1f, Create QueryResponse for error on request, msg: 
Test retry state: get retry delay
2025-11-03T16:52:04.697336Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: kqp error Marker# PQ50 : Response {   SessionId: "ydb://session/3?node_id=1&id=ZWE0ZDVjYjgtMzdmMDAyOTAtZWUwZTIxZDktY2ZkYmMwZTc="   QueryIssues {     message: "Failed to resolve tablet: 72075186224037891 after several retries."     severity: 1   }   TxMeta {     id: "01k95a41ef7cdrp4ws1y91bx4t"   } } YdbStatus: UNAVAILABLE ConsumedRu: 1 , code: 500001 
2025-11-03T16:52:04.697397Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Write session will restart in 2.000000s
2025-11-03T16:52:04.697494Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Write session: Do CDS request
2025-11-03T16:52:04.697528Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Do schedule cds request after 2000 ms
2025-11-03T16:52:04.695676Z node 1 :PQ_PARTITION_CHOOSER INFO: partition_chooser_impl__abstract_chooser_actor.h:312: TPartitionChooser [1:7568542936885633425:2729] (SourceId=test-message-group-id, PreferedPartition=(NULL)) ReplyError: kqp error Marker# PQ50 : Response {
  SessionId: "ydb://session/3?node_id=1&id=ZWE0ZDVjYjgtMzdmMDAyOTAtZWUwZTIxZDktY2ZkYmMwZTc="
  QueryIssues {
    message: "Failed to resolve tablet: 72075186224037891 after several retries."
    severity: 1
  }
  TxMeta {
    id: "01k95a41ef7cdrp4ws1y91bx4t"
  }
}
YdbStatus: UNAVAILABLE
ConsumedRu: 1
2025-11-03T16:52:04.695758Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 14 reason: kqp error Marker# PQ50 : Response {
  SessionId: "ydb://session/3?node_id=1&id=ZWE0ZDVjYjgtMzdmMDAyOTAtZWUwZTIxZDktY2ZkYmMwZTc="
  QueryIssues {
    message: "Failed to resolve tablet: 72075186224037891 after several retries."
    severity: 1
  }
  TxMeta {
    id: "01k95a41ef7cdrp4ws1y91bx4t"
  }
}
YdbStatus: UNAVAILABLE
ConsumedRu: 1
 sessionId: 
2025-11-03T16:52:04.696133Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 14 sessionId:  is DEAD
2025-11-03T16:52:06.521117Z node 1 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976715732. Failed to resolve tablet: 72075186224037890 after several retries.
2025-11-03T16:52:06.521237Z node 1 :KQP_EXECUTER WARN: kqp_executer_impl.h:245: ActorId: [1:7568542945475568122:2736] TxId: 281474976715732. Ctx: { TraceId: 01k95a42qf1q6mtfvhxspqdrtv, Database: /Root, SessionId: ydb://session/3?node_id=1&id=MjBhNTk2ODUtOTA2ZTg0ZTUtMzczNDI5ZmUtZjRiY2Y3Zjc=, PoolId: default}. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037890 after several retries.
2025-11-03T16:52:06.521504Z node 1 :KQP_SESSION WARN: kqp_session_actor.cpp:2987: SessionId: ydb://session/3?node_id=1&id=MjBhNTk2ODUtOTA2ZTg0ZTUtMzczNDI5ZmUtZjRiY2Y3Zjc=, ActorId: [1:7568542941180600809:2736], ActorState: ExecuteState, TraceId: 01k95a42qf1q6mtfvhxspqdrtv, Create QueryResponse for error on request, msg: 
2025-11-03T16:52:06.523024Z node 1 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Failed to resolve tablet: 72075186224037890 after several retries." severity: 1 } TxMeta { id: "01k95a438r9nwvkg9rbs1jj2sr" } } YdbStatus: UNAVAILABLE ConsumedRu: 360 }
2025-11-03T16:52:06.699029Z :INFO: [/Root] MessageGroupId [test-message-group-id] Running cds request ms
2025-11-03T16:52:06.703301Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Got CDS response: 
write_sessions_clusters { clusters { endpoint: "localhost:1567" name: "dc1" available: true } primary_cluster_selection_reason: CLIENT_LOCATION } version: 1
2025-11-03T16:52:06.703346Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Start write session. Will connect to endpoint: localhost:1567
2025-11-03T16:52:06.709452Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" }
2025-11-03T16:52:06.710190Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-11-03T16:52:06.710222Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 15
2025-11-03T16:52:06.710724Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 15 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" }
2025-11-03T16:52:06.710839Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 15 topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" from ipv6:[::1]:34482
2025-11-03T16:52:06.710853Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=15 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:34482 proto=v1  topic=test-topic durationSec=0
2025-11-03T16:52:06.710861Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-11-03T16:52:06.712183Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 15 sessionId:  describe result for acl check
2025-11-03T16:52:06.712323Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-11-03T16:52:06.712333Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-11-03T16:52:06.712341Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-11-03T16:52:06.712359Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7568542949770535504:2746] (SourceId=test-message-group-id, PreferedPartition=(NULL)) StartKqpSession
2025-11-03T16:52:06.715278Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7568542949770535504:2746] (SourceId=test-message-group-id, PreferedPartition=(NULL)) Select from the table
2025-11-03T16:52:07.614113Z node 2 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976720693. Failed to resolve tablet: 72075186224037888 after several retries.
2025-11-03T16:52:07.614241Z node 2 :KQP_EXECUTER WARN: kqp_executer_impl.h:245: ActorId: [2:7568542949768079944:2558] TxId: 281474976720693. Ctx: { TraceId: 01k95a43aa2z2c9kza1df6fzp5, Database: /Root, SessionId: ydb://session/3?node_id=2&id=YmM4YTg4NDMtZDk0YTYyOWItMmZkOWE2ZDUtMTY0OGIxOWQ=, PoolId: default}. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037888 after several retries.
2025-11-03T16:52:07.614512Z node 2 :KQP_SESSION WARN: kqp_session_actor.cpp:2987: SessionId: ydb://session/3?node_id=2&id=YmM4YTg4NDMtZDk0YTYyOWItMmZkOWE2ZDUtMTY0OGIxOWQ=, ActorId: [2:7568542945473112630:2558], ActorState: ExecuteState, TraceId: 01k95a43aa2z2c9kza1df6fzp5, Create QueryResponse for error on request, msg: 
2025-11-03T16:52:07.615693Z node 2 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Failed to resolve tablet: 72075186224037888 after several retries." severity: 1 } TxMeta { id: "01k95a449tbk7sz5d36mds284q" } } YdbStatus: UNAVAILABLE ConsumedRu: 661 }
2025-11-03T16:52:07.736792Z node 1 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976715734. Failed to resolve tablet: 72075186224037891 after several retries.
2025-11-03T16:52:07.736900Z node 1 :KQP_EXECUTER WARN: kqp_executer_impl.h:245: ActorId: [1:7568542949770535515:2748] TxId: 281474976715734. Ctx: { TraceId: 01k95a44dv9gzpnc4t7s4vs056, Database: /Root, SessionId: ydb://session/3?node_id=1&id=MzE1Zjg0YWEtYTJlZTQ4MzItNzA4ZTU2N2QtYjAwZWQ4YTE=, PoolId: default}. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037891 after several retries.
2025-11-03T16:52:07.737097Z node 1 :KQP_SESSION WARN: kqp_session_actor.cpp:2987: SessionId: ydb://session/3?node_id=1&id=MzE1Zjg0YWEtYTJlZTQ4MzItNzA4ZTU2N2QtYjAwZWQ4YTE=, ActorId: [1:7568542949770535505:2748], ActorState: ExecuteState, TraceId: 01k95a44dv9gzpnc4t7s4vs056, Create QueryResponse for error on request, msg: 
2025-11-03T16:52:07.738322Z node 1 :PQ_PARTITION_CHOOSER INFO: partition_chooser_impl__abstract_chooser_actor.h:312: TPartitionChooser [1:7568542949770535504:2746] (SourceId=test-message-group-id, PreferedPartition=(NULL)) ReplyError: kqp error Marker# PQ50 : Response {
  SessionId: "ydb://session/3?node_id=1&id=MzE1Zjg0YWEtYTJlZTQ4MzItNzA4ZTU2N2QtYjAwZWQ4YTE="
  QueryIssues {
    message: "Failed to resolve tablet: 72075186224037891 after several retries."
    severity: 1
  }
  TxMeta {
    id: "01k95a44dw9j1axk5f6z0svrcx"
  }
}
YdbStatus: UNAVAILABLE
ConsumedRu: 1
2025-11-03T16:52:07.738396Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 15 reason: kqp error Marker# PQ50 : Response {
  SessionId: "ydb://session/3?node_id=1&id=MzE1Zjg0YWEtYTJlZTQ4MzItNzA4ZTU2N2QtYjAwZWQ4YTE="
  QueryIssues {
    message: "Failed to resolve tablet: 72075186224037891 after several retries."
    severity: 1
  }
  TxMeta {
    id: "01k95a44dw9j1axk5f6z0svrcx"
  }
}
YdbStatus: UNAVAILABLE
ConsumedRu: 1
 sessionId: 
2025-11-03T16:52:07.738733Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 15 sessionId:  is DEAD
Test retry state: get retry delay
2025-11-03T16:52:07.740200Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: kqp error Marker# PQ50 : Response {   SessionId: "ydb://session/3?node_id=1&id=MzE1Zjg0YWEtYTJlZTQ4MzItNzA4ZTU2N2QtYjAwZWQ4YTE="   QueryIssues {     message: "Failed to resolve tablet: 72075186224037891 after several retries."     severity: 1   }   TxMeta {     id: "01k95a44dw9j1axk5f6z0svrcx"   } } YdbStatus: UNAVAILABLE ConsumedRu: 1 , code: 500001 
2025-11-03T16:52:07.740240Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Write session will restart in 2.000000s
2025-11-03T16:52:07.740325Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Write session: Do CDS request
2025-11-03T16:52:07.740365Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Do schedule cds request after 2000 ms
2025-11-03T16:52:08.940874Z node 1 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976715736. Failed to resolve tablet: 72075186224037888 after several retries.
2025-11-03T16:52:08.940984Z node 1 :KQP_EXECUTER WARN: kqp_executer_impl.h:245: ActorId: [1:7568542954065502878:2752] TxId: 281474976715736. Ctx: { TraceId: 01k95a457bb6880bqvysx9bs74, Database: /Root, SessionId: ydb://session/3?node_id=1&id=MTAyMjlkZDQtNzAzZTk3ODctMWU3ODkxM2YtNTcyZTk3M2M=, PoolId: default}. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037888 after several retries.
2025-11-03T16:52:08.941226Z node 1 :KQP_SESSION WARN: kqp_session_actor.cpp:2987: SessionId: ydb://session/3?node_id=1&id=MTAyMjlkZDQtNzAzZTk3ODctMWU3ODkxM2YtNTcyZTk3M2M=, ActorId: [1:7568542954065502846:2752], ActorState: ExecuteState, TraceId: 01k95a457bb6880bqvysx9bs74, Create QueryResponse for error on request, msg: 
2025-11-03T16:52:08.942475Z node 1 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Failed to resolve tablet: 72075186224037888 after several retries." severity: 1 } TxMeta { id: "01k95a45m886zzbrvpv6jr0h5s" } } YdbStatus: UNAVAILABLE ConsumedRu: 271 }
2025-11-03T16:52:09.750282Z :INFO: [/Root] MessageGroupId [test-message-group-id] Running cds request ms
2025-11-03T16:52:09.767087Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Got CDS response: 
write_sessions_clusters { clusters { endpoint: "localhost:1567" name: "dc1" available: true } primary_cluster_selection_reason: CLIENT_LOCATION } version: 1
2025-11-03T16:52:09.767139Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Start write session. Will connect to endpoint: localhost:1567
2025-11-03T16:52:09.770985Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" }
2025-11-03T16:52:09.770933Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-11-03T16:52:09.770979Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 16
2025-11-03T16:52:09.772878Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 16 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" }
2025-11-03T16:52:09.773015Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 16 topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" from ipv6:[::1]:34482
2025-11-03T16:52:09.773033Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=16 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:34482 proto=v1  topic=test-topic durationSec=0
2025-11-03T16:52:09.773044Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-11-03T16:52:09.774880Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 16 sessionId:  describe result for acl check
2025-11-03T16:52:09.775001Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-11-03T16:52:09.775012Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-11-03T16:52:09.775020Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-11-03T16:52:09.775037Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7568542962655437561:2763] (SourceId=test-message-group-id, PreferedPartition=(NULL)) StartKqpSession
2025-11-03T16:52:09.777238Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7568542962655437561:2763] (SourceId=test-message-group-id, PreferedPartition=(NULL)) Select from the table
2025-11-03T16:52:10.155675Z node 2 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976720695. Failed to resolve tablet: 72075186224037890 after several retries.
2025-11-03T16:52:10.155800Z node 2 :KQP_EXECUTER WARN: kqp_executer_impl.h:245: ActorId: [2:7568542962652981916:2570] TxId: 281474976720695. Ctx: { TraceId: 01k95a469a1p9ndqsws7kmnsjt, Database: /Root, SessionId: ydb://session/3?node_id=2&id=NGE2M2U2ZjAtMzFhNzc4MDctZDM0MTI5OS1iOWI1ZTQyNA==, PoolId: default}. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037890 after several retries.
2025-11-03T16:52:10.156064Z node 2 :KQP_SESSION WARN: kqp_session_actor.cpp:2987: SessionId: ydb://session/3?node_id=2&id=NGE2M2U2ZjAtMzFhNzc4MDctZDM0MTI5OS1iOWI1ZTQyNA==, ActorId: [2:7568542958358014603:2570], ActorState: ExecuteState, TraceId: 01k95a469a1p9ndqsws7kmnsjt, Create QueryResponse for error on request, msg: 
2025-11-03T16:52:10.160327Z node 2 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Failed to resolve tablet: 72075186224037890 after several retries." severity: 1 } TxMeta { id: "01k95a46s9267zc9y79cf5jrn2" } } YdbStatus: UNAVAILABLE ConsumedRu: 334 }
2025-11-03T16:52:10.788073Z node 1 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976715738. Failed to resolve tablet: 72075186224037891 after several retries.
2025-11-03T16:52:10.788192Z node 1 :KQP_EXECUTER WARN: kqp_executer_impl.h:245: ActorId: [1:7568542962655437572:2765] TxId: 281474976715738. Ctx: { TraceId: 01k95a47dh0dsv4pgam0pnf4kq, Database: /Root, SessionId: ydb://session/3?node_id=1&id=YTNiMWM3ZC1kNTllMWU2Mi1hNjA5NDQ5MS04Y2U3NDg3Mg==, PoolId: default}. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037891 after several retries.
2025-11-03T16:52:10.788410Z node 1 :KQP_SESSION WARN: kqp_session_actor.cpp:2987: SessionId: ydb://session/3?node_id=1&id=YTNiMWM3ZC1kNTllMWU2Mi1hNjA5NDQ5MS04Y2U3NDg3Mg==, ActorId: [1:7568542962655437562:2765], ActorState: ExecuteState, TraceId: 01k95a47dh0dsv4pgam0pnf4kq, Create QueryResponse for error on request, msg: 
2025-11-03T16:52:10.789328Z node 1 :PQ_PARTITION_CHOOSER INFO: partition_chooser_impl__abstract_chooser_actor.h:312: TPartitionChooser [1:7568542962655437561:2763] (SourceId=test-message-group-id, PreferedPartition=(NULL)) ReplyError: kqp error Marker# PQ50 : Response {
  SessionId: "ydb://session/3?node_id=1&id=YTNiMWM3ZC1kNTllMWU2Mi1hNjA5NDQ5MS04Y2U3NDg3Mg=="
  QueryIssues {
    message: "Failed to resolve tablet: 72075186224037891 after several retries."
    severity: 1
  }
  TxMeta {
    id: "01k95a47dh0dsv4pgam2dfyv4s"
  }
}
YdbStatus: UNAVAILABLE
ConsumedRu: 1
2025-11-03T16:52:10.789397Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 16 reason: kqp error Marker# PQ50 : Response {
  SessionId: "ydb://session/3?node_id=1&id=YTNiMWM3ZC1kNTllMWU2Mi1hNjA5NDQ5MS04Y2U3NDg3Mg=="
  QueryIssues {
    message: "Failed to resolve tablet: 72075186224037891 after several retries."
    severity: 1
  }
  TxMeta {
    id: "01k95a47dh0dsv4pgam2dfyv4s"
  }
}
YdbStatus: UNAVAILABLE
ConsumedRu: 1
 sessionId: 
2025-11-03T16:52:10.789724Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 16 sessionId:  is DEAD
Test retry state: get retry delay
2025-11-03T16:52:10.791056Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: kqp error Marker# PQ50 : Response {   SessionId: "ydb://session/3?node_id=1&id=YTNiMWM3ZC1kNTllMWU2Mi1hNjA5NDQ5MS04Y2U3NDg3Mg=="   QueryIssues {     message: "Failed to resolve tablet: 72075186224037891 after several retries."     severity: 1   }   TxMeta {     id: "01k95a47dh0dsv4pgam2dfyv4s"   } } YdbStatus: UNAVAILABLE ConsumedRu: 1 , code: 500001 
2025-11-03T16:52:10.791099Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Write session will restart in 2.000000s
2025-11-03T16:52:10.791187Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Write session: Do CDS request
2025-11-03T16:52:10.791217Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Do schedule cds request after 2000 ms
2025-11-03T16:52:11.386129Z node 1 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976715739. Failed to resolve tablet: 72075186224037890 after several retries.
2025-11-03T16:52:11.386252Z node 1 :KQP_EXECUTER WARN: kqp_executer_impl.h:245: ActorId: [1:7568542966950404909:2768] TxId: 281474976715739. Ctx: { TraceId: 01k95a47jtbk5kdj9ar0j8cn1b, Database: /Root, SessionId: ydb://session/3?node_id=1&id=Njg3OTllMzAtOWZhMTI1ODMtNjgzMjFjMzEtZTM5MDY2NTU=, PoolId: default}. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037890 after several retries.
2025-11-03T16:52:11.386507Z node 1 :KQP_SESSION WARN: kqp_session_actor.cpp:2987: SessionId: ydb://session/3?node_id=1&id=Njg3OTllMzAtOWZhMTI1ODMtNjgzMjFjMzEtZTM5MDY2NTU=, ActorId: [1:7568542962655437584:2768], ActorState: ExecuteState, TraceId: 01k95a47jtbk5kdj9ar0j8cn1b, Create QueryResponse for error on request, msg: 
2025-11-03T16:52:11.387698Z node 1 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Failed to resolve tablet: 72075186224037890 after several retries." severity: 1 } TxMeta { id: "01k95a480y7fa330cgbhf02smp" } } YdbStatus: UNAVAILABLE ConsumedRu: 297 }
2025-11-03T16:52:12.606304Z node 2 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976720697. Failed to resolve tablet: 72075186224037890 after several retries.
2025-11-03T16:52:12.606421Z node 2 :KQP_EXECUTER WARN: kqp_executer_impl.h:245: ActorId: [2:7568542971242916587:2582] TxId: 281474976720697. Ctx: { TraceId: 01k95a48ry034b0msmgqmah54r, Database: /Root, SessionId: ydb://session/3?node_id=2&id=YzY2NTA4YmUtY2IyMDJlMzUtZGYzNjkxYzEtNWZlMGRkMzM=, PoolId: default}. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037890 after several retries.
2025-11-03T16:52:12.606662Z node 2 :KQP_SESSION WARN: kqp_session_actor.cpp:2987: SessionId: ydb://session/3?node_id=2&id=YzY2NTA4YmUtY2IyMDJlMzUtZGYzNjkxYzEtNWZlMGRkMzM=, ActorId: [2:7568542971242916574:2582], ActorState: ExecuteState, TraceId: 01k95a48ry034b0msmgqmah54r, Create QueryResponse for error on request, msg: 
2025-11-03T16:52:12.607763Z node 2 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Failed to resolve tablet: 72075186224037890 after several retries." severity: 1 } TxMeta { id: "01k95a4968bczsrn6xerfw968t" } } YdbStatus: UNAVAILABLE ConsumedRu: 277 }
2025-11-03T16:52:12.792305Z :INFO: [/Root] MessageGroupId [test-message-group-id] Running cds request ms
2025-11-03T16:52:12.804665Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Got CDS response: 
write_sessions_clusters { clusters { endpoint: "localhost:1567" name: "dc1" available: true } primary_cluster_selection_reason: CLIENT_LOCATION } version: 1
2025-11-03T16:52:12.804713Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Start write session. Will connect to endpoint: localhost:1567
2025-11-03T16:52:12.809132Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" }
2025-11-03T16:52:12.812625Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-11-03T16:52:12.812658Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 17
2025-11-03T16:52:12.813075Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 17 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" }
2025-11-03T16:52:12.813200Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 17 topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" from ipv6:[::1]:34482
2025-11-03T16:52:12.813216Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=17 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:34482 proto=v1  topic=test-topic durationSec=0
2025-11-03T16:52:12.813227Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-11-03T16:52:12.814397Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 17 sessionId:  describe result for acl check
2025-11-03T16:52:12.814507Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-11-03T16:52:12.814530Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-11-03T16:52:12.814538Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-11-03T16:52:12.814553Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7568542975540339636:2786] (SourceId=test-message-group-id, PreferedPartition=(NULL)) StartKqpSession
2025-11-03T16:52:12.816414Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7568542975540339636:2786] (SourceId=test-message-group-id, PreferedPartition=(NULL)) Select from the table
2025-11-03T16:52:13.748075Z node 1 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976715742. Failed to resolve tablet: 72075186224037888 after several retries.
2025-11-03T16:52:13.748198Z node 1 :KQP_EXECUTER WARN: kqp_executer_impl.h:245: ActorId: [1:7568542975540339622:2779] TxId: 281474976715742. Ctx: { TraceId: 01k95a49z6c8a9y3pa2xvdv332, Database: /Root, SessionId: ydb://session/3?node_id=1&id=MjIxYzJmNDMtYjE1MzE4MTgtODc3MzcyZWEtMWEwYzY3MWU=, PoolId: default}. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037888 after several retries.
2025-11-03T16:52:13.748436Z node 1 :KQP_SESSION WARN: kqp_session_actor.cpp:2987: SessionId: ydb://session/3?node_id=1&id=MjIxYzJmNDMtYjE1MzE4MTgtODc3MzcyZWEtMWEwYzY3MWU=, ActorId: [1:7568542975540339603:2779], ActorState: ExecuteState, TraceId: 01k95a49z6c8a9y3pa2xvdv332, Create QueryResponse for error on request, msg: 
2025-11-03T16:52:13.752897Z node 1 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Failed to resolve tablet: 72075186224037888 after several retries." severity: 1 } TxMeta { id: "01k95a4aar6ehjd5gcgx6sgx8y" } } YdbStatus: UNAVAILABLE ConsumedRu: 240 }
2025-11-03T16:52:13.800487Z node 1 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976715743. Failed to resolve tablet: 72075186224037891 after several retries.
2025-11-03T16:52:13.800612Z node 1 :KQP_EXECUTER WARN: kqp_executer_impl.h:245: ActorId: [1:7568542975540339644:2788] TxId: 281474976715743. Ctx: { TraceId: 01k95a4acg6ck2fan2en2q9f1s, Database: /Root, SessionId: ydb://session/3?node_id=1&id=OGFkMWQzNjAtZWNhNWI5NGQtYzFmYjA0ODAtY2ZhNGYxYjM=, PoolId: default}. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037891 after several retries.
2025-11-03T16:52:13.800827Z node 1 :KQP_SESSION WARN: kqp_session_actor.cpp:2987: SessionId: ydb://session/3?node_id=1&id=OGFkMWQzNjAtZWNhNWI5NGQtYzFmYjA0ODAtY2ZhNGYxYjM=, ActorId: [1:7568542975540339637:2788], ActorState: ExecuteState, TraceId: 01k95a4acg6ck2fan2en2q9f1s, Create QueryResponse for error on request, msg: 
Test retry state: get retry delay
2025-11-03T16:52:13.803155Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: kqp error Marker# PQ50 : Response {   SessionId: "ydb://session/3?node_id=1&id=OGFkMWQzNjAtZWNhNWI5NGQtYzFmYjA0ODAtY2ZhNGYxYjM="   QueryIssues {     message: "Failed to resolve tablet: 72075186224037891 after several retries."     severity: 1   }   TxMeta {     id: "01k95a4ach3m6k5abdd1a1gdvp"   } } YdbStatus: UNAVAILABLE ConsumedRu: 1 , code: 500001 
2025-11-03T16:52:13.803189Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Write session will restart in 2.000000s
2025-11-03T16:52:13.803260Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Write session: Do CDS request
2025-11-03T16:52:13.803290Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Do schedule cds request after 2000 ms
2025-11-03T16:52:13.802196Z node 1 :PQ_PARTITION_CHOOSER INFO: partition_chooser_impl__abstract_chooser_actor.h:312: TPartitionChooser [1:7568542975540339636:2786] (SourceId=test-message-group-id, PreferedPartition=(NULL)) ReplyError: kqp error Marker# PQ50 : Response {
  SessionId: "ydb://session/3?node_id=1&id=OGFkMWQzNjAtZWNhNWI5NGQtYzFmYjA0ODAtY2ZhNGYxYjM="
  QueryIssues {
    message: "Failed to resolve tablet: 72075186224037891 after several retries."
    severity: 1
  }
  TxMeta {
    id: "01k95a4ach3m6k5abdd1a1gdvp"
  }
}
YdbStatus: UNAVAILABLE
ConsumedRu: 1
2025-11-03T16:52:13.802270Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 17 reason: kqp error Marker# PQ50 : Response {
  SessionId: "ydb://session/3?node_id=1&id=OGFkMWQzNjAtZWNhNWI5NGQtYzFmYjA0ODAtY2ZhNGYxYjM="
  QueryIssues {
    message: "Failed to resolve tablet: 72075186224037891 after several retries."
    severity: 1
  }
  TxMeta {
    id: "01k95a4ach3m6k5abdd1a1gdvp"
  }
}
YdbStatus: UNAVAILABLE
ConsumedRu: 1
 sessionId: 
2025-11-03T16:52:13.802614Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 17 sessionId:  is DEAD
2025-11-03T16:52:15.100652Z node 2 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976720699. Failed to resolve tablet: 72075186224037888 after several retries.
2025-11-03T16:52:15.100770Z node 2 :KQP_EXECUTER WARN: kqp_executer_impl.h:245: ActorId: [2:7568542984127818559:2592] TxId: 281474976720699. Ctx: { TraceId: 01k95a4b5a1syrneck9kszhj3s, Database: /Root, SessionId: ydb://session/3?node_id=2&id=YjJiOGI0NTMtZGQ0ZTZkMDEtNmMyM2Y1NzQtNTA0M2U5OTM=, PoolId: default}. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037888 after several retries.
2025-11-03T16:52:15.101012Z node 2 :KQP_SESSION WARN: kqp_session_actor.cpp:2987: SessionId: ydb://session/3?node_id=2&id=YjJiOGI0NTMtZGQ0ZTZkMDEtNmMyM2Y1NzQtNTA0M2U5OTM=, ActorId: [2:7568542979832851246:2592], ActorState: ExecuteState, TraceId: 01k95a4b5a1syrneck9kszhj3s, Create QueryResponse for error on request, msg: 
2025-11-03T16:52:15.104787Z node 2 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Failed to resolve tablet: 72075186224037888 after several retries." severity: 1 } TxMeta { id: "01k95a4bmaajk52mnwvn630x23" } } YdbStatus: UNAVAILABLE ConsumedRu: 311 }
2025-11-03T16:52:15.808060Z :INFO: [/Root] MessageGroupId [test-message-group-id] Running cds request ms
2025-11-03T16:52:15.814883Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Got CDS response: 
write_sessions_clusters { clusters { endpoint: "localhost:1567" name: "dc1" available: true } primary_cluster_selection_reason: CLIENT_LOCATION } version: 1
2025-11-03T16:52:15.814935Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Start write session. Will connect to endpoint: localhost:1567
2025-11-03T16:52:15.819902Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" }
2025-11-03T16:52:15.820281Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-11-03T16:52:15.820311Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 18
2025-11-03T16:52:15.820821Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 18 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" }
2025-11-03T16:52:15.820946Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 18 topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" from ipv6:[::1]:34482
2025-11-03T16:52:15.820969Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=18 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:34482 proto=v1  topic=test-topic durationSec=0
2025-11-03T16:52:15.820980Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-11-03T16:52:15.822401Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 18 sessionId:  describe result for acl check
2025-11-03T16:52:15.822544Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-11-03T16:52:15.822555Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-11-03T16:52:15.822565Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-11-03T16:52:15.822581Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7568542988425241711:2803] (SourceId=test-message-group-id, PreferedPartition=(NULL)) StartKqpSession
2025-11-03T16:52:15.825092Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7568542988425241711:2803] (SourceId=test-message-group-id, PreferedPartition=(NULL)) Select from the table
2025-11-03T16:52:16.328091Z node 1 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976715746. Failed to resolve tablet: 72075186224037890 after several retries.
2025-11-03T16:52:16.328216Z node 1 :KQP_EXECUTER WARN: kqp_executer_impl.h:245: ActorId: [1:7568542988425241671:2794] TxId: 281474976715746. Ctx: { TraceId: 01k95a4c96d6t55vxqwbcy47vt, Database: /Root, SessionId: ydb://session/3?node_id=1&id=ZDE1NTlkYmYtYTk2OGY4YTItZTMzODdjMzItOTQ0YTNlYmY=, PoolId: default}. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037890 after several retries.
2025-11-03T16:52:16.328485Z node 1 :KQP_SESSION WARN: kqp_session_actor.cpp:2987: SessionId: ydb://session/3?node_id=1&id=ZDE1NTlkYmYtYTk2OGY4YTItZTMzODdjMzItOTQ0YTNlYmY=, ActorId: [1:7568542984130274351:2794], ActorState: ExecuteState, TraceId: 01k95a4c96d6t55vxqwbcy47vt, Create QueryResponse for error on request, msg: 
2025-11-03T16:52:16.329259Z node 1 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Failed to resolve tablet: 72075186224037890 after several retries." severity: 1 } TxMeta { id: "01k95a4cvf2kvk659yxrq1f172" } } YdbStatus: UNAVAILABLE ConsumedRu: 386 }
2025-11-03T16:52:16.823417Z node 1 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976715747. Failed to resolve tablet: 72075186224037891 after several retries.
2025-11-03T16:52:16.823518Z node 1 :KQP_EXECUTER WARN: kqp_executer_impl.h:245: ActorId: [1:7568542988425241722:2805] TxId: 281474976715747. Ctx: { TraceId: 01k95a4dah072vzdf0q23df7yh, Database: /Root, SessionId: ydb://session/3?node_id=1&id=NmQ4MmE0YjItNDFiMzc3NmEtY2ViYWZhMjQtOWVmNDgxMzY=, PoolId: default}. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037891 after several retries.
2025-11-03T16:52:16.823715Z node 1 :KQP_SESSION WARN: kqp_session_actor.cpp:2987: SessionId: ydb://session/3?node_id=1&id=NmQ4MmE0YjItNDFiMzc3NmEtY2ViYWZhMjQtOWVmNDgxMzY=, ActorId: [1:7568542988425241714:2805], ActorState: ExecuteState, TraceId: 01k95a4dah072vzdf0q23df7yh, Create QueryResponse for error on request, msg: 
2025-11-03T16:52:16.826885Z node 1 :PQ_PARTITION_CHOOSER INFO: partition_chooser_impl__abstract_chooser_actor.h:312: TPartitionChooser [1:7568542988425241711:2803] (SourceId=test-message-group-id, PreferedPartition=(NULL)) ReplyError: kqp error Marker# PQ50 : Response {
  SessionId: "ydb://session/3?node_id=1&id=NmQ4MmE0YjItNDFiMzc3NmEtY2ViYWZhMjQtOWVmNDgxMzY="
  QueryIssues {
    message: "Failed to resolve tablet: 72075186224037891 after several retries."
    severity: 1
  }
  TxMeta {
    id: "01k95a4dah072vzdf0q2vsjjrb"
  }
}
YdbStatus: UNAVAILABLE
ConsumedRu: 1
2025-11-03T16:52:16.826962Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 18 reason: kqp error Marker# PQ50 : Response {
  SessionId: "ydb://session/3?node_id=1&id=NmQ4MmE0YjItNDFiMzc3NmEtY2ViYWZhMjQtOWVmNDgxMzY="
  QueryIssues {
    message: "Failed to resolve tablet: 72075186224037891 after several retries."
    severity: 1
  }
  TxMeta {
    id: "01k95a4dah072vzdf0q2vsjjrb"
  }
}
YdbStatus: UNAVAILABLE
ConsumedRu: 1
 sessionId: 
2025-11-03T16:52:16.827335Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 18 sessionId:  is DEAD
Test retry state: get retry delay
2025-11-03T16:52:16.831962Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: kqp error Marker# PQ50 : Response {   SessionId: "ydb://session/3?node_id=1&id=NmQ4MmE0YjItNDFiMzc3NmEtY2ViYWZhMjQtOWVmNDgxMzY="   QueryIssues {     message: "Failed to resolve tablet: 72075186224037891 after several retries."     severity: 1   }   TxMeta {     id: "01k95a4dah072vzdf0q2vsjjrb"   } } YdbStatus: UNAVAILABLE ConsumedRu: 1 , code: 500001 
2025-11-03T16:52:16.832019Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Write session will restart in 2.000000s
2025-11-03T16:52:16.832117Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Write session: Do CDS request
2025-11-03T16:52:16.832164Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Do schedule cds request after 2000 ms
2025-11-03T16:52:17.865292Z node 2 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976720701. Failed to resolve tablet: 72075186224037888 after several retries.
2025-11-03T16:52:17.865420Z node 2 :KQP_EXECUTER WARN: kqp_executer_impl.h:245: ActorId: [2:7568542992717753236:2604] TxId: 281474976720701. Ctx: { TraceId: 01k95a4dkbb6eqcn3ce3c5cdz2, Database: /Root, SessionId: ydb://session/3?node_id=2&id=OWQ5NmM2NWItYjE3N2Q0YWMtOGIxZDFlNWQtNzFiMmUxYjM=, PoolId: default}. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037888 after several retries.
2025-11-03T16:52:17.865713Z node 2 :KQP_SESSION WARN: kqp_session_actor.cpp:2987: SessionId: ydb://session/3?node_id=2&id=OWQ5NmM2NWItYjE3N2Q0YWMtOGIxZDFlNWQtNzFiMmUxYjM=, ActorId: [2:7568542992717753218:2604], ActorState: ExecuteState, TraceId: 01k95a4dkbb6eqcn3ce3c5cdz2, Create QueryResponse for error on request, msg: 
2025-11-03T16:52:17.867148Z node 2 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Failed to resolve tablet: 72075186224037888 after several retries." severity: 1 } TxMeta { id: "01k95a4ea26z576t2fnmgyctrt" } } YdbStatus: UNAVAILABLE ConsumedRu: 480 }
2025-11-03T16:52:18.743331Z node 1 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976715750. Failed to resolve tablet: 72075186224037890 after several retries.
2025-11-03T16:52:18.743469Z node 1 :KQP_EXECUTER WARN: kqp_executer_impl.h:245: ActorId: [1:7568542997015176423:2811] TxId: 281474976715750. Ctx: { TraceId: 01k95a4esp1z25martajzds1hw, Database: /Root, SessionId: ydb://session/3?node_id=1&id=OTEwNTcxZDAtY2RjOTY0ODAtZWY1Y2FiMTctYzAyOTYxZGE=, PoolId: default}. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037890 after several retries.
2025-11-03T16:52:18.743727Z node 1 :KQP_SESSION WARN: kqp_session_actor.cpp:2987: SessionId: ydb://session/3?node_id=1&id=OTEwNTcxZDAtY2RjOTY0ODAtZWY1Y2FiMTctYzAyOTYxZGE=, ActorId: [1:7568542997015176404:2811], ActorState: ExecuteState, TraceId: 01k95a4esp1z25martajzds1hw, Create QueryResponse for error on request, msg: 
2025-11-03T16:52:18.744886Z node 1 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Failed to resolve tablet: 72075186224037890 after several retries." severity: 1 } TxMeta { id: "01k95a4f6w8w6fn3sxdv1as3s5" } } YdbStatus: UNAVAILABLE ConsumedRu: 274 }
2025-11-03T16:52:18.836224Z :INFO: [/Root] MessageGroupId [test-message-group-id] Running cds request ms
2025-11-03T16:52:18.841198Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Got CDS response: 
write_sessions_clusters { clusters { endpoint: "localhost:1567" name: "dc1" available: true } primary_cluster_selection_reason: CLIENT_LOCATION } version: 1
2025-11-03T16:52:18.841249Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Start write session. Will connect to endpoint: localhost:1567
2025-11-03T16:52:18.844571Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" }
2025-11-03T16:52:18.845550Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-11-03T16:52:18.845581Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 19
2025-11-03T16:52:18.846064Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 19 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" }
2025-11-03T16:52:18.846190Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 19 topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" from ipv6:[::1]:34482
2025-11-03T16:52:18.846206Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=19 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:34482 proto=v1  topic=test-topic durationSec=0
2025-11-03T16:52:18.846217Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-11-03T16:52:18.847628Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 19 sessionId:  describe result for acl check
2025-11-03T16:52:18.847765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-11-03T16:52:18.847775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-11-03T16:52:18.847783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-11-03T16:52:18.847801Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7568543001310143796:2820] (SourceId=test-message-group-id, PreferedPartition=(NULL)) StartKqpSession
2025-11-03T16:52:18.850413Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7568543001310143796:2820] (SourceId=test-message-group-id, PreferedPartition=(NULL)) Select from the table
2025-11-03T16:52:19.852498Z node 1 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976715752. Failed to resolve tablet: 72075186224037891 after several retries.
2025-11-03T16:52:19.852606Z node 1 :KQP_EXECUTER WARN: kqp_executer_impl.h:245: ActorId: [1:7568543001310143805:2822] TxId: 281474976715752. Ctx: { TraceId: 01k95a4g920hdqmsv3fk0c337x, Database: /Root, SessionId: ydb://session/3?node_id=1&id=OTNhODhjYzMtNDMxOTU5YzUtNjBmNjhhZWQtODEyMWY5MDQ=, PoolId: default}. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037891 after several retries.
2025-11-03T16:52:19.852809Z node 1 :KQP_SESSION WARN: kqp_session_actor.cpp:2987: SessionId: ydb://session/3?node_id=1&id=OTNhODhjYzMtNDMxOTU5YzUtNjBmNjhhZWQtODEyMWY5MDQ=, ActorId: [1:7568543001310143797:2822], ActorState: ExecuteState, TraceId: 01k95a4g920hdqmsv3fk0c337x, Create QueryResponse for error on request, msg: 
2025-11-03T16:52:19.854086Z node 1 :PQ_PARTITION_CHOOSER INFO: partition_chooser_impl__abstract_chooser_actor.h:312: TPartitionChooser [1:7568543001310143796:2820] (SourceId=test-message-group-id, PreferedPartition=(NULL)) ReplyError: kqp error Marker# PQ50 : Response {
  SessionId: "ydb://session/3?node_id=1&id=OTNhODhjYzMtNDMxOTU5YzUtNjBmNjhhZWQtODEyMWY5MDQ="
  QueryIssues {
    message: "Failed to resolve tablet: 72075186224037891 after several retries."
    severity: 1
  }
  TxMeta {
    id: "01k95a4g931mhf6v81d5r078xh"
  }
}
YdbStatus: UNAVAILABLE
ConsumedRu: 1
2025-11-03T16:52:19.854163Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 19 reason: kqp error Marker# PQ50 : Response {
  SessionId: "ydb://session/3?node_id=1&id=OTNhODhjYzMtNDMxOTU5YzUtNjBmNjhhZWQtODEyMWY5MDQ="
  QueryIssues {
    message: "Failed to resolve tablet: 72075186224037891 after several retries."
    severity: 1
  }
  TxMeta {
    id: "01k95a4g931mhf6v81d5r078xh"
  }
}
YdbStatus: UNAVAILABLE
ConsumedRu: 1
 sessionId: 
2025-11-03T16:52:19.854580Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 19 sessionId:  is DEAD
Test retry state: get retry delay
2025-11-03T16:52:19.856561Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: kqp error Marker# PQ50 : Response {   SessionId: "ydb://session/3?node_id=1&id=OTNhODhjYzMtNDMxOTU5YzUtNjBmNjhhZWQtODEyMWY5MDQ="   QueryIssues {     message: "Failed to resolve tablet: 72075186224037891 after several retries."     severity: 1   }   TxMeta {     id: "01k95a4g931mhf6v81d5r078xh"   } } YdbStatus: UNAVAILABLE ConsumedRu: 1 , code: 500001 
2025-11-03T16:52:19.856602Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Write session will restart in 2.000000s
2025-11-03T16:52:19.856682Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Write session: Do CDS request
2025-11-03T16:52:19.856732Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Do schedule cds request after 2000 ms
2025-11-03T16:52:20.392093Z node 2 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976720703. Failed to resolve tablet: 72075186224037890 after several retries.
2025-11-03T16:52:20.392238Z node 2 :KQP_EXECUTER WARN: kqp_executer_impl.h:245: ActorId: [2:7568543005602655203:2616] TxId: 281474976720703. Ctx: { TraceId: 01k95a4g9vd86q5rpw7hay0pyd, Database: /Root, SessionId: ydb://session/3?node_id=2&id=YjM0MDMxMTYtODQzYTJjZjktNjMyM2MwMjgtZDIxYTEzMGU=, PoolId: default}. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037890 after several retries.
2025-11-03T16:52:20.392506Z node 2 :KQP_SESSION WARN: kqp_session_actor.cpp:2987: SessionId: ydb://session/3?node_id=2&id=YjM0MDMxMTYtODQzYTJjZjktNjMyM2MwMjgtZDIxYTEzMGU=, ActorId: [2:7568543001307687894:2616], ActorState: ExecuteState, TraceId: 01k95a4g9vd86q5rpw7hay0pyd, Create QueryResponse for error on request, msg: 
2025-11-03T16:52:20.393343Z node 2 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Failed to resolve tablet: 72075186224037890 after several retries." severity: 1 } TxMeta { id: "01k95a4gq4e8q63sjpzr972ecn" } } YdbStatus: UNAVAILABLE ConsumedRu: 278 }
2025-11-03T16:52:21.252109Z node 1 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976715754. Failed to resolve tablet: 72075186224037888 after several retries.
2025-11-03T16:52:21.252231Z node 1 :KQP_EXECUTER WARN: kqp_executer_impl.h:245: ActorId: [1:7568543009900078465:2826] TxId: 281474976715754. Ctx: { TraceId: 01k95a4h566zms5sj51e222j4a, Database: /Root, SessionId: ydb://session/3?node_id=1&id=ZTc0ZDQ0ZmYtNGEwZDg0MTktZDAyM2MxNjktMmNkMTQ0MGM=, PoolId: default}. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037888 after several retries.
2025-11-03T16:52:21.252471Z node 1 :KQP_SESSION WARN: kqp_session_actor.cpp:2987: SessionId: ydb://session/3?node_id=1&id=ZTc0ZDQ0ZmYtNGEwZDg0MTktZDAyM2MxNjktMmNkMTQ0MGM=, ActorId: [1:7568543005605111139:2826], ActorState: ExecuteState, TraceId: 01k95a4h566zms5sj51e222j4a, Create QueryResponse for error on request, msg: 
2025-11-03T16:52:21.253331Z node 1 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Failed to resolve tablet: 72075186224037888 after several retries." severity: 1 } TxMeta { id: "01k95a4hmg3zmtwxxvsdzenwxp" } } YdbStatus: UNAVAILABLE ConsumedRu: 319 }
2025-11-03T16:52:21.860062Z :INFO: [/Root] MessageGroupId [test-message-group-id] Running cds request ms
2025-11-03T16:52:21.868062Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Got CDS response: 
write_sessions_clusters { clusters { endpoint: "localhost:1567" name: "dc1" available: true } primary_cluster_selection_reason: CLIENT_LOCATION } version: 1
2025-11-03T16:52:21.868120Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Start write session. Will connect to endpoint: localhost:1567
2025-11-03T16:52:21.873193Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" }
2025-11-03T16:52:21.876692Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-11-03T16:52:21.876722Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 20
2025-11-03T16:52:21.877129Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 20 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" }
2025-11-03T16:52:21.877250Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 20 topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" from ipv6:[::1]:34482
2025-11-03T16:52:21.877265Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=20 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:34482 proto=v1  topic=test-topic durationSec=0
2025-11-03T16:52:21.877274Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-11-03T16:52:21.878668Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 20 sessionId:  describe result for acl check
2025-11-03T16:52:21.878788Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-11-03T16:52:21.878799Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-11-03T16:52:21.878808Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-11-03T16:52:21.878826Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7568543014195045849:2837] (SourceId=test-message-group-id, PreferedPartition=(NULL)) StartKqpSession
2025-11-03T16:52:21.881368Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7568543014195045849:2837] (SourceId=test-message-group-id, PreferedPartition=(NULL)) Select from the table
2025-11-03T16:52:22.895382Z node 1 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976715756. Failed to resolve tablet: 72075186224037891 after several retries.
2025-11-03T16:52:22.895487Z node 1 :KQP_EXECUTER WARN: kqp_executer_impl.h:245: ActorId: [1:7568543014195045861:2839] TxId: 281474976715756. Ctx: { TraceId: 01k95a4k7sfcm2ah04ytnm8ncm, Database: /Root, SessionId: ydb://session/3?node_id=1&id=OGFiYTNmZDEtMTAyZWE2MzEtNGYyYjJjODQtZWUwN2EzMjE=, PoolId: default}. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037891 after several retries.
2025-11-03T16:52:22.895679Z node 1 :KQP_SESSION WARN: kqp_session_actor.cpp:2987: SessionId: ydb://session/3?node_id=1&id=OGFiYTNmZDEtMTAyZWE2MzEtNGYyYjJjODQtZWUwN2EzMjE=, ActorId: [1:7568543014195045850:2839], ActorState: ExecuteState, TraceId: 01k95a4k7sfcm2ah04ytnm8ncm, Create QueryResponse for error on request, msg: 
2025-11-03T16:52:22.897331Z node 1 :PQ_PARTITION_CHOOSER INFO: partition_chooser_impl__abstract_chooser_actor.h:312: TPartitionChooser [1:7568543014195045849:2837] (SourceId=test-message-group-id, PreferedPartition=(NULL)) ReplyError: kqp error Marker# PQ50 : Response {
  SessionId: "ydb://session/3?node_id=1&id=OGFiYTNmZDEtMTAyZWE2MzEtNGYyYjJjODQtZWUwN2EzMjE="
  QueryIssues {
    message: "Failed to resolve tablet: 72075186224037891 after several retries."
    severity: 1
  }
  TxMeta {
    id: "01k95a4k7t7qt9vv0teqctmvkv"
  }
}
YdbStatus: UNAVAILABLE
ConsumedRu: 1
2025-11-03T16:52:22.897405Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 20 reason: kqp error Marker# PQ50 : Response {
  SessionId: "ydb://session/3?node_id=1&id=OGFiYTNmZDEtMTAyZWE2MzEtNGYyYjJjODQtZWUwN2EzMjE="
  QueryIssues {
    message: "Failed to resolve tablet: 72075186224037891 after several retries."
    severity: 1
  }
  TxMeta {
    id: "01k95a4k7t7qt9vv0teqctmvkv"
  }
}
YdbStatus: UNAVAILABLE
ConsumedRu: 1
 sessionId: 
2025-11-03T16:52:22.897727Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 20 sessionId:  is DEAD
Test retry state: get retry delay
2025-11-03T16:52:22.899373Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: kqp error Marker# PQ50 : Response {   SessionId: "ydb://session/3?node_id=1&id=OGFiYTNmZDEtMTAyZWE2MzEtNGYyYjJjODQtZWUwN2EzMjE="   QueryIssues {     message: "Failed to resolve tablet: 72075186224037891 after several retries."     severity: 1   }   TxMeta {     id: "01k95a4k7t7qt9vv0teqctmvkv"   } } YdbStatus: UNAVAILABLE ConsumedRu: 1 , code: 500001 
2025-11-03T16:52:22.900503Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Write session will restart in 2.000000s
2025-11-03T16:52:22.900619Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Write session: Do CDS request
2025-11-03T16:52:22.900662Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Do schedule cds request after 2000 ms
2025-11-03T16:52:22.940076Z node 2 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976720705. Failed to resolve tablet: 72075186224037890 after several retries.
2025-11-03T16:52:22.940183Z node 2 :KQP_EXECUTER WARN: kqp_executer_impl.h:245: ActorId: [2:7568543014192589879:2626] TxId: 281474976720705. Ctx: { TraceId: 01k95a4jrp9wzreq6k01sbzvd7, Database: /Root, SessionId: ydb://session/3?node_id=2&id=NmZiMDBmZjktNmNhMTEzZWEtY2RhZTlmMmQtNDk0Y2Y0NzM=, PoolId: default}. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037890 after several retries.
2025-11-03T16:52:22.940391Z node 2 :KQP_SESSION WARN: kqp_session_actor.cpp:2987: SessionId: ydb://session/3?node_id=2&id=NmZiMDBmZjktNmNhMTEzZWEtY2RhZTlmMmQtNDk0Y2Y0NzM=, ActorId: [2:7568543014192589862:2626], ActorState: ExecuteState, TraceId: 01k95a4jrp9wzreq6k01sbzvd7, Create QueryResponse for error on request, msg: 
2025-11-03T16:52:22.941227Z node 2 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Failed to resolve tablet: 72075186224037890 after several retries." severity: 1 } TxMeta { id: "01k95a4k9ab1nr9vpjphny3cnq" } } YdbStatus: UNAVAILABLE ConsumedRu: 345 }
2025-11-03T16:52:23.672053Z node 1 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976715757. Failed to resolve tablet: 72075186224037890 after several retries.
2025-11-03T16:52:23.672185Z node 1 :KQP_EXECUTER WARN: kqp_executer_impl.h:245: ActorId: [1:7568543018490013199:2842] TxId: 281474976715757. Ctx: { TraceId: 01k95a4kkj1g12c74cfgyt83d3, Database: /Root, SessionId: ydb://session/3?node_id=1&id=OThmOTYyNjUtY2IyMDU1NjMtNzA5YzU4YmItZDQxZmZmYjA=, PoolId: default}. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037890 after several retries.
2025-11-03T16:52:23.672429Z node 1 :KQP_SESSION WARN: kqp_session_actor.cpp:2987: SessionId: ydb://session/3?node_id=1&id=OThmOTYyNjUtY2IyMDU1NjMtNzA5YzU4YmItZDQxZmZmYjA=, ActorId: [1:7568543018490013175:2842], ActorState: ExecuteState, TraceId: 01k95a4kkj1g12c74cfgyt83d3, Create QueryResponse for error on request, msg: 
2025-11-03T16:52:23.677214Z node 1 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Failed to resolve tablet: 72075186224037890 after several retries." severity: 1 } TxMeta { id: "01k95a4m0g5vc4nx2491jv5pzq" } } YdbStatus: UNAVAILABLE ConsumedRu: 269 }
2025-11-03T16:52:24.908063Z :INFO: [/Root] MessageGroupId [test-message-group-id] Running cds request ms
2025-11-03T16:52:24.916201Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Got CDS response: 
write_sessions_clusters { clusters { endpoint: "localhost:1567" name: "dc1" available: true } primary_cluster_selection_reason: CLIENT_LOCATION } version: 1
2025-11-03T16:52:24.916259Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Start write session. Will connect to endpoint: localhost:1567
2025-11-03T16:52:24.920075Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" }
2025-11-03T16:52:24.920354Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-11-03T16:52:24.920386Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 21
2025-11-03T16:52:24.920728Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 21 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" }
2025-11-03T16:52:24.920855Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 21 topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" from ipv6:[::1]:34482
2025-11-03T16:52:24.920878Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=21 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:34482 proto=v1  topic=test-topic durationSec=0
2025-11-03T16:52:24.920888Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-11-03T16:52:24.922142Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 21 sessionId:  describe result for acl check
2025-11-03T16:52:24.922263Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-11-03T16:52:24.922274Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-11-03T16:52:24.922282Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-11-03T16:52:24.922298Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7568543027079947913:2861] (SourceId=test-message-group-id, PreferedPartition=(NULL)) StartKqpSession
2025-11-03T16:52:24.924765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7568543027079947913:2861] (SourceId=test-message-group-id, PreferedPartition=(NULL)) Select from the table
2025-11-03T16:52:25.341137Z node 2 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976720707. Failed to resolve tablet: 72075186224037890 after several retries.
2025-11-03T16:52:25.341251Z node 2 :KQP_EXECUTER WARN: kqp_executer_impl.h:245: ActorId: [2:7568543027077491846:2638] TxId: 281474976720707. Ctx: { TraceId: 01k95a4n8a4hk42qdzt8qm3x8k, Database: /Root, SessionId: ydb://session/3?node_id=2&id=NWFhMDZhZDUtMzYwYjhiN2MtZmIxNDA4MzAtYWMxY2JiYTc=, PoolId: default}. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037890 after several retries.
2025-11-03T16:52:25.341493Z node 2 :KQP_SESSION WARN: kqp_session_actor.cpp:2987: SessionId: ydb://session/3?node_id=2&id=NWFhMDZhZDUtMzYwYjhiN2MtZmIxNDA4MzAtYWMxY2JiYTc=, ActorId: [2:7568543022782524537:2638], ActorState: ExecuteState, TraceId: 01k95a4n8a4hk42qdzt8qm3x8k, Create QueryResponse for error on request, msg: 
2025-11-03T16:52:25.342715Z node 2 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Failed to resolve tablet: 72075186224037890 after several retries." severity: 1 } TxMeta { id: "01k95a4nk8dedf3bkdp7xqkksh" } } YdbStatus: UNAVAILABLE ConsumedRu: 225 }
2025-11-03T16:52:25.908518Z node 1 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976715760. Failed to resolve tablet: 72075186224037891 after several retries.
2025-11-03T16:52:25.908625Z node 1 :KQP_EXECUTER WARN: kqp_executer_impl.h:245: ActorId: [1:7568543027079947925:2863] TxId: 281474976715760. Ctx: { TraceId: 01k95a4p6x8smcae45ekv982zh, Database: /Root, SessionId: ydb://session/3?node_id=1&id=MTBjMzk1Ny1mMDZmMjcxMy02YTIyYzAyLWQ0YWVlM2Yy, PoolId: default}. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037891 after several retries.
2025-11-03T16:52:25.908834Z node 1 :KQP_SESSION WARN: kqp_session_actor.cpp:2987: SessionId: ydb://session/3?node_id=1&id=MTBjMzk1Ny1mMDZmMjcxMy02YTIyYzAyLWQ0YWVlM2Yy, ActorId: [1:7568543027079947914:2863], ActorState: ExecuteState, TraceId: 01k95a4p6x8smcae45ekv982zh, Create QueryResponse for error on request, msg: 
2025-11-03T16:52:25.910169Z node 1 :PQ_PARTITION_CHOOSER INFO: partition_chooser_impl__abstract_chooser_actor.h:312: TPartitionChooser [1:7568543027079947913:2861] (SourceId=test-message-group-id, PreferedPartition=(NULL)) ReplyError: kqp error Marker# PQ50 : Response {
  SessionId: "ydb://session/3?node_id=1&id=MTBjMzk1Ny1mMDZmMjcxMy02YTIyYzAyLWQ0YWVlM2Yy"
  QueryIssues {
    message: "Failed to resolve tablet: 72075186224037891 after several retries."
    severity: 1
  }
  TxMeta {
    id: "01k95a4p6x8smcae45enwrd733"
  }
}
YdbStatus: UNAVAILABLE
ConsumedRu: 1
2025-11-03T16:52:25.910249Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 21 reason: kqp error Marker# PQ50 : Response {
  SessionId: "ydb://session/3?node_id=1&id=MTBjMzk1Ny1mMDZmMjcxMy02YTIyYzAyLWQ0YWVlM2Yy"
  QueryIssues {
    message: "Failed to resolve tablet: 72075186224037891 after several retries."
    severity: 1
  }
  TxMeta {
    id: "01k95a4p6x8smcae45enwrd733"
  }
}
YdbStatus: UNAVAILABLE
ConsumedRu: 1
 sessionId: 
2025-11-03T16:52:25.910588Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 21 sessionId:  is DEAD
Test retry state: get retry delay
2025-11-03T16:52:25.920319Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: kqp error Marker# PQ50 : Response {   SessionId: "ydb://session/3?node_id=1&id=MTBjMzk1Ny1mMDZmMjcxMy02YTIyYzAyLWQ0YWVlM2Yy"   QueryIssues {     message: "Failed to resolve tablet: 72075186224037891 after several retries."     severity: 1   }   TxMeta {     id: "01k95a4p6x8smcae45enwrd733"   } } YdbStatus: UNAVAILABLE ConsumedRu: 1 , code: 500001 
2025-11-03T16:52:25.920355Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Write session will restart in 2.000000s
2025-11-03T16:52:25.920449Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Write session: Do CDS request
2025-11-03T16:52:25.920481Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Do schedule cds request after 2000 ms
2025-11-03T16:52:26.102976Z node 1 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976715761. Failed to resolve tablet: 72075186224037890 after several retries.
2025-11-03T16:52:26.103091Z node 1 :KQP_EXECUTER WARN: kqp_executer_impl.h:245: ActorId: [1:7568543031374915231:2853] TxId: 281474976715761. Ctx: { TraceId: 01k95a4nz842ys6gef2s9z415p, Database: /Root, SessionId: ydb://session/3?node_id=1&id=ZmI3ZWM5YzAtODQxZDY2NjYtN2JlZmJmOWMtOGM3NDJhZmM=, PoolId: default}. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037890 after several retries.
2025-11-03T16:52:26.103342Z node 1 :KQP_SESSION WARN: kqp_session_actor.cpp:2987: SessionId: ydb://session/3?node_id=1&id=ZmI3ZWM5YzAtODQxZDY2NjYtN2JlZmJmOWMtOGM3NDJhZmM=, ActorId: [1:7568543027079947889:2853], ActorState: ExecuteState, TraceId: 01k95a4nz842ys6gef2s9z415p, Create QueryResponse for error on request, msg: 
2025-11-03T16:52:26.108511Z node 1 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Failed to resolve tablet: 72075186224037890 after several retries." severity: 1 } TxMeta { id: "01k95a4pcmdxa2tprp4w4wfjbq" } } YdbStatus: UNAVAILABLE ConsumedRu: 277 }
2025-11-03T16:52:27.686710Z node 2 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976720709. Failed to resolve tablet: 72075186224037890 after several retries.
2025-11-03T16:52:27.686821Z node 2 :KQP_EXECUTER WARN: kqp_executer_impl.h:245: ActorId: [2:7568543035667426519:2648] TxId: 281474976720709. Ctx: { TraceId: 01k95a4qk9a031f53nhdmef7ty, Database: /Root, SessionId: ydb://session/3?node_id=2&id=MjA4N2UwNTAtN2RlMTdmNjEtNjZhMGEyZTctYzE5OWM5ZGM=, PoolId: default}. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037890 after several retries.
2025-11-03T16:52:27.687079Z node 2 :KQP_SESSION WARN: kqp_session_actor.cpp:2987: SessionId: ydb://session/3?node_id=2&id=MjA4N2UwNTAtN2RlMTdmNjEtNjZhMGEyZTctYzE5OWM5ZGM=, ActorId: [2:7568543035667426505:2648], ActorState: ExecuteState, TraceId: 01k95a4qk9a031f53nhdmef7ty, Create QueryResponse for error on request, msg: 
2025-11-03T16:52:27.688013Z node 2 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Failed to resolve tablet: 72075186224037890 after several retries." severity: 1 } TxMeta { id: "01k95a4qym0n0q4f4h7r4e27s4" } } YdbStatus: UNAVAILABLE ConsumedRu: 238 }
2025-11-03T16:52:27.921278Z :INFO: [/Root] MessageGroupId [test-message-group-id] Running cds request ms
2025-11-03T16:52:27.925916Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Got CDS response: 
write_sessions_clusters { clusters { endpoint: "localhost:1567" name: "dc1" available: true } primary_cluster_selection_reason: CLIENT_LOCATION } version: 1
2025-11-03T16:52:27.925967Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Start write session. Will connect to endpoint: localhost:1567
2025-11-03T16:52:27.929310Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" }
2025-11-03T16:52:27.929975Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-11-03T16:52:27.930005Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 22
2025-11-03T16:52:27.930337Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 22 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" }
2025-11-03T16:52:27.930452Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 22 topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" from ipv6:[::1]:34482
2025-11-03T16:52:27.930466Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=22 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:34482 proto=v1  topic=test-topic durationSec=0
2025-11-03T16:52:27.930494Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-11-03T16:52:27.931735Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 22 sessionId:  describe result for acl check
2025-11-03T16:52:27.931832Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-11-03T16:52:27.931841Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-11-03T16:52:27.931849Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-11-03T16:52:27.931862Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7568543039964850002:2878] (SourceId=test-message-group-id, PreferedPartition=(NULL)) StartKqpSession
2025-11-03T16:52:27.934094Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7568543039964850002:2878] (SourceId=test-message-group-id, PreferedPartition=(NULL)) Select from the table
2025-11-03T16:52:28.398072Z node 1 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976715764. Failed to resolve tablet: 72075186224037888 after several retries.
2025-11-03T16:52:28.398222Z node 1 :KQP_EXECUTER WARN: kqp_executer_impl.h:245: ActorId: [1:7568543039964849961:2869] TxId: 281474976715764. Ctx: { TraceId: 01k95a4rb432m0f5mn6w35phhx, Database: /Root, SessionId: ydb://session/3?node_id=1&id=OTBhNDJmMGItZjZhYmM4OTAtODVjMWM2NWItNzkyYjUzOTI=, PoolId: default}. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037888 after several retries.
2025-11-03T16:52:28.398544Z node 1 :KQP_SESSION WARN: kqp_session_actor.cpp:2987: SessionId: ydb://session/3?node_id=1&id=OTBhNDJmMGItZjZhYmM4OTAtODVjMWM2NWItNzkyYjUzOTI=, ActorId: [1:7568543039964849945:2869], ActorState: ExecuteState, TraceId: 01k95a4rb432m0f5mn6w35phhx, Create QueryResponse for error on request, msg: 
2025-11-03T16:52:28.399507Z node 1 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Failed to resolve tablet: 72075186224037888 after several retries." severity: 1 } TxMeta { id: "01k95a4rmv30ndk29t7w33kz71" } } YdbStatus: UNAVAILABLE ConsumedRu: 204 }
2025-11-03T16:52:28.908848Z node 1 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976715765. Failed to resolve tablet: 72075186224037891 after several retries.
2025-11-03T16:52:28.908964Z node 1 :KQP_EXECUTER WARN: kqp_executer_impl.h:245: ActorId: [1:7568543039964850016:2880] TxId: 281474976715765. Ctx: { TraceId: 01k95a4s4y1bn70zjpw3h58c60, Database: /Root, SessionId: ydb://session/3?node_id=1&id=ZDE2NWJhN2QtYjU0NTBhN2QtMmFiOTMwNC1mNWFmNDRlNA==, PoolId: default}. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037891 after several retries.
2025-11-03T16:52:28.909166Z node 1 :KQP_SESSION WARN: kqp_session_actor.cpp:2987: SessionId: ydb://session/3?node_id=1&id=ZDE2NWJhN2QtYjU0NTBhN2QtMmFiOTMwNC1mNWFmNDRlNA==, ActorId: [1:7568543039964850003:2880], ActorState: ExecuteState, TraceId: 01k95a4s4y1bn70zjpw3h58c60, Create QueryResponse for error on request, msg: 
2025-11-03T16:52:28.910386Z node 1 :PQ_PARTITION_CHOOSER INFO: partition_chooser_impl__abstract_chooser_actor.h:312: TPartitionChooser [1:7568543039964850002:2878] (SourceId=test-message-group-id, PreferedPartition=(NULL)) ReplyError: kqp error Marker# PQ50 : Response {
  SessionId: "ydb://session/3?node_id=1&id=ZDE2NWJhN2QtYjU0NTBhN2QtMmFiOTMwNC1mNWFmNDRlNA=="
  QueryIssues {
    message: "Failed to resolve tablet: 72075186224037891 after several retries."
    severity: 1
  }
  TxMeta {
    id: "01k95a4s4y1bn70zjpw4my104q"
  }
}
YdbStatus: UNAVAILABLE
ConsumedRu: 1
2025-11-03T16:52:28.910449Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 22 reason: kqp error Marker# PQ50 : Response {
  SessionId: "ydb://session/3?node_id=1&id=ZDE2NWJhN2QtYjU0NTBhN2QtMmFiOTMwNC1mNWFmNDRlNA=="
  QueryIssues {
    message: "Failed to resolve tablet: 72075186224037891 after several retries."
    severity: 1
  }
  TxMeta {
    id: "01k95a4s4y1bn70zjpw4my104q"
  }
}
YdbStatus: UNAVAILABLE
ConsumedRu: 1
 sessionId: 
2025-11-03T16:52:28.910763Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 22 sessionId:  is DEAD
2025-11-03T16:52:28.911916Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Counters: { Errors: 0 CurrentSessionLifetimeMs: 60587 BytesWritten: 7 MessagesWritten: 1 BytesWrittenCompressed: 27 BytesInflightUncompressed: 0 BytesInflightCompressed: 54 BytesInflightTotal: 0 MessagesInflight: 2 }
Test retry state: get retry delay
2025-11-03T16:52:28.912036Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: kqp error Marker# PQ50 : Response {   SessionId: "ydb://session/3?node_id=1&id=ZDE2NWJhN2QtYjU0NTBhN2QtMmFiOTMwNC1mNWFmNDRlNA=="   QueryIssues {     message: "Failed to resolve tablet: 72075186224037891 after several retries."     severity: 1   }   TxMeta {     id: "01k95a4s4y1bn70zjpw4my104q"   } } YdbStatus: UNAVAILABLE ConsumedRu: 1 , code: 500001 
2025-11-03T16:52:28.912064Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Write session will restart in 2.000000s
2025-11-03T16:52:28.912139Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Write session: Do CDS request
2025-11-03T16:52:28.912175Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Do schedule cds request after 2000 ms
2025-11-03T16:52:30.056613Z node 2 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976720711. Failed to resolve tablet: 72075186224037890 after several retries.
2025-11-03T16:52:30.056737Z node 2 :KQP_EXECUTER WARN: kqp_executer_impl.h:245: ActorId: [2:7568543048552328490:2658] TxId: 281474976720711. Ctx: { TraceId: 01k95a4swj39f4qxyrb564q2ep, Database: /Root, SessionId: ydb://session/3?node_id=2&id=MWNiMDU3ZGEtMzQ2NmJhZmEtYjg4YzM4NWQtNDdhYWIwMjE=, PoolId: default}. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037890 after several retries.
2025-11-03T16:52:30.056996Z node 2 :KQP_SESSION WARN: kqp_session_actor.cpp:2987: SessionId: ydb://session/3?node_id=2&id=MWNiMDU3ZGEtMzQ2NmJhZmEtYjg4YzM4NWQtNDdhYWIwMjE=, ActorId: [2:7568543044257361177:2658], ActorState: ExecuteState, TraceId: 01k95a4swj39f4qxyrb564q2ep, Create QueryResponse for error on request, msg: 
2025-11-03T16:52:30.057833Z node 2 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Failed to resolve tablet: 72075186224037890 after several retries." severity: 1 } TxMeta { id: "01k95a4t7r7w44hq03hnzxwbt7" } } YdbStatus: UNAVAILABLE ConsumedRu: 231 }
2025-11-03T16:52:30.728092Z node 1 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976715768. Failed to resolve tablet: 72075186224037890 after several retries.
2025-11-03T16:52:30.728254Z node 1 :KQP_EXECUTER WARN: kqp_executer_impl.h:245: ActorId: [1:7568543048554784709:2889] TxId: 281474976715768. Ctx: { TraceId: 01k95a4tjvbzhm1dmrgn88q0s7, Database: /Root, SessionId: ydb://session/3?node_id=1&id=NzQxNWFhMTItNGZkNjU1MWMtZDlmOGM5OWYtMzhmNmFiMTg=, PoolId: default}. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037890 after several retries.
2025-11-03T16:52:30.728568Z node 1 :KQP_SESSION WARN: kqp_session_actor.cpp:2987: SessionId: ydb://session/3?node_id=1&id=NzQxNWFhMTItNGZkNjU1MWMtZDlmOGM5OWYtMzhmNmFiMTg=, ActorId: [1:7568543048554784692:2889], ActorState: ExecuteState, TraceId: 01k95a4tjvbzhm1dmrgn88q0s7, Create QueryResponse for error on request, msg: 
2025-11-03T16:52:30.729620Z node 1 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Failed to resolve tablet: 72075186224037890 after several retries." severity: 1 } TxMeta { id: "01k95a4txzdwkgegxx2f4anyqn" } } YdbStatus: UNAVAILABLE ConsumedRu: 232 }
2025-11-03T16:52:30.913422Z :INFO: [/Root] MessageGroupId [test-message-group-id] Running cds request ms
2025-11-03T16:52:30.918165Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Got CDS response: 
write_sessions_clusters { clusters { endpoint: "localhost:1567" name: "dc1" available: true } primary_cluster_selection_reason: CLIENT_LOCATION } version: 1
2025-11-03T16:52:30.918215Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Start write session. Will connect to endpoint: localhost:1567
2025-11-03T16:52:30.923715Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-11-03T16:52:30.923749Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 23
2025-11-03T16:52:30.924668Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" }
2025-11-03T16:52:30.925157Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 23 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" }
2025-11-03T16:52:30.925285Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 23 topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" from ipv6:[::1]:34482
2025-11-03T16:52:30.925301Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=23 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:34482 proto=v1  topic=test-topic durationSec=0
2025-11-03T16:52:30.925311Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-11-03T16:52:30.926715Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 23 sessionId:  describe result for acl check
2025-11-03T16:52:30.926822Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-11-03T16:52:30.926833Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-11-03T16:52:30.926842Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-11-03T16:52:30.926858Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7568543052849752083:2898] (SourceId=test-message-group-id, PreferedPartition=(NULL)) StartKqpSession
2025-11-03T16:52:30.929366Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7568543052849752083:2898] (SourceId=test-message-group-id, PreferedPartition=(NULL)) Select from the table
2025-11-03T16:52:31.923338Z node 1 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976715770. Failed to resolve tablet: 72075186224037891 after several retries.
2025-11-03T16:52:31.923449Z node 1 :KQP_EXECUTER WARN: kqp_executer_impl.h:245: ActorId: [1:7568543052849752097:2901] TxId: 281474976715770. Ctx: { TraceId: 01k95a4w2hdnhgq11p2h9t9r9z, Database: /Root, SessionId: ydb://session/3?node_id=1&id=MWM4NTQ5NWMtZTJkZjFhMWEtMWI4N2Q1ZmQtODZiN2FlN2I=, PoolId: default}. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037891 after several retries.
2025-11-03T16:52:31.923658Z node 1 :KQP_SESSION WARN: kqp_session_actor.cpp:2987: SessionId: ydb://session/3?node_id=1&id=MWM4NTQ5NWMtZTJkZjFhMWEtMWI4N2Q1ZmQtODZiN2FlN2I=, ActorId: [1:7568543052849752086:2901], ActorState: ExecuteState, TraceId: 01k95a4w2hdnhgq11p2h9t9r9z, Create QueryResponse for error on request, msg: 
2025-11-03T16:52:31.929137Z node 1 :PQ_PARTITION_CHOOSER INFO: partition_chooser_impl__abstract_chooser_actor.h:312: TPartitionChooser [1:7568543052849752083:2898] (SourceId=test-message-group-id, PreferedPartition=(NULL)) ReplyError: kqp error Marker# PQ50 : Response {
  SessionId: "ydb://session/3?node_id=1&id=MWM4NTQ5NWMtZTJkZjFhMWEtMWI4N2Q1ZmQtODZiN2FlN2I="
  QueryIssues {
    message: "Failed to resolve tablet: 72075186224037891 after several retries."
    severity: 1
  }
  TxMeta {
    id: "01k95a4w2j5gs62gaf11tb9g9m"
  }
}
YdbStatus: UNAVAILABLE
ConsumedRu: 1
2025-11-03T16:52:31.929220Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 23 reason: kqp error Marker# PQ50 : Response {
  SessionId: "ydb://session/3?node_id=1&id=MWM4NTQ5NWMtZTJkZjFhMWEtMWI4N2Q1ZmQtODZiN2FlN2I="
  QueryIssues {
    message: "Failed to resolve tablet: 72075186224037891 after several retries."
    severity: 1
  }
  TxMeta {
    id: "01k95a4w2j5gs62gaf11tb9g9m"
  }
}
YdbStatus: UNAVAILABLE
ConsumedRu: 1
 sessionId: 
2025-11-03T16:52:31.929550Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 23 sessionId:  is DEAD
Test retry state: get retry delay
2025-11-03T16:52:31.932163Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: kqp error Marker# PQ50 : Response {   SessionId: "ydb://session/3?node_id=1&id=MWM4NTQ5NWMtZTJkZjFhMWEtMWI4N2Q1ZmQtODZiN2FlN2I="   QueryIssues {     message: "Failed to resolve tablet: 72075186224037891 after several retries."     severity: 1   }   TxMeta {     id: "01k95a4w2j5gs62gaf11tb9g9m"   } } YdbStatus: UNAVAILABLE ConsumedRu: 1 , code: 500001 
2025-11-03T16:52:31.932196Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Write session will restart in 2.000000s
2025-11-03T16:52:31.932275Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Write session: Do CDS request
2025-11-03T16:52:31.932311Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Do schedule cds request after 2000 ms
2025-11-03T16:52:32.424886Z node 2 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976720713. Failed to resolve tablet: 72075186224037888 after several retries.
2025-11-03T16:52:32.425007Z node 2 :KQP_EXECUTER WARN: kqp_executer_impl.h:245: ActorId: [2:7568543057142263161:2670] TxId: 281474976720713. Ctx: { TraceId: 01k95a4w6jenbk3n60twbw8k53, Database: /Root, SessionId: ydb://session/3?node_id=2&id=NGI5OTM1ZGQtYjY3M2NkYTEtZDNlODhiYTYtYjhmNmExMzk=, PoolId: default}. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037888 after several retries.
2025-11-03T16:52:32.425267Z node 2 :KQP_SESSION WARN: kqp_session_actor.cpp:2987: SessionId: ydb://session/3?node_id=2&id=NGI5OTM1ZGQtYjY3M2NkYTEtZDNlODhiYTYtYjhmNmExMzk=, ActorId: [2:7568543057142263148:2670], ActorState: ExecuteState, TraceId: 01k95a4w6jenbk3n60twbw8k53, Create QueryResponse for error on request, msg: 
2025-11-03T16:52:32.426142Z node 2 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Failed to resolve tablet: 72075186224037888 after several retries." severity: 1 } TxMeta { id: "01k95a4wj03crrayrf3zpvxfs7" } } YdbStatus: UNAVAILABLE ConsumedRu: 236 }
2025-11-03T16:52:33.045417Z node 1 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976715772. Failed to resolve tablet: 72075186224037888 after several retries.
2025-11-03T16:52:33.045549Z node 1 :KQP_EXECUTER WARN: kqp_executer_impl.h:245: ActorId: [1:7568543061439686754:2904] TxId: 281474976715772. Ctx: { TraceId: 01k95a4wvmanr4zhge0rpb034k, Database: /Root, SessionId: ydb://session/3?node_id=1&id=MWQ5ZDJiZjYtYzM5ZmM2YWMtYzI4YTA3NzYtMjE1NGVmNTY=, PoolId: default}. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037888 after several retries.
2025-11-03T16:52:33.045821Z node 1 :KQP_SESSION WARN: kqp_session_actor.cpp:2987: SessionId: ydb://session/3?node_id=1&id=MWQ5ZDJiZjYtYzM5ZmM2YWMtYzI4YTA3NzYtMjE1NGVmNTY=, ActorId: [1:7568543057144719426:2904], ActorState: ExecuteState, TraceId: 01k95a4wvmanr4zhge0rpb034k, Create QueryResponse for error on request, msg: 
2025-11-03T16:52:33.046766Z node 1 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Failed to resolve tablet: 72075186224037888 after several retries." severity: 1 } TxMeta { id: "01k95a4x6789bgcatan3vjy7my" } } YdbStatus: UNAVAILABLE ConsumedRu: 220 }
2025-11-03T16:52:33.936248Z :INFO: [/Root] MessageGroupId [test-message-group-id] Running cds request ms
2025-11-03T16:52:33.940353Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Got CDS response: 
write_sessions_clusters { clusters { endpoint: "localhost:1567" name: "dc1" available: true } primary_cluster_selection_reason: CLIENT_LOCATION } version: 1
2025-11-03T16:52:33.940410Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Start write session. Will connect to endpoint: localhost:1567
2025-11-03T16:52:33.943144Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-11-03T16:52:33.943220Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" }
2025-11-03T16:52:33.943180Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 24
2025-11-03T16:52:33.943680Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 24 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" }
2025-11-03T16:52:33.943821Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 24 topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" from ipv6:[::1]:34482
2025-11-03T16:52:33.943860Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=24 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:34482 proto=v1  topic=test-topic durationSec=0
2025-11-03T16:52:33.943879Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-11-03T16:52:33.945029Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 24 sessionId:  describe result for acl check
2025-11-03T16:52:33.945143Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-11-03T16:52:33.945181Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-11-03T16:52:33.945191Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-11-03T16:52:33.945209Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7568543065734654139:2916] (SourceId=test-message-group-id, PreferedPartition=(NULL)) StartKqpSession
2025-11-03T16:52:33.947570Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7568543065734654139:2916] (SourceId=test-message-group-id, PreferedPartition=(NULL)) Select from the table
2025-11-03T16:52:34.779586Z node 2 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976720715. Failed to resolve tablet: 72075186224037890 after several retries.
2025-11-03T16:52:34.779699Z node 2 :KQP_EXECUTER WARN: kqp_executer_impl.h:245: ActorId: [2:7568543065732197837:2680] TxId: 281474976720715. Ctx: { TraceId: 01k95a4ygn8yapxyjtedwkcfy2, Database: /Root, SessionId: ydb://session/3?node_id=2&id=YzAyM2Y5NWQtYWUwZjdlMDMtNDgwMzcyODctZjFjNmU0NzQ=, PoolId: default}. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037890 after several retries.
2025-11-03T16:52:34.779926Z node 2 :KQP_SESSION WARN: kqp_session_actor.cpp:2987: SessionId: ydb://session/3?node_id=2&id=YzAyM2Y5NWQtYWUwZjdlMDMtNDgwMzcyODctZjFjNmU0NzQ=, ActorId: [2:7568543065732197820:2680], ActorState: ExecuteState, TraceId: 01k95a4ygn8yapxyjtedwkcfy2, Create QueryResponse for error on request, msg: 
2025-11-03T16:52:34.781533Z node 2 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Failed to resolve tablet: 72075186224037890 after several retries." severity: 1 } TxMeta { id: "01k95a4yw493w78n6a517x8bsg" } } YdbStatus: UNAVAILABLE ConsumedRu: 241 }
2025-11-03T16:52:34.916735Z node 1 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976715774. Failed to resolve tablet: 72075186224037891 after several retries.
2025-11-03T16:52:34.916856Z node 1 :KQP_EXECUTER WARN: kqp_executer_impl.h:245: ActorId: [1:7568543065734654150:2918] TxId: 281474976715774. Ctx: { TraceId: 01k95a4z0va70std29h8c51q74, Database: /Root, SessionId: ydb://session/3?node_id=1&id=Yzg0ZTZhYmUtMjdjNjkzMjgtNzkyMGQ3NDctZjdkOTA1NDk=, PoolId: default}. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037891 after several retries.
2025-11-03T16:52:34.917070Z node 1 :KQP_SESSION WARN: kqp_session_actor.cpp:2987: SessionId: ydb://session/3?node_id=1&id=Yzg0ZTZhYmUtMjdjNjkzMjgtNzkyMGQ3NDctZjdkOTA1NDk=, ActorId: [1:7568543065734654140:2918], ActorState: ExecuteState, TraceId: 01k95a4z0va70std29h8c51q74, Create QueryResponse for error on request, msg: 
2025-11-03T16:52:34.918116Z node 1 :PQ_PARTITION_CHOOSER INFO: partition_chooser_impl__abstract_chooser_actor.h:312: TPartitionChooser [1:7568543065734654139:2916] (SourceId=test-message-group-id, PreferedPartition=(NULL)) ReplyError: kqp error Marker# PQ50 : Response {
  SessionId: "ydb://session/3?node_id=1&id=Yzg0ZTZhYmUtMjdjNjkzMjgtNzkyMGQ3NDctZjdkOTA1NDk="
  QueryIssues {
    message: "Failed to resolve tablet: 72075186224037891 after several retries."
    severity: 1
  }
  TxMeta {
    id: "01k95a4z0wd4h79khy5895asv4"
  }
}
YdbStatus: UNAVAILABLE
ConsumedRu: 1
2025-11-03T16:52:34.918216Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 24 reason: kqp error Marker# PQ50 : Response {
  SessionId: "ydb://session/3?node_id=1&id=Yzg0ZTZhYmUtMjdjNjkzMjgtNzkyMGQ3NDctZjdkOTA1NDk="
  QueryIssues {
    message: "Failed to resolve tablet: 72075186224037891 after several retries."
    severity: 1
  }
  TxMeta {
    id: "01k95a4z0wd4h79khy5895asv4"
  }
}
YdbStatus: UNAVAILABLE
ConsumedRu: 1
 sessionId: 
2025-11-03T16:52:34.918590Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 24 sessionId:  is DEAD
Test retry state: get retry delay
2025-11-03T16:52:34.926365Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: kqp error Marker# PQ50 : Response {   SessionId: "ydb://session/3?node_id=1&id=Yzg0ZTZhYmUtMjdjNjkzMjgtNzkyMGQ3NDctZjdkOTA1NDk="   QueryIssues {     message: "Failed to resolve tablet: 72075186224037891 after several retries."     severity: 1   }   TxMeta {     id: "01k95a4z0wd4h79khy5895asv4"   } } YdbStatus: UNAVAILABLE ConsumedRu: 1 , code: 500001 
2025-11-03T16:52:34.926393Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Write session will restart in 2.000000s
2025-11-03T16:52:34.926450Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Write session: Do CDS request
2025-11-03T16:52:34.926491Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Do schedule cds request after 2000 ms
2025-11-03T16:52:35.364095Z node 1 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976715775. Failed to resolve tablet: 72075186224037888 after several retries.
2025-11-03T16:52:35.364249Z node 1 :KQP_EXECUTER WARN: kqp_executer_impl.h:245: ActorId: [1:7568543070029621479:2920] TxId: 281474976715775. Ctx: { TraceId: 01k95a4z418a7r9ycq51rshs20, Database: /Root, SessionId: ydb://session/3?node_id=1&id=Nzk2Mjc1MTQtZmE0MTJiMmUtZmUwNDBlMTUtNTBiZDNjYWI=, PoolId: default}. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037888 after several retries.
2025-11-03T16:52:35.364528Z node 1 :KQP_SESSION WARN: kqp_session_actor.cpp:2987: SessionId: ydb://session/3?node_id=1&id=Nzk2Mjc1MTQtZmE0MTJiMmUtZmUwNDBlMTUtNTBiZDNjYWI=, ActorId: [1:7568543070029621454:2920], ActorState: ExecuteState, TraceId: 01k95a4z418a7r9ycq51rshs20, Create QueryResponse for error on request, msg: 
2025-11-03T16:52:35.365458Z node 1 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Failed to resolve tablet: 72075186224037888 after several retries." severity: 1 } TxMeta { id: "01k95a4zexf5g6jk0yawgen9ca" } } YdbStatus: UNAVAILABLE ConsumedRu: 229 }
2025-11-03T16:52:36.929262Z :INFO: [/Root] MessageGroupId [test-message-group-id] Running cds request ms
2025-11-03T16:52:36.933206Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Got CDS response: 
write_sessions_clusters { clusters { endpoint: "localhost:1567" name: "dc1" available: true } primary_cluster_selection_reason: CLIENT_LOCATION } version: 1
2025-11-03T16:52:36.933252Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Start write session. Will connect to endpoint: localhost:1567
2025-11-03T16:52:36.936257Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" }
2025-11-03T16:52:36.936246Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-11-03T16:52:36.936274Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 25
2025-11-03T16:52:36.940281Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 25 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" }
2025-11-03T16:52:36.940436Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 25 topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" from ipv6:[::1]:34482
2025-11-03T16:52:36.940451Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=25 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:34482 proto=v1  topic=test-topic durationSec=0
2025-11-03T16:52:36.940460Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-11-03T16:52:36.941933Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 25 sessionId:  describe result for acl check
2025-11-03T16:52:36.942047Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-11-03T16:52:36.942056Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-11-03T16:52:36.942064Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-11-03T16:52:36.942078Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7568543078619556219:2939] (SourceId=test-message-group-id, PreferedPartition=(NULL)) StartKqpSession
2025-11-03T16:52:36.944719Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7568543078619556219:2939] (SourceId=test-message-group-id, PreferedPartition=(NULL)) Select from the table
2025-11-03T16:52:37.115453Z node 2 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976720717. Failed to resolve tablet: 72075186224037888 after several retries.
2025-11-03T16:52:37.115585Z node 2 :KQP_EXECUTER WARN: kqp_executer_impl.h:245: ActorId: [2:7568543078617099805:2692] TxId: 281474976720717. Ctx: { TraceId: 01k95a50t85s6hp8d1m6jbsca2, Database: /Root, SessionId: ydb://session/3?node_id=2&id=NGEyZmUyOTgtODIzNGZkZjQtNTQyNjY2YjMtZDhkMjM2M2U=, PoolId: default}. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037888 after several retries.
2025-11-03T16:52:37.115813Z node 2 :KQP_SESSION WARN: kqp_session_actor.cpp:2987: SessionId: ydb://session/3?node_id=2&id=NGEyZmUyOTgtODIzNGZkZjQtNTQyNjY2YjMtZDhkMjM2M2U=, ActorId: [2:7568543074322132496:2692], ActorState: ExecuteState, TraceId: 01k95a50t85s6hp8d1m6jbsca2, Create QueryResponse for error on request, msg: 
2025-11-03T16:52:37.116616Z node 2 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Failed to resolve tablet: 72075186224037888 after several retries." severity: 1 } TxMeta { id: "01k95a514p1bgbh0gcc2tthg4g" } } YdbStatus: UNAVAILABLE ConsumedRu: 219 }
2025-11-03T16:52:37.756091Z node 1 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976715778. Failed to resolve tablet: 72075186224037890 after several retries.
2025-11-03T16:52:37.756232Z node 1 :KQP_EXECUTER WARN: kqp_executer_impl.h:245: ActorId: [1:7568543078619556200:2931] TxId: 281474976715778. Ctx: { TraceId: 01k95a51cf3pczk94230sawf5y, Database: /Root, SessionId: ydb://session/3?node_id=1&id=NDZhMzgxMTUtOTBiMzMwZTEtMzBlMTdhYmYtYzYwMmM2OTA=, PoolId: default}. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037890 after several retries.
2025-11-03T16:52:37.756484Z node 1 :KQP_SESSION WARN: kqp_session_actor.cpp:2987: SessionId: ydb://session/3?node_id=1&id=NDZhMzgxMTUtOTBiMzMwZTEtMzBlMTdhYmYtYzYwMmM2OTA=, ActorId: [1:7568543078619556180:2931], ActorState: ExecuteState, TraceId: 01k95a51cf3pczk94230sawf5y, Create QueryResponse for error on request, msg: 
2025-11-03T16:52:37.757528Z node 1 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Failed to resolve tablet: 72075186224037890 after several retries." severity: 1 } TxMeta { id: "01k95a51sr3kt3w3emwzmdahte" } } YdbStatus: UNAVAILABLE ConsumedRu: 279 }
2025-11-03T16:52:37.924085Z node 1 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976715779. Failed to resolve tablet: 72075186224037891 after several retries.
2025-11-03T16:52:37.924219Z node 1 :KQP_EXECUTER WARN: kqp_executer_impl.h:245: ActorId: [1:7568543078619556234:2941] TxId: 281474976715779. Ctx: { TraceId: 01k95a51yg0c9rgs6vy8qdq5p8, Database: /Root, SessionId: ydb://session/3?node_id=1&id=ZjhmYTZiNjYtNjkxNjU4MDktYjU5MTkxNDUtNzVlZjc0Y2Q=, PoolId: default}. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037891 after several retries.
2025-11-03T16:52:37.924456Z node 1 :KQP_SESSION WARN: kqp_session_actor.cpp:2987: SessionId: ydb://session/3?node_id=1&id=ZjhmYTZiNjYtNjkxNjU4MDktYjU5MTkxNDUtNzVlZjc0Y2Q=, ActorId: [1:7568543078619556220:2941], ActorState: ExecuteState, TraceId: 01k95a51yg0c9rgs6vy8qdq5p8, Create QueryResponse for error on request, msg: 
2025-11-03T16:52:37.925809Z node 1 :PQ_PARTITION_CHOOSER INFO: partition_chooser_impl__abstract_chooser_actor.h:312: TPartitionChooser [1:7568543078619556219:2939] (SourceId=test-message-group-id, PreferedPartition=(NULL)) ReplyError: kqp error Marker# PQ50 : Response {
  SessionId: "ydb://session/3?node_id=1&id=ZjhmYTZiNjYtNjkxNjU4MDktYjU5MTkxNDUtNzVlZjc0Y2Q="
  QueryIssues {
    message: "Failed to resolve tablet: 72075186224037891 after several retries."
    severity: 1
  }
  TxMeta {
    id: "01k95a51yn7yb11w93njeqtt59"
  }
}
YdbStatus: UNAVAILABLE
ConsumedRu: 1
2025-11-03T16:52:37.925885Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 25 reason: kqp error Marker# PQ50 : Response {
  SessionId: "ydb://session/3?node_id=1&id=ZjhmYTZiNjYtNjkxNjU4MDktYjU5MTkxNDUtNzVlZjc0Y2Q="
  QueryIssues {
    message: "Failed to resolve tablet: 72075186224037891 after several retries."
    severity: 1
  }
  TxMeta {
    id: "01k95a51yn7yb11w93njeqtt59"
  }
}
YdbStatus: UNAVAILABLE
ConsumedRu: 1
 sessionId: 
2025-11-03T16:52:37.926239Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 25 sessionId:  is DEAD
Test retry state: get retry delay
2025-11-03T16:52:37.928252Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: kqp error Marker# PQ50 : Response {   SessionId: "ydb://session/3?node_id=1&id=ZjhmYTZiNjYtNjkxNjU4MDktYjU5MTkxNDUtNzVlZjc0Y2Q="   QueryIssues {     message: "Failed to resolve tablet: 72075186224037891 after several retries."     severity: 1   }   TxMeta {     id: "01k95a51yn7yb11w93njeqtt59"   } } YdbStatus: UNAVAILABLE ConsumedRu: 1 , code: 500001 
2025-11-03T16:52:37.928287Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Write session will restart in 2.000000s
2025-11-03T16:52:37.928365Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Write session: Do CDS request
2025-11-03T16:52:37.928393Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Do schedule cds request after 2000 ms
2025-11-03T16:52:39.480080Z node 2 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976720719. Failed to resolve tablet: 72075186224037888 after several retries.
2025-11-03T16:52:39.480217Z node 2 :KQP_EXECUTER WARN: kqp_executer_impl.h:245: ActorId: [2:7568543087207034477:2702] TxId: 281474976720719. Ctx: { TraceId: 01k95a533acs4zpb3hpm38kcwc, Database: /Root, SessionId: ydb://session/3?node_id=2&id=M2VkNWFmMmUtYjVkZWYzYS00M2RmNjVmOC02YjIzOWYyZQ==, PoolId: default}. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037888 after several retries.
2025-11-03T16:52:39.480480Z node 2 :KQP_SESSION WARN: kqp_session_actor.cpp:2987: SessionId: ydb://session/3?node_id=2&id=M2VkNWFmMmUtYjVkZWYzYS00M2RmNjVmOC02YjIzOWYyZQ==, ActorId: [2:7568543087207034464:2702], ActorState: ExecuteState, TraceId: 01k95a533acs4zpb3hpm38kcwc, Create QueryResponse for error on request, msg: 
2025-11-03T16:52:39.481531Z node 2 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Failed to resolve tablet: 72075186224037888 after several retries." severity: 1 } TxMeta { id: "01k95a53e04z2saqatayvd1462" } } YdbStatus: UNAVAILABLE ConsumedRu: 216 }
2025-11-03T16:52:39.932053Z :INFO: [/Root] MessageGroupId [test-message-group-id] Running cds request ms
2025-11-03T16:52:39.938551Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Got CDS response: 
write_sessions_clusters { clusters { endpoint: "localhost:1567" name: "dc1" available: true } primary_cluster_selection_reason: CLIENT_LOCATION } version: 1
2025-11-03T16:52:39.938602Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Start write session. Will connect to endpoint: localhost:1567
2025-11-03T16:52:39.942192Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" }
2025-11-03T16:52:39.946804Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-11-03T16:52:39.946837Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 26
2025-11-03T16:52:39.947246Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 26 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" }
2025-11-03T16:52:39.947368Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 26 topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" from ipv6:[::1]:34482
2025-11-03T16:52:39.947382Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=26 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:34482 proto=v1  topic=test-topic durationSec=0
2025-11-03T16:52:39.947393Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-11-03T16:52:39.948923Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 26 sessionId:  describe result for acl check
2025-11-03T16:52:39.949039Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-11-03T16:52:39.949048Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-11-03T16:52:39.949056Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-11-03T16:52:39.949071Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7568543091504458305:2955] (SourceId=test-message-group-id, PreferedPartition=(NULL)) StartKqpSession
2025-11-03T16:52:39.951388Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7568543091504458305:2955] (SourceId=test-message-group-id, PreferedPartition=(NULL)) Select from the table
2025-11-03T16:52:40.074409Z node 1 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976715782. Failed to resolve tablet: 72075186224037890 after several retries.
2025-11-03T16:52:40.074562Z node 1 :KQP_EXECUTER WARN: kqp_executer_impl.h:245: ActorId: [1:7568543091504458244:2946] TxId: 281474976715782. Ctx: { TraceId: 01k95a53qa52wpbjkxmx5qgkn3, Database: /Root, SessionId: ydb://session/3?node_id=1&id=YzdlOGJhMjMtMjgzZTFjMGItZDM0OWExMjUtOTg4YTljYzc=, PoolId: default}. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037890 after several retries.
2025-11-03T16:52:40.074812Z node 1 :KQP_SESSION WARN: kqp_session_actor.cpp:2987: SessionId: ydb://session/3?node_id=1&id=YzdlOGJhMjMtMjgzZTFjMGItZDM0OWExMjUtOTg4YTljYzc=, ActorId: [1:7568543087209490925:2946], ActorState: ExecuteState, TraceId: 01k95a53qa52wpbjkxmx5qgkn3, Create QueryResponse for error on request, msg: 
2025-11-03T16:52:40.075699Z node 1 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Failed to resolve tablet: 72075186224037890 after several retries." severity: 1 } TxMeta { id: "01k95a541s980jfjknc11mkscv" } } YdbStatus: UNAVAILABLE ConsumedRu: 220 }
2025-11-03T16:52:40.925196Z node 1 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976715783. Failed to resolve tablet: 72075186224037891 after several retries.
2025-11-03T16:52:40.925322Z node 1 :KQP_EXECUTER WARN: kqp_executer_impl.h:245: ActorId: [1:7568543091504458318:2957] TxId: 281474976715783. Ctx: { TraceId: 01k95a54wf21t69jbtqfmj9fka, Database: /Root, SessionId: ydb://session/3?node_id=1&id=ZjczMDhlMzMtNDQ2MDcxOWUtYTYxMzJhZjItOTFlZGE5Yzk=, PoolId: default}. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037891 after several retries.
2025-11-03T16:52:40.925554Z node 1 :KQP_SESSION WARN: kqp_session_actor.cpp:2987: SessionId: ydb://session/3?node_id=1&id=ZjczMDhlMzMtNDQ2MDcxOWUtYTYxMzJhZjItOTFlZGE5Yzk=, ActorId: [1:7568543091504458306:2957], ActorState: ExecuteState, TraceId: 01k95a54wf21t69jbtqfmj9fka, Create QueryResponse for error on request, msg: 
2025-11-03T16:52:40.926736Z node 1 :PQ_PARTITION_CHOOSER INFO: partition_chooser_impl__abstract_chooser_actor.h:312: TPartitionChooser [1:7568543091504458305:2955] (SourceId=test-message-group-id, PreferedPartition=(NULL)) ReplyError: kqp error Marker# PQ50 : Response {
  SessionId: "ydb://session/3?node_id=1&id=ZjczMDhlMzMtNDQ2MDcxOWUtYTYxMzJhZjItOTFlZGE5Yzk="
  QueryIssues {
    message: "Failed to resolve tablet: 72075186224037891 after several retries."
    severity: 1
  }
  TxMeta {
    id: "01k95a54wk4vzz69ctmx0drb0q"
  }
}
YdbStatus: UNAVAILABLE
ConsumedRu: 2
2025-11-03T16:52:40.926804Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 26 reason: kqp error Marker# PQ50 : Response {
  SessionId: "ydb://session/3?node_id=1&id=ZjczMDhlMzMtNDQ2MDcxOWUtYTYxMzJhZjItOTFlZGE5Yzk="
  QueryIssues {
    message: "Failed to resolve tablet: 72075186224037891 after several retries."
    severity: 1
  }
  TxMeta {
    id: "01k95a54wk4vzz69ctmx0drb0q"
  }
}
YdbStatus: UNAVAILABLE
ConsumedRu: 2
 sessionId: 
2025-11-03T16:52:40.927207Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 26 sessionId:  is DEAD
Test retry state: get retry delay
2025-11-03T16:52:40.929093Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: kqp error Marker# PQ50 : Response {   SessionId: "ydb://session/3?node_id=1&id=ZjczMDhlMzMtNDQ2MDcxOWUtYTYxMzJhZjItOTFlZGE5Yzk="   QueryIssues {     message: "Failed to resolve tablet: 72075186224037891 after several retries."     severity: 1   }   TxMeta {     id: "01k95a54wk4vzz69ctmx0drb0q"   } } YdbStatus: UNAVAILABLE ConsumedRu: 2 , code: 500001 
2025-11-03T16:52:40.929125Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Write session will restart in 2.000000s
2025-11-03T16:52:40.929204Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Write session: Do CDS request
2025-11-03T16:52:40.929235Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Do schedule cds request after 2000 ms
2025-11-03T16:52:41.808622Z node 2 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976720721. Failed to resolve tablet: 72075186224037890 after several retries.
2025-11-03T16:52:41.808741Z node 2 :KQP_EXECUTER WARN: kqp_executer_impl.h:245: ActorId: [2:7568543095796969152:2712] TxId: 281474976720721. Ctx: { TraceId: 01k95a55d6b33s5xdg0gq2akht, Database: /Root, SessionId: ydb://session/3?node_id=2&id=ZjQ2MDIwYjMtNGIxZDdlZjQtZmYzOGRmOTctNjFiNjY1OTU=, PoolId: default}. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037890 after several retries.
2025-11-03T16:52:41.809004Z node 2 :KQP_SESSION WARN: kqp_session_actor.cpp:2987: SessionId: ydb://session/3?node_id=2&id=ZjQ2MDIwYjMtNGIxZDdlZjQtZmYzOGRmOTctNjFiNjY1OTU=, ActorId: [2:7568543095796969135:2712], ActorState: ExecuteState, TraceId: 01k95a55d6b33s5xdg0gq2akht, Create QueryResponse for error on request, msg: 
2025-11-03T16:52:41.810181Z node 2 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Failed to resolve tablet: 72075186224037890 after several retries." severity: 1 } TxMeta { id: "01k95a55qpdt1nnambkkfwqd69" } } YdbStatus: UNAVAILABLE ConsumedRu: 215 }
2025-11-03T16:52:42.426829Z node 1 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976715786. Failed to resolve tablet: 72075186224037890 after several retries.
2025-11-03T16:52:42.426924Z node 1 :KQP_EXECUTER WARN: kqp_executer_impl.h:245: ActorId: [1:7568543100094392985:2962] TxId: 281474976715786. Ctx: { TraceId: 01k95a55zqahh06t57yvnc0cb8, Database: /Root, SessionId: ydb://session/3?node_id=1&id=ZmFlNzk4Zi0zNTFiNmYwZS1lZWVmNzIyMC1lZDllMzEyMw==, PoolId: default}. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037890 after several retries.
2025-11-03T16:52:42.427126Z node 1 :KQP_SESSION WARN: kqp_session_actor.cpp:2987: SessionId: ydb://session/3?node_id=1&id=ZmFlNzk4Zi0zNTFiNmYwZS1lZWVmNzIyMC1lZDllMzEyMw==, ActorId: [1:7568543100094392968:2962], ActorState: ExecuteState, TraceId: 01k95a55zqahh06t57yvnc0cb8, Create QueryResponse for error on request, msg: 
2025-11-03T16:52:42.428142Z node 1 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Failed to resolve tablet: 72075186224037890 after several retries." severity: 1 } TxMeta { id: "01k95a56br5mdevgsmvq9t6qb9" } } YdbStatus: UNAVAILABLE ConsumedRu: 252 }
2025-11-03T16:52:42.936052Z :INFO: [/Root] MessageGroupId [test-message-group-id] Running cds request ms
2025-11-03T16:52:42.951658Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Got CDS response: 
write_sessions_clusters { clusters { endpoint: "localhost:1567" name: "dc1" available: true } primary_cluster_selection_reason: CLIENT_LOCATION } version: 1
2025-11-03T16:52:42.951708Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Start write session. Will connect to endpoint: localhost:1567
2025-11-03T16:52:42.956917Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" }
2025-11-03T16:52:42.964400Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-11-03T16:52:42.964439Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 27
2025-11-03T16:52:42.968296Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 27 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" }
2025-11-03T16:52:42.968466Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 27 topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" from ipv6:[::1]:34482
2025-11-03T16:52:42.968484Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=27 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:34482 proto=v1  topic=test-topic durationSec=0
2025-11-03T16:52:42.968494Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-11-03T16:52:42.973426Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 27 sessionId:  describe result for acl check
2025-11-03T16:52:42.973540Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-11-03T16:52:42.973550Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-11-03T16:52:42.973560Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-11-03T16:52:42.973576Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7568543104389360369:2972] (SourceId=test-message-group-id, PreferedPartition=(NULL)) StartKqpSession
2025-11-03T16:52:42.976251Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7568543104389360369:2972] (SourceId=test-message-group-id, PreferedPartition=(NULL)) Select from the table
2025-11-03T16:52:43.968848Z node 1 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976715788. Failed to resolve tablet: 72075186224037891 after several retries.
2025-11-03T16:52:43.968969Z node 1 :KQP_EXECUTER WARN: kqp_executer_impl.h:245: ActorId: [1:7568543104389360377:2975] TxId: 281474976715788. Ctx: { TraceId: 01k95a57v053qa6x708k083e6t, Database: /Root, SessionId: ydb://session/3?node_id=1&id=NzJjNzZkYmEtNzVhNDU5MjMtOTY5Yzc4MmYtMTY3YTgyNWU=, PoolId: default}. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037891 after several retries.
2025-11-03T16:52:43.969203Z node 1 :KQP_SESSION WARN: kqp_session_actor.cpp:2987: SessionId: ydb://session/3?node_id=1&id=NzJjNzZkYmEtNzVhNDU5MjMtOTY5Yzc4MmYtMTY3YTgyNWU=, ActorId: [1:7568543104389360370:2975], ActorState: ExecuteState, TraceId: 01k95a57v053qa6x708k083e6t, Create QueryResponse for error on request, msg: 
2025-11-03T16:52:43.970326Z node 1 :PQ_PARTITION_CHOOSER INFO: partition_chooser_impl__abstract_chooser_actor.h:312: TPartitionChooser [1:7568543104389360369:2972] (SourceId=test-message-group-id, PreferedPartition=(NULL)) ReplyError: kqp error Marker# PQ50 : Response {
  SessionId: "ydb://session/3?node_id=1&id=NzJjNzZkYmEtNzVhNDU5MjMtOTY5Yzc4MmYtMTY3YTgyNWU="
  QueryIssues {
    message: "Failed to resolve tablet: 72075186224037891 after several retries."
    severity: 1
  }
  TxMeta {
    id: "01k95a57v053qa6x708pvhvx05"
  }
}
YdbStatus: UNAVAILABLE
ConsumedRu: 1
2025-11-03T16:52:43.970409Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 27 reason: kqp error Marker# PQ50 : Response {
  SessionId: "ydb://session/3?node_id=1&id=NzJjNzZkYmEtNzVhNDU5MjMtOTY5Yzc4MmYtMTY3YTgyNWU="
  QueryIssues {
    message: "Failed to resolve tablet: 72075186224037891 after several retries."
    severity: 1
  }
  TxMeta {
    id: "01k95a57v053qa6x708pvhvx05"
  }
}
YdbStatus: UNAVAILABLE
ConsumedRu: 1
 sessionId: 
2025-11-03T16:52:43.970751Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 27 sessionId:  is DEAD
Test retry state: get retry delay
2025-11-03T16:52:43.973229Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: kqp error Marker# PQ50 : Response {   SessionId: "ydb://session/3?node_id=1&id=NzJjNzZkYmEtNzVhNDU5MjMtOTY5Yzc4MmYtMTY3YTgyNWU="   QueryIssues {     message: "Failed to resolve tablet: 72075186224037891 after several retries."     severity: 1   }   TxMeta {     id: "01k95a57v053qa6x708pvhvx05"   } } YdbStatus: UNAVAILABLE ConsumedRu: 1 , code: 500001 
2025-11-03T16:52:43.973278Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Write session will restart in 2.000000s
2025-11-03T16:52:43.973367Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Write session: Do CDS request
2025-11-03T16:52:43.973405Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Do schedule cds request after 2000 ms
2025-11-03T16:52:44.241758Z node 2 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976720723. Failed to resolve tablet: 72075186224037888 after several retries.
2025-11-03T16:52:44.241876Z node 2 :KQP_EXECUTER WARN: kqp_executer_impl.h:245: ActorId: [2:7568543108681871120:2724] TxId: 281474976720723. Ctx: { TraceId: 01k95a57ny2mksywqqw7ke4e8t, Database: /Root, SessionId: ydb://session/3?node_id=2&id=MTkwOWVmNmYtNGI3ZDhlOC02ODFmZGZmNS05YzI0NmM3Mg==, PoolId: default}. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037888 after several retries.
2025-11-03T16:52:44.242114Z node 2 :KQP_SESSION WARN: kqp_session_actor.cpp:2987: SessionId: ydb://session/3?node_id=2&id=MTkwOWVmNmYtNGI3ZDhlOC02ODFmZGZmNS05YzI0NmM3Mg==, ActorId: [2:7568543104386903811:2724], ActorState: ExecuteState, TraceId: 01k95a57ny2mksywqqw7ke4e8t, Create QueryResponse for error on request, msg: 
2025-11-03T16:52:44.243425Z node 2 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Failed to resolve tablet: 72075186224037888 after several retries." severity: 1 } TxMeta { id: "01k95a582mc4p57sc76h3va2fv" } } YdbStatus: UNAVAILABLE ConsumedRu: 264 }
2025-11-03T16:52:44.824075Z node 1 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976715789. Failed to resolve tablet: 72075186224037890 after several retries.
2025-11-03T16:52:44.824220Z node 1 :KQP_EXECUTER WARN: kqp_executer_impl.h:245: ActorId: [1:7568543108684327721:2978] TxId: 281474976715789. Ctx: { TraceId: 01k95a589928bm0hrs4paajzjd, Database: /Root, SessionId: ydb://session/3?node_id=1&id=MjIwYWYyMzEtZWQ5MDU3YWMtMTI1NTFjNGYtNDk3NjlkY2U=, PoolId: default}. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037890 after several retries.
2025-11-03T16:52:44.824491Z node 1 :KQP_SESSION WARN: kqp_session_actor.cpp:2987: SessionId: ydb://session/3?node_id=1&id=MjIwYWYyMzEtZWQ5MDU3YWMtMTI1NTFjNGYtNDk3NjlkY2U=, ActorId: [1:7568543108684327692:2978], ActorState: ExecuteState, TraceId: 01k95a589928bm0hrs4paajzjd, Create QueryResponse for error on request, msg: 
2025-11-03T16:52:44.825554Z node 1 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Failed to resolve tablet: 72075186224037890 after several retries." severity: 1 } TxMeta { id: "01k95a58nr9fhnknpvt8kqeva1" } } YdbStatus: UNAVAILABLE ConsumedRu: 261 }
2025-11-03T16:52:45.976052Z :INFO: [/Root] MessageGroupId [test-message-group-id] Running cds request ms
2025-11-03T16:52:45.984172Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Got CDS response: 
write_sessions_clusters { clusters { endpoint: "localhost:1567" name: "dc1" available: true } primary_cluster_selection_reason: CLIENT_LOCATION } version: 1
2025-11-03T16:52:45.984219Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Start write session. Will connect to endpoint: localhost:1567
2025-11-03T16:52:45.987361Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-11-03T16:52:45.987393Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 28
2025-11-03T16:52:45.987725Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" }
2025-11-03T16:52:45.992470Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 28 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" }
2025-11-03T16:52:45.992641Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 28 topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" from ipv6:[::1]:34482
2025-11-03T16:52:45.992658Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=28 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:34482 proto=v1  topic=test-topic durationSec=0
2025-11-03T16:52:45.992669Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-11-03T16:52:45.994905Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 28 sessionId:  describe result for acl check
2025-11-03T16:52:45.995028Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-11-03T16:52:45.995038Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-11-03T16:52:45.995047Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-11-03T16:52:45.995064Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7568543117274262436:2996] (SourceId=test-message-group-id, PreferedPartition=(NULL)) StartKqpSession
2025-11-03T16:52:45.997891Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7568543117274262436:2996] (SourceId=test-message-group-id, PreferedPartition=(NULL)) Select from the table
2025-11-03T16:52:46.620091Z node 2 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976720725. Failed to resolve tablet: 72075186224037890 after several retries.
2025-11-03T16:52:46.620232Z node 2 :KQP_EXECUTER WARN: kqp_executer_impl.h:245: ActorId: [2:7568543117271805791:2734] TxId: 281474976720725. Ctx: { TraceId: 01k95a5a1y8tpnngm8s376rbaj, Database: /Root, SessionId: ydb://session/3?node_id=2&id=YTQ0ZThjMmMtNDU2N2E3MjQtZjU4NzE2NDMtZmQ4ZGE1Nw==, PoolId: default}. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037890 after several retries.
2025-11-03T16:52:46.620506Z node 2 :KQP_SESSION WARN: kqp_session_actor.cpp:2987: SessionId: ydb://session/3?node_id=2&id=YTQ0ZThjMmMtNDU2N2E3MjQtZjU4NzE2NDMtZmQ4ZGE1Nw==, ActorId: [2:7568543117271805778:2734], ActorState: ExecuteState, TraceId: 01k95a5a1y8tpnngm8s376rbaj, Create QueryResponse for error on request, msg: 
2025-11-03T16:52:46.623596Z node 2 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Failed to resolve tablet: 72075186224037890 after several retries." severity: 1 } TxMeta { id: "01k95a5adscd04xjghv2pwacwq" } } YdbStatus: UNAVAILABLE ConsumedRu: 249 }
2025-11-03T16:52:46.991163Z node 1 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976715792. Failed to resolve tablet: 72075186224037891 after several retries.
2025-11-03T16:52:46.991284Z node 1 :KQP_EXECUTER WARN: kqp_executer_impl.h:245: ActorId: [1:7568543121569229740:2998] TxId: 281474976715792. Ctx: { TraceId: 01k95a5ase2bga4s52cvncgxbp, Database: /Root, SessionId: ydb://session/3?node_id=1&id=YjgyYzk5YzktYjdlNWJkM2QtMTNhMGQ1MTMtOTViNjA2MWI=, PoolId: default}. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037891 after several retries.
2025-11-03T16:52:46.991506Z node 1 :KQP_SESSION WARN: kqp_session_actor.cpp:2987: SessionId: ydb://session/3?node_id=1&id=YjgyYzk5YzktYjdlNWJkM2QtMTNhMGQ1MTMtOTViNjA2MWI=, ActorId: [1:7568543117274262437:2998], ActorState: ExecuteState, TraceId: 01k95a5ase2bga4s52cvncgxbp, Create QueryResponse for error on request, msg: 
Test retry state: get retry delay
2025-11-03T16:52:46.996762Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: kqp error Marker# PQ50 : Response {   SessionId: "ydb://session/3?node_id=1&id=YjgyYzk5YzktYjdlNWJkM2QtMTNhMGQ1MTMtOTViNjA2MWI="   QueryIssues {     message: "Failed to resolve tablet: 72075186224037891 after several retries."     severity: 1   }   TxMeta {     id: "01k95a5asr4vr82691m37wt8ej"   } } YdbStatus: UNAVAILABLE ConsumedRu: 1 , code: 500001 
2025-11-03T16:52:46.996834Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Write session will restart in 2.000000s
2025-11-03T16:52:46.996923Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Write session: Do CDS request
2025-11-03T16:52:46.996959Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Do schedule cds request after 2000 ms
2025-11-03T16:52:46.994206Z node 1 :PQ_PARTITION_CHOOSER INFO: partition_chooser_impl__abstract_chooser_actor.h:312: TPartitionChooser [1:7568543117274262436:2996] (SourceId=test-message-group-id, PreferedPartition=(NULL)) ReplyError: kqp error Marker# PQ50 : Response {
  SessionId: "ydb://session/3?node_id=1&id=YjgyYzk5YzktYjdlNWJkM2QtMTNhMGQ1MTMtOTViNjA2MWI="
  QueryIssues {
    message: "Failed to resolve tablet: 72075186224037891 after several retries."
    severity: 1
  }
  TxMeta {
    id: "01k95a5asr4vr82691m37wt8ej"
  }
}
YdbStatus: UNAVAILABLE
ConsumedRu: 1
2025-11-03T16:52:46.994309Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 28 reason: kqp error Marker# PQ50 : Response {
  SessionId: "ydb://session/3?node_id=1&id=YjgyYzk5YzktYjdlNWJkM2QtMTNhMGQ1MTMtOTViNjA2MWI="
  QueryIssues {
    message: "Failed to resolve tablet: 72075186224037891 after several retries."
    severity: 1
  }
  TxMeta {
    id: "01k95a5asr4vr82691m37wt8ej"
  }
}
YdbStatus: UNAVAILABLE
ConsumedRu: 1
 sessionId: 
2025-11-03T16:52:46.994689Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 28 sessionId:  is DEAD
2025-11-03T16:52:47.177988Z node 1 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976715793. Failed to resolve tablet: 72075186224037888 after several retries.
2025-11-03T16:52:47.178107Z node 1 :KQP_EXECUTER WARN: kqp_executer_impl.h:245: ActorId: [1:7568543121569229750:2988] TxId: 281474976715793. Ctx: { TraceId: 01k95a5am4ckst7ksh0an6081e, Database: /Root, SessionId: ydb://session/3?node_id=1&id=N2M5OTc3MjMtNDdhYjU0NmItNDMwMGZjYmMtYzNlNzgxYzg=, PoolId: default}. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037888 after several retries.
2025-11-03T16:52:47.178365Z node 1 :KQP_SESSION WARN: kqp_session_actor.cpp:2987: SessionId: ydb://session/3?node_id=1&id=N2M5OTc3MjMtNDdhYjU0NmItNDMwMGZjYmMtYzNlNzgxYzg=, ActorId: [1:7568543117274262414:2988], ActorState: ExecuteState, TraceId: 01k95a5am4ckst7ksh0an6081e, Create QueryResponse for error on request, msg: 
2025-11-03T16:52:47.180932Z node 1 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Failed to resolve tablet: 72075186224037888 after several retries." severity: 1 } TxMeta { id: "01k95a5azmfbv8qgmw1ta5rfay" } } YdbStatus: UNAVAILABLE ConsumedRu: 239 }
2025-11-03T16:52:49.002018Z :INFO: [/Root] MessageGroupId [test-message-group-id] Running cds request ms
2025-11-03T16:52:49.008896Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Got CDS response: 
write_sessions_clusters { clusters { endpoint: "localhost:1567" name: "dc1" available: true } primary_cluster_selection_reason: CLIENT_LOCATION } version: 1
2025-11-03T16:52:49.008944Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Start write session. Will connect to endpoint: localhost:1567
2025-11-03T16:52:49.011565Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-11-03T16:52:49.011594Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 29
2025-11-03T16:52:49.012320Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" }
2025-11-03T16:52:49.012799Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 29 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" }
2025-11-03T16:52:49.012930Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 29 topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" from ipv6:[::1]:34482
2025-11-03T16:52:49.012951Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=29 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:34482 proto=v1  topic=test-topic durationSec=0
2025-11-03T16:52:49.012961Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-11-03T16:52:49.014164Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 29 sessionId:  describe result for acl check
2025-11-03T16:52:49.014262Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-11-03T16:52:49.014270Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-11-03T16:52:49.014278Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-11-03T16:52:49.014292Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7568543134454131806:3013] (SourceId=test-message-group-id, PreferedPartition=(NULL)) StartKqpSession
2025-11-03T16:52:49.016480Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7568543134454131806:3013] (SourceId=test-message-group-id, PreferedPartition=(NULL)) Select from the table
2025-11-03T16:52:49.035031Z node 2 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976720727. Failed to resolve tablet: 72075186224037888 after several retries.
2025-11-03T16:52:49.035172Z node 2 :KQP_EXECUTER WARN: kqp_executer_impl.h:245: ActorId: [2:7568543130156707764:2744] TxId: 281474976720727. Ctx: { TraceId: 01k95a5cccch8ex0m0ymsavyj1, Database: /Root, SessionId: ydb://session/3?node_id=2&id=OGVhOTAwMi03MmZlODdlOS0xZjRhYTEyMi0zNzFhYmNiMA==, PoolId: default}. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037888 after several retries.
2025-11-03T16:52:49.035450Z node 2 :KQP_SESSION WARN: kqp_session_actor.cpp:2987: SessionId: ydb://session/3?node_id=2&id=OGVhOTAwMi03MmZlODdlOS0xZjRhYTEyMi0zNzFhYmNiMA==, ActorId: [2:7568543125861740451:2744], ActorState: ExecuteState, TraceId: 01k95a5cccch8ex0m0ymsavyj1, Create QueryResponse for error on request, msg: 
2025-11-03T16:52:49.036473Z node 2 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Failed to resolve tablet: 72075186224037888 after several retries." severity: 1 } TxMeta { id: "01k95a5crv856mnvssbtnzz1hd" } } YdbStatus: UNAVAILABLE ConsumedRu: 262 }
2025-11-03T16:52:49.633148Z node 1 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976715796. Failed to resolve tablet: 72075186224037888 after several retries.
2025-11-03T16:52:49.633265Z node 1 :KQP_EXECUTER WARN: kqp_executer_impl.h:245: ActorId: [1:7568543130159164473:3004] TxId: 281474976715796. Ctx: { TraceId: 01k95a5cxq7p8rckdtxrtc1bkw, Database: /Root, SessionId: ydb://session/3?node_id=1&id=NDUwMDY2YTItNWU1ZGMzNjUtZDJhYzk0YTMtOTkxZmQ1ZTY=, PoolId: default}. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037888 after several retries.
2025-11-03T16:52:49.633516Z node 1 :KQP_SESSION WARN: kqp_session_actor.cpp:2987: SessionId: ydb://session/3?node_id=1&id=NDUwMDY2YTItNWU1ZGMzNjUtZDJhYzk0YTMtOTkxZmQ1ZTY=, ActorId: [1:7568543130159164457:3004], ActorState: ExecuteState, TraceId: 01k95a5cxq7p8rckdtxrtc1bkw, Create QueryResponse for error on request, msg: 
2025-11-03T16:52:49.634326Z node 1 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Failed to resolve tablet: 72075186224037888 after several retries." severity: 1 } TxMeta { id: "01k95a5da48kga0m59c7zeh2yx" } } YdbStatus: UNAVAILABLE ConsumedRu: 256 }
2025-11-03T16:52:49.986378Z node 1 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976715797. Failed to resolve tablet: 72075186224037891 after several retries.
2025-11-03T16:52:49.986492Z node 1 :KQP_EXECUTER WARN: kqp_executer_impl.h:245: ActorId: [1:7568543134454131814:3015] TxId: 281474976715797. Ctx: { TraceId: 01k95a5dqrc5jwqpwwwwdjzebk, Database: /Root, SessionId: ydb://session/3?node_id=1&id=ZGZhYjEwZDItYzUzYmQyNjItZDhkZmYxYmMtZDMzODgzZjU=, PoolId: default}. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037891 after several retries.
2025-11-03T16:52:49.986699Z node 1 :KQP_SESSION WARN: kqp_session_actor.cpp:2987: SessionId: ydb://session/3?node_id=1&id=ZGZhYjEwZDItYzUzYmQyNjItZDhkZmYxYmMtZDMzODgzZjU=, ActorId: [1:7568543134454131807:3015], ActorState: ExecuteState, TraceId: 01k95a5dqrc5jwqpwwwwdjzebk, Create QueryResponse for error on request, msg: 
2025-11-03T16:52:49.988443Z node 1 :PQ_PARTITION_CHOOSER INFO: partition_chooser_impl__abstract_chooser_actor.h:312: TPartitionChooser [1:7568543134454131806:3013] (SourceId=test-message-group-id, PreferedPartition=(NULL)) ReplyError: kqp error Marker# PQ50 : Response {
  SessionId: "ydb://session/3?node_id=1&id=ZGZhYjEwZDItYzUzYmQyNjItZDhkZmYxYmMtZDMzODgzZjU="
  QueryIssues {
    message: "Failed to resolve tablet: 72075186224037891 after several retries."
    severity: 1
  }
  TxMeta {
    id: "01k95a5dqs2t46y7s20rt3hr7k"
  }
}
YdbStatus: UNAVAILABLE
ConsumedRu: 1
2025-11-03T16:52:49.988528Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 29 reason: kqp error Marker# PQ50 : Response {
  SessionId: "ydb://session/3?node_id=1&id=ZGZhYjEwZDItYzUzYmQyNjItZDhkZmYxYmMtZDMzODgzZjU="
  QueryIssues {
    message: "Failed to resolve tablet: 72075186224037891 after several retries."
    severity: 1
  }
  TxMeta {
    id: "01k95a5dqs2t46y7s20rt3hr7k"
  }
}
YdbStatus: UNAVAILABLE
ConsumedRu: 1
 sessionId: 
2025-11-03T16:52:49.988928Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 29 sessionId:  is DEAD
Test retry state: get retry delay
2025-11-03T16:52:49.995693Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: kqp error Marker# PQ50 : Response {   SessionId: "ydb://session/3?node_id=1&id=ZGZhYjEwZDItYzUzYmQyNjItZDhkZmYxYmMtZDMzODgzZjU="   QueryIssues {     message: "Failed to resolve tablet: 72075186224037891 after several retries."     severity: 1   }   TxMeta {     id: "01k95a5dqs2t46y7s20rt3hr7k"   } } YdbStatus: UNAVAILABLE ConsumedRu: 1 , code: 500001 
2025-11-03T16:52:49.995729Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Write session will restart in 2.000000s
2025-11-03T16:52:49.995807Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Write session: Do CDS request
2025-11-03T16:52:49.995841Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Do schedule cds request after 2000 ms
2025-11-03T16:52:51.452196Z node 2 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976720729. Failed to resolve tablet: 72075186224037888 after several retries.
2025-11-03T16:52:51.452337Z node 2 :KQP_EXECUTER WARN: kqp_executer_impl.h:245: ActorId: [2:7568543138746642438:2756] TxId: 281474976720729. Ctx: { TraceId: 01k95a5eqs4nkh58xpcjcn189m, Database: /Root, SessionId: ydb://session/3?node_id=2&id=YmRkNWNkNTMtMTc1MDM0NTMtZmJmZDZjMjMtNjVkYjljMWY=, PoolId: default}. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037888 after several retries.
2025-11-03T16:52:51.452623Z node 2 :KQP_SESSION WARN: kqp_session_actor.cpp:2987: SessionId: ydb://session/3?node_id=2&id=YmRkNWNkNTMtMTc1MDM0NTMtZmJmZDZjMjMtNjVkYjljMWY=, ActorId: [2:7568543138746642422:2756], ActorState: ExecuteState, TraceId: 01k95a5eqs4nkh58xpcjcn189m, Create QueryResponse for error on request, msg: 
2025-11-03T16:52:51.453849Z node 2 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Failed to resolve tablet: 72075186224037888 after several retries." severity: 1 } TxMeta { id: "01k95a5f4rfn5gn18sdg29m8br" } } YdbStatus: UNAVAILABLE ConsumedRu: 269 }
2025-11-03T16:52:51.968830Z node 1 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976715800. Failed to resolve tablet: 72075186224037888 after several retries.
2025-11-03T16:52:51.968948Z node 1 :KQP_EXECUTER WARN: kqp_executer_impl.h:245: ActorId: [1:7568543138749099227:3022] TxId: 281474976715800. Ctx: { TraceId: 01k95a5faccna35bd97abfzws1, Database: /Root, SessionId: ydb://session/3?node_id=1&id=Y2VlODk0ZC0yNTI2OTM4YS1hNTVkZjY2Ny1mOTFmZDRkZA==, PoolId: default}. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037888 after several retries.
2025-11-03T16:52:51.969215Z node 1 :KQP_SESSION WARN: kqp_session_actor.cpp:2987: SessionId: ydb://session/3?node_id=1&id=Y2VlODk0ZC0yNTI2OTM4YS1hNTVkZjY2Ny1mOTFmZDRkZA==, ActorId: [1:7568543138749099203:3022], ActorState: ExecuteState, TraceId: 01k95a5faccna35bd97abfzws1, Create QueryResponse for error on request, msg: 
2025-11-03T16:52:51.970404Z node 1 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Failed to resolve tablet: 72075186224037888 after several retries." severity: 1 } TxMeta { id: "01k95a5fmv3qzras2shfskne7z" } } YdbStatus: UNAVAILABLE ConsumedRu: 220 }
2025-11-03T16:52:52.000097Z :INFO: [/Root] MessageGroupId [test-message-group-id] Running cds request ms
2025-11-03T16:52:52.006772Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Got CDS response: 
write_sessions_clusters { clusters { endpoint: "localhost:1567" name: "dc1" available: true } primary_cluster_selection_reason: CLIENT_LOCATION } version: 1
2025-11-03T16:52:52.006828Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Start write session. Will connect to endpoint: localhost:1567
2025-11-03T16:52:52.013535Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" }
2025-11-03T16:52:52.016329Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-11-03T16:52:52.016359Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 30
2025-11-03T16:52:52.016814Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 30 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" }
2025-11-03T16:52:52.016935Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 30 topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" from ipv6:[::1]:34482
2025-11-03T16:52:52.016949Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=30 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:34482 proto=v1  topic=test-topic durationSec=0
2025-11-03T16:52:52.016960Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-11-03T16:52:52.018622Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 30 sessionId:  describe result for acl check
2025-11-03T16:52:52.018761Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-11-03T16:52:52.018771Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-11-03T16:52:52.018787Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-11-03T16:52:52.018803Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7568543147339033898:3032] (SourceId=test-message-group-id, PreferedPartition=(NULL)) StartKqpSession
2025-11-03T16:52:52.021461Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7568543147339033898:3032] (SourceId=test-message-group-id, PreferedPartition=(NULL)) Select from the table
2025-11-03T16:52:53.016228Z node 1 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976715802. Failed to resolve tablet: 72075186224037891 after several retries.
2025-11-03T16:52:53.016351Z node 1 :KQP_EXECUTER WARN: kqp_executer_impl.h:245: ActorId: [1:7568543147339033906:3034] TxId: 281474976715802. Ctx: { TraceId: 01k95a5gnn2dn68j7p3h6cfpzy, Database: /Root, SessionId: ydb://session/3?node_id=1&id=MTMzZWVmYzEtOWRlZmQ4OTktY2Y2OGMxMDktZmViNjY2ZDc=, PoolId: default}. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037891 after several retries.
2025-11-03T16:52:53.016592Z node 1 :KQP_SESSION WARN: kqp_session_actor.cpp:2987: SessionId: ydb://session/3?node_id=1&id=MTMzZWVmYzEtOWRlZmQ4OTktY2Y2OGMxMDktZmViNjY2ZDc=, ActorId: [1:7568543147339033899:3034], ActorState: ExecuteState, TraceId: 01k95a5gnn2dn68j7p3h6cfpzy, Create QueryResponse for error on request, msg: 
Test retry state: get retry delay
2025-11-03T16:52:53.028525Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: kqp error Marker# PQ50 : Response {   SessionId: "ydb://session/3?node_id=1&id=MTMzZWVmYzEtOWRlZmQ4OTktY2Y2OGMxMDktZmViNjY2ZDc="   QueryIssues {     message: "Failed to resolve tablet: 72075186224037891 after several retries."     severity: 1   }   TxMeta {     id: "01k95a5gnrdeca3yq76wmbhzj6"   } } YdbStatus: UNAVAILABLE ConsumedRu: 1 , code: 500001 
2025-11-03T16:52:53.025117Z node 1 :PQ_PARTITION_CHOOSER INFO: partition_chooser_impl__abstract_chooser_actor.h:312: TPartitionChooser [1:7568543147339033898:3032] (SourceId=test-message-group-id, PreferedPartition=(NULL)) ReplyError: kqp error Marker# PQ50 : Response {
  SessionId: "ydb://session/3?node_id=1&id=MTMzZWVmYzEtOWRlZmQ4OTktY2Y2OGMxMDktZmViNjY2ZDc="
  QueryIssues {
    message: "Failed to resolve tablet: 72075186224037891 after several retries."
    severity: 1
  }
  TxMeta {
    id: "01k95a5gnrdeca3yq76wmbhzj6"
  }
}
YdbStatus: UNAVAILABLE
ConsumedRu: 1
2025-11-03T16:52:53.028559Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Write session will restart in 2.000000s
2025-11-03T16:52:53.025234Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 30 reason: kqp error Marker# PQ50 : Response {
  SessionId: "ydb://session/3?node_id=1&id=MTMzZWVmYzEtOWRlZmQ4OTktY2Y2OGMxMDktZmViNjY2ZDc="
  QueryIssues {
    message: "Failed to resolve tablet: 72075186224037891 after several retries."
    severity: 1
  }
  TxMeta {
    id: "01k95a5gnrdeca3yq76wmbhzj6"
  }
}
YdbStatus: UNAVAILABLE
ConsumedRu: 1
 sessionId: 
2025-11-03T16:52:53.025601Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 30 sessionId:  is DEAD
2025-11-03T16:52:53.028631Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Write session: Do CDS request
2025-11-03T16:52:53.028663Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Do schedule cds request after 2000 ms
2025-11-03T16:52:53.842469Z node 2 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976720731. Failed to resolve tablet: 72075186224037888 after several retries.
2025-11-03T16:52:53.842578Z node 2 :KQP_EXECUTER WARN: kqp_executer_impl.h:245: ActorId: [2:7568543147336577114:2768] TxId: 281474976720731. Ctx: { TraceId: 01k95a5h3921w30spwhddr3cgj, Database: /Root, SessionId: ydb://session/3?node_id=2&id=MTE5MTgzYzQtYzE0MGRiNGUtMmYwYTcwYjAtNTY2YmNlMjc=, PoolId: default}. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037888 after several retries.
2025-11-03T16:52:53.842833Z node 2 :KQP_SESSION WARN: kqp_session_actor.cpp:2987: SessionId: ydb://session/3?node_id=2&id=MTE5MTgzYzQtYzE0MGRiNGUtMmYwYTcwYjAtNTY2YmNlMjc=, ActorId: [2:7568543147336577097:2768], ActorState: ExecuteState, TraceId: 01k95a5h3921w30spwhddr3cgj, Create QueryResponse for error on request, msg: 
2025-11-03T16:52:53.844116Z node 2 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Failed to resolve tablet: 72075186224037888 after several retries." severity: 1 } TxMeta { id: "01k95a5hek036ehyn7q3v59mgf" } } YdbStatus: UNAVAILABLE ConsumedRu: 235 }
2025-11-03T16:52:54.392080Z node 1 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976715804. Failed to resolve tablet: 72075186224037890 after several retries.
2025-11-03T16:52:54.392215Z node 1 :KQP_EXECUTER WARN: kqp_executer_impl.h:245: ActorId: [1:7568543151634001266:3037] TxId: 281474976715804. Ctx: { TraceId: 01k95a5hkdd4fjankk4ahvfxhf, Database: /Root, SessionId: ydb://session/3?node_id=1&id=MjMwZDI4NzYtNDE1Yzg3NDAtN2JlODE0M2MtZWJkYjQ0YTU=, PoolId: default}. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037890 after several retries.
2025-11-03T16:52:54.392463Z node 1 :KQP_SESSION WARN: kqp_session_actor.cpp:2987: SessionId: ydb://session/3?node_id=1&id=MjMwZDI4NzYtNDE1Yzg3NDAtN2JlODE0M2MtZWJkYjQ0YTU=, ActorId: [1:7568543147339033947:3037], ActorState: ExecuteState, TraceId: 01k95a5hkdd4fjankk4ahvfxhf, Create QueryResponse for error on request, msg: 
2025-11-03T16:52:54.402796Z node 1 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Failed to resolve tablet: 72075186224037890 after several retries." severity: 1 } TxMeta { id: "01k95a5j19c1qqx53rsc3g8epe" } } YdbStatus: UNAVAILABLE ConsumedRu: 293 }
2025-11-03T16:52:55.032191Z :INFO: [/Root] MessageGroupId [test-message-group-id] Running cds request ms
2025-11-03T16:52:55.036357Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Got CDS response: 
write_sessions_clusters { clusters { endpoint: "localhost:1567" name: "dc1" available: true } primary_cluster_selection_reason: CLIENT_LOCATION } version: 1
2025-11-03T16:52:55.036401Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Start write session. Will connect to endpoint: localhost:1567
2025-11-03T16:52:55.040296Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" }
2025-11-03T16:52:55.040404Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-11-03T16:52:55.040436Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 31
2025-11-03T16:52:55.044502Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 31 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" }
2025-11-03T16:52:55.044667Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 31 topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" from ipv6:[::1]:34482
2025-11-03T16:52:55.044684Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=31 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:34482 proto=v1  topic=test-topic durationSec=0
2025-11-03T16:52:55.044694Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-11-03T16:52:55.046299Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 31 sessionId:  describe result for acl check
2025-11-03T16:52:55.046447Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-11-03T16:52:55.046459Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-11-03T16:52:55.046468Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-11-03T16:52:55.046481Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7568543160223935946:3049] (SourceId=test-message-group-id, PreferedPartition=(NULL)) StartKqpSession
2025-11-03T16:52:55.048814Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7568543160223935946:3049] (SourceId=test-message-group-id, PreferedPartition=(NULL)) Select from the table
2025-11-03T16:52:56.036527Z node 1 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976715806. Failed to resolve tablet: 72075186224037891 after several retries.
2025-11-03T16:52:56.036630Z node 1 :KQP_EXECUTER WARN: kqp_executer_impl.h:245: ActorId: [1:7568543160223935954:3051] TxId: 281474976715806. Ctx: { TraceId: 01k95a5km9c70t85q4afd4c809, Database: /Root, SessionId: ydb://session/3?node_id=1&id=NjJjYzY1MjEtZTFhMjI5YS1kN2QxYzQ1MS1mMDVlOWY2Yw==, PoolId: default}. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037891 after several retries.
2025-11-03T16:52:56.036843Z node 1 :KQP_SESSION WARN: kqp_session_actor.cpp:2987: SessionId: ydb://session/3?node_id=1&id=NjJjYzY1MjEtZTFhMjI5YS1kN2QxYzQ1MS1mMDVlOWY2Yw==, ActorId: [1:7568543160223935947:3051], ActorState: ExecuteState, TraceId: 01k95a5km9c70t85q4afd4c809, Create QueryResponse for error on request, msg: 
Test retry state: get retry delay
2025-11-03T16:52:56.038988Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: kqp error Marker# PQ50 : Response {   SessionId: "ydb://session/3?node_id=1&id=NjJjYzY1MjEtZTFhMjI5YS1kN2QxYzQ1MS1mMDVlOWY2Yw=="   QueryIssues {     message: "Failed to resolve tablet: 72075186224037891 after several retries."     severity: 1   }   TxMeta {     id: "01k95a5km9c70t85q4agdhanrp"   } } YdbStatus: UNAVAILABLE ConsumedRu: 1 , code: 500001 
2025-11-03T16:52:56.039031Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Write session will restart in 2.000000s
2025-11-03T16:52:56.039104Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Write session: Do CDS request
2025-11-03T16:52:56.039134Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Do schedule cds request after 2000 ms
2025-11-03T16:52:56.038096Z node 1 :PQ_PARTITION_CHOOSER INFO: partition_chooser_impl__abstract_chooser_actor.h:312: TPartitionChooser [1:7568543160223935946:3049] (SourceId=test-message-group-id, PreferedPartition=(NULL)) ReplyError: kqp error Marker# PQ50 : Response {
  SessionId: "ydb://session/3?node_id=1&id=NjJjYzY1MjEtZTFhMjI5YS1kN2QxYzQ1MS1mMDVlOWY2Yw=="
  QueryIssues {
    message: "Failed to resolve tablet: 72075186224037891 after several retries."
    severity: 1
  }
  TxMeta {
    id: "01k95a5km9c70t85q4agdhanrp"
  }
}
YdbStatus: UNAVAILABLE
ConsumedRu: 1
2025-11-03T16:52:56.038198Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 31 reason: kqp error Marker# PQ50 : Response {
  SessionId: "ydb://session/3?node_id=1&id=NjJjYzY1MjEtZTFhMjI5YS1kN2QxYzQ1MS1mMDVlOWY2Yw=="
  QueryIssues {
    message: "Failed to resolve tablet: 72075186224037891 after several retries."
    severity: 1
  }
  TxMeta {
    id: "01k95a5km9c70t85q4agdhanrp"
  }
}
YdbStatus: UNAVAILABLE
ConsumedRu: 1
 sessionId: 
2025-11-03T16:52:56.039431Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 31 sessionId:  is DEAD
WAIT for retries done
ALLOW tablets
{"NodeId":1,"Down":false}
{"NodeId":2,"Down":false}
WAIT for repair
2025-11-03T16:52:56.163696Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:140: [72075186224037893][rt3.dc1--test-topic] BALANCER INIT DONE for rt3.dc1--test-topic: (0, 72075186224037892) 
2025-11-03T16:52:56.179621Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:971: [72075186224037893][rt3.dc1--test-topic] Discovered subdomain [OwnerId: 72057594046644480, LocalPathId: 1] state, outOfSpace = 0 at RB 72075186224037893
2025-11-03T16:52:56.194765Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2960: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-11-03T16:52:56.207734Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2992: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-11-03T16:52:56.209002Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:913: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-11-03T16:52:56.209025Z node 1 :PERSQUEUE INFO: pq_impl.cpp:599: [PQ: 72075186224037892] has a tx writes info
2025-11-03T16:52:56.209072Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-11-03T16:52:56.209351Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-11-03T16:52:56.209572Z node 1 :PERSQUEUE INFO: partition_init.cpp:1101: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7568543164518903604:3063]
2025-11-03T16:52:56.220725Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-11-03T16:52:56.237824Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-11-03T16:52:56.238080Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-11-03T16:52:56.239850Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-11-03T16:52:56.240129Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000001_00000?
2025-11-03T16:52:56.240193Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000001_00000?
2025-11-03T16:52:56.240295Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000001_00000?
2025-11-03T16:52:56.240384Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 1 size 175 so 0 eo 1 d0000000000_00000000000000000000_00000_0000000001_00000?
2025-11-03T16:52:56.240560Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-11-03T16:52:56.240581Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-11-03T16:52:56.240630Z node 1 :PERSQUEUE INFO: partition_init.cpp:968: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-11-03T16:52:56.240655Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-11-03T16:52:56.240674Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-11-03T16:52:56.240705Z node 1 :PERSQUEUE INFO: partition.cpp:707: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2 [1:7568543164518903604:3063]
2025-11-03T16:52:56.240743Z node 1 :PERSQUEUE DEBUG: partition.cpp:727: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 1 Head Offset 1 PartNo 0 PackedSize 0 count 0 nextOffset 1 batches 0
SYNC INIT sourceId  test-message-group-id seqNo 1 offset 0
SYNC INIT DATA KEY: d0000000000_00000000000000000000_00000_0000000001_00000? size 175
2025-11-03T16:52:56.240779Z node 1 :PERSQUEUE DEBUG: partition_mlp.cpp:83: [72075186224037892][Partition][0][StateIdle] Initializing MLP Consumers: 0
2025-11-03T16:52:56.240805Z node 1 :PERSQUEUE DEBUG: partition.cpp:4273: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-11-03T16:52:56.240819Z node 1 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:56.240833Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:56.240850Z node 1 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:56.240892Z node 1 :PERSQUEUE DEBUG: partition.cpp:752: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  test-message-group-id SeqNo: 1 offset: 0 MaxOffset: 1
2025-11-03T16:52:56.240918Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:923: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-11-03T16:52:56.240960Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:965: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-11-03T16:52:56.241014Z node 1 :PERSQUEUE DEBUG: partition_mlp.cpp:60: [72075186224037892][Partition][0][StateIdle] Process MLP pending events. Count 0
2025-11-03T16:52:56.241160Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:52:56.241386Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:880: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 partno 0 count 1 size 1024000 endOffset 1 max time lag 0ms effective offset 0
2025-11-03T16:52:56.241563Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1105: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 175 count 1 last offset 0, current partition end offset: 1
2025-11-03T16:52:56.241577Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1121: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-11-03T16:52:56.241613Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 1 parts_count 0 actorID [1:7568543164518903574:3063]
2025-11-03T16:52:56.241647Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-11-03T16:52:56.241870Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-11-03T16:52:56.241890Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-11-03T16:52:56.241926Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 1 size 175 actorID [1:7568543164518903574:3063]
2025-11-03T16:52:56.241982Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:572: FormAnswer for 1 blobs
2025-11-03T16:52:56.242090Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 0 totakecount 1 count 1 size 155 from pos 0 cbcount 1
2025-11-03T16:52:56.242152Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1015: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1762188688333 queuesize 0 startOffset 0
2025-11-03T16:52:56.242659Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 1 parts_count 0
2025-11-03T16:52:56.242706Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 0 suffix '63' size 175
2025-11-03T16:52:56.247446Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:404: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2
2025-11-03T16:52:56.247504Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [1:7568543164518903554:3062], now have 1 active actors on pipe
2025-11-03T16:52:56.340447Z node 1 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:56.340483Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:56.340505Z node 1 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:56.440743Z node 1 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:56.440779Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:56.440793Z node 1 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:56.542376Z node 1 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:56.542408Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:56.542436Z node 1 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:56.642718Z node 1 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:56.642755Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:56.642770Z node 1 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:56.744091Z node 1 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:56.744128Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:56.744143Z node 1 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:56.845966Z node 1 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:56.845991Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:56.845999Z node 1 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:56.946123Z node 1 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:56.946156Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:56.946170Z node 1 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:57.046893Z node 1 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:57.046926Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:57.046941Z node 1 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:57.147770Z node 1 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:57.147804Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:57.147820Z node 1 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:57.249174Z node 1 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:57.249205Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:57.249219Z node 1 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:57.352201Z node 1 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:57.352233Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:57.352246Z node 1 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:57.456199Z node 1 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:57.456234Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:57.456246Z node 1 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:57.556727Z node 1 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:57.556804Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:57.556819Z node 1 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:57.657960Z node 1 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:57.657991Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:57.658003Z node 1 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:57.758440Z node 1 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:57.758492Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:57.758516Z node 1 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:57.860402Z node 1 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:57.860435Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:57.860448Z node 1 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:57.960267Z node 1 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:57.960297Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:57.960310Z node 1 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:58.041818Z :INFO: [/Root] MessageGroupId [test-message-group-id] Running cds request ms
2025-11-03T16:52:58.051094Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Got CDS response: 
write_sessions_clusters { clusters { endpoint: "localhost:1567" name: "dc1" available: true } primary_cluster_selection_reason: CLIENT_LOCATION } version: 1
2025-11-03T16:52:58.051149Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Start write session. Will connect to endpoint: localhost:1567
2025-11-03T16:52:58.054885Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" }
2025-11-03T16:52:58.054814Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-11-03T16:52:58.054848Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 32
2025-11-03T16:52:58.056028Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 32 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" }
2025-11-03T16:52:58.056165Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 32 topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" from ipv6:[::1]:34482
2025-11-03T16:52:58.056191Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=32 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:34482 proto=v1  topic=test-topic durationSec=0
2025-11-03T16:52:58.056202Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-11-03T16:52:58.057739Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 32 sessionId:  describe result for acl check
2025-11-03T16:52:58.057805Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-11-03T16:52:58.057811Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-11-03T16:52:58.057818Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-11-03T16:52:58.057828Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7568543173108838365:3095] (SourceId=test-message-group-id, PreferedPartition=(NULL)) StartKqpSession
2025-11-03T16:52:58.059683Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7568543173108838365:3095] (SourceId=test-message-group-id, PreferedPartition=(NULL)) Select from the table
2025-11-03T16:52:58.064495Z node 1 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:58.064523Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:58.064534Z node 1 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:58.074475Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7568543173108838365:3095] (SourceId=test-message-group-id, PreferedPartition=(NULL)) Update the table
2025-11-03T16:52:58.098527Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7568543173108838365:3095] (SourceId=test-message-group-id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-11-03T16:52:58.098566Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7568543173108838365:3095] (SourceId=test-message-group-id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-11-03T16:52:58.098583Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7568543173108838365:3095] (SourceId=test-message-group-id, PreferedPartition=(NULL)) Start idle
2025-11-03T16:52:58.098614Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 32 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-11-03T16:52:58.099883Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2
2025-11-03T16:52:58.099925Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [1:7568543173108838399:3095], now have 1 active actors on pipe
2025-11-03T16:52:58.100015Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:58.100037Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:58.100104Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner test-message-group-id
2025-11-03T16:52:58.100139Z node 1 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:58.100158Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:58.100171Z node 1 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-03T16:52:58.100207Z node 1 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:58.100246Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-03T16:52:58.100287Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-03T16:52:58.100464Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:58.100479Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:58.100529Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-03T16:52:58.101596Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|ddbc30ce-f580f6e0-738fdc62-ce520f1f_0] Write session established. Init response: last_sequence_number: 1 session_id: "test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-11-03T16:52:58.101749Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Write session: try to update token
2025-11-03T16:52:58.101791Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Send 2 message(s) (0 left), first sequence number is 2
REPAIR done
2025-11-03T16:52:58.100670Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 32 partition: 0 MaxSeqNo: 1 sessionId: test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0
2025-11-03T16:52:58.103641Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 32 sessionId: test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:52:58.103924Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:52:58.104272Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:58.104306Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:58.104372Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-11-03T16:52:58.104423Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-11-03T16:52:58.104599Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:58.104617Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:58.104914Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0test-message-group-id' SeqNo: 2 partNo : 0 messageNo: 1 size 98 offset: -1
2025-11-03T16:52:58.104947Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0test-message-group-id' SeqNo: 3 partNo : 0 messageNo: 1 size 98 offset: -1
2025-11-03T16:52:58.104979Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:52:58.105032Z node 1 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:58.105065Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:58.105076Z node 1 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (2)
2025-11-03T16:52:58.105182Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0test-message-group-id' seqNo 2 partNo 0
2025-11-03T16:52:58.106102Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0test-message-group-id' seqNo 2 partNo 0 FormedBlobsCount 0 NewHead: Offset 1 PartNo 0 PackedSize 187 count 1 nextOffset 2 batches 1
2025-11-03T16:52:58.106165Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0test-message-group-id' seqNo 3 partNo 0
2025-11-03T16:52:58.106200Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0test-message-group-id' seqNo 3 partNo 0 FormedBlobsCount 0 NewHead: Offset 1 PartNo 0 PackedSize 342 count 2 nextOffset 3 batches 1
2025-11-03T16:52:58.106216Z node 1 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:58.106677Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 1,2 HeadOffset 1 endOffset 1 curOffset 3 d0000000000_00000000000000000001_00000_0000000002_00000? size 321 WTime 1762188778105
2025-11-03T16:52:58.106810Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-03T16:52:58.106928Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 1 partNo 0 count 2 size 321
2025-11-03T16:52:58.112891Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 1 count 2 size 321 actorID [1:7568543164518903574:3063]
2025-11-03T16:52:58.112956Z node 1 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-03T16:52:58.113014Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 240 WriteNewSizeFromSupportivePartitions# 0
2025-11-03T16:52:58.113046Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:52:58.113100Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0test-message-group-id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 2, partNo: 0, Offset: 1 is stored on disk
2025-11-03T16:52:58.113122Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:52:58.113157Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0test-message-group-id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 3, partNo: 0, Offset: 2 is stored on disk
2025-11-03T16:52:58.113330Z node 1 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:58.113344Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:58.113356Z node 1 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:58.113388Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:52:58.113446Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1  requestId: <none> cookie: 1
2025-11-03T16:52:58.113537Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-11-03T16:52:58.113875Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 1 partno 0 count 2 parts 0 suffix '63' size 321
2025-11-03T16:52:58.119672Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Write session got write response: sequence_numbers: 2 sequence_numbers: 3 offsets: 1 offsets: 2 already_written: false already_written: false write_statistics { persist_duration_ms: 7 }
2025-11-03T16:52:58.119719Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Write session: acknoledged message 2
2025-11-03T16:52:58.119753Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Write session: acknoledged message 3
2025-11-03T16:52:58.124048Z :TWriteSession_TestPolicy INFO: Enqueue message with sequence number 4
2025-11-03T16:52:58.124383Z :TWriteSession_TestPolicy INFO: [] Write messages with sequence numbers 4
2025-11-03T16:52:58.124461Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Write 1 messages with Id from 4 to 4
2025-11-03T16:52:58.124548Z :TWriteSession_TestPolicy INFO: Wait for writer event
2025-11-03T16:52:58.124588Z :TWriteSession_TestPolicy INFO: Got new continue token
2025-11-03T16:52:58.126643Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Write session: try to update token
2025-11-03T16:52:58.126693Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Send 1 message(s) (0 left), first sequence number is 4
2025-11-03T16:52:58.131000Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 32 sessionId: test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:52:58.131323Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:52:58.132253Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:58.132279Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:58.132342Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 2  requestId: <none> cookie: 2
2025-11-03T16:52:58.132421Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-11-03T16:52:58.132615Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:52:58.132634Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:52:58.132689Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0test-message-group-id' SeqNo: 4 partNo : 0 messageNo: 3 size 98 offset: -1
2025-11-03T16:52:58.132722Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:52:58.132768Z node 1 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:58.132793Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:58.132806Z node 1 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-03T16:52:58.132913Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0test-message-group-id' seqNo 4 partNo 0
2025-11-03T16:52:58.219511Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0test-message-group-id' seqNo 4 partNo 0 FormedBlobsCount 0 NewHead: Offset 3 PartNo 0 PackedSize 187 count 1 nextOffset 4 batches 1
2025-11-03T16:52:58.219584Z node 1 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:58.224140Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 3,1 HeadOffset 3 endOffset 3 curOffset 4 d0000000000_00000000000000000003_00000_0000000001_00000? size 175 WTime 1762188778223
2025-11-03T16:52:58.224397Z node 1 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:52:58.224438Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-03T16:52:58.224556Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 3 partNo 0 count 1 size 175
2025-11-03T16:52:58.231364Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 3 count 1 size 175 actorID [1:7568543164518903574:3063]
2025-11-03T16:52:58.231439Z node 1 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-03T16:52:58.231498Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 120 WriteNewSizeFromSupportivePartitions# 0
2025-11-03T16:52:58.231535Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:52:58.231575Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0test-message-group-id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 4, partNo: 0, Offset: 3 is stored on disk
2025-11-03T16:52:58.231763Z node 1 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:52:58.231778Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:52:58.231791Z node 1 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:52:58.231824Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:52:58.231867Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 3  requestId: <none> cookie: 2
2025-11-03T16:52:58.231939Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-11-03T16:52:58.233499Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 3 partno 0 count 1 parts 0 suffix '63' size 175
2025-11-03T16:52:58.240200Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Write session got write response: sequence_numbers: 4 offsets: 3 already_written: false write_statistics { persist_duration_ms: 11 queued_in_partition_duration_ms: 88 }
2025-11-03T16:52:58.240248Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Write session: acknoledged message 4
====ExpectBreakDown
WAIT for retries...
KICK tablets
{"NodeId":1,"Down":true}
{"NodeId":2,"Down":true}
{"TabletsKicked":6}
{"TabletsKicked":0}
2025-11-03T16:52:58.266915Z :TWriteSession_TestPolicy INFO: Enqueue message with sequence number 5
2025-11-03T16:52:58.266968Z :TWriteSession_TestPolicy INFO: Enqueue message with sequence number 6
2025-11-03T16:52:58.268073Z :TWriteSession_TestPolicy INFO: [] Write messages with sequence numbers 5
2025-11-03T16:52:58.268166Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Write 1 messages with Id from 5 to 5
2025-11-03T16:52:58.268246Z :TWriteSession_TestPolicy INFO: Wait for writer event
2025-11-03T16:52:58.268277Z :TWriteSession_TestPolicy INFO: Got new continue token
2025-11-03T16:52:58.268299Z :TWriteSession_TestPolicy INFO: [] Write messages with sequence numbers 6
2025-11-03T16:52:58.268325Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Write 1 messages with Id from 6 to 6
2025-11-03T16:52:58.269701Z :TWriteSession_TestPolicy INFO: Wait for writer event
2025-11-03T16:52:58.269744Z :TWriteSession_TestPolicy INFO: Got new continue token
2025-11-03T16:52:58.272172Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Write session: try to update token
2025-11-03T16:52:58.272228Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Send 2 message(s) (0 left), first sequence number is 5
2025-11-03T16:52:58.279591Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 32 sessionId: test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:52:58.279671Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-11-03T16:52:58.279686Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-11-03T16:52:58.280050Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 32 reason: pipe to partition's 0 tablet is dead #2 sessionId: test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0
2025-11-03T16:52:58.280299Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 32 sessionId: test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0 is DEAD
====CreateRetryState
====CreateRetryState Initialized
Test retry state: get retry delay
2025-11-03T16:52:58.281268Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: pipe to partition's 0 tablet is dead #2, code: 500027 
2025-11-03T16:52:58.281301Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Write session will restart in 2.000000s
2025-11-03T16:52:58.281372Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Write session: Do CDS request
2025-11-03T16:52:58.281405Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Do schedule cds request after 2000 ms
2025-11-03T16:52:59.840832Z node 1 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976715812. Failed to resolve tablet: 72075186224037890 after several retries.
2025-11-03T16:52:59.840949Z node 1 :KQP_EXECUTER WARN: kqp_executer_impl.h:245: ActorId: [1:7568543177403805747:3100] TxId: 281474976715812. Ctx: { TraceId: 01k95a5q440hwjvwfhv5egavhj, Database: /Root, SessionId: ydb://session/3?node_id=1&id=YmFmNjE1MDItYjNjMTdlNmUtYjRiYmUxZTktNzc1YWZjMGQ=, PoolId: default}. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037890 after several retries.
2025-11-03T16:52:59.841229Z node 1 :KQP_SESSION WARN: kqp_session_actor.cpp:2987: SessionId: ydb://session/3?node_id=1&id=YmFmNjE1MDItYjNjMTdlNmUtYjRiYmUxZTktNzc1YWZjMGQ=, ActorId: [1:7568543173108838426:3100], ActorState: ExecuteState, TraceId: 01k95a5q440hwjvwfhv5egavhj, Create QueryResponse for error on request, msg: 
2025-11-03T16:52:59.848786Z node 1 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Failed to resolve tablet: 72075186224037890 after several retries." severity: 1 } TxMeta { id: "01k95a5qh466dt5xfw5m1gjdpy" } } YdbStatus: UNAVAILABLE ConsumedRu: 275 }
2025-11-03T16:52:59.967511Z node 2 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976720735. Failed to resolve tablet: 72075186224037888 after several retries.
2025-11-03T16:52:59.967654Z node 2 :KQP_EXECUTER WARN: kqp_executer_impl.h:245: ActorId: [2:7568543177401348367:2800] TxId: 281474976720735. Ctx: { TraceId: 01k95a5q555n5a1emrbdc4y8w9, Database: /Root, SessionId: ydb://session/3?node_id=2&id=NTY0MzFiYTktY2NhNjY5ODUtNGZjYWIxOGItZjFkZDA0MTQ=, PoolId: default}. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037888 after several retries.
2025-11-03T16:52:59.967962Z node 2 :KQP_SESSION WARN: kqp_session_actor.cpp:2987: SessionId: ydb://session/3?node_id=2&id=NTY0MzFiYTktY2NhNjY5ODUtNGZjYWIxOGItZjFkZDA0MTQ=, ActorId: [2:7568543173106381054:2800], ActorState: ExecuteState, TraceId: 01k95a5q555n5a1emrbdc4y8w9, Create QueryResponse for error on request, msg: 
2025-11-03T16:52:59.968865Z node 2 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Failed to resolve tablet: 72075186224037888 after several retries." severity: 1 } TxMeta { id: "01k95a5qm40t71wpc9t8d3c0mc" } } YdbStatus: UNAVAILABLE ConsumedRu: 310 }
2025-11-03T16:53:00.284230Z :INFO: [/Root] MessageGroupId [test-message-group-id] Running cds request ms
2025-11-03T16:53:00.299447Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Got CDS response: 
write_sessions_clusters { clusters { endpoint: "localhost:1567" name: "dc1" available: true } primary_cluster_selection_reason: CLIENT_LOCATION } version: 1
2025-11-03T16:53:00.299515Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Start write session. Will connect to endpoint: localhost:1567
2025-11-03T16:53:00.303764Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" }
2025-11-03T16:53:00.305325Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-11-03T16:53:00.305357Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 33
2025-11-03T16:53:00.305805Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 33 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" }
2025-11-03T16:53:00.305927Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 33 topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" from ipv6:[::1]:34482
2025-11-03T16:53:00.305942Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=33 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:34482 proto=v1  topic=test-topic durationSec=0
2025-11-03T16:53:00.305953Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-11-03T16:53:00.307290Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 33 sessionId:  describe result for acl check
2025-11-03T16:53:00.307406Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-11-03T16:53:00.307417Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-11-03T16:53:00.307427Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-11-03T16:53:00.307443Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7568543181698773120:3110] (SourceId=test-message-group-id, PreferedPartition=(NULL)) StartKqpSession
2025-11-03T16:53:00.310123Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7568543181698773120:3110] (SourceId=test-message-group-id, PreferedPartition=(NULL)) Select from the table
2025-11-03T16:53:01.117632Z node 1 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976715814. Failed to resolve tablet: 72075186224037891 after several retries.
2025-11-03T16:53:01.117751Z node 1 :KQP_EXECUTER WARN: kqp_executer_impl.h:245: ActorId: [1:7568543181698773131:3112] TxId: 281474976715814. Ctx: { TraceId: 01k95a5rrpdg37kxhf8zgmbmbv, Database: /Root, SessionId: ydb://session/3?node_id=1&id=OGI0M2JjNjAtZDVhYzgxYmMtOTFjMzg5M2ItYWZjYTYxNzE=, PoolId: default}. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037891 after several retries.
2025-11-03T16:53:01.117959Z node 1 :KQP_SESSION WARN: kqp_session_actor.cpp:2987: SessionId: ydb://session/3?node_id=1&id=OGI0M2JjNjAtZDVhYzgxYmMtOTFjMzg5M2ItYWZjYTYxNzE=, ActorId: [1:7568543181698773121:3112], ActorState: ExecuteState, TraceId: 01k95a5rrpdg37kxhf8zgmbmbv, Create QueryResponse for error on request, msg: 
Test retry state: get retry delay
2025-11-03T16:53:01.120724Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: kqp error Marker# PQ50 : Response {   SessionId: "ydb://session/3?node_id=1&id=OGI0M2JjNjAtZDVhYzgxYmMtOTFjMzg5M2ItYWZjYTYxNzE="   QueryIssues {     message: "Failed to resolve tablet: 72075186224037891 after several retries."     severity: 1   }   TxMeta {     id: "01k95a5rrr142bqz1c3jqks0bc"   } } YdbStatus: UNAVAILABLE ConsumedRu: 1 , code: 500001 
2025-11-03T16:53:01.120759Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Write session will restart in 2.000000s
2025-11-03T16:53:01.120836Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Write session: Do CDS request
2025-11-03T16:53:01.120868Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Do schedule cds request after 2000 ms
2025-11-03T16:53:01.119166Z node 1 :PQ_PARTITION_CHOOSER INFO: partition_chooser_impl__abstract_chooser_actor.h:312: TPartitionChooser [1:7568543181698773120:3110] (SourceId=test-message-group-id, PreferedPartition=(NULL)) ReplyError: kqp error Marker# PQ50 : Response {
  SessionId: "ydb://session/3?node_id=1&id=OGI0M2JjNjAtZDVhYzgxYmMtOTFjMzg5M2ItYWZjYTYxNzE="
  QueryIssues {
    message: "Failed to resolve tablet: 72075186224037891 after several retries."
    severity: 1
  }
  TxMeta {
    id: "01k95a5rrr142bqz1c3jqks0bc"
  }
}
YdbStatus: UNAVAILABLE
ConsumedRu: 1
2025-11-03T16:53:01.119240Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 33 reason: kqp error Marker# PQ50 : Response {
  SessionId: "ydb://session/3?node_id=1&id=OGI0M2JjNjAtZDVhYzgxYmMtOTFjMzg5M2ItYWZjYTYxNzE="
  QueryIssues {
    message: "Failed to resolve tablet: 72075186224037891 after several retries."
    severity: 1
  }
  TxMeta {
    id: "01k95a5rrr142bqz1c3jqks0bc"
  }
}
YdbStatus: UNAVAILABLE
ConsumedRu: 1
 sessionId: 
2025-11-03T16:53:01.119573Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 33 sessionId:  is DEAD
2025-11-03T16:53:02.316071Z node 1 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976715816. Failed to resolve tablet: 72075186224037888 after several retries.
2025-11-03T16:53:02.316201Z node 1 :KQP_EXECUTER WARN: kqp_executer_impl.h:245: ActorId: [1:7568543185993740488:3115] TxId: 281474976715816. Ctx: { TraceId: 01k95a5s9jcm0echjzst2vysk1, Database: /Root, SessionId: ydb://session/3?node_id=1&id=MTZlMTIyODMtMjFiMDBhNzgtNTZlNDFkM2ItZjNhMGE5MzQ=, PoolId: default}. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037888 after several retries.
2025-11-03T16:53:02.316444Z node 1 :KQP_SESSION WARN: kqp_session_actor.cpp:2987: SessionId: ydb://session/3?node_id=1&id=MTZlMTIyODMtMjFiMDBhNzgtNTZlNDFkM2ItZjNhMGE5MzQ=, ActorId: [1:7568543181698773161:3115], ActorState: ExecuteState, TraceId: 01k95a5s9jcm0echjzst2vysk1, Create QueryResponse for error on request, msg: 
2025-11-03T16:53:02.320577Z node 1 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Failed to resolve tablet: 72075186224037888 after several retries." severity: 1 } TxMeta { id: "01k95a5srgez5d7j4z7g4ch837" } } YdbStatus: UNAVAILABLE ConsumedRu: 311 }
2025-11-03T16:53:02.404741Z node 2 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976720737. Failed to resolve tablet: 72075186224037890 after several retries.
2025-11-03T16:53:02.404919Z node 2 :KQP_EXECUTER WARN: kqp_executer_impl.h:245: ActorId: [2:7568543185991283038:2812] TxId: 281474976720737. Ctx: { TraceId: 01k95a5sdf5g3feag5kmv49c66, Database: /Root, SessionId: ydb://session/3?node_id=2&id=ZTE4OWU5MDYtMjc4MjFkYTUtODViM2UxMzItNmQzOWNlNjg=, PoolId: default}. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037890 after several retries.
2025-11-03T16:53:02.405241Z node 2 :KQP_SESSION WARN: kqp_session_actor.cpp:2987: SessionId: ydb://session/3?node_id=2&id=ZTE4OWU5MDYtMjc4MjFkYTUtODViM2UxMzItNmQzOWNlNjg=, ActorId: [2:7568543181696315729:2812], ActorState: ExecuteState, TraceId: 01k95a5sdf5g3feag5kmv49c66, Create QueryResponse for error on request, msg: 
2025-11-03T16:53:02.406467Z node 2 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Failed to resolve tablet: 72075186224037890 after several retries." severity: 1 } TxMeta { id: "01k95a5st46n5hs5t8dwkgfq6d" } } YdbStatus: UNAVAILABLE ConsumedRu: 264 }
2025-11-03T16:53:03.136060Z :INFO: [/Root] MessageGroupId [test-message-group-id] Running cds request ms
2025-11-03T16:53:03.148190Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Got CDS response: 
write_sessions_clusters { clusters { endpoint: "localhost:1567" name: "dc1" available: true } primary_cluster_selection_reason: CLIENT_LOCATION } version: 1
2025-11-03T16:53:03.148242Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Start write session. Will connect to endpoint: localhost:1567
2025-11-03T16:53:03.151567Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" }
2025-11-03T16:53:03.151477Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-11-03T16:53:03.151508Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 34
2025-11-03T16:53:03.152789Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 34 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" }
2025-11-03T16:53:03.152925Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 34 topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" from ipv6:[::1]:34482
2025-11-03T16:53:03.152941Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=34 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:34482 proto=v1  topic=test-topic durationSec=0
2025-11-03T16:53:03.152951Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-11-03T16:53:03.154473Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 34 sessionId:  describe result for acl check
2025-11-03T16:53:03.154590Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-11-03T16:53:03.154601Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-11-03T16:53:03.154608Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-11-03T16:53:03.154624Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7568543194583675175:3127] (SourceId=test-message-group-id, PreferedPartition=(NULL)) StartKqpSession
2025-11-03T16:53:03.161626Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7568543194583675175:3127] (SourceId=test-message-group-id, PreferedPartition=(NULL)) Select from the table
2025-11-03T16:53:04.180124Z node 1 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976715818. Failed to resolve tablet: 72075186224037891 after several retries.
2025-11-03T16:53:04.180264Z node 1 :KQP_EXECUTER WARN: kqp_executer_impl.h:245: ActorId: [1:7568543194583675186:3129] TxId: 281474976715818. Ctx: { TraceId: 01k95a5vhs0r7d7s79mttp8xz1, Database: /Root, SessionId: ydb://session/3?node_id=1&id=YmYzZjAzZTUtOGUzODQyZmQtYTY0ZDkxMGYtNTMwZjlhNjk=, PoolId: default}. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037891 after several retries.
2025-11-03T16:53:04.180511Z node 1 :KQP_SESSION WARN: kqp_session_actor.cpp:2987: SessionId: ydb://session/3?node_id=1&id=YmYzZjAzZTUtOGUzODQyZmQtYTY0ZDkxMGYtNTMwZjlhNjk=, ActorId: [1:7568543194583675176:3129], ActorState: ExecuteState, TraceId: 01k95a5vhs0r7d7s79mttp8xz1, Create QueryResponse for error on request, msg: 
2025-11-03T16:53:04.181532Z node 1 :PQ_PARTITION_CHOOSER INFO: partition_chooser_impl__abstract_chooser_actor.h:312: TPartitionChooser [1:7568543194583675175:3127] (SourceId=test-message-group-id, PreferedPartition=(NULL)) ReplyError: kqp error Marker# PQ50 : Response {
  SessionId: "ydb://session/3?node_id=1&id=YmYzZjAzZTUtOGUzODQyZmQtYTY0ZDkxMGYtNTMwZjlhNjk="
  QueryIssues {
    message: "Failed to resolve tablet: 72075186224037891 after several retries."
    severity: 1
  }
  TxMeta {
    id: "01k95a5vhtfdx8er1wndgccewr"
  }
}
YdbStatus: UNAVAILABLE
ConsumedRu: 1
2025-11-03T16:53:04.181603Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 34 reason: kqp error Marker# PQ50 : Response {
  SessionId: "ydb://session/3?node_id=1&id=YmYzZjAzZTUtOGUzODQyZmQtYTY0ZDkxMGYtNTMwZjlhNjk="
  QueryIssues {
    message: "Failed to resolve tablet: 72075186224037891 after several retries."
    severity: 1
  }
  TxMeta {
    id: "01k95a5vhtfdx8er1wndgccewr"
  }
}
YdbStatus: UNAVAILABLE
ConsumedRu: 1
 sessionId: 
2025-11-03T16:53:04.181946Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 34 sessionId:  is DEAD
Test retry state: get retry delay
2025-11-03T16:53:04.184151Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: kqp error Marker# PQ50 : Response {   SessionId: "ydb://session/3?node_id=1&id=YmYzZjAzZTUtOGUzODQyZmQtYTY0ZDkxMGYtNTMwZjlhNjk="   QueryIssues {     message: "Failed to resolve tablet: 72075186224037891 after several retries."     severity: 1   }   TxMeta {     id: "01k95a5vhtfdx8er1wndgccewr"   } } YdbStatus: UNAVAILABLE ConsumedRu: 1 , code: 500001 
2025-11-03T16:53:04.184186Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Write session will restart in 2.000000s
2025-11-03T16:53:04.184262Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Write session: Do CDS request
2025-11-03T16:53:04.184295Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Do schedule cds request after 2000 ms
2025-11-03T16:53:04.979625Z node 1 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976715819. Failed to resolve tablet: 72075186224037890 after several retries.
2025-11-03T16:53:04.979738Z node 1 :KQP_EXECUTER WARN: kqp_executer_impl.h:245: ActorId: [1:7568543194583675237:3131] TxId: 281474976715819. Ctx: { TraceId: 01k95a5vpzaf7jrb5c9y5n8980, Database: /Root, SessionId: ydb://session/3?node_id=1&id=YTBjZmU5M2MtY2U2ZGY4YWQtOTE1OGJiZWUtMmRiZTZmODY=, PoolId: default}. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037890 after several retries.
2025-11-03T16:53:04.980012Z node 1 :KQP_SESSION WARN: kqp_session_actor.cpp:2987: SessionId: ydb://session/3?node_id=1&id=YTBjZmU5M2MtY2U2ZGY4YWQtOTE1OGJiZWUtMmRiZTZmODY=, ActorId: [1:7568543194583675194:3131], ActorState: ExecuteState, TraceId: 01k95a5vpzaf7jrb5c9y5n8980, Create QueryResponse for error on request, msg: 
2025-11-03T16:53:04.981575Z node 1 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Failed to resolve tablet: 72075186224037890 after several retries." severity: 1 } TxMeta { id: "01k95a5wbcdh85kj27fcr4bg1t" } } YdbStatus: UNAVAILABLE ConsumedRu: 420 }
2025-11-03T16:53:05.138148Z node 2 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976720739. Failed to resolve tablet: 72075186224037890 after several retries.
2025-11-03T16:53:05.138279Z node 2 :KQP_EXECUTER WARN: kqp_executer_impl.h:245: ActorId: [2:7568543198876185010:2822] TxId: 281474976720739. Ctx: { TraceId: 01k95a5vsm9j43t3pe66dg12vq, Database: /Root, SessionId: ydb://session/3?node_id=2&id=Yzc5MDBjYzEtYjc2ZjJkZDAtNjcwYzVhZTYtZTU1ODg4Mjk=, PoolId: default}. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037890 after several retries.
2025-11-03T16:53:05.138536Z node 2 :KQP_SESSION WARN: kqp_session_actor.cpp:2987: SessionId: ydb://session/3?node_id=2&id=Yzc5MDBjYzEtYjc2ZjJkZDAtNjcwYzVhZTYtZTU1ODg4Mjk=, ActorId: [2:7568543194581217697:2822], ActorState: ExecuteState, TraceId: 01k95a5vsm9j43t3pe66dg12vq, Create QueryResponse for error on request, msg: 
2025-11-03T16:53:05.139563Z node 2 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Failed to resolve tablet: 72075186224037890 after several retries." severity: 1 } TxMeta { id: "01k95a5wf04xc1zdzp3p8zz17c" } } YdbStatus: UNAVAILABLE ConsumedRu: 441 }
2025-11-03T16:53:06.186164Z :INFO: [/Root] MessageGroupId [test-message-group-id] Running cds request ms
2025-11-03T16:53:06.190346Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Got CDS response: 
write_sessions_clusters { clusters { endpoint: "localhost:1567" name: "dc1" available: true } primary_cluster_selection_reason: CLIENT_LOCATION } version: 1
2025-11-03T16:53:06.190391Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Start write session. Will connect to endpoint: localhost:1567
2025-11-03T16:53:06.193234Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" }
2025-11-03T16:53:06.193245Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-11-03T16:53:06.193275Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 35
2025-11-03T16:53:06.193664Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 35 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" }
2025-11-03T16:53:06.193744Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 35 topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" from ipv6:[::1]:34482
2025-11-03T16:53:06.193752Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=35 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:34482 proto=v1  topic=test-topic durationSec=0
2025-11-03T16:53:06.193759Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-11-03T16:53:06.194738Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 35 sessionId:  describe result for acl check
2025-11-03T16:53:06.194806Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-11-03T16:53:06.194812Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-11-03T16:53:06.194818Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-11-03T16:53:06.194828Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7568543207468577241:3150] (SourceId=test-message-group-id, PreferedPartition=(NULL)) StartKqpSession
2025-11-03T16:53:06.197133Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7568543207468577241:3150] (SourceId=test-message-group-id, PreferedPartition=(NULL)) Select from the table
2025-11-03T16:53:07.192333Z node 1 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976715822. Failed to resolve tablet: 72075186224037891 after several retries.
2025-11-03T16:53:07.192446Z node 1 :KQP_EXECUTER WARN: kqp_executer_impl.h:245: ActorId: [1:7568543207468577252:3152] TxId: 281474976715822. Ctx: { TraceId: 01k95a5ygne2d2enkv8j94aeda, Database: /Root, SessionId: ydb://session/3?node_id=1&id=MjQ2MDZjM2MtZDkxMGIyNGMtYmRhNTIzYjYtOGRlNDA4NmQ=, PoolId: default}. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037891 after several retries.
2025-11-03T16:53:07.192661Z node 1 :KQP_SESSION WARN: kqp_session_actor.cpp:2987: SessionId: ydb://session/3?node_id=1&id=MjQ2MDZjM2MtZDkxMGIyNGMtYmRhNTIzYjYtOGRlNDA4NmQ=, ActorId: [1:7568543207468577242:3152], ActorState: ExecuteState, TraceId: 01k95a5ygne2d2enkv8j94aeda, Create QueryResponse for error on request, msg: 
Test retry state: get retry delay
2025-11-03T16:53:07.196156Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: kqp error Marker# PQ50 : Response {   SessionId: "ydb://session/3?node_id=1&id=MjQ2MDZjM2MtZDkxMGIyNGMtYmRhNTIzYjYtOGRlNDA4NmQ="   QueryIssues {     message: "Failed to resolve tablet: 72075186224037891 after several retries."     severity: 1   }   TxMeta {     id: "01k95a5ygne2d2enkv8n64k5nr"   } } YdbStatus: UNAVAILABLE ConsumedRu: 1 , code: 500001 
2025-11-03T16:53:07.196188Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Write session will restart in 2.000000s
2025-11-03T16:53:07.196263Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Write session: Do CDS request
2025-11-03T16:53:07.196297Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Do schedule cds request after 2000 ms
2025-11-03T16:53:07.194475Z node 1 :PQ_PARTITION_CHOOSER INFO: partition_chooser_impl__abstract_chooser_actor.h:312: TPartitionChooser [1:7568543207468577241:3150] (SourceId=test-message-group-id, PreferedPartition=(NULL)) ReplyError: kqp error Marker# PQ50 : Response {
  SessionId: "ydb://session/3?node_id=1&id=MjQ2MDZjM2MtZDkxMGIyNGMtYmRhNTIzYjYtOGRlNDA4NmQ="
  QueryIssues {
    message: "Failed to resolve tablet: 72075186224037891 after several retries."
    severity: 1
  }
  TxMeta {
    id: "01k95a5ygne2d2enkv8n64k5nr"
  }
}
YdbStatus: UNAVAILABLE
ConsumedRu: 1
2025-11-03T16:53:07.194556Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 35 reason: kqp error Marker# PQ50 : Response {
  SessionId: "ydb://session/3?node_id=1&id=MjQ2MDZjM2MtZDkxMGIyNGMtYmRhNTIzYjYtOGRlNDA4NmQ="
  QueryIssues {
    message: "Failed to resolve tablet: 72075186224037891 after several retries."
    severity: 1
  }
  TxMeta {
    id: "01k95a5ygne2d2enkv8n64k5nr"
  }
}
YdbStatus: UNAVAILABLE
ConsumedRu: 1
 sessionId: 
2025-11-03T16:53:07.194871Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 35 sessionId:  is DEAD
2025-11-03T16:53:07.350476Z node 1 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976715823. Failed to resolve tablet: 72075186224037890 after several retries.
2025-11-03T16:53:07.350596Z node 1 :KQP_EXECUTER WARN: kqp_executer_impl.h:245: ActorId: [1:7568543207468577265:3142] TxId: 281474976715823. Ctx: { TraceId: 01k95a5ya31250gcp07p7s0b4r, Database: /Root, SessionId: ydb://session/3?node_id=1&id=NjU3OGFjYy1mNjEwZGVjZC01OTZkMmQ3Ni0xMGUzMGFlYQ==, PoolId: default}. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037890 after several retries.
2025-11-03T16:53:07.350883Z node 1 :KQP_SESSION WARN: kqp_session_actor.cpp:2987: SessionId: ydb://session/3?node_id=1&id=NjU3OGFjYy1mNjEwZGVjZC01OTZkMmQ3Ni0xMGUzMGFlYQ==, ActorId: [1:7568543203173609927:3142], ActorState: ExecuteState, TraceId: 01k95a5ya31250gcp07p7s0b4r, Create QueryResponse for error on request, msg: 
2025-11-03T16:53:07.351967Z node 1 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Failed to resolve tablet: 72075186224037890 after several retries." severity: 1 } TxMeta { id: "01k95a5ynj9y460d55f60raes7" } } YdbStatus: UNAVAILABLE ConsumedRu: 241 }
2025-11-03T16:53:07.572079Z node 2 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976720741. Failed to resolve tablet: 72075186224037890 after several retries.
2025-11-03T16:53:07.572225Z node 2 :KQP_EXECUTER WARN: kqp_executer_impl.h:245: ActorId: [2:7568543207466119683:2834] TxId: 281474976720741. Ctx: { TraceId: 01k95a5yf10s3tn3ye4g47w4a6, Database: /Root, SessionId: ydb://session/3?node_id=2&id=NzBhOGJkNjYtYWJhMjM1ZmEtM2U3ODVjYy0zNDU3YmJlYQ==, PoolId: default}. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037890 after several retries.
2025-11-03T16:53:07.572530Z node 2 :KQP_SESSION WARN: kqp_session_actor.cpp:2987: SessionId: ydb://session/3?node_id=2&id=NzBhOGJkNjYtYWJhMjM1ZmEtM2U3ODVjYy0zNDU3YmJlYQ==, ActorId: [2:7568543207466119669:2834], ActorState: ExecuteState, TraceId: 01k95a5yf10s3tn3ye4g47w4a6, Create QueryResponse for error on request, msg: 
2025-11-03T16:53:07.576868Z node 2 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Failed to resolve tablet: 72075186224037890 after several retries." severity: 1 } TxMeta { id: "01k95a5yvw2n7hddv327bqv8pf" } } YdbStatus: UNAVAILABLE ConsumedRu: 262 }
2025-11-03T16:53:09.200052Z :INFO: [/Root] MessageGroupId [test-message-group-id] Running cds request ms
2025-11-03T16:53:09.204102Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Got CDS response: 
write_sessions_clusters { clusters { endpoint: "localhost:1567" name: "dc1" available: true } primary_cluster_selection_reason: CLIENT_LOCATION } version: 1
2025-11-03T16:53:09.204154Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Start write session. Will connect to endpoint: localhost:1567
2025-11-03T16:53:09.207237Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" }
2025-11-03T16:53:09.211285Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-11-03T16:53:09.211319Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 36
2025-11-03T16:53:09.211777Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 36 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" }
2025-11-03T16:53:09.211904Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 36 topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" from ipv6:[::1]:34482
2025-11-03T16:53:09.211921Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=36 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:34482 proto=v1  topic=test-topic durationSec=0
2025-11-03T16:53:09.211932Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-11-03T16:53:09.213276Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 36 sessionId:  describe result for acl check
2025-11-03T16:53:09.213405Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-11-03T16:53:09.213416Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-11-03T16:53:09.213426Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-11-03T16:53:09.213441Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7568543220353479319:3167] (SourceId=test-message-group-id, PreferedPartition=(NULL)) StartKqpSession
2025-11-03T16:53:09.223283Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7568543220353479319:3167] (SourceId=test-message-group-id, PreferedPartition=(NULL)) Select from the table
2025-11-03T16:53:09.975556Z node 1 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976715826. Failed to resolve tablet: 72075186224037888 after several retries.
2025-11-03T16:53:09.975699Z node 1 :KQP_EXECUTER WARN: kqp_executer_impl.h:245: ActorId: [1:7568543216058512000:3158] TxId: 281474976715826. Ctx: { TraceId: 01k95a60mbbnqe1hhdpxzm3d7z, Database: /Root, SessionId: ydb://session/3?node_id=1&id=YWY3ODBhNDgtNzdkN2E3MTYtZDkzMjBmYzUtODI5MmY5NGU=, PoolId: default}. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037888 after several retries.
2025-11-03T16:53:09.976008Z node 1 :KQP_SESSION WARN: kqp_session_actor.cpp:2987: SessionId: ydb://session/3?node_id=1&id=YWY3ODBhNDgtNzdkN2E3MTYtZDkzMjBmYzUtODI5MmY5NGU=, ActorId: [1:7568543216058511974:3158], ActorState: ExecuteState, TraceId: 01k95a60mbbnqe1hhdpxzm3d7z, Create QueryResponse for error on request, msg: 
2025-11-03T16:53:09.976882Z node 1 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Failed to resolve tablet: 72075186224037888 after several retries." severity: 1 } TxMeta { id: "01k95a616y6z000qazt6bebrj9" } } YdbStatus: UNAVAILABLE ConsumedRu: 392 }
2025-11-03T16:53:10.139263Z node 2 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976720743. Failed to resolve tablet: 72075186224037888 after several retries.
2025-11-03T16:53:10.139388Z node 2 :KQP_EXECUTER WARN: kqp_executer_impl.h:245: ActorId: [2:7568543220351021654:2844] TxId: 281474976720743. Ctx: { TraceId: 01k95a60vc04a8682styk7kgpx, Database: /Root, SessionId: ydb://session/3?node_id=2&id=ODJiZmJlMzQtYmJlNDViMzItNjQ2OWE4ODItYTZhYzZkNDQ=, PoolId: default}. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037888 after several retries.
2025-11-03T16:53:10.139658Z node 2 :KQP_SESSION WARN: kqp_session_actor.cpp:2987: SessionId: ydb://session/3?node_id=2&id=ODJiZmJlMzQtYmJlNDViMzItNjQ2OWE4ODItYTZhYzZkNDQ=, ActorId: [2:7568543216056054341:2844], ActorState: ExecuteState, TraceId: 01k95a60vc04a8682styk7kgpx, Create QueryResponse for error on request, msg: 
2025-11-03T16:53:10.144246Z node 2 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Failed to resolve tablet: 72075186224037888 after several retries." severity: 1 } TxMeta { id: "01k95a61b41b9jv5snmhap5ev6" } } YdbStatus: UNAVAILABLE ConsumedRu: 330 }
2025-11-03T16:53:10.233034Z node 1 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976715827. Failed to resolve tablet: 72075186224037891 after several retries.
2025-11-03T16:53:10.233156Z node 1 :KQP_EXECUTER WARN: kqp_executer_impl.h:245: ActorId: [1:7568543220353479332:3169] TxId: 281474976715827. Ctx: { TraceId: 01k95a61f73dj68pxvhte142cs, Database: /Root, SessionId: ydb://session/3?node_id=1&id=ZmI0OWFiZDEtNzc2NTg5YzEtYzQ0NmRmODktZmIxOTYwMGY=, PoolId: default}. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037891 after several retries.
2025-11-03T16:53:10.233378Z node 1 :KQP_SESSION WARN: kqp_session_actor.cpp:2987: SessionId: ydb://session/3?node_id=1&id=ZmI0OWFiZDEtNzc2NTg5YzEtYzQ0NmRmODktZmIxOTYwMGY=, ActorId: [1:7568543220353479320:3169], ActorState: ExecuteState, TraceId: 01k95a61f73dj68pxvhte142cs, Create QueryResponse for error on request, msg: 
2025-11-03T16:53:10.235115Z node 1 :PQ_PARTITION_CHOOSER INFO: partition_chooser_impl__abstract_chooser_actor.h:312: TPartitionChooser [1:7568543220353479319:3167] (SourceId=test-message-group-id, PreferedPartition=(NULL)) ReplyError: kqp error Marker# PQ50 : Response {
  SessionId: "ydb://session/3?node_id=1&id=ZmI0OWFiZDEtNzc2NTg5YzEtYzQ0NmRmODktZmIxOTYwMGY="
  QueryIssues {
    message: "Failed to resolve tablet: 72075186224037891 after several retries."
    severity: 1
  }
  TxMeta {
    id: "01k95a61f84xfzy349sjxvtanq"
  }
}
YdbStatus: UNAVAILABLE
ConsumedRu: 1
2025-11-03T16:53:10.235258Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 36 reason: kqp error Marker# PQ50 : Response {
  SessionId: "ydb://session/3?node_id=1&id=ZmI0OWFiZDEtNzc2NTg5YzEtYzQ0NmRmODktZmIxOTYwMGY="
  QueryIssues {
    message: "Failed to resolve tablet: 72075186224037891 after several retries."
    severity: 1
  }
  TxMeta {
    id: "01k95a61f84xfzy349sjxvtanq"
  }
}
YdbStatus: UNAVAILABLE
ConsumedRu: 1
 sessionId: 
2025-11-03T16:53:10.235582Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 36 sessionId:  is DEAD
Test retry state: get retry delay
2025-11-03T16:53:10.238894Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: kqp error Marker# PQ50 : Response {   SessionId: "ydb://session/3?node_id=1&id=ZmI0OWFiZDEtNzc2NTg5YzEtYzQ0NmRmODktZmIxOTYwMGY="   QueryIssues {     message: "Failed to resolve tablet: 72075186224037891 after several retries."     severity: 1   }   TxMeta {     id: "01k95a61f84xfzy349sjxvtanq"   } } YdbStatus: UNAVAILABLE ConsumedRu: 1 , code: 500001 
2025-11-03T16:53:10.238933Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Write session will restart in 2.000000s
2025-11-03T16:53:10.239022Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Write session: Do CDS request
2025-11-03T16:53:10.239058Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Do schedule cds request after 2000 ms
2025-11-03T16:53:12.242633Z :INFO: [/Root] MessageGroupId [test-message-group-id] Running cds request ms
2025-11-03T16:53:12.257732Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Got CDS response: 
write_sessions_clusters { clusters { endpoint: "localhost:1567" name: "dc1" available: true } primary_cluster_selection_reason: CLIENT_LOCATION } version: 1
2025-11-03T16:53:12.257788Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Start write session. Will connect to endpoint: localhost:1567
2025-11-03T16:53:12.262448Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" }
2025-11-03T16:53:12.263191Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-11-03T16:53:12.263219Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 37
2025-11-03T16:53:12.263626Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 37 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" }
2025-11-03T16:53:12.263742Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 37 topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" from ipv6:[::1]:34482
2025-11-03T16:53:12.263757Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=37 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:34482 proto=v1  topic=test-topic durationSec=0
2025-11-03T16:53:12.263766Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-11-03T16:53:12.269243Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 37 sessionId:  describe result for acl check
2025-11-03T16:53:12.269384Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-11-03T16:53:12.269394Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-11-03T16:53:12.269404Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-11-03T16:53:12.269420Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7568543233238381387:3184] (SourceId=test-message-group-id, PreferedPartition=(NULL)) StartKqpSession
2025-11-03T16:53:12.272324Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7568543233238381387:3184] (SourceId=test-message-group-id, PreferedPartition=(NULL)) Select from the table
2025-11-03T16:53:12.716092Z node 1 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976715830. Failed to resolve tablet: 72075186224037890 after several retries.
2025-11-03T16:53:12.716236Z node 1 :KQP_EXECUTER WARN: kqp_executer_impl.h:245: ActorId: [1:7568543228943414043:3174] TxId: 281474976715830. Ctx: { TraceId: 01k95a6367dj1n3arxt866bnxb, Database: /Root, SessionId: ydb://session/3?node_id=1&id=NTU5ZTQ3ZjQtYTE3MmIzMjMtMzZmYWNhODItM2M5Y2Q5OGM=, PoolId: default}. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037890 after several retries.
2025-11-03T16:53:12.716517Z node 1 :KQP_SESSION WARN: kqp_session_actor.cpp:2987: SessionId: ydb://session/3?node_id=1&id=NTU5ZTQ3ZjQtYTE3MmIzMjMtMzZmYWNhODItM2M5Y2Q5OGM=, ActorId: [1:7568543224648446727:3174], ActorState: ExecuteState, TraceId: 01k95a6367dj1n3arxt866bnxb, Create QueryResponse for error on request, msg: 
2025-11-03T16:53:12.718719Z node 1 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Failed to resolve tablet: 72075186224037890 after several retries." severity: 1 } TxMeta { id: "01k95a63x0bamyakgcrtx7jnsk" } } YdbStatus: UNAVAILABLE ConsumedRu: 480 }
2025-11-03T16:53:12.860142Z node 2 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976720745. Failed to resolve tablet: 72075186224037888 after several retries.
2025-11-03T16:53:12.860291Z node 2 :KQP_EXECUTER WARN: kqp_executer_impl.h:245: ActorId: [2:7568543228940956325:2856] TxId: 281474976720745. Ctx: { TraceId: 01k95a63bjbm20p1dyv3b22k9t, Database: /Root, SessionId: ydb://session/3?node_id=2&id=OGI5OWIyMTgtOTcyNmI3ZDAtMTYwMzBmZjItYWZhNDAyOTg=, PoolId: default}. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037888 after several retries.
2025-11-03T16:53:12.860591Z node 2 :KQP_SESSION WARN: kqp_session_actor.cpp:2987: SessionId: ydb://session/3?node_id=2&id=OGI5OWIyMTgtOTcyNmI3ZDAtMTYwMzBmZjItYWZhNDAyOTg=, ActorId: [2:7568543228940956312:2856], ActorState: ExecuteState, TraceId: 01k95a63bjbm20p1dyv3b22k9t, Create QueryResponse for error on request, msg: 
2025-11-03T16:53:12.863156Z node 2 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Failed to resolve tablet: 72075186224037888 after several retries." severity: 1 } TxMeta { id: "01k95a640w1fxaw5t072rj9b6x" } } YdbStatus: UNAVAILABLE ConsumedRu: 438 }
2025-11-03T16:53:13.264368Z node 1 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976715831. Failed to resolve tablet: 72075186224037891 after several retries.
2025-11-03T16:53:13.264497Z node 1 :KQP_EXECUTER WARN: kqp_executer_impl.h:245: ActorId: [1:7568543233238381398:3186] TxId: 281474976715831. Ctx: { TraceId: 01k95a64eg6dcspbr7qggf812v, Database: /Root, SessionId: ydb://session/3?node_id=1&id=Mzg3YzIzYjQtYzY1NjcyOTgtYmM3YjE3YmYtYmVhMWNhZTc=, PoolId: default}. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037891 after several retries.
2025-11-03T16:53:13.264745Z node 1 :KQP_SESSION WARN: kqp_session_actor.cpp:2987: SessionId: ydb://session/3?node_id=1&id=Mzg3YzIzYjQtYzY1NjcyOTgtYmM3YjE3YmYtYmVhMWNhZTc=, ActorId: [1:7568543233238381388:3186], ActorState: ExecuteState, TraceId: 01k95a64eg6dcspbr7qggf812v, Create QueryResponse for error on request, msg: 
2025-11-03T16:53:13.266034Z node 1 :PQ_PARTITION_CHOOSER INFO: partition_chooser_impl__abstract_chooser_actor.h:312: TPartitionChooser [1:7568543233238381387:3184] (SourceId=test-message-group-id, PreferedPartition=(NULL)) ReplyError: kqp error Marker# PQ50 : Response {
  SessionId: "ydb://session/3?node_id=1&id=Mzg3YzIzYjQtYzY1NjcyOTgtYmM3YjE3YmYtYmVhMWNhZTc="
  QueryIssues {
    message: "Failed to resolve tablet: 72075186224037891 after several retries."
    severity: 1
  }
  TxMeta {
    id: "01k95a64ej3by99s5d7fgkq63z"
  }
}
YdbStatus: UNAVAILABLE
ConsumedRu: 1
2025-11-03T16:53:13.266116Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 37 reason: kqp error Marker# PQ50 : Response {
  SessionId: "ydb://session/3?node_id=1&id=Mzg3YzIzYjQtYzY1NjcyOTgtYmM3YjE3YmYtYmVhMWNhZTc="
  QueryIssues {
    message: "Failed to resolve tablet: 72075186224037891 after several retries."
    severity: 1
  }
  TxMeta {
    id: "01k95a64ej3by99s5d7fgkq63z"
  }
}
YdbStatus: UNAVAILABLE
ConsumedRu: 1
 sessionId: 
2025-11-03T16:53:13.266524Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 37 sessionId:  is DEAD
Test retry state: get retry delay
2025-11-03T16:53:13.267327Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: kqp error Marker# PQ50 : Response {   SessionId: "ydb://session/3?node_id=1&id=Mzg3YzIzYjQtYzY1NjcyOTgtYmM3YjE3YmYtYmVhMWNhZTc="   QueryIssues {     message: "Failed to resolve tablet: 72075186224037891 after several retries."     severity: 1   }   TxMeta {     id: "01k95a64ej3by99s5d7fgkq63z"   } } YdbStatus: UNAVAILABLE ConsumedRu: 1 , code: 500001 
2025-11-03T16:53:13.267360Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Write session will restart in 2.000000s
2025-11-03T16:53:13.267449Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Write session: Do CDS request
2025-11-03T16:53:13.267482Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Do schedule cds request after 2000 ms
2025-11-03T16:53:15.272066Z :INFO: [/Root] MessageGroupId [test-message-group-id] Running cds request ms
2025-11-03T16:53:15.277492Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Got CDS response: 
write_sessions_clusters { clusters { endpoint: "localhost:1567" name: "dc1" available: true } primary_cluster_selection_reason: CLIENT_LOCATION } version: 1
2025-11-03T16:53:15.277547Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Start write session. Will connect to endpoint: localhost:1567
2025-11-03T16:53:15.281735Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" }
2025-11-03T16:53:15.280883Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-11-03T16:53:15.280921Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 38
2025-11-03T16:53:15.282339Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 38 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" }
2025-11-03T16:53:15.282494Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 38 topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" from ipv6:[::1]:34482
2025-11-03T16:53:15.282512Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=38 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:34482 proto=v1  topic=test-topic durationSec=0
2025-11-03T16:53:15.282524Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-11-03T16:53:15.289504Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 38 sessionId:  describe result for acl check
2025-11-03T16:53:15.289647Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-11-03T16:53:15.289658Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-11-03T16:53:15.289670Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-11-03T16:53:15.289690Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7568543246123283458:3201] (SourceId=test-message-group-id, PreferedPartition=(NULL)) StartKqpSession
2025-11-03T16:53:15.292732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7568543246123283458:3201] (SourceId=test-message-group-id, PreferedPartition=(NULL)) Select from the table
2025-11-03T16:53:15.370375Z node 1 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976715834. Failed to resolve tablet: 72075186224037890 after several retries.
2025-11-03T16:53:15.370529Z node 1 :KQP_EXECUTER WARN: kqp_executer_impl.h:245: ActorId: [1:7568543241828316095:3191] TxId: 281474976715834. Ctx: { TraceId: 01k95a65vyaw2wzq935cgcxtbx, Database: /Root, SessionId: ydb://session/3?node_id=1&id=MTgzZmI0NWItNzRkOWQyOTItNjMzZjg2MzgtYjE4MjEzNTc=, PoolId: default}. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037890 after several retries.
2025-11-03T16:53:15.370902Z node 1 :KQP_SESSION WARN: kqp_session_actor.cpp:2987: SessionId: ydb://session/3?node_id=1&id=MTgzZmI0NWItNzRkOWQyOTItNjMzZjg2MzgtYjE4MjEzNTc=, ActorId: [1:7568543237533348774:3191], ActorState: ExecuteState, TraceId: 01k95a65vyaw2wzq935cgcxtbx, Create QueryResponse for error on request, msg: 
2025-11-03T16:53:15.376839Z node 1 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Failed to resolve tablet: 72075186224037890 after several retries." severity: 1 } TxMeta { id: "01k95a66fz747hfma2dcm9pf12" } } YdbStatus: UNAVAILABLE ConsumedRu: 412 }
2025-11-03T16:53:15.588084Z node 2 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976720747. Failed to resolve tablet: 72075186224037890 after several retries.
2025-11-03T16:53:15.588235Z node 2 :KQP_EXECUTER WARN: kqp_executer_impl.h:245: ActorId: [2:7568543241825858297:2868] TxId: 281474976720747. Ctx: { TraceId: 01k95a660fb6xh3d2g3hpn9tpn, Database: /Root, SessionId: ydb://session/3?node_id=2&id=MWVjMmQ0MC03MzkzMGU4Ny04MjU0NWYxZC1hYjY4NmYz, PoolId: default}. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037890 after several retries.
2025-11-03T16:53:15.588528Z node 2 :KQP_SESSION WARN: kqp_session_actor.cpp:2987: SessionId: ydb://session/3?node_id=2&id=MWVjMmQ0MC03MzkzMGU4Ny04MjU0NWYxZC1hYjY4NmYz, ActorId: [2:7568543237530890988:2868], ActorState: ExecuteState, TraceId: 01k95a660fb6xh3d2g3hpn9tpn, Create QueryResponse for error on request, msg: 
2025-11-03T16:53:15.589804Z node 2 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Failed to resolve tablet: 72075186224037890 after several retries." severity: 1 } TxMeta { id: "01k95a66my82gxcte4r4xp8wkr" } } YdbStatus: UNAVAILABLE ConsumedRu: 427 }
2025-11-03T16:53:16.325765Z node 1 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976715835. Failed to resolve tablet: 72075186224037891 after several retries.
2025-11-03T16:53:16.325873Z node 1 :KQP_EXECUTER WARN: kqp_executer_impl.h:245: ActorId: [1:7568543246123283469:3203] TxId: 281474976715835. Ctx: { TraceId: 01k95a67cx0km4ak9ycxaa451h, Database: /Root, SessionId: ydb://session/3?node_id=1&id=YWE1MjQ5YWUtZWFjYTI0YS02MGEwYmViMi05MWIzMjY5Mw==, PoolId: default}. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037891 after several retries.
2025-11-03T16:53:16.326075Z node 1 :KQP_SESSION WARN: kqp_session_actor.cpp:2987: SessionId: ydb://session/3?node_id=1&id=YWE1MjQ5YWUtZWFjYTI0YS02MGEwYmViMi05MWIzMjY5Mw==, ActorId: [1:7568543246123283459:3203], ActorState: ExecuteState, TraceId: 01k95a67cx0km4ak9ycxaa451h, Create QueryResponse for error on request, msg: 
2025-11-03T16:53:16.327383Z node 1 :PQ_PARTITION_CHOOSER INFO: partition_chooser_impl__abstract_chooser_actor.h:312: TPartitionChooser [1:7568543246123283458:3201] (SourceId=test-message-group-id, PreferedPartition=(NULL)) ReplyError: kqp error Marker# PQ50 : Response {
  SessionId: "ydb://session/3?node_id=1&id=YWE1MjQ5YWUtZWFjYTI0YS02MGEwYmViMi05MWIzMjY5Mw=="
  QueryIssues {
    message: "Failed to resolve tablet: 72075186224037891 after several retries."
    severity: 1
  }
  TxMeta {
    id: "01k95a67d121rhqmcjctk78v9m"
  }
}
YdbStatus: UNAVAILABLE
ConsumedRu: 1
2025-11-03T16:53:16.327487Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 38 reason: kqp error Marker# PQ50 : Response {
  SessionId: "ydb://session/3?node_id=1&id=YWE1MjQ5YWUtZWFjYTI0YS02MGEwYmViMi05MWIzMjY5Mw=="
  QueryIssues {
    message: "Failed to resolve tablet: 72075186224037891 after several retries."
    severity: 1
  }
  TxMeta {
    id: "01k95a67d121rhqmcjctk78v9m"
  }
}
YdbStatus: UNAVAILABLE
ConsumedRu: 1
 sessionId: 
2025-11-03T16:53:16.329320Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 38 sessionId:  is DEAD
Test retry state: get retry delay
2025-11-03T16:53:16.330695Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: kqp error Marker# PQ50 : Response {   SessionId: "ydb://session/3?node_id=1&id=YWE1MjQ5YWUtZWFjYTI0YS02MGEwYmViMi05MWIzMjY5Mw=="   QueryIssues {     message: "Failed to resolve tablet: 72075186224037891 after several retries."     severity: 1   }   TxMeta {     id: "01k95a67d121rhqmcjctk78v9m"   } } YdbStatus: UNAVAILABLE ConsumedRu: 1 , code: 500001 
2025-11-03T16:53:16.330734Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Write session will restart in 2.000000s
2025-11-03T16:53:16.330816Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Write session: Do CDS request
2025-11-03T16:53:16.330852Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Do schedule cds request after 2000 ms
2025-11-03T16:53:17.878128Z node 1 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976715838. Failed to resolve tablet: 72075186224037890 after several retries.
2025-11-03T16:53:17.878250Z node 1 :KQP_EXECUTER WARN: kqp_executer_impl.h:245: ActorId: [1:7568543250418250846:3207] TxId: 281474976715838. Ctx: { TraceId: 01k95a68eva75fdthtg4vcffm6, Database: /Root, SessionId: ydb://session/3?node_id=1&id=NzZlMWIwNWYtY2ZiYjI4NjItYzFiOGE5MDctODRjOThjMGU=, PoolId: default}. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037890 after several retries.
2025-11-03T16:53:17.878571Z node 1 :KQP_SESSION WARN: kqp_session_actor.cpp:2987: SessionId: ydb://session/3?node_id=1&id=NzZlMWIwNWYtY2ZiYjI4NjItYzFiOGE5MDctODRjOThjMGU=, ActorId: [1:7568543250418250825:3207], ActorState: ExecuteState, TraceId: 01k95a68eva75fdthtg4vcffm6, Create QueryResponse for error on request, msg: 
2025-11-03T16:53:17.879763Z node 1 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Failed to resolve tablet: 72075186224037890 after several retries." severity: 1 } TxMeta { id: "01k95a68ymf98efmk8p821z2p0" } } YdbStatus: UNAVAILABLE ConsumedRu: 325 }
2025-11-03T16:53:18.331366Z :INFO: [/Root] MessageGroupId [test-message-group-id] Running cds request ms
2025-11-03T16:53:18.345443Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Got CDS response: 
write_sessions_clusters { clusters { endpoint: "localhost:1567" name: "dc1" available: true } primary_cluster_selection_reason: CLIENT_LOCATION } version: 1
2025-11-03T16:53:18.345501Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Start write session. Will connect to endpoint: localhost:1567
2025-11-03T16:53:18.349327Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" }
2025-11-03T16:53:18.349795Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-11-03T16:53:18.349828Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 39
2025-11-03T16:53:18.350414Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 39 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" }
2025-11-03T16:53:18.350549Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 39 topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" from ipv6:[::1]:34482
2025-11-03T16:53:18.350565Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=39 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:34482 proto=v1  topic=test-topic durationSec=0
2025-11-03T16:53:18.350574Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-11-03T16:53:18.351941Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 39 sessionId:  describe result for acl check
2025-11-03T16:53:18.352076Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-11-03T16:53:18.352088Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-11-03T16:53:18.352098Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-11-03T16:53:18.352113Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7568543259008185525:3218] (SourceId=test-message-group-id, PreferedPartition=(NULL)) StartKqpSession
2025-11-03T16:53:18.354613Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7568543259008185525:3218] (SourceId=test-message-group-id, PreferedPartition=(NULL)) Select from the table
2025-11-03T16:53:18.632101Z node 2 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976720749. Failed to resolve tablet: 72075186224037888 after several retries.
2025-11-03T16:53:18.632231Z node 2 :KQP_EXECUTER WARN: kqp_executer_impl.h:245: ActorId: [2:7568543254710760270:2878] TxId: 281474976720749. Ctx: { TraceId: 01k95a68nkce838ef8qrrztzc3, Database: /Root, SessionId: ydb://session/3?node_id=2&id=ZDViYThiODctMTcwMDgyMjMtNDc3YWIwMjMtY2RhN2ZhZTQ=, PoolId: default}. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037888 after several retries.
2025-11-03T16:53:18.632507Z node 2 :KQP_SESSION WARN: kqp_session_actor.cpp:2987: SessionId: ydb://session/3?node_id=2&id=ZDViYThiODctMTcwMDgyMjMtNDc3YWIwMjMtY2RhN2ZhZTQ=, ActorId: [2:7568543250415792957:2878], ActorState: ExecuteState, TraceId: 01k95a68nkce838ef8qrrztzc3, Create QueryResponse for error on request, msg: 
2025-11-03T16:53:18.633646Z node 2 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Failed to resolve tablet: 72075186224037888 after several retries." severity: 1 } TxMeta { id: "01k95a69mc177cagtndkc711cs" } } YdbStatus: UNAVAILABLE ConsumedRu: 652 }
2025-11-03T16:53:19.365285Z node 1 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976715840. Failed to resolve tablet: 72075186224037891 after several retries.
2025-11-03T16:53:19.365404Z node 1 :KQP_EXECUTER WARN: kqp_executer_impl.h:245: ActorId: [1:7568543259008185536:3220] TxId: 281474976715840. Ctx: { TraceId: 01k95a6acj9cyeqy33xgsrq9hn, Database: /Root, SessionId: ydb://session/3?node_id=1&id=OTM4M2E5Y2EtMzc0ZDM5NWMtMWJiMTA3MjktYzQ3NWU1Y2I=, PoolId: default}. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037891 after several retries.
2025-11-03T16:53:19.365638Z node 1 :KQP_SESSION WARN: kqp_session_actor.cpp:2987: SessionId: ydb://session/3?node_id=1&id=OTM4M2E5Y2EtMzc0ZDM5NWMtMWJiMTA3MjktYzQ3NWU1Y2I=, ActorId: [1:7568543259008185526:3220], ActorState: ExecuteState, TraceId: 01k95a6acj9cyeqy33xgsrq9hn, Create QueryResponse for error on request, msg: 
2025-11-03T16:53:19.367186Z node 1 :PQ_PARTITION_CHOOSER INFO: partition_chooser_impl__abstract_chooser_actor.h:312: TPartitionChooser [1:7568543259008185525:3218] (SourceId=test-message-group-id, PreferedPartition=(NULL)) ReplyError: kqp error Marker# PQ50 : Response {
  SessionId: "ydb://session/3?node_id=1&id=OTM4M2E5Y2EtMzc0ZDM5NWMtMWJiMTA3MjktYzQ3NWU1Y2I="
  QueryIssues {
    message: "Failed to resolve tablet: 72075186224037891 after several retries."
    severity: 1
  }
  TxMeta {
    id: "01k95a6ackexhtstrx2nz1kz3f"
  }
}
YdbStatus: UNAVAILABLE
ConsumedRu: 1
2025-11-03T16:53:19.367271Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 39 reason: kqp error Marker# PQ50 : Response {
  SessionId: "ydb://session/3?node_id=1&id=OTM4M2E5Y2EtMzc0ZDM5NWMtMWJiMTA3MjktYzQ3NWU1Y2I="
  QueryIssues {
    message: "Failed to resolve tablet: 72075186224037891 after several retries."
    severity: 1
  }
  TxMeta {
    id: "01k95a6ackexhtstrx2nz1kz3f"
  }
}
YdbStatus: UNAVAILABLE
ConsumedRu: 1
 sessionId: 
2025-11-03T16:53:19.367640Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 39 sessionId:  is DEAD
Test retry state: get retry delay
2025-11-03T16:53:19.372286Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: kqp error Marker# PQ50 : Response {   SessionId: "ydb://session/3?node_id=1&id=OTM4M2E5Y2EtMzc0ZDM5NWMtMWJiMTA3MjktYzQ3NWU1Y2I="   QueryIssues {     message: "Failed to resolve tablet: 72075186224037891 after several retries."     severity: 1   }   TxMeta {     id: "01k95a6ackexhtstrx2nz1kz3f"   } } YdbStatus: UNAVAILABLE ConsumedRu: 1 , code: 500001 
2025-11-03T16:53:19.372327Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Write session will restart in 2.000000s
2025-11-03T16:53:19.372419Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Write session: Do CDS request
2025-11-03T16:53:19.372451Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Do schedule cds request after 2000 ms
2025-11-03T16:53:20.620848Z node 1 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976715842. Failed to resolve tablet: 72075186224037890 after several retries.
2025-11-03T16:53:20.620960Z node 1 :KQP_EXECUTER WARN: kqp_executer_impl.h:245: ActorId: [1:7568543263303152897:3223] TxId: 281474976715842. Ctx: { TraceId: 01k95a6ax7fd02c5swjj9wwwvp, Database: /Root, SessionId: ydb://session/3?node_id=1&id=NTFmZDExNjktZDQzNTExYmUtNDZkYjcwNGItYWY5MzFkOWQ=, PoolId: default}. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037890 after several retries.
2025-11-03T16:53:20.621221Z node 1 :KQP_SESSION WARN: kqp_session_actor.cpp:2987: SessionId: ydb://session/3?node_id=1&id=NTFmZDExNjktZDQzNTExYmUtNDZkYjcwNGItYWY5MzFkOWQ=, ActorId: [1:7568543259008185559:3223], ActorState: ExecuteState, TraceId: 01k95a6ax7fd02c5swjj9wwwvp, Create QueryResponse for error on request, msg: 
2025-11-03T16:53:20.622652Z node 1 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Failed to resolve tablet: 72075186224037890 after several retries." severity: 1 } TxMeta { id: "01k95a6bkg80pnz8qsyvs6yhcq" } } YdbStatus: UNAVAILABLE ConsumedRu: 469 }
2025-11-03T16:53:21.373319Z :INFO: [/Root] MessageGroupId [test-message-group-id] Running cds request ms
2025-11-03T16:53:21.384228Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Got CDS response: 
write_sessions_clusters { clusters { endpoint: "localhost:1567" name: "dc1" available: true } primary_cluster_selection_reason: CLIENT_LOCATION } version: 1
2025-11-03T16:53:21.384293Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Start write session. Will connect to endpoint: localhost:1567
2025-11-03T16:53:21.388465Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" }
2025-11-03T16:53:21.390294Z node 2 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976720751. Failed to resolve tablet: 72075186224037890 after several retries.
2025-11-03T16:53:21.390432Z node 2 :KQP_EXECUTER WARN: kqp_executer_impl.h:245: ActorId: [2:7568543267595662243:2890] TxId: 281474976720751. Ctx: { TraceId: 01k95a6bmtdev8xqffpmasndvm, Database: /Root, SessionId: ydb://session/3?node_id=2&id=NGE0OWFmMTUtNzE1ZDNkNDgtZGVkYzliNzAtOGYyZDIyYjA=, PoolId: default}. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037890 after several retries.
2025-11-03T16:53:21.390690Z node 2 :KQP_SESSION WARN: kqp_session_actor.cpp:2987: SessionId: ydb://session/3?node_id=2&id=NGE0OWFmMTUtNzE1ZDNkNDgtZGVkYzliNzAtOGYyZDIyYjA=, ActorId: [2:7568543263300694928:2890], ActorState: ExecuteState, TraceId: 01k95a6bmtdev8xqffpmasndvm, Create QueryResponse for error on request, msg: 
2025-11-03T16:53:21.389550Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-11-03T16:53:21.389586Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 40
2025-11-03T16:53:21.396202Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 40 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" }
2025-11-03T16:53:21.396404Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 40 topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" from ipv6:[::1]:34482
2025-11-03T16:53:21.396424Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=40 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:34482 proto=v1  topic=test-topic durationSec=0
2025-11-03T16:53:21.396437Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-11-03T16:53:21.400755Z node 2 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Failed to resolve tablet: 72075186224037890 after several retries." severity: 1 } TxMeta { id: "01k95a6c909sm3sqcs6qyvdfnx" } } YdbStatus: UNAVAILABLE ConsumedRu: 407 }
2025-11-03T16:53:21.405370Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 40 sessionId:  describe result for acl check
2025-11-03T16:53:21.405524Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-11-03T16:53:21.405537Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-11-03T16:53:21.405545Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-11-03T16:53:21.405564Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7568543271893087581:3237] (SourceId=test-message-group-id, PreferedPartition=(NULL)) StartKqpSession
2025-11-03T16:53:21.409101Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7568543271893087581:3237] (SourceId=test-message-group-id, PreferedPartition=(NULL)) Select from the table
2025-11-03T16:53:22.420094Z node 1 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976715844. Failed to resolve tablet: 72075186224037891 after several retries.
2025-11-03T16:53:22.420221Z node 1 :KQP_EXECUTER WARN: kqp_executer_impl.h:245: ActorId: [1:7568543271893087592:3239] TxId: 281474976715844. Ctx: { TraceId: 01k95a6dc1cnhxsgxn9avvtz77, Database: /Root, SessionId: ydb://session/3?node_id=1&id=NDYwZTUyYTgtMzI2MzQwOTItZmJmYTA0ZGMtYTI4NmY4M2M=, PoolId: default}. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037891 after several retries.
2025-11-03T16:53:22.420441Z node 1 :KQP_SESSION WARN: kqp_session_actor.cpp:2987: SessionId: ydb://session/3?node_id=1&id=NDYwZTUyYTgtMzI2MzQwOTItZmJmYTA0ZGMtYTI4NmY4M2M=, ActorId: [1:7568543271893087582:3239], ActorState: ExecuteState, TraceId: 01k95a6dc1cnhxsgxn9avvtz77, Create QueryResponse for error on request, msg: 
2025-11-03T16:53:22.421865Z node 1 :PQ_PARTITION_CHOOSER INFO: partition_chooser_impl__abstract_chooser_actor.h:312: TPartitionChooser [1:7568543271893087581:3237] (SourceId=test-message-group-id, PreferedPartition=(NULL)) ReplyError: kqp error Marker# PQ50 : Response {
  SessionId: "ydb://session/3?node_id=1&id=NDYwZTUyYTgtMzI2MzQwOTItZmJmYTA0ZGMtYTI4NmY4M2M="
  QueryIssues {
    message: "Failed to resolve tablet: 72075186224037891 after several retries."
    severity: 1
  }
  TxMeta {
    id: "01k95a6dc5d0nhwhkte80jv7de"
  }
}
YdbStatus: UNAVAILABLE
ConsumedRu: 1
2025-11-03T16:53:22.421949Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 40 reason: kqp error Marker# PQ50 : Response {
  SessionId: "ydb://session/3?node_id=1&id=NDYwZTUyYTgtMzI2MzQwOTItZmJmYTA0ZGMtYTI4NmY4M2M="
  QueryIssues {
    message: "Failed to resolve tablet: 72075186224037891 after several retries."
    severity: 1
  }
  TxMeta {
    id: "01k95a6dc5d0nhwhkte80jv7de"
  }
}
YdbStatus: UNAVAILABLE
ConsumedRu: 1
 sessionId: 
2025-11-03T16:53:22.422325Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 40 sessionId:  is DEAD
Test retry state: get retry delay
2025-11-03T16:53:22.428221Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: kqp error Marker# PQ50 : Response {   SessionId: "ydb://session/3?node_id=1&id=NDYwZTUyYTgtMzI2MzQwOTItZmJmYTA0ZGMtYTI4NmY4M2M="   QueryIssues {     message: "Failed to resolve tablet: 72075186224037891 after several retries."     severity: 1   }   TxMeta {     id: "01k95a6dc5d0nhwhkte80jv7de"   } } YdbStatus: UNAVAILABLE ConsumedRu: 1 , code: 500001 
2025-11-03T16:53:22.428261Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Write session will restart in 2.000000s
2025-11-03T16:53:22.428344Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Write session: Do CDS request
2025-11-03T16:53:22.428380Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Do schedule cds request after 2000 ms
2025-11-03T16:53:23.376775Z node 1 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976715845. Failed to resolve tablet: 72075186224037888 after several retries.
2025-11-03T16:53:23.376894Z node 1 :KQP_EXECUTER WARN: kqp_executer_impl.h:245: ActorId: [1:7568543276188054946:3242] TxId: 281474976715845. Ctx: { TraceId: 01k95a6djv4m94vb9994neddxh, Database: /Root, SessionId: ydb://session/3?node_id=1&id=YmZkZTA0MjUtNjM5YmUxYmEtNzQxZTc2ODktYzQ2YmFmZDc=, PoolId: default}. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037888 after several retries.
2025-11-03T16:53:23.377181Z node 1 :KQP_SESSION WARN: kqp_session_actor.cpp:2987: SessionId: ydb://session/3?node_id=1&id=YmZkZTA0MjUtNjM5YmUxYmEtNzQxZTc2ODktYzQ2YmFmZDc=, ActorId: [1:7568543271893087604:3242], ActorState: ExecuteState, TraceId: 01k95a6djv4m94vb9994neddxh, Create QueryResponse for error on request, msg: 
2025-11-03T16:53:23.378709Z node 1 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Failed to resolve tablet: 72075186224037888 after several retries." severity: 1 } TxMeta { id: "01k95a6ea8558ev2cy2p5n6xgb" } } YdbStatus: UNAVAILABLE ConsumedRu: 491 }
2025-11-03T16:53:24.117237Z node 2 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976720753. Failed to resolve tablet: 72075186224037890 after several retries.
2025-11-03T16:53:24.117360Z node 2 :KQP_EXECUTER WARN: kqp_executer_impl.h:245: ActorId: [2:7568543280480564215:2904] TxId: 281474976720753. Ctx: { TraceId: 01k95a6eb792wf9ptfkpr4mg9k, Database: /Root, SessionId: ydb://session/3?node_id=2&id=YTAwYzk4NWYtMWI2NzNjMDAtMmQ0NDYwNGYtZGU3OGU3YmQ=, PoolId: default}. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037890 after several retries.
2025-11-03T16:53:24.117616Z node 2 :KQP_SESSION WARN: kqp_session_actor.cpp:2987: SessionId: ydb://session/3?node_id=2&id=YTAwYzk4NWYtMWI2NzNjMDAtMmQ0NDYwNGYtZGU3OGU3YmQ=, ActorId: [2:7568543276185596902:2904], ActorState: ExecuteState, TraceId: 01k95a6eb792wf9ptfkpr4mg9k, Create QueryResponse for error on request, msg: 
2025-11-03T16:53:24.118973Z node 2 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Failed to resolve tablet: 72075186224037890 after several retries." severity: 1 } TxMeta { id: "01k95a6ezg21rqcgzd8kfam7kb" } } YdbStatus: UNAVAILABLE ConsumedRu: 420 }
2025-11-03T16:53:24.436048Z :INFO: [/Root] MessageGroupId [test-message-group-id] Running cds request ms
2025-11-03T16:53:24.439815Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Got CDS response: 
write_sessions_clusters { clusters { endpoint: "localhost:1567" name: "dc1" available: true } primary_cluster_selection_reason: CLIENT_LOCATION } version: 1
2025-11-03T16:53:24.439864Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Start write session. Will connect to endpoint: localhost:1567
2025-11-03T16:53:24.449040Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" }
2025-11-03T16:53:24.449761Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-11-03T16:53:24.449804Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 41
2025-11-03T16:53:24.450204Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 41 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" }
2025-11-03T16:53:24.450340Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 41 topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" from ipv6:[::1]:34482
2025-11-03T16:53:24.450356Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=41 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:34482 proto=v1  topic=test-topic durationSec=0
2025-11-03T16:53:24.450367Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-11-03T16:53:24.451879Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 41 sessionId:  describe result for acl check
2025-11-03T16:53:24.452008Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-11-03T16:53:24.452020Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-11-03T16:53:24.452029Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-11-03T16:53:24.452044Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7568543284777989647:3260] (SourceId=test-message-group-id, PreferedPartition=(NULL)) StartKqpSession
2025-11-03T16:53:24.454377Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7568543284777989647:3260] (SourceId=test-message-group-id, PreferedPartition=(NULL)) Select from the table
2025-11-03T16:53:25.473219Z node 1 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976715848. Failed to resolve tablet: 72075186224037891 after several retries.
2025-11-03T16:53:25.473327Z node 1 :KQP_EXECUTER WARN: kqp_executer_impl.h:245: ActorId: [1:7568543284777989658:3262] TxId: 281474976715848. Ctx: { TraceId: 01k95a6gb6471vhcxrrgzxqnk8, Database: /Root, SessionId: ydb://session/3?node_id=1&id=ZjNmOWU2MTYtNDUxZDdmZDQtNGQyNTFlYmQtYjNhMTQwNjY=, PoolId: default}. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037891 after several retries.
2025-11-03T16:53:25.473545Z node 1 :KQP_SESSION WARN: kqp_session_actor.cpp:2987: SessionId: ydb://session/3?node_id=1&id=ZjNmOWU2MTYtNDUxZDdmZDQtNGQyNTFlYmQtYjNhMTQwNjY=, ActorId: [1:7568543284777989648:3262], ActorState: ExecuteState, TraceId: 01k95a6gb6471vhcxrrgzxqnk8, Create QueryResponse for error on request, msg: 
Test retry state: get retry delay
2025-11-03T16:53:25.478208Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: kqp error Marker# PQ50 : Response {   SessionId: "ydb://session/3?node_id=1&id=ZjNmOWU2MTYtNDUxZDdmZDQtNGQyNTFlYmQtYjNhMTQwNjY="   QueryIssues {     message: "Failed to resolve tablet: 72075186224037891 after several retries."     severity: 1   }   TxMeta {     id: "01k95a6gb7ackzcqfk0tp45x2h"   } } YdbStatus: UNAVAILABLE ConsumedRu: 1 , code: 500001 
2025-11-03T16:53:25.478262Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Write session will restart in 2.000000s
2025-11-03T16:53:25.478385Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Write session: Do CDS request
2025-11-03T16:53:25.478440Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Do schedule cds request after 2000 ms
2025-11-03T16:53:25.474851Z node 1 :PQ_PARTITION_CHOOSER INFO: partition_chooser_impl__abstract_chooser_actor.h:312: TPartitionChooser [1:7568543284777989647:3260] (SourceId=test-message-group-id, PreferedPartition=(NULL)) ReplyError: kqp error Marker# PQ50 : Response {
  SessionId: "ydb://session/3?node_id=1&id=ZjNmOWU2MTYtNDUxZDdmZDQtNGQyNTFlYmQtYjNhMTQwNjY="
  QueryIssues {
    message: "Failed to resolve tablet: 72075186224037891 after several retries."
    severity: 1
  }
  TxMeta {
    id: "01k95a6gb7ackzcqfk0tp45x2h"
  }
}
YdbStatus: UNAVAILABLE
ConsumedRu: 1
2025-11-03T16:53:25.474946Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 41 reason: kqp error Marker# PQ50 : Response {
  SessionId: "ydb://session/3?node_id=1&id=ZjNmOWU2MTYtNDUxZDdmZDQtNGQyNTFlYmQtYjNhMTQwNjY="
  QueryIssues {
    message: "Failed to resolve tablet: 72075186224037891 after several retries."
    severity: 1
  }
  TxMeta {
    id: "01k95a6gb7ackzcqfk0tp45x2h"
  }
}
YdbStatus: UNAVAILABLE
ConsumedRu: 1
 sessionId: 
2025-11-03T16:53:25.475313Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 41 sessionId:  is DEAD
2025-11-03T16:53:25.852881Z node 1 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976715849. Failed to resolve tablet: 72075186224037890 after several retries.
2025-11-03T16:53:25.852997Z node 1 :KQP_EXECUTER WARN: kqp_executer_impl.h:245: ActorId: [1:7568543284777989674:3253] TxId: 281474976715849. Ctx: { TraceId: 01k95a6g8x874wnym5g748gdfm, Database: /Root, SessionId: ydb://session/3?node_id=1&id=NjI1N2I0OGUtZTE1OGUzYjAtMTVjOTM1ODctN2M3MDg3MTc=, PoolId: default}. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037890 after several retries.
2025-11-03T16:53:25.853250Z node 1 :KQP_SESSION WARN: kqp_session_actor.cpp:2987: SessionId: ydb://session/3?node_id=1&id=NjI1N2I0OGUtZTE1OGUzYjAtMTVjOTM1ODctN2M3MDg3MTc=, ActorId: [1:7568543284777989631:3253], ActorState: ExecuteState, TraceId: 01k95a6g8x874wnym5g748gdfm, Create QueryResponse for error on request, msg: 
2025-11-03T16:53:25.854800Z node 1 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Failed to resolve tablet: 72075186224037890 after several retries." severity: 1 } TxMeta { id: "01k95a6gpr79rktsbgabx89rd5" } } YdbStatus: UNAVAILABLE ConsumedRu: 290 }
2025-11-03T16:53:27.041090Z node 2 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976720755. Failed to resolve tablet: 72075186224037890 after several retries.
2025-11-03T16:53:27.041203Z node 2 :KQP_EXECUTER WARN: kqp_executer_impl.h:245: ActorId: [2:7568543289070498891:2916] TxId: 281474976720755. Ctx: { TraceId: 01k95a6h07ar6ntjrt5sbja14w, Database: /Root, SessionId: ydb://session/3?node_id=2&id=ZWE3ZmEwOGQtOGM2MDk2MDktM2Q0ZGNmNWMtY2Q2NWZmOTA=, PoolId: default}. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037890 after several retries.
2025-11-03T16:53:27.041446Z node 2 :KQP_SESSION WARN: kqp_session_actor.cpp:2987: SessionId: ydb://session/3?node_id=2&id=ZWE3ZmEwOGQtOGM2MDk2MDktM2Q0ZGNmNWMtY2Q2NWZmOTA=, ActorId: [2:7568543289070498873:2916], ActorState: ExecuteState, TraceId: 01k95a6h07ar6ntjrt5sbja14w, Create QueryResponse for error on request, msg: 
2025-11-03T16:53:27.042748Z node 2 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Failed to resolve tablet: 72075186224037890 after several retries." severity: 1 } TxMeta { id: "01k95a6hva4qzdqbmbhnf7pbvd" } } YdbStatus: UNAVAILABLE ConsumedRu: 567 }
2025-11-03T16:53:27.484057Z :INFO: [/Root] MessageGroupId [test-message-group-id] Running cds request ms
2025-11-03T16:53:27.493776Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Got CDS response: 
write_sessions_clusters { clusters { endpoint: "localhost:1567" name: "dc1" available: true } primary_cluster_selection_reason: CLIENT_LOCATION } version: 1
2025-11-03T16:53:27.493828Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Start write session. Will connect to endpoint: localhost:1567
2025-11-03T16:53:27.500285Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" }
2025-11-03T16:53:27.501118Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-11-03T16:53:27.501149Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 42
2025-11-03T16:53:27.501589Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 42 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" }
2025-11-03T16:53:27.501713Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 42 topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" from ipv6:[::1]:34482
2025-11-03T16:53:27.501729Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=42 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:34482 proto=v1  topic=test-topic durationSec=0
2025-11-03T16:53:27.501738Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-11-03T16:53:27.509276Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 42 sessionId:  describe result for acl check
2025-11-03T16:53:27.509417Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-11-03T16:53:27.509429Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-11-03T16:53:27.509439Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-11-03T16:53:27.509455Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7568543297662891720:3277] (SourceId=test-message-group-id, PreferedPartition=(NULL)) StartKqpSession
2025-11-03T16:53:27.520456Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7568543297662891720:3277] (SourceId=test-message-group-id, PreferedPartition=(NULL)) Select from the table
2025-11-03T16:53:28.474149Z node 1 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976715852. Failed to resolve tablet: 72075186224037888 after several retries.
2025-11-03T16:53:28.474259Z node 1 :KQP_EXECUTER WARN: kqp_executer_impl.h:245: ActorId: [1:7568543297662891705:3269] TxId: 281474976715852. Ctx: { TraceId: 01k95a6jpb6jy45zz8d1taf2wr, Database: /Root, SessionId: ydb://session/3?node_id=1&id=OThlZWZkZWQtYjJmOWY5NTItYzNlNTBmMTYtNGFkMTdlYzk=, PoolId: default}. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037888 after several retries.
2025-11-03T16:53:28.474522Z node 1 :KQP_SESSION WARN: kqp_session_actor.cpp:2987: SessionId: ydb://session/3?node_id=1&id=OThlZWZkZWQtYjJmOWY5NTItYzNlNTBmMTYtNGFkMTdlYzk=, ActorId: [1:7568543293367924382:3269], ActorState: ExecuteState, TraceId: 01k95a6jpb6jy45zz8d1taf2wr, Create QueryResponse for error on request, msg: 
2025-11-03T16:53:28.484938Z node 1 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Failed to resolve tablet: 72075186224037888 after several retries." severity: 1 } TxMeta { id: "01k95a6k684dt766hfg5grgtwd" } } YdbStatus: UNAVAILABLE ConsumedRu: 336 }
Test retry state: get retry delay
2025-11-03T16:53:28.635536Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: kqp error Marker# PQ50 : Response {   SessionId: "ydb://session/3?node_id=1&id=NzljOTU0ZGQtNmNhMTBmNTgtZTBlZTcwNWYtNjU2NGRjOWU="   QueryIssues {     message: "Failed to resolve tablet: 72075186224037891 after several retries."     severity: 1   }   TxMeta {     id: "01k95a6kb89gyvzr2j719xbm2v"   } } YdbStatus: UNAVAILABLE ConsumedRu: 1 , code: 500001 
2025-11-03T16:53:28.635576Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Write session will restart in 2.000000s
2025-11-03T16:53:28.635663Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Write session: Do CDS request
2025-11-03T16:53:28.635698Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Do schedule cds request after 2000 ms
2025-11-03T16:53:28.632102Z node 1 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976715853. Failed to resolve tablet: 72075186224037891 after several retries.
2025-11-03T16:53:28.632234Z node 1 :KQP_EXECUTER WARN: kqp_executer_impl.h:245: ActorId: [1:7568543297662891737:3279] TxId: 281474976715853. Ctx: { TraceId: 01k95a6kb0d1xjd8epmxzk5rne, Database: /Root, SessionId: ydb://session/3?node_id=1&id=NzljOTU0ZGQtNmNhMTBmNTgtZTBlZTcwNWYtNjU2NGRjOWU=, PoolId: default}. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037891 after several retries.
2025-11-03T16:53:28.632466Z node 1 :KQP_SESSION WARN: kqp_session_actor.cpp:2987: SessionId: ydb://session/3?node_id=1&id=NzljOTU0ZGQtNmNhMTBmNTgtZTBlZTcwNWYtNjU2NGRjOWU=, ActorId: [1:7568543297662891721:3279], ActorState: ExecuteState, TraceId: 01k95a6kb0d1xjd8epmxzk5rne, Create QueryResponse for error on request, msg: 
2025-11-03T16:53:28.633796Z node 1 :PQ_PARTITION_CHOOSER INFO: partition_chooser_impl__abstract_chooser_actor.h:312: TPartitionChooser [1:7568543297662891720:3277] (SourceId=test-message-group-id, PreferedPartition=(NULL)) ReplyError: kqp error Marker# PQ50 : Response {
  SessionId: "ydb://session/3?node_id=1&id=NzljOTU0ZGQtNmNhMTBmNTgtZTBlZTcwNWYtNjU2NGRjOWU="
  QueryIssues {
    message: "Failed to resolve tablet: 72075186224037891 after several retries."
    severity: 1
  }
  TxMeta {
    id: "01k95a6kb89gyvzr2j719xbm2v"
  }
}
YdbStatus: UNAVAILABLE
ConsumedRu: 1
2025-11-03T16:53:28.633875Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 42 reason: kqp error Marker# PQ50 : Response {
  SessionId: "ydb://session/3?node_id=1&id=NzljOTU0ZGQtNmNhMTBmNTgtZTBlZTcwNWYtNjU2NGRjOWU="
  QueryIssues {
    message: "Failed to resolve tablet: 72075186224037891 after several retries."
    severity: 1
  }
  TxMeta {
    id: "01k95a6kb89gyvzr2j719xbm2v"
  }
}
YdbStatus: UNAVAILABLE
ConsumedRu: 1
 sessionId: 
2025-11-03T16:53:28.634263Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 42 sessionId:  is DEAD
2025-11-03T16:53:29.821220Z node 2 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976720757. Failed to resolve tablet: 72075186224037890 after several retries.
2025-11-03T16:53:29.821330Z node 2 :KQP_EXECUTER WARN: kqp_executer_impl.h:245: ActorId: [2:7568543301955400859:2928] TxId: 281474976720757. Ctx: { TraceId: 01k95a6kvc2svfgd5863pwgyqm, Database: /Root, SessionId: ydb://session/3?node_id=2&id=OWQzNmNmZDQtMTk5YTM0YmEtODg1ZWRjMWQtYWMxN2ZjNjI=, PoolId: default}. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037890 after several retries.
2025-11-03T16:53:29.821586Z node 2 :KQP_SESSION WARN: kqp_session_actor.cpp:2987: SessionId: ydb://session/3?node_id=2&id=OWQzNmNmZDQtMTk5YTM0YmEtODg1ZWRjMWQtYWMxN2ZjNjI=, ActorId: [2:7568543301955400846:2928], ActorState: ExecuteState, TraceId: 01k95a6kvc2svfgd5863pwgyqm, Create QueryResponse for error on request, msg: 
2025-11-03T16:53:29.823064Z node 2 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Failed to resolve tablet: 72075186224037890 after several retries." severity: 1 } TxMeta { id: "01k95a6mjv24x1jwrcm46mefq8" } } YdbStatus: UNAVAILABLE ConsumedRu: 494 }
2025-11-03T16:53:30.640820Z :INFO: [/Root] MessageGroupId [test-message-group-id] Running cds request ms
2025-11-03T16:53:30.648198Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Got CDS response: 
write_sessions_clusters { clusters { endpoint: "localhost:1567" name: "dc1" available: true } primary_cluster_selection_reason: CLIENT_LOCATION } version: 1
2025-11-03T16:53:30.648251Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Start write session. Will connect to endpoint: localhost:1567
2025-11-03T16:53:30.656721Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-11-03T16:53:30.656757Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 43
2025-11-03T16:53:30.657520Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" }
2025-11-03T16:53:30.664563Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 43 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" }
2025-11-03T16:53:30.664741Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 43 topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" from ipv6:[::1]:34482
2025-11-03T16:53:30.664759Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=43 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:34482 proto=v1  topic=test-topic durationSec=0
2025-11-03T16:53:30.664771Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-11-03T16:53:30.666444Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 43 sessionId:  describe result for acl check
2025-11-03T16:53:30.666585Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-11-03T16:53:30.666596Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-11-03T16:53:30.666608Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-11-03T16:53:30.666626Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7568543310547793785:3299] (SourceId=test-message-group-id, PreferedPartition=(NULL)) StartKqpSession
2025-11-03T16:53:30.669525Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7568543310547793785:3299] (SourceId=test-message-group-id, PreferedPartition=(NULL)) Select from the table
2025-11-03T16:53:31.444100Z node 1 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976715856. Failed to resolve tablet: 72075186224037890 after several retries.
2025-11-03T16:53:31.444237Z node 1 :KQP_EXECUTER WARN: kqp_executer_impl.h:245: ActorId: [1:7568543310547793762:3289] TxId: 281474976715856. Ctx: { TraceId: 01k95a6n8f8hc515cqa3w9shd1, Database: /Root, SessionId: ydb://session/3?node_id=1&id=YTQ5ZDdjMmItNThmZjBkZDktY2FkYjg5NTktY2MyNTFjMmY=, PoolId: default}. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037890 after several retries.
2025-11-03T16:53:31.444501Z node 1 :KQP_SESSION WARN: kqp_session_actor.cpp:2987: SessionId: ydb://session/3?node_id=1&id=YTQ5ZDdjMmItNThmZjBkZDktY2FkYjg5NTktY2MyNTFjMmY=, ActorId: [1:7568543306252826438:3289], ActorState: ExecuteState, TraceId: 01k95a6n8f8hc515cqa3w9shd1, Create QueryResponse for error on request, msg: 
2025-11-03T16:53:31.445839Z node 1 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Failed to resolve tablet: 72075186224037890 after several retries." severity: 1 } TxMeta { id: "01k95a6p6g49kwjm0hv58xkav0" } } YdbStatus: UNAVAILABLE ConsumedRu: 626 }
2025-11-03T16:53:31.674199Z node 1 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976715857. Failed to resolve tablet: 72075186224037891 after several retries.
2025-11-03T16:53:31.674335Z node 1 :KQP_EXECUTER WARN: kqp_executer_impl.h:245: ActorId: [1:7568543310547793794:3301] TxId: 281474976715857. Ctx: { TraceId: 01k95a6pdd1xhzx0t13jc7vm3j, Database: /Root, SessionId: ydb://session/3?node_id=1&id=YWY5ZjUzMzgtYzA0MjE4YzktMWM3NTEwYmMtMTY1MGQ4YmI=, PoolId: default}. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037891 after several retries.
2025-11-03T16:53:31.674528Z node 1 :KQP_SESSION WARN: kqp_session_actor.cpp:2987: SessionId: ydb://session/3?node_id=1&id=YWY5ZjUzMzgtYzA0MjE4YzktMWM3NTEwYmMtMTY1MGQ4YmI=, ActorId: [1:7568543310547793786:3301], ActorState: ExecuteState, TraceId: 01k95a6pdd1xhzx0t13jc7vm3j, Create QueryResponse for error on request, msg: 
2025-11-03T16:53:31.675630Z node 1 :PQ_PARTITION_CHOOSER INFO: partition_chooser_impl__abstract_chooser_actor.h:312: TPartitionChooser [1:7568543310547793785:3299] (SourceId=test-message-group-id, PreferedPartition=(NULL)) ReplyError: kqp error Marker# PQ50 : Response {
  SessionId: "ydb://session/3?node_id=1&id=YWY5ZjUzMzgtYzA0MjE4YzktMWM3NTEwYmMtMTY1MGQ4YmI="
  QueryIssues {
    message: "Failed to resolve tablet: 72075186224037891 after several retries."
    severity: 1
  }
  TxMeta {
    id: "01k95a6pdee5x6gkrvzbdx8gn4"
  }
}
YdbStatus: UNAVAILABLE
ConsumedRu: 1
2025-11-03T16:53:31.675700Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 43 reason: kqp error Marker# PQ50 : Response {
  SessionId: "ydb://session/3?node_id=1&id=YWY5ZjUzMzgtYzA0MjE4YzktMWM3NTEwYmMtMTY1MGQ4YmI="
  QueryIssues {
    message: "Failed to resolve tablet: 72075186224037891 after several retries."
    severity: 1
  }
  TxMeta {
    id: "01k95a6pdee5x6gkrvzbdx8gn4"
  }
}
YdbStatus: UNAVAILABLE
ConsumedRu: 1
 sessionId: 
2025-11-03T16:53:31.676087Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 43 sessionId:  is DEAD
2025-11-03T16:53:31.677003Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Counters: { Errors: 0 CurrentSessionLifetimeMs: 33575 BytesWritten: 28 MessagesWritten: 4 BytesWrittenCompressed: 108 BytesInflightUncompressed: 0 BytesInflightCompressed: 54 BytesInflightTotal: 0 MessagesInflight: 2 }
Test retry state: get retry delay
2025-11-03T16:53:31.677090Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: kqp error Marker# PQ50 : Response {   SessionId: "ydb://session/3?node_id=1&id=YWY5ZjUzMzgtYzA0MjE4YzktMWM3NTEwYmMtMTY1MGQ4YmI="   QueryIssues {     message: "Failed to resolve tablet: 72075186224037891 after several retries."     severity: 1   }   TxMeta {     id: "01k95a6pdee5x6gkrvzbdx8gn4"   } } YdbStatus: UNAVAILABLE ConsumedRu: 1 , code: 500001 
2025-11-03T16:53:31.677110Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Write session will restart in 2.000000s
2025-11-03T16:53:31.677171Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Write session: Do CDS request
2025-11-03T16:53:31.677194Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Do schedule cds request after 2000 ms
2025-11-03T16:53:32.504605Z node 2 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976720759. Failed to resolve tablet: 72075186224037888 after several retries.
2025-11-03T16:53:32.504721Z node 2 :KQP_EXECUTER WARN: kqp_executer_impl.h:245: ActorId: [2:7568543314840302831:2938] TxId: 281474976720759. Ctx: { TraceId: 01k95a6pj97pg4r3y3yn5g7aa0, Database: /Root, SessionId: ydb://session/3?node_id=2&id=NTE4ZTA2MjAtNDFhNjcwMDEtOWMzYWE1OTgtM2E4YzIzNQ==, PoolId: default}. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037888 after several retries.
2025-11-03T16:53:32.504977Z node 2 :KQP_SESSION WARN: kqp_session_actor.cpp:2987: SessionId: ydb://session/3?node_id=2&id=NTE4ZTA2MjAtNDFhNjcwMDEtOWMzYWE1OTgtM2E4YzIzNQ==, ActorId: [2:7568543310545335517:2938], ActorState: ExecuteState, TraceId: 01k95a6pj97pg4r3y3yn5g7aa0, Create QueryResponse for error on request, msg: 
2025-11-03T16:53:32.506213Z node 2 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Failed to resolve tablet: 72075186224037888 after several retries." severity: 1 } TxMeta { id: "01k95a6q6mbxc7z20n8krp17ed" } } YdbStatus: UNAVAILABLE ConsumedRu: 422 }
2025-11-03T16:53:33.680236Z :INFO: [/Root] MessageGroupId [test-message-group-id] Running cds request ms
2025-11-03T16:53:33.684600Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Got CDS response: 
write_sessions_clusters { clusters { endpoint: "localhost:1567" name: "dc1" available: true } primary_cluster_selection_reason: CLIENT_LOCATION } version: 1
2025-11-03T16:53:33.684651Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Start write session. Will connect to endpoint: localhost:1567
2025-11-03T16:53:33.687871Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" }
2025-11-03T16:53:33.688340Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-11-03T16:53:33.688374Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 44
2025-11-03T16:53:33.689190Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 44 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" }
2025-11-03T16:53:33.689354Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 44 topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" from ipv6:[::1]:34482
2025-11-03T16:53:33.689372Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=44 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:34482 proto=v1  topic=test-topic durationSec=0
2025-11-03T16:53:33.689383Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-11-03T16:53:33.690833Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 44 sessionId:  describe result for acl check
2025-11-03T16:53:33.690939Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-11-03T16:53:33.690948Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-11-03T16:53:33.690957Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-11-03T16:53:33.690973Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7568543323432695869:3316] (SourceId=test-message-group-id, PreferedPartition=(NULL)) StartKqpSession
2025-11-03T16:53:33.695613Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7568543323432695869:3316] (SourceId=test-message-group-id, PreferedPartition=(NULL)) Select from the table
2025-11-03T16:53:33.857261Z node 1 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976715860. Failed to resolve tablet: 72075186224037888 after several retries.
2025-11-03T16:53:33.857417Z node 1 :KQP_EXECUTER WARN: kqp_executer_impl.h:245: ActorId: [1:7568543319137728509:3306] TxId: 281474976715860. Ctx: { TraceId: 01k95a6r4z9bxtx6wbedn7khh1, Database: /Root, SessionId: ydb://session/3?node_id=1&id=ZjViODhhNzQtOWNlZjIyOWMtNzcwNjM1MTMtMzc0ZGEwMDA=, PoolId: default}. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037888 after several retries.
2025-11-03T16:53:33.857744Z node 1 :KQP_SESSION WARN: kqp_session_actor.cpp:2987: SessionId: ydb://session/3?node_id=1&id=ZjViODhhNzQtOWNlZjIyOWMtNzcwNjM1MTMtMzc0ZGEwMDA=, ActorId: [1:7568543319137728493:3306], ActorState: ExecuteState, TraceId: 01k95a6r4z9bxtx6wbedn7khh1, Create QueryResponse for error on request, msg: 
2025-11-03T16:53:33.858982Z node 1 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Failed to resolve tablet: 72075186224037888 after several retries." severity: 1 } TxMeta { id: "01k95a6rhw49y4fd30mtyc2g70" } } YdbStatus: UNAVAILABLE ConsumedRu: 270 }
2025-11-03T16:53:34.713546Z node 1 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976715861. Failed to resolve tablet: 72075186224037891 after several retries.
2025-11-03T16:53:34.713659Z node 1 :KQP_EXECUTER WARN: kqp_executer_impl.h:245: ActorId: [1:7568543323432695879:3318] TxId: 281474976715861. Ctx: { TraceId: 01k95a6sbzb1whqt0ebtqhsw9j, Database: /Root, SessionId: ydb://session/3?node_id=1&id=MWZkNTZjZTMtYWZkYTVlYTItOGZmNDgzODktZTkwYWUzNjI=, PoolId: default}. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037891 after several retries.
2025-11-03T16:53:34.713871Z node 1 :KQP_SESSION WARN: kqp_session_actor.cpp:2987: SessionId: ydb://session/3?node_id=1&id=MWZkNTZjZTMtYWZkYTVlYTItOGZmNDgzODktZTkwYWUzNjI=, ActorId: [1:7568543323432695870:3318], ActorState: ExecuteState, TraceId: 01k95a6sbzb1whqt0ebtqhsw9j, Create QueryResponse for error on request, msg: 
2025-11-03T16:53:34.715489Z node 1 :PQ_PARTITION_CHOOSER INFO: partition_chooser_impl__abstract_chooser_actor.h:312: TPartitionChooser [1:7568543323432695869:3316] (SourceId=test-message-group-id, PreferedPartition=(NULL)) ReplyError: kqp error Marker# PQ50 : Response {
  SessionId: "ydb://session/3?node_id=1&id=MWZkNTZjZTMtYWZkYTVlYTItOGZmNDgzODktZTkwYWUzNjI="
  QueryIssues {
    message: "Failed to resolve tablet: 72075186224037891 after several retries."
    severity: 1
  }
  TxMeta {
    id: "01k95a6sc48ybe2xzka3h1mp1g"
  }
}
YdbStatus: UNAVAILABLE
ConsumedRu: 1
2025-11-03T16:53:34.715584Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 44 reason: kqp error Marker# PQ50 : Response {
  SessionId: "ydb://session/3?node_id=1&id=MWZkNTZjZTMtYWZkYTVlYTItOGZmNDgzODktZTkwYWUzNjI="
  QueryIssues {
    message: "Failed to resolve tablet: 72075186224037891 after several retries."
    severity: 1
  }
  TxMeta {
    id: "01k95a6sc48ybe2xzka3h1mp1g"
  }
}
YdbStatus: UNAVAILABLE
ConsumedRu: 1
 sessionId: 
2025-11-03T16:53:34.715925Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 44 sessionId:  is DEAD
Test retry state: get retry delay
2025-11-03T16:53:34.719746Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: kqp error Marker# PQ50 : Response {   SessionId: "ydb://session/3?node_id=1&id=MWZkNTZjZTMtYWZkYTVlYTItOGZmNDgzODktZTkwYWUzNjI="   QueryIssues {     message: "Failed to resolve tablet: 72075186224037891 after several retries."     severity: 1   }   TxMeta {     id: "01k95a6sc48ybe2xzka3h1mp1g"   } } YdbStatus: UNAVAILABLE ConsumedRu: 1 , code: 500001 
2025-11-03T16:53:34.719785Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Write session will restart in 2.000000s
2025-11-03T16:53:34.719871Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Write session: Do CDS request
2025-11-03T16:53:34.719907Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Do schedule cds request after 2000 ms
2025-11-03T16:53:35.081180Z node 2 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976720761. Failed to resolve tablet: 72075186224037890 after several retries.
2025-11-03T16:53:35.081291Z node 2 :KQP_EXECUTER WARN: kqp_executer_impl.h:245: ActorId: [2:7568543327725204802:2950] TxId: 281474976720761. Ctx: { TraceId: 01k95a6s64858p2vq6yqzz709f, Database: /Root, SessionId: ydb://session/3?node_id=2&id=MmQyM2M1NTgtMTlhM2U4MC1iM2UzMjQyMy1lZjU0MDcyZQ==, PoolId: default}. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037890 after several retries.
2025-11-03T16:53:35.081531Z node 2 :KQP_SESSION WARN: kqp_session_actor.cpp:2987: SessionId: ydb://session/3?node_id=2&id=MmQyM2M1NTgtMTlhM2U4MC1iM2UzMjQyMy1lZjU0MDcyZQ==, ActorId: [2:7568543323430237489:2950], ActorState: ExecuteState, TraceId: 01k95a6s64858p2vq6yqzz709f, Create QueryResponse for error on request, msg: 
2025-11-03T16:53:35.082770Z node 2 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Failed to resolve tablet: 72075186224037890 after several retries." severity: 1 } TxMeta { id: "01k95a6snwagdafdtw56qtk4kp" } } YdbStatus: UNAVAILABLE ConsumedRu: 326 }
2025-11-03T16:53:36.585567Z node 1 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976715864. Failed to resolve tablet: 72075186224037888 after several retries.
2025-11-03T16:53:36.585687Z node 1 :KQP_EXECUTER WARN: kqp_executer_impl.h:245: ActorId: [1:7568543332022630560:3322] TxId: 281474976715864. Ctx: { TraceId: 01k95a6tge238hbg2edd21tta8, Database: /Root, SessionId: ydb://session/3?node_id=1&id=NTZmZWFlLWU5MDhjZmRiLWFhZDdmNDdmLWYxMTFjY2Fl, PoolId: default}. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037888 after several retries.
2025-11-03T16:53:36.585940Z node 1 :KQP_SESSION WARN: kqp_session_actor.cpp:2987: SessionId: ydb://session/3?node_id=1&id=NTZmZWFlLWU5MDhjZmRiLWFhZDdmNDdmLWYxMTFjY2Fl, ActorId: [1:7568543327727663236:3322], ActorState: ExecuteState, TraceId: 01k95a6tge238hbg2edd21tta8, Create QueryResponse for error on request, msg: 
2025-11-03T16:53:36.587258Z node 1 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Failed to resolve tablet: 72075186224037888 after several retries." severity: 1 } TxMeta { id: "01k95a6v6w85v3kre1cvg9vbrs" } } YdbStatus: UNAVAILABLE ConsumedRu: 471 }
2025-11-03T16:53:36.723255Z :INFO: [/Root] MessageGroupId [test-message-group-id] Running cds request ms
2025-11-03T16:53:36.727295Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Got CDS response: 
write_sessions_clusters { clusters { endpoint: "localhost:1567" name: "dc1" available: true } primary_cluster_selection_reason: CLIENT_LOCATION } version: 1
2025-11-03T16:53:36.727345Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Start write session. Will connect to endpoint: localhost:1567
2025-11-03T16:53:36.731251Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-11-03T16:53:36.731282Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 45
2025-11-03T16:53:36.732131Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" }
2025-11-03T16:53:36.733147Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 45 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" }
2025-11-03T16:53:36.733288Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 45 topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" from ipv6:[::1]:34482
2025-11-03T16:53:36.733304Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=45 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:34482 proto=v1  topic=test-topic durationSec=0
2025-11-03T16:53:36.733314Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-11-03T16:53:36.734687Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 45 sessionId:  describe result for acl check
2025-11-03T16:53:36.734779Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-11-03T16:53:36.734790Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-11-03T16:53:36.734798Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-11-03T16:53:36.734814Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7568543336317597937:3333] (SourceId=test-message-group-id, PreferedPartition=(NULL)) StartKqpSession
2025-11-03T16:53:36.737164Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7568543336317597937:3333] (SourceId=test-message-group-id, PreferedPartition=(NULL)) Select from the table
2025-11-03T16:53:37.730032Z node 1 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976715866. Failed to resolve tablet: 72075186224037891 after several retries.
2025-11-03T16:53:37.730152Z node 1 :KQP_EXECUTER WARN: kqp_executer_impl.h:245: ActorId: [1:7568543336317597948:3335] TxId: 281474976715866. Ctx: { TraceId: 01k95a6wb1bn9wb2ax1ggch3jv, Database: /Root, SessionId: ydb://session/3?node_id=1&id=YjkzNTUyMzEtNWZmOWYyMzMtOTQxZDZhNTItNzJkMjQ4NjM=, PoolId: default}. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037891 after several retries.
2025-11-03T16:53:37.730380Z node 1 :KQP_SESSION WARN: kqp_session_actor.cpp:2987: SessionId: ydb://session/3?node_id=1&id=YjkzNTUyMzEtNWZmOWYyMzMtOTQxZDZhNTItNzJkMjQ4NjM=, ActorId: [1:7568543336317597938:3335], ActorState: ExecuteState, TraceId: 01k95a6wb1bn9wb2ax1ggch3jv, Create QueryResponse for error on request, msg: 
2025-11-03T16:53:37.731855Z node 1 :PQ_PARTITION_CHOOSER INFO: partition_chooser_impl__abstract_chooser_actor.h:312: TPartitionChooser [1:7568543336317597937:3333] (SourceId=test-message-group-id, PreferedPartition=(NULL)) ReplyError: kqp error Marker# PQ50 : Response {
  SessionId: "ydb://session/3?node_id=1&id=YjkzNTUyMzEtNWZmOWYyMzMtOTQxZDZhNTItNzJkMjQ4NjM="
  QueryIssues {
    message: "Failed to resolve tablet: 72075186224037891 after several retries."
    severity: 1
  }
  TxMeta {
    id: "01k95a6wb2a1ajmky6jc7qx9t9"
  }
}
YdbStatus: UNAVAILABLE
ConsumedRu: 1
2025-11-03T16:53:37.731943Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 45 reason: kqp error Marker# PQ50 : Response {
  SessionId: "ydb://session/3?node_id=1&id=YjkzNTUyMzEtNWZmOWYyMzMtOTQxZDZhNTItNzJkMjQ4NjM="
  QueryIssues {
    message: "Failed to resolve tablet: 72075186224037891 after several retries."
    severity: 1
  }
  TxMeta {
    id: "01k95a6wb2a1ajmky6jc7qx9t9"
  }
}
YdbStatus: UNAVAILABLE
ConsumedRu: 1
 sessionId: 
2025-11-03T16:53:37.732316Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 45 sessionId:  is DEAD
Test retry state: get retry delay
2025-11-03T16:53:37.740211Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: kqp error Marker# PQ50 : Response {   SessionId: "ydb://session/3?node_id=1&id=YjkzNTUyMzEtNWZmOWYyMzMtOTQxZDZhNTItNzJkMjQ4NjM="   QueryIssues {     message: "Failed to resolve tablet: 72075186224037891 after several retries."     severity: 1   }   TxMeta {     id: "01k95a6wb2a1ajmky6jc7qx9t9"   } } YdbStatus: UNAVAILABLE ConsumedRu: 1 , code: 500001 
2025-11-03T16:53:37.740247Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Write session will restart in 2.000000s
2025-11-03T16:53:37.740329Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Write session: Do CDS request
2025-11-03T16:53:37.740360Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Do schedule cds request after 2000 ms
2025-11-03T16:53:37.789881Z node 2 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976720763. Failed to resolve tablet: 72075186224037888 after several retries.
2025-11-03T16:53:37.790050Z node 2 :KQP_EXECUTER WARN: kqp_executer_impl.h:245: ActorId: [2:7568543336315139475:2962] TxId: 281474976720763. Ctx: { TraceId: 01k95a6vptdzbbhnrzck7da1qn, Database: /Root, SessionId: ydb://session/3?node_id=2&id=M2RkOWE2YjktYTc1YTZlMGEtY2ZkNzY1MjItN2I1ZDg4OWQ=, PoolId: default}. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037888 after several retries.
2025-11-03T16:53:37.790338Z node 2 :KQP_SESSION WARN: kqp_session_actor.cpp:2987: SessionId: ydb://session/3?node_id=2&id=M2RkOWE2YjktYTc1YTZlMGEtY2ZkNzY1MjItN2I1ZDg4OWQ=, ActorId: [2:7568543336315139461:2962], ActorState: ExecuteState, TraceId: 01k95a6vptdzbbhnrzck7da1qn, Create QueryResponse for error on request, msg: 
2025-11-03T16:53:37.792094Z node 2 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Failed to resolve tablet: 72075186224037888 after several retries." severity: 1 } TxMeta { id: "01k95a6wcc9q62erpmnjwjf0c6" } } YdbStatus: UNAVAILABLE ConsumedRu: 447 }
2025-11-03T16:53:39.236668Z node 1 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976715868. Failed to resolve tablet: 72075186224037888 after several retries.
2025-11-03T16:53:39.236790Z node 1 :KQP_EXECUTER WARN: kqp_executer_impl.h:245: ActorId: [1:7568543344907532617:3339] TxId: 281474976715868. Ctx: { TraceId: 01k95a6x5qcxa72dc8vh6pktyb, Database: /Root, SessionId: ydb://session/3?node_id=1&id=ZTNhNmRiNWEtYjdkZTI3Y2UtNzNmZTYwNTAtOTU1ZGYwZWI=, PoolId: default}. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037888 after several retries.
2025-11-03T16:53:39.237046Z node 1 :KQP_SESSION WARN: kqp_session_actor.cpp:2987: SessionId: ydb://session/3?node_id=1&id=ZTNhNmRiNWEtYjdkZTI3Y2UtNzNmZTYwNTAtOTU1ZGYwZWI=, ActorId: [1:7568543340612565289:3339], ActorState: ExecuteState, TraceId: 01k95a6x5qcxa72dc8vh6pktyb, Create QueryResponse for error on request, msg: 
2025-11-03T16:53:39.238433Z node 1 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Failed to resolve tablet: 72075186224037888 after several retries." severity: 1 } TxMeta { id: "01k95a6xsg8581xf770zgpmqep" } } YdbStatus: UNAVAILABLE ConsumedRu: 415 }
2025-11-03T16:53:39.744208Z :INFO: [/Root] MessageGroupId [test-message-group-id] Running cds request ms
2025-11-03T16:53:39.748707Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Got CDS response: 
write_sessions_clusters { clusters { endpoint: "localhost:1567" name: "dc1" available: true } primary_cluster_selection_reason: CLIENT_LOCATION } version: 1
2025-11-03T16:53:39.748757Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Start write session. Will connect to endpoint: localhost:1567
2025-11-03T16:53:39.751744Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-11-03T16:53:39.751777Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 46
2025-11-03T16:53:39.752750Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" }
2025-11-03T16:53:39.753323Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 46 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" }
2025-11-03T16:53:39.753461Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 46 topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" from ipv6:[::1]:34482
2025-11-03T16:53:39.753479Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=46 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:34482 proto=v1  topic=test-topic durationSec=0
2025-11-03T16:53:39.753491Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-11-03T16:53:39.755099Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 46 sessionId:  describe result for acl check
2025-11-03T16:53:39.755225Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-11-03T16:53:39.755236Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-11-03T16:53:39.755247Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-11-03T16:53:39.755264Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7568543349202499993:3350] (SourceId=test-message-group-id, PreferedPartition=(NULL)) StartKqpSession
2025-11-03T16:53:39.758228Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7568543349202499993:3350] (SourceId=test-message-group-id, PreferedPartition=(NULL)) Select from the table
2025-11-03T16:53:40.781203Z node 1 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976715870. Failed to resolve tablet: 72075186224037891 after several retries.
2025-11-03T16:53:40.781338Z node 1 :KQP_EXECUTER WARN: kqp_executer_impl.h:245: ActorId: [1:7568543349202500004:3352] TxId: 281474976715870. Ctx: { TraceId: 01k95a6z9e51byytm3gryeb5r3, Database: /Root, SessionId: ydb://session/3?node_id=1&id=ZmI5MzQ3OWEtNTY4YjEyM2UtMjg3YThjOWEtZDY2MGY0YTA=, PoolId: default}. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037891 after several retries.
2025-11-03T16:53:40.781617Z node 1 :KQP_SESSION WARN: kqp_session_actor.cpp:2987: SessionId: ydb://session/3?node_id=1&id=ZmI5MzQ3OWEtNTY4YjEyM2UtMjg3YThjOWEtZDY2MGY0YTA=, ActorId: [1:7568543349202499994:3352], ActorState: ExecuteState, TraceId: 01k95a6z9e51byytm3gryeb5r3, Create QueryResponse for error on request, msg: 
2025-11-03T16:53:40.783864Z node 1 :PQ_PARTITION_CHOOSER INFO: partition_chooser_impl__abstract_chooser_actor.h:312: TPartitionChooser [1:7568543349202499993:3350] (SourceId=test-message-group-id, PreferedPartition=(NULL)) ReplyError: kqp error Marker# PQ50 : Response {
  SessionId: "ydb://session/3?node_id=1&id=ZmI5MzQ3OWEtNTY4YjEyM2UtMjg3YThjOWEtZDY2MGY0YTA="
  QueryIssues {
    message: "Failed to resolve tablet: 72075186224037891 after several retries."
    severity: 1
  }
  TxMeta {
    id: "01k95a6z9f8ktscykneaghcdjf"
  }
}
YdbStatus: UNAVAILABLE
ConsumedRu: 1
2025-11-03T16:53:40.783941Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 46 reason: kqp error Marker# PQ50 : Response {
  SessionId: "ydb://session/3?node_id=1&id=ZmI5MzQ3OWEtNTY4YjEyM2UtMjg3YThjOWEtZDY2MGY0YTA="
  QueryIssues {
    message: "Failed to resolve tablet: 72075186224037891 after several retries."
    severity: 1
  }
  TxMeta {
    id: "01k95a6z9f8ktscykneaghcdjf"
  }
}
YdbStatus: UNAVAILABLE
ConsumedRu: 1
 sessionId: 
2025-11-03T16:53:40.784289Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 46 sessionId:  is DEAD
Test retry state: get retry delay
2025-11-03T16:53:40.785663Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: kqp error Marker# PQ50 : Response {   SessionId: "ydb://session/3?node_id=1&id=ZmI5MzQ3OWEtNTY4YjEyM2UtMjg3YThjOWEtZDY2MGY0YTA="   QueryIssues {     message: "Failed to resolve tablet: 72075186224037891 after several retries."     severity: 1   }   TxMeta {     id: "01k95a6z9f8ktscykneaghcdjf"   } } YdbStatus: UNAVAILABLE ConsumedRu: 1 , code: 500001 
2025-11-03T16:53:40.785697Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Write session will restart in 2.000000s
2025-11-03T16:53:40.785779Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Write session: Do CDS request
2025-11-03T16:53:40.785811Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Do schedule cds request after 2000 ms
2025-11-03T16:53:40.993055Z node 2 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976720765. Failed to resolve tablet: 72075186224037890 after several retries.
2025-11-03T16:53:40.993175Z node 2 :KQP_EXECUTER WARN: kqp_executer_impl.h:245: ActorId: [2:7568543349200041446:2972] TxId: 281474976720765. Ctx: { TraceId: 01k95a6yb7drz5snfzmmgfask2, Database: /Root, SessionId: ydb://session/3?node_id=2&id=NDVjZDE4YzItNmQ4ZTliMDctZWY3M2RiZDYtNDI0ZWE5ZDY=, PoolId: default}. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037890 after several retries.
2025-11-03T16:53:40.993439Z node 2 :KQP_SESSION WARN: kqp_session_actor.cpp:2987: SessionId: ydb://session/3?node_id=2&id=NDVjZDE4YzItNmQ4ZTliMDctZWY3M2RiZDYtNDI0ZWE5ZDY=, ActorId: [2:7568543344905074133:2972], ActorState: ExecuteState, TraceId: 01k95a6yb7drz5snfzmmgfask2, Create QueryResponse for error on request, msg: 
2025-11-03T16:53:40.994961Z node 2 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Failed to resolve tablet: 72075186224037890 after several retries." severity: 1 } TxMeta { id: "01k95a6zfc8nrg7jm5k4eezv5s" } } YdbStatus: UNAVAILABLE ConsumedRu: 758 }
2025-11-03T16:53:41.668213Z node 1 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976715871. Failed to resolve tablet: 72075186224037890 after several retries.
2025-11-03T16:53:41.668358Z node 1 :KQP_EXECUTER WARN: kqp_executer_impl.h:245: ActorId: [1:7568543353497467354:3355] TxId: 281474976715871. Ctx: { TraceId: 01k95a6zrpc7kvypjr4ge09sd7, Database: /Root, SessionId: ydb://session/3?node_id=1&id=MzllNmI2ZjQtNWExZDVkOGQtNGRlYWY0YjQtNjZjYmI0YmM=, PoolId: default}. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037890 after several retries.
2025-11-03T16:53:41.668713Z node 1 :KQP_SESSION WARN: kqp_session_actor.cpp:2987: SessionId: ydb://session/3?node_id=1&id=MzllNmI2ZjQtNWExZDVkOGQtNGRlYWY0YjQtNjZjYmI0YmM=, ActorId: [1:7568543353497467327:3355], ActorState: ExecuteState, TraceId: 01k95a6zrpc7kvypjr4ge09sd7, Create QueryResponse for error on request, msg: 
2025-11-03T16:53:41.672937Z node 1 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Failed to resolve tablet: 72075186224037890 after several retries." severity: 1 } TxMeta { id: "01k95a705cbhekk9xhg2qdfn6g" } } YdbStatus: UNAVAILABLE ConsumedRu: 261 }
2025-11-03T16:53:42.792171Z :INFO: [/Root] MessageGroupId [test-message-group-id] Running cds request ms
2025-11-03T16:53:42.796688Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Got CDS response: 
write_sessions_clusters { clusters { endpoint: "localhost:1567" name: "dc1" available: true } primary_cluster_selection_reason: CLIENT_LOCATION } version: 1
2025-11-03T16:53:42.796736Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Start write session. Will connect to endpoint: localhost:1567
2025-11-03T16:53:42.804650Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" }
2025-11-03T16:53:42.806410Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-11-03T16:53:42.806458Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 47
2025-11-03T16:53:42.806955Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 47 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" }
2025-11-03T16:53:42.807089Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 47 topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" from ipv6:[::1]:34482
2025-11-03T16:53:42.807103Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=47 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:34482 proto=v1  topic=test-topic durationSec=0
2025-11-03T16:53:42.807110Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-11-03T16:53:42.808125Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 47 sessionId:  describe result for acl check
2025-11-03T16:53:42.808206Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-11-03T16:53:42.808216Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-11-03T16:53:42.808225Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-11-03T16:53:42.808244Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7568543362087402060:3373] (SourceId=test-message-group-id, PreferedPartition=(NULL)) StartKqpSession
2025-11-03T16:53:42.810112Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7568543362087402060:3373] (SourceId=test-message-group-id, PreferedPartition=(NULL)) Select from the table
2025-11-03T16:53:43.633372Z node 2 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976720767. Failed to resolve tablet: 72075186224037890 after several retries.
2025-11-03T16:53:43.633485Z node 2 :KQP_EXECUTER WARN: kqp_executer_impl.h:245: ActorId: [2:7568543362084943419:2984] TxId: 281474976720767. Ctx: { TraceId: 01k95a71fbax3j2d2afk5ky409, Database: /Root, SessionId: ydb://session/3?node_id=2&id=Y2I1MWU5NTMtM2JhODYzYi03ZmJhMzkyNy1hMWEzMmQ3MA==, PoolId: default}. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037890 after several retries.
2025-11-03T16:53:43.633736Z node 2 :KQP_SESSION WARN: kqp_session_actor.cpp:2987: SessionId: ydb://session/3?node_id=2&id=Y2I1MWU5NTMtM2JhODYzYi03ZmJhMzkyNy1hMWEzMmQ3MA==, ActorId: [2:7568543357789976105:2984], ActorState: ExecuteState, TraceId: 01k95a71fbax3j2d2afk5ky409, Create QueryResponse for error on request, msg: 
2025-11-03T16:53:43.635234Z node 2 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Failed to resolve tablet: 72075186224037890 after several retries." severity: 1 } TxMeta { id: "01k95a7230asx7sjemz8k5gahv" } } YdbStatus: UNAVAILABLE ConsumedRu: 406 }
2025-11-03T16:53:43.817248Z node 1 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976715874. Failed to resolve tablet: 72075186224037891 after several retries.
2025-11-03T16:53:43.817367Z node 1 :KQP_EXECUTER WARN: kqp_executer_impl.h:245: ActorId: [1:7568543362087402071:3375] TxId: 281474976715874. Ctx: { TraceId: 01k95a728t5map87xwrsb0x8mx, Database: /Root, SessionId: ydb://session/3?node_id=1&id=NTBhYmE0MjktYjdiNzc4MTQtZDk0ZGE2NzktZjY5N2JmNg==, PoolId: default}. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037891 after several retries.
2025-11-03T16:53:43.817593Z node 1 :KQP_SESSION WARN: kqp_session_actor.cpp:2987: SessionId: ydb://session/3?node_id=1&id=NTBhYmE0MjktYjdiNzc4MTQtZDk0ZGE2NzktZjY5N2JmNg==, ActorId: [1:7568543362087402061:3375], ActorState: ExecuteState, TraceId: 01k95a728t5map87xwrsb0x8mx, Create QueryResponse for error on request, msg: 
2025-11-03T16:53:43.820014Z node 1 :PQ_PARTITION_CHOOSER INFO: partition_chooser_impl__abstract_chooser_actor.h:312: TPartitionChooser [1:7568543362087402060:3373] (SourceId=test-message-group-id, PreferedPartition=(NULL)) ReplyError: kqp error Marker# PQ50 : Response {
  SessionId: "ydb://session/3?node_id=1&id=NTBhYmE0MjktYjdiNzc4MTQtZDk0ZGE2NzktZjY5N2JmNg=="
  QueryIssues {
    message: "Failed to resolve tablet: 72075186224037891 after several retries."
    severity: 1
  }
  TxMeta {
    id: "01k95a728t5map87xwrtspeng3"
  }
}
YdbStatus: UNAVAILABLE
ConsumedRu: 1
2025-11-03T16:53:43.820103Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 47 reason: kqp error Marker# PQ50 : Response {
  SessionId: "ydb://session/3?node_id=1&id=NTBhYmE0MjktYjdiNzc4MTQtZDk0ZGE2NzktZjY5N2JmNg=="
  QueryIssues {
    message: "Failed to resolve tablet: 72075186224037891 after several retries."
    severity: 1
  }
  TxMeta {
    id: "01k95a728t5map87xwrtspeng3"
  }
}
YdbStatus: UNAVAILABLE
ConsumedRu: 1
 sessionId: 
2025-11-03T16:53:43.820450Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 47 sessionId:  is DEAD
Test retry state: get retry delay
2025-11-03T16:53:43.822694Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: kqp error Marker# PQ50 : Response {   SessionId: "ydb://session/3?node_id=1&id=NTBhYmE0MjktYjdiNzc4MTQtZDk0ZGE2NzktZjY5N2JmNg=="   QueryIssues {     message: "Failed to resolve tablet: 72075186224037891 after several retries."     severity: 1   }   TxMeta {     id: "01k95a728t5map87xwrtspeng3"   } } YdbStatus: UNAVAILABLE ConsumedRu: 1 , code: 500001 
2025-11-03T16:53:43.822729Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Write session will restart in 2.000000s
2025-11-03T16:53:43.822831Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Write session: Do CDS request
2025-11-03T16:53:43.822863Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Do schedule cds request after 2000 ms
2025-11-03T16:53:44.592773Z node 1 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976715875. Failed to resolve tablet: 72075186224037890 after several retries.
2025-11-03T16:53:44.592935Z node 1 :KQP_EXECUTER WARN: kqp_executer_impl.h:245: ActorId: [1:7568543366382369404:3366] TxId: 281474976715875. Ctx: { TraceId: 01k95a724v0dyadvwck5d447dk, Database: /Root, SessionId: ydb://session/3?node_id=1&id=Mzk3N2I0NzItMWNkMDRiNzEtN2VhODRkNTItNzY1ODU1ZmM=, PoolId: default}. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037890 after several retries.
2025-11-03T16:53:44.593202Z node 1 :KQP_SESSION WARN: kqp_session_actor.cpp:2987: SessionId: ydb://session/3?node_id=1&id=Mzk3N2I0NzItMWNkMDRiNzEtN2VhODRkNTItNzY1ODU1ZmM=, ActorId: [1:7568543362087402044:3366], ActorState: ExecuteState, TraceId: 01k95a724v0dyadvwck5d447dk, Create QueryResponse for error on request, msg: 
2025-11-03T16:53:44.594300Z node 1 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Failed to resolve tablet: 72075186224037890 after several retries." severity: 1 } TxMeta { id: "01k95a731gf5cxkhzpek9snsy3" } } YdbStatus: UNAVAILABLE ConsumedRu: 603 }
2025-11-03T16:53:45.836060Z :INFO: [/Root] MessageGroupId [test-message-group-id] Running cds request ms
2025-11-03T16:53:45.840503Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Got CDS response: 
write_sessions_clusters { clusters { endpoint: "localhost:1567" name: "dc1" available: true } primary_cluster_selection_reason: CLIENT_LOCATION } version: 1
2025-11-03T16:53:45.840554Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Start write session. Will connect to endpoint: localhost:1567
2025-11-03T16:53:45.844108Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-11-03T16:53:45.844145Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 48
2025-11-03T16:53:45.845046Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" }
2025-11-03T16:53:45.845617Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 48 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" }
2025-11-03T16:53:45.845757Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 48 topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" from ipv6:[::1]:34482
2025-11-03T16:53:45.845774Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=48 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:34482 proto=v1  topic=test-topic durationSec=0
2025-11-03T16:53:45.845785Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-11-03T16:53:45.847763Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 48 sessionId:  describe result for acl check
2025-11-03T16:53:45.847841Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-11-03T16:53:45.847847Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-11-03T16:53:45.847853Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-11-03T16:53:45.847865Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7568543374972304115:3390] (SourceId=test-message-group-id, PreferedPartition=(NULL)) StartKqpSession
2025-11-03T16:53:45.849666Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7568543374972304115:3390] (SourceId=test-message-group-id, PreferedPartition=(NULL)) Select from the table
2025-11-03T16:53:46.265178Z node 2 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976720769. Failed to resolve tablet: 72075186224037888 after several retries.
2025-11-03T16:53:46.265297Z node 2 :KQP_EXECUTER WARN: kqp_executer_impl.h:245: ActorId: [2:7568543374969845390:2996] TxId: 281474976720769. Ctx: { TraceId: 01k95a741z9a39ajpdjwghtrxw, Database: /Root, SessionId: ydb://session/3?node_id=2&id=N2RmMmY2MTItZDhiMDM2MzktYzRjNjBmNTEtZDNiZWViZTI=, PoolId: default}. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037888 after several retries.
2025-11-03T16:53:46.265555Z node 2 :KQP_SESSION WARN: kqp_session_actor.cpp:2987: SessionId: ydb://session/3?node_id=2&id=N2RmMmY2MTItZDhiMDM2MzktYzRjNjBmNTEtZDNiZWViZTI=, ActorId: [2:7568543370674878077:2996], ActorState: ExecuteState, TraceId: 01k95a741z9a39ajpdjwghtrxw, Create QueryResponse for error on request, msg: 
2025-11-03T16:53:46.266930Z node 2 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Failed to resolve tablet: 72075186224037888 after several retries." severity: 1 } TxMeta { id: "01k95a74ma267q3sgewk7pytnh" } } YdbStatus: UNAVAILABLE ConsumedRu: 382 }
2025-11-03T16:53:46.868934Z node 1 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976715878. Failed to resolve tablet: 72075186224037891 after several retries.
2025-11-03T16:53:46.869057Z node 1 :KQP_EXECUTER WARN: kqp_executer_impl.h:245: ActorId: [1:7568543374972304126:3392] TxId: 281474976715878. Ctx: { TraceId: 01k95a757s68dw1nnr98kpb7xp, Database: /Root, SessionId: ydb://session/3?node_id=1&id=YTJmYmQ4MmQtNWE4ODVjMjQtZDM4MmM3OC1iYTllOWZi, PoolId: default}. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037891 after several retries.
2025-11-03T16:53:46.869277Z node 1 :KQP_SESSION WARN: kqp_session_actor.cpp:2987: SessionId: ydb://session/3?node_id=1&id=YTJmYmQ4MmQtNWE4ODVjMjQtZDM4MmM3OC1iYTllOWZi, ActorId: [1:7568543374972304116:3392], ActorState: ExecuteState, TraceId: 01k95a757s68dw1nnr98kpb7xp, Create QueryResponse for error on request, msg: 
2025-11-03T16:53:46.870670Z node 1 :PQ_PARTITION_CHOOSER INFO: partition_chooser_impl__abstract_chooser_actor.h:312: TPartitionChooser [1:7568543374972304115:3390] (SourceId=test-message-group-id, PreferedPartition=(NULL)) ReplyError: kqp error Marker# PQ50 : Response {
  SessionId: "ydb://session/3?node_id=1&id=YTJmYmQ4MmQtNWE4ODVjMjQtZDM4MmM3OC1iYTllOWZi"
  QueryIssues {
    message: "Failed to resolve tablet: 72075186224037891 after several retries."
    severity: 1
  }
  TxMeta {
    id: "01k95a757t76dvh7sqja7rd4q9"
  }
}
YdbStatus: UNAVAILABLE
ConsumedRu: 1
2025-11-03T16:53:46.870746Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 48 reason: kqp error Marker# PQ50 : Response {
  SessionId: "ydb://session/3?node_id=1&id=YTJmYmQ4MmQtNWE4ODVjMjQtZDM4MmM3OC1iYTllOWZi"
  QueryIssues {
    message: "Failed to resolve tablet: 72075186224037891 after several retries."
    severity: 1
  }
  TxMeta {
    id: "01k95a757t76dvh7sqja7rd4q9"
  }
}
YdbStatus: UNAVAILABLE
ConsumedRu: 1
 sessionId: 
2025-11-03T16:53:46.871098Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 48 sessionId:  is DEAD
Test retry state: get retry delay
2025-11-03T16:53:46.872663Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: kqp error Marker# PQ50 : Response {   SessionId: "ydb://session/3?node_id=1&id=YTJmYmQ4MmQtNWE4ODVjMjQtZDM4MmM3OC1iYTllOWZi"   QueryIssues {     message: "Failed to resolve tablet: 72075186224037891 after several retries."     severity: 1   }   TxMeta {     id: "01k95a757t76dvh7sqja7rd4q9"   } } YdbStatus: UNAVAILABLE ConsumedRu: 1 , code: 500001 
2025-11-03T16:53:46.872700Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Write session will restart in 2.000000s
2025-11-03T16:53:46.872780Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Write session: Do CDS request
2025-11-03T16:53:46.872811Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Do schedule cds request after 2000 ms
2025-11-03T16:53:47.549279Z node 1 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976715879. Failed to resolve tablet: 72075186224037890 after several retries.
2025-11-03T16:53:47.549432Z node 1 :KQP_EXECUTER WARN: kqp_executer_impl.h:245: ActorId: [1:7568543379267271457:3382] TxId: 281474976715879. Ctx: { TraceId: 01k95a7503bmga6jzgbmf1xf1q, Database: /Root, SessionId: ydb://session/3?node_id=1&id=OGY1ZDk2ZC01ZDRkZTA3OS02NWUxMzRjLWVlZTc3YjM1, PoolId: default}. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037890 after several retries.
2025-11-03T16:53:47.549722Z node 1 :KQP_SESSION WARN: kqp_session_actor.cpp:2987: SessionId: ydb://session/3?node_id=1&id=OGY1ZDk2ZC01ZDRkZTA3OS02NWUxMzRjLWVlZTc3YjM1, ActorId: [1:7568543374972304095:3382], ActorState: ExecuteState, TraceId: 01k95a7503bmga6jzgbmf1xf1q, Create QueryResponse for error on request, msg: 
2025-11-03T16:53:47.552436Z node 1 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Failed to resolve tablet: 72075186224037890 after several retries." severity: 1 } TxMeta { id: "01k95a75xrf1v1ywhaz42bj6tn" } } YdbStatus: UNAVAILABLE ConsumedRu: 619 }
2025-11-03T16:53:48.825188Z node 2 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976720771. Failed to resolve tablet: 72075186224037890 after several retries.
2025-11-03T16:53:48.825321Z node 2 :KQP_EXECUTER WARN: kqp_executer_impl.h:245: ActorId: [2:7568543383559780063:3008] TxId: 281474976720771. Ctx: { TraceId: 01k95a76m73tqb17pzv22818ba, Database: /Root, SessionId: ydb://session/3?node_id=2&id=OTM3YjA3MzctNWUwMjVlYmItN2Q0NzY0ZGYtNjRmOWVjOGY=, PoolId: default}. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037890 after several retries.
2025-11-03T16:53:48.825596Z node 2 :KQP_SESSION WARN: kqp_session_actor.cpp:2987: SessionId: ydb://session/3?node_id=2&id=OTM3YjA3MzctNWUwMjVlYmItN2Q0NzY0ZGYtNjRmOWVjOGY=, ActorId: [2:7568543383559780050:3008], ActorState: ExecuteState, TraceId: 01k95a76m73tqb17pzv22818ba, Create QueryResponse for error on request, msg: 
2025-11-03T16:53:48.826942Z node 2 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Failed to resolve tablet: 72075186224037890 after several retries." severity: 1 } TxMeta { id: "01k95a774g5pwq9dysng7jm74q" } } YdbStatus: UNAVAILABLE ConsumedRu: 341 }
2025-11-03T16:53:48.877782Z :INFO: [/Root] MessageGroupId [test-message-group-id] Running cds request ms
2025-11-03T16:53:48.886943Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Got CDS response: 
write_sessions_clusters { clusters { endpoint: "localhost:1567" name: "dc1" available: true } primary_cluster_selection_reason: CLIENT_LOCATION } version: 1
2025-11-03T16:53:48.886999Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Start write session. Will connect to endpoint: localhost:1567
2025-11-03T16:53:48.893387Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" }
2025-11-03T16:53:48.893752Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-11-03T16:53:48.893790Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 49
2025-11-03T16:53:48.895012Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 49 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" }
2025-11-03T16:53:48.895162Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 49 topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" from ipv6:[::1]:34482
2025-11-03T16:53:48.895185Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=49 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:34482 proto=v1  topic=test-topic durationSec=0
2025-11-03T16:53:48.895195Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-11-03T16:53:48.896634Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 49 sessionId:  describe result for acl check
2025-11-03T16:53:48.896765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-11-03T16:53:48.896777Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-11-03T16:53:48.896787Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-11-03T16:53:48.896804Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7568543387857206169:3407] (SourceId=test-message-group-id, PreferedPartition=(NULL)) StartKqpSession
2025-11-03T16:53:48.899338Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7568543387857206169:3407] (SourceId=test-message-group-id, PreferedPartition=(NULL)) Select from the table
2025-11-03T16:53:49.899128Z node 1 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976715882. Failed to resolve tablet: 72075186224037891 after several retries.
2025-11-03T16:53:49.899246Z node 1 :KQP_EXECUTER WARN: kqp_executer_impl.h:245: ActorId: [1:7568543387857206181:3409] TxId: 281474976715882. Ctx: { TraceId: 01k95a787331zwwr1g794xwxmv, Database: /Root, SessionId: ydb://session/3?node_id=1&id=N2Y1MDg0NDYtYTQxZDZjODctZThiYzNlMTAtNmRiYTkzNzQ=, PoolId: default}. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037891 after several retries.
2025-11-03T16:53:49.899450Z node 1 :KQP_SESSION WARN: kqp_session_actor.cpp:2987: SessionId: ydb://session/3?node_id=1&id=N2Y1MDg0NDYtYTQxZDZjODctZThiYzNlMTAtNmRiYTkzNzQ=, ActorId: [1:7568543387857206170:3409], ActorState: ExecuteState, TraceId: 01k95a787331zwwr1g794xwxmv, Create QueryResponse for error on request, msg: 
Test retry state: get retry delay
2025-11-03T16:53:49.902479Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: kqp error Marker# PQ50 : Response {   SessionId: "ydb://session/3?node_id=1&id=N2Y1MDg0NDYtYTQxZDZjODctZThiYzNlMTAtNmRiYTkzNzQ="   QueryIssues {     message: "Failed to resolve tablet: 72075186224037891 after several retries."     severity: 1   }   TxMeta {     id: "01k95a787bc515anmjzbv5k8z1"   } } YdbStatus: UNAVAILABLE ConsumedRu: 5 , code: 500001 
2025-11-03T16:53:49.902516Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Write session will restart in 2.000000s
2025-11-03T16:53:49.902599Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Write session: Do CDS request
2025-11-03T16:53:49.902635Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Do schedule cds request after 2000 ms
2025-11-03T16:53:49.900345Z node 1 :PQ_PARTITION_CHOOSER INFO: partition_chooser_impl__abstract_chooser_actor.h:312: TPartitionChooser [1:7568543387857206169:3407] (SourceId=test-message-group-id, PreferedPartition=(NULL)) ReplyError: kqp error Marker# PQ50 : Response {
  SessionId: "ydb://session/3?node_id=1&id=N2Y1MDg0NDYtYTQxZDZjODctZThiYzNlMTAtNmRiYTkzNzQ="
  QueryIssues {
    message: "Failed to resolve tablet: 72075186224037891 after several retries."
    severity: 1
  }
  TxMeta {
    id: "01k95a787bc515anmjzbv5k8z1"
  }
}
YdbStatus: UNAVAILABLE
ConsumedRu: 5
2025-11-03T16:53:49.900420Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 49 reason: kqp error Marker# PQ50 : Response {
  SessionId: "ydb://session/3?node_id=1&id=N2Y1MDg0NDYtYTQxZDZjODctZThiYzNlMTAtNmRiYTkzNzQ="
  QueryIssues {
    message: "Failed to resolve tablet: 72075186224037891 after several retries."
    severity: 1
  }
  TxMeta {
    id: "01k95a787bc515anmjzbv5k8z1"
  }
}
YdbStatus: UNAVAILABLE
ConsumedRu: 5
 sessionId: 
2025-11-03T16:53:49.900718Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 49 sessionId:  is DEAD
2025-11-03T16:53:50.138132Z node 1 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976715883. Failed to resolve tablet: 72075186224037888 after several retries.
2025-11-03T16:53:50.138269Z node 1 :KQP_EXECUTER WARN: kqp_executer_impl.h:245: ActorId: [1:7568543392152173496:3399] TxId: 281474976715883. Ctx: { TraceId: 01k95a77wb743zb32p83w5eyg4, Database: /Root, SessionId: ydb://session/3?node_id=1&id=Y2ZiYmM4N2QtZDUzN2RjOWYtNWNkY2JkNC05NzhiN2E1MA==, PoolId: default}. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037888 after several retries.
2025-11-03T16:53:50.138587Z node 1 :KQP_SESSION WARN: kqp_session_actor.cpp:2987: SessionId: ydb://session/3?node_id=1&id=Y2ZiYmM4N2QtZDUzN2RjOWYtNWNkY2JkNC05NzhiN2E1MA==, ActorId: [1:7568543387857206151:3399], ActorState: ExecuteState, TraceId: 01k95a77wb743zb32p83w5eyg4, Create QueryResponse for error on request, msg: 
2025-11-03T16:53:50.140025Z node 1 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Failed to resolve tablet: 72075186224037888 after several retries." severity: 1 } TxMeta { id: "01k95a78en0k9yjnj3bygrft94" } } YdbStatus: UNAVAILABLE ConsumedRu: 380 }
2025-11-03T16:53:51.476109Z node 2 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976720773. Failed to resolve tablet: 72075186224037890 after several retries.
2025-11-03T16:53:51.476229Z node 2 :KQP_EXECUTER WARN: kqp_executer_impl.h:245: ActorId: [2:7568543396444682038:3018] TxId: 281474976720773. Ctx: { TraceId: 01k95a7947655ds6czqkczx2zn, Database: /Root, SessionId: ydb://session/3?node_id=2&id=NGI5ZGE2MDEtOGJlMTgxYTUtNGFiNTI1NjktZGE3MzRkN2U=, PoolId: default}. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037890 after several retries.
2025-11-03T16:53:51.476489Z node 2 :KQP_SESSION WARN: kqp_session_actor.cpp:2987: SessionId: ydb://session/3?node_id=2&id=NGI5ZGE2MDEtOGJlMTgxYTUtNGFiNTI1NjktZGE3MzRkN2U=, ActorId: [2:7568543392149714721:3018], ActorState: ExecuteState, TraceId: 01k95a7947655ds6czqkczx2zn, Create QueryResponse for error on request, msg: 
2025-11-03T16:53:51.480699Z node 2 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Failed to resolve tablet: 72075186224037890 after several retries." severity: 1 } TxMeta { id: "01k95a79qr509fzwc776se3hjs" } } YdbStatus: UNAVAILABLE ConsumedRu: 405 }
2025-11-03T16:53:51.904384Z :INFO: [/Root] MessageGroupId [test-message-group-id] Running cds request ms
2025-11-03T16:53:51.917654Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Got CDS response: 
write_sessions_clusters { clusters { endpoint: "localhost:1567" name: "dc1" available: true } primary_cluster_selection_reason: CLIENT_LOCATION } version: 1
2025-11-03T16:53:51.917709Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Start write session. Will connect to endpoint: localhost:1567
2025-11-03T16:53:51.921353Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" }
2025-11-03T16:53:51.921775Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-11-03T16:53:51.921814Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 50
2025-11-03T16:53:51.928177Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 50 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" }
2025-11-03T16:53:51.928374Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 50 topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" from ipv6:[::1]:34482
2025-11-03T16:53:51.928391Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=50 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:34482 proto=v1  topic=test-topic durationSec=0
2025-11-03T16:53:51.928404Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-11-03T16:53:51.937320Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 50 sessionId:  describe result for acl check
2025-11-03T16:53:51.937457Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-11-03T16:53:51.937468Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-11-03T16:53:51.937479Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-11-03T16:53:51.937497Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7568543400742108236:3426] (SourceId=test-message-group-id, PreferedPartition=(NULL)) StartKqpSession
2025-11-03T16:53:51.940839Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7568543400742108236:3426] (SourceId=test-message-group-id, PreferedPartition=(NULL)) Select from the table
2025-11-03T16:53:52.836552Z node 1 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976715886. Failed to resolve tablet: 72075186224037888 after several retries.
2025-11-03T16:53:52.836673Z node 1 :KQP_EXECUTER WARN: kqp_executer_impl.h:245: ActorId: [1:7568543400742108221:3417] TxId: 281474976715886. Ctx: { TraceId: 01k95a7adbeyb91c99z99yknkz, Database: /Root, SessionId: ydb://session/3?node_id=1&id=ZTg4MzI4NzItNjJiZWRkNjMtNWQxMGIwM2UtNjQxZmEyZWQ=, PoolId: default}. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037888 after several retries.
2025-11-03T16:53:52.836925Z node 1 :KQP_SESSION WARN: kqp_session_actor.cpp:2987: SessionId: ydb://session/3?node_id=1&id=ZTg4MzI4NzItNjJiZWRkNjMtNWQxMGIwM2UtNjQxZmEyZWQ=, ActorId: [1:7568543400742108202:3417], ActorState: ExecuteState, TraceId: 01k95a7adbeyb91c99z99yknkz, Create QueryResponse for error on request, msg: 
2025-11-03T16:53:52.838376Z node 1 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Failed to resolve tablet: 72075186224037888 after several retries." severity: 1 } TxMeta { id: "01k95a7b2me872e7v5s7v7t26k" } } YdbStatus: UNAVAILABLE ConsumedRu: 445 }
2025-11-03T16:53:52.941224Z node 1 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976715887. Failed to resolve tablet: 72075186224037891 after several retries.
2025-11-03T16:53:52.941346Z node 1 :KQP_EXECUTER WARN: kqp_executer_impl.h:245: ActorId: [1:7568543400742108247:3428] TxId: 281474976715887. Ctx: { TraceId: 01k95a7b651s7s5tezb5m8wk0x, Database: /Root, SessionId: ydb://session/3?node_id=1&id=ZTk3ZjE5MDMtNjljOTIyZGEtM2ZmMjYzYzctYmUzNDlkOWQ=, PoolId: default}. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037891 after several retries.
2025-11-03T16:53:52.941557Z node 1 :KQP_SESSION WARN: kqp_session_actor.cpp:2987: SessionId: ydb://session/3?node_id=1&id=ZTk3ZjE5MDMtNjljOTIyZGEtM2ZmMjYzYzctYmUzNDlkOWQ=, ActorId: [1:7568543400742108237:3428], ActorState: ExecuteState, TraceId: 01k95a7b651s7s5tezb5m8wk0x, Create QueryResponse for error on request, msg: 
2025-11-03T16:53:52.942555Z node 1 :PQ_PARTITION_CHOOSER INFO: partition_chooser_impl__abstract_chooser_actor.h:312: TPartitionChooser [1:7568543400742108236:3426] (SourceId=test-message-group-id, PreferedPartition=(NULL)) ReplyError: kqp error Marker# PQ50 : Response {
  SessionId: "ydb://session/3?node_id=1&id=ZTk3ZjE5MDMtNjljOTIyZGEtM2ZmMjYzYzctYmUzNDlkOWQ="
  QueryIssues {
    message: "Failed to resolve tablet: 72075186224037891 after several retries."
    severity: 1
  }
  TxMeta {
    id: "01k95a7b6c28bfpw97m8rheqfn"
  }
}
YdbStatus: UNAVAILABLE
ConsumedRu: 1
2025-11-03T16:53:52.942631Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 50 reason: kqp error Marker# PQ50 : Response {
  SessionId: "ydb://session/3?node_id=1&id=ZTk3ZjE5MDMtNjljOTIyZGEtM2ZmMjYzYzctYmUzNDlkOWQ="
  QueryIssues {
    message: "Failed to resolve tablet: 72075186224037891 after several retries."
    severity: 1
  }
  TxMeta {
    id: "01k95a7b6c28bfpw97m8rheqfn"
  }
}
YdbStatus: UNAVAILABLE
ConsumedRu: 1
 sessionId: 
2025-11-03T16:53:52.942984Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 50 sessionId:  is DEAD
Test retry state: get retry delay
2025-11-03T16:53:52.944671Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: kqp error Marker# PQ50 : Response {   SessionId: "ydb://session/3?node_id=1&id=ZTk3ZjE5MDMtNjljOTIyZGEtM2ZmMjYzYzctYmUzNDlkOWQ="   QueryIssues {     message: "Failed to resolve tablet: 72075186224037891 after several retries."     severity: 1   }   TxMeta {     id: "01k95a7b6c28bfpw97m8rheqfn"   } } YdbStatus: UNAVAILABLE ConsumedRu: 1 , code: 500001 
2025-11-03T16:53:52.944706Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Write session will restart in 2.000000s
2025-11-03T16:53:52.944792Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Write session: Do CDS request
2025-11-03T16:53:52.944828Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Do schedule cds request after 2000 ms
2025-11-03T16:53:54.079646Z node 2 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976720775. Failed to resolve tablet: 72075186224037890 after several retries.
2025-11-03T16:53:54.079756Z node 2 :KQP_EXECUTER WARN: kqp_executer_impl.h:245: ActorId: [2:7568543409329584006:3032] TxId: 281474976720775. Ctx: { TraceId: 01k95a7bq71ac0cpfzayyq3p0x, Database: /Root, SessionId: ydb://session/3?node_id=2&id=ODdlODI3Yi1jMWYxNDE2ZC0yNjUzN2IzNy0yZTM2YTI0Ng==, PoolId: default}. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037890 after several retries.
2025-11-03T16:53:54.080020Z node 2 :KQP_SESSION WARN: kqp_session_actor.cpp:2987: SessionId: ydb://session/3?node_id=2&id=ODdlODI3Yi1jMWYxNDE2ZC0yNjUzN2IzNy0yZTM2YTI0Ng==, ActorId: [2:7568543405034616697:3032], ActorState: ExecuteState, TraceId: 01k95a7bq71ac0cpfzayyq3p0x, Create QueryResponse for error on request, msg: 
2025-11-03T16:53:54.081085Z node 2 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Failed to resolve tablet: 72075186224037890 after several retries." severity: 1 } TxMeta { id: "01k95a7c802pg4r7xb09bexf7s" } } YdbStatus: UNAVAILABLE ConsumedRu: 343 }
2025-11-03T16:53:54.946037Z :INFO: [/Root] MessageGroupId [test-message-group-id] Running cds request ms
2025-11-03T16:53:54.952744Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Got CDS response: 
write_sessions_clusters { clusters { endpoint: "localhost:1567" name: "dc1" available: true } primary_cluster_selection_reason: CLIENT_LOCATION } version: 1
2025-11-03T16:53:54.952799Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Start write session. Will connect to endpoint: localhost:1567
2025-11-03T16:53:54.960276Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" }
2025-11-03T16:53:54.960831Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-11-03T16:53:54.960870Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 51
2025-11-03T16:53:54.961337Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 51 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" }
2025-11-03T16:53:54.961471Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 51 topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" from ipv6:[::1]:34482
2025-11-03T16:53:54.961488Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=51 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:34482 proto=v1  topic=test-topic durationSec=0
2025-11-03T16:53:54.961499Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-11-03T16:53:54.962971Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 51 sessionId:  describe result for acl check
2025-11-03T16:53:54.963092Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-11-03T16:53:54.963118Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-11-03T16:53:54.963126Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-11-03T16:53:54.963143Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7568543413627010305:3443] (SourceId=test-message-group-id, PreferedPartition=(NULL)) StartKqpSession
2025-11-03T16:53:54.965886Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7568543413627010305:3443] (SourceId=test-message-group-id, PreferedPartition=(NULL)) Select from the table
2025-11-03T16:53:55.500073Z node 1 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976715890. Failed to resolve tablet: 72075186224037890 after several retries.
2025-11-03T16:53:55.500210Z node 1 :KQP_EXECUTER WARN: kqp_executer_impl.h:245: ActorId: [1:7568543413627010268:3434] TxId: 281474976715890. Ctx: { TraceId: 01k95a7d1m83g5zhth8bgb9sfz, Database: /Root, SessionId: ydb://session/3?node_id=1&id=MWFjYzk5MmUtMmQ0ZmUwMWUtMjIzMTJlYTQtMjdhNGQxMQ==, PoolId: default}. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037890 after several retries.
2025-11-03T16:53:55.500455Z node 1 :KQP_SESSION WARN: kqp_session_actor.cpp:2987: SessionId: ydb://session/3?node_id=1&id=MWFjYzk5MmUtMmQ0ZmUwMWUtMjIzMTJlYTQtMjdhNGQxMQ==, ActorId: [1:7568543409332042947:3434], ActorState: ExecuteState, TraceId: 01k95a7d1m83g5zhth8bgb9sfz, Create QueryResponse for error on request, msg: 
2025-11-03T16:53:55.512501Z node 1 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Failed to resolve tablet: 72075186224037890 after several retries." severity: 1 } TxMeta { id: "01k95a7dp4fy45grj4dsedq4sm" } } YdbStatus: UNAVAILABLE ConsumedRu: 431 }
2025-11-03T16:53:55.982831Z node 1 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976715891. Failed to resolve tablet: 72075186224037891 after several retries.
2025-11-03T16:53:55.982966Z node 1 :KQP_EXECUTER WARN: kqp_executer_impl.h:245: ActorId: [1:7568543413627010315:3445] TxId: 281474976715891. Ctx: { TraceId: 01k95a7e4p6qje8830n5arzyb1, Database: /Root, SessionId: ydb://session/3?node_id=1&id=YzgyNDgyMmUtNzc3MDBlZTYtNGQxYTUyNmEtOTZmZDNjZTk=, PoolId: default}. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037891 after several retries.
2025-11-03T16:53:55.983202Z node 1 :KQP_SESSION WARN: kqp_session_actor.cpp:2987: SessionId: ydb://session/3?node_id=1&id=YzgyNDgyMmUtNzc3MDBlZTYtNGQxYTUyNmEtOTZmZDNjZTk=, ActorId: [1:7568543413627010306:3445], ActorState: ExecuteState, TraceId: 01k95a7e4p6qje8830n5arzyb1, Create QueryResponse for error on request, msg: 
2025-11-03T16:53:55.984240Z node 1 :PQ_PARTITION_CHOOSER INFO: partition_chooser_impl__abstract_chooser_actor.h:312: TPartitionChooser [1:7568543413627010305:3443] (SourceId=test-message-group-id, PreferedPartition=(NULL)) ReplyError: kqp error Marker# PQ50 : Response {
  SessionId: "ydb://session/3?node_id=1&id=YzgyNDgyMmUtNzc3MDBlZTYtNGQxYTUyNmEtOTZmZDNjZTk="
  QueryIssues {
    message: "Failed to resolve tablet: 72075186224037891 after several retries."
    severity: 1
  }
  TxMeta {
    id: "01k95a7e4p6qje8830n977bnws"
  }
}
YdbStatus: UNAVAILABLE
ConsumedRu: 1
2025-11-03T16:53:55.984356Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 51 reason: kqp error Marker# PQ50 : Response {
  SessionId: "ydb://session/3?node_id=1&id=YzgyNDgyMmUtNzc3MDBlZTYtNGQxYTUyNmEtOTZmZDNjZTk="
  QueryIssues {
    message: "Failed to resolve tablet: 72075186224037891 after several retries."
    severity: 1
  }
  TxMeta {
    id: "01k95a7e4p6qje8830n977bnws"
  }
}
YdbStatus: UNAVAILABLE
ConsumedRu: 1
 sessionId: 
2025-11-03T16:53:55.984715Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 51 sessionId:  is DEAD
Test retry state: get retry delay
2025-11-03T16:53:55.990561Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: kqp error Marker# PQ50 : Response {   SessionId: "ydb://session/3?node_id=1&id=YzgyNDgyMmUtNzc3MDBlZTYtNGQxYTUyNmEtOTZmZDNjZTk="   QueryIssues {     message: "Failed to resolve tablet: 72075186224037891 after several retries."     severity: 1   }   TxMeta {     id: "01k95a7e4p6qje8830n977bnws"   } } YdbStatus: UNAVAILABLE ConsumedRu: 1 , code: 500001 
2025-11-03T16:53:55.990597Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Write session will restart in 2.000000s
2025-11-03T16:53:55.990693Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Write session: Do CDS request
2025-11-03T16:53:55.990724Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Do schedule cds request after 2000 ms
2025-11-03T16:53:56.686277Z node 2 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976720777. Failed to resolve tablet: 72075186224037888 after several retries.
2025-11-03T16:53:56.686425Z node 2 :KQP_EXECUTER WARN: kqp_executer_impl.h:245: ActorId: [2:7568543417919518681:3044] TxId: 281474976720777. Ctx: { TraceId: 01k95a7e8c3gb0rp81edk2vchx, Database: /Root, SessionId: ydb://session/3?node_id=2&id=OTJkOWMwOTQtMzE1N2MzMzYtMzNlNzMzMzgtNzI2YWY4ZTg=, PoolId: default}. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037888 after several retries.
2025-11-03T16:53:56.686736Z node 2 :KQP_SESSION WARN: kqp_session_actor.cpp:2987: SessionId: ydb://session/3?node_id=2&id=OTJkOWMwOTQtMzE1N2MzMzYtMzNlNzMzMzgtNzI2YWY4ZTg=, ActorId: [2:7568543417919518668:3044], ActorState: ExecuteState, TraceId: 01k95a7e8c3gb0rp81edk2vchx, Create QueryResponse for error on request, msg: 
2025-11-03T16:53:56.687640Z node 2 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Failed to resolve tablet: 72075186224037888 after several retries." severity: 1 } TxMeta { id: "01k95a7esmcxtqmfz3e12a1bm5" } } YdbStatus: UNAVAILABLE ConsumedRu: 348 }
2025-11-03T16:53:57.991582Z :INFO: [/Root] MessageGroupId [test-message-group-id] Running cds request ms
2025-11-03T16:53:58.002552Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Got CDS response: 
write_sessions_clusters { clusters { endpoint: "localhost:1567" name: "dc1" available: true } primary_cluster_selection_reason: CLIENT_LOCATION } version: 1
2025-11-03T16:53:58.002606Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Start write session. Will connect to endpoint: localhost:1567
2025-11-03T16:53:58.016291Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" }
2025-11-03T16:53:58.016606Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-11-03T16:53:58.016638Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 52
2025-11-03T16:53:58.017056Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 52 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" }
2025-11-03T16:53:58.017187Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 52 topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" from ipv6:[::1]:34482
2025-11-03T16:53:58.017206Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=52 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:34482 proto=v1  topic=test-topic durationSec=0
2025-11-03T16:53:58.017216Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-11-03T16:53:58.018670Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 52 sessionId:  describe result for acl check
2025-11-03T16:53:58.018783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-11-03T16:53:58.018795Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-11-03T16:53:58.018804Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-11-03T16:53:58.018820Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7568543430806879686:3460] (SourceId=test-message-group-id, PreferedPartition=(NULL)) StartKqpSession
2025-11-03T16:53:58.021548Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7568543430806879686:3460] (SourceId=test-message-group-id, PreferedPartition=(NULL)) Select from the table
2025-11-03T16:53:58.052836Z node 1 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976715894. Failed to resolve tablet: 72075186224037888 after several retries.
2025-11-03T16:53:58.052916Z node 1 :KQP_EXECUTER WARN: kqp_executer_impl.h:245: ActorId: [1:7568543426511912320:3450] TxId: 281474976715894. Ctx: { TraceId: 01k95a7fn736dvryp50dqmv4th, Database: /Root, SessionId: ydb://session/3?node_id=1&id=YTE5NDAzMDUtODYyMDk2ZjgtODI4MmFlMmMtYjNkYmJmN2Q=, PoolId: default}. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037888 after several retries.
2025-11-03T16:53:58.053128Z node 1 :KQP_SESSION WARN: kqp_session_actor.cpp:2987: SessionId: ydb://session/3?node_id=1&id=YTE5NDAzMDUtODYyMDk2ZjgtODI4MmFlMmMtYjNkYmJmN2Q=, ActorId: [1:7568543422216944999:3450], ActorState: ExecuteState, TraceId: 01k95a7fn736dvryp50dqmv4th, Create QueryResponse for error on request, msg: 
2025-11-03T16:53:58.054217Z node 1 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Failed to resolve tablet: 72075186224037888 after several retries." severity: 1 } TxMeta { id: "01k95a7g5xcfv18fd9e5hbskv7" } } YdbStatus: UNAVAILABLE ConsumedRu: 352 }
2025-11-03T16:53:59.025094Z node 1 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976715895. Failed to resolve tablet: 72075186224037891 after several retries.
2025-11-03T16:53:59.025216Z node 1 :KQP_EXECUTER WARN: kqp_executer_impl.h:245: ActorId: [1:7568543430806879694:3462] TxId: 281474976715895. Ctx: { TraceId: 01k95a7h454cqbsb00q74721mk, Database: /Root, SessionId: ydb://session/3?node_id=1&id=Yzk3NDg3NmYtZDI5NjMwMTgtYmZhODFiZmYtODQ3YTE0NTA=, PoolId: default}. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037891 after several retries.
2025-11-03T16:53:59.025437Z node 1 :KQP_SESSION WARN: kqp_session_actor.cpp:2987: SessionId: ydb://session/3?node_id=1&id=Yzk3NDg3NmYtZDI5NjMwMTgtYmZhODFiZmYtODQ3YTE0NTA=, ActorId: [1:7568543430806879687:3462], ActorState: ExecuteState, TraceId: 01k95a7h454cqbsb00q74721mk, Create QueryResponse for error on request, msg: 
Test retry state: get retry delay
2025-11-03T16:53:59.028386Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: kqp error Marker# PQ50 : Response {   SessionId: "ydb://session/3?node_id=1&id=Yzk3NDg3NmYtZDI5NjMwMTgtYmZhODFiZmYtODQ3YTE0NTA="   QueryIssues {     message: "Failed to resolve tablet: 72075186224037891 after several retries."     severity: 1   }   TxMeta {     id: "01k95a7h46b4hvbktfphq720vp"   } } YdbStatus: UNAVAILABLE ConsumedRu: 1 , code: 500001 
2025-11-03T16:53:59.028418Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Write session will restart in 2.000000s
2025-11-03T16:53:59.028503Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Write session: Do CDS request
2025-11-03T16:53:59.028534Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Do schedule cds request after 2000 ms
2025-11-03T16:53:59.026950Z node 1 :PQ_PARTITION_CHOOSER INFO: partition_chooser_impl__abstract_chooser_actor.h:312: TPartitionChooser [1:7568543430806879686:3460] (SourceId=test-message-group-id, PreferedPartition=(NULL)) ReplyError: kqp error Marker# PQ50 : Response {
  SessionId: "ydb://session/3?node_id=1&id=Yzk3NDg3NmYtZDI5NjMwMTgtYmZhODFiZmYtODQ3YTE0NTA="
  QueryIssues {
    message: "Failed to resolve tablet: 72075186224037891 after several retries."
    severity: 1
  }
  TxMeta {
    id: "01k95a7h46b4hvbktfphq720vp"
  }
}
YdbStatus: UNAVAILABLE
ConsumedRu: 1
2025-11-03T16:53:59.027029Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 52 reason: kqp error Marker# PQ50 : Response {
  SessionId: "ydb://session/3?node_id=1&id=Yzk3NDg3NmYtZDI5NjMwMTgtYmZhODFiZmYtODQ3YTE0NTA="
  QueryIssues {
    message: "Failed to resolve tablet: 72075186224037891 after several retries."
    severity: 1
  }
  TxMeta {
    id: "01k95a7h46b4hvbktfphq720vp"
  }
}
YdbStatus: UNAVAILABLE
ConsumedRu: 1
 sessionId: 
2025-11-03T16:53:59.027399Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 52 sessionId:  is DEAD
2025-11-03T16:53:59.203342Z node 2 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976720779. Failed to resolve tablet: 72075186224037888 after several retries.
2025-11-03T16:53:59.203453Z node 2 :KQP_EXECUTER WARN: kqp_executer_impl.h:245: ActorId: [2:7568543430804420654:3054] TxId: 281474976720779. Ctx: { TraceId: 01k95a7gsv0kew3fk3grznac50, Database: /Root, SessionId: ydb://session/3?node_id=2&id=MmQzY2ExMWMtNDJkY2IyMjYtMWFkNTQ1YjktMWM3YjQ1YQ==, PoolId: default}. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037888 after several retries.
2025-11-03T16:53:59.203698Z node 2 :KQP_SESSION WARN: kqp_session_actor.cpp:2987: SessionId: ydb://session/3?node_id=2&id=MmQzY2ExMWMtNDJkY2IyMjYtMWFkNTQ1YjktMWM3YjQ1YQ==, ActorId: [2:7568543426509453341:3054], ActorState: ExecuteState, TraceId: 01k95a7gsv0kew3fk3grznac50, Create QueryResponse for error on request, msg: 
2025-11-03T16:53:59.204793Z node 2 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Failed to resolve tablet: 72075186224037888 after several retries." severity: 1 } TxMeta { id: "01k95a7h961tspg91az01ezygg" } } YdbStatus: UNAVAILABLE ConsumedRu: 320 }
2025-11-03T16:54:00.544066Z node 1 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976715898. Failed to resolve tablet: 72075186224037888 after several retries.
2025-11-03T16:54:00.544184Z node 1 :KQP_EXECUTER WARN: kqp_executer_impl.h:245: ActorId: [1:7568543435101847063:3466] TxId: 281474976715898. Ctx: { TraceId: 01k95a7j4keh8tjz4xxpqhvw0f, Database: /Root, SessionId: ydb://session/3?node_id=1&id=NzI4M2Y3YjItNjZlNmQ2YjktNGQ0ODUxOTctZWQ4NmRiYmQ=, PoolId: default}. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037888 after several retries.
2025-11-03T16:54:00.544439Z node 1 :KQP_SESSION WARN: kqp_session_actor.cpp:2987: SessionId: ydb://session/3?node_id=1&id=NzI4M2Y3YjItNjZlNmQ2YjktNGQ0ODUxOTctZWQ4NmRiYmQ=, ActorId: [1:7568543435101847046:3466], ActorState: ExecuteState, TraceId: 01k95a7j4keh8tjz4xxpqhvw0f, Create QueryResponse for error on request, msg: 
2025-11-03T16:54:00.545666Z node 1 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Failed to resolve tablet: 72075186224037888 after several retries." severity: 1 } TxMeta { id: "01k95a7jm94m3qz3n7j2g3w4tj" } } YdbStatus: UNAVAILABLE ConsumedRu: 331 }
2025-11-03T16:54:01.032184Z :INFO: [/Root] MessageGroupId [test-message-group-id] Running cds request ms
2025-11-03T16:54:01.041735Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Got CDS response: 
write_sessions_clusters { clusters { endpoint: "localhost:1567" name: "dc1" available: true } primary_cluster_selection_reason: CLIENT_LOCATION } version: 1
2025-11-03T16:54:01.041789Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Start write session. Will connect to endpoint: localhost:1567
2025-11-03T16:54:01.045414Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" }
2025-11-03T16:54:01.048650Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-11-03T16:54:01.048682Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 53
2025-11-03T16:54:01.050469Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 53 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" }
2025-11-03T16:54:01.050612Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 53 topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" from ipv6:[::1]:34482
2025-11-03T16:54:01.050630Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=53 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:34482 proto=v1  topic=test-topic durationSec=0
2025-11-03T16:54:01.050641Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-11-03T16:54:01.052257Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 53 sessionId:  describe result for acl check
2025-11-03T16:54:01.052394Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-11-03T16:54:01.052407Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-11-03T16:54:01.052416Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-11-03T16:54:01.052434Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7568543443691781740:3477] (SourceId=test-message-group-id, PreferedPartition=(NULL)) StartKqpSession
2025-11-03T16:54:01.056217Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7568543443691781740:3477] (SourceId=test-message-group-id, PreferedPartition=(NULL)) Select from the table
2025-11-03T16:54:01.683477Z node 2 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976720781. Failed to resolve tablet: 72075186224037888 after several retries.
2025-11-03T16:54:01.683614Z node 2 :KQP_EXECUTER WARN: kqp_executer_impl.h:245: ActorId: [2:7568543439394355326:3066] TxId: 281474976720781. Ctx: { TraceId: 01k95a7k8k14hqasbj8p022abx, Database: /Root, SessionId: ydb://session/3?node_id=2&id=ODg4MjhlZGEtMjgwNjczMDAtZjBmNjUwY2ItY2E3OTE5ZjU=, PoolId: default}. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037888 after several retries.
2025-11-03T16:54:01.683942Z node 2 :KQP_SESSION WARN: kqp_session_actor.cpp:2987: SessionId: ydb://session/3?node_id=2&id=ODg4MjhlZGEtMjgwNjczMDAtZjBmNjUwY2ItY2E3OTE5ZjU=, ActorId: [2:7568543439394355312:3066], ActorState: ExecuteState, TraceId: 01k95a7k8k14hqasbj8p022abx, Create QueryResponse for error on request, msg: 
2025-11-03T16:54:01.685345Z node 2 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Failed to resolve tablet: 72075186224037888 after several retries." severity: 1 } TxMeta { id: "01k95a7kprcxb3r6hvbnwjf2r1" } } YdbStatus: UNAVAILABLE ConsumedRu: 296 }
2025-11-03T16:54:02.034568Z node 1 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976715900. Failed to resolve tablet: 72075186224037891 after several retries.
2025-11-03T16:54:02.034686Z node 1 :KQP_EXECUTER WARN: kqp_executer_impl.h:245: ActorId: [1:7568543443691781750:3479] TxId: 281474976715900. Ctx: { TraceId: 01k95a7m300g0gnsqadj8n572j, Database: /Root, SessionId: ydb://session/3?node_id=1&id=YTI5ZGY4YWItYjhhOWEzOGMtM2Y0NGIzZjItOWFhZTg4ZjA=, PoolId: default}. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037891 after several retries.
2025-11-03T16:54:02.034931Z node 1 :KQP_SESSION WARN: kqp_session_actor.cpp:2987: SessionId: ydb://session/3?node_id=1&id=YTI5ZGY4YWItYjhhOWEzOGMtM2Y0NGIzZjItOWFhZTg4ZjA=, ActorId: [1:7568543443691781741:3479], ActorState: ExecuteState, TraceId: 01k95a7m300g0gnsqadj8n572j, Create QueryResponse for error on request, msg: 
2025-11-03T16:54:02.036592Z node 1 :PQ_PARTITION_CHOOSER INFO: partition_chooser_impl__abstract_chooser_actor.h:312: TPartitionChooser [1:7568543443691781740:3477] (SourceId=test-message-group-id, PreferedPartition=(NULL)) ReplyError: kqp error Marker# PQ50 : Response {
  SessionId: "ydb://session/3?node_id=1&id=YTI5ZGY4YWItYjhhOWEzOGMtM2Y0NGIzZjItOWFhZTg4ZjA="
  QueryIssues {
    message: "Failed to resolve tablet: 72075186224037891 after several retries."
    severity: 1
  }
  TxMeta {
    id: "01k95a7m3587fa0eytn17ge2ad"
  }
}
YdbStatus: UNAVAILABLE
ConsumedRu: 1
2025-11-03T16:54:02.036679Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 53 reason: kqp error Marker# PQ50 : Response {
  SessionId: "ydb://session/3?node_id=1&id=YTI5ZGY4YWItYjhhOWEzOGMtM2Y0NGIzZjItOWFhZTg4ZjA="
  QueryIssues {
    message: "Failed to resolve tablet: 72075186224037891 after several retries."
    severity: 1
  }
  TxMeta {
    id: "01k95a7m3587fa0eytn17ge2ad"
  }
}
YdbStatus: UNAVAILABLE
ConsumedRu: 1
 sessionId: 
2025-11-03T16:54:02.037055Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 53 sessionId:  is DEAD
Test retry state: get retry delay
2025-11-03T16:54:02.040535Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: kqp error Marker# PQ50 : Response {   SessionId: "ydb://session/3?node_id=1&id=YTI5ZGY4YWItYjhhOWEzOGMtM2Y0NGIzZjItOWFhZTg4ZjA="   QueryIssues {     message: "Failed to resolve tablet: 72075186224037891 after several retries."     severity: 1   }   TxMeta {     id: "01k95a7m3587fa0eytn17ge2ad"   } } YdbStatus: UNAVAILABLE ConsumedRu: 1 , code: 500001 
2025-11-03T16:54:02.040576Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Write session will restart in 2.000000s
2025-11-03T16:54:02.040658Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Write session: Do CDS request
2025-11-03T16:54:02.040695Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Do schedule cds request after 2000 ms
2025-11-03T16:54:02.918421Z node 1 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976715901. Failed to resolve tablet: 72075186224037890 after several retries.
2025-11-03T16:54:02.918542Z node 1 :KQP_EXECUTER WARN: kqp_executer_impl.h:245: ActorId: [1:7568543443691781800:3482] TxId: 281474976715901. Ctx: { TraceId: 01k95a7mjd3c27tpgwnres9wk0, Database: /Root, SessionId: ydb://session/3?node_id=1&id=ZTBhZmMzMGQtYTE2ZDE3N2MtNWI4MmE3ZmYtM2Y1ZmU5ODg=, PoolId: default}. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037890 after several retries.
2025-11-03T16:54:02.918816Z node 1 :KQP_SESSION WARN: kqp_session_actor.cpp:2987: SessionId: ydb://session/3?node_id=1&id=ZTBhZmMzMGQtYTE2ZDE3N2MtNWI4MmE3ZmYtM2Y1ZmU5ODg=, ActorId: [1:7568543443691781774:3482], ActorState: ExecuteState, TraceId: 01k95a7mjd3c27tpgwnres9wk0, Create QueryResponse for error on request, msg: 
2025-11-03T16:54:02.919875Z node 1 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Failed to resolve tablet: 72075186224037890 after several retries." severity: 1 } TxMeta { id: "01k95a7myr8ee53ry0kdqbqfbs" } } YdbStatus: UNAVAILABLE ConsumedRu: 257 }
2025-11-03T16:54:04.046223Z :INFO: [/Root] MessageGroupId [test-message-group-id] Running cds request ms
2025-11-03T16:54:04.052579Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Got CDS response: 
write_sessions_clusters { clusters { endpoint: "localhost:1567" name: "dc1" available: true } primary_cluster_selection_reason: CLIENT_LOCATION } version: 1
2025-11-03T16:54:04.052633Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Start write session. Will connect to endpoint: localhost:1567
2025-11-03T16:54:04.057418Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" }
2025-11-03T16:54:04.058005Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-11-03T16:54:04.058036Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 54
2025-11-03T16:54:04.058523Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 54 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" }
2025-11-03T16:54:04.058639Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 54 topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" from ipv6:[::1]:34482
2025-11-03T16:54:04.058653Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=54 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:34482 proto=v1  topic=test-topic durationSec=0
2025-11-03T16:54:04.058663Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-11-03T16:54:04.060101Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 54 sessionId:  describe result for acl check
2025-11-03T16:54:04.060204Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-11-03T16:54:04.060213Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-11-03T16:54:04.060223Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-11-03T16:54:04.060237Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7568543456576683806:3500] (SourceId=test-message-group-id, PreferedPartition=(NULL)) StartKqpSession
2025-11-03T16:54:04.062886Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7568543456576683806:3500] (SourceId=test-message-group-id, PreferedPartition=(NULL)) Select from the table
2025-11-03T16:54:04.165639Z node 2 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976720783. Failed to resolve tablet: 72075186224037888 after several retries.
2025-11-03T16:54:04.165770Z node 2 :KQP_EXECUTER WARN: kqp_executer_impl.h:245: ActorId: [2:7568543452279257298:3076] TxId: 281474976720783. Ctx: { TraceId: 01k95a7np18q5kfct9htxt8drj, Database: /Root, SessionId: ydb://session/3?node_id=2&id=YjViMDEzMmMtOGFmMDM3OGQtNTdiNDlmOTctZDY5NWQ0Mjk=, PoolId: default}. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037888 after several retries.
2025-11-03T16:54:04.166072Z node 2 :KQP_SESSION WARN: kqp_session_actor.cpp:2987: SessionId: ydb://session/3?node_id=2&id=YjViMDEzMmMtOGFmMDM3OGQtNTdiNDlmOTctZDY5NWQ0Mjk=, ActorId: [2:7568543447984289985:3076], ActorState: ExecuteState, TraceId: 01k95a7np18q5kfct9htxt8drj, Create QueryResponse for error on request, msg: 
2025-11-03T16:54:04.167417Z node 2 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Failed to resolve tablet: 72075186224037888 after several retries." severity: 1 } TxMeta { id: "01k95a7p485zr6crzmveg7dzbn" } } YdbStatus: UNAVAILABLE ConsumedRu: 297 }
2025-11-03T16:54:05.114345Z node 1 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976715904. Failed to resolve tablet: 72075186224037891 after several retries.
2025-11-03T16:54:05.114467Z node 1 :KQP_EXECUTER WARN: kqp_executer_impl.h:245: ActorId: [1:7568543456576683816:3502] TxId: 281474976715904. Ctx: { TraceId: 01k95a7q0z2bjfegpfsgpqeb4c, Database: /Root, SessionId: ydb://session/3?node_id=1&id=YzAzNTFkOTMtOTNhNDNmZGItYzgxOGExMzAtM2U2YWM4YWY=, PoolId: default}. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037891 after several retries.
2025-11-03T16:54:05.114679Z node 1 :KQP_SESSION WARN: kqp_session_actor.cpp:2987: SessionId: ydb://session/3?node_id=1&id=YzAzNTFkOTMtOTNhNDNmZGItYzgxOGExMzAtM2U2YWM4YWY=, ActorId: [1:7568543456576683807:3502], ActorState: ExecuteState, TraceId: 01k95a7q0z2bjfegpfsgpqeb4c, Create QueryResponse for error on request, msg: 
2025-11-03T16:54:05.117330Z node 1 :PQ_PARTITION_CHOOSER INFO: partition_chooser_impl__abstract_chooser_actor.h:312: TPartitionChooser [1:7568543456576683806:3500] (SourceId=test-message-group-id, PreferedPartition=(NULL)) ReplyError: kqp error Marker# PQ50 : Response {
  SessionId: "ydb://session/3?node_id=1&id=YzAzNTFkOTMtOTNhNDNmZGItYzgxOGExMzAtM2U2YWM4YWY="
  QueryIssues {
    message: "Failed to resolve tablet: 72075186224037891 after several retries."
    severity: 1
  }
  TxMeta {
    id: "01k95a7q0z2bjfegpfskw8y07e"
  }
}
YdbStatus: UNAVAILABLE
ConsumedRu: 40
2025-11-03T16:54:05.117407Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 54 reason: kqp error Marker# PQ50 : Response {
  SessionId: "ydb://session/3?node_id=1&id=YzAzNTFkOTMtOTNhNDNmZGItYzgxOGExMzAtM2U2YWM4YWY="
  QueryIssues {
    message: "Failed to resolve tablet: 72075186224037891 after several retries."
    severity: 1
  }
  TxMeta {
    id: "01k95a7q0z2bjfegpfskw8y07e"
  }
}
YdbStatus: UNAVAILABLE
ConsumedRu: 40
 sessionId: 
2025-11-03T16:54:05.117701Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 54 sessionId:  is DEAD
Test retry state: get retry delay
2025-11-03T16:54:05.119842Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: kqp error Marker# PQ50 : Response {   SessionId: "ydb://session/3?node_id=1&id=YzAzNTFkOTMtOTNhNDNmZGItYzgxOGExMzAtM2U2YWM4YWY="   QueryIssues {     message: "Failed to resolve tablet: 72075186224037891 after several retries."     severity: 1   }   TxMeta {     id: "01k95a7q0z2bjfegpfskw8y07e"   } } YdbStatus: UNAVAILABLE ConsumedRu: 40 , code: 500001 
2025-11-03T16:54:05.119895Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Write session will restart in 2.000000s
2025-11-03T16:54:05.119952Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Write session: Do CDS request
2025-11-03T16:54:05.119989Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Do schedule cds request after 2000 ms
2025-11-03T16:54:05.316458Z node 1 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976715905. Failed to resolve tablet: 72075186224037890 after several retries.
2025-11-03T16:54:05.316591Z node 1 :KQP_EXECUTER WARN: kqp_executer_impl.h:245: ActorId: [1:7568543456576683830:3493] TxId: 281474976715905. Ctx: { TraceId: 01k95a7pwjc5mhka0sbj5eewj0, Database: /Root, SessionId: ydb://session/3?node_id=1&id=YjNiYmE3YjktYWE4NTE3N2MtNjQ5N2IzMGUtMzgzMDk4MmQ=, PoolId: default}. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037890 after several retries.
2025-11-03T16:54:05.316866Z node 1 :KQP_SESSION WARN: kqp_session_actor.cpp:2987: SessionId: ydb://session/3?node_id=1&id=YjNiYmE3YjktYWE4NTE3N2MtNjQ5N2IzMGUtMzgzMDk4MmQ=, ActorId: [1:7568543452281716488:3493], ActorState: ExecuteState, TraceId: 01k95a7pwjc5mhka0sbj5eewj0, Create QueryResponse for error on request, msg: 
2025-11-03T16:54:05.317684Z node 1 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Failed to resolve tablet: 72075186224037890 after several retries." severity: 1 } TxMeta { id: "01k95a7q908b0geezkyv6kwr8g" } } YdbStatus: UNAVAILABLE ConsumedRu: 256 }
2025-11-03T16:54:06.713632Z node 2 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976720785. Failed to resolve tablet: 72075186224037888 after several retries.
2025-11-03T16:54:06.713761Z node 2 :KQP_EXECUTER WARN: kqp_executer_impl.h:245: ActorId: [2:7568543460869191970:3088] TxId: 281474976720785. Ctx: { TraceId: 01k95a7r3j36tt82wxhbsvrcnc, Database: /Root, SessionId: ydb://session/3?node_id=2&id=ZDljMzJlMzUtYzE4NmQ2ZGQtOTZhM2FkYmYtY2M3YTNkNTQ=, PoolId: default}. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037888 after several retries.
2025-11-03T16:54:06.714028Z node 2 :KQP_SESSION WARN: kqp_session_actor.cpp:2987: SessionId: ydb://session/3?node_id=2&id=ZDljMzJlMzUtYzE4NmQ2ZGQtOTZhM2FkYmYtY2M3YTNkNTQ=, ActorId: [2:7568543460869191956:3088], ActorState: ExecuteState, TraceId: 01k95a7r3j36tt82wxhbsvrcnc, Create QueryResponse for error on request, msg: 
2025-11-03T16:54:06.724524Z node 2 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Failed to resolve tablet: 72075186224037888 after several retries." severity: 1 } TxMeta { id: "01k95a7rm4bc225drr748dhs9p" } } YdbStatus: UNAVAILABLE ConsumedRu: 345 }
2025-11-03T16:54:07.121221Z :INFO: [/Root] MessageGroupId [test-message-group-id] Running cds request ms
2025-11-03T16:54:07.132014Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Got CDS response: 
write_sessions_clusters { clusters { endpoint: "localhost:1567" name: "dc1" available: true } primary_cluster_selection_reason: CLIENT_LOCATION } version: 1
2025-11-03T16:54:07.132068Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Start write session. Will connect to endpoint: localhost:1567
2025-11-03T16:54:07.135727Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" }
2025-11-03T16:54:07.135541Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-11-03T16:54:07.135580Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 55
2025-11-03T16:54:07.138752Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 55 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" }
2025-11-03T16:54:07.138946Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 55 topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" from ipv6:[::1]:34482
2025-11-03T16:54:07.138978Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=55 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:34482 proto=v1  topic=test-topic durationSec=0
2025-11-03T16:54:07.138989Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-11-03T16:54:07.140485Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 55 sessionId:  describe result for acl check
2025-11-03T16:54:07.140600Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-11-03T16:54:07.140613Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-11-03T16:54:07.140623Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-11-03T16:54:07.140640Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7568543469461585885:3517] (SourceId=test-message-group-id, PreferedPartition=(NULL)) StartKqpSession
2025-11-03T16:54:07.145576Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7568543469461585885:3517] (SourceId=test-message-group-id, PreferedPartition=(NULL)) Select from the table
2025-11-03T16:54:07.785484Z node 1 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976715908. Failed to resolve tablet: 72075186224037888 after several retries.
2025-11-03T16:54:07.785607Z node 1 :KQP_EXECUTER WARN: kqp_executer_impl.h:245: ActorId: [1:7568543465166618555:3509] TxId: 281474976715908. Ctx: { TraceId: 01k95a7s7h7c8r8y2zqn8pjebm, Database: /Root, SessionId: ydb://session/3?node_id=1&id=ZGQxZjFjYWEtMjc5ODllYS00ODIzODY1OC01Yjg3MTEzNw==, PoolId: default}. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037888 after several retries.
2025-11-03T16:54:07.785868Z node 1 :KQP_SESSION WARN: kqp_session_actor.cpp:2987: SessionId: ydb://session/3?node_id=1&id=ZGQxZjFjYWEtMjc5ODllYS00ODIzODY1OC01Yjg3MTEzNw==, ActorId: [1:7568543465166618537:3509], ActorState: ExecuteState, TraceId: 01k95a7s7h7c8r8y2zqn8pjebm, Create QueryResponse for error on request, msg: 
2025-11-03T16:54:07.786768Z node 1 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Failed to resolve tablet: 72075186224037888 after several retries." severity: 1 } TxMeta { id: "01k95a7spw1gx1hq9tjmznma11" } } YdbStatus: UNAVAILABLE ConsumedRu: 322 }
2025-11-03T16:54:08.125322Z node 1 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976715909. Failed to resolve tablet: 72075186224037891 after several retries.
2025-11-03T16:54:08.125448Z node 1 :KQP_EXECUTER WARN: kqp_executer_impl.h:245: ActorId: [1:7568543469461585893:3519] TxId: 281474976715909. Ctx: { TraceId: 01k95a7t1afh65mc34fffj9rgn, Database: /Root, SessionId: ydb://session/3?node_id=1&id=ZTFhYjE1MC03NGVkNzBiMC0zOGFiNmI5Ni00ZDk4ZTEzMw==, PoolId: default}. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037891 after several retries.
2025-11-03T16:54:08.125699Z node 1 :KQP_SESSION WARN: kqp_session_actor.cpp:2987: SessionId: ydb://session/3?node_id=1&id=ZTFhYjE1MC03NGVkNzBiMC0zOGFiNmI5Ni00ZDk4ZTEzMw==, ActorId: [1:7568543469461585886:3519], ActorState: ExecuteState, TraceId: 01k95a7t1afh65mc34fffj9rgn, Create QueryResponse for error on request, msg: 
2025-11-03T16:54:08.126870Z node 1 :PQ_PARTITION_CHOOSER INFO: partition_chooser_impl__abstract_chooser_actor.h:312: TPartitionChooser [1:7568543469461585885:3517] (SourceId=test-message-group-id, PreferedPartition=(NULL)) ReplyError: kqp error Marker# PQ50 : Response {
  SessionId: "ydb://session/3?node_id=1&id=ZTFhYjE1MC03NGVkNzBiMC0zOGFiNmI5Ni00ZDk4ZTEzMw=="
  QueryIssues {
    message: "Failed to resolve tablet: 72075186224037891 after several retries."
    severity: 1
  }
  TxMeta {
    id: "01k95a7t1b0grk44gp93k18k4t"
  }
}
YdbStatus: UNAVAILABLE
ConsumedRu: 1
2025-11-03T16:54:08.126965Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 55 reason: kqp error Marker# PQ50 : Response {
  SessionId: "ydb://session/3?node_id=1&id=ZTFhYjE1MC03NGVkNzBiMC0zOGFiNmI5Ni00ZDk4ZTEzMw=="
  QueryIssues {
    message: "Failed to resolve tablet: 72075186224037891 after several retries."
    severity: 1
  }
  TxMeta {
    id: "01k95a7t1b0grk44gp93k18k4t"
  }
}
YdbStatus: UNAVAILABLE
ConsumedRu: 1
 sessionId: 
2025-11-03T16:54:08.127928Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 55 sessionId:  is DEAD
Test retry state: get retry delay
2025-11-03T16:54:08.128372Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: kqp error Marker# PQ50 : Response {   SessionId: "ydb://session/3?node_id=1&id=ZTFhYjE1MC03NGVkNzBiMC0zOGFiNmI5Ni00ZDk4ZTEzMw=="   QueryIssues {     message: "Failed to resolve tablet: 72075186224037891 after several retries."     severity: 1   }   TxMeta {     id: "01k95a7t1b0grk44gp93k18k4t"   } } YdbStatus: UNAVAILABLE ConsumedRu: 1 , code: 500001 
2025-11-03T16:54:08.128407Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Write session will restart in 2.000000s
2025-11-03T16:54:08.128493Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Write session: Do CDS request
2025-11-03T16:54:08.128529Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Do schedule cds request after 2000 ms
2025-11-03T16:54:09.115817Z node 2 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976720787. Failed to resolve tablet: 72075186224037888 after several retries.
2025-11-03T16:54:09.115930Z node 2 :KQP_EXECUTER WARN: kqp_executer_impl.h:245: ActorId: [2:7568543473754093942:3098] TxId: 281474976720787. Ctx: { TraceId: 01k95a7tkd8j23sk9rbpj10dts, Database: /Root, SessionId: ydb://session/3?node_id=2&id=NjM4OThhYWUtMmUwN2IxMjQtNWFmYzBmYzktZjM2MjE5NzE=, PoolId: default}. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037888 after several retries.
2025-11-03T16:54:09.116221Z node 2 :KQP_SESSION WARN: kqp_session_actor.cpp:2987: SessionId: ydb://session/3?node_id=2&id=NjM4OThhYWUtMmUwN2IxMjQtNWFmYzBmYzktZjM2MjE5NzE=, ActorId: [2:7568543469459126629:3098], ActorState: ExecuteState, TraceId: 01k95a7tkd8j23sk9rbpj10dts, Create QueryResponse for error on request, msg: 
2025-11-03T16:54:09.117312Z node 2 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Failed to resolve tablet: 72075186224037888 after several retries." severity: 1 } TxMeta { id: "01k95a7v0421qn292kwzrze44v" } } YdbStatus: UNAVAILABLE ConsumedRu: 266 }
2025-11-03T16:54:10.129230Z :INFO: [/Root] MessageGroupId [test-message-group-id] Running cds request ms
2025-11-03T16:54:10.137454Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Got CDS response: 
write_sessions_clusters { clusters { endpoint: "localhost:1567" name: "dc1" available: true } primary_cluster_selection_reason: CLIENT_LOCATION } version: 1
2025-11-03T16:54:10.137507Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Start write session. Will connect to endpoint: localhost:1567
2025-11-03T16:54:10.145581Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" }
2025-11-03T16:54:10.148740Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-11-03T16:54:10.148772Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 56
2025-11-03T16:54:10.148877Z node 1 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976715912. Failed to resolve tablet: 72075186224037890 after several retries.
2025-11-03T16:54:10.148985Z node 1 :KQP_EXECUTER WARN: kqp_executer_impl.h:245: ActorId: [1:7568543478051520604:3525] TxId: 281474976715912. Ctx: { TraceId: 01k95a7vnx4c49qdw4pbd3vebr, Database: /Root, SessionId: ydb://session/3?node_id=1&id=MTQ5OTc5YmUtZDFjNWJhNmUtOWZkNDJkNWUtMjI5OTMxNGI=, PoolId: default}. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037890 after several retries.
2025-11-03T16:54:10.149247Z node 1 :KQP_SESSION WARN: kqp_session_actor.cpp:2987: SessionId: ydb://session/3?node_id=1&id=MTQ5OTc5YmUtZDFjNWJhNmUtOWZkNDJkNWUtMjI5OTMxNGI=, ActorId: [1:7568543473756553286:3525], ActorState: ExecuteState, TraceId: 01k95a7vnx4c49qdw4pbd3vebr, Create QueryResponse for error on request, msg: 
2025-11-03T16:54:10.150800Z node 1 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Failed to resolve tablet: 72075186224037890 after several retries." severity: 1 } TxMeta { id: "01k95a7w0wbdsecvj4cfaxamaj" } } YdbStatus: UNAVAILABLE ConsumedRu: 229 }
2025-11-03T16:54:10.151619Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 56 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" }
2025-11-03T16:54:10.151754Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 56 topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" from ipv6:[::1]:34482
2025-11-03T16:54:10.151769Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=56 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:34482 proto=v1  topic=test-topic durationSec=0
2025-11-03T16:54:10.151778Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-11-03T16:54:10.153201Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 56 sessionId:  describe result for acl check
2025-11-03T16:54:10.153335Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-11-03T16:54:10.153345Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-11-03T16:54:10.153354Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-11-03T16:54:10.153373Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7568543482346487976:3534] (SourceId=test-message-group-id, PreferedPartition=(NULL)) StartKqpSession
2025-11-03T16:54:10.156243Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7568543482346487976:3534] (SourceId=test-message-group-id, PreferedPartition=(NULL)) Select from the table
2025-11-03T16:54:11.124509Z node 1 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976715914. Failed to resolve tablet: 72075186224037891 after several retries.
2025-11-03T16:54:11.124626Z node 1 :KQP_EXECUTER WARN: kqp_executer_impl.h:245: ActorId: [1:7568543482346487987:3536] TxId: 281474976715914. Ctx: { TraceId: 01k95a7wzcee46vtns3mcf5kg9, Database: /Root, SessionId: ydb://session/3?node_id=1&id=MzU1MjdlZTEtNzI5ZTY5MzMtNWVmNGRhN2ItOGY0MGQ1Mjc=, PoolId: default}. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037891 after several retries.
2025-11-03T16:54:11.124852Z node 1 :KQP_SESSION WARN: kqp_session_actor.cpp:2987: SessionId: ydb://session/3?node_id=1&id=MzU1MjdlZTEtNzI5ZTY5MzMtNWVmNGRhN2ItOGY0MGQ1Mjc=, ActorId: [1:7568543482346487977:3536], ActorState: ExecuteState, TraceId: 01k95a7wzcee46vtns3mcf5kg9, Create QueryResponse for error on request, msg: 
2025-11-03T16:54:11.125908Z node 1 :PQ_PARTITION_CHOOSER INFO: partition_chooser_impl__abstract_chooser_actor.h:312: TPartitionChooser [1:7568543482346487976:3534] (SourceId=test-message-group-id, PreferedPartition=(NULL)) ReplyError: kqp error Marker# PQ50 : Response {
  SessionId: "ydb://session/3?node_id=1&id=MzU1MjdlZTEtNzI5ZTY5MzMtNWVmNGRhN2ItOGY0MGQ1Mjc="
  QueryIssues {
    message: "Failed to resolve tablet: 72075186224037891 after several retries."
    severity: 1
  }
  TxMeta {
    id: "01k95a7wzddpttef37sc353bym"
  }
}
YdbStatus: UNAVAILABLE
ConsumedRu: 1
2025-11-03T16:54:11.125981Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 56 reason: kqp error Marker# PQ50 : Response {
  SessionId: "ydb://session/3?node_id=1&id=MzU1MjdlZTEtNzI5ZTY5MzMtNWVmNGRhN2ItOGY0MGQ1Mjc="
  QueryIssues {
    message: "Failed to resolve tablet: 72075186224037891 after several retries."
    severity: 1
  }
  TxMeta {
    id: "01k95a7wzddpttef37sc353bym"
  }
}
YdbStatus: UNAVAILABLE
ConsumedRu: 1
 sessionId: 
2025-11-03T16:54:11.126330Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 56 sessionId:  is DEAD
Test retry state: get retry delay
2025-11-03T16:54:11.127733Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: kqp error Marker# PQ50 : Response {   SessionId: "ydb://session/3?node_id=1&id=MzU1MjdlZTEtNzI5ZTY5MzMtNWVmNGRhN2ItOGY0MGQ1Mjc="   QueryIssues {     message: "Failed to resolve tablet: 72075186224037891 after several retries."     severity: 1   }   TxMeta {     id: "01k95a7wzddpttef37sc353bym"   } } YdbStatus: UNAVAILABLE ConsumedRu: 1 , code: 500001 
2025-11-03T16:54:11.127765Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Write session will restart in 2.000000s
2025-11-03T16:54:11.127850Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Write session: Do CDS request
2025-11-03T16:54:11.127884Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Do schedule cds request after 2000 ms
2025-11-03T16:54:11.516083Z node 2 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976720789. Failed to resolve tablet: 72075186224037890 after several retries.
2025-11-03T16:54:11.516216Z node 2 :KQP_EXECUTER WARN: kqp_executer_impl.h:245: ActorId: [2:7568543482344028613:3110] TxId: 281474976720789. Ctx: { TraceId: 01k95a7wy7fjm2vwrt9cfc6akg, Database: /Root, SessionId: ydb://session/3?node_id=2&id=YWRiMmViMWItOGVkOWU5MDUtOGQ3OTY4YTItYTY0OTRkY2U=, PoolId: default}. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037890 after several retries.
2025-11-03T16:54:11.516495Z node 2 :KQP_SESSION WARN: kqp_session_actor.cpp:2987: SessionId: ydb://session/3?node_id=2&id=YWRiMmViMWItOGVkOWU5MDUtOGQ3OTY4YTItYTY0OTRkY2U=, ActorId: [2:7568543482344028600:3110], ActorState: ExecuteState, TraceId: 01k95a7wy7fjm2vwrt9cfc6akg, Create QueryResponse for error on request, msg: 
2025-11-03T16:54:11.523118Z node 2 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Failed to resolve tablet: 72075186224037890 after several retries." severity: 1 } TxMeta { id: "01k95a7xa57qf553375vrtfw9z" } } YdbStatus: UNAVAILABLE ConsumedRu: 248 }
2025-11-03T16:54:12.692479Z node 1 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976715916. Failed to resolve tablet: 72075186224037888 after several retries.
2025-11-03T16:54:12.692604Z node 1 :KQP_EXECUTER WARN: kqp_executer_impl.h:245: ActorId: [1:7568543486641455348:3540] TxId: 281474976715916. Ctx: { TraceId: 01k95a7xyj2hty2t647hpcpczw, Database: /Root, SessionId: ydb://session/3?node_id=1&id=ZTI1NDA1ODUtOTMxZjcyZTItMjAyNjg4ZjItZmFhMjc0NWM=, PoolId: default}. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037888 after several retries.
2025-11-03T16:54:12.692875Z node 1 :KQP_SESSION WARN: kqp_session_actor.cpp:2987: SessionId: ydb://session/3?node_id=1&id=ZTI1NDA1ODUtOTMxZjcyZTItMjAyNjg4ZjItZmFhMjc0NWM=, ActorId: [1:7568543486641455331:3540], ActorState: ExecuteState, TraceId: 01k95a7xyj2hty2t647hpcpczw, Create QueryResponse for error on request, msg: 
2025-11-03T16:54:12.694096Z node 1 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Failed to resolve tablet: 72075186224037888 after several retries." severity: 1 } TxMeta { id: "01k95a7yfra8fc74xymjtm426j" } } YdbStatus: UNAVAILABLE ConsumedRu: 360 }
2025-11-03T16:54:13.134021Z :INFO: [/Root] MessageGroupId [test-message-group-id] Running cds request ms
2025-11-03T16:54:13.140840Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Got CDS response: 
write_sessions_clusters { clusters { endpoint: "localhost:1567" name: "dc1" available: true } primary_cluster_selection_reason: CLIENT_LOCATION } version: 1
2025-11-03T16:54:13.140893Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Start write session. Will connect to endpoint: localhost:1567
2025-11-03T16:54:13.145794Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-11-03T16:54:13.145826Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 57
2025-11-03T16:54:13.148854Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" }
2025-11-03T16:54:13.152410Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 57 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" }
2025-11-03T16:54:13.152581Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 57 topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" from ipv6:[::1]:34482
2025-11-03T16:54:13.152600Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=57 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:34482 proto=v1  topic=test-topic durationSec=0
2025-11-03T16:54:13.152612Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-11-03T16:54:13.157307Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 57 sessionId:  describe result for acl check
2025-11-03T16:54:13.157437Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-11-03T16:54:13.157448Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-11-03T16:54:13.157457Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-11-03T16:54:13.157474Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7568543495231390030:3551] (SourceId=test-message-group-id, PreferedPartition=(NULL)) StartKqpSession
2025-11-03T16:54:13.160236Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7568543495231390030:3551] (SourceId=test-message-group-id, PreferedPartition=(NULL)) Select from the table
2025-11-03T16:54:14.001005Z node 2 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976720791. Failed to resolve tablet: 72075186224037890 after several retries.
2025-11-03T16:54:14.001138Z node 2 :KQP_EXECUTER WARN: kqp_executer_impl.h:245: ActorId: [2:7568543490933963285:3120] TxId: 281474976720791. Ctx: { TraceId: 01k95a7z9ffjm9drhthg82yfjp, Database: /Root, SessionId: ydb://session/3?node_id=2&id=NTdkODJhNjYtMjZjZTZkYi0xOWQ1ZjAwMy05ODY1MDFmYw==, PoolId: default}. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037890 after several retries.
2025-11-03T16:54:14.001405Z node 2 :KQP_SESSION WARN: kqp_session_actor.cpp:2987: SessionId: ydb://session/3?node_id=2&id=NTdkODJhNjYtMjZjZTZkYi0xOWQ1ZjAwMy05ODY1MDFmYw==, ActorId: [2:7568543490933963272:3120], ActorState: ExecuteState, TraceId: 01k95a7z9ffjm9drhthg82yfjp, Create QueryResponse for error on request, msg: 
2025-11-03T16:54:14.002721Z node 2 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Failed to resolve tablet: 72075186224037890 after several retries." severity: 1 } TxMeta { id: "01k95a7zq79tw7mjm7hf4235cb" } } YdbStatus: UNAVAILABLE ConsumedRu: 281 }
2025-11-03T16:54:14.187782Z node 1 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976715918. Failed to resolve tablet: 72075186224037891 after several retries.
2025-11-03T16:54:14.187884Z node 1 :KQP_EXECUTER WARN: kqp_executer_impl.h:245: ActorId: [1:7568543495231390043:3553] TxId: 281474976715918. Ctx: { TraceId: 01k95a7zx8a3ycdw04fg158g83, Database: /Root, SessionId: ydb://session/3?node_id=1&id=YzAwZmE5MjAtNzkyM2ZlOTMtY2I5Y2QzYjYtZDUzOTBjYTk=, PoolId: default}. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037891 after several retries.
2025-11-03T16:54:14.188111Z node 1 :KQP_SESSION WARN: kqp_session_actor.cpp:2987: SessionId: ydb://session/3?node_id=1&id=YzAwZmE5MjAtNzkyM2ZlOTMtY2I5Y2QzYjYtZDUzOTBjYTk=, ActorId: [1:7568543495231390032:3553], ActorState: ExecuteState, TraceId: 01k95a7zx8a3ycdw04fg158g83, Create QueryResponse for error on request, msg: 
2025-11-03T16:54:14.189578Z node 1 :PQ_PARTITION_CHOOSER INFO: partition_chooser_impl__abstract_chooser_actor.h:312: TPartitionChooser [1:7568543495231390030:3551] (SourceId=test-message-group-id, PreferedPartition=(NULL)) ReplyError: kqp error Marker# PQ50 : Response {
  SessionId: "ydb://session/3?node_id=1&id=YzAwZmE5MjAtNzkyM2ZlOTMtY2I5Y2QzYjYtZDUzOTBjYTk="
  QueryIssues {
    message: "Failed to resolve tablet: 72075186224037891 after several retries."
    severity: 1
  }
  TxMeta {
    id: "01k95a7zxce1bet1brffrsx5c6"
  }
}
YdbStatus: UNAVAILABLE
ConsumedRu: 1
2025-11-03T16:54:14.189668Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 57 reason: kqp error Marker# PQ50 : Response {
  SessionId: "ydb://session/3?node_id=1&id=YzAwZmE5MjAtNzkyM2ZlOTMtY2I5Y2QzYjYtZDUzOTBjYTk="
  QueryIssues {
    message: "Failed to resolve tablet: 72075186224037891 after several retries."
    severity: 1
  }
  TxMeta {
    id: "01k95a7zxce1bet1brffrsx5c6"
  }
}
YdbStatus: UNAVAILABLE
ConsumedRu: 1
 sessionId: 
2025-11-03T16:54:14.190020Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 57 sessionId:  is DEAD
Test retry state: get retry delay
2025-11-03T16:54:14.192190Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: kqp error Marker# PQ50 : Response {   SessionId: "ydb://session/3?node_id=1&id=YzAwZmE5MjAtNzkyM2ZlOTMtY2I5Y2QzYjYtZDUzOTBjYTk="   QueryIssues {     message: "Failed to resolve tablet: 72075186224037891 after several retries."     severity: 1   }   TxMeta {     id: "01k95a7zxce1bet1brffrsx5c6"   } } YdbStatus: UNAVAILABLE ConsumedRu: 1 , code: 500001 
2025-11-03T16:54:14.192226Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Write session will restart in 2.000000s
2025-11-03T16:54:14.192315Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Write session: Do CDS request
2025-11-03T16:54:14.192351Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Do schedule cds request after 2000 ms
2025-11-03T16:54:15.168795Z node 1 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976715919. Failed to resolve tablet: 72075186224037890 after several retries.
2025-11-03T16:54:15.168919Z node 1 :KQP_EXECUTER WARN: kqp_executer_impl.h:245: ActorId: [1:7568543499526357395:3556] TxId: 281474976715919. Ctx: { TraceId: 01k95a80e3332s51gcp36gs370, Database: /Root, SessionId: ydb://session/3?node_id=1&id=Nzk2NjJhYTktNTRkNzVlY2MtODU4Mzk2Ny0yNTIwYmI0Yg==, PoolId: default}. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037890 after several retries.
2025-11-03T16:54:15.169193Z node 1 :KQP_SESSION WARN: kqp_session_actor.cpp:2987: SessionId: ydb://session/3?node_id=1&id=Nzk2NjJhYTktNTRkNzVlY2MtODU4Mzk2Ny0yNTIwYmI0Yg==, ActorId: [1:7568543495231390063:3556], ActorState: ExecuteState, TraceId: 01k95a80e3332s51gcp36gs370, Create QueryResponse for error on request, msg: 
2025-11-03T16:54:15.170571Z node 1 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Failed to resolve tablet: 72075186224037890 after several retries." severity: 1 } TxMeta { id: "01k95a80x44ta486ptxw79536v" } } YdbStatus: UNAVAILABLE ConsumedRu: 312 }
2025-11-03T16:54:16.196063Z :INFO: [/Root] MessageGroupId [test-message-group-id] Running cds request ms
2025-11-03T16:54:16.202365Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Got CDS response: 
write_sessions_clusters { clusters { endpoint: "localhost:1567" name: "dc1" available: true } primary_cluster_selection_reason: CLIENT_LOCATION } version: 1
2025-11-03T16:54:16.202435Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Start write session. Will connect to endpoint: localhost:1567
2025-11-03T16:54:16.206037Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" }
2025-11-03T16:54:16.206497Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-11-03T16:54:16.206527Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 58
2025-11-03T16:54:16.206892Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 58 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" }
2025-11-03T16:54:16.207016Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 58 topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" from ipv6:[::1]:34482
2025-11-03T16:54:16.207031Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=58 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:34482 proto=v1  topic=test-topic durationSec=0
2025-11-03T16:54:16.207043Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-11-03T16:54:16.208589Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 58 sessionId:  describe result for acl check
2025-11-03T16:54:16.208711Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-11-03T16:54:16.208722Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-11-03T16:54:16.208731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-11-03T16:54:16.208747Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7568543508116292089:3570] (SourceId=test-message-group-id, PreferedPartition=(NULL)) StartKqpSession
2025-11-03T16:54:16.211583Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7568543508116292089:3570] (SourceId=test-message-group-id, PreferedPartition=(NULL)) Select from the table
2025-11-03T16:54:16.529051Z node 2 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976720793. Failed to resolve tablet: 72075186224037890 after several retries.
2025-11-03T16:54:16.529185Z node 2 :KQP_EXECUTER WARN: kqp_executer_impl.h:245: ActorId: [2:7568543503818865256:3130] TxId: 281474976720793. Ctx: { TraceId: 01k95a81px07tna2h3195tvxaj, Database: /Root, SessionId: ydb://session/3?node_id=2&id=MjUyYmYwZDItZjdkZTI4MDYtNTBjYzVhYjktNTY4NjkzNWE=, PoolId: default}. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037890 after several retries.
2025-11-03T16:54:16.529451Z node 2 :KQP_SESSION WARN: kqp_session_actor.cpp:2987: SessionId: ydb://session/3?node_id=2&id=MjUyYmYwZDItZjdkZTI4MDYtNTBjYzVhYjktNTY4NjkzNWE=, ActorId: [2:7568543503818865239:3130], ActorState: ExecuteState, TraceId: 01k95a81px07tna2h3195tvxaj, Create QueryResponse for error on request, msg: 
2025-11-03T16:54:16.530726Z node 2 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Failed to resolve tablet: 72075186224037890 after several retries." severity: 1 } TxMeta { id: "01k95a82604f0bym1e4r492y1a" } } YdbStatus: UNAVAILABLE ConsumedRu: 315 }
2025-11-03T16:54:17.248244Z node 1 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976715922. Failed to resolve tablet: 72075186224037891 after several retries.
2025-11-03T16:54:17.248384Z node 1 :KQP_EXECUTER WARN: kqp_executer_impl.h:245: ActorId: [1:7568543508116292111:3572] TxId: 281474976715922. Ctx: { TraceId: 01k95a82wk2z5vr30met1ft64s, Database: /Root, SessionId: ydb://session/3?node_id=1&id=NmRhOThkZmItNWIzNTk4ZDUtOGZlMmVhNS1kNGVkMDk3Mg==, PoolId: default}. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037891 after several retries.
2025-11-03T16:54:17.248634Z node 1 :KQP_SESSION WARN: kqp_session_actor.cpp:2987: SessionId: ydb://session/3?node_id=1&id=NmRhOThkZmItNWIzNTk4ZDUtOGZlMmVhNS1kNGVkMDk3Mg==, ActorId: [1:7568543508116292090:3572], ActorState: ExecuteState, TraceId: 01k95a82wk2z5vr30met1ft64s, Create QueryResponse for error on request, msg: 
2025-11-03T16:54:17.250076Z node 1 :PQ_PARTITION_CHOOSER INFO: partition_chooser_impl__abstract_chooser_actor.h:312: TPartitionChooser [1:7568543508116292089:3570] (SourceId=test-message-group-id, PreferedPartition=(NULL)) ReplyError: kqp error Marker# PQ50 : Response {
  SessionId: "ydb://session/3?node_id=1&id=NmRhOThkZmItNWIzNTk4ZDUtOGZlMmVhNS1kNGVkMDk3Mg=="
  QueryIssues {
    message: "Failed to resolve tablet: 72075186224037891 after several retries."
    severity: 1
  }
  TxMeta {
    id: "01k95a82x08wkjpm29r8hg597r"
  }
}
YdbStatus: UNAVAILABLE
ConsumedRu: 7
2025-11-03T16:54:17.250168Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 58 reason: kqp error Marker# PQ50 : Response {
  SessionId: "ydb://session/3?node_id=1&id=NmRhOThkZmItNWIzNTk4ZDUtOGZlMmVhNS1kNGVkMDk3Mg=="
  QueryIssues {
    message: "Failed to resolve tablet: 72075186224037891 after several retries."
    severity: 1
  }
  TxMeta {
    id: "01k95a82x08wkjpm29r8hg597r"
  }
}
YdbStatus: UNAVAILABLE
ConsumedRu: 7
 sessionId: 
2025-11-03T16:54:17.250535Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 58 sessionId:  is DEAD
Test retry state: get retry delay
2025-11-03T16:54:17.251550Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: kqp error Marker# PQ50 : Response {   SessionId: "ydb://session/3?node_id=1&id=NmRhOThkZmItNWIzNTk4ZDUtOGZlMmVhNS1kNGVkMDk3Mg=="   QueryIssues {     message: "Failed to resolve tablet: 72075186224037891 after several retries."     severity: 1   }   TxMeta {     id: "01k95a82x08wkjpm29r8hg597r"   } } YdbStatus: UNAVAILABLE ConsumedRu: 7 , code: 500001 
2025-11-03T16:54:17.251587Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Write session will restart in 2.000000s
2025-11-03T16:54:17.251667Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Write session: Do CDS request
2025-11-03T16:54:17.251719Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Do schedule cds request after 2000 ms
2025-11-03T16:54:17.690858Z node 1 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976715923. Failed to resolve tablet: 72075186224037888 after several retries.
2025-11-03T16:54:17.690984Z node 1 :KQP_EXECUTER WARN: kqp_executer_impl.h:245: ActorId: [1:7568543508116292131:3567] TxId: 281474976715923. Ctx: { TraceId: 01k95a82vg8yn37grjph0yhmme, Database: /Root, SessionId: ydb://session/3?node_id=1&id=YTI5OTE3NjQtNjlkODFlYTQtOGZlMmI3NDktNjI4ZDhiZjg=, PoolId: default}. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037888 after several retries.
2025-11-03T16:54:17.691270Z node 1 :KQP_SESSION WARN: kqp_session_actor.cpp:2987: SessionId: ydb://session/3?node_id=1&id=YTI5OTE3NjQtNjlkODFlYTQtOGZlMmI3NDktNjI4ZDhiZjg=, ActorId: [1:7568543508116292082:3567], ActorState: ExecuteState, TraceId: 01k95a82vg8yn37grjph0yhmme, Create QueryResponse for error on request, msg: 
2025-11-03T16:54:17.696629Z node 1 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Failed to resolve tablet: 72075186224037888 after several retries." severity: 1 } TxMeta { id: "01k95a83b8ecqmrntk97306ash" } } YdbStatus: UNAVAILABLE ConsumedRu: 332 }
2025-11-03T16:54:19.009588Z node 2 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976720795. Failed to resolve tablet: 72075186224037888 after several retries.
2025-11-03T16:54:19.009716Z node 2 :KQP_EXECUTER WARN: kqp_executer_impl.h:245: ActorId: [2:7568543512408799929:3142] TxId: 281474976720795. Ctx: { TraceId: 01k95a845v60tcb3t3pje73gqn, Database: /Root, SessionId: ydb://session/3?node_id=2&id=OTlmMGU3NzYtNzdiOTM3NGUtNzQ5YWJjN2EtMzQ0MzRhNDI=, PoolId: default}. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037888 after several retries.
2025-11-03T16:54:19.009980Z node 2 :KQP_SESSION WARN: kqp_session_actor.cpp:2987: SessionId: ydb://session/3?node_id=2&id=OTlmMGU3NzYtNzdiOTM3NGUtNzQ5YWJjN2EtMzQ0MzRhNDI=, ActorId: [2:7568543512408799916:3142], ActorState: ExecuteState, TraceId: 01k95a845v60tcb3t3pje73gqn, Create QueryResponse for error on request, msg: 
2025-11-03T16:54:19.011482Z node 2 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Failed to resolve tablet: 72075186224037888 after several retries." severity: 1 } TxMeta { id: "01k95a84kk06mfpq2x1t5z5rdx" } } YdbStatus: UNAVAILABLE ConsumedRu: 288 }
2025-11-03T16:54:19.256051Z :INFO: [/Root] MessageGroupId [test-message-group-id] Running cds request ms
2025-11-03T16:54:19.264199Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Got CDS response: 
write_sessions_clusters { clusters { endpoint: "localhost:1567" name: "dc1" available: true } primary_cluster_selection_reason: CLIENT_LOCATION } version: 1
2025-11-03T16:54:19.264254Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Start write session. Will connect to endpoint: localhost:1567
2025-11-03T16:54:19.267333Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-11-03T16:54:19.267363Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 59
2025-11-03T16:54:19.268328Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" }
2025-11-03T16:54:19.268914Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 59 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" }
2025-11-03T16:54:19.269057Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 59 topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" from ipv6:[::1]:34482
2025-11-03T16:54:19.269072Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=59 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:34482 proto=v1  topic=test-topic durationSec=0
2025-11-03T16:54:19.269081Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-11-03T16:54:19.270711Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 59 sessionId:  describe result for acl check
2025-11-03T16:54:19.270829Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-11-03T16:54:19.270839Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-11-03T16:54:19.270850Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-11-03T16:54:19.270866Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7568543521001194165:3591] (SourceId=test-message-group-id, PreferedPartition=(NULL)) StartKqpSession
2025-11-03T16:54:19.273529Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7568543521001194165:3591] (SourceId=test-message-group-id, PreferedPartition=(NULL)) Select from the table
2025-11-03T16:54:20.232199Z node 1 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976715926. Failed to resolve tablet: 72075186224037890 after several retries.
2025-11-03T16:54:20.232315Z node 1 :KQP_EXECUTER WARN: kqp_executer_impl.h:245: ActorId: [1:7568543521001194154:3583] TxId: 281474976715926. Ctx: { TraceId: 01k95a85ah5m5a2gnzp3p4rz1v, Database: /Root, SessionId: ydb://session/3?node_id=1&id=ZDM0M2FkMmItNjE1OGJkMDEtZjFmMjA2MmUtZmQyMmFjODg=, PoolId: default}. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037890 after several retries.
2025-11-03T16:54:20.232577Z node 1 :KQP_SESSION WARN: kqp_session_actor.cpp:2987: SessionId: ydb://session/3?node_id=1&id=ZDM0M2FkMmItNjE1OGJkMDEtZjFmMjA2MmUtZmQyMmFjODg=, ActorId: [1:7568543516706226832:3583], ActorState: ExecuteState, TraceId: 01k95a85ah5m5a2gnzp3p4rz1v, Create QueryResponse for error on request, msg: 
2025-11-03T16:54:20.233886Z node 1 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Failed to resolve tablet: 72075186224037890 after several retries." severity: 1 } TxMeta { id: "01k95a85vf0gccq44gdtfzq84d" } } YdbStatus: UNAVAILABLE ConsumedRu: 351 }
2025-11-03T16:54:20.269017Z node 1 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976715927. Failed to resolve tablet: 72075186224037891 after several retries.
2025-11-03T16:54:20.269126Z node 1 :KQP_EXECUTER WARN: kqp_executer_impl.h:245: ActorId: [1:7568543521001194176:3593] TxId: 281474976715927. Ctx: { TraceId: 01k95a85wa7mh38msxzp0y0b38, Database: /Root, SessionId: ydb://session/3?node_id=1&id=NjM5YzZkOTgtYmViYjFkYWQtMzc4NzJjMmMtNTY5OTZlYmM=, PoolId: default}. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037891 after several retries.
2025-11-03T16:54:20.269336Z node 1 :KQP_SESSION WARN: kqp_session_actor.cpp:2987: SessionId: ydb://session/3?node_id=1&id=NjM5YzZkOTgtYmViYjFkYWQtMzc4NzJjMmMtNTY5OTZlYmM=, ActorId: [1:7568543521001194166:3593], ActorState: ExecuteState, TraceId: 01k95a85wa7mh38msxzp0y0b38, Create QueryResponse for error on request, msg: 
2025-11-03T16:54:20.270776Z node 1 :PQ_PARTITION_CHOOSER INFO: partition_chooser_impl__abstract_chooser_actor.h:312: TPartitionChooser [1:7568543521001194165:3591] (SourceId=test-message-group-id, PreferedPartition=(NULL)) ReplyError: kqp error Marker# PQ50 : Response {
  SessionId: "ydb://session/3?node_id=1&id=NjM5YzZkOTgtYmViYjFkYWQtMzc4NzJjMmMtNTY5OTZlYmM="
  QueryIssues {
    message: "Failed to resolve tablet: 72075186224037891 after several retries."
    severity: 1
  }
  TxMeta {
    id: "01k95a85wa7mh38msxzt07kyat"
  }
}
YdbStatus: UNAVAILABLE
ConsumedRu: 1
2025-11-03T16:54:20.270851Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 59 reason: kqp error Marker# PQ50 : Response {
  SessionId: "ydb://session/3?node_id=1&id=NjM5YzZkOTgtYmViYjFkYWQtMzc4NzJjMmMtNTY5OTZlYmM="
  QueryIssues {
    message: "Failed to resolve tablet: 72075186224037891 after several retries."
    severity: 1
  }
  TxMeta {
    id: "01k95a85wa7mh38msxzt07kyat"
  }
}
YdbStatus: UNAVAILABLE
ConsumedRu: 1
 sessionId: 
2025-11-03T16:54:20.271251Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 59 sessionId:  is DEAD
Test retry state: get retry delay
2025-11-03T16:54:20.276216Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: kqp error Marker# PQ50 : Response {   SessionId: "ydb://session/3?node_id=1&id=NjM5YzZkOTgtYmViYjFkYWQtMzc4NzJjMmMtNTY5OTZlYmM="   QueryIssues {     message: "Failed to resolve tablet: 72075186224037891 after several retries."     severity: 1   }   TxMeta {     id: "01k95a85wa7mh38msxzt07kyat"   } } YdbStatus: UNAVAILABLE ConsumedRu: 1 , code: 500001 
2025-11-03T16:54:20.276251Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Write session will restart in 2.000000s
2025-11-03T16:54:20.276331Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Write session: Do CDS request
2025-11-03T16:54:20.276364Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Do schedule cds request after 2000 ms
2025-11-03T16:54:21.629755Z node 2 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976720797. Failed to resolve tablet: 72075186224037890 after several retries.
2025-11-03T16:54:21.629876Z node 2 :KQP_EXECUTER WARN: kqp_executer_impl.h:245: ActorId: [2:7568543525293701900:3152] TxId: 281474976720797. Ctx: { TraceId: 01k95a86ked71ybbpfnttg7nh3, Database: /Root, SessionId: ydb://session/3?node_id=2&id=YjFhM2IzYWMtZmIzNmY4MjAtN2NiNjUyNGYtYzA4NmE1MDQ=, PoolId: default}. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037890 after several retries.
2025-11-03T16:54:21.630172Z node 2 :KQP_SESSION WARN: kqp_session_actor.cpp:2987: SessionId: ydb://session/3?node_id=2&id=YjFhM2IzYWMtZmIzNmY4MjAtN2NiNjUyNGYtYzA4NmE1MDQ=, ActorId: [2:7568543525293701883:3152], ActorState: ExecuteState, TraceId: 01k95a86ked71ybbpfnttg7nh3, Create QueryResponse for error on request, msg: 
2025-11-03T16:54:21.631629Z node 2 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Failed to resolve tablet: 72075186224037890 after several retries." severity: 1 } TxMeta { id: "01k95a875x91wzbfzgymqxyabv" } } YdbStatus: UNAVAILABLE ConsumedRu: 374 }
2025-11-03T16:54:22.284202Z :INFO: [/Root] MessageGroupId [test-message-group-id] Running cds request ms
2025-11-03T16:54:22.300360Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Got CDS response: 
write_sessions_clusters { clusters { endpoint: "localhost:1567" name: "dc1" available: true } primary_cluster_selection_reason: CLIENT_LOCATION } version: 1
2025-11-03T16:54:22.300416Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Start write session. Will connect to endpoint: localhost:1567
2025-11-03T16:54:22.303994Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" }
2025-11-03T16:54:22.307899Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-11-03T16:54:22.307935Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 60
2025-11-03T16:54:22.308581Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 60 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" }
2025-11-03T16:54:22.308712Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 60 topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" from ipv6:[::1]:34482
2025-11-03T16:54:22.308728Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=60 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:34482 proto=v1  topic=test-topic durationSec=0
2025-11-03T16:54:22.308737Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-11-03T16:54:22.310100Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 60 sessionId:  describe result for acl check
2025-11-03T16:54:22.310189Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-11-03T16:54:22.310200Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-11-03T16:54:22.310210Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-11-03T16:54:22.310225Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7568543533886096241:3608] (SourceId=test-message-group-id, PreferedPartition=(NULL)) StartKqpSession
2025-11-03T16:54:22.312937Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7568543533886096241:3608] (SourceId=test-message-group-id, PreferedPartition=(NULL)) Select from the table
2025-11-03T16:54:22.876162Z node 1 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976715930. Failed to resolve tablet: 72075186224037890 after several retries.
2025-11-03T16:54:22.876282Z node 1 :KQP_EXECUTER WARN: kqp_executer_impl.h:245: ActorId: [1:7568543529591128901:3599] TxId: 281474976715930. Ctx: { TraceId: 01k95a87sq9k6m4g578hpp6z06, Database: /Root, SessionId: ydb://session/3?node_id=1&id=NWZkZjBmYjUtZTg2YTg1M2MtOGM5ZmEyYi0zYzBjM2FjMw==, PoolId: default}. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037890 after several retries.
2025-11-03T16:54:22.876543Z node 1 :KQP_SESSION WARN: kqp_session_actor.cpp:2987: SessionId: ydb://session/3?node_id=1&id=NWZkZjBmYjUtZTg2YTg1M2MtOGM5ZmEyYi0zYzBjM2FjMw==, ActorId: [1:7568543529591128881:3599], ActorState: ExecuteState, TraceId: 01k95a87sq9k6m4g578hpp6z06, Create QueryResponse for error on request, msg: 
2025-11-03T16:54:22.877707Z node 1 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Failed to resolve tablet: 72075186224037890 after several retries." severity: 1 } TxMeta { id: "01k95a88dkcrqxq8q4v1m8bcqz" } } YdbStatus: UNAVAILABLE ConsumedRu: 414 }
2025-11-03T16:54:23.338785Z node 1 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976715931. Failed to resolve tablet: 72075186224037891 after several retries.
2025-11-03T16:54:23.338894Z node 1 :KQP_EXECUTER WARN: kqp_executer_impl.h:245: ActorId: [1:7568543533886096252:3611] TxId: 281474976715931. Ctx: { TraceId: 01k95a88v97ygtxjr96e7qzjfh, Database: /Root, SessionId: ydb://session/3?node_id=1&id=MTY0ZWFhMDUtNjE2ZWQ2M2YtOGM2MWFiN2EtMzZlMGU2Mzg=, PoolId: default}. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037891 after several retries.
2025-11-03T16:54:23.339094Z node 1 :KQP_SESSION WARN: kqp_session_actor.cpp:2987: SessionId: ydb://session/3?node_id=1&id=MTY0ZWFhMDUtNjE2ZWQ2M2YtOGM2MWFiN2EtMzZlMGU2Mzg=, ActorId: [1:7568543533886096242:3611], ActorState: ExecuteState, TraceId: 01k95a88v97ygtxjr96e7qzjfh, Create QueryResponse for error on request, msg: 
2025-11-03T16:54:23.340372Z node 1 :PQ_PARTITION_CHOOSER INFO: partition_chooser_impl__abstract_chooser_actor.h:312: TPartitionChooser [1:7568543533886096241:3608] (SourceId=test-message-group-id, PreferedPartition=(NULL)) ReplyError: kqp error Marker# PQ50 : Response {
  SessionId: "ydb://session/3?node_id=1&id=MTY0ZWFhMDUtNjE2ZWQ2M2YtOGM2MWFiN2EtMzZlMGU2Mzg="
  QueryIssues {
    message: "Failed to resolve tablet: 72075186224037891 after several retries."
    severity: 1
  }
  TxMeta {
    id: "01k95a88v97ygtxjr96j6rndyw"
  }
}
YdbStatus: UNAVAILABLE
ConsumedRu: 1
2025-11-03T16:54:23.340460Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 60 reason: kqp error Marker# PQ50 : Response {
  SessionId: "ydb://session/3?node_id=1&id=MTY0ZWFhMDUtNjE2ZWQ2M2YtOGM2MWFiN2EtMzZlMGU2Mzg="
  QueryIssues {
    message: "Failed to resolve tablet: 72075186224037891 after several retries."
    severity: 1
  }
  TxMeta {
    id: "01k95a88v97ygtxjr96j6rndyw"
  }
}
YdbStatus: UNAVAILABLE
ConsumedRu: 1
 sessionId: 
2025-11-03T16:54:23.340774Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 60 sessionId:  is DEAD
Test retry state: get retry delay
2025-11-03T16:54:23.344682Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: kqp error Marker# PQ50 : Response {   SessionId: "ydb://session/3?node_id=1&id=MTY0ZWFhMDUtNjE2ZWQ2M2YtOGM2MWFiN2EtMzZlMGU2Mzg="   QueryIssues {     message: "Failed to resolve tablet: 72075186224037891 after several retries."     severity: 1   }   TxMeta {     id: "01k95a88v97ygtxjr96j6rndyw"   } } YdbStatus: UNAVAILABLE ConsumedRu: 1 , code: 500001 
2025-11-03T16:54:23.344717Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Write session will restart in 2.000000s
2025-11-03T16:54:23.344800Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Write session: Do CDS request
2025-11-03T16:54:23.344851Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Do schedule cds request after 2000 ms
2025-11-03T16:54:24.464078Z node 2 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976720799. Failed to resolve tablet: 72075186224037888 after several retries.
2025-11-03T16:54:24.464217Z node 2 :KQP_EXECUTER WARN: kqp_executer_impl.h:245: ActorId: [2:7568543538178603872:3164] TxId: 281474976720799. Ctx: { TraceId: 01k95a895b8zxjvf73c5ka1fvc, Database: /Root, SessionId: ydb://session/3?node_id=2&id=YjQ1ZTZjMTEtYmVhMWQyZDItNGJmYzVhMDItOWFkYTgyMDM=, PoolId: default}. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037888 after several retries.
2025-11-03T16:54:24.464492Z node 2 :KQP_SESSION WARN: kqp_session_actor.cpp:2987: SessionId: ydb://session/3?node_id=2&id=YjQ1ZTZjMTEtYmVhMWQyZDItNGJmYzVhMDItOWFkYTgyMDM=, ActorId: [2:7568543533883636559:3164], ActorState: ExecuteState, TraceId: 01k95a895b8zxjvf73c5ka1fvc, Create QueryResponse for error on request, msg: 
2025-11-03T16:54:24.467783Z node 2 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Failed to resolve tablet: 72075186224037888 after several retries." severity: 1 } TxMeta { id: "01k95a89yf673fxmp5e9cgs7fy" } } YdbStatus: UNAVAILABLE ConsumedRu: 530 }
2025-11-03T16:54:25.345406Z :INFO: [/Root] MessageGroupId [test-message-group-id] Running cds request ms
2025-11-03T16:54:25.349329Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Got CDS response: 
write_sessions_clusters { clusters { endpoint: "localhost:1567" name: "dc1" available: true } primary_cluster_selection_reason: CLIENT_LOCATION } version: 1
2025-11-03T16:54:25.349379Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Start write session. Will connect to endpoint: localhost:1567
2025-11-03T16:54:25.353024Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" }
2025-11-03T16:54:25.353799Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-11-03T16:54:25.353834Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 61
2025-11-03T16:54:25.354159Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 61 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" }
2025-11-03T16:54:25.354292Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 61 topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" from ipv6:[::1]:34482
2025-11-03T16:54:25.354309Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=61 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:34482 proto=v1  topic=test-topic durationSec=0
2025-11-03T16:54:25.354321Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-11-03T16:54:25.355992Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 61 sessionId:  describe result for acl check
2025-11-03T16:54:25.356112Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-11-03T16:54:25.356122Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-11-03T16:54:25.356134Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-11-03T16:54:25.356150Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7568543546770998315:3626] (SourceId=test-message-group-id, PreferedPartition=(NULL)) StartKqpSession
2025-11-03T16:54:25.358883Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7568543546770998315:3626] (SourceId=test-message-group-id, PreferedPartition=(NULL)) Select from the table
2025-11-03T16:54:25.491148Z node 1 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976715934. Failed to resolve tablet: 72075186224037890 after several retries.
2025-11-03T16:54:25.491271Z node 1 :KQP_EXECUTER WARN: kqp_executer_impl.h:245: ActorId: [1:7568543542476030951:3616] TxId: 281474976715934. Ctx: { TraceId: 01k95a8acfdmdj128st72wyq7y, Database: /Root, SessionId: ydb://session/3?node_id=1&id=MmUzNTlmN2UtYTE0OTAzMTUtMjU3NGRhMDgtZDk2NmIzZDI=, PoolId: default}. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037890 after several retries.
2025-11-03T16:54:25.491539Z node 1 :KQP_SESSION WARN: kqp_session_actor.cpp:2987: SessionId: ydb://session/3?node_id=1&id=MmUzNTlmN2UtYTE0OTAzMTUtMjU3NGRhMDgtZDk2NmIzZDI=, ActorId: [1:7568543538181063630:3616], ActorState: ExecuteState, TraceId: 01k95a8acfdmdj128st72wyq7y, Create QueryResponse for error on request, msg: 
2025-11-03T16:54:25.493232Z node 1 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Failed to resolve tablet: 72075186224037890 after several retries." severity: 1 } TxMeta { id: "01k95a8azg88wf6c5ehjgec72b" } } YdbStatus: UNAVAILABLE ConsumedRu: 398 }
2025-11-03T16:54:26.363272Z node 1 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976715935. Failed to resolve tablet: 72075186224037891 after several retries.
2025-11-03T16:54:26.363385Z node 1 :KQP_EXECUTER WARN: kqp_executer_impl.h:245: ActorId: [1:7568543546770998326:3628] TxId: 281474976715935. Ctx: { TraceId: 01k95a8btf6xxctafj00m2rsrw, Database: /Root, SessionId: ydb://session/3?node_id=1&id=MzFhMGQ1OTItOGJlYjE5OWMtMWEwMTc3MTgtNjE2ZGI5MTE=, PoolId: default}. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037891 after several retries.
2025-11-03T16:54:26.363600Z node 1 :KQP_SESSION WARN: kqp_session_actor.cpp:2987: SessionId: ydb://session/3?node_id=1&id=MzFhMGQ1OTItOGJlYjE5OWMtMWEwMTc3MTgtNjE2ZGI5MTE=, ActorId: [1:7568543546770998316:3628], ActorState: ExecuteState, TraceId: 01k95a8btf6xxctafj00m2rsrw, Create QueryResponse for error on request, msg: 
2025-11-03T16:54:26.364957Z node 1 :PQ_PARTITION_CHOOSER INFO: partition_chooser_impl__abstract_chooser_actor.h:312: TPartitionChooser [1:7568543546770998315:3626] (SourceId=test-message-group-id, PreferedPartition=(NULL)) ReplyError: kqp error Marker# PQ50 : Response {
  SessionId: "ydb://session/3?node_id=1&id=MzFhMGQ1OTItOGJlYjE5OWMtMWEwMTc3MTgtNjE2ZGI5MTE="
  QueryIssues {
    message: "Failed to resolve tablet: 72075186224037891 after several retries."
    severity: 1
  }
  TxMeta {
    id: "01k95a8btrbye7w129x01dmwbd"
  }
}
YdbStatus: UNAVAILABLE
ConsumedRu: 1
2025-11-03T16:54:26.365038Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 61 reason: kqp error Marker# PQ50 : Response {
  SessionId: "ydb://session/3?node_id=1&id=MzFhMGQ1OTItOGJlYjE5OWMtMWEwMTc3MTgtNjE2ZGI5MTE="
  QueryIssues {
    message: "Failed to resolve tablet: 72075186224037891 after several retries."
    severity: 1
  }
  TxMeta {
    id: "01k95a8btrbye7w129x01dmwbd"
  }
}
YdbStatus: UNAVAILABLE
ConsumedRu: 1
 sessionId: 
2025-11-03T16:54:26.365359Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 61 sessionId:  is DEAD
Test retry state: get retry delay
2025-11-03T16:54:26.369410Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: kqp error Marker# PQ50 : Response {   SessionId: "ydb://session/3?node_id=1&id=MzFhMGQ1OTItOGJlYjE5OWMtMWEwMTc3MTgtNjE2ZGI5MTE="   QueryIssues {     message: "Failed to resolve tablet: 72075186224037891 after several retries."     severity: 1   }   TxMeta {     id: "01k95a8btrbye7w129x01dmwbd"   } } YdbStatus: UNAVAILABLE ConsumedRu: 1 , code: 500001 
2025-11-03T16:54:26.369451Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Write session will restart in 2.000000s
2025-11-03T16:54:26.369543Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Write session: Do CDS request
2025-11-03T16:54:26.369577Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Do schedule cds request after 2000 ms
WAIT for retries done
ALLOW tablets
{"NodeId":1,"Down":false}
{"NodeId":2,"Down":false}
WAIT for repair
2025-11-03T16:54:26.469608Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:140: [72075186224037893][rt3.dc1--test-topic] BALANCER INIT DONE for rt3.dc1--test-topic: (0, 72075186224037892) 
2025-11-03T16:54:26.492249Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:971: [72075186224037893][rt3.dc1--test-topic] Discovered subdomain [OwnerId: 72057594046644480, LocalPathId: 1] state, outOfSpace = 0 at RB 72075186224037893
2025-11-03T16:54:26.496937Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2960: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-11-03T16:54:26.519854Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2992: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-11-03T16:54:26.520797Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:913: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-11-03T16:54:26.520816Z node 1 :PERSQUEUE INFO: pq_impl.cpp:599: [PQ: 72075186224037892] has a tx writes info
2025-11-03T16:54:26.520869Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-11-03T16:54:26.521151Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-11-03T16:54:26.521371Z node 1 :PERSQUEUE INFO: partition_init.cpp:1101: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7568543551065965949:3633]
2025-11-03T16:54:26.525779Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-11-03T16:54:26.690057Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-11-03T16:54:26.690323Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-11-03T16:54:26.691998Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-11-03T16:54:26.692300Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000001_00000?
2025-11-03T16:54:26.692308Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000001_00000_0000000002_00000?
2025-11-03T16:54:26.692315Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000003_00000_0000000001_00000?
2025-11-03T16:54:26.692360Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000001_00000?
2025-11-03T16:54:26.692504Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000001_00000_0000000002_00000?
2025-11-03T16:54:26.692551Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00000_0000000001_00000?
2025-11-03T16:54:26.692581Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000001_00000?
2025-11-03T16:54:26.692649Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 1 size 175 so 0 eo 1 d0000000000_00000000000000000000_00000_0000000001_00000?
2025-11-03T16:54:26.692711Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000001_00000_0000000002_00000?
2025-11-03T16:54:26.692767Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 1 count 2 size 321 so 0 eo 3 d0000000000_00000000000000000001_00000_0000000002_00000?
2025-11-03T16:54:26.692818Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00000_0000000001_00000?
2025-11-03T16:54:26.692866Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 1 size 175 so 0 eo 4 d0000000000_00000000000000000003_00000_0000000001_00000?
2025-11-03T16:54:26.693027Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-11-03T16:54:26.693043Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-11-03T16:54:26.693063Z node 1 :PERSQUEUE INFO: partition_init.cpp:968: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-11-03T16:54:26.693078Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-11-03T16:54:26.693094Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-11-03T16:54:26.693119Z node 1 :PERSQUEUE INFO: partition.cpp:707: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3 [1:7568543551065965949:3633]
2025-11-03T16:54:26.693161Z node 1 :PERSQUEUE DEBUG: partition.cpp:727: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 4 Head Offset 4 PartNo 0 PackedSize 0 count 0 nextOffset 4 batches 0
SYNC INIT sourceId  test-message-group-id seqNo 4 offset 3
SYNC INIT DATA KEY: d0000000000_00000000000000000000_00000_0000000001_00000? size 175
SYNC INIT DATA KEY: d0000000000_00000000000000000001_00000_0000000002_00000? size 321
SYNC INIT DATA KEY: d0000000000_00000000000000000003_00000_0000000001_00000? size 175
2025-11-03T16:54:26.693193Z node 1 :PERSQUEUE DEBUG: partition_mlp.cpp:83: [72075186224037892][Partition][0][StateIdle] Initializing MLP Consumers: 0
2025-11-03T16:54:26.693218Z node 1 :PERSQUEUE DEBUG: partition.cpp:4273: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-11-03T16:54:26.693234Z node 1 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:54:26.693246Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:54:26.693260Z node 1 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:54:26.693297Z node 1 :PERSQUEUE DEBUG: partition.cpp:752: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  test-message-group-id SeqNo: 4 offset: 3 MaxOffset: 4
2025-11-03T16:54:26.693316Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:923: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-11-03T16:54:26.693336Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:965: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-11-03T16:54:26.693377Z node 1 :PERSQUEUE DEBUG: partition_mlp.cpp:60: [72075186224037892][Partition][0][StateIdle] Process MLP pending events. Count 0
2025-11-03T16:54:26.693558Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:54:26.693836Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:880: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 partno 0 count 1 size 1024000 endOffset 4 max time lag 0ms effective offset 0
2025-11-03T16:54:26.694016Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1105: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 175 count 1 last offset 0, current partition end offset: 4
2025-11-03T16:54:26.694031Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1121: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-11-03T16:54:26.694064Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 1 parts_count 0 actorID [1:7568543551065965930:3633]
2025-11-03T16:54:26.694091Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-11-03T16:54:26.694266Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-11-03T16:54:26.694279Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-11-03T16:54:26.694304Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 1 size 175 actorID [1:7568543551065965930:3633]
2025-11-03T16:54:26.695638Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 1 parts_count 0
2025-11-03T16:54:26.695727Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 0 suffix '63' size 175
2025-11-03T16:54:26.706133Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:572: FormAnswer for 1 blobs
2025-11-03T16:54:26.706295Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 0 totakecount 1 count 1 size 155 from pos 0 cbcount 1
2025-11-03T16:54:26.707447Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:404: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 3
2025-11-03T16:54:26.709692Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [1:7568543551065965926:3632], now have 1 active actors on pipe
2025-11-03T16:54:26.716500Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1015: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1762188688333 queuesize 0 startOffset 0
2025-11-03T16:54:26.796142Z node 1 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:54:26.796173Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:54:26.796187Z node 1 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:54:26.895427Z node 1 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:54:26.895458Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:54:26.895473Z node 1 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:54:26.994638Z node 1 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:54:26.994667Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:54:26.994680Z node 1 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:54:27.096157Z node 1 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:54:27.096188Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:54:27.096202Z node 1 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:54:27.198169Z node 1 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:54:27.198199Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:54:27.198212Z node 1 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:54:27.298865Z node 1 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:54:27.298897Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:54:27.298911Z node 1 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:54:27.399850Z node 1 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:54:27.399892Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:54:27.399907Z node 1 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:54:27.500184Z node 1 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:54:27.500216Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:54:27.500231Z node 1 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:54:27.607076Z node 1 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:54:27.607113Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:54:27.607128Z node 1 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:54:27.711737Z node 1 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:54:27.711770Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:54:27.711784Z node 1 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:54:27.813837Z node 1 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:54:27.813872Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:54:27.813888Z node 1 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:54:27.920120Z node 1 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:54:27.920156Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:54:27.920172Z node 1 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:54:28.024078Z node 1 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:54:28.024113Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:54:28.024129Z node 1 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:54:28.125184Z node 1 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:54:28.125215Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:54:28.125228Z node 1 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:54:28.226103Z node 1 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:54:28.226131Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:54:28.226143Z node 1 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:54:28.332204Z node 1 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:54:28.332236Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:54:28.332249Z node 1 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:54:28.370899Z :INFO: [/Root] MessageGroupId [test-message-group-id] Running cds request ms
2025-11-03T16:54:28.384748Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Got CDS response: 
write_sessions_clusters { clusters { endpoint: "localhost:1567" name: "dc1" available: true } primary_cluster_selection_reason: CLIENT_LOCATION } version: 1
2025-11-03T16:54:28.384801Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Start write session. Will connect to endpoint: localhost:1567
2025-11-03T16:54:28.390225Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-11-03T16:54:28.390260Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 62
2025-11-03T16:54:28.391319Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" }
2025-11-03T16:54:28.391900Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 62 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" }
2025-11-03T16:54:28.392068Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 62 topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" from ipv6:[::1]:34482
2025-11-03T16:54:28.392094Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=62 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:34482 proto=v1  topic=test-topic durationSec=0
2025-11-03T16:54:28.392110Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-11-03T16:54:28.393769Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 62 sessionId:  describe result for acl check
2025-11-03T16:54:28.393895Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-11-03T16:54:28.393907Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-11-03T16:54:28.393917Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-11-03T16:54:28.393933Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7568543559655900734:3670] (SourceId=test-message-group-id, PreferedPartition=(NULL)) StartKqpSession
2025-11-03T16:54:28.396919Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7568543559655900734:3670] (SourceId=test-message-group-id, PreferedPartition=(NULL)) Select from the table
2025-11-03T16:54:28.409577Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7568543559655900734:3670] (SourceId=test-message-group-id, PreferedPartition=(NULL)) Update the table
2025-11-03T16:54:28.422565Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7568543559655900734:3670] (SourceId=test-message-group-id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-11-03T16:54:28.422604Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7568543559655900734:3670] (SourceId=test-message-group-id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-11-03T16:54:28.422621Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7568543559655900734:3670] (SourceId=test-message-group-id, PreferedPartition=(NULL)) Start idle
2025-11-03T16:54:28.422650Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 62 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-11-03T16:54:28.424339Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 3
2025-11-03T16:54:28.424394Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [1:7568543559655900771:3670], now have 1 active actors on pipe
2025-11-03T16:54:28.424552Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:54:28.424579Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:54:28.424660Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie test-message-group-id|240e63a5-24c1ca36-3277ff93-dab8b839_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner test-message-group-id
2025-11-03T16:54:28.424701Z node 1 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:54:28.424723Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:54:28.424738Z node 1 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-03T16:54:28.424787Z node 1 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:54:28.424834Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-03T16:54:28.424881Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-03T16:54:28.425335Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:54:28.425354Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:54:28.425421Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-03T16:54:28.425552Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 62 partition: 0 MaxSeqNo: 4 sessionId: test-message-group-id|240e63a5-24c1ca36-3277ff93-dab8b839_0
2025-11-03T16:54:28.428071Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|7e253a59-48def270-fb131d2f-42203bb5_0] Write session established. Init response: last_sequence_number: 4 session_id: "test-message-group-id|240e63a5-24c1ca36-3277ff93-dab8b839_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-11-03T16:54:28.428219Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|240e63a5-24c1ca36-3277ff93-dab8b839_0] Write session: try to update token
2025-11-03T16:54:28.428253Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|240e63a5-24c1ca36-3277ff93-dab8b839_0] Send 2 message(s) (0 left), first sequence number is 5
REPAIR done
2025-11-03T16:54:28.428790Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 62 sessionId: test-message-group-id|240e63a5-24c1ca36-3277ff93-dab8b839_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:54:28.429096Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:54:28.429474Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:54:28.429504Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:54:28.429574Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-11-03T16:54:28.429620Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-11-03T16:54:28.429903Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:54:28.429923Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:54:28.430202Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0test-message-group-id' SeqNo: 5 partNo : 0 messageNo: 1 size 98 offset: -1
2025-11-03T16:54:28.430230Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0test-message-group-id' SeqNo: 6 partNo : 0 messageNo: 1 size 98 offset: -1
2025-11-03T16:54:28.430281Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:54:28.430335Z node 1 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:54:28.430377Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:54:28.430390Z node 1 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (2)
2025-11-03T16:54:28.430513Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0test-message-group-id' seqNo 5 partNo 0
2025-11-03T16:54:28.432143Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0test-message-group-id' seqNo 5 partNo 0 FormedBlobsCount 0 NewHead: Offset 4 PartNo 0 PackedSize 187 count 1 nextOffset 5 batches 1
2025-11-03T16:54:28.432213Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0test-message-group-id' seqNo 6 partNo 0
2025-11-03T16:54:28.432252Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0test-message-group-id' seqNo 6 partNo 0 FormedBlobsCount 0 NewHead: Offset 4 PartNo 0 PackedSize 342 count 2 nextOffset 6 batches 1
2025-11-03T16:54:28.432271Z node 1 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:54:28.432725Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 4,2 HeadOffset 4 endOffset 4 curOffset 6 d0000000000_00000000000000000004_00000_0000000002_00000? size 321 WTime 1762188868432
2025-11-03T16:54:28.432865Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-03T16:54:28.432997Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 4 partNo 0 count 2 size 321
2025-11-03T16:54:28.436838Z node 1 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:54:28.442607Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 4 count 2 size 321 actorID [1:7568543551065965930:3633]
2025-11-03T16:54:28.442694Z node 1 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-03T16:54:28.442758Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 240 WriteNewSizeFromSupportivePartitions# 0
2025-11-03T16:54:28.442795Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:54:28.442839Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0test-message-group-id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 5, partNo: 0, Offset: 4 is stored on disk
2025-11-03T16:54:28.442861Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:54:28.442890Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0test-message-group-id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 6, partNo: 0, Offset: 5 is stored on disk
2025-11-03T16:54:28.443960Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|240e63a5-24c1ca36-3277ff93-dab8b839_0] Write session got write response: sequence_numbers: 5 sequence_numbers: 6 offsets: 4 offsets: 5 already_written: false already_written: false write_statistics { persist_duration_ms: 4 queued_in_partition_duration_ms: 3 }
2025-11-03T16:54:28.444021Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|240e63a5-24c1ca36-3277ff93-dab8b839_0] Write session: acknoledged message 5
2025-11-03T16:54:28.444055Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|240e63a5-24c1ca36-3277ff93-dab8b839_0] Write session: acknoledged message 6
2025-11-03T16:54:28.443081Z node 1 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:54:28.443104Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:54:28.443112Z node 1 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:54:28.443140Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:54:28.443186Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1  requestId: <none> cookie: 1
2025-11-03T16:54:28.443273Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-11-03T16:54:28.443372Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 4 partno 0 count 2 parts 0 suffix '63' size 321
2025-11-03T16:54:28.460079Z :TWriteSession_TestPolicy INFO: Enqueue message with sequence number 7
2025-11-03T16:54:28.471593Z :TWriteSession_TestPolicy INFO: [] Write messages with sequence numbers 7
2025-11-03T16:54:28.471684Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|240e63a5-24c1ca36-3277ff93-dab8b839_0] Write 1 messages with Id from 7 to 7
2025-11-03T16:54:28.471760Z :TWriteSession_TestPolicy INFO: Wait for writer event
2025-11-03T16:54:28.471795Z :TWriteSession_TestPolicy INFO: Got new continue token
2025-11-03T16:54:28.476380Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|240e63a5-24c1ca36-3277ff93-dab8b839_0] Write session: try to update token
2025-11-03T16:54:28.476443Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|240e63a5-24c1ca36-3277ff93-dab8b839_0] Send 1 message(s) (0 left), first sequence number is 7
2025-11-03T16:54:28.477339Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 62 sessionId: test-message-group-id|240e63a5-24c1ca36-3277ff93-dab8b839_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:54:28.477661Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:54:28.478059Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:54:28.478092Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:54:28.478204Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 2  requestId: <none> cookie: 2
2025-11-03T16:54:28.478264Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-11-03T16:54:28.478642Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:54:28.478666Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:54:28.478727Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0test-message-group-id' SeqNo: 7 partNo : 0 messageNo: 3 size 98 offset: -1
2025-11-03T16:54:28.478765Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:54:28.478812Z node 1 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:54:28.478839Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:54:28.478852Z node 1 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-03T16:54:28.478971Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0test-message-group-id' seqNo 7 partNo 0
2025-11-03T16:54:28.520926Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0test-message-group-id' seqNo 7 partNo 0 FormedBlobsCount 0 NewHead: Offset 6 PartNo 0 PackedSize 187 count 1 nextOffset 7 batches 1
2025-11-03T16:54:28.521000Z node 1 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:54:28.521413Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 6,1 HeadOffset 6 endOffset 6 curOffset 7 d0000000000_00000000000000000006_00000_0000000001_00000? size 175 WTime 1762188868517
2025-11-03T16:54:28.521581Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-03T16:54:28.521674Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 6 partNo 0 count 1 size 175
2025-11-03T16:54:28.530719Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 6 count 1 size 175 actorID [1:7568543551065965930:3633]
2025-11-03T16:54:28.530790Z node 1 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-03T16:54:28.530846Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 120 WriteNewSizeFromSupportivePartitions# 0
2025-11-03T16:54:28.530884Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:54:28.530926Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0test-message-group-id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 7, partNo: 0, Offset: 6 is stored on disk
2025-11-03T16:54:28.531114Z node 1 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:54:28.531128Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:54:28.531140Z node 1 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:54:28.531176Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:54:28.531214Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 3  requestId: <none> cookie: 2
2025-11-03T16:54:28.531287Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-11-03T16:54:28.532436Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|240e63a5-24c1ca36-3277ff93-dab8b839_0] Write session got write response: sequence_numbers: 7 offsets: 6 already_written: false write_statistics { persist_duration_ms: 9 queued_in_partition_duration_ms: 39 }
2025-11-03T16:54:28.532475Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|240e63a5-24c1ca36-3277ff93-dab8b839_0] Write session: acknoledged message 7
2025-11-03T16:54:28.532760Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 6 partno 0 count 1 parts 0 suffix '63' size 175
2025-11-03T16:54:28.536086Z :TWriteSession_TestPolicy INFO: Wait for client write event loop to stop
2025-11-03T16:54:28.536162Z :TWriteSession_TestPolicy DEBUG: Close writer (stop)
2025-11-03T16:54:28.536210Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|240e63a5-24c1ca36-3277ff93-dab8b839_0] Write session: close. Timeout = 0 ms
2025-11-03T16:54:28.536253Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|240e63a5-24c1ca36-3277ff93-dab8b839_0] Write session will now close
2025-11-03T16:54:28.536326Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|240e63a5-24c1ca36-3277ff93-dab8b839_0] Write session: aborting
2025-11-03T16:54:28.536811Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|240e63a5-24c1ca36-3277ff93-dab8b839_0] Write session: gracefully shut down, all writes complete
2025-11-03T16:54:28.536859Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|240e63a5-24c1ca36-3277ff93-dab8b839_0] Write session: destroy
2025-11-03T16:54:28.536957Z :TWriteSession_TestPolicy DEBUG: Writer closed
2025-11-03T16:54:28.537496Z node 1 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:54:28.537528Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:54:28.537541Z node 1 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:54:28.539951Z :TWriteSession_TestPolicy INFO: Client write event loop stopped
2025-11-03T16:54:28.540267Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 62 sessionId: test-message-group-id|240e63a5-24c1ca36-3277ff93-dab8b839_0 grpc read done: success: 0 data: 
2025-11-03T16:54:28.540295Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 62 sessionId: test-message-group-id|240e63a5-24c1ca36-3277ff93-dab8b839_0 grpc read failed
2025-11-03T16:54:28.540331Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 62 sessionId: test-message-group-id|240e63a5-24c1ca36-3277ff93-dab8b839_0 grpc closed
2025-11-03T16:54:28.540348Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 62 sessionId: test-message-group-id|240e63a5-24c1ca36-3277ff93-dab8b839_0 is DEAD
2025-11-03T16:54:28.540955Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-11-03T16:54:28.542037Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [1:7568543559655900771:3670] destroyed
2025-11-03T16:54:28.542081Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-11-03T16:54:28.542114Z node 1 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:54:28.542126Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:54:28.542140Z node 1 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:54:28.641038Z node 1 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:54:28.641076Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:54:28.641090Z node 1 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:54:28.744092Z node 1 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:54:28.744125Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:54:28.744139Z node 1 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:54:28.848107Z node 1 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:54:28.848143Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:54:28.848158Z node 1 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:54:28.949626Z node 1 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:54:28.949657Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:54:28.949670Z node 1 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:54:29.050582Z node 1 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:54:29.050614Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:54:29.050628Z node 1 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:54:29.155022Z node 1 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:54:29.155067Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:54:29.155081Z node 1 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:54:29.257957Z node 1 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:54:29.257990Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:54:29.258004Z node 1 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:54:29.356524Z node 1 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:54:29.356562Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:54:29.356584Z node 1 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:54:29.456925Z node 1 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:54:29.456955Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:54:29.456970Z node 1 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:54:29.564109Z node 1 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:54:29.564151Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:54:29.564167Z node 1 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:54:29.668119Z node 1 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:54:29.668157Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:54:29.668173Z node 1 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:54:34.399732Z :TWriteSession_TestBrokenPolicy INFO: Random seed for debugging is 1762188874399709
2025-11-03T16:54:35.075251Z node 4 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[4:7568543589185983236:2146];send_to=[0:7307199536658146131:7762515];
2025-11-03T16:54:35.075321Z node 4 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
2025-11-03T16:54:35.113491Z node 4 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-11-03T16:54:35.119655Z node 4 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
test_client.cpp: SetPath # /home/runner/.ya/build/build_root/7jz3/00196f/r3tmp/tmpWgbie5/pdisk_1.dat
2025-11-03T16:54:35.134540Z node 3 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-11-03T16:54:35.135834Z node 3 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-11-03T16:54:35.140305Z node 3 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=incorrect path status: LookupError;
2025-11-03T16:54:35.287875Z node 4 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-11-03T16:54:35.302164Z node 3 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
2025-11-03T16:54:35.332243Z node 4 :CONFIGS_DISPATCHER ERROR: configs_dispatcher.cpp:1229: Notification cookie mismatch for subscription [4:7568543584891015822:2073] 1762188875066974 != 1762188875066971
2025-11-03T16:54:35.354831Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(3, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-11-03T16:54:35.354931Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(3, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-11-03T16:54:35.355187Z node 3 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-11-03T16:54:35.360968Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(4, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-11-03T16:54:35.361074Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(4, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-11-03T16:54:35.373819Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(3, (0,0,0,0)) VolatileState: Connecting -> Connected
2025-11-03T16:54:35.379052Z node 3 :HIVE WARN: hive_impl.cpp:811: HIVE#72057594037968897 Handle TEvInterconnect::TEvNodeConnected, NodeId 4 Cookie 4
2025-11-03T16:54:35.381236Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(4, (0,0,0,0)) VolatileState: Connecting -> Connected
TServer::EnableGrpc on GrpcPort 14895, node 3
2025-11-03T16:54:35.538730Z node 3 :NET_CLASSIFIER WARN: net_classifier.cpp:190: distributable config is empty, broken or outdated, will use file: /home/runner/.ya/build/build_root/7jz3/00196f/r3tmp/yandexg5gcPP.tmp
2025-11-03T16:54:35.538760Z node 3 :NET_CLASSIFIER WARN: net_classifier.cpp:196: will try to initialize from file: /home/runner/.ya/build/build_root/7jz3/00196f/r3tmp/yandexg5gcPP.tmp
2025-11-03T16:54:35.538947Z node 3 :NET_CLASSIFIER WARN: net_classifier.cpp:202: successfully initialized from file: /home/runner/.ya/build/build_root/7jz3/00196f/r3tmp/yandexg5gcPP.tmp
2025-11-03T16:54:35.539130Z node 3 :NET_CLASSIFIER ERROR: net_classifier.cpp:228: got bad distributable configuration
2025-11-03T16:54:35.606859Z INFO: TTestServer started on Port 25951 GrpcPort 14895
2025-11-03T16:54:35.665209Z node 4 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-11-03T16:54:35.753745Z node 3 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
TClient is connected to server localhost:25951
PQClient connected to localhost:14895
WaitRootIsUp 'Root'...
TClient::Ls request: Root
2025-11-03T16:54:36.068952Z node 3 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "Root"
    PathId: 1
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 1
    CreateStep: 0
    ParentPathId: 1
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 1
      SubDomainVersion: 0
      SecurityStateVersion: 0
    }
    ChildrenExist: false
  }
  Children {
    Name: ".sys"
    PathId: 18446744073709551615
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 0
    CreateStep: 0
    ParentPathId: 18446744073709551615
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 0
      Pl...
(TRUNCATED)
WaitRootIsUp 'Root' success.
2025-11-03T16:54:36.080627Z node 4 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-11-03T16:54:36.093597Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpAlterSubDomain, opId: 281474976715657:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_alter_subdomain.cpp:311)
waiting...
waiting...
waiting...
waiting...
2025-11-03T16:54:40.077836Z node 4 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[4:7568543589185983236:2146];send_to=[0:7307199536658146131:7762515];
2025-11-03T16:54:40.077946Z node 4 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
2025-11-03T16:54:40.386947Z node 4 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [4:7568543610660819993:2304], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-03T16:54:40.387007Z node 4 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [4:7568543610660819982:2301], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-03T16:54:40.387067Z node 4 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-03T16:54:40.387443Z node 4 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [4:7568543610660819998:2306], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-03T16:54:40.387511Z node 4 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-03T16:54:40.400799Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateResourcePool, opId: 281474976720657:3, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_resource_pool.cpp:179)
2025-11-03T16:54:40.452566Z node 4 :KQP_WORKLOAD_SERVICE WARN: helpers.h:73: [WorkloadService] [TPoolCreatorActor] ActorId: [4:7568543610660819997:2305], DatabaseId: /Root, PoolId: default, Scheduled retry for error: { <main>: Error: Transaction 281474976720657 completed, doublechecking }
2025-11-03T16:54:40.582460Z node 4 :TX_PROXY ERROR: schemereq.cpp:593: Actor# [4:7568543610660820027:2144] txid# 281474976720658, issues: { message: "Check failed: path: \'/Root/.metadata/workload_manager/pools/default\', error: path exist, request accepts it (id: [OwnerId: 72057594046644480, LocalPathId: 8], type: EPathTypeResourcePool, state: EPathStateNoChanges)" severity: 1 }
2025-11-03T16:54:40.643257Z node 4 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:570: Compilation failed, self: [4:7568543610660820034:2310], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-11-03T16:54:40.644713Z node 4 :KQP_SESSION WARN: kqp_session_actor.cpp:2506: SessionId: ydb://session/3?node_id=4&id=ODhlZjRiZjYtMzlmYjZlOTctNDAzOGJhMzctZjEzNzBmZWQ=, ActorId: [4:7568543610660819971:2300], ActorState: ExecuteState, TraceId: 01k95a8tfn0qnpaap5jm46rwma, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-11-03T16:54:40.645241Z node 4 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-11-03T16:54:41.256909Z node 3 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:570: Compilation failed, self: [3:7568543616925270099:2336], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-11-03T16:54:41.261183Z node 3 :KQP_SESSION WARN: kqp_session_actor.cpp:2506: SessionId: ydb://session/3?node_id=3&id=NDNmYzliZWMtZmRkOWE0ODMtYjkzYjg3ZmEtZjE5N2E0OQ==, ActorId: [3:7568543616925270048:2327], ActorState: ExecuteState, TraceId: 01k95a8v9k1mav4p3kz149c6pj, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-11-03T16:54:41.261666Z node 3 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-11-03T16:54:41.301065Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976715661:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:690)
2025-11-03T16:54:41.491396Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976715662:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:690)
2025-11-03T16:54:41.693024Z node 4 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:570: Compilation failed, self: [4:7568543614955787435:2324], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:5:17: Error: At function: KiReadTable!
        <main>:5:17: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Versions]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-11-03T16:54:41.694567Z node 4 :KQP_SESSION WARN: kqp_session_actor.cpp:2506: SessionId: ydb://session/3?node_id=4&id=YmJmYjg4NDMtZTBjNWNhNmItNjBmYjU4ODEtMjdjYWI0NWU=, ActorId: [4:7568543614955787428:2320], ActorState: ExecuteState, TraceId: 01k95a8vqg78n8hps5r6gb3d5j, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-11-03T16:54:41.695077Z node 4 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 5 column: 17 } message: "At function: KiReadTable!" end_position { row: 5 column: 17 } severity: 1 issues { position { row: 5 column: 17 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Versions]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 5 column: 17 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-11-03T16:54:41.785951Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976715663:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:690)
=== Init DC: UPSERT INTO `/Root/PQ/Config/V2/Cluster` (name, balancer, local, enabled, weight) VALUES ("dc1", "localhost:14895", true, true, 1000);
2025-11-03T16:54:42.657179Z node 3 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976715664. Ctx: { TraceId: 01k95a8wcyd6n9k57p2210eeak, Database: , SessionId: ydb://session/3?node_id=3&id=MmRlZjMzYzctNjBjOThiNzAtOWIyYWNmN2YtYzVlYzBjNWU=, PoolId: default, DatabaseId: /Root}. Database not set, use /Root
=== CheckClustersList. Subcribe to ClusterTracker from [3:7568543621220237825:3007] 
2025-11-03T16:54:50.243507Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard_impl.cpp:7727: Cannot get console configs
2025-11-03T16:54:50.243556Z node 3 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
=== CheckClustersList. Ok
2025-11-03T16:54:50.359536Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976715669:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:690)
waiting...
PQ Client: create topic: rt3.dc1--test-topic with 1 partitions
CallPersQueueGRPC request to localhost:14895
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-11-03T16:54:50.518249Z node 3 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
CallPersQueueGRPC request to localhost:14895
MetaRequest {
  CmdCreateTopic {
    Topic: "rt3.dc1--test-topic"
    NumPartitions: 1
    Config {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
  }
}
CallPersQueueGRPC response:
Status: 129
ProxyErrorCode: 53
SchemeStatus: 1
FlatTxId {
  TxId: 281474976715670
  SchemeShardTabletId: 72057594046644480
  PathId: 13
}
ErrorCode: OK
AddTopic: rt3.dc1--test-topic
===Run query:``DECLARE $version as Int64; DECLARE $path AS Utf8; DECLARE $cluster as Utf8; UPSERT INTO `/Root/PQ/Config/V2/Topics` (path, dc) VALUES ($path, $cluster); UPSERT INTO `/Root/PQ/Config/V2/Versions` (name, version) VALUES ("Topics", $version);`` with topic = test-topic, dc = dc1
2025-11-03T16:54:50.570248Z node 3 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1655: [72075186224037893][] pipe [3:7568543655579976619:3288] connected; active server actors: 1
2025-11-03T16:54:50.570613Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1519: [72075186224037893][rt3.dc1--test-topic] updating configuration. Deleted partitions []. Added partitions [0]
2025-11-03T16:54:50.571441Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:971: [72075186224037893][rt3.dc1--test-topic] Discovered subdomain [OwnerId: 72057594046644480, LocalPathId: 1] state, outOfSpace = 0 at RB 72075186224037893
2025-11-03T16:54:50.573875Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:140: [72075186224037893][rt3.dc1--test-topic] BALANCER INIT DONE for rt3.dc1--test-topic: (0, 72075186224037892) 
2025-11-03T16:54:50.576463Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2960: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-11-03T16:54:50.587310Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2992: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-11-03T16:54:50.587577Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:787: [PQ: 72075186224037892] no config, start with empty partitions and default config
2025-11-03T16:54:50.587617Z node 4 :PERSQUEUE NOTICE: pq_impl.cpp:913: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-11-03T16:54:50.587682Z node 4 :PERSQUEUE INFO: pq_impl.cpp:612: [PQ: 72075186224037892] doesn't have tx writes info
2025-11-03T16:54:50.588056Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [3:7568543655579976618:3287], now have 1 active actors on pipe
2025-11-03T16:54:50.588090Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [3:7568543655579976638:2434], now have 1 active actors on pipe
2025-11-03T16:54:50.592191Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:404: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 4, Generation 1
2025-11-03T16:54:50.592617Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-03T16:54:50.610532Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-03T16:54:50.620113Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [3:7568543655579976675:3329], now have 1 active actors on pipe
2025-11-03T16:54:50.620938Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-03T16:54:50.625884Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-03T16:54:50.626827Z node 4 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-11-03T16:54:50.626878Z node 4 :PERSQUEUE DEBUG: partition.cpp:1312: [72075186224037892][Partition][0][StateInit] HandleOnInit TEvPQ::TEvProposePartitionConfig
2025-11-03T16:54:50.627152Z node 4 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-11-03T16:54:50.627351Z node 4 :PERSQUEUE INFO: partition_init.cpp:1101: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [4:7568543653610493484:2400]
2025-11-03T16:54:50.630543Z node 4 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-11-03T16:54:50.630569Z node 4 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-11-03T16:54:50.630595Z node 4 :PERSQUEUE INFO: partition.cpp:707: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1 [4:7568543653610493484:2400]
2025-11-03T16:54:50.630630Z node 4 :PERSQUEUE DEBUG: partition.cpp:727: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 0 Head Offset 0 PartNo 0 PackedSize 0 count 0 nextOffset 0 batches 0
2025-11-03T16:54:50.630671Z node 4 :PERSQUEUE DEBUG: partition_mlp.cpp:83: [72075186224037892][Partition][0][StateIdle] Initializing MLP Consumers: 0
2025-11-03T16:54:50.633899Z node 4 :PERSQUEUE DEBUG: partition.cpp:4273: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 1
2025-11-03T16:54:50.633949Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:54:50.634039Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:54:50.634054Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-03T16:54:50.634079Z node 4 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-11-03T16:54:50.634095Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-11-03T16:54:50.634109Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:54:50.634121Z node 4 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-11-03T16:54:50.634161Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:923: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-11-03T16:54:50.634205Z node 4 :PERSQUEUE DEBUG: partition_mlp.cpp:60: [72075186224037892][Partition][0][StateIdle] Process MLP pending events. Count 0
2025-11-03T16:54:50.634499Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-03T16:54:50.634643Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:183: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:54:50.641885Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-03T16:54:50.642024Z node 4 :PERSQUEUE DEBUG: partition.cpp:1416: [72075186224037892][Partition][0][StateIdle] Handle TEvPQ::TEvTxCommit Step 1762188890665, TxId 281474976715670
2025-11-03T16:54:50.642049Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-11-03T16:54:50.642062Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:54:50.642179Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:54:50.642406Z node 4 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-03T16:54:50.645053Z node 4 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-03T16:54:50.645214Z node 4 :PERSQUEUE DEBUG: partition_mlp.cpp:83: [72075186224037892][Partition][0][StateIdle] Initializing MLP Consumers: 0
2025-11-03T16:54:50.645330Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-11-03T16:54:50.645358Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:54:50.645370Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:54:50.645381Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:54:50.645411Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:183: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:54:50.645731Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:398: [PQ: 72075186224037892] Apply new config PartitionConfig { LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 } PartitionIds: 0 TopicName: "rt3.dc1--test-topic" Version: 0 LocalDC: true Codecs { Ids: 0 Ids: 1 Ids: 2 Codecs: "raw" Codecs: "gzip" Codecs: "lzop" } TopicPath: "/Root/PQ/rt3.dc1--test-topic" YcCloudId: "" YcFolderId: "" YdbDatabaseId: "" YdbDatabasePath: "/Root" Partitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } AllPartitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } Consumers { Name: "user" ReadFromTimestampsMs: 0 FormatVersion: 0 Version: 0 Generation: 0 } MonitoringProjectId: ""
2025-11-03T16:54:50.645815Z node 4 :PERSQUEUE NOTICE: pq_impl.cpp:913: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-11-03T16:54:50.646054Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-03T16:54:50.652223Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-03T16:54:50.652322Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-03T16:54:50.656316Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-03T16:54:50.693539Z node 3 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976715671. Ctx: { TraceId: 01k95a94eg8nysq877q1xse3gw, Database: , SessionId: ydb://session/3?node_id=3&id=NTRkZTNjMjItMWZmYTNhZTYtY2ZkMGY5ZjQtYWIyZTBlMWM=, PoolId: default, DatabaseId: /Root}. Database not set, use /Root
===Query complete
TClient::Ls request: /Root/PQ/rt3.dc1--test-topic
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976715670
    CreateStep: 1762188890665
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts...
(TRUNCATED)
GetTopicVersionFromPath:  record Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976715670
    CreateStep: 1762188890665
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      YdbDatabasePath: "/Root"
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
    Partitions {
      PartitionId: 0
      TabletId: 72075186224037892
      Status: Active
    }
    AlterVersion: 1
    BalancerTabletID: 72075186224037893
    NextPartitionId: 1
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 1
      PlanResolution: 7
      Coordinators: 72057594046316545
      TimeCastBucketsPerMediator: 2
      Mediators: 72057594046382081
    }
    DomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    PathsInside: 12
    PathsLimit: 10000
    ShardsInside: 6
    ShardsLimit: 200000
    ResourcesDomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    DiskSpaceUsage {
      Tables {
        TotalSize: 0
        DataSize: 0
        IndexSize: 0
      }
      Topics {
        ReserveSize: 0
        AccountSize: 0
        DataSize: 0
        UsedReserveSize: 0
      }
    }
    PQPartitionsInside: 1
    PQPartitionsLimit: 1000000
    SchemeLimits {
      MaxDepth: 32
      MaxPaths: 10000
      MaxChildrenInDir: 100000
      MaxAclBytesSize: 10240
      MaxTableColumns: 200
      MaxTableColumnNameLength: 255
      MaxTableKeyColumns: 30
      MaxTableIndices: 20
      MaxShards: 200000
      MaxShardsInPath: 35000
      MaxConsistentCopyTargets: 10000
      MaxPathElementLength: 255
      ExtraPathSymbolsAllowed: "!\"#$%&\'()*+,-.:;<=>?@[\\]^_`{|}~"
      MaxPQPartitions: 1000000
      MaxTableCdcStreams: 5
      MaxExports: 10
      MaxImports: 10
      MaxColumnTableColumns: 10000
    }
  }
}
Path: "/Root/PQ/rt3.dc1--test-topic"
 name rt3.dc1--test-topic version1
CallPersQueueGRPC request to localhost:14895
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-11-03T16:54:50.735029Z node 3 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
2025-11-03T16:54:50.736104Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:54:50.736138Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:54:50.736153Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
Status: 1
ErrorCode: OK
MetaResponse {
  CmdGetTopicMetadataResult {
    TopicInfo {
      Topic: "rt3.dc1--test-topic"
      NumPartitions: 1
      Config {
        PartitionConfig {
          LifetimeSeconds: 86400
          LowWatermark: 8388608
          SourceIdLifetimeSeconds: 86400
          WriteSpeedInBytesPerSecond: 20000000
          BurstSize: 20000000
          SourceIdMaxCounts: 6000000
        }
        Version: 1
        LocalDC: true
        Codecs {
          Ids: 0
          Ids: 1
          Ids: 2
          Codecs: "raw"
          Codecs: "gzip"
          Codecs: "lzop"
        }
        TopicPath: "/Root/PQ/rt3.dc1--test-topic"
        YdbDatabasePath: "/Root"
        Consumers {
          Name: "user"
          ReadFromTimestampsMs: 0
          FormatVersion: 0
          Version: 0
        }
      }
      ErrorCode: OK
    }
  }
}
=== Topic created, have version: 1
2025-11-03T16:54:50.756339Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: try to update token
2025-11-03T16:54:50.756762Z :INFO: [] MessageGroupId [src] SessionId [] Write session: Do CDS request
2025-11-03T16:54:50.756809Z :INFO: [] MessageGroupId [src] SessionId [] Start write session. Will connect to endpoint: localhost:14895
2025-11-03T16:54:50.765717Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src" }
2025-11-03T16:54:50.766108Z node 3 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-11-03T16:54:50.766141Z node 3 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1
2025-11-03T16:54:50.766486Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src" }
2025-11-03T16:54:50.766569Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1 topic: "test-topic" message_group_id: "src" from ipv6:[::1]:58800
2025-11-03T16:54:50.766583Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:58800 proto=v1  topic=test-topic durationSec=0
2025-11-03T16:54:50.766592Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-11-03T16:54:50.768446Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1 sessionId:  describe result for acl check
2025-11-03T16:54:50.768599Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-11-03T16:54:50.768610Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-11-03T16:54:50.768622Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-11-03T16:54:50.768646Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [3:7568543655579976746:2451] (SourceId=src, PreferedPartition=(NULL)) StartKqpSession
2025-11-03T16:54:50.771578Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [3:7568543655579976746:2451] (SourceId=src, PreferedPartition=(NULL)) Select from the table
2025-11-03T16:54:50.840139Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:54:50.840173Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:54:50.840189Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:54:50.944116Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:54:50.944157Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:54:50.944174Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:54:50.965202Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [3:7568543655579976746:2451] (SourceId=src, PreferedPartition=(NULL)) RequestPQRB
2025-11-03T16:54:50.965563Z node 3 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1655: [72075186224037893][rt3.dc1--test-topic] pipe [3:7568543655579976782:2451] connected; active server actors: 1
2025-11-03T16:54:50.965655Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [3:7568543655579976746:2451] (SourceId=src, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=src
2025-11-03T16:54:50.965676Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [3:7568543655579976746:2451] (SourceId=src, PreferedPartition=(NULL)) Update the table
2025-11-03T16:54:50.966780Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1659: [72075186224037893][rt3.dc1--test-topic] pipe [3:7568543655579976782:2451] disconnected.
2025-11-03T16:54:50.966821Z node 3 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1670: [72075186224037893][rt3.dc1--test-topic] pipe [3:7568543655579976782:2451] disconnected; active server actors: 1
2025-11-03T16:54:50.966839Z node 3 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1695: [72075186224037893][rt3.dc1--test-topic] pipe [3:7568543655579976782:2451] disconnected no session
2025-11-03T16:54:51.041262Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:54:51.041295Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:54:51.041310Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:54:51.121742Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [3:7568543655579976746:2451] (SourceId=src, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-11-03T16:54:51.121789Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [3:7568543655579976746:2451] (SourceId=src, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-11-03T16:54:51.121807Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [3:7568543655579976746:2451] (SourceId=src, PreferedPartition=(NULL)) Start idle
2025-11-03T16:54:51.121839Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-11-03T16:54:51.127582Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [3:7568543659874944105:2451], now have 1 active actors on pipe
2025-11-03T16:54:51.128264Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 4, Generation: 1
2025-11-03T16:54:51.132141Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:54:51.132189Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:54:51.132288Z node 4 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src|ba5eb24-fed3d6ce-92365415-3df39d29_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src
2025-11-03T16:54:51.132343Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:54:51.132371Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:54:51.132390Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-03T16:54:51.132440Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:54:51.132490Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-03T16:54:51.132564Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-03T16:54:51.143348Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:54:51.143393Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:54:51.143483Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-03T16:54:51.144922Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:54:51.144950Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:54:51.144964Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:54:51.147765Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1 partition: 0 MaxSeqNo: 0 sessionId: src|ba5eb24-fed3d6ce-92365415-3df39d29_0
2025-11-03T16:54:51.150457Z :INFO: [] MessageGroupId [src] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1762188891150 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-11-03T16:54:51.150641Z :INFO: [] MessageGroupId [src] SessionId [] Write session established. Init response: session_id: "src|ba5eb24-fed3d6ce-92365415-3df39d29_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-11-03T16:54:51.150860Z :INFO: [] MessageGroupId [src] SessionId [src|ba5eb24-fed3d6ce-92365415-3df39d29_0] Write session: close. Timeout = 0 ms
2025-11-03T16:54:51.150902Z :INFO: [] MessageGroupId [src] SessionId [src|ba5eb24-fed3d6ce-92365415-3df39d29_0] Write session will now close
2025-11-03T16:54:51.150955Z :DEBUG: [] MessageGroupId [src] SessionId [src|ba5eb24-fed3d6ce-92365415-3df39d29_0] Write session: aborting
2025-11-03T16:54:51.151400Z :INFO: [] MessageGroupId [src] SessionId [src|ba5eb24-fed3d6ce-92365415-3df39d29_0] Write session: gracefully shut down, all writes complete
2025-11-03T16:54:51.151445Z :DEBUG: [] MessageGroupId [src] SessionId [src|ba5eb24-fed3d6ce-92365415-3df39d29_0] Write session: destroy
====TYdbPqTestRetryPolicy()
2025-11-03T16:54:51.155078Z :TWriteSession_TestBrokenPolicy INFO: Enqueue message with sequence number 1
2025-11-03T16:54:51.158858Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId: src|ba5eb24-fed3d6ce-92365415-3df39d29_0 grpc read done: success: 0 data: 
2025-11-03T16:54:51.158887Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 1 sessionId: src|ba5eb24-fed3d6ce-92365415-3df39d29_0 grpc read failed
2025-11-03T16:54:51.158937Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 1 sessionId: src|ba5eb24-fed3d6ce-92365415-3df39d29_0 grpc closed
2025-11-03T16:54:51.158956Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1 sessionId: src|ba5eb24-fed3d6ce-92365415-3df39d29_0 is DEAD
2025-11-03T16:54:51.159782Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-11-03T16:54:51.164440Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [3:7568543659874944105:2451] destroyed
2025-11-03T16:54:51.164497Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-11-03T16:54:51.164528Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:54:51.164544Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:54:51.164557Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
{"NodeId":3,"Down":true}
2025-11-03T16:54:51.188578Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [] Write session: try to update token
2025-11-03T16:54:51.188941Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [] Write session: Do CDS request
2025-11-03T16:54:51.188987Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [] Do schedule cds request after 0 ms
2025-11-03T16:54:51.189071Z :TWriteSession_TestBrokenPolicy INFO: Wait for writer event
2025-11-03T16:54:51.189109Z :INFO: [/Root] MessageGroupId [test-message-group-id] Running cds request ms
{"NodeId":4,"Down":true}
{"TabletsKicked":3}
2025-11-03T16:54:51.202091Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [] Got CDS response: 
write_sessions_clusters { clusters { endpoint: "localhost:14895" name: "dc1" available: true } primary_cluster_selection_reason: CLIENT_LOCATION } version: 1
2025-11-03T16:54:51.202151Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [] Start write session. Will connect to endpoint: localhost:14895
{"TabletsKicked":3}
TClient::Ls request: /Root/PQ/rt3.dc1--test-topic
2025-11-03T16:54:51.209008Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [3:7568543655579976638:2434] destroyed
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976715670
    CreateStep: 1762188890665
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts...
(TRUNCATED)
2025-11-03T16:54:51.233333Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [] Write session: send init request: init_request { topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" }
2025-11-03T16:54:51.234193Z node 3 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-11-03T16:54:51.234227Z node 3 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2
2025-11-03T16:54:51.234797Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" }
2025-11-03T16:54:51.234933Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2 topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" from ipv6:[::1]:58836
2025-11-03T16:54:51.234950Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:58836 proto=v1  topic=test-topic durationSec=0
2025-11-03T16:54:51.234961Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-11-03T16:54:51.236630Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2 sessionId:  describe result for acl check
2025-11-03T16:54:51.236753Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-11-03T16:54:51.236764Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-11-03T16:54:51.236774Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-11-03T16:54:51.236792Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [3:7568543659874944142:2468] (SourceId=test-message-group-id, PreferedPartition=(NULL)) StartKqpSession
2025-11-03T16:54:51.239883Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [3:7568543659874944142:2468] (SourceId=test-message-group-id, PreferedPartition=(NULL)) Select from the table
2025-11-03T16:54:52.040724Z node 3 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976715674. Failed to resolve tablet: 72075186224037891 after several retries.
2025-11-03T16:54:52.040866Z node 3 :KQP_EXECUTER WARN: kqp_executer_impl.h:245: ActorId: [3:7568543659874944155:2470] TxId: 281474976715674. Ctx: { TraceId: 01k95a95386xget778238z86yw, Database: /Root, SessionId: ydb://session/3?node_id=3&id=NDNlYThmMzEtN2E2NzE5ZGYtOTgxYWE3ZTEtZDhhNzdmNGQ=, PoolId: default}. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037891 after several retries.
2025-11-03T16:54:52.041164Z node 3 :KQP_SESSION WARN: kqp_session_actor.cpp:2987: SessionId: ydb://session/3?node_id=3&id=NDNlYThmMzEtN2E2NzE5ZGYtOTgxYWE3ZTEtZDhhNzdmNGQ=, ActorId: [3:7568543659874944143:2470], ActorState: ExecuteState, TraceId: 01k95a95386xget778238z86yw, Create QueryResponse for error on request, msg: 
2025-11-03T16:54:52.043929Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1762188892043 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
====CreateRetryState
2025-11-03T16:54:52.044131Z :ERROR: [/Root] MessageGroupId [test-message-group-id] SessionId [] Got error. Status: UNAVAILABLE, Description: <main>: Error: kqp error Marker# PQ50 : Response {   SessionId: "ydb://session/3?node_id=3&id=NDNlYThmMzEtN2E2NzE5ZGYtOTgxYWE3ZTEtZDhhNzdmNGQ="   QueryIssues {     message: "Failed to resolve tablet: 72075186224037891 after several retries."     severity: 1   }   TxMeta {     id: "01k95a95386xget77823j4c55c"   } } YdbStatus: UNAVAILABLE ConsumedRu: 1 , code: 500001 
2025-11-03T16:54:52.044179Z :ERROR: [/Root] MessageGroupId [test-message-group-id] SessionId [] Write session will not restart after a fatal error
2025-11-03T16:54:52.044210Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [] Write session will now close
2025-11-03T16:54:52.044249Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [] Write session: aborting
2025-11-03T16:54:52.042452Z node 3 :PQ_PARTITION_CHOOSER INFO: partition_chooser_impl__abstract_chooser_actor.h:312: TPartitionChooser [3:7568543659874944142:2468] (SourceId=test-message-group-id, PreferedPartition=(NULL)) ReplyError: kqp error Marker# PQ50 : Response {
  SessionId: "ydb://session/3?node_id=3&id=NDNlYThmMzEtN2E2NzE5ZGYtOTgxYWE3ZTEtZDhhNzdmNGQ="
  QueryIssues {
    message: "Failed to resolve tablet: 72075186224037891 after several retries."
    severity: 1
  }
  TxMeta {
    id: "01k95a95386xget77823j4c55c"
  }
}
YdbStatus: UNAVAILABLE
ConsumedRu: 1
2025-11-03T16:54:52.042537Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2 reason: kqp error Marker# PQ50 : Response {
  SessionId: "ydb://session/3?node_id=3&id=NDNlYThmMzEtN2E2NzE5ZGYtOTgxYWE3ZTEtZDhhNzdmNGQ="
  QueryIssues {
    message: "Failed to resolve tablet: 72075186224037891 after several retries."
    severity: 1
  }
  TxMeta {
    id: "01k95a95386xget77823j4c55c"
  }
}
YdbStatus: UNAVAILABLE
ConsumedRu: 1
 sessionId: 
2025-11-03T16:54:52.042851Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2 sessionId:  is DEAD
2025-11-03T16:54:52.048171Z :TWriteSession_TestBrokenPolicy INFO: Got close event: SessionClosed { Status: UNAVAILABLE Issues: "<main>: Error: kqp error Marker# PQ50 : Response {   SessionId: "ydb://session/3?node_id=3&id=NDNlYThmMzEtN2E2NzE5ZGYtOTgxYWE3ZTEtZDhhNzdmNGQ="   QueryIssues {     message: "Failed to resolve tablet: 72075186224037891 after several retries."     severity: 1   }   TxMeta {     id: "01k95a95386xget77823j4c55c"   } } YdbStatus: UNAVAILABLE ConsumedRu: 1 , code: 500001 " }
2025-11-03T16:54:52.048228Z :TWriteSession_TestBrokenPolicy DEBUG: Close writer (stop)
2025-11-03T16:54:52.048280Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [] Write session: destroy
2025-11-03T16:54:52.050163Z :TWriteSession_TestBrokenPolicy DEBUG: Writer closed
2025-11-03T16:54:52.546334Z node 3 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976715675. Failed to resolve tablet: 72075186224037888 after several retries.
2025-11-03T16:54:52.546453Z node 3 :KQP_EXECUTER WARN: kqp_executer_impl.h:245: ActorId: [3:7568543659874944199:2473] TxId: 281474976715675. Ctx: { TraceId: 01k95a956q85aj3xbz8xbqsczp, Database: /Root, SessionId: ydb://session/3?node_id=3&id=NjFlNzg5ZWYtZGIxZWYwNDYtY2ZlNWYyMC0zMTBlZjlhOQ==, PoolId: default}. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037888 after several retries.
2025-11-03T16:54:52.546770Z node 3 :KQP_SESSION WARN: kqp_session_actor.cpp:2987: SessionId: ydb://session/3?node_id=3&id=NjFlNzg5ZWYtZGIxZWYwNDYtY2ZlNWYyMC0zMTBlZjlhOQ==, ActorId: [3:7568543659874944167:2473], ActorState: ExecuteState, TraceId: 01k95a956q85aj3xbz8xbqsczp, Create QueryResponse for error on request, msg: 
2025-11-03T16:54:52.547911Z node 3 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Failed to resolve tablet: 72075186224037888 after several retries." severity: 1 } TxMeta { id: "01k95a95m0e44mb4zzjvr7padg" } } YdbStatus: UNAVAILABLE ConsumedRu: 274 }
2025-11-03T16:54:52.762197Z node 4 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976720663. Failed to resolve tablet: 72075186224037890 after several retries.
2025-11-03T16:54:52.762334Z node 4 :KQP_EXECUTER WARN: kqp_executer_impl.h:245: ActorId: [4:7568543657905460847:2408] TxId: 281474976720663. Ctx: { TraceId: 01k95a959b44v2f2vfp64ks8zx, Database: /Root, SessionId: ydb://session/3?node_id=4&id=ODgxOGI4ZjItZWNiNDNjMzUtNDI1MGQzZGEtYTI2MTIyMmQ=, PoolId: default}. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037890 after several retries.
2025-11-03T16:54:52.762620Z node 4 :KQP_SESSION WARN: kqp_session_actor.cpp:2987: SessionId: ydb://session/3?node_id=4&id=ODgxOGI4ZjItZWNiNDNjMzUtNDI1MGQzZGEtYTI2MTIyMmQ=, ActorId: [4:7568543657905460833:2408], ActorState: ExecuteState, TraceId: 01k95a959b44v2f2vfp64ks8zx, Create QueryResponse for error on request, msg: 
2025-11-03T16:54:52.765898Z node 4 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Failed to resolve tablet: 72075186224037890 after several retries." severity: 1 } TxMeta { id: "01k95a95s0d9enz29nq1ktarx8" } } YdbStatus: UNAVAILABLE ConsumedRu: 320 }
2025-11-03T16:54:54.797904Z :TWriteSession_TestBrokenPolicy INFO: Enqueue message with sequence number 2
2025-11-03T16:54:54.797990Z :TWriteSession_TestBrokenPolicy INFO: Wait for writer to die on itself
2025-11-03T16:54:54.798074Z :TWriteSession_TestBrokenPolicy INFO: Client write event loop stopped
2025-11-03T16:54:54.961515Z node 3 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976715678. Failed to resolve tablet: 72075186224037888 after several retries.
2025-11-03T16:54:54.961649Z node 3 :KQP_EXECUTER WARN: kqp_executer_impl.h:245: ActorId: [3:7568543668464878913:2483] TxId: 281474976715678. Ctx: { TraceId: 01k95a97beasm0j3ynh1c7e83k, Database: /Root, SessionId: ydb://session/3?node_id=3&id=NzM1NDliYzktNTU4OTYyNWYtODlkYmIwMWQtMjM4M2Q3Njc=, PoolId: default}. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037888 after several retries.
2025-11-03T16:54:54.976459Z node 3 :KQP_SESSION WARN: kqp_session_actor.cpp:2987: SessionId: ydb://session/3?node_id=3&id=NzM1NDliYzktNTU4OTYyNWYtODlkYmIwMWQtMjM4M2Q3Njc=, ActorId: [3:7568543668464878890:2483], ActorState: ExecuteState, TraceId: 01k95a97beasm0j3ynh1c7e83k, Create QueryResponse for error on request, msg: 
2025-11-03T16:54:54.992571Z node 3 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Failed to resolve tablet: 72075186224037888 after several retries." severity: 1 } TxMeta { id: "01k95a97s3cshp8egcx49tz4m9" } } YdbStatus: UNAVAILABLE ConsumedRu: 287 }
2025-11-03T16:54:56.984061Z :TWriteSession_RetryOnTargetCluster INFO: Random seed for debugging is 1762188896984037
2025-11-03T16:54:57.020074Z :RetryOnTargetCluster_Dc2 INFO: Random seed for debugging is 1762188897020050
2025-11-03T16:54:57.833351Z node 5 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[5:7568543683947303184:2086];send_to=[0:7307199536658146131:7762515];
2025-11-03T16:54:57.852867Z node 5 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
2025-11-03T16:54:58.047396Z node 5 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-11-03T16:54:58.080682Z node 5 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
test_client.cpp: SetPath # /home/runner/.ya/build/build_root/7jz3/00196f/r3tmp/tmpEtOMqI/pdisk_1.dat
2025-11-03T16:54:58.101574Z node 6 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-11-03T16:54:58.120246Z node 6 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-11-03T16:54:58.120451Z node 6 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=incorrect path status: LookupError;
2025-11-03T16:54:58.256060Z node 5 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-11-03T16:54:58.286556Z node 5 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
2025-11-03T16:54:58.304838Z node 6 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-11-03T16:54:58.336942Z node 5 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(5, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-11-03T16:54:58.337043Z node 5 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(5, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-11-03T16:54:58.340669Z node 5 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(6, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-11-03T16:54:58.340793Z node 5 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(6, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-11-03T16:54:58.357323Z node 5 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(5, (0,0,0,0)) VolatileState: Connecting -> Connected
2025-11-03T16:54:58.357521Z node 5 :HIVE WARN: hive_impl.cpp:811: HIVE#72057594037968897 Handle TEvInterconnect::TEvNodeConnected, NodeId 6 Cookie 6
2025-11-03T16:54:58.359138Z node 5 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(6, (0,0,0,0)) VolatileState: Connecting -> Connected
TServer::EnableGrpc on GrpcPort 23327, node 5
2025-11-03T16:54:58.608867Z node 5 :NET_CLASSIFIER WARN: net_classifier.cpp:190: distributable config is empty, broken or outdated, will use file: /home/runner/.ya/build/build_root/7jz3/00196f/r3tmp/yandexSJ1A5r.tmp
2025-11-03T16:54:58.608902Z node 5 :NET_CLASSIFIER WARN: net_classifier.cpp:196: will try to initialize from file: /home/runner/.ya/build/build_root/7jz3/00196f/r3tmp/yandexSJ1A5r.tmp
2025-11-03T16:54:58.609083Z node 5 :NET_CLASSIFIER WARN: net_classifier.cpp:202: successfully initialized from file: /home/runner/.ya/build/build_root/7jz3/00196f/r3tmp/yandexSJ1A5r.tmp
2025-11-03T16:54:58.609308Z node 5 :NET_CLASSIFIER ERROR: net_classifier.cpp:228: got bad distributable configuration
2025-11-03T16:54:58.683567Z INFO: TTestServer started on Port 65508 GrpcPort 23327
2025-11-03T16:54:58.749888Z node 6 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-11-03T16:54:58.868108Z node 5 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
TClient is connected to server localhost:65508
2025-11-03T16:54:58.990588Z node 5 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
PQClient connected to localhost:23327
WaitRootIsUp 'Root'...
TClient::Ls request: Root
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "Root"
    PathId: 1
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 1
    CreateStep: 0
    ParentPathId: 1
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 1
      SubDomainVersion: 0
      SecurityStateVersion: 0
    }
    ChildrenExist: false
  }
  Children {
    Name: ".sys"
    PathId: 18446744073709551615
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 0
    CreateStep: 0
    ParentPathId: 18446744073709551615
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 0
      Pl...
(TRUNCATED)
WaitRootIsUp 'Root' success.
2025-11-03T16:54:59.025868Z node 5 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpAlterSubDomain, opId: 281474976720657:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_alter_subdomain.cpp:311)
waiting...
waiting...
2025-11-03T16:54:59.084868Z node 5 :FLAT_TX_SCHEMESHARD WARN: schemeshard__notify.cpp:122: NotifyTxCompletion, unknown transaction, txId: 281474976720658, at schemeshard: 72057594046644480
2025-11-03T16:54:59.092143Z node 6 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
waiting...
waiting...
2025-11-03T16:55:02.809607Z node 5 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[5:7568543683947303184:2086];send_to=[0:7307199536658146131:7762515];
2025-11-03T16:55:02.809700Z node 5 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
2025-11-03T16:55:03.591234Z node 5 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [5:7568543709717107975:2329], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-03T16:55:03.591270Z node 5 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [5:7568543709717107987:2333], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-03T16:55:03.591369Z node 5 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-03T16:55:03.591756Z node 5 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [5:7568543709717107991:2335], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-03T16:55:03.591818Z node 5 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-03T16:55:03.596469Z node 5 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateResourcePool, opId: 281474976720661:3, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_resource_pool.cpp:179)
2025-11-03T16:55:03.628158Z node 5 :KQP_WORKLOAD_SERVICE WARN: helpers.h:73: [WorkloadService] [TPoolCreatorActor] ActorId: [5:7568543709717107990:2334], DatabaseId: /Root, PoolId: default, Scheduled retry for error: { <main>: Error: Transaction 281474976720661 completed, doublechecking }
2025-11-03T16:55:03.646217Z node 5 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720662:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:690)
2025-11-03T16:55:03.746924Z node 5 :TX_PROXY ERROR: schemereq.cpp:593: Actor# [5:7568543709717108137:2724] txid# 281474976720663, issues: { message: "Check failed: path: \'/Root/.metadata/workload_manager/pools/default\', error: path exist, request accepts it (id: [OwnerId: 72057594046644480, LocalPathId: 8], type: EPathTypeResourcePool, state: EPathStateNoChanges)" severity: 1 }
2025-11-03T16:55:03.791401Z node 5 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:570: Compilation failed, self: [5:7568543709717108155:2346], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-11-03T16:55:03.791659Z node 5 :KQP_SESSION WARN: kqp_session_actor.cpp:2506: SessionId: ydb://session/3?node_id=5&id=ODhkOWQ5NmQtMzRhMmY1NjQtZjQ1Y2RlNi04ZDg5ZmUzNA==, ActorId: [5:7568543709717107973:2328], ActorState: ExecuteState, TraceId: 01k95a9h4x8xgewdj96xksagc8, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-11-03T16:55:03.792207Z node 5 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-11-03T16:55:03.817290Z node 6 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:570: Compilation failed, self: [6:7568543711149448378:2308], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:5:17: Error: At function: KiReadTable!
        <main>:5:17: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Versions]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-11-03T16:55:03.820184Z node 6 :KQP_SESSION WARN: kqp_session_actor.cpp:2506: SessionId: ydb://session/3?node_id=6&id=Y2VjY2VjY2UtNzFjMjY0MjgtYThmZmE0MmYtNTFjNjM1OWI=, ActorId: [6:7568543711149448333:2300], ActorState: ExecuteState, TraceId: 01k95a9ha3f71c9npk4qywf6jn, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-11-03T16:55:03.820721Z node 6 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 5 column: 17 } message: "At function: KiReadTable!" end_position { row: 5 column: 17 } severity: 1 issues { position { row: 5 column: 17 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Versions]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 5 column: 17 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-11-03T16:55:03.822584Z node 5 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720664:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:690)
2025-11-03T16:55:04.060564Z node 5 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720665:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:690)
=== Init DC: UPSERT INTO `/Root/PQ/Config/V2/Cluster` (name, balancer, local, enabled, weight) VALUES ("dc1", "localhost:23327", true, true, 1000);
2025-11-03T16:55:04.542094Z node 5 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976720666. Ctx: { TraceId: 01k95a9hwt8cdg4g221z0j9h51, Database: , SessionId: ydb://session/3?node_id=5&id=ZDNlNzAyOTgtZGE3OWE4OWMtYjcyNTBmNGQtNjljYzBkYw==, PoolId: default, DatabaseId: /Root}. Database not set, use /Root
=== CheckClustersList. Subcribe to ClusterTracker from [5:7568543714012075790:2986] 
=== CheckClustersList. Ok
2025-11-03T16:55:11.436066Z node 5 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720671:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:690)
waiting...
PQ Client: create topic: rt3.dc1--test-topic with 1 partitions
CallPersQueueGRPC request to localhost:23327
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-11-03T16:55:11.513739Z node 5 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
CallPersQueueGRPC request to localhost:23327
MetaRequest {
  CmdCreateTopic {
    Topic: "rt3.dc1--test-topic"
    NumPartitions: 1
    Config {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
  }
}
CallPersQueueGRPC response:
Status: 129
ProxyErrorCode: 53
SchemeStatus: 1
FlatTxId {
  TxId: 281474976720672
  SchemeShardTabletId: 72057594046644480
  PathId: 13
}
ErrorCode: OK
AddTopic: rt3.dc1--test-topic
===Run query:``DECLARE $version as Int64; DECLARE $path AS Utf8; DECLARE $cluster as Utf8; UPSERT INTO `/Root/PQ/Config/V2/Topics` (path, dc) VALUES ($path, $cluster); UPSERT INTO `/Root/PQ/Config/V2/Versions` (name, version) VALUES ("Topics", $version);`` with topic = test-topic, dc = dc1
2025-11-03T16:55:11.549206Z node 5 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1655: [72075186224037893][] pipe [5:7568543744076847290:3260] connected; active server actors: 1
2025-11-03T16:55:11.549701Z node 5 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1519: [72075186224037893][rt3.dc1--test-topic] updating configuration. Deleted partitions []. Added partitions [0]
2025-11-03T16:55:11.550493Z node 5 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:971: [72075186224037893][rt3.dc1--test-topic] Discovered subdomain [OwnerId: 72057594046644480, LocalPathId: 1] state, outOfSpace = 0 at RB 72075186224037893
2025-11-03T16:55:11.553011Z node 5 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:140: [72075186224037893][rt3.dc1--test-topic] BALANCER INIT DONE for rt3.dc1--test-topic: (0, 72075186224037892) 
2025-11-03T16:55:11.558077Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2960: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-11-03T16:55:11.571705Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2992: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-11-03T16:55:11.572081Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:787: [PQ: 72075186224037892] no config, start with empty partitions and default config
2025-11-03T16:55:11.572117Z node 6 :PERSQUEUE NOTICE: pq_impl.cpp:913: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-11-03T16:55:11.572160Z node 6 :PERSQUEUE INFO: pq_impl.cpp:612: [PQ: 72075186224037892] doesn't have tx writes info
2025-11-03T16:55:11.573149Z node 5 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:404: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 6, Generation 1
2025-11-03T16:55:11.573362Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [5:7568543744076847289:3259], now have 1 active actors on pipe
2025-11-03T16:55:11.573396Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [5:7568543744076847309:2439], now have 1 active actors on pipe
2025-11-03T16:55:11.573985Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-03T16:55:11.580214Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-03T16:55:11.588889Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [5:7568543744076847345:3304], now have 1 active actors on pipe
2025-11-03T16:55:11.589415Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-03T16:55:11.599794Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-03T16:55:11.601079Z node 6 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-11-03T16:55:11.601142Z node 6 :PERSQUEUE DEBUG: partition.cpp:1312: [72075186224037892][Partition][0][StateInit] HandleOnInit TEvPQ::TEvProposePartitionConfig
2025-11-03T16:55:11.601458Z node 6 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-11-03T16:55:11.601761Z node 6 :PERSQUEUE INFO: partition_init.cpp:1101: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [6:7568543745509187152:2378]
2025-11-03T16:55:11.605541Z node 6 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-11-03T16:55:11.605583Z node 6 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-11-03T16:55:11.605610Z node 6 :PERSQUEUE INFO: partition.cpp:707: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1 [6:7568543745509187152:2378]
2025-11-03T16:55:11.605639Z node 6 :PERSQUEUE DEBUG: partition.cpp:727: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 0 Head Offset 0 PartNo 0 PackedSize 0 count 0 nextOffset 0 batches 0
2025-11-03T16:55:11.605678Z node 6 :PERSQUEUE DEBUG: partition_mlp.cpp:83: [72075186224037892][Partition][0][StateIdle] Initializing MLP Consumers: 0
2025-11-03T16:55:11.607111Z node 6 :PERSQUEUE DEBUG: partition.cpp:4273: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 1
2025-11-03T16:55:11.607157Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:11.607252Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:11.607265Z node 6 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-03T16:55:11.607290Z node 6 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-11-03T16:55:11.607303Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:11.607319Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:11.607334Z node 6 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-11-03T16:55:11.607365Z node 6 :PERSQUEUE DEBUG: partition_read.cpp:923: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-11-03T16:55:11.607411Z node 6 :PERSQUEUE DEBUG: partition_mlp.cpp:60: [72075186224037892][Partition][0][StateIdle] Process MLP pending events. Count 0
2025-11-03T16:55:11.609407Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-03T16:55:11.609574Z node 6 :PERSQUEUE DEBUG: partition_compaction.cpp:183: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:55:11.616199Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-03T16:55:11.616348Z node 6 :PERSQUEUE DEBUG: partition.cpp:1416: [72075186224037892][Partition][0][StateIdle] Handle TEvPQ::TEvTxCommit Step 1762188911630, TxId 281474976720672
2025-11-03T16:55:11.616372Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:11.616387Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:11.616556Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:11.616786Z node 6 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-03T16:55:11.619904Z node 6 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-03T16:55:11.620103Z node 6 :PERSQUEUE DEBUG: partition_mlp.cpp:83: [72075186224037892][Partition][0][StateIdle] Initializing MLP Consumers: 0
2025-11-03T16:55:11.620225Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-11-03T16:55:11.620250Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:11.620265Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:11.620278Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:11.620324Z node 6 :PERSQUEUE DEBUG: partition_compaction.cpp:183: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:55:11.620679Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:398: [PQ: 72075186224037892] Apply new config PartitionConfig { LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 } PartitionIds: 0 TopicName: "rt3.dc1--test-topic" Version: 0 LocalDC: true Codecs { Ids: 0 Ids: 1 Ids: 2 Codecs: "raw" Codecs: "gzip" Codecs: "lzop" } TopicPath: "/Root/PQ/rt3.dc1--test-topic" YcCloudId: "" YcFolderId: "" YdbDatabaseId: "" YdbDatabasePath: "/Root" Partitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } AllPartitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } Consumers { Name: "user" ReadFromTimestampsMs: 0 FormatVersion: 0 Version: 0 Generation: 0 } MonitoringProjectId: ""
2025-11-03T16:55:11.620803Z node 6 :PERSQUEUE NOTICE: pq_impl.cpp:913: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-11-03T16:55:11.621104Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-03T16:55:11.631151Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-03T16:55:11.631267Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-03T16:55:11.635478Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-03T16:55:11.710351Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:11.710391Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:11.710424Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:11.714402Z node 5 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976720673. Ctx: { TraceId: 01k95a9ry808s059d95meppegm, Database: , SessionId: ydb://session/3?node_id=5&id=MTQ1OTYwOTAtNTFiYWRkODktZGEzNjIwZmItNWQ1ZjkwZmI=, PoolId: default, DatabaseId: /Root}. Database not set, use /Root
===Query complete
TClient::Ls request: /Root/PQ/rt3.dc1--test-topic
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976720672
    CreateStep: 1762188911630
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts...
(TRUNCATED)
GetTopicVersionFromPath:  record Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976720672
    CreateStep: 1762188911630
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      YdbDatabasePath: "/Root"
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
    Partitions {
      PartitionId: 0
      TabletId: 72075186224037892
      Status: Active
    }
    AlterVersion: 1
    BalancerTabletID: 72075186224037893
    NextPartitionId: 1
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 1
      PlanResolution: 7
      Coordinators: 72057594046316545
      TimeCastBucketsPerMediator: 2
      Mediators: 72057594046382081
    }
    DomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    PathsInside: 12
    PathsLimit: 10000
    ShardsInside: 6
    ShardsLimit: 200000
    ResourcesDomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    DiskSpaceUsage {
      Tables {
        TotalSize: 0
        DataSize: 0
        IndexSize: 0
      }
      Topics {
        ReserveSize: 0
        AccountSize: 0
        DataSize: 0
        UsedReserveSize: 0
      }
    }
    PQPartitionsInside: 1
    PQPartitionsLimit: 1000000
    SchemeLimits {
      MaxDepth: 32
      MaxPaths: 10000
      MaxChildrenInDir: 100000
      MaxAclBytesSize: 10240
      MaxTableColumns: 200
      MaxTableColumnNameLength: 255
      MaxTableKeyColumns: 30
      MaxTableIndices: 20
      MaxShards: 200000
      MaxShardsInPath: 35000
      MaxConsistentCopyTargets: 10000
      MaxPathElementLength: 255
      ExtraPathSymbolsAllowed: "!\"#$%&\'()*+,-.:;<=>?@[\\]^_`{|}~"
      MaxPQPartitions: 1000000
      MaxTableCdcStreams: 5
      MaxExports: 10
      MaxImports: 10
      MaxColumnTableColumns: 10000
    }
  }
}
Path: "/Root/PQ/rt3.dc1--test-topic"
 name rt3.dc1--test-topic version1
CallPersQueueGRPC request to localhost:23327
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-11-03T16:55:11.750090Z node 5 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
MetaResponse {
  CmdGetTopicMetadataResult {
    TopicInfo {
      Topic: "rt3.dc1--test-topic"
      NumPartitions: 1
      Config {
        PartitionConfig {
          LifetimeSeconds: 86400
          LowWatermark: 8388608
          SourceIdLifetimeSeconds: 86400
          WriteSpeedInBytesPerSecond: 20000000
          BurstSize: 20000000
          SourceIdMaxCounts: 6000000
        }
        Version: 1
        LocalDC: true
        Codecs {
          Ids: 0
          Ids: 1
          Ids: 2
          Codecs: "raw"
          Codecs: "gzip"
          Codecs: "lzop"
        }
        TopicPath: "/Root/PQ/rt3.dc1--test-topic"
        YdbDatabasePath: "/Root"
        Consumers {
          Name: "user"
          ReadFromTimestampsMs: 0
          FormatVersion: 0
          Version: 0
        }
      }
      ErrorCode: OK
    }
  }
}
=== Topic created, have version: 1
2025-11-03T16:55:11.759338Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: try to update token
2025-11-03T16:55:11.759861Z :INFO: [] MessageGroupId [src] SessionId [] Write session: Do CDS request
2025-11-03T16:55:11.759952Z :INFO: [] MessageGroupId [src] SessionId [] Start write session. Will connect to endpoint: localhost:23327
2025-11-03T16:55:11.776292Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src" }
2025-11-03T16:55:11.777473Z node 5 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-11-03T16:55:11.777516Z node 5 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1
2025-11-03T16:55:11.777804Z node 5 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src" }
2025-11-03T16:55:11.777897Z node 5 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1 topic: "test-topic" message_group_id: "src" from ipv6:[::1]:45624
2025-11-03T16:55:11.777917Z node 5 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:45624 proto=v1  topic=test-topic durationSec=0
2025-11-03T16:55:11.777941Z node 5 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-11-03T16:55:11.779638Z node 5 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1 sessionId:  describe result for acl check
2025-11-03T16:55:11.779789Z node 5 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-11-03T16:55:11.779801Z node 5 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-11-03T16:55:11.779813Z node 5 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-11-03T16:55:11.779832Z node 5 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [5:7568543744076847423:2459] (SourceId=src, PreferedPartition=(NULL)) StartKqpSession
2025-11-03T16:55:11.782806Z node 5 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [5:7568543744076847423:2459] (SourceId=src, PreferedPartition=(NULL)) Select from the table
2025-11-03T16:55:11.810935Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:11.810971Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:11.810986Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:11.910840Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:11.910878Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:11.910904Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:11.947365Z node 5 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [5:7568543744076847423:2459] (SourceId=src, PreferedPartition=(NULL)) RequestPQRB
2025-11-03T16:55:11.947812Z node 5 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1655: [72075186224037893][rt3.dc1--test-topic] pipe [5:7568543744076847464:2459] connected; active server actors: 1
2025-11-03T16:55:11.947851Z node 5 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [5:7568543744076847423:2459] (SourceId=src, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=src
2025-11-03T16:55:11.947866Z node 5 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [5:7568543744076847423:2459] (SourceId=src, PreferedPartition=(NULL)) Update the table
2025-11-03T16:55:11.948088Z node 5 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1659: [72075186224037893][rt3.dc1--test-topic] pipe [5:7568543744076847464:2459] disconnected.
2025-11-03T16:55:11.948114Z node 5 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1670: [72075186224037893][rt3.dc1--test-topic] pipe [5:7568543744076847464:2459] disconnected; active server actors: 1
2025-11-03T16:55:11.948133Z node 5 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1695: [72075186224037893][rt3.dc1--test-topic] pipe [5:7568543744076847464:2459] disconnected no session
2025-11-03T16:55:12.011232Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:12.011272Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:12.011289Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:12.064725Z node 5 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [5:7568543744076847423:2459] (SourceId=src, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-11-03T16:55:12.064774Z node 5 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [5:7568543744076847423:2459] (SourceId=src, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-11-03T16:55:12.064794Z node 5 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [5:7568543744076847423:2459] (SourceId=src, PreferedPartition=(NULL)) Start idle
2025-11-03T16:55:12.064826Z node 5 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-11-03T16:55:12.065636Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [5:7568543748371814785:2459], now have 1 active actors on pipe
2025-11-03T16:55:12.065783Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 6, Generation: 1
2025-11-03T16:55:12.066028Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:55:12.066069Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:55:12.066148Z node 6 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src|c9aee322-62ce344a-3dc1886a-bb1d506b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src
2025-11-03T16:55:12.066189Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:12.066210Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:12.066224Z node 6 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-03T16:55:12.066265Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:12.066304Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-03T16:55:12.066352Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-03T16:55:12.070455Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:55:12.070499Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:55:12.070603Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-03T16:55:12.071131Z node 5 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1 partition: 0 MaxSeqNo: 0 sessionId: src|c9aee322-62ce344a-3dc1886a-bb1d506b_0
2025-11-03T16:55:12.072123Z :INFO: [] MessageGroupId [src] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1762188912072 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-11-03T16:55:12.072278Z :INFO: [] MessageGroupId [src] SessionId [] Write session established. Init response: session_id: "src|c9aee322-62ce344a-3dc1886a-bb1d506b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-11-03T16:55:12.072478Z :INFO: [] MessageGroupId [src] SessionId [src|c9aee322-62ce344a-3dc1886a-bb1d506b_0] Write session: close. Timeout = 0 ms
2025-11-03T16:55:12.072525Z :INFO: [] MessageGroupId [src] SessionId [src|c9aee322-62ce344a-3dc1886a-bb1d506b_0] Write session will now close
2025-11-03T16:55:12.072577Z :DEBUG: [] MessageGroupId [src] SessionId [src|c9aee322-62ce344a-3dc1886a-bb1d506b_0] Write session: aborting
2025-11-03T16:55:12.073007Z :INFO: [] MessageGroupId [src] SessionId [src|c9aee322-62ce344a-3dc1886a-bb1d506b_0] Write session: gracefully shut down, all writes complete
2025-11-03T16:55:12.073062Z :DEBUG: [] MessageGroupId [src] SessionId [src|c9aee322-62ce344a-3dc1886a-bb1d506b_0] Write session: destroy
2025-11-03T16:55:12.074898Z node 5 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId: src|c9aee322-62ce344a-3dc1886a-bb1d506b_0 grpc read done: success: 0 data: 
2025-11-03T16:55:12.074922Z node 5 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 1 sessionId: src|c9aee322-62ce344a-3dc1886a-bb1d506b_0 grpc read failed
2025-11-03T16:55:12.074953Z node 5 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 1 sessionId: src|c9aee322-62ce344a-3dc1886a-bb1d506b_0 grpc closed
2025-11-03T16:55:12.074974Z node 5 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1 sessionId: src|c9aee322-62ce344a-3dc1886a-bb1d506b_0 is DEAD
2025-11-03T16:55:12.076310Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-11-03T16:55:12.076736Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [5:7568543748371814785:2459] destroyed
2025-11-03T16:55:12.076783Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-11-03T16:55:12.076811Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:12.076828Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:12.076841Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:12.112118Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:12.112153Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:12.112170Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:12.216122Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:12.216159Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:12.216177Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:12.316408Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:12.316447Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:12.316465Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:12.420114Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:12.420150Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:12.420164Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:12.521123Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:12.521159Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:12.521178Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:12.624440Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:12.624483Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:12.624503Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:12.725228Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:12.725264Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:12.725283Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:12.832924Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:12.832954Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:12.832970Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:12.933708Z node 7 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[7:7568543749590763818:2077];send_to=[0:7307199536658146131:7762515];
2025-11-03T16:55:12.933776Z node 7 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
2025-11-03T16:55:12.936516Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:12.936550Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:12.936567Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
test_client.cpp: SetPath # /home/runner/.ya/build/build_root/7jz3/00196f/r3tmp/tmpNDAzOW/pdisk_1.dat
2025-11-03T16:55:13.012730Z node 7 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-11-03T16:55:13.013261Z node 7 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-11-03T16:55:13.019848Z node 8 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-11-03T16:55:13.022782Z node 8 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-11-03T16:55:13.022953Z node 8 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=incorrect path status: LookupError;
2025-11-03T16:55:13.037430Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:13.037458Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:13.068023Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:13.138092Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:13.138115Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:13.138126Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:13.195493Z node 7 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
2025-11-03T16:55:13.221716Z node 7 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-11-03T16:55:13.229001Z node 7 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(7, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-11-03T16:55:13.229116Z node 7 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(7, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-11-03T16:55:13.230171Z node 7 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(8, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-11-03T16:55:13.230256Z node 7 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(8, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-11-03T16:55:13.231835Z node 5 :FLAT_TX_SCHEMESHARD WARN: schemeshard_impl.cpp:7727: Cannot get console configs
2025-11-03T16:55:13.231875Z node 5 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
2025-11-03T16:55:13.237442Z node 7 :HIVE WARN: hive_impl.cpp:811: HIVE#72057594037968897 Handle TEvInterconnect::TEvNodeConnected, NodeId 8 Cookie 8
2025-11-03T16:55:13.237599Z node 7 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(7, (0,0,0,0)) VolatileState: Connecting -> Connected
2025-11-03T16:55:13.238530Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:13.238557Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:13.238578Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:13.238509Z node 7 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(8, (0,0,0,0)) VolatileState: Connecting -> Connected
TServer::EnableGrpc on GrpcPort 2871, node 7
2025-11-03T16:55:13.258358Z node 8 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-11-03T16:55:13.282192Z node 7 :NET_CLASSIFIER WARN: net_classifier.cpp:190: distributable config is empty, broken or outdated, will use file: /home/runner/.ya/build/build_root/7jz3/00196f/r3tmp/yandexqPaLEN.tmp
2025-11-03T16:55:13.282225Z node 7 :NET_CLASSIFIER WARN: net_classifier.cpp:196: will try to initialize from file: /home/runner/.ya/build/build_root/7jz3/00196f/r3tmp/yandexqPaLEN.tmp
2025-11-03T16:55:13.282364Z node 7 :NET_CLASSIFIER WARN: net_classifier.cpp:202: successfully initialized from file: /home/runner/.ya/build/build_root/7jz3/00196f/r3tmp/yandexqPaLEN.tmp
2025-11-03T16:55:13.282544Z node 7 :NET_CLASSIFIER ERROR: net_classifier.cpp:228: got bad distributable configuration
2025-11-03T16:55:13.318295Z INFO: TTestServer started on Port 20209 GrpcPort 2871
2025-11-03T16:55:13.340755Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:13.340797Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:13.340814Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:13.441501Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:13.441533Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:13.441549Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:13.541568Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:13.541600Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:13.541611Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
TClient is connected to server localhost:20209
PQClient connected to localhost:2871
WaitRootIsUp 'Root'...
TClient::Ls request: Root
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "Root"
    PathId: 1
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 1
    CreateStep: 0
    ParentPathId: 1
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 1
      SubDomainVersion: 0
      SecurityStateVersion: 0
    }
    ChildrenExist: false
  }
  Children {
    Name: ".sys"
    PathId: 18446744073709551615
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 0
    CreateStep: 0
    ParentPathId: 18446744073709551615
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 0
      Pl...
(TRUNCATED)
WaitRootIsUp 'Root' success.
2025-11-03T16:55:13.585177Z node 7 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpAlterSubDomain, opId: 281474976710657:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_alter_subdomain.cpp:311)
waiting...
waiting...
2025-11-03T16:55:13.641901Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:13.641940Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:13.641959Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
waiting...
waiting...
2025-11-03T16:55:13.742659Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:13.742697Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:13.742714Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:13.791883Z node 7 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-11-03T16:55:13.844652Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:13.844693Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:13.844710Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:13.948103Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:13.948142Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:13.948159Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:13.975814Z node 7 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-11-03T16:55:14.007077Z node 8 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-11-03T16:55:14.048424Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:14.048459Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:14.048475Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:14.151895Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:14.151938Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:14.151955Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:14.255070Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:14.255101Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:14.255113Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:14.356323Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:14.356363Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:14.356382Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:14.460198Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:14.460234Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:14.460257Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:14.564094Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:14.564134Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:14.564150Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:14.668415Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:14.668455Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:14.668473Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:14.772494Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:14.772534Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:14.772552Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:14.871314Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:14.871357Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:14.871373Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:14.971889Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:14.971937Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:14.971954Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:15.077077Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:15.077123Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:15.077140Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:15.180099Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:15.180137Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:15.180153Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:15.284105Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:15.284142Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:15.284158Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:15.383677Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:15.383714Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:15.383730Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:15.484241Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:15.484279Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:15.484296Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:15.586314Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:15.586351Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:15.586368Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:15.688625Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:15.688654Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:15.688666Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:15.789276Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:15.789305Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:15.789321Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:15.889639Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:15.889671Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:15.889686Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:15.992171Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:15.992204Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:15.992221Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:16.091354Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:16.091384Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:16.091402Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:16.191723Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:16.191752Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:16.191768Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:16.294300Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:16.294339Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:16.294355Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:16.394430Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:16.394471Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:16.394490Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:16.494887Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:16.494927Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:16.494946Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:16.596715Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:16.596748Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:16.596764Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:16.612281Z node 6 :PERSQUEUE DEBUG: partition_compaction.cpp:183: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:55:16.700146Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:16.700181Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:16.700198Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:16.801250Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:16.801286Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:16.801302Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:16.901340Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:16.901378Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:16.901396Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:17.001745Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:17.001786Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:17.001805Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:17.104119Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:17.104161Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:17.104179Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:17.205233Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:17.205275Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:17.205293Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:17.308124Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:17.308165Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:17.308182Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:17.410262Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:17.410304Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:17.410320Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:17.512142Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:17.512190Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:17.512207Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:17.616430Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:17.616465Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:17.616481Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:17.716469Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:17.716508Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:17.716529Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:17.820107Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:17.820144Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:17.820160Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:17.922451Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:17.922487Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:17.922502Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:17.936143Z node 7 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[7:7568543749590763818:2077];send_to=[0:7307199536658146131:7762515];
2025-11-03T16:55:17.936257Z node 7 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
2025-11-03T16:55:18.012895Z node 7 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [7:7568543775360568600:2333], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-03T16:55:18.012987Z node 7 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [7:7568543775360568583:2330], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-03T16:55:18.013142Z node 7 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-03T16:55:18.014238Z node 7 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [7:7568543775360568610:2335], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-03T16:55:18.014341Z node 7 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-03T16:55:18.017107Z node 7 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateResourcePool, opId: 281474976710661:3, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_resource_pool.cpp:179)
2025-11-03T16:55:18.028074Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:18.028106Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:18.028120Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:18.049697Z node 7 :KQP_WORKLOAD_SERVICE WARN: helpers.h:73: [WorkloadService] [TPoolCreatorActor] ActorId: [7:7568543775360568608:2334], DatabaseId: /Root, PoolId: default, Scheduled retry for error: { <main>: Error: Transaction 281474976710661 completed, doublechecking }
2025-11-03T16:55:18.064727Z node 7 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710662:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:690)
2025-11-03T16:55:18.106941Z node 7 :TX_PROXY ERROR: schemereq.cpp:593: Actor# [7:7568543775360568761:2738] txid# 281474976710663, issues: { message: "Check failed: path: \'/Root/.metadata/workload_manager/pools/default\', error: path exist, request accepts it (id: [OwnerId: 72057594046644480, LocalPathId: 8], type: EPathTypeResourcePool, state: EPathStateNoChanges)" severity: 1 }
2025-11-03T16:55:18.128799Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:18.128830Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:18.128844Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:18.151513Z node 7 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:570: Compilation failed, self: [7:7568543775360568772:2346], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-11-03T16:55:18.155073Z node 7 :KQP_SESSION WARN: kqp_session_actor.cpp:2506: SessionId: ydb://session/3?node_id=7&id=Yzk2ZDA2YjMtNmRiZWFjNjctZmVkYzY4OGYtNWMwNjMxYTA=, ActorId: [7:7568543775360568565:2327], ActorState: ExecuteState, TraceId: 01k95a9z7q82ckssxqchf8npp9, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-11-03T16:55:18.155653Z node 7 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-11-03T16:55:18.164457Z node 7 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710664:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:690)
2025-11-03T16:55:18.229312Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:18.229343Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:18.229360Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:18.295037Z node 8 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:570: Compilation failed, self: [8:7568543774152267824:2310], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:5:17: Error: At function: KiReadTable!
        <main>:5:17: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Versions]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-11-03T16:55:18.295353Z node 8 :KQP_SESSION WARN: kqp_session_actor.cpp:2506: SessionId: ydb://session/3?node_id=8&id=OGVjNWM2MTktZTc5OWVmNjQtOTY4NDBmZDktNDAyYjJiZmY=, ActorId: [8:7568543774152267794:2304], ActorState: ExecuteState, TraceId: 01k95a9zfbb2cxwzqz0yk8c5n0, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-11-03T16:55:18.295940Z node 8 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 5 column: 17 } message: "At function: KiReadTable!" end_position { row: 5 column: 17 } severity: 1 issues { position { row: 5 column: 17 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Versions]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 5 column: 17 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-11-03T16:55:18.330021Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:18.330054Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:18.330070Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:18.382517Z node 7 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710665:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:690)
2025-11-03T16:55:18.430214Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:18.430239Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:18.430250Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
=== Init DC: UPSERT INTO `/Root/PQ/Config/V2/Cluster` (name, balancer, local, enabled, weight) VALUES ("dc1", "localhost:2871", true, true, 1000), ("dc2", "localhost:23327", false, false, 1000);
2025-11-03T16:55:18.530505Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:18.530551Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:18.530566Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:18.630928Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:18.630984Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:18.631001Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:18.731238Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:18.731276Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:18.731294Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:18.806775Z node 7 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976710666. Ctx: { TraceId: 01k95a9zrybffzwb8w2ds4betw, Database: , SessionId: ydb://session/3?node_id=7&id=NDMxMWQ4NjQtZWU3MWU4ODUtNTBkNzY4ODEtYTQ2ZGQ4NTU=, PoolId: default, DatabaseId: /Root}. Database not set, use /Root
2025-11-03T16:55:18.831489Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:18.831517Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:18.831529Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
=== CheckClustersList. Subcribe to ClusterTracker from [7:7568543775360569103:2996] 
2025-11-03T16:55:18.932107Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:18.932147Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:18.932164Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:19.033783Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:19.033821Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:19.033837Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:19.134951Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:19.134989Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:19.135004Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:19.236123Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:19.236165Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:19.236182Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:19.340129Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:19.340172Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:19.340186Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:19.440655Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:19.440688Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:19.440713Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:19.543381Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:19.543423Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:19.543440Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:19.643233Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:19.643267Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:19.643282Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:19.744241Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:19.744277Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:19.744296Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:19.847854Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:19.847898Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:19.847918Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:19.948196Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:19.948243Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:19.948261Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:20.049840Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:20.049894Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:20.049917Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:20.150417Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:20.150447Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:20.150464Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:20.252191Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:20.252226Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:20.252243Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:20.353540Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:20.353576Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:20.353593Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:20.456437Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:20.456470Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:20.456496Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:20.560839Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:20.560876Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:20.560907Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:20.661344Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:20.661379Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:20.661397Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:20.761829Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:20.761862Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:20.761878Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:20.862162Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:20.862194Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:20.862210Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:20.965427Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:20.965473Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:20.965489Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:21.064895Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:21.064926Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:21.064943Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:21.165244Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:21.165276Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:21.165292Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:21.266432Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:21.266469Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:21.266491Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:21.366490Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:21.366525Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:21.366554Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:21.466824Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:21.466884Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:21.466905Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:21.567260Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:21.567301Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:21.567320Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:21.613051Z node 6 :PERSQUEUE DEBUG: partition_compaction.cpp:183: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:55:21.667490Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:21.667523Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:21.667542Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:21.772085Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:21.772120Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:21.772136Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:21.872887Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:21.872922Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:21.872940Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:21.973561Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:21.973604Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:21.973620Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:22.074631Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:22.074664Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:22.074679Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:22.176170Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:22.176216Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:22.176234Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:22.276303Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:22.276347Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:22.276364Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:22.380082Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:22.380124Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:22.380142Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:22.480098Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:22.480141Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:22.480159Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:22.583313Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:22.583351Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:22.583369Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:22.682649Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:22.682690Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:22.682708Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:22.783504Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:22.783537Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:22.783552Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:22.884190Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:22.884233Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:22.884254Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:22.992098Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:22.992139Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:22.992158Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:23.091951Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:23.092018Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:23.092038Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:23.192301Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:23.192349Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:23.192367Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:23.292661Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:23.292693Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:23.292709Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:23.404087Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:23.404127Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:23.404144Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:23.504046Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:23.504079Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:23.504096Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:23.607004Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:23.607047Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:23.607065Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:23.708153Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:23.708187Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:23.708204Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:23.812120Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:23.812156Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:23.812173Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:23.916113Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:23.916153Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:23.916170Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:24.016052Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:24.016094Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:24.016111Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:24.116761Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:24.116808Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:24.116825Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:24.220123Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:24.220159Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:24.220177Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:24.321181Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:24.321217Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:24.321235Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:24.421596Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:24.421643Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:24.421662Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:24.522467Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:24.522509Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:24.522529Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:24.622814Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:24.622850Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:24.622866Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:24.723115Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:24.723149Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:24.723167Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:24.824164Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:24.824198Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:24.824214Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:24.925175Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:24.925207Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:24.925224Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:25.025737Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:25.025768Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:25.025789Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:25.126812Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:25.126850Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:25.126867Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:25.227054Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:25.227098Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:25.227118Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:25.330894Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:25.330942Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:25.330962Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:25.432274Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:25.432305Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:25.432327Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:25.536185Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:25.536226Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:25.536255Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:25.637193Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:25.637236Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:25.637256Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:25.737449Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:25.737496Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:25.737517Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:25.838339Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:25.838375Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:25.838393Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:25.938668Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:25.938708Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:25.938724Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:26.040079Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:26.040112Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:26.040129Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:26.144189Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:26.144220Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:26.144235Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
=== CheckClustersList. Ok
2025-11-03T16:55:26.155900Z node 7 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710671:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:690)
waiting...
PQ Client: create topic: rt3.dc1--test-topic with 1 partitions
CallPersQueueGRPC request to localhost:2871
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-11-03T16:55:26.231632Z node 7 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
CallPersQueueGRPC request to localhost:2871
MetaRequest {
  CmdCreateTopic {
    Topic: "rt3.dc1--test-topic"
    NumPartitions: 1
    Config {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
  }
}
CallPersQueueGRPC response:
Status: 129
ProxyErrorCode: 53
SchemeStatus: 1
FlatTxId {
  TxId: 281474976710672
  SchemeShardTabletId: 72057594046644480
  PathId: 13
}
ErrorCode: OK
AddTopic: rt3.dc1--test-topic
===Run query:``DECLARE $version as Int64; DECLARE $path AS Utf8; DECLARE $cluster as Utf8; UPSERT INTO `/Root/PQ/Config/V2/Topics` (path, dc) VALUES ($path, $cluster); UPSERT INTO `/Root/PQ/Config/V2/Versions` (name, version) VALUES ("Topics", $version);`` with topic = test-topic, dc = dc1
2025-11-03T16:55:26.244919Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:26.244950Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:26.244964Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:26.272077Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1655: [72075186224037893][] pipe [7:7568543809720307892:3267] connected; active server actors: 1
2025-11-03T16:55:26.272275Z node 7 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1519: [72075186224037893][rt3.dc1--test-topic] updating configuration. Deleted partitions []. Added partitions [0]
2025-11-03T16:55:26.274789Z node 7 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:971: [72075186224037893][rt3.dc1--test-topic] Discovered subdomain [OwnerId: 72057594046644480, LocalPathId: 1] state, outOfSpace = 0 at RB 72075186224037893
2025-11-03T16:55:26.274892Z node 7 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:140: [72075186224037893][rt3.dc1--test-topic] BALANCER INIT DONE for rt3.dc1--test-topic: (0, 72075186224037892) 
2025-11-03T16:55:26.281000Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2960: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-11-03T16:55:26.288257Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2992: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-11-03T16:55:26.288484Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:787: [PQ: 72075186224037892] no config, start with empty partitions and default config
2025-11-03T16:55:26.288513Z node 8 :PERSQUEUE NOTICE: pq_impl.cpp:913: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-11-03T16:55:26.288553Z node 8 :PERSQUEUE INFO: pq_impl.cpp:612: [PQ: 72075186224037892] doesn't have tx writes info
2025-11-03T16:55:26.288795Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [7:7568543809720307924:2436], now have 1 active actors on pipe
2025-11-03T16:55:26.288819Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [7:7568543809720307891:3266], now have 1 active actors on pipe
2025-11-03T16:55:26.291891Z node 7 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:404: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 8, Generation 1
2025-11-03T16:55:26.296369Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-03T16:55:26.303001Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-03T16:55:26.308922Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [7:7568543809720307961:3318], now have 1 active actors on pipe
2025-11-03T16:55:26.309600Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-03T16:55:26.313373Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-03T16:55:26.314300Z node 8 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-11-03T16:55:26.314387Z node 8 :PERSQUEUE DEBUG: partition.cpp:1312: [72075186224037892][Partition][0][StateInit] HandleOnInit TEvPQ::TEvProposePartitionConfig
2025-11-03T16:55:26.314662Z node 8 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-11-03T16:55:26.314844Z node 8 :PERSQUEUE INFO: partition_init.cpp:1101: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [8:7568543808512006574:2378]
2025-11-03T16:55:26.317854Z node 8 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-11-03T16:55:26.317886Z node 8 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-11-03T16:55:26.317909Z node 8 :PERSQUEUE INFO: partition.cpp:707: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1 [8:7568543808512006574:2378]
2025-11-03T16:55:26.317939Z node 8 :PERSQUEUE DEBUG: partition.cpp:727: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 0 Head Offset 0 PartNo 0 PackedSize 0 count 0 nextOffset 0 batches 0
2025-11-03T16:55:26.317973Z node 8 :PERSQUEUE DEBUG: partition_mlp.cpp:83: [72075186224037892][Partition][0][StateIdle] Initializing MLP Consumers: 0
2025-11-03T16:55:26.319369Z node 8 :PERSQUEUE DEBUG: partition.cpp:4273: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 1
2025-11-03T16:55:26.319430Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:26.319509Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:26.319629Z node 8 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-03T16:55:26.319656Z node 8 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-11-03T16:55:26.319672Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:26.319684Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:26.319697Z node 8 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-11-03T16:55:26.319730Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:923: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-11-03T16:55:26.319772Z node 8 :PERSQUEUE DEBUG: partition_mlp.cpp:60: [72075186224037892][Partition][0][StateIdle] Process MLP pending events. Count 0
2025-11-03T16:55:26.320060Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-03T16:55:26.320184Z node 8 :PERSQUEUE DEBUG: partition_compaction.cpp:183: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:55:26.325105Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-03T16:55:26.325235Z node 8 :PERSQUEUE DEBUG: partition.cpp:1416: [72075186224037892][Partition][0][StateIdle] Handle TEvPQ::TEvTxCommit Step 1762188926351, TxId 281474976710672
2025-11-03T16:55:26.325265Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:26.325279Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:26.325404Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:26.325596Z node 8 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-03T16:55:26.327378Z node 8 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-03T16:55:26.327531Z node 8 :PERSQUEUE DEBUG: partition_mlp.cpp:83: [72075186224037892][Partition][0][StateIdle] Initializing MLP Consumers: 0
2025-11-03T16:55:26.327634Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-11-03T16:55:26.327660Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:26.327673Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:26.327685Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:26.327710Z node 8 :PERSQUEUE DEBUG: partition_compaction.cpp:183: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:55:26.328047Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:398: [PQ: 72075186224037892] Apply new config PartitionConfig { LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 } PartitionIds: 0 TopicName: "rt3.dc1--test-topic" Version: 0 LocalDC: true Codecs { Ids: 0 Ids: 1 Ids: 2 Codecs: "raw" Codecs: "gzip" Codecs: "lzop" } TopicPath: "/Root/PQ/rt3.dc1--test-topic" YcCloudId: "" YcFolderId: "" YdbDatabaseId: "" YdbDatabasePath: "/Root" Partitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } AllPartitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } Consumers { Name: "user" ReadFromTimestampsMs: 0 FormatVersion: 0 Version: 0 Generation: 0 } MonitoringProjectId: ""
2025-11-03T16:55:26.328155Z node 8 :PERSQUEUE NOTICE: pq_impl.cpp:913: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-11-03T16:55:26.328399Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-03T16:55:26.334992Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-03T16:55:26.335086Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-03T16:55:26.337407Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-03T16:55:26.345245Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:26.345285Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:26.345303Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:26.402256Z node 7 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976710673. Ctx: { TraceId: 01k95aa7a9761g0fmm57048jet, Database: , SessionId: ydb://session/3?node_id=7&id=MzIxYmM3MDAtOGU1MjY1ZDQtZmFkODI2MzctZDhmN2MyOGY=, PoolId: default, DatabaseId: /Root}. Database not set, use /Root
2025-11-03T16:55:26.419903Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:26.419940Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:26.419955Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
===Query complete
TClient::Ls request: /Root/PQ/rt3.dc1--test-topic
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976710672
    CreateStep: 1762188926351
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts...
(TRUNCATED)
GetTopicVersionFromPath:  record Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976710672
    CreateStep: 1762188926351
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      YdbDatabasePath: "/Root"
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
    Partitions {
      PartitionId: 0
      TabletId: 72075186224037892
      Status: Active
    }
    AlterVersion: 1
    BalancerTabletID: 72075186224037893
    NextPartitionId: 1
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 1
      PlanResolution: 7
      Coordinators: 72057594046316545
      TimeCastBucketsPerMediator: 2
      Mediators: 72057594046382081
    }
    DomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    PathsInside: 12
    PathsLimit: 10000
    ShardsInside: 6
    ShardsLimit: 200000
    ResourcesDomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    DiskSpaceUsage {
      Tables {
        TotalSize: 0
        DataSize: 0
        IndexSize: 0
      }
      Topics {
        ReserveSize: 0
        AccountSize: 0
        DataSize: 0
        UsedReserveSize: 0
      }
    }
    PQPartitionsInside: 1
    PQPartitionsLimit: 1000000
    SchemeLimits {
      MaxDepth: 32
      MaxPaths: 10000
      MaxChildrenInDir: 100000
      MaxAclBytesSize: 10240
      MaxTableColumns: 200
      MaxTableColumnNameLength: 255
      MaxTableKeyColumns: 30
      MaxTableIndices: 20
      MaxShards: 200000
      MaxShardsInPath: 35000
      MaxConsistentCopyTargets: 10000
      MaxPathElementLength: 255
      ExtraPathSymbolsAllowed: "!\"#$%&\'()*+,-.:;<=>?@[\\]^_`{|}~"
      MaxPQPartitions: 1000000
      MaxTableCdcStreams: 5
      MaxExports: 10
      MaxImports: 10
      MaxColumnTableColumns: 10000
    }
  }
}
Path: "/Root/PQ/rt3.dc1--test-topic"
 name rt3.dc1--test-topic version1
CallPersQueueGRPC request to localhost:2871
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-11-03T16:55:26.428700Z node 7 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
MetaResponse {
  CmdGetTopicMetadataResult {
    TopicInfo {
      Topic: "rt3.dc1--test-topic"
      NumPartitions: 1
      Config {
        PartitionConfig {
          LifetimeSeconds: 86400
          LowWatermark: 8388608
          SourceIdLifetimeSeconds: 86400
          WriteSpeedInBytesPerSecond: 20000000
          BurstSize: 20000000
          SourceIdMaxCounts: 6000000
        }
        Version: 1
        LocalDC: true
        Codecs {
          Ids: 0
          Ids: 1
          Ids: 2
          Codecs: "raw"
          Codecs: "gzip"
          Codecs: "lzop"
        }
        TopicPath: "/Root/PQ/rt3.dc1--test-topic"
        YdbDatabasePath: "/Root"
        Consumers {
          Name: "user"
          ReadFromTimestampsMs: 0
          FormatVersion: 0
          Version: 0
        }
      }
      ErrorCode: OK
    }
  }
}
=== Topic created, have version: 1
2025-11-03T16:55:26.441289Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: try to update token
2025-11-03T16:55:26.441928Z :INFO: [] MessageGroupId [src] SessionId [] Write session: Do CDS request
2025-11-03T16:55:26.441989Z :INFO: [] MessageGroupId [src] SessionId [] Start write session. Will connect to endpoint: localhost:2871
2025-11-03T16:55:26.445602Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:26.445639Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:26.445658Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:26.454279Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src" }
2025-11-03T16:55:26.454524Z node 7 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-11-03T16:55:26.454581Z node 7 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1
2025-11-03T16:55:26.455094Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src" }
2025-11-03T16:55:26.455221Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1 topic: "test-topic" message_group_id: "src" from ipv6:[::1]:33336
2025-11-03T16:55:26.455250Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:33336 proto=v1  topic=test-topic durationSec=0
2025-11-03T16:55:26.455266Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-11-03T16:55:26.457015Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1 sessionId:  describe result for acl check
2025-11-03T16:55:26.457164Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-11-03T16:55:26.457184Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-11-03T16:55:26.457196Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-11-03T16:55:26.457225Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [7:7568543809720308032:2453] (SourceId=src, PreferedPartition=(NULL)) StartKqpSession
2025-11-03T16:55:26.460528Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [7:7568543809720308032:2453] (SourceId=src, PreferedPartition=(NULL)) Select from the table
2025-11-03T16:55:26.520971Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:26.521008Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:26.521034Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:26.545980Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:26.546015Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:26.546033Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:26.613142Z node 6 :PERSQUEUE DEBUG: partition_compaction.cpp:183: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:55:26.621329Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:26.621366Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:26.621382Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:26.645765Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [7:7568543809720308032:2453] (SourceId=src, PreferedPartition=(NULL)) RequestPQRB
2025-11-03T16:55:26.646065Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1655: [72075186224037893][rt3.dc1--test-topic] pipe [7:7568543809720308069:2453] connected; active server actors: 1
2025-11-03T16:55:26.646110Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [7:7568543809720308032:2453] (SourceId=src, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=src
2025-11-03T16:55:26.646129Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [7:7568543809720308032:2453] (SourceId=src, PreferedPartition=(NULL)) Update the table
2025-11-03T16:55:26.646208Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:26.646289Z node 7 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1659: [72075186224037893][rt3.dc1--test-topic] pipe [7:7568543809720308069:2453] disconnected.
2025-11-03T16:55:26.646244Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:26.646259Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:26.646308Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1670: [72075186224037893][rt3.dc1--test-topic] pipe [7:7568543809720308069:2453] disconnected; active server actors: 1
2025-11-03T16:55:26.646321Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1695: [72075186224037893][rt3.dc1--test-topic] pipe [7:7568543809720308069:2453] disconnected no session
2025-11-03T16:55:26.721487Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:26.721525Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:26.721545Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:26.746561Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:26.746602Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:26.746619Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:26.782348Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [7:7568543809720308032:2453] (SourceId=src, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-11-03T16:55:26.782393Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [7:7568543809720308032:2453] (SourceId=src, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-11-03T16:55:26.782413Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [7:7568543809720308032:2453] (SourceId=src, PreferedPartition=(NULL)) Start idle
2025-11-03T16:55:26.782445Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-11-03T16:55:26.783782Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 8, Generation: 1
2025-11-03T16:55:26.783484Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [7:7568543809720308094:2453], now have 1 active actors on pipe
2025-11-03T16:55:26.784030Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:55:26.784064Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:55:26.784160Z node 8 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src|2ace57a5-c4be6425-27a2bd6b-c786d6ee_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src
2025-11-03T16:55:26.784219Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:26.784251Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:26.784267Z node 8 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-03T16:55:26.784317Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:26.784387Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-03T16:55:26.784450Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-03T16:55:26.786151Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:55:26.786193Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:55:26.786282Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-03T16:55:26.786644Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1 partition: 0 MaxSeqNo: 0 sessionId: src|2ace57a5-c4be6425-27a2bd6b-c786d6ee_0
2025-11-03T16:55:26.787312Z :INFO: [] MessageGroupId [src] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1762188926787 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-11-03T16:55:26.787441Z :INFO: [] MessageGroupId [src] SessionId [] Write session established. Init response: session_id: "src|2ace57a5-c4be6425-27a2bd6b-c786d6ee_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-11-03T16:55:26.787632Z :INFO: [] MessageGroupId [src] SessionId [src|2ace57a5-c4be6425-27a2bd6b-c786d6ee_0] Write session: close. Timeout = 0 ms
2025-11-03T16:55:26.787693Z :INFO: [] MessageGroupId [src] SessionId [src|2ace57a5-c4be6425-27a2bd6b-c786d6ee_0] Write session will now close
2025-11-03T16:55:26.787761Z :DEBUG: [] MessageGroupId [src] SessionId [src|2ace57a5-c4be6425-27a2bd6b-c786d6ee_0] Write session: aborting
2025-11-03T16:55:26.788339Z :INFO: [] MessageGroupId [src] SessionId [src|2ace57a5-c4be6425-27a2bd6b-c786d6ee_0] Write session: gracefully shut down, all writes complete
2025-11-03T16:55:26.788388Z :DEBUG: [] MessageGroupId [src] SessionId [src|2ace57a5-c4be6425-27a2bd6b-c786d6ee_0] Write session: destroy
2025-11-03T16:55:26.789066Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId: src|2ace57a5-c4be6425-27a2bd6b-c786d6ee_0 grpc read done: success: 0 data: 
2025-11-03T16:55:26.789090Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 1 sessionId: src|2ace57a5-c4be6425-27a2bd6b-c786d6ee_0 grpc read failed
2025-11-03T16:55:26.789136Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:824: session v1 closed cookie: 1 sessionId: src|2ace57a5-c4be6425-27a2bd6b-c786d6ee_0
2025-11-03T16:55:26.789158Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1 sessionId: src|2ace57a5-c4be6425-27a2bd6b-c786d6ee_0 is DEAD
2025-11-03T16:55:26.789536Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-11-03T16:55:26.789998Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [7:7568543809720308094:2453] destroyed
2025-11-03T16:55:26.790048Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
====TYdbPqTestRetryPolicy()
====ExpectBreakDown
2025-11-03T16:55:26.790083Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:26.790102Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:26.790120Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
=== Create write session 
2025-11-03T16:55:26.805660Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [] Write session: try to update token
2025-11-03T16:55:26.806169Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [] Write session: Do CDS request
2025-11-03T16:55:26.806251Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [] Do schedule cds request after 0 ms
=== Wait retries
2025-11-03T16:55:26.806381Z :INFO: [/Root] MessageGroupId [test-message-group-id] Running cds request ms
2025-11-03T16:55:26.816966Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [] Got CDS response: 
write_sessions_clusters { clusters { endpoint: "localhost:23327" name: "dc2" } clusters { endpoint: "localhost:2871" name: "dc1" available: true } primary_cluster_selection_reason: CLIENT_PREFERENCE } version: 1
====CreateRetryState
====CreateRetryState Initialized
Test retry state: get retry delay
2025-11-03T16:55:26.817151Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [] Got error. Status: GENERIC_ERROR, Description: <main>: Error: Selected destination cluster: dc2 is currently disabled <main>: Error: Could not get valid endpoint from cluster discovery 
2025-11-03T16:55:26.817206Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [] Write session will restart in 2.000000s
2025-11-03T16:55:26.817298Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [] Write session: Do CDS request
2025-11-03T16:55:26.817356Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [] Do schedule cds request after 2000 ms
2025-11-03T16:55:26.821813Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:26.821852Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:26.821869Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:26.846944Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:26.846978Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:26.846992Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:26.922209Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:26.922251Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:26.922273Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:26.947297Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:26.947338Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:26.947357Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:27.022528Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:27.022576Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:27.022595Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:27.047659Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:27.047712Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:27.047738Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:27.122833Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:27.122870Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:27.122901Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:27.148016Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:27.148056Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:27.148072Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:27.223254Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:27.223292Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:27.223312Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:27.248357Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:27.248396Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:27.248411Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:27.323543Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:27.323584Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:27.323601Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:27.348720Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:27.348760Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:27.348786Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:27.428091Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:27.428132Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:27.428151Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:27.449166Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:27.449211Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:27.449228Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:27.531644Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:27.531688Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:27.531704Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:27.552104Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:27.552134Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:27.552151Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:27.634802Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:27.634839Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:27.634855Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:27.651298Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:27.651338Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:27.651356Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:27.735254Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:27.735284Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:27.735297Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:27.751636Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:27.751668Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:27.751685Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:27.835518Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:27.835546Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:27.835558Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:27.852721Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:27.852752Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:27.852768Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:27.935968Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:27.936034Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:27.936053Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:27.952857Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:27.952891Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:27.952909Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:28.036316Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:28.036352Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:28.036368Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:28.055342Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:28.055386Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:28.055406Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:28.136662Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:28.136698Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:28.136717Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:28.155093Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:28.155135Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:28.155152Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:28.160211Z node 7 :FLAT_TX_SCHEMESHARD WARN: schemeshard_impl.cpp:7727: Cannot get console configs
2025-11-03T16:55:28.160244Z node 7 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
2025-11-03T16:55:28.240193Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:28.240235Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:28.240254Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:28.255742Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:28.255792Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:28.255813Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:28.344102Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:28.344142Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:28.344160Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:28.355791Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:28.355826Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:28.355846Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:28.446584Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:28.446625Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:28.446647Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:28.456151Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:28.456189Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:28.456209Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:28.548103Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:28.548142Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:28.548161Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:28.556801Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:28.556837Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:28.556856Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:28.650327Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:28.650370Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:28.650390Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:28.657270Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:28.657299Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:28.657312Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:28.754153Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:28.754198Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:28.754219Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:28.764921Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:28.764959Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:28.764975Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:28.825420Z :INFO: [/Root] MessageGroupId [test-message-group-id] Running cds request ms
2025-11-03T16:55:28.836888Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [] Got CDS response: 
write_sessions_clusters { clusters { endpoint: "localhost:23327" name: "dc2" } clusters { endpoint: "localhost:2871" name: "dc1" available: true } primary_cluster_selection_reason: CLIENT_PREFERENCE } version: 1
Test retry state: get retry delay
2025-11-03T16:55:28.837015Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [] Got error. Status: GENERIC_ERROR, Description: <main>: Error: Selected destination cluster: dc2 is currently disabled <main>: Error: Could not get valid endpoint from cluster discovery 
2025-11-03T16:55:28.837048Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [] Write session will restart in 2.000000s
2025-11-03T16:55:28.837099Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [] Write session: Do CDS request
2025-11-03T16:55:28.837136Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [] Do schedule cds request after 2000 ms
2025-11-03T16:55:28.857737Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:28.857783Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:28.857804Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:28.867619Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:28.867649Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:28.867666Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:28.960103Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:28.960143Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:28.960163Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:28.976095Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:28.976134Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:28.976151Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:29.060309Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:29.060338Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:29.060354Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:29.076068Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:29.076101Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:29.076118Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:29.160662Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:29.160696Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:29.160713Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:29.176274Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:29.176311Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:29.176327Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:29.262133Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:29.262167Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:29.262183Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:29.284069Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:29.284104Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:29.284119Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:29.363316Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:29.363345Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:29.363362Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:29.385188Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:29.385224Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:29.385241Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:29.463626Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:29.463665Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:29.463684Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:29.485212Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:29.485249Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:29.485267Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:29.563662Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:29.563705Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:29.563726Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:29.587377Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:29.587413Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:29.587433Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:29.664005Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:29.664045Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:29.664065Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:29.687832Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:29.687870Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:29.687890Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:29.769025Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:29.769065Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:29.769085Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:29.788420Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:29.788465Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:29.788484Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:29.869870Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:29.869911Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:29.869933Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:29.890286Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:29.890334Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:29.890353Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:29.970828Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:29.970871Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:29.970889Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:29.991462Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:29.991508Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:29.991528Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:30.072641Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:30.072680Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:30.072698Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:30.092963Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:30.093006Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:30.093026Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:30.176267Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:30.176301Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:30.176319Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:30.193418Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:30.193460Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:30.193478Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:30.279466Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:30.279501Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:30.279517Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:30.296112Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:30.296154Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:30.296175Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:30.382008Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:30.382043Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:30.382059Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:30.398012Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:30.398056Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:30.398072Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:30.484182Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:30.484217Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:30.484235Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:30.499309Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:30.499344Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:30.499362Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:30.583951Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:30.583989Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:30.584000Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:30.598868Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:30.598900Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:30.598917Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:30.684822Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:30.684866Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:30.684885Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:30.699201Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:30.699241Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:30.699259Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:30.785246Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:30.785280Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:30.785298Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:30.800041Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:30.800079Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:30.800095Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:30.838383Z :INFO: [/Root] MessageGroupId [test-message-group-id] Running cds request ms
2025-11-03T16:55:30.848181Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [] Got CDS response: 
write_sessions_clusters { clusters { endpoint: "localhost:23327" name: "dc2" } clusters { endpoint: "localhost:2871" name: "dc1" available: true } primary_cluster_selection_reason: CLIENT_PREFERENCE } version: 1
Test retry state: get retry delay
2025-11-03T16:55:30.848410Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [] Got error. Status: GENERIC_ERROR, Description: <main>: Error: Selected destination cluster: dc2 is currently disabled <main>: Error: Could not get valid endpoint from cluster discovery 
2025-11-03T16:55:30.848436Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [] Write session will restart in 2.000000s
2025-11-03T16:55:30.848521Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [] Write session: Do CDS request
2025-11-03T16:55:30.848558Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [] Do schedule cds request after 2000 ms
=== Enable dc2
===Update clusters: UPDATE `/Root/PQ/Config/V2/Cluster` SET enabled = true where name = "dc2";
2025-11-03T16:55:30.886942Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:30.886982Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:30.886999Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:30.901850Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:30.901890Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:30.901907Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:30.987410Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:30.987444Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:30.987462Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:31.003554Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:31.003605Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:31.003623Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:31.088085Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:31.088122Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:31.088138Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:31.103782Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:31.103825Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:31.103845Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:31.172016Z node 7 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976710679. Ctx: { TraceId: 01k95aabtn75bp21s5gprt5z7s, Database: , SessionId: ydb://session/3?node_id=7&id=YWRlZWI0ODEtZDJlNzVjMjItY2ZmNTk1NDYtY2E3ODI2ZjY=, PoolId: default, DatabaseId: /Root}. Database not set, use /Root
2025-11-03T16:55:31.188132Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:31.188165Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:31.188182Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
=== Wait for repair
2025-11-03T16:55:31.204082Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:31.204123Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:31.204141Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:31.288575Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:31.288606Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:31.288628Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:31.304421Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:31.304461Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:31.304480Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:31.320127Z node 8 :PERSQUEUE DEBUG: partition_compaction.cpp:183: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:55:31.392106Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:31.392148Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:31.392172Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:31.404762Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:31.404804Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:31.404824Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:31.493337Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:31.493379Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:31.493398Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:31.505498Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:31.505542Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:31.505562Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:31.595799Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:31.595836Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:31.595852Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:31.607403Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:31.607441Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:31.607459Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:31.613307Z node 6 :PERSQUEUE DEBUG: partition_compaction.cpp:183: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:55:31.697302Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:31.697340Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:31.697358Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:31.707338Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:31.707377Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:31.707395Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:31.800095Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:31.800133Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:31.800150Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:31.807688Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:31.807730Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:31.807747Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:31.906252Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:31.906287Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:31.906302Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:31.911781Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:31.911822Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:31.911839Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:32.007218Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:32.007250Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:32.007264Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:32.012007Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:32.012038Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:32.012052Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:32.108127Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:32.108155Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:32.108169Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:32.112842Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:32.112876Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:32.112891Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:32.208799Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:32.208843Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:32.208860Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:32.213192Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:32.213228Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:32.213245Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:32.308865Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:32.308914Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:32.308928Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:32.313572Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:32.313600Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:32.313615Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:32.409722Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:32.409762Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:32.409785Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:32.416078Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:32.416118Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:32.416140Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:32.510148Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:32.510185Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:32.510206Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:32.516406Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:32.516447Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:32.516478Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:32.610537Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:32.610587Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:32.610609Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:32.620126Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:32.620177Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:32.620199Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:32.710896Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:32.710940Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:32.710959Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:32.720640Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:32.720680Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:32.720701Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:32.812159Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:32.812196Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:32.812214Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:32.820983Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:32.821028Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:32.821056Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:32.849281Z :INFO: [/Root] MessageGroupId [test-message-group-id] Running cds request ms
2025-11-03T16:55:32.859907Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [] Got CDS response: 
write_sessions_clusters { clusters { endpoint: "localhost:23327" name: "dc2" available: true } clusters { endpoint: "localhost:2871" name: "dc1" available: true } primary_cluster_selection_reason: CLIENT_PREFERENCE } version: 1
2025-11-03T16:55:32.859973Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [] Start write session. Will connect to endpoint: localhost:23327
2025-11-03T16:55:32.891809Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [] Write session: send init request: init_request { topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc2" }
2025-11-03T16:55:32.889859Z node 5 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-11-03T16:55:32.889900Z node 5 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2
2025-11-03T16:55:32.892562Z node 5 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc2" }
2025-11-03T16:55:32.892745Z node 5 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2 topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc2" from ipv6:[::1]:59250
2025-11-03T16:55:32.892765Z node 5 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:59250 proto=v1  topic=test-topic durationSec=0
2025-11-03T16:55:32.892780Z node 5 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-11-03T16:55:32.894750Z node 5 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2 sessionId:  describe result for acl check
2025-11-03T16:55:32.894894Z node 5 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-11-03T16:55:32.894907Z node 5 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-11-03T16:55:32.894920Z node 5 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-11-03T16:55:32.894938Z node 5 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [5:7568543834271161525:2635] (SourceId=test-message-group-id, PreferedPartition=(NULL)) StartKqpSession
2025-11-03T16:55:32.899020Z node 5 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [5:7568543834271161525:2635] (SourceId=test-message-group-id, PreferedPartition=(NULL)) Select from the table
2025-11-03T16:55:32.908592Z node 5 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [5:7568543834271161525:2635] (SourceId=test-message-group-id, PreferedPartition=(NULL)) RequestPQRB
2025-11-03T16:55:32.909314Z node 5 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1655: [72075186224037893][rt3.dc1--test-topic] pipe [5:7568543834271161545:2635] connected; active server actors: 1
2025-11-03T16:55:32.909461Z node 5 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [5:7568543834271161525:2635] (SourceId=test-message-group-id, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=test-message-group-id
2025-11-03T16:55:32.909487Z node 5 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [5:7568543834271161525:2635] (SourceId=test-message-group-id, PreferedPartition=(NULL)) Update the table
2025-11-03T16:55:32.910284Z node 5 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1659: [72075186224037893][rt3.dc1--test-topic] pipe [5:7568543834271161545:2635] disconnected.
2025-11-03T16:55:32.910318Z node 5 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1670: [72075186224037893][rt3.dc1--test-topic] pipe [5:7568543834271161545:2635] disconnected; active server actors: 1
2025-11-03T16:55:32.910339Z node 5 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1695: [72075186224037893][rt3.dc1--test-topic] pipe [5:7568543834271161545:2635] disconnected no session
2025-11-03T16:55:32.916434Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:32.916472Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:32.916492Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:32.918283Z node 5 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [5:7568543834271161525:2635] (SourceId=test-message-group-id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-11-03T16:55:32.918330Z node 5 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [5:7568543834271161525:2635] (SourceId=test-message-group-id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-11-03T16:55:32.918350Z node 5 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [5:7568543834271161525:2635] (SourceId=test-message-group-id, PreferedPartition=(NULL)) Start idle
2025-11-03T16:55:32.918382Z node 5 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-11-03T16:55:32.923005Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [5:7568543834271161563:2635], now have 1 active actors on pipe
2025-11-03T16:55:32.923339Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 6, Generation: 1
2025-11-03T16:55:32.923695Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:55:32.923731Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:55:32.923816Z node 6 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie test-message-group-id|472e465-aa26a78-b9d02785-871eb7f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner test-message-group-id
2025-11-03T16:55:32.923859Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:32.923878Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:32.923895Z node 6 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-03T16:55:32.923962Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:32.924021Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-03T16:55:32.924082Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:32.924098Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:32.924113Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:32.924151Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-03T16:55:32.925103Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:55:32.925135Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:55:32.925207Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-03T16:55:32.925690Z node 5 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2 partition: 0 MaxSeqNo: 0 sessionId: test-message-group-id|472e465-aa26a78-b9d02785-871eb7f_0
2025-11-03T16:55:32.926700Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [] Counters: { Errors: 3 CurrentSessionLifetimeMs: 1762188932926 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-11-03T16:55:32.926836Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [] Write session established. Init response: session_id: "test-message-group-id|472e465-aa26a78-b9d02785-871eb7f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
=== Close writer
2025-11-03T16:55:32.927070Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|472e465-aa26a78-b9d02785-871eb7f_0] Write session: close. Timeout = 18446744073709551 ms
2025-11-03T16:55:32.927123Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|472e465-aa26a78-b9d02785-871eb7f_0] Write session will now close
2025-11-03T16:55:32.927177Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|472e465-aa26a78-b9d02785-871eb7f_0] Write session: aborting
2025-11-03T16:55:32.927635Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|472e465-aa26a78-b9d02785-871eb7f_0] Write session: gracefully shut down, all writes complete
2025-11-03T16:55:32.927762Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|472e465-aa26a78-b9d02785-871eb7f_0] Write session: destroy
2025-11-03T16:55:32.929909Z node 5 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: test-message-group-id|472e465-aa26a78-b9d02785-871eb7f_0 grpc read done: success: 0 data: 
2025-11-03T16:55:32.929935Z node 5 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 2 sessionId: test-message-group-id|472e465-aa26a78-b9d02785-871eb7f_0 grpc read failed
2025-11-03T16:55:32.929971Z node 5 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 2 sessionId: test-message-group-id|472e465-aa26a78-b9d02785-871eb7f_0 grpc closed
2025-11-03T16:55:32.929996Z node 5 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2 sessionId: test-message-group-id|472e465-aa26a78-b9d02785-871eb7f_0 is DEAD
2025-11-03T16:55:32.930797Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-11-03T16:55:32.931927Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [5:7568543834271161563:2635] destroyed
2025-11-03T16:55:32.932090Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-11-03T16:55:32.932133Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:32.932166Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:32.932183Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:33.012950Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:33.012989Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:33.013010Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:33.028299Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:33.028341Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:33.028360Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:33.114121Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:33.114158Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:33.114174Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:33.132086Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:33.132124Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:33.132143Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:33.214138Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:33.214169Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:33.214184Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:33.314503Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:33.314539Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:33.314555Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:33.419123Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:33.419166Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:33.419184Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:33.520261Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:33.520295Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:33.520310Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:33.623237Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:33.623277Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:33.623295Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:33.700780Z node 5 :KQP_EXECUTER ERROR: kqp_executer_impl.h:1006: ActorId: [5:7568543838566128894:2641] TxId: 281474976720692. Ctx: { TraceId: 01k95aae649s38rp4hfneet4zy, Database: /Root, SessionId: ydb://session/3?node_id=5&id=ODc4MzU2ZjktMzM4ZGY3N2UtZmQ5YTJkOTEtMTkzMGJkOTM=, PoolId: default}. UNAVAILABLE: Failed to send EvStartKqpTasksRequest because node is unavailable: 6
2025-11-03T16:55:33.701772Z node 5 :KQP_COMPUTE ERROR: dq_compute_actor_impl.h:1210: SelfId: [5:7568543838566128900:2641], TxId: 281474976720692, task: 3. Ctx: { CheckpointId : .  TraceId : 01k95aae649s38rp4hfneet4zy.  RunScriptActorId : [0:0:0].  CustomerSuppliedId : .  PoolId : default.  SessionId : ydb://session/3?node_id=5&id=ODc4MzU2ZjktMzM4ZGY3N2UtZmQ5YTJkOTEtMTkzMGJkOTM=.  CurrentExecutionId : .  Database : /Root.  DatabaseId : /Root. }. Handle abort execution event from: [5:7568543838566128894:2641], status: UNAVAILABLE, reason: { <main>: Error: Terminate execution }
2025-11-03T16:55:33.724147Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:33.724195Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:33.724217Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:33.826553Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:33.826624Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:33.826647Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:33.926888Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:33.926941Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:33.926961Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:34.027231Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:34.027272Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:34.027296Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:34.127610Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:34.127643Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:34.127672Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:34.227899Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:34.227942Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:34.227961Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:34.328283Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:34.328322Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:34.328341Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:34.431253Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:34.431301Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:34.431320Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:34.531555Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:34.531604Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:34.531624Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:34.633357Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:34.633391Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:34.633405Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:34.733723Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:34.733746Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:34.733757Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:34.837300Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:34.837342Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:34.837358Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:34.939655Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:34.939694Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:34.939710Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:35.039961Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:35.040010Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:35.040027Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
====Start test
2025-11-03T16:55:36.739548Z :TWriteSession_SwitchBackToLocalCluster INFO: Random seed for debugging is 1762188936739527
2025-11-03T16:55:36.792317Z :SwitchBackToLocalCluster INFO: Random seed for debugging is 1762188936792293
2025-11-03T16:55:37.356570Z node 9 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[9:7568543856866634189:2136];send_to=[0:7307199536658146131:7762515];
2025-11-03T16:55:37.362272Z node 9 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
test_client.cpp: SetPath # /home/runner/.ya/build/build_root/7jz3/00196f/r3tmp/tmptAYqPq/pdisk_1.dat
2025-11-03T16:55:37.400741Z node 9 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-11-03T16:55:37.408083Z node 9 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-11-03T16:55:37.408337Z node 10 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-11-03T16:55:37.410449Z node 10 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-11-03T16:55:37.410685Z node 10 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=incorrect path status: LookupError;
2025-11-03T16:55:37.549073Z node 9 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
2025-11-03T16:55:37.579603Z node 9 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(9, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-11-03T16:55:37.579701Z node 9 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(9, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-11-03T16:55:37.581248Z node 9 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(10, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-11-03T16:55:37.581337Z node 9 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(10, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-11-03T16:55:37.589168Z node 9 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-11-03T16:55:37.594160Z node 9 :HIVE WARN: hive_impl.cpp:811: HIVE#72057594037968897 Handle TEvInterconnect::TEvNodeConnected, NodeId 10 Cookie 10
2025-11-03T16:55:37.594325Z node 9 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(9, (0,0,0,0)) VolatileState: Connecting -> Connected
2025-11-03T16:55:37.597889Z node 9 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(10, (0,0,0,0)) VolatileState: Connecting -> Connected
TServer::EnableGrpc on GrpcPort 31038, node 9
2025-11-03T16:55:37.651143Z node 10 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-11-03T16:55:37.690202Z node 9 :NET_CLASSIFIER WARN: net_classifier.cpp:190: distributable config is empty, broken or outdated, will use file: /home/runner/.ya/build/build_root/7jz3/00196f/r3tmp/yandexd1bmuX.tmp
2025-11-03T16:55:37.690224Z node 9 :NET_CLASSIFIER WARN: net_classifier.cpp:196: will try to initialize from file: /home/runner/.ya/build/build_root/7jz3/00196f/r3tmp/yandexd1bmuX.tmp
2025-11-03T16:55:37.690346Z node 9 :NET_CLASSIFIER WARN: net_classifier.cpp:202: successfully initialized from file: /home/runner/.ya/build/build_root/7jz3/00196f/r3tmp/yandexd1bmuX.tmp
2025-11-03T16:55:37.690487Z node 9 :NET_CLASSIFIER ERROR: net_classifier.cpp:228: got bad distributable configuration
2025-11-03T16:55:37.733747Z INFO: TTestServer started on Port 21771 GrpcPort 31038
2025-11-03T16:55:37.981652Z node 9 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
TClient is connected to server localhost:21771
PQClient connected to localhost:31038
WaitRootIsUp 'Root'...
TClient::Ls request: Root
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "Root"
    PathId: 1
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 1
    CreateStep: 0
    ParentPathId: 1
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 1
      SubDomainVersion: 0
      SecurityStateVersion: 0
    }
    ChildrenExist: false
  }
  Children {
    Name: ".sys"
    PathId: 18446744073709551615
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 0
    CreateStep: 0
    ParentPathId: 18446744073709551615
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 0
      Pl...
(TRUNCATED)
WaitRootIsUp 'Root' success.
2025-11-03T16:55:38.037611Z node 9 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpAlterSubDomain, opId: 281474976710657:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_alter_subdomain.cpp:311)
waiting...
waiting...
waiting...
waiting...
2025-11-03T16:55:38.379626Z node 9 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-11-03T16:55:38.400158Z node 10 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-11-03T16:55:42.348295Z node 9 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[9:7568543856866634189:2136];send_to=[0:7307199536658146131:7762515];
2025-11-03T16:55:42.348396Z node 9 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
2025-11-03T16:55:42.437714Z node 10 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [10:7568543875959260443:2301], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-03T16:55:42.437821Z node 10 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-03T16:55:42.437962Z node 10 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [10:7568543875959260456:2304], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-03T16:55:42.442642Z node 10 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [10:7568543875959260458:2305], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-03T16:55:42.442795Z node 10 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-03T16:55:42.455538Z node 9 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateResourcePool, opId: 281474976720657:3, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_resource_pool.cpp:179)
2025-11-03T16:55:42.498818Z node 10 :KQP_WORKLOAD_SERVICE WARN: helpers.h:73: [WorkloadService] [TPoolCreatorActor] ActorId: [10:7568543875959260459:2306], DatabaseId: /Root, PoolId: default, Scheduled retry for error: { <main>: Error: Transaction 281474976720657 completed, doublechecking }
2025-11-03T16:55:42.598856Z node 10 :TX_PROXY ERROR: schemereq.cpp:593: Actor# [10:7568543875959260488:2144] txid# 281474976720658, issues: { message: "Check failed: path: \'/Root/.metadata/workload_manager/pools/default\', error: path exist, request accepts it (id: [OwnerId: 72057594046644480, LocalPathId: 8], type: EPathTypeResourcePool, state: EPathStateNoChanges)" severity: 1 }
2025-11-03T16:55:42.685183Z node 10 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:570: Compilation failed, self: [10:7568543875959260503:2310], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-11-03T16:55:42.688410Z node 10 :KQP_SESSION WARN: kqp_session_actor.cpp:2506: SessionId: ydb://session/3?node_id=10&id=NTExMGZhMTgtOTc2NTI4OTUtYzE0YzNmNWMtZGM1N2UxODc=, ActorId: [10:7568543875959260434:2300], ActorState: ExecuteState, TraceId: 01k95aaq3279awbqbccvcthphf, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-11-03T16:55:42.688933Z node 10 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-11-03T16:55:42.691892Z node 9 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:570: Compilation failed, self: [9:7568543878341471668:2335], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-11-03T16:55:42.695530Z node 9 :KQP_SESSION WARN: kqp_session_actor.cpp:2506: SessionId: ydb://session/3?node_id=9&id=NDcyNjcyNjAtOGM4M2U1MjYtNDc0MjdjMTMtYTcxMWJlYjg=, ActorId: [9:7568543878341471617:2326], ActorState: ExecuteState, TraceId: 01k95aaq9m1ec1d7jq02p9gvfg, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-11-03T16:55:42.696119Z node 9 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-11-03T16:55:42.728696Z node 9 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710661:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:690)
2025-11-03T16:55:43.061155Z node 9 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710662:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:690)
2025-11-03T16:55:43.384723Z node 9 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710663:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:690)
=== Init DC: UPSERT INTO `/Root/PQ/Config/V2/Cluster` (name, balancer, local, enabled, weight) VALUES ("dc1", "localhost:31038", true, true, 1000), ("dc2", "localhost:4763", false, true, 1000);
2025-11-03T16:55:44.135337Z node 9 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976710664. Ctx: { TraceId: 01k95aar98bge6bvbdnhq1dxy5, Database: , SessionId: ydb://session/3?node_id=9&id=ZDZiZGIzYjgtZjFmMGUwOTgtYWVkMGQ5NDQtYWYyYzc1ZTA=, PoolId: default, DatabaseId: /Root}. Database not set, use /Root
=== CheckClustersList. Subcribe to ClusterTracker from [9:7568543886931406697:2995] 
=== CheckClustersList. Ok
2025-11-03T16:55:52.191232Z node 9 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710669:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:690)
waiting...
PQ Client: create topic: rt3.dc1--test-topic with 1 partitions
CallPersQueueGRPC request to localhost:31038
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-11-03T16:55:52.307067Z node 9 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
CallPersQueueGRPC request to localhost:31038
MetaRequest {
  CmdCreateTopic {
    Topic: "rt3.dc1--test-topic"
    NumPartitions: 1
    Config {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
  }
}
CallPersQueueGRPC response:
Status: 129
ProxyErrorCode: 53
SchemeStatus: 1
FlatTxId {
  TxId: 281474976710670
  SchemeShardTabletId: 72057594046644480
  PathId: 13
}
ErrorCode: OK
AddTopic: rt3.dc1--test-topic
===Run query:``DECLARE $version as Int64; DECLARE $path AS Utf8; DECLARE $cluster as Utf8; UPSERT INTO `/Root/PQ/Config/V2/Topics` (path, dc) VALUES ($path, $cluster); UPSERT INTO `/Root/PQ/Config/V2/Versions` (name, version) VALUES ("Topics", $version);`` with topic = test-topic, dc = dc1
2025-11-03T16:55:52.367328Z node 9 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1655: [72075186224037893][] pipe [9:7568543921291145459:3248] connected; active server actors: 1
2025-11-03T16:55:52.367612Z node 9 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1519: [72075186224037893][rt3.dc1--test-topic] updating configuration. Deleted partitions []. Added partitions [0]
2025-11-03T16:55:52.370374Z node 9 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:971: [72075186224037893][rt3.dc1--test-topic] Discovered subdomain [OwnerId: 72057594046644480, LocalPathId: 1] state, outOfSpace = 0 at RB 72075186224037893
2025-11-03T16:55:52.379382Z node 9 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:140: [72075186224037893][rt3.dc1--test-topic] BALANCER INIT DONE for rt3.dc1--test-topic: (0, 72075186224037892) 
2025-11-03T16:55:52.380204Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:2960: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-11-03T16:55:52.415856Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:2992: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-11-03T16:55:52.416390Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:787: [PQ: 72075186224037892] no config, start with empty partitions and default config
2025-11-03T16:55:52.416460Z node 10 :PERSQUEUE NOTICE: pq_impl.cpp:913: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-11-03T16:55:52.416544Z node 10 :PERSQUEUE INFO: pq_impl.cpp:612: [PQ: 72075186224037892] doesn't have tx writes info
2025-11-03T16:55:52.424033Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [9:7568543921291145508:2440], now have 1 active actors on pipe
2025-11-03T16:55:52.424179Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [9:7568543921291145457:3247], now have 1 active actors on pipe
2025-11-03T16:55:52.424528Z node 9 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:404: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 10, Generation 1
2025-11-03T16:55:52.427314Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-03T16:55:52.449063Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-03T16:55:52.476120Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [9:7568543921291145548:3308], now have 1 active actors on pipe
2025-11-03T16:55:52.476963Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-03T16:55:52.487578Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-03T16:55:52.488737Z node 10 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-11-03T16:55:52.488801Z node 10 :PERSQUEUE DEBUG: partition.cpp:1312: [72075186224037892][Partition][0][StateInit] HandleOnInit TEvPQ::TEvProposePartitionConfig
2025-11-03T16:55:52.489196Z node 10 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-11-03T16:55:52.489421Z node 10 :PERSQUEUE INFO: partition_init.cpp:1101: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [10:7568543918908933898:2385]
2025-11-03T16:55:52.494123Z node 10 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-11-03T16:55:52.494167Z node 10 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-11-03T16:55:52.494196Z node 10 :PERSQUEUE INFO: partition.cpp:707: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1 [10:7568543918908933898:2385]
2025-11-03T16:55:52.494233Z node 10 :PERSQUEUE DEBUG: partition.cpp:727: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 0 Head Offset 0 PartNo 0 PackedSize 0 count 0 nextOffset 0 batches 0
2025-11-03T16:55:52.494273Z node 10 :PERSQUEUE DEBUG: partition_mlp.cpp:83: [72075186224037892][Partition][0][StateIdle] Initializing MLP Consumers: 0
2025-11-03T16:55:52.495872Z node 10 :PERSQUEUE DEBUG: partition.cpp:4273: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 1
2025-11-03T16:55:52.495911Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:52.502465Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:52.502495Z node 10 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-03T16:55:52.502523Z node 10 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-11-03T16:55:52.502558Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:52.502577Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:52.502595Z node 10 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-11-03T16:55:52.502663Z node 10 :PERSQUEUE DEBUG: partition_read.cpp:923: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-11-03T16:55:52.502713Z node 10 :PERSQUEUE DEBUG: partition_mlp.cpp:60: [72075186224037892][Partition][0][StateIdle] Process MLP pending events. Count 0
2025-11-03T16:55:52.503391Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-03T16:55:52.503576Z node 10 :PERSQUEUE DEBUG: partition_compaction.cpp:183: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:55:52.514567Z node 9 :FLAT_TX_SCHEMESHARD WARN: schemeshard_impl.cpp:7727: Cannot get console configs
2025-11-03T16:55:52.514598Z node 9 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
2025-11-03T16:55:52.518053Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-03T16:55:52.518202Z node 10 :PERSQUEUE DEBUG: partition.cpp:1416: [72075186224037892][Partition][0][StateIdle] Handle TEvPQ::TEvTxCommit Step 1762188952517, TxId 281474976710670
2025-11-03T16:55:52.518224Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:52.518235Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:52.518358Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:52.518569Z node 10 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-03T16:55:52.525731Z node 10 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-03T16:55:52.525909Z node 10 :PERSQUEUE DEBUG: partition_mlp.cpp:83: [72075186224037892][Partition][0][StateIdle] Initializing MLP Consumers: 0
2025-11-03T16:55:52.526032Z node 10 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-11-03T16:55:52.526072Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:52.526087Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:52.526102Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:52.526133Z node 10 :PERSQUEUE DEBUG: partition_compaction.cpp:183: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:55:52.526467Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:398: [PQ: 72075186224037892] Apply new config PartitionConfig { LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 } PartitionIds: 0 TopicName: "rt3.dc1--test-topic" Version: 0 LocalDC: true Codecs { Ids: 0 Ids: 1 Ids: 2 Codecs: "raw" Codecs: "gzip" Codecs: "lzop" } TopicPath: "/Root/PQ/rt3.dc1--test-topic" YcCloudId: "" YcFolderId: "" YdbDatabaseId: "" YdbDatabasePath: "/Root" Partitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } AllPartitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } Consumers { Name: "user" ReadFromTimestampsMs: 0 FormatVersion: 0 Version: 0 Generation: 0 } MonitoringProjectId: ""
2025-11-03T16:55:52.526574Z node 10 :PERSQUEUE NOTICE: pq_impl.cpp:913: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-11-03T16:55:52.526846Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-03T16:55:52.539899Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-03T16:55:52.540058Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-03T16:55:52.548549Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-03T16:55:52.604915Z node 9 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976710671. Ctx: { TraceId: 01k95ab0sq6r42kqh884hzhkdj, Database: , SessionId: ydb://session/3?node_id=9&id=MjMwNmE0NmEtNzA4NWZjNWUtMjFiN2M5MTItMmNmNWExMTc=, PoolId: default, DatabaseId: /Root}. Database not set, use /Root
2025-11-03T16:55:52.602095Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:52.602140Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:52.602160Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
===Query complete
TClient::Ls request: /Root/PQ/rt3.dc1--test-topic
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976710670
    CreateStep: 1762188952517
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts...
(TRUNCATED)
GetTopicVersionFromPath:  record Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976710670
    CreateStep: 1762188952517
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      YdbDatabasePath: "/Root"
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
    Partitions {
      PartitionId: 0
      TabletId: 72075186224037892
      Status: Active
    }
    AlterVersion: 1
    BalancerTabletID: 72075186224037893
    NextPartitionId: 1
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 1
      PlanResolution: 7
      Coordinators: 72057594046316545
      TimeCastBucketsPerMediator: 2
      Mediators: 72057594046382081
    }
    DomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    PathsInside: 12
    PathsLimit: 10000
    ShardsInside: 6
    ShardsLimit: 200000
    ResourcesDomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    DiskSpaceUsage {
      Tables {
        TotalSize: 0
        DataSize: 0
        IndexSize: 0
      }
      Topics {
        ReserveSize: 0
        AccountSize: 0
        DataSize: 0
        UsedReserveSize: 0
      }
    }
    PQPartitionsInside: 1
    PQPartitionsLimit: 1000000
    SchemeLimits {
      MaxDepth: 32
      MaxPaths: 10000
      MaxChildrenInDir: 100000
      MaxAclBytesSize: 10240
      MaxTableColumns: 200
      MaxTableColumnNameLength: 255
      MaxTableKeyColumns: 30
      MaxTableIndices: 20
      MaxShards: 200000
      MaxShardsInPath: 35000
      MaxConsistentCopyTargets: 10000
      MaxPathElementLength: 255
      ExtraPathSymbolsAllowed: "!\"#$%&\'()*+,-.:;<=>?@[\\]^_`{|}~"
      MaxPQPartitions: 1000000
      MaxTableCdcStreams: 5
      MaxExports: 10
      MaxImports: 10
      MaxColumnTableColumns: 10000
    }
  }
}
Path: "/Root/PQ/rt3.dc1--test-topic"
 name rt3.dc1--test-topic version1
CallPersQueueGRPC request to localhost:31038
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-11-03T16:55:52.663546Z node 9 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
MetaResponse {
  CmdGetTopicMetadataResult {
    TopicInfo {
      Topic: "rt3.dc1--test-topic"
      NumPartitions: 1
      Config {
        PartitionConfig {
          LifetimeSeconds: 86400
          LowWatermark: 8388608
          SourceIdLifetimeSeconds: 86400
          WriteSpeedInBytesPerSecond: 20000000
          BurstSize: 20000000
          SourceIdMaxCounts: 6000000
        }
        Version: 1
        LocalDC: true
        Codecs {
          Ids: 0
          Ids: 1
          Ids: 2
          Codecs: "raw"
          Codecs: "gzip"
          Codecs: "lzop"
        }
        TopicPath: "/Root/PQ/rt3.dc1--test-topic"
        YdbDatabasePath: "/Root"
        Consumers {
          Name: "user"
          ReadFromTimestampsMs: 0
          FormatVersion: 0
          Version: 0
        }
      }
      ErrorCode: OK
    }
  }
}
=== Topic created, have version: 1
2025-11-03T16:55:52.686608Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: try to update token
2025-11-03T16:55:52.688374Z :INFO: [] MessageGroupId [src] SessionId [] Write session: Do CDS request
2025-11-03T16:55:52.688765Z :INFO: [] MessageGroupId [src] SessionId [] Start write session. Will connect to endpoint: localhost:31038
2025-11-03T16:55:52.704194Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:52.704237Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:52.704258Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:52.717179Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src" }
2025-11-03T16:55:52.720868Z node 9 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-11-03T16:55:52.720918Z node 9 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1
2025-11-03T16:55:52.721451Z node 9 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src" }
2025-11-03T16:55:52.721588Z node 9 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1 topic: "test-topic" message_group_id: "src" from ipv6:[::1]:37862
2025-11-03T16:55:52.721610Z node 9 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37862 proto=v1  topic=test-topic durationSec=0
2025-11-03T16:55:52.721624Z node 9 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-11-03T16:55:52.723587Z node 9 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1 sessionId:  describe result for acl check
2025-11-03T16:55:52.723748Z node 9 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-11-03T16:55:52.723779Z node 9 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-11-03T16:55:52.723798Z node 9 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-11-03T16:55:52.723823Z node 9 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [9:7568543921291145633:2462] (SourceId=src, PreferedPartition=(NULL)) StartKqpSession
2025-11-03T16:55:52.727682Z node 9 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [9:7568543921291145633:2462] (SourceId=src, PreferedPartition=(NULL)) Select from the table
2025-11-03T16:55:52.804840Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:52.804881Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:52.804901Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:52.907221Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:52.907262Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:52.907280Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:52.966023Z node 9 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [9:7568543921291145633:2462] (SourceId=src, PreferedPartition=(NULL)) RequestPQRB
2025-11-03T16:55:52.966372Z node 9 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1655: [72075186224037893][rt3.dc1--test-topic] pipe [9:7568543921291145675:2462] connected; active server actors: 1
2025-11-03T16:55:52.966551Z node 9 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [9:7568543921291145633:2462] (SourceId=src, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=src
2025-11-03T16:55:52.966578Z node 9 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [9:7568543921291145633:2462] (SourceId=src, PreferedPartition=(NULL)) Update the table
2025-11-03T16:55:52.968002Z node 9 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1659: [72075186224037893][rt3.dc1--test-topic] pipe [9:7568543921291145675:2462] disconnected.
2025-11-03T16:55:52.968039Z node 9 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1670: [72075186224037893][rt3.dc1--test-topic] pipe [9:7568543921291145675:2462] disconnected; active server actors: 1
2025-11-03T16:55:52.968061Z node 9 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1695: [72075186224037893][rt3.dc1--test-topic] pipe [9:7568543921291145675:2462] disconnected no session
2025-11-03T16:55:53.009422Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:53.009463Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:53.009483Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:53.110508Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:53.110550Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:53.110569Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:53.165620Z node 9 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [9:7568543921291145633:2462] (SourceId=src, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-11-03T16:55:53.165675Z node 9 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [9:7568543921291145633:2462] (SourceId=src, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-11-03T16:55:53.165700Z node 9 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [9:7568543921291145633:2462] (SourceId=src, PreferedPartition=(NULL)) Start idle
2025-11-03T16:55:53.165733Z node 9 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-11-03T16:55:53.168256Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [9:7568543925586112997:2462], now have 1 active actors on pipe
2025-11-03T16:55:53.168377Z node 9 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 10, Generation: 1
2025-11-03T16:55:53.170762Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:55:53.170816Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:55:53.170930Z node 10 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src|80ab4655-408e03e1-30c5531-2c7ae7aa_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src
2025-11-03T16:55:53.170985Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:53.171016Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:53.171038Z node 10 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-03T16:55:53.171111Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:53.171169Z node 10 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-03T16:55:53.171254Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-03T16:55:53.173822Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:55:53.173866Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:55:53.173971Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-03T16:55:53.175752Z node 9 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1 partition: 0 MaxSeqNo: 0 sessionId: src|80ab4655-408e03e1-30c5531-2c7ae7aa_0
2025-11-03T16:55:53.180255Z :INFO: [] MessageGroupId [src] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1762188953180 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-11-03T16:55:53.180399Z :INFO: [] MessageGroupId [src] SessionId [] Write session established. Init response: session_id: "src|80ab4655-408e03e1-30c5531-2c7ae7aa_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-11-03T16:55:53.180630Z :INFO: [] MessageGroupId [src] SessionId [src|80ab4655-408e03e1-30c5531-2c7ae7aa_0] Write session: close. Timeout = 0 ms
2025-11-03T16:55:53.180695Z :INFO: [] MessageGroupId [src] SessionId [src|80ab4655-408e03e1-30c5531-2c7ae7aa_0] Write session will now close
2025-11-03T16:55:53.180754Z :DEBUG: [] MessageGroupId [src] SessionId [src|80ab4655-408e03e1-30c5531-2c7ae7aa_0] Write session: aborting
2025-11-03T16:55:53.181318Z :INFO: [] MessageGroupId [src] SessionId [src|80ab4655-408e03e1-30c5531-2c7ae7aa_0] Write session: gracefully shut down, all writes complete
2025-11-03T16:55:53.181371Z :DEBUG: [] MessageGroupId [src] SessionId [src|80ab4655-408e03e1-30c5531-2c7ae7aa_0] Write session: destroy
2025-11-03T16:55:53.182051Z node 9 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId: src|80ab4655-408e03e1-30c5531-2c7ae7aa_0 grpc read done: success: 0 data: 
2025-11-03T16:55:53.182081Z node 9 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 1 sessionId: src|80ab4655-408e03e1-30c5531-2c7ae7aa_0 grpc read failed
2025-11-03T16:55:53.182146Z node 9 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:824: session v1 closed cookie: 1 sessionId: src|80ab4655-408e03e1-30c5531-2c7ae7aa_0
2025-11-03T16:55:53.182165Z node 9 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1 sessionId: src|80ab4655-408e03e1-30c5531-2c7ae7aa_0 is DEAD
2025-11-03T16:55:53.182527Z node 9 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-11-03T16:55:53.183667Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [9:7568543925586112997:2462] destroyed
2025-11-03T16:55:53.183724Z node 10 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-11-03T16:55:53.183760Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:53.183780Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:53.183797Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:53.214139Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:53.214182Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:53.214201Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:53.320173Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:53.320219Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:53.320238Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:53.424545Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:53.424592Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:53.424610Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:53.532135Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:53.532179Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:53.532201Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:53.633656Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:53.633702Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:53.633722Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:53.737018Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:53.737062Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:53.737081Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:53.840300Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:53.840342Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:53.840359Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:53.941361Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:53.941402Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:53.941426Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:54.048152Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:54.048220Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:54.048247Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:54.149021Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:54.149071Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:54.149093Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:54.252270Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:54.252313Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:54.252335Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:54.351842Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:54.351895Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:54.351915Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:54.459523Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:54.459566Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:54.459588Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:54.560171Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:54.560209Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:54.560232Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:54.660491Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:54.660528Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:54.660546Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
test_client.cpp: SetPath # /home/runner/.ya/build/build_root/7jz3/00196f/r3tmp/tmpBem7Fq/pdisk_1.dat
2025-11-03T16:55:54.711664Z node 11 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-11-03T16:55:54.713883Z node 12 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-11-03T16:55:54.723509Z node 11 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-11-03T16:55:54.723640Z node 11 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=incorrect path status: LookupError;
2025-11-03T16:55:54.723717Z node 12 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-11-03T16:55:54.723817Z node 12 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=incorrect path status: LookupError;
2025-11-03T16:55:54.761059Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:54.761090Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:54.761109Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:54.864352Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:54.864388Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:54.864406Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:54.968347Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:54.968379Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:54.968405Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:55.024742Z node 12 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-11-03T16:55:55.028151Z node 11 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-11-03T16:55:55.072092Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:55.072132Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:55.072156Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:55.145983Z node 11 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
2025-11-03T16:55:55.172677Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:55.172721Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:55.172743Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:55.270851Z node 11 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(11, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-11-03T16:55:55.271003Z node 11 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(11, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-11-03T16:55:55.272106Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:55.272141Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:55.272159Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:55.273668Z node 11 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(12, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-11-03T16:55:55.273778Z node 11 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(12, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-11-03T16:55:55.286047Z node 11 :HIVE WARN: hive_impl.cpp:811: HIVE#72057594037968897 Handle TEvInterconnect::TEvNodeConnected, NodeId 12 Cookie 12
2025-11-03T16:55:55.286251Z node 11 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(11, (0,0,0,0)) VolatileState: Connecting -> Connected
2025-11-03T16:55:55.289738Z node 11 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(12, (0,0,0,0)) VolatileState: Connecting -> Connected
TServer::EnableGrpc on GrpcPort 4763, node 11
2025-11-03T16:55:55.371816Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:55.371863Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:55.371883Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:55.441235Z node 12 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-11-03T16:55:55.451949Z node 11 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-11-03T16:55:55.459695Z node 11 :NET_CLASSIFIER WARN: net_classifier.cpp:190: distributable config is empty, broken or outdated, will use file: /home/runner/.ya/build/build_root/7jz3/00196f/r3tmp/yandexBDRn9m.tmp
2025-11-03T16:55:55.459725Z node 11 :NET_CLASSIFIER WARN: net_classifier.cpp:196: will try to initialize from file: /home/runner/.ya/build/build_root/7jz3/00196f/r3tmp/yandexBDRn9m.tmp
2025-11-03T16:55:55.459874Z node 11 :NET_CLASSIFIER WARN: net_classifier.cpp:202: successfully initialized from file: /home/runner/.ya/build/build_root/7jz3/00196f/r3tmp/yandexBDRn9m.tmp
2025-11-03T16:55:55.460064Z node 11 :NET_CLASSIFIER ERROR: net_classifier.cpp:228: got bad distributable configuration
2025-11-03T16:55:55.472824Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:55.472856Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:55.472879Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:55.573241Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:55.573276Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:55.573293Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:55.652179Z node 11 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-11-03T16:55:55.656211Z node 12 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-11-03T16:55:55.673581Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:55.673615Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:55.673633Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:55.698303Z INFO: TTestServer started on Port 9033 GrpcPort 4763
2025-11-03T16:55:55.774035Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:55.774071Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:55.774089Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:55.874482Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:55.874514Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:55.874530Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:55.974965Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:55.975014Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:55.975032Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:56.075485Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:56.075518Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:56.075539Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:56.180272Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:56.180325Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:56.180352Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:56.280863Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:56.280902Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:56.280917Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:56.384562Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:56.384602Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:56.384620Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:56.492266Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:56.492321Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:56.492343Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
TClient is connected to server localhost:9033
PQClient connected to localhost:4763
WaitRootIsUp 'Root'...
TClient::Ls request: Root
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "Root"
    PathId: 1
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 1
    CreateStep: 0
    ParentPathId: 1
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 1
      SubDomainVersion: 0
      SecurityStateVersion: 0
    }
    ChildrenExist: false
  }
  Children {
    Name: ".sys"
    PathId: 18446744073709551615
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 0
    CreateStep: 0
    ParentPathId: 18446744073709551615
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 0
      Pl...
(TRUNCATED)
WaitRootIsUp 'Root' success.
2025-11-03T16:55:56.582980Z node 11 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpAlterSubDomain, opId: 281474976715657:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_alter_subdomain.cpp:311)
2025-11-03T16:55:56.596447Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:56.596498Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:56.596517Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
waiting...
waiting...
waiting...
2025-11-03T16:55:56.698570Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:56.698618Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:56.698639Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
waiting...
2025-11-03T16:55:56.804229Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:56.804274Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:56.804295Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:56.904392Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:56.904439Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:56.904461Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:57.007573Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:57.007609Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:57.007629Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:57.109486Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:57.109535Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:57.109557Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:57.211865Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:57.211916Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:57.211945Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:57.316111Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:57.316158Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:57.316177Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:57.420741Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:57.420782Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:57.420801Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:57.508286Z node 10 :PERSQUEUE DEBUG: partition_compaction.cpp:183: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:55:57.519969Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:57.520033Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:57.520054Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:57.620844Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:57.620893Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:57.620918Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:57.724177Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:57.724223Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:57.724240Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:57.824693Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:57.824737Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:57.824756Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:57.926177Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:57.926237Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:57.926266Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:58.026851Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:58.026889Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:58.026905Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:58.128321Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:58.128372Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:58.128404Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:58.236098Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:58.236143Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:58.236159Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:58.344176Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:58.344225Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:58.344245Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:58.452201Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:58.452240Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:58.452256Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:58.556271Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:58.556323Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:58.556345Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:58.660238Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:58.660281Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:58.660303Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:58.765959Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:58.766010Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:58.766032Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:58.868091Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:58.868143Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:58.868176Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:58.968581Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:58.968623Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:58.968652Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:59.072198Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:59.072240Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:59.072259Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:59.172615Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:59.172656Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:59.172671Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:59.274850Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:59.274899Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:59.274920Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:59.376112Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:59.376160Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:59.376179Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:59.478627Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:59.478688Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:59.478706Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:59.578584Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:59.578618Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:59.578631Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:59.684494Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:59.684548Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:59.684568Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:59.785521Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:59.785568Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:59.785586Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:59.887079Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:59.887130Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:59.887148Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:55:59.990566Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:55:59.990614Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:55:59.990642Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:00.092122Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:00.092172Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:00.092192Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:00.191865Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:00.191916Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:00.191947Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:00.300142Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:00.300193Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:00.300214Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:00.404147Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:00.404199Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:00.404221Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:00.504645Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:00.504693Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:00.504716Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:00.608519Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:00.608564Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:00.608585Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:00.716134Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:00.716188Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:00.716211Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:00.820235Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:00.820291Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:00.820313Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:00.924239Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:00.924294Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:00.924317Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:01.023640Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:01.023689Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:01.023712Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:01.123419Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:01.123479Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:01.123504Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:01.228296Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:01.228342Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:01.228369Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:01.328208Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:01.328268Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:01.328289Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:01.429082Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:01.429122Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:01.429142Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:01.530354Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:01.530396Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:01.530416Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:01.629796Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:01.629838Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:01.629856Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:01.732142Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:01.732196Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:01.732218Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:01.832853Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:01.832913Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:01.832935Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:01.936226Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:01.936267Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:01.936286Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:02.037430Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:02.037482Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:02.037502Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:02.140412Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:02.140459Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:02.140479Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:02.244325Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:02.244367Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:02.244386Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:02.348178Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:02.348220Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:02.348237Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:02.452209Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:02.452256Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:02.452276Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:02.509224Z node 10 :PERSQUEUE DEBUG: partition_compaction.cpp:183: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:56:02.552196Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:02.552242Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:02.552261Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:02.656125Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:02.656173Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:02.656192Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:02.755943Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:02.756004Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:02.756022Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:02.855460Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:02.855511Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:02.855532Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:02.957348Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:02.957389Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:02.957407Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:03.060815Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:03.060855Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:03.060874Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:03.160637Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:03.160694Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:03.160716Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:03.260952Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:03.260985Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:03.261004Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:03.363823Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:03.363859Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:03.363878Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:03.469847Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:03.469891Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:03.469917Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:03.571702Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:03.571747Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:03.571766Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:03.672790Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:03.672825Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:03.672842Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:03.779379Z node 12 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [12:7568543969036956471:2307], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-03T16:56:03.779379Z node 12 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [12:7568543969036956440:2304], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-03T16:56:03.779474Z node 12 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-03T16:56:03.780088Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:03.780125Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:03.780146Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:03.792561Z node 12 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [12:7568543969036956477:2309], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-03T16:56:03.792693Z node 12 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-03T16:56:03.800027Z node 11 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateResourcePool, opId: 281474976720657:3, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_resource_pool.cpp:179)
2025-11-03T16:56:03.845298Z node 11 :KQP_PROXY ERROR: kqp_proxy_service.cpp:1316: TraceId: "01k95ab52wc1xax79r9n8fgzx9", Request deadline has expired for 2.094271s seconds
2025-11-03T16:56:03.857267Z node 12 :KQP_WORKLOAD_SERVICE WARN: helpers.h:73: [WorkloadService] [TPoolCreatorActor] ActorId: [12:7568543969036956476:2308], DatabaseId: /Root, PoolId: default, Scheduled retry for error: { <main>: Error: Transaction 281474976720657 completed, doublechecking }
2025-11-03T16:56:03.883871Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:03.883910Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:03.883926Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:03.922999Z node 11 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976715661:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:690)
2025-11-03T16:56:03.950577Z node 11 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:570: Compilation failed, self: [11:7568543965504698260:2342], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-11-03T16:56:03.954125Z node 12 :TX_PROXY ERROR: schemereq.cpp:593: Actor# [12:7568543969036956508:2151] txid# 281474976720658, issues: { message: "Check failed: path: \'/Root/.metadata/workload_manager/pools/default\', error: path exist, request accepts it (id: [OwnerId: 72057594046644480, LocalPathId: 8], type: EPathTypeResourcePool, state: EPathStateNoChanges)" severity: 1 }
2025-11-03T16:56:03.954311Z node 11 :KQP_SESSION WARN: kqp_session_actor.cpp:2506: SessionId: ydb://session/3?node_id=11&id=NzNhOGU2NjgtNmM4NWQ3N2QtMTMxZmIyMTUtMzBjMzIyNjU=, ActorId: [11:7568543965504698204:2333], ActorState: ExecuteState, TraceId: 01k95abc0626h819xqyq2ffdxt, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-11-03T16:56:03.954871Z node 11 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-11-03T16:56:03.984559Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:03.984593Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:03.984612Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:04.032450Z node 12 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:570: Compilation failed, self: [12:7568543969036956515:2314], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-11-03T16:56:04.036509Z node 12 :KQP_SESSION WARN: kqp_session_actor.cpp:2506: SessionId: ydb://session/3?node_id=12&id=NTdiZjEzNzAtNDRmNWNjYmItNzg3MDA3Yy1lOTM2ZDkzMg==, ActorId: [12:7568543969036956435:2301], ActorState: ExecuteState, TraceId: 01k95abbxy9h4rbqpmhx6vwg2e, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-11-03T16:56:04.037061Z node 12 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-11-03T16:56:04.091229Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:04.091264Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:04.091282Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:04.119718Z node 11 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976715662:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:690)
2025-11-03T16:56:04.192155Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:04.192194Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:04.192216Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:04.298353Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:04.298391Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:04.298410Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:04.400103Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:04.400145Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:04.400166Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:04.490822Z node 11 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976715663:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:690)
2025-11-03T16:56:04.505299Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:04.505344Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:04.505363Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:04.605888Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:04.605932Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:04.605951Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:04.708353Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:04.708389Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:04.708407Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
=== Init DC: UPSERT INTO `/Root/PQ/Config/V2/Cluster` (name, balancer, local, enabled, weight) VALUES ("dc1", "localhost:31038", false, true, 1000), ("dc2", "localhost:4763", true, true, 1000);
2025-11-03T16:56:04.812260Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:04.812299Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:04.812318Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:04.915059Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:04.915094Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:04.915115Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:05.015268Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:05.015307Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:05.015326Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:05.076936Z node 11 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976715664. Ctx: { TraceId: 01k95abcy69t5pqw3knhbcdxe3, Database: , SessionId: ydb://session/3?node_id=11&id=OGQzMDBiOS05ZDdiYTUxMS0yNjc3Mzg5NS0zMGIzOGQxYQ==, PoolId: default, DatabaseId: /Root}. Database not set, use /Root
2025-11-03T16:56:05.115775Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:05.115811Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:05.115830Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
=== CheckClustersList. Subcribe to ClusterTracker from [11:7568543974094633292:3009] 
2025-11-03T16:56:05.218377Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:05.218422Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:05.218440Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:05.320011Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:05.320049Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:05.320066Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:05.422109Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:05.422149Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:05.422168Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:05.523998Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:05.524042Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:05.524059Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:05.624304Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:05.624338Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:05.624356Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:05.724620Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:05.724657Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:05.724675Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:05.824980Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:05.825020Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:05.825040Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:05.925898Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:05.925945Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:05.925966Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:06.026957Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:06.027009Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:06.027029Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:06.128110Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:06.128160Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:06.128180Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:06.230416Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:06.230462Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:06.230483Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:06.330855Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:06.330892Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:06.330908Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:06.435206Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:06.435244Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:06.435264Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:06.536113Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:06.536156Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:06.536176Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:06.639128Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:06.639166Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:06.639185Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:06.740383Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:06.740422Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:06.740442Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:06.844343Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:06.844380Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:06.844398Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:06.948293Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:06.948331Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:06.948349Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:07.050636Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:07.050676Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:07.050721Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:07.152890Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:07.152931Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:07.152949Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:07.256109Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:07.256151Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:07.256171Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:07.355810Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:07.355851Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:07.355870Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:07.567267Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:07.567310Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:07.567330Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:07.567566Z node 10 :PERSQUEUE DEBUG: partition_compaction.cpp:183: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:56:07.664669Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:07.664711Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:07.664730Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:07.767169Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:07.767206Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:07.767222Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:07.872145Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:07.872191Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:07.872211Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:07.969228Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:07.969274Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:07.969294Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:08.069120Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:08.069170Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:08.069193Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:08.172182Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:08.172241Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:08.172264Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:08.276179Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:08.276232Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:08.276255Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:08.375761Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:08.375807Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:08.375827Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:08.476269Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:08.476312Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:08.476334Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:08.577984Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:08.578020Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:08.578041Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:08.680210Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:08.680251Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:08.680278Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:08.784222Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:08.784264Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:08.784282Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:08.885712Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:08.885758Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:08.885778Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:08.985840Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:08.985883Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:08.985901Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:09.086949Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:09.086990Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:09.087009Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:09.188958Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:09.189002Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:09.189021Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:09.289651Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:09.289689Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:09.289706Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:09.389724Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:09.389767Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:09.389788Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:09.489864Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:09.489908Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:09.489929Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:09.590842Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:09.590891Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:09.590913Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:09.692103Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:09.692148Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:09.692167Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:09.792075Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:09.792120Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:09.792140Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:09.893365Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:09.893405Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:09.893424Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:09.993201Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:09.993246Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:09.993278Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:10.087522Z node 11 :FLAT_TX_SCHEMESHARD WARN: schemeshard_impl.cpp:7727: Cannot get console configs
2025-11-03T16:56:10.087562Z node 11 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
2025-11-03T16:56:10.094450Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:10.094498Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:10.094519Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:10.196405Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:10.196445Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:10.196464Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:10.296836Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:10.296878Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:10.296897Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:10.399423Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:10.399467Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:10.399484Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:10.502156Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:10.502198Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:10.502218Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:10.602543Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:10.602599Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:10.602615Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:10.708096Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:10.708140Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:10.708157Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:10.805352Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:10.805399Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:10.805417Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:10.915849Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:10.915889Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:10.915906Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:11.016343Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:11.016379Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:11.016398Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:11.119057Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:11.119096Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:11.119113Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:11.220254Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:11.220304Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:11.220322Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:11.322188Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:11.322228Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:11.322244Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:11.421266Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:11.421300Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:11.421318Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:11.521474Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:11.521513Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:11.521532Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
=== CheckClustersList. Ok
2025-11-03T16:56:11.621888Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:11.621934Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:11.621960Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:11.724372Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:11.724418Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:11.724441Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:11.775952Z node 11 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976715669:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:690)
waiting...
2025-11-03T16:56:11.824488Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:11.824527Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:11.824545Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
PQ Client: create topic: rt3.dc2--test-topic with 1 partitions
CallPersQueueGRPC request to localhost:4763
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc2--test-topic"
  }
}
2025-11-03T16:56:11.914778Z node 11 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc2--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
CallPersQueueGRPC request to localhost:4763
MetaRequest {
  CmdCreateTopic {
    Topic: "rt3.dc2--test-topic"
    NumPartitions: 1
    Config {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
  }
}
2025-11-03T16:56:11.928096Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:11.928144Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:11.928164Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
CallPersQueueGRPC response:
Status: 129
ProxyErrorCode: 53
SchemeStatus: 1
FlatTxId {
  TxId: 281474976715670
  SchemeShardTabletId: 72057594046644480
  PathId: 13
}
ErrorCode: OK
AddTopic: rt3.dc2--test-topic
===Run query:``DECLARE $version as Int64; DECLARE $path AS Utf8; DECLARE $cluster as Utf8; UPSERT INTO `/Root/PQ/Config/V2/Topics` (path, dc) VALUES ($path, $cluster); UPSERT INTO `/Root/PQ/Config/V2/Versions` (name, version) VALUES ("Topics", $version);`` with topic = test-topic, dc = dc2
2025-11-03T16:56:12.014360Z node 11 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1655: [72075186224037893][] pipe [11:7568543999864437445:3249] connected; active server actors: 1
2025-11-03T16:56:12.014584Z node 11 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1519: [72075186224037893][rt3.dc2--test-topic] updating configuration. Deleted partitions []. Added partitions [0]
2025-11-03T16:56:12.016992Z node 11 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:971: [72075186224037893][rt3.dc2--test-topic] Discovered subdomain [OwnerId: 72057594046644480, LocalPathId: 1] state, outOfSpace = 0 at RB 72075186224037893
2025-11-03T16:56:12.020630Z node 12 :PERSQUEUE DEBUG: pq_impl.cpp:2960: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-11-03T16:56:12.022746Z node 11 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:140: [72075186224037893][rt3.dc2--test-topic] BALANCER INIT DONE for rt3.dc2--test-topic: (0, 72075186224037892) 
2025-11-03T16:56:12.033247Z node 12 :PERSQUEUE DEBUG: pq_impl.cpp:2992: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-11-03T16:56:12.033514Z node 12 :PERSQUEUE DEBUG: pq_impl.cpp:787: [PQ: 72075186224037892] no config, start with empty partitions and default config
2025-11-03T16:56:12.033549Z node 12 :PERSQUEUE NOTICE: pq_impl.cpp:913: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-11-03T16:56:12.033596Z node 12 :PERSQUEUE INFO: pq_impl.cpp:612: [PQ: 72075186224037892] doesn't have tx writes info
2025-11-03T16:56:12.033243Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:12.033282Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:12.033310Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:12.038215Z node 11 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:404: [72075186224037893][rt3.dc2--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 12, Generation 1
2025-11-03T16:56:12.040135Z node 12 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [11:7568543999864437444:3248], now have 1 active actors on pipe
2025-11-03T16:56:12.040184Z node 12 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [11:7568544004159404774:2436], now have 1 active actors on pipe
2025-11-03T16:56:12.040590Z node 12 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-03T16:56:12.054101Z node 12 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-03T16:56:12.076680Z node 12 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [11:7568544004159404805:3299], now have 1 active actors on pipe
2025-11-03T16:56:12.077506Z node 12 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-03T16:56:12.089529Z node 12 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-03T16:56:12.090684Z node 12 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc2--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-11-03T16:56:12.090778Z node 12 :PERSQUEUE DEBUG: partition.cpp:1312: [72075186224037892][Partition][0][StateInit] HandleOnInit TEvPQ::TEvProposePartitionConfig
2025-11-03T16:56:12.091180Z node 12 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc2--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-11-03T16:56:12.091428Z node 12 :PERSQUEUE INFO: partition_init.cpp:1101: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [12:7568544007691662632:2391]
2025-11-03T16:56:12.095176Z node 12 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc2--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-11-03T16:56:12.095214Z node 12 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc2--test-topic:0:Initializer] Initializing completed.
2025-11-03T16:56:12.095246Z node 12 :PERSQUEUE INFO: partition.cpp:707: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc2--test-topic' partition 0 generation 1 [12:7568544007691662632:2391]
2025-11-03T16:56:12.095284Z node 12 :PERSQUEUE DEBUG: partition.cpp:727: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc2--test-topic partitition 0 so 0 endOffset 0 Head Offset 0 PartNo 0 PackedSize 0 count 0 nextOffset 0 batches 0
2025-11-03T16:56:12.095328Z node 12 :PERSQUEUE DEBUG: partition_mlp.cpp:83: [72075186224037892][Partition][0][StateIdle] Initializing MLP Consumers: 0
2025-11-03T16:56:12.102716Z node 12 :PERSQUEUE DEBUG: partition.cpp:4273: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 1
2025-11-03T16:56:12.102777Z node 12 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:12.102904Z node 12 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:12.102920Z node 12 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-03T16:56:12.102945Z node 12 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-11-03T16:56:12.102966Z node 12 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:12.102987Z node 12 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:12.103004Z node 12 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-11-03T16:56:12.103048Z node 12 :PERSQUEUE DEBUG: partition_read.cpp:923: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc2--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-11-03T16:56:12.103100Z node 12 :PERSQUEUE DEBUG: partition_mlp.cpp:60: [72075186224037892][Partition][0][StateIdle] Process MLP pending events. Count 0
2025-11-03T16:56:12.103843Z node 12 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-03T16:56:12.104028Z node 12 :PERSQUEUE DEBUG: partition_compaction.cpp:183: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:56:12.125766Z node 12 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-03T16:56:12.125939Z node 12 :PERSQUEUE DEBUG: partition.cpp:1416: [72075186224037892][Partition][0][StateIdle] Handle TEvPQ::TEvTxCommit Step 1762188972117, TxId 281474976715670
2025-11-03T16:56:12.125971Z node 12 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:12.125986Z node 12 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:12.126166Z node 12 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:12.126456Z node 12 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-03T16:56:12.137088Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:12.137130Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:12.137158Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:12.138270Z node 12 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-03T16:56:12.138521Z node 12 :PERSQUEUE DEBUG: partition_mlp.cpp:83: [72075186224037892][Partition][0][StateIdle] Initializing MLP Consumers: 0
2025-11-03T16:56:12.138686Z node 12 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-11-03T16:56:12.138742Z node 12 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:12.138764Z node 12 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:12.138785Z node 12 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:12.138825Z node 12 :PERSQUEUE DEBUG: partition_compaction.cpp:183: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:56:12.139273Z node 12 :PERSQUEUE DEBUG: pq_impl.cpp:398: [PQ: 72075186224037892] Apply new config PartitionConfig { LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 } PartitionIds: 0 TopicName: "rt3.dc2--test-topic" Version: 0 LocalDC: true Codecs { Ids: 0 Ids: 1 Ids: 2 Codecs: "raw" Codecs: "gzip" Codecs: "lzop" } TopicPath: "/Root/PQ/rt3.dc2--test-topic" YcCloudId: "" YcFolderId: "" YdbDatabaseId: "" YdbDatabasePath: "/Root" Partitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } AllPartitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } Consumers { Name: "user" ReadFromTimestampsMs: 0 FormatVersion: 0 Version: 0 Generation: 0 } MonitoringProjectId: ""
2025-11-03T16:56:12.139415Z node 12 :PERSQUEUE NOTICE: pq_impl.cpp:913: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-11-03T16:56:12.139849Z node 12 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-03T16:56:12.173388Z node 12 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-03T16:56:12.173528Z node 12 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-03T16:56:12.182037Z node 12 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-03T16:56:12.203315Z node 12 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:12.203351Z node 12 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:12.203370Z node 12 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:12.209070Z node 11 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976715671. Ctx: { TraceId: 01k95abkz536q37va0319pky0h, Database: , SessionId: ydb://session/3?node_id=11&id=N2UyMDNhYzgtNjExMmZhNDktYTcyNzYxMzgtNjMzNWNjYTg=, PoolId: default, DatabaseId: /Root}. Database not set, use /Root
2025-11-03T16:56:12.244185Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:12.244221Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:12.244238Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
===Query complete
TClient::Ls request: /Root/PQ/rt3.dc2--test-topic
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc2--test-topic"
    PathId: 13
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976715670
    CreateStep: 1762188972117
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc2--test-topic"
    PathId: 13
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts...
(TRUNCATED)
GetTopicVersionFromPath:  record Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc2--test-topic"
    PathId: 13
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976715670
    CreateStep: 1762188972117
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc2--test-topic"
    PathId: 13
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      YdbDatabasePath: "/Root"
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
    Partitions {
      PartitionId: 0
      TabletId: 72075186224037892
      Status: Active
    }
    AlterVersion: 1
    BalancerTabletID: 72075186224037893
    NextPartitionId: 1
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 1
      PlanResolution: 7
      Coordinators: 72057594046316545
      TimeCastBucketsPerMediator: 2
      Mediators: 72057594046382081
    }
    DomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    PathsInside: 12
    PathsLimit: 10000
    ShardsInside: 6
    ShardsLimit: 200000
    ResourcesDomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    DiskSpaceUsage {
      Tables {
        TotalSize: 0
        DataSize: 0
        IndexSize: 0
      }
      Topics {
        ReserveSize: 0
        AccountSize: 0
        DataSize: 0
        UsedReserveSize: 0
      }
    }
    PQPartitionsInside: 1
    PQPartitionsLimit: 1000000
    SchemeLimits {
      MaxDepth: 32
      MaxPaths: 10000
      MaxChildrenInDir: 100000
      MaxAclBytesSize: 10240
      MaxTableColumns: 200
      MaxTableColumnNameLength: 255
      MaxTableKeyColumns: 30
      MaxTableIndices: 20
      MaxShards: 200000
      MaxShardsInPath: 35000
      MaxConsistentCopyTargets: 10000
      MaxPathElementLength: 255
      ExtraPathSymbolsAllowed: "!\"#$%&\'()*+,-.:;<=>?@[\\]^_`{|}~"
      MaxPQPartitions: 1000000
      MaxTableCdcStreams: 5
      MaxExports: 10
      MaxImports: 10
      MaxColumnTableColumns: 10000
    }
  }
}
Path: "/Root/PQ/rt3.dc2--test-topic"
 name rt3.dc2--test-topic version1
CallPersQueueGRPC request to localhost:4763
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc2--test-topic"
  }
}
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
MetaResponse {
  CmdGetTopicMetadataResult {
    TopicInfo {
      Topic: "rt3.dc2--test-topic"
      NumPartitions: 1
      Config {
        PartitionConfig {
          LifetimeSeconds: 86400
          LowWatermark: 8388608
          SourceIdLifetimeSeconds: 86400
          WriteSpeedInBytesPerSecond: 20000000
          BurstSize: 20000000
          SourceIdMaxCounts: 6000000
        }
        Version: 1
        LocalDC: true
        Codecs {
          Ids: 0
          Ids: 1
          Ids: 2
          Codecs: "raw"
          Codecs: "gzip"
          Codecs: "lzop"
        }
        TopicPath: "/Root/PQ/rt3.dc2--test-topic"
        YdbDatabasePath: "/Root"
        Consumers {
          Name: "user"
          ReadFromTimestampsMs: 0
          FormatVersion: 0
          Version: 0
        }
      }
      ErrorCode: OK
    }
  }
}
=== Topic created, have version: 1
=== Start session 1
====TYdbPqTestRetryPolicy()
2025-11-03T16:56:12.301230Z :TWriteSession_SwitchBackToLocalCluster INFO: Enqueue message with sequence number 1
2025-11-03T16:56:12.289579Z node 11 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
2025-11-03T16:56:12.308117Z node 12 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:12.308163Z node 12 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:12.308185Z node 12 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:12.348348Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:12.348388Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:12.348406Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:12.353375Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [] Write session: try to update token
2025-11-03T16:56:12.353863Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [] Write session: Do CDS request
2025-11-03T16:56:12.353927Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [] Do schedule cds request after 0 ms
2025-11-03T16:56:12.354011Z :TWriteSession_SwitchBackToLocalCluster INFO: Wait for writer event
2025-11-03T16:56:12.354036Z :INFO: [/Root] MessageGroupId [test-message-group-id] Running cds request ms
2025-11-03T16:56:12.376261Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [] Got CDS response: 
write_sessions_clusters { clusters { endpoint: "localhost:31038" name: "dc1" available: true } clusters { endpoint: "localhost:4763" name: "dc2" available: true } primary_cluster_selection_reason: CLIENT_LOCATION } version: 1
2025-11-03T16:56:12.376325Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [] Start write session. Will connect to endpoint: localhost:31038
2025-11-03T16:56:12.398167Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [] Write session: send init request: init_request { topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" }
2025-11-03T16:56:12.399192Z node 9 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-11-03T16:56:12.399226Z node 9 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2
2025-11-03T16:56:12.399680Z node 9 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" }
2025-11-03T16:56:12.399836Z node 9 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2 topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" from ipv6:[::1]:55150
2025-11-03T16:56:12.399856Z node 9 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:55150 proto=v1  topic=test-topic durationSec=0
2025-11-03T16:56:12.399872Z node 9 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-11-03T16:56:12.401996Z node 9 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2 sessionId:  describe result for acl check
2025-11-03T16:56:12.402157Z node 9 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-11-03T16:56:12.402169Z node 9 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-11-03T16:56:12.402182Z node 9 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-11-03T16:56:12.402203Z node 9 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [9:7568544007190492313:2613] (SourceId=test-message-group-id, PreferedPartition=(NULL)) StartKqpSession
2025-11-03T16:56:12.406388Z node 9 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [9:7568544007190492313:2613] (SourceId=test-message-group-id, PreferedPartition=(NULL)) Select from the table
2025-11-03T16:56:12.408176Z node 12 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:12.408221Z node 12 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:12.408242Z node 12 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:12.429162Z node 9 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [9:7568544007190492313:2613] (SourceId=test-message-group-id, PreferedPartition=(NULL)) RequestPQRB
2025-11-03T16:56:12.430078Z node 9 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1655: [72075186224037893][rt3.dc1--test-topic] pipe [9:7568544007190492336:2613] connected; active server actors: 1
2025-11-03T16:56:12.430284Z node 9 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [9:7568544007190492313:2613] (SourceId=test-message-group-id, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=test-message-group-id
2025-11-03T16:56:12.430310Z node 9 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [9:7568544007190492313:2613] (SourceId=test-message-group-id, PreferedPartition=(NULL)) Update the table
2025-11-03T16:56:12.432767Z node 9 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1659: [72075186224037893][rt3.dc1--test-topic] pipe [9:7568544007190492336:2613] disconnected.
2025-11-03T16:56:12.432811Z node 9 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1670: [72075186224037893][rt3.dc1--test-topic] pipe [9:7568544007190492336:2613] disconnected; active server actors: 1
2025-11-03T16:56:12.432835Z node 9 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1695: [72075186224037893][rt3.dc1--test-topic] pipe [9:7568544007190492336:2613] disconnected no session
2025-11-03T16:56:12.452661Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:12.452697Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:12.452716Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:12.454697Z node 9 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [9:7568544007190492313:2613] (SourceId=test-message-group-id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-11-03T16:56:12.454776Z node 9 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [9:7568544007190492313:2613] (SourceId=test-message-group-id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-11-03T16:56:12.454799Z node 9 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [9:7568544007190492313:2613] (SourceId=test-message-group-id, PreferedPartition=(NULL)) Start idle
2025-11-03T16:56:12.454835Z node 9 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-11-03T16:56:12.464514Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [9:7568544007190492352:2613], now have 1 active actors on pipe
2025-11-03T16:56:12.468324Z node 9 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 10, Generation: 1
2025-11-03T16:56:12.472511Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:56:12.472559Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:56:12.472663Z node 10 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie test-message-group-id|47eeb6f3-26b2788f-e368fca5-d3ffbe5f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner test-message-group-id
2025-11-03T16:56:12.472708Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:12.472731Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:12.472749Z node 10 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-03T16:56:12.472802Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:12.472848Z node 10 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-03T16:56:12.472907Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-03T16:56:12.473841Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:56:12.473869Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:56:12.473943Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-03T16:56:12.474289Z node 9 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2 partition: 0 MaxSeqNo: 0 sessionId: test-message-group-id|47eeb6f3-26b2788f-e368fca5-d3ffbe5f_0
2025-11-03T16:56:12.476727Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1762188972476 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-11-03T16:56:12.476856Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [] Write session established. Init response: session_id: "test-message-group-id|47eeb6f3-26b2788f-e368fca5-d3ffbe5f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-11-03T16:56:12.477050Z :TWriteSession_SwitchBackToLocalCluster INFO: Got new continue token
2025-11-03T16:56:12.477107Z :TWriteSession_SwitchBackToLocalCluster INFO: [] Write messages with sequence numbers 1
2025-11-03T16:56:12.477155Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|47eeb6f3-26b2788f-e368fca5-d3ffbe5f_0] Write 1 messages with Id from 1 to 1
2025-11-03T16:56:12.477230Z :TWriteSession_SwitchBackToLocalCluster INFO: Wait for writer event
2025-11-03T16:56:12.477277Z :TWriteSession_SwitchBackToLocalCluster INFO: Got new continue token
2025-11-03T16:56:12.500535Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|47eeb6f3-26b2788f-e368fca5-d3ffbe5f_0] Write session: try to update token
2025-11-03T16:56:12.500599Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|47eeb6f3-26b2788f-e368fca5-d3ffbe5f_0] Send 1 message(s) (0 left), first sequence number is 1
2025-11-03T16:56:12.501369Z node 9 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: test-message-group-id|47eeb6f3-26b2788f-e368fca5-d3ffbe5f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:56:12.512123Z node 12 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:12.512169Z node 12 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:12.512187Z node 12 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:12.526689Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:56:12.526742Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:56:12.526863Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-11-03T16:56:12.526104Z node 9 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:56:12.532606Z node 9 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:56:12.540411Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:56:12.540457Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:56:12.540858Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0test-message-group-id' SeqNo: 1 partNo : 0 messageNo: 1 size 98 offset: -1
2025-11-03T16:56:12.540918Z node 10 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:56:12.540976Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:12.541009Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:12.541027Z node 10 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-03T16:56:12.541155Z node 10 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0test-message-group-id' seqNo 1 partNo 0
2025-11-03T16:56:12.542178Z node 10 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0test-message-group-id' seqNo 1 partNo 0 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 187 count 1 nextOffset 1 batches 1
2025-11-03T16:56:12.542220Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:12.542902Z node 10 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 0,1 HeadOffset 0 endOffset 0 curOffset 1 d0000000000_00000000000000000000_00000_0000000001_00000? size 175 WTime 1762188972542
2025-11-03T16:56:12.543081Z node 10 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-03T16:56:12.543229Z node 10 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 0 partNo 0 count 1 size 175
2025-11-03T16:56:12.553956Z node 10 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:56:12.554175Z node 10 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 0 count 1 size 175 actorID [10:7568543918908933880:2385]
2025-11-03T16:56:12.554240Z node 10 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-03T16:56:12.554305Z node 10 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 120 WriteNewSizeFromSupportivePartitions# 0
2025-11-03T16:56:12.554343Z node 10 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:56:12.554398Z node 10 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0test-message-group-id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 1, partNo: 0, Offset: 0 is stored on disk
2025-11-03T16:56:12.554634Z node 10 :PERSQUEUE DEBUG: partition_read.cpp:923: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-11-03T16:56:12.554663Z node 10 :PERSQUEUE DEBUG: partition_read.cpp:965: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-11-03T16:56:12.554690Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:12.554722Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:12.554740Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:12.554777Z node 10 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:56:12.554826Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:1186: [PQ: 72075186224037892] Topic 'rt3.dc1--test-topic' counters. CacheSize 175 CachedBlobs 1
2025-11-03T16:56:12.554854Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1  requestId: <none> cookie: 1
2025-11-03T16:56:12.554982Z node 10 :PERSQUEUE DEBUG: partition_read.cpp:880: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 partno 0 count 1 size 1024000 endOffset 1 max time lag 0ms effective offset 0
2025-11-03T16:56:12.555228Z node 10 :PERSQUEUE DEBUG: partition_read.cpp:1105: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 175 count 1 last offset 0, current partition end offset: 1
2025-11-03T16:56:12.555251Z node 10 :PERSQUEUE DEBUG: partition_read.cpp:1121: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-11-03T16:56:12.555307Z node 10 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 0 partno 0 count 1 parts_count 0 source 1 size 175 accessed 0 times before, last time 2025-11-03T16:56:12.000000Z
2025-11-03T16:56:12.555334Z node 10 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 3. All 1 blobs are from cache.
2025-11-03T16:56:12.555384Z node 10 :PERSQUEUE DEBUG: partition_read.cpp:572: FormAnswer for 1 blobs
2025-11-03T16:56:12.555526Z node 10 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 0 totakecount 1 count 1 size 155 from pos 0 cbcount 1
2025-11-03T16:56:12.555604Z node 10 :PERSQUEUE DEBUG: partition_read.cpp:1015: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1762188972538 queuesize 0 startOffset 0
2025-11-03T16:56:12.555769Z node 10 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 0 suffix '63' size 175
2025-11-03T16:56:12.555827Z node 10 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 0 suffix '63'
2025-11-03T16:56:12.556658Z node 9 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:56:12.558625Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|47eeb6f3-26b2788f-e368fca5-d3ffbe5f_0] Write session got write response: sequence_numbers: 1 offsets: 0 already_written: false write_statistics { persist_duration_ms: 11 queued_in_partition_duration_ms: 2 }
2025-11-03T16:56:12.558674Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|47eeb6f3-26b2788f-e368fca5-d3ffbe5f_0] Write session: acknoledged message 1
===Wait for 1st reconnect
=== Expect breakdown
====ExpectBreakDown
===Disabled DC1
===Update clusters: UPDATE `/Root/PQ/Config/V2/Cluster` SET enabled = false where name = "dc1";
2025-11-03T16:56:12.568801Z node 10 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:56:12.613072Z node 12 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:12.613108Z node 12 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:12.613127Z node 12 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:12.655990Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:12.656032Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:12.656050Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:12.716173Z node 12 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:12.716212Z node 12 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:12.716230Z node 12 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:12.756730Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:12.756769Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:12.756787Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:12.820349Z node 12 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:12.820388Z node 12 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:12.820404Z node 12 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:12.859545Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:12.859586Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:12.859612Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:12.905244Z node 9 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976710686. Ctx: { TraceId: 01k95abmje4xnv48r75d7cgqnv, Database: , SessionId: ydb://session/3?node_id=9&id=ZjczMTMyY2UtZTAyODQ4MGItYjBjMWMzMTctMTQwMDI3NQ==, PoolId: default, DatabaseId: /Root}. Database not set, use /Root
2025-11-03T16:56:12.920394Z node 12 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:12.920430Z node 12 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:12.920448Z node 12 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:12.955490Z node 9 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2 reason: cluster disabled sessionId: test-message-group-id|47eeb6f3-26b2788f-e368fca5-d3ffbe5f_0
2025-11-03T16:56:12.955924Z node 9 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2 sessionId: test-message-group-id|47eeb6f3-26b2788f-e368fca5-d3ffbe5f_0 is DEAD
2025-11-03T16:56:12.956382Z node 9 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-11-03T16:56:12.958450Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [9:7568544007190492352:2613] destroyed
2025-11-03T16:56:12.958505Z node 10 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-11-03T16:56:12.958540Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:12.958561Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:12.958579Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
====CreateRetryState
====CreateRetryState Initialized
Test retry state: get retry delay
2025-11-03T16:56:12.962038Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|47eeb6f3-26b2788f-e368fca5-d3ffbe5f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: cluster disabled, code: 500020 
2025-11-03T16:56:12.962093Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|47eeb6f3-26b2788f-e368fca5-d3ffbe5f_0] Write session will restart in 2.000000s
2025-11-03T16:56:12.962187Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|47eeb6f3-26b2788f-e368fca5-d3ffbe5f_0] Write session: Do CDS request
2025-11-03T16:56:12.962237Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|47eeb6f3-26b2788f-e368fca5-d3ffbe5f_0] Do schedule cds request after 2000 ms
2025-11-03T16:56:12.961663Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:12.961708Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:12.961730Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
===Update clusters: UPDATE `/Root/PQ/Config/V2/Cluster` SET enabled = false where name = "dc1";
2025-11-03T16:56:13.024275Z node 12 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:13.024319Z node 12 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:13.024336Z node 12 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:13.071637Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:13.071678Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:13.071697Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:13.121977Z node 12 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:13.122011Z node 12 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:13.122029Z node 12 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:13.175877Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:13.175924Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:13.175954Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:13.280139Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:13.280193Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:13.280215Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:13.347220Z node 11 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976715673. Ctx: { TraceId: 01k95abmyybg5m96tqtm78sbk5, Database: , SessionId: ydb://session/3?node_id=11&id=ZjI4ZmI1ZmQtMmIxMDRjNDgtNGZmZDQ5NGEtZDQyYzYwOGI=, PoolId: default, DatabaseId: /Root}. Database not set, use /Root
2025-11-03T16:56:13.381898Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:13.381946Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:13.381967Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:13.484231Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:13.484276Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:13.484301Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:13.592173Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:13.592220Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:13.592243Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:13.696133Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:13.696181Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:13.696206Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:13.796334Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:13.796386Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:13.796409Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:13.896735Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:13.896771Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:13.896790Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:14.000221Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:14.000265Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:14.000283Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:14.104373Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:14.104414Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:14.104433Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:14.204335Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:14.204370Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:14.204390Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:14.306042Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:14.306095Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:14.306120Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:14.408190Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:14.408229Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:14.408249Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:14.512168Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:14.512204Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:14.512223Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:14.616172Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:14.616208Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:14.616227Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:14.720175Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:14.720225Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:14.720244Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:14.820281Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:14.820319Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:14.820338Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:14.924168Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:14.924211Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:14.924232Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:14.964054Z :INFO: [/Root] MessageGroupId [test-message-group-id] Running cds request ms
2025-11-03T16:56:14.973579Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|47eeb6f3-26b2788f-e368fca5-d3ffbe5f_0] Got CDS response: 
write_sessions_clusters { clusters { endpoint: "localhost:31038" name: "dc1" } clusters { endpoint: "localhost:4763" name: "dc2" available: true } primary_cluster_selection_reason: CLIENT_LOCATION } version: 1
2025-11-03T16:56:14.973656Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|47eeb6f3-26b2788f-e368fca5-d3ffbe5f_0] Start write session. Will connect to endpoint: localhost:4763
2025-11-03T16:56:14.996978Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|47eeb6f3-26b2788f-e368fca5-d3ffbe5f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" }
2025-11-03T16:56:15.004776Z node 11 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-11-03T16:56:15.004827Z node 11 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1
2025-11-03T16:56:15.005308Z node 11 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" }
2025-11-03T16:56:15.005477Z node 11 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1 topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" from ipv6:[::1]:53950
2025-11-03T16:56:15.005497Z node 11 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53950 proto=v1  topic=test-topic durationSec=0
2025-11-03T16:56:15.005509Z node 11 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-11-03T16:56:15.007634Z node 11 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1 sessionId:  describe result for acl check
2025-11-03T16:56:15.007814Z node 11 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-11-03T16:56:15.007830Z node 11 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-11-03T16:56:15.007844Z node 11 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-11-03T16:56:15.007870Z node 11 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [11:7568544017044306869:2473] (SourceId=test-message-group-id, PreferedPartition=(NULL)) StartKqpSession
2025-11-03T16:56:15.011842Z node 11 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [11:7568544017044306869:2473] (SourceId=test-message-group-id, PreferedPartition=(NULL)) Select from the table
2025-11-03T16:56:15.024762Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:15.024806Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:15.024832Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:15.128337Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:15.128386Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:15.128406Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:15.229313Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:15.229356Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:15.229375Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:15.332039Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:15.332093Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:15.332120Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:15.432797Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:15.432836Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:15.432856Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:15.449855Z node 11 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [11:7568544017044306869:2473] (SourceId=test-message-group-id, PreferedPartition=(NULL)) RequestPQRB
2025-11-03T16:56:15.456330Z node 11 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1655: [72075186224037893][rt3.dc2--test-topic] pipe [11:7568544017044306905:2473] connected; active server actors: 1
2025-11-03T16:56:15.456498Z node 11 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [11:7568544017044306869:2473] (SourceId=test-message-group-id, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=test-message-group-id
2025-11-03T16:56:15.456526Z node 11 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [11:7568544017044306869:2473] (SourceId=test-message-group-id, PreferedPartition=(NULL)) Update the table
2025-11-03T16:56:15.460181Z node 11 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1659: [72075186224037893][rt3.dc2--test-topic] pipe [11:7568544017044306905:2473] disconnected.
2025-11-03T16:56:15.460223Z node 11 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1670: [72075186224037893][rt3.dc2--test-topic] pipe [11:7568544017044306905:2473] disconnected; active server actors: 1
2025-11-03T16:56:15.460249Z node 11 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1695: [72075186224037893][rt3.dc2--test-topic] pipe [11:7568544017044306905:2473] disconnected no session
2025-11-03T16:56:15.536087Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:15.536125Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:15.536143Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:15.640455Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:15.640502Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:15.640519Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:15.649989Z node 11 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [11:7568544017044306869:2473] (SourceId=test-message-group-id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-11-03T16:56:15.650037Z node 11 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [11:7568544017044306869:2473] (SourceId=test-message-group-id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-11-03T16:56:15.650064Z node 11 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [11:7568544017044306869:2473] (SourceId=test-message-group-id, PreferedPartition=(NULL)) Start idle
2025-11-03T16:56:15.650097Z node 11 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-11-03T16:56:15.658920Z node 11 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 12, Generation: 1
2025-11-03T16:56:15.744204Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:15.744245Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:15.744277Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:15.847647Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:15.847685Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:15.847703Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:15.948228Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:15.948276Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:15.948302Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:16.052392Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:16.052433Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:16.052457Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:16.149396Z node 12 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:16.149439Z node 12 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:16.149461Z node 12 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:16.149580Z node 12 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [11:7568544017044306937:2473], now have 1 active actors on pipe
2025-11-03T16:56:16.149664Z node 12 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc2--test-topic' requestId: <none>
2025-11-03T16:56:16.149699Z node 12 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc2--test-topic' partition 0
2025-11-03T16:56:16.149812Z node 12 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie test-message-group-id|db0421fb-5a986157-5743eb7b-5772240b_0 generated for partition 0 topic 'rt3.dc2--test-topic' owner test-message-group-id
2025-11-03T16:56:16.149858Z node 12 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:16.149890Z node 12 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:16.149912Z node 12 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-03T16:56:16.149968Z node 12 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:16.150014Z node 12 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-03T16:56:16.156134Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:16.156174Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:16.156197Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:16.157525Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|47eeb6f3-26b2788f-e368fca5-d3ffbe5f_0] Write session established. Init response: session_id: "test-message-group-id|db0421fb-5a986157-5743eb7b-5772240b_0" topic: "test-topic" cluster: "dc2" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-11-03T16:56:16.150075Z node 12 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc2--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-03T16:56:16.152162Z node 12 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc2--test-topic' requestId: <none>
2025-11-03T16:56:16.152198Z node 12 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc2--test-topic' partition 0
2025-11-03T16:56:16.156497Z node 11 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1 partition: 0 MaxSeqNo: 0 sessionId: test-message-group-id|db0421fb-5a986157-5743eb7b-5772240b_0
2025-11-03T16:56:16.152328Z node 12 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc2--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-03T16:56:16.172533Z node 11 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1 reason: Session preferred cluster "dc1" is enabled for at least 1.000000s and session is older than 1.000000s sessionId: test-message-group-id|db0421fb-5a986157-5743eb7b-5772240b_0
2025-11-03T16:56:16.172921Z node 11 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1 sessionId: test-message-group-id|db0421fb-5a986157-5743eb7b-5772240b_0 is DEAD
2025-11-03T16:56:16.173306Z node 11 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
====CreateRetryState
====CreateRetryState Initialized
2025-11-03T16:56:16.174102Z node 12 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [11:7568544017044306937:2473] destroyed
2025-11-03T16:56:16.174160Z node 12 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-11-03T16:56:16.174192Z node 12 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:16.174214Z node 12 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:16.174239Z node 12 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:16.248244Z node 12 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:16.248288Z node 12 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:16.248309Z node 12 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:16.260217Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:16.260254Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:16.260275Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:16.352085Z node 12 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:16.352125Z node 12 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:16.352144Z node 12 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:16.364364Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:16.364410Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:16.364429Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:16.452151Z node 12 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:16.452199Z node 12 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:16.452220Z node 12 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:16.468336Z node 10 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:16.468372Z node 10 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:16.468394Z node 10 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
VERIFY failed (2025-11-03T16:56:16.174921Z): assertion failed in non-unittest thread with message:
assertion failed at ydb/public/sdk/cpp/src/client/persqueue_public/ut/ut_utils/ut_utils.h:279, virtual IRetryState::TPtr NYdb::NPersQueue::NTests::TYdbPqTestRetryPolicy::CreateRetryState() const: (res) 
  library/cpp/testing/unittest/registar.cpp:36
  RaiseError(): requirement UnittestThread failed
NPrivate::InternalPanicImpl(int, char const*, char const*, int, int, int, TBasicStringBuf<char, std::__y1::char_traits<char>>, char const*, unsigned long)+888 (0x1ACF8E48)
NPrivate::Panic(NPrivate::TStaticBuf const&, int, char const*, char const*, char const*, ...)+571 (0x1ACE6B7B)
NUnitTest::NPrivate::RaiseError(char const*, TBasicString<char, std::__y1::char_traits<char>> const&, bool)+1270 (0x1B188316)
NYdb::NPersQueue::NTests::TYdbPqTestRetryPolicy::CreateRetryState() const+1302 (0x1A8B1A56)
NYdb::Dev::NPersQueue::TWriteSessionImpl::RestartImpl(NYdb::Dev::TPlainStatus const&)+1047 (0x1D4E79A7)
NYdb::Dev::NPersQueue::TWriteSessionImpl::OnReadDone(NYdbGrpc::Dev::TGrpcStatus&&, unsigned long)+2544 (0x1D4FD080)
??+0 (0x1D5345D9)
NYdbGrpc::Dev::TStreamRequestReadWriteProcessor<Ydb::PersQueue::V1::PersQueueService::Stub, Ydb::PersQueue::V1::StreamingWriteClientMessage, Ydb::PersQueue::V1::StreamingWriteServerMessage>::OnReadDone(bool)+1803 (0x1D4822DB)
NYdbGrpc::Dev::TQueueClientFixedEvent<NYdbGrpc::Dev::TStreamRequestReadWriteProcessor<Ydb::PersQueue::V1::PersQueueService::Stub, Ydb::PersQueue::V1::StreamingWriteClientMessage, Ydb::PersQueue::V1::StreamingWriteServerMessage>>::Execute(bool)+112 (0x1D48A900)
??+0 (0x1CDE995B)
??+0 (0x1AD0995F)
??+0 (0x1AD09EBD)
??+0 (0x1ACFDEA5)
??+0 (0x1A9A0D47)
??+0 (0x7F7942A5DAC3)
??+0 (0x7F7942AEF8C0)
2025-11-03T16:56:22.214467Z :TWriteSession_SeqNoShift INFO: Random seed for debugging is 1762188982214426
2025-11-03T16:56:22.254094Z :SeqNoShift_Dc2 INFO: Random seed for debugging is 1762188982254048
2025-11-03T16:56:22.969398Z node 1 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[1:7568544049122800545:2077];send_to=[0:7307199536658146131:7762515];
2025-11-03T16:56:22.969450Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
2025-11-03T16:56:23.057512Z node 1 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:123: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, got undelivered to scheme cache: ActorUnknown
2025-11-03T16:56:23.071186Z node 1 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-11-03T16:56:23.092376Z node 2 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[2:7568544052562631775:2175];send_to=[0:7307199536658146131:7762515];
2025-11-03T16:56:23.092784Z node 2 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
2025-11-03T16:56:23.118053Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
test_client.cpp: SetPath # /home/runner/.ya/build/build_root/7jz3/00196f/r3tmp/tmpp1lHqf/pdisk_1.dat
2025-11-03T16:56:23.463249Z node 1 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-11-03T16:56:23.464217Z node 2 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-11-03T16:56:23.551921Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(1, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-11-03T16:56:23.566303Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(1, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-11-03T16:56:23.567197Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(2, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-11-03T16:56:23.567273Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(2, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-11-03T16:56:23.591077Z node 1 :HIVE WARN: hive_impl.cpp:811: HIVE#72057594037968897 Handle TEvInterconnect::TEvNodeConnected, NodeId 2 Cookie 2
2025-11-03T16:56:23.591230Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(1, (0,0,0,0)) VolatileState: Connecting -> Connected
2025-11-03T16:56:23.592612Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(2, (0,0,0,0)) VolatileState: Connecting -> Connected
2025-11-03T16:56:23.744432Z node 1 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
2025-11-03T16:56:23.849191Z node 2 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-11-03T16:56:23.855336Z node 1 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
TServer::EnableGrpc on GrpcPort 14811, node 1
2025-11-03T16:56:24.076818Z node 1 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-11-03T16:56:24.114561Z node 2 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-11-03T16:56:24.177244Z node 1 :NET_CLASSIFIER WARN: net_classifier.cpp:190: distributable config is empty, broken or outdated, will use file: /home/runner/.ya/build/build_root/7jz3/00196f/r3tmp/yandex4Y0CQL.tmp
2025-11-03T16:56:24.177272Z node 1 :NET_CLASSIFIER WARN: net_classifier.cpp:196: will try to initialize from file: /home/runner/.ya/build/build_root/7jz3/00196f/r3tmp/yandex4Y0CQL.tmp
2025-11-03T16:56:24.177441Z node 1 :NET_CLASSIFIER WARN: net_classifier.cpp:202: successfully initialized from file: /home/runner/.ya/build/build_root/7jz3/00196f/r3tmp/yandex4Y0CQL.tmp
2025-11-03T16:56:24.177565Z node 1 :NET_CLASSIFIER ERROR: net_classifier.cpp:228: got bad distributable configuration
2025-11-03T16:56:24.272621Z INFO: TTestServer started on Port 6036 GrpcPort 14811
TClient is connected to server localhost:6036
PQClient connected to localhost:14811
WaitRootIsUp 'Root'...
TClient::Ls request: Root
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "Root"
    PathId: 1
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 1
    CreateStep: 0
    ParentPathId: 1
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 1
      SubDomainVersion: 0
      SecurityStateVersion: 0
    }
    ChildrenExist: false
  }
  Children {
    Name: ".sys"
    PathId: 18446744073709551615
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 0
    CreateStep: 0
    ParentPathId: 18446744073709551615
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 0
      Pl...
(TRUNCATED)
WaitRootIsUp 'Root' success.
2025-11-03T16:56:24.689782Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpAlterSubDomain, opId: 281474976715657:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_alter_subdomain.cpp:311)
waiting...
waiting...
waiting...
waiting...
2025-11-03T16:56:27.972163Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[1:7568544049122800545:2077];send_to=[0:7307199536658146131:7762515];
2025-11-03T16:56:27.972265Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
2025-11-03T16:56:28.090389Z node 2 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[2:7568544052562631775:2175];send_to=[0:7307199536658146131:7762515];
2025-11-03T16:56:28.090513Z node 2 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
2025-11-03T16:56:28.347778Z node 1 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [1:7568544074892605296:2329], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-03T16:56:28.347963Z node 1 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-03T16:56:28.354306Z node 1 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [1:7568544074892605315:2332], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-03T16:56:28.354413Z node 1 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [1:7568544074892605316:2333], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-03T16:56:28.354718Z node 1 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-03T16:56:28.359704Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateResourcePool, opId: 281474976715661:3, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_resource_pool.cpp:179)
2025-11-03T16:56:28.403309Z node 1 :KQP_WORKLOAD_SERVICE WARN: helpers.h:73: [WorkloadService] [TPoolCreatorActor] ActorId: [1:7568544074892605321:2335], DatabaseId: /Root, PoolId: default, Scheduled retry for error: { <main>: Error: Transaction 281474976715661 completed, doublechecking }
2025-11-03T16:56:28.490560Z node 1 :TX_PROXY ERROR: schemereq.cpp:593: Actor# [1:7568544074892605406:2682] txid# 281474976715662, issues: { message: "Check failed: path: \'/Root/.metadata/workload_manager/pools/default\', error: path exist, request accepts it (id: [OwnerId: 72057594046644480, LocalPathId: 8], type: EPathTypeResourcePool, state: EPathStateNoChanges)" severity: 1 }
2025-11-03T16:56:28.796377Z node 1 :BS_CONTROLLER ERROR: {BSC07@impl.h:2215} ProcessControllerEvent event processing took too much time Type# 2146435072 Duration# 0.120221s
2025-11-03T16:56:28.796426Z node 1 :BS_CONTROLLER ERROR: {BSC00@bsc.cpp:1019} StateWork event processing took too much time Type# 2146435078 Duration# 0.120293s
2025-11-03T16:56:28.850273Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976715663:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:690)
2025-11-03T16:56:28.876263Z node 1 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:570: Compilation failed, self: [1:7568544074892605416:2341], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-11-03T16:56:28.879211Z node 1 :KQP_SESSION WARN: kqp_session_actor.cpp:2506: SessionId: ydb://session/3?node_id=1&id=YTlhY2Q5YTktZGE0MTRiNDYtNjc5YmY3ODMtOWRjMDc2N2M=, ActorId: [1:7568544074892605282:2328], ActorState: ExecuteState, TraceId: 01k95ac3xs3z9e6wvx4vxmqjad, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-11-03T16:56:28.879577Z node 2 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:570: Compilation failed, self: [2:7568544074037468491:2306], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-11-03T16:56:28.879802Z node 2 :KQP_SESSION WARN: kqp_session_actor.cpp:2506: SessionId: ydb://session/3?node_id=2&id=OTdkZjAxNzQtNDY1NGViNzctMzg3MzQwNzEtNDMxNTNjYjA=, ActorId: [2:7568544074037468442:2299], ActorState: ExecuteState, TraceId: 01k95ac40x228fxe2m419m828h, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-11-03T16:56:28.881854Z node 2 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-11-03T16:56:28.886272Z node 1 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-11-03T16:56:29.061466Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976715664:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:690)
2025-11-03T16:56:29.229751Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976715665:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:690)
=== Init DC: UPSERT INTO `/Root/PQ/Config/V2/Cluster` (name, balancer, local, enabled, weight) VALUES ("dc1", "localhost:13111", false, true, 1000), ("dc2", "localhost:14811", true, true, 1000);
2025-11-03T16:56:29.538652Z node 1 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976715666. Ctx: { TraceId: 01k95ac4x64g49sqmkrbmvak3m, Database: , SessionId: ydb://session/3?node_id=1&id=YTEwOTdmODYtNjJkNjIwOS04OTQzOTY4ZS01M2VhZmM5YQ==, PoolId: default, DatabaseId: /Root}. Database not set, use /Root
=== CheckClustersList. Subcribe to ClusterTracker from [1:7568544079187573127:2985] 
=== CheckClustersList. Ok
2025-11-03T16:56:35.990758Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976715671:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:690)
waiting...
PQ Client: create topic: rt3.dc2--test-topic with 1 partitions
CallPersQueueGRPC request to localhost:14811
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc2--test-topic"
  }
}
2025-11-03T16:56:36.141742Z node 1 :PERSQUEUE TRACE: msgbus_server_scheme_request.cpp:218: TMessageBusServerProxy::Handle
2025-11-03T16:56:36.141778Z node 1 :PERSQUEUE TRACE: msgbus_server_scheme_request.cpp:230: TMessageBusServerProxy::Handle CreateMessageBusServerPersQueue
2025-11-03T16:56:36.141855Z node 1 :PERSQUEUE TRACE: msgbus_server_persqueue.cpp:178: Send to PqMetaCache TEvDescribeTopicsRequest
2025-11-03T16:56:36.141881Z node 1 :PERSQUEUE TRACE: msgbus_server_persqueue.cpp:185: Send to PqMetaCache TEvDescribeTopicsRequest Result:1
2025-11-03T16:56:36.143295Z node 1 :PERSQUEUE TRACE: msgbus_server_persqueue.cpp:325: TPersQueueBaseRequestProcessor::CreateChildren
2025-11-03T16:56:36.143315Z node 1 :PERSQUEUE TRACE: msgbus_server_persqueue.cpp:357: TPersQueueBaseRequestProcessor::CreateChildrenIfNeeded topics count = 0
2025-11-03T16:56:36.143352Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc2--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
CallPersQueueGRPC request to localhost:14811
MetaRequest {
  CmdCreateTopic {
    Topic: "rt3.dc2--test-topic"
    NumPartitions: 1
    Config {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
  }
}
2025-11-03T16:56:36.170208Z node 1 :PERSQUEUE TRACE: msgbus_server_scheme_request.cpp:218: TMessageBusServerProxy::Handle
2025-11-03T16:56:36.170240Z node 1 :PERSQUEUE TRACE: msgbus_server_scheme_request.cpp:225: TMessageBusServerProxy::Handle new TMessageBusServerSchemeRequest
CallPersQueueGRPC response:
Status: 129
ProxyErrorCode: 53
SchemeStatus: 1
FlatTxId {
  TxId: 281474976715672
  SchemeShardTabletId: 72057594046644480
  PathId: 13
}
ErrorCode: OK
AddTopic: rt3.dc2--test-topic
===Run query:``DECLARE $version as Int64; DECLARE $path AS Utf8; DECLARE $cluster as Utf8; UPSERT INTO `/Root/PQ/Config/V2/Topics` (path, dc) VALUES ($path, $cluster); UPSERT INTO `/Root/PQ/Config/V2/Versions` (name, version) VALUES ("Topics", $version);`` with topic = test-topic, dc = dc2
2025-11-03T16:56:36.214392Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1655: [72075186224037893][] pipe [1:7568544109252344587:3227] connected; active server actors: 1
2025-11-03T16:56:36.214769Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1519: [72075186224037893][rt3.dc2--test-topic] updating configuration. Deleted partitions []. Added partitions [0]
2025-11-03T16:56:36.216210Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:971: [72075186224037893][rt3.dc2--test-topic] Discovered subdomain [OwnerId: 72057594046644480, LocalPathId: 1] state, outOfSpace = 0 at RB 72075186224037893
2025-11-03T16:56:36.217080Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:140: [72075186224037893][rt3.dc2--test-topic] BALANCER INIT DONE for rt3.dc2--test-topic: (0, 72075186224037892) 
2025-11-03T16:56:36.238272Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 268632582, Sender [2:7568544108397207280:2369], Recipient [2:7568544108397207262:2383]: TEvCollectGarbageResult {TabletId# 72075186224037892 RecordGeneration# 1 PerGenerationCounter# 0 Channel# 2 Status# OK}
2025-11-03T16:56:36.238346Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 268632582, Sender [2:7568544108397207281:2370], Recipient [2:7568544108397207262:2383]: TEvCollectGarbageResult {TabletId# 72075186224037892 RecordGeneration# 1 PerGenerationCounter# 1 Channel# 2 Status# OK}
2025-11-03T16:56:36.240107Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 131085, Sender [2:7568544048267664307:2073], Recipient [2:7568544108397207262:2383]: NActors::TEvInterconnect::TEvNodeInfo
2025-11-03T16:56:36.240142Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5315: HandleHook, processing event TEvInterconnect::TEvNodeInfo
2025-11-03T16:56:36.240183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2960: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-11-03T16:56:36.240297Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 269746185, Sender [2:7568544074037468482:2133], Recipient [2:7568544108397207262:2383]: NKikimr::TEvTxProxySchemeCache::TEvWatchNotifyUpdated
2025-11-03T16:56:36.240319Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5347: HandleHook, processing event TEvTxProxySchemeCache::TEvWatchNotifyUpdated
2025-11-03T16:56:36.240545Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 270794752, Sender [2:7568544108397207262:2383], Recipient [2:7568544108397207262:2383]: NKikimrClient.TKeyValueRequest Cookie: 3 CmdRead { Key: "_config" } CmdRead { Key: "_state" } CmdRead { Key: "_txinfo" } CmdSetExecutorFastLogPolicy { IsAllowed: false }
2025-11-03T16:56:36.240787Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 270794753, Sender [2:7568544108397207290:2383], Recipient [2:7568544108397207262:2383]: NKikimr::TEvKeyValue::TEvIntermediate
2025-11-03T16:56:36.246675Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 270270976, Sender [2:7568544048267664299:2065], Recipient [2:7568544108397207262:2383]: {TEvRegisterTabletResult TabletId# 72075186224037892 Entry# 1762188996106}
2025-11-03T16:56:36.246712Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5349: HandleHook, processing event TEvMediatorTimecast::TEvRegisterTabletResult
2025-11-03T16:56:36.247695Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 270795264, Sender [2:7568544108397207262:2383], Recipient [2:7568544108397207262:2383]: NKikimrClient.TResponse Status: 1 Cookie: 3 ReadResult { Status: 5 Message: "No such key Marker# KV48 (_config)" } ReadResult { Status: 5 Message: "No such key Marker# KV48 (_state)" } ReadResult { Status: 5 Message: "No such key Marker# KV48 (_txinfo)" } SetExecutorFastLogPolicyResult { Status: 0 }
2025-11-03T16:56:36.247727Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5322: HandleHook, processing event TEvKeyValue::TEvResponse
2025-11-03T16:56:36.247820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2992: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-11-03T16:56:36.247933Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 270794752, Sender [2:7568544108397207262:2383], Recipient [2:7568544108397207262:2383]: NKikimrClient.TKeyValueRequest Cookie: 6 CmdReadRange { Range { From: "tx_00000000000000000000" IncludeFrom: true To: "tx_18446744073709551615" IncludeTo: true } IncludeData: true } CmdSetExecutorFastLogPolicy { IsAllowed: false }
2025-11-03T16:56:36.248147Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 270794753, Sender [2:7568544108397207293:2383], Recipient [2:7568544108397207262:2383]: NKikimr::TEvKeyValue::TEvIntermediate
2025-11-03T16:56:36.248393Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 270795264, Sender [2:7568544108397207262:2383], Recipient [2:7568544108397207262:2383]: NKikimrClient.TResponse Status: 1 Cookie: 6 ReadRangeResult { Status: 5 } SetExecutorFastLogPolicyResult { Status: 0 }
2025-11-03T16:56:36.248405Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5322: HandleHook, processing event TEvKeyValue::TEvResponse
2025-11-03T16:56:36.248451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:787: [PQ: 72075186224037892] no config, start with empty partitions and default config
2025-11-03T16:56:36.248505Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:913: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-11-03T16:56:36.248546Z node 2 :PERSQUEUE INFO: pq_impl.cpp:612: [PQ: 72075186224037892] doesn't have tx writes info
2025-11-03T16:56:36.249149Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:404: [72075186224037893][rt3.dc2--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1
2025-11-03T16:56:36.249753Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 269877761, Sender [2:7568544108397207264:2359], Recipient [2:7568544108397207262:2383]: NKikimr::TEvTabletPipe::TEvServerConnected
2025-11-03T16:56:36.249782Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5330: HandleHook, processing event TEvTabletPipe::TEvServerConnected
2025-11-03T16:56:36.249798Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:2716: [PQ: 72075186224037892] Handle TEvTabletPipe::TEvServerConnected
2025-11-03T16:56:36.249844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [1:7568544109252344619:2441], now have 1 active actors on pipe
2025-11-03T16:56:36.249885Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 269877761, Sender [2:7568544108397207261:2358], Recipient [2:7568544108397207262:2383]: NKikimr::TEvTabletPipe::TEvServerConnected
2025-11-03T16:56:36.249898Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5330: HandleHook, processing event TEvTabletPipe::TEvServerConnected
2025-11-03T16:56:36.249907Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:2716: [PQ: 72075186224037892] Handle TEvTabletPipe::TEvServerConnected
2025-11-03T16:56:36.249923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [1:7568544109252344586:3226], now have 1 active actors on pipe
2025-11-03T16:56:36.250434Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271188536, Sender [1:7568544109252344581:2441], Recipient [2:7568544108397207264:2359]
2025-11-03T16:56:36.250459Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5345: HandleHook, processing event TEvPQ::TEvSubDomainStatus
2025-11-03T16:56:36.250485Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271187998, Sender [1:7568544053417768176:2209], Recipient [2:7568544108397207261:2358]
2025-11-03T16:56:36.250499Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5337: HandleHook, processing event TEvPersQueue::TEvProposeTransaction
2025-11-03T16:56:36.250989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-03T16:56:36.251132Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 270794752, Sender [2:7568544108397207262:2383], Recipient [2:7568544108397207262:2383]: NKikimrClient.TKeyValueRequest Cookie: 5 CmdWrite { Key: "tx_00000281474976715672" Value: "\010\230\247\200\200\200\200@\020\002\030\212\334\230\325\2443 \377\377\377\377\377\377\377\377\377\001X\002b\260\001\022\037\030\200\243\005(\200\200\200\0040\200\243\0058\200\332\304\t@\200\332\304\th\001\370\001\200\233\356\002\030\000\"\023rt3.dc2--test-topic(\0000\001\252\001\027\010\000\010\001\010\002\022\003raw\022\004gzip\022\004lzop\272\001\034/Root/PQ/rt3.dc2--test-topic\322\001\000\332\001\000\342\001\000\352\001\005/Root\372\001\010\010\000\030\0010\0018\000\242\002\010\010\000\030\0010\0018\000\252\002\016\n\004user\020\000\030\0008\000@\000\312\002\000j\000r\022\t\360t\334z\267\336\010i\021\241\010\000\000\001\000\000\000\202\001\000" } CmdWrite { Key: "_txinfo" Value: "\020\000\030\000(\240\215\0060\0008\000" StorageChannel: INLINE }
2025-11-03T16:56:36.253217Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 270794753, Sender [2:7568544108397207294:2383], Recipient [2:7568544108397207262:2383]: NKikimr::TEvKeyValue::TEvIntermediate
2025-11-03T16:56:36.255674Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 270795264, Sender [2:7568544108397207262:2383], Recipient [2:7568544108397207262:2383]: NKikimrClient.TResponse Status: 1 Cookie: 5 WriteResult { Status: 0 StatusFlags: 1 } WriteResult { Status: 0 StatusFlags: 1 }
2025-11-03T16:56:36.255700Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5322: HandleHook, processing event TEvKeyValue::TEvResponse
2025-11-03T16:56:36.255717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-03T16:56:36.261815Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 269550082, Sender [1:7568544053417768176:2209], Recipient [2:7568544108397207261:2358]
2025-11-03T16:56:36.261845Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5346: HandleHook, processing event TEvPersQueue::TEvProposeTransactionAttach
2025-11-03T16:56:36.264828Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 269877761, Sender [2:7568544108397207298:2383], Recipient [2:7568544108397207262:2383]: NKikimr::TEvTabletPipe::TEvServerConnected
2025-11-03T16:56:36.264863Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5330: HandleHook, processing event TEvTabletPipe::TEvServerConnected
2025-11-03T16:56:36.264877Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:2716: [PQ: 72075186224037892] Handle TEvTabletPipe::TEvServerConnected
2025-11-03T16:56:36.264903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [1:7568544109252344660:3281], now have 1 active actors on pipe
2025-11-03T16:56:36.266497Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 269287424, Sender [1:7568544053417768418:2381], Recipient [2:7568544108397207298:2383]
2025-11-03T16:56:36.266528Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5339: HandleHook, processing event TEvTxProcessing::TEvPlanStep
2025-11-03T16:56:36.266811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-03T16:56:36.267000Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 270794752, Sender [2:7568544108397207262:2383], Recipient [2:7568544108397207262:2383]: NKikimrClient.TKeyValueRequest Cookie: 5 CmdWrite { Key: "tx_00000281474976715672" Value: "\010\230\247\200\200\200\200@\020\004\030\212\334\230\325\2443 \377\377\377\377\377\377\377\377\377\001@\325\335\230\325\2443X\002b\260\001\022\037\030\200\243\005(\200\200\200\0040\200\243\0058\200\332\304\t@\200\332\304\th\001\370\001\200\233\356\002\030\000\"\023rt3.dc2--test-topic(\0000\001\252\001\027\010\000\010\001\010\002\022\003raw\022\004gzip\022\004lzop\272\001\034/Root/PQ/rt3.dc2--test-topic\322\001\000\332\001\000\342\001\000\352\001\005/Root\372\001\010\010\000\030\0010\0018\000\242\002\010\010\000\030\0010\0018\000\252\002\016\n\004user\020\000\030\0008\000@\000\312\002\000j\000r\022\t\360t\334z\267\336\010i\021\241\010\000\000\001\000\000\000\202\001\000" } CmdWrite { Key: "_txinfo" Value: "\020\325\335\230\325\2443\030\230\247\200\200\200\200@(\240\215\0060\0008\000" StorageChannel: INLINE }
2025-11-03T16:56:36.269517Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 270794753, Sender [2:7568544108397207299:2383], Recipient [2:7568544108397207262:2383]: NKikimr::TEvKeyValue::TEvIntermediate
2025-11-03T16:56:36.272596Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 270795264, Sender [2:7568544108397207262:2383], Recipient [2:7568544108397207262:2383]: NKikimrClient.TResponse Status: 1 Cookie: 5 WriteResult { Status: 0 StatusFlags: 1 } WriteResult { Status: 0 StatusFlags: 1 }
2025-11-03T16:56:36.272635Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5322: HandleHook, processing event TEvKeyValue::TEvResponse
2025-11-03T16:56:36.272650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-03T16:56:36.273752Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 270794756, Sender [2:7568544108397207262:2383], Recipient [2:7568544108397207262:2383]: NKikimr::TEvKeyValue::TEvCollect
2025-11-03T16:56:36.273834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc2--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-11-03T16:56:36.273927Z node 2 :PERSQUEUE TRACE: partition.h:573: StateInit event# 271188530 (NKikimr::TEvPQ::TEvProposePartitionConfig), Tablet [2:7568544108397207262:2383], Partition 0, Sender [2:7568544108397207262:2383], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:36.273980Z node 2 :PERSQUEUE TRACE: partition.h:575: StateInit, received event# 271188530, Sender [2:7568544108397207262:2383], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvProposePartitionConfig
2025-11-03T16:56:36.274001Z node 2 :PERSQUEUE TRACE: partition.h:589: StateInit, processing event TEvPQ::TEvProposePartitionConfig
2025-11-03T16:56:36.274034Z node 2 :PERSQUEUE DEBUG: partition.cpp:1312: [72075186224037892][Partition][0][StateInit] HandleOnInit TEvPQ::TEvProposePartitionConfig
2025-11-03T16:56:36.274156Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 270794752, Sender [2:7568544108397207303:2383], Recipient [2:7568544108397207262:2383]: NKikimrClient.TKeyValueRequest CmdRead { Key: "_config_0" }
2025-11-03T16:56:36.274289Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 270794753, Sender [2:7568544108397207305:2383], Recipient [2:7568544108397207262:2383]: NKikimr::TEvKeyValue::TEvIntermediate
2025-11-03T16:56:36.274449Z node 2 :PERSQUEUE TRACE: partition.h:573: StateInit event# 270795264 (NKikimr::TEvKeyValue::TEvResponse), Tablet [2:7568544108397207262:2383], Partition 0, Sender [2:7568544108397207262:2383], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:36.274534Z node 2 :PERSQUEUE TRACE: partition.h:575: StateInit, received event# 270795264, Sender [2:7568544108397207262:2383], Recipient [2:7568544108397207303:2383]: NKikimrClient.TResponse Status: 1 ReadResult { Status: 5 Message: "No such key Marker# KV48 (_config_0)" }
2025-11-03T16:56:36.274605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc2--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-11-03T16:56:36.275038Z node 2 :PERSQUEUE INFO: partition_init.cpp:1101: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7568544108397207303:2383]
2025-11-03T16:56:36.278717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc2--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-11-03T16:56:36.278978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc2--test-topic:0:Initializer] Initializing completed.
2025-11-03T16:56:36.279012Z node 2 :PERSQUEUE INFO: partition.cpp:707: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc2--test-topic' partition 0 generation 1 [2:7568544108397207303:2383]
2025-11-03T16:56:36.279044Z node 2 :PERSQUEUE DEBUG: partition.cpp:727: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc2--test-topic partitition 0 so 0 endOffset 0 Head Offset 0 PartNo 0 PackedSize 0 count 0 nextOffset 0 batches 0
2025-11-03T16:56:36.279086Z node 2 :PERSQUEUE DEBUG: partition_mlp.cpp:83: [72075186224037892][Partition][0][StateIdle] Initializing MLP Consumers: 0
2025-11-03T16:56:36.280536Z node 2 :PERSQUEUE DEBUG: partition.cpp:4273: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 1
2025-11-03T16:56:36.280583Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:36.280694Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:36.280710Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-03T16:56:36.280729Z node 2 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-11-03T16:56:36.280745Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:36.280759Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:36.280770Z node 2 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-11-03T16:56:36.280811Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:923: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc2--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-11-03T16:56:36.280856Z node 2 :PERSQUEUE DEBUG: partition_mlp.cpp:60: [72075186224037892][Partition][0][StateIdle] Process MLP pending events. Count 0
2025-11-03T16:56:36.281017Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 270794760, Sender [2:7568544108397207304:2385], Recipient [2:7568544108397207262:2383]: NKikimr::TEvKeyValue::TEvCompleteGC
2025-11-03T16:56:36.281340Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271188531, Sender [2:7568544108397207303:2383], Recipient [2:7568544108397207262:2383]: NKikimr::TEvPQ::TEvProposePartitionConfigResult
2025-11-03T16:56:36.281357Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5343: HandleHook, processing event TEvPQ::TEvProposePartitionConfigResult
2025-11-03T16:56:36.281558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-03T16:56:36.281619Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188562 (NKikimr::TEvPQ::TEvTxBatchComplete), Tablet [2:7568544108397207262:2383], Partition 0, Sender [2:7568544108397207303:2383], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:36.281658Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188562, Sender [2:7568544108397207303:2383], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvTxBatchComplete
2025-11-03T16:56:36.281696Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 65538 (NActors::TEvents::TEvWakeup), Tablet [2:7568544108397207262:2383], Partition 0, Sender [2:7568544108397207303:2383], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:36.281730Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 65538, Sender [2:7568544108397207303:2383], Recipient [2:7568544108397207303:2383]: NActors::TEvents::TEvWakeup
2025-11-03T16:56:36.281815Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:183: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:56:36.281852Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271188497, Sender [2:7568544108397207303:2383], Recipient [2:7568544108397207262:2383]: NKikimr::TEvPQ::TEvInitComplete
2025-11-03T16:56:36.281871Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5323: HandleHook, processing event TEvPQ::TEvInitComplete
2025-11-03T16:56:36.281909Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271188503, Sender [2:7568544108397207303:2383], Recipient [2:7568544108397207262:2383]: NKikimr::TEvPQ::TEvPartitionLabeledCounters
2025-11-03T16:56:36.281923Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5326: HandleHook, processing event TEvPQ::TEvPartitionLabeledCounters
2025-11-03T16:56:36.281966Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271188503, Sender [2:7568544108397207303:2383], Recipient [2:7568544108397207262:2383]: NKikimr::TEvPQ::TEvPartitionLabeledCounters
2025-11-03T16:56:36.281976Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5326: HandleHook, processing event TEvPQ::TEvPartitionLabeledCounters
2025-11-03T16:56:36.282008Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271188503, Sender [2:7568544108397207303:2383], Recipient [2:7568544108397207262:2383]: NKikimr::TEvPQ::TEvPartitionLabeledCounters
2025-11-03T16:56:36.282017Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5326: HandleHook, processing event TEvPQ::TEvPartitionLabeledCounters
2025-11-03T16:56:36.282217Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 270794752, Sender [2:7568544108397207262:2383], Recipient [2:7568544108397207262:2383]: NKikimrClient.TKeyValueRequest Cookie: 5 CmdWrite { Key: "tx_00000281474976715672" Value: "\010\230\247\200\200\200\200@\020\006\030\212\334\230\325\2443 \377\377\377\377\377\377\377\377\377\001@\325\335\230\325\2443H\001X\002b\260\001\022\037\030\200\243\005(\200\200\200\0040\200\243\0058\200\332\304\t@\200\332\304\th\001\370\001\200\233\356\002\030\000\"\023rt3.dc2--test-topic(\0000\001\252\001\027\010\000\010\001\010\002\022\003raw\022\004gzip\022\004lzop\272\001\034/Root/PQ/rt3.dc2--test-topic\322\001\000\332\001\000\342\001\000\352\001\005/Root\372\001\010\010\000\030\0010\0018\000\242\002\010\010\000\030\0010\0018\000\252\002\016\n\004user\020\000\030\0008\000@\000\312\002\000j\000r\022\t\360t\334z\267\336\010i\021\241\010\000\000\001\000\000\000\202\001\004\n\002\010\000" } CmdWrite { Key: "_txinfo" Value: "\020\325\335\230\325\2443\030\230\247\200\200\200\200@(\240\215\0060\325\335\230\325\24438\230\247\200\200\200\200@" StorageChannel: INLINE }
2025-11-03T16:56:36.282412Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271188501, Sender [2:7568544108397207303:2383], Recipient [2:7568544108397207262:2383]: NKikimr::TEvPQ::TEvPartitionCounters
2025-11-03T16:56:36.282430Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5324: HandleHook, processing event TEvPQ::TEvPartitionCounters
2025-11-03T16:56:36.282451Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:1078: [PQ: 72075186224037892] Handle TEvPQ::TEvPartitionCounters PartitionId 0
2025-11-03T16:56:36.290394Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 270794753, Sender [2:7568544108397207308:2383], Recipient [2:7568544108397207262:2383]: NKikimr::TEvKeyValue::TEvIntermediate
2025-11-03T16:56:36.294474Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 270794756, Sender [2:7568544108397207262:2383], Recipient [2:7568544108397207262:2383]: NKikimr::TEvKeyValue::TEvCollect
2025-11-03T16:56:36.294630Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 270795264, Sender [2:7568544108397207262:2383], Recipient [2:7568544108397207262:2383]: NKikimrClient.TResponse Status: 1 Cookie: 5 WriteResult { Status: 0 StatusFlags: 1 } WriteResult { Status: 0 StatusFlags: 1 }
2025-11-03T16:56:36.294642Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5322: HandleHook, processing event TEvKeyValue::TEvResponse
2025-11-03T16:56:36.294657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-03T16:56:36.294733Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:4082: [PQ: 72075186224037892] Commit tx 281474976715672
2025-11-03T16:56:36.294836Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188532 (NKikimr::TEvPQ::TEvTxCommit), Tablet [2:7568544108397207262:2383], Partition 0, Sender [2:7568544108397207262:2383], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:36.294867Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188532, Sender [2:7568544108397207262:2383], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvTxCommit
2025-11-03T16:56:36.294884Z node 2 :PERSQUEUE TRACE: partition.h:664: StateIdle, processing event TEvPQ::TEvTxCommit
2025-11-03T16:56:36.294908Z node 2 :PERSQUEUE DEBUG: partition.cpp:1416: [72075186224037892][Partition][0][StateIdle] Handle TEvPQ::TEvTxCommit Step 1762188996309, TxId 281474976715672
2025-11-03T16:56:36.294931Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:36.294944Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:36.295086Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:36.295133Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:36.295176Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:36.295190Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:36.295402Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-03T16:56:36.295647Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 270794752, Sender [2:7568544108397207286:2383], Recipient [2:7568544108397207262:2383]: NKikimrClient.TKeyValueRequest Cookie: 0 CmdWrite { Key: "i0000000000" Value: "\030\000(\000" StorageChannel: INLINE } CmdWrite { Key: "I0000000000" Value: "\010\325\335\230\325\2443\020\230\247\200\200\200\200@" StorageChannel: INLINE } CmdWrite { Key: "m0000000000cuser" Value: "\010\000\020\000\030\000\"\000(\0000\000@\000" StorageChannel: INLINE } CmdWrite { Key: "m0000000000uuser" Value: "\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000" StorageChannel: INLINE } CmdWrite { Key: "_config_0" Value: "\022\037\030\200\243\005(\200\200\200\0040\200\243\0058\200\332\304\t@\200\332\304\th\001\370\001\200\233\356\002\030\000\"\023rt3.dc2--test-topic(\0000\001\252\001\027\010\000\010\001\010\002\022\003raw\022\004gzip\022\004lzop\272\001\034/Root/PQ/rt3.dc2--test-topic\322\001\000\332\001\000\342\001\000\352\001\005/Root\372\001\010\010\000\030\0010\0018\000\242\002\010\010\000\030\0010\0018\000\252\002\016\n\004user\020\000\030\0008\000@\000\312\002\000" StorageChannel: INL
2025-11-03T16:56:36.295800Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 270794753, Sender [2:7568544108397207315:2383], Recipient [2:7568544108397207262:2383]: NKikimr::TEvKeyValue::TEvIntermediate
2025-11-03T16:56:36.299204Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 270794760, Sender [2:7568544108397207314:2386], Recipient [2:7568544108397207262:2383]: NKikimr::TEvKeyValue::TEvCompleteGC
2025-11-03T16:56:36.299535Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 270795264 (NKikimr::TEvKeyValue::TEvResponse), Tablet [2:7568544108397207262:2383], Partition 0, Sender [2:7568544108397207286:2383], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:36.299678Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 270795264, Sender [2:7568544108397207286:2383], Recipient [2:7568544108397207303:2383]: NKikimrClient.TResponse Status: 1 WriteResult { Status: 0 StatusFlags: 1 } WriteResult { Status: 0 StatusFlags: 1 } WriteResult { Status: 0 StatusFlags: 1 } WriteResult { Status: 0 StatusFlags: 1 } WriteResult { Status: 0 StatusFlags: 1 }
2025-11-03T16:56:36.299695Z node 2 :PERSQUEUE TRACE: partition.h:625: StateIdle, processing event TEvKeyValue::TEvResponse
2025-11-03T16:56:36.299711Z node 2 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-03T16:56:36.299889Z node 2 :PERSQUEUE DEBUG: partition_mlp.cpp:83: [72075186224037892][Partition][0][StateIdle] Initializing MLP Consumers: 0
2025-11-03T16:56:36.299993Z node 2 :PERSQUEUE TRACE: partition_write.cpp:518: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse.
2025-11-03T16:56:36.300045Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-11-03T16:56:36.300062Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:36.300077Z node 2 :PERSQUEUE TRACE: partition_write.cpp:424: [72075186224037892][Partition][0][StateIdle] TPartition::SyncMemoryStateWithKVState.
2025-11-03T16:56:36.300103Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:36.300119Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:36.300132Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:36.300149Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:36.300192Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:36.300207Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:36.300229Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:36.300247Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:183: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:56:36.300345Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271188533, Sender [2:7568544108397207303:2383], Recipient [2:7568544108397207262:2383]: NKikimr::TEvPQ::TEvTxCommitDone
2025-11-03T16:56:36.300364Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5344: HandleHook, processing event TEvPQ::TEvTxCommitDone
2025-11-03T16:56:36.300977Z node 2 :PERSQUEUE TRACE: pq_l2_cache.h:116: StateFunc, received event# 271450112, Sender [2:7568544108397207286:2383], Recipient [2:7568544048267664305:2071]: NKikimr::NPQ::TEvPqCache::TEvCacheL2Request
2025-11-03T16:56:36.301004Z node 2 :PERSQUEUE TRACE: pq_l2_cache.h:119: StateFunc, processing event TEvPqCache::TEvCacheL2Request
2025-11-03T16:56:36.301522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:398: [PQ: 72075186224037892] Apply new config PartitionConfig { LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 } PartitionIds: 0 TopicName: "rt3.dc2--test-topic" Version: 0 LocalDC: true Codecs { Ids: 0 Ids: 1 Ids: 2 Codecs: "raw" Codecs: "gzip" Codecs: "lzop" } TopicPath: "/Root/PQ/rt3.dc2--test-topic" YcCloudId: "" YcFolderId: "" YdbDatabaseId: "" YdbDatabasePath: "/Root" Partitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } AllPartitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } Consumers { Name: "user" ReadFromTimestampsMs: 0 FormatVersion: 0 Version: 0 Generation: 0 } MonitoringProjectId: ""
2025-11-03T16:56:36.301665Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:913: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-11-03T16:56:36.302037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-03T16:56:36.302102Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271188503, Sender [2:7568544108397207303:2383], Recipient [2:7568544108397207262:2383]: NKikimr::TEvPQ::TEvPartitionLabeledCounters
2025-11-03T16:56:36.302119Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5326: HandleHook, processing event TEvPQ::TEvPartitionLabeledCounters
2025-11-03T16:56:36.302301Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 270794752, Sender [2:7568544108397207262:2383], Recipient [2:7568544108397207262:2383]: NKikimrClient.TKeyValueRequest Cookie: 5 CmdWrite { Key: "tx_00000281474976715672" Value: "\010\230\247\200\200\200\200@\020\t\030\212\334\230\325\2443 \377\377\377\377\377\377\377\377\377\001@\325\335\230\325\2443H\001X\002b\260\001\022\037\030\200\243\005(\200\200\200\0040\200\243\0058\200\332\304\t@\200\332\304\th\001\370\001\200\233\356\002\030\000\"\023rt3.dc2--test-topic(\0000\001\252\001\027\010\000\010\001\010\002\022\003raw\022\004gzip\022\004lzop\272\001\034/Root/PQ/rt3.dc2--test-topic\322\001\000\332\001\000\342\001\000\352\001\005/Root\372\001\010\010\000\030\0010\0018\000\242\002\010\010\000\030\0010\0018\000\252\002\016\n\004user\020\000\030\0008\000@\000\312\002\000j\000r\022\t\360t\334z\267\336\010i\021\241\010\000\000\001\000\000\000\202\001\004\n\002\010\000" } CmdWrite { Key: "_txinfo" Value: "\020\325\335\230\325\2443\030\230\247\200\200\200\200@(\240\215\0060\325\335\230\325\24438\230\247\200\200\200\200@" StorageChannel: INLINE } CmdWrite { Key: "_config" Value: "
2025-11-03T16:56:36.307957Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 270794753, Sender [2:7568544108397207321:2383], Recipient [2:7568544108397207262:2383]: NKikimr::TEvKeyValue::TEvIntermediate
2025-11-03T16:56:36.312049Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 270795264, Sender [2:7568544108397207262:2383], Recipient [2:7568544108397207262:2383]: NKikimrClient.TResponse Status: 1 Cookie: 5 WriteResult { Status: 0 StatusFlags: 1 } WriteResult { Status: 0 StatusFlags: 1 } WriteResult { Status: 0 StatusFlags: 1 }
2025-11-03T16:56:36.312078Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5322: HandleHook, processing event TEvKeyValue::TEvResponse
2025-11-03T16:56:36.312093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-03T16:56:36.312199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-03T16:56:36.312264Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 270794756, Sender [2:7568544108397207262:2383], Recipient [2:7568544108397207262:2383]: NKikimr::TEvKeyValue::TEvCollect
2025-11-03T16:56:36.312393Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 270794752, Sender [2:7568544108397207262:2383], Recipient [2:7568544108397207262:2383]: NKikimrClient.TKeyValueRequest Cookie: 5 CmdDeleteRange { Range { From: "tx_00000281474976715672" IncludeFrom: true To: "tx_00000281474976715672" IncludeTo: true } } CmdWrite { Key: "_txinfo" Value: "\020\325\335\230\325\2443\030\230\247\200\200\200\200@(\240\215\0060\325\335\230\325\24438\230\247\200\200\200\200@" StorageChannel: INLINE }
2025-11-03T16:56:36.312537Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 270794753, Sender [2:7568544108397207328:2383], Recipient [2:7568544108397207262:2383]: NKikimr::TEvKeyValue::TEvIntermediate
2025-11-03T16:56:36.315698Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 270794760, Sender [2:7568544108397207327:2387], Recipient [2:7568544108397207262:2383]: NKikimr::TEvKeyValue::TEvCompleteGC
2025-11-03T16:56:36.316030Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 270795264, Sender [2:7568544108397207262:2383], Recipient [2:7568544108397207262:2383]: NKikimrClient.TResponse Status: 1 Cookie: 5 DeleteRangeResult { Status: 0 } WriteResult { Status: 0 StatusFlags: 1 }
2025-11-03T16:56:36.316043Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5322: HandleHook, processing event TEvKeyValue::TEvResponse
2025-11-03T16:56:36.316056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-03T16:56:36.318571Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 270794756, Sender [2:7568544108397207262:2383], Recipient [2:7568544108397207262:2383]: NKikimr::TEvKeyValue::TEvCollect
2025-11-03T16:56:36.319733Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 270794760, Sender [2:7568544108397207334:2388], Recipient [2:7568544108397207262:2383]: NKikimr::TEvKeyValue::TEvCompleteGC
2025-11-03T16:56:36.334274Z node 1 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976715673. Ctx: { TraceId: 01k95acbm3cxnhmemwkzrkmjtr, Database: , SessionId: ydb://session/3?node_id=1&id=ZGVhMzMxOTQtYzcwY2RmZWYtYTM3MTZlNjAtYTkxNTkxMg==, PoolId: default, DatabaseId: /Root}. Database not set, use /Root
===Query complete
TClient::Ls request: /Root/PQ/rt3.dc2--test-topic
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc2--test-topic"
    PathId: 13
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976715672
    CreateStep: 1762188996309
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc2--test-topic"
    PathId: 13
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts...
(TRUNCATED)
GetTopicVersionFromPath:  record Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc2--test-topic"
    PathId: 13
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976715672
    CreateStep: 1762188996309
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc2--test-topic"
    PathId: 13
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      YdbDatabasePath: "/Root"
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
    Partitions {
      PartitionId: 0
      TabletId: 72075186224037892
      Status: Active
    }
    AlterVersion: 1
    BalancerTabletID: 72075186224037893
    NextPartitionId: 1
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 1
      PlanResolution: 7
      Coordinators: 72057594046316545
      TimeCastBucketsPerMediator: 2
      Mediators: 72057594046382081
    }
    DomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    PathsInside: 12
    PathsLimit: 10000
    ShardsInside: 6
    ShardsLimit: 200000
    ResourcesDomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    DiskSpaceUsage {
      Tables {
        TotalSize: 0
        DataSize: 0
        IndexSize: 0
      }
      Topics {
        ReserveSize: 0
        AccountSize: 0
        DataSize: 0
        UsedReserveSize: 0
      }
    }
    PQPartitionsInside: 1
    PQPartitionsLimit: 1000000
    SchemeLimits {
      MaxDepth: 32
      MaxPaths: 10000
      MaxChildrenInDir: 100000
      MaxAclBytesSize: 10240
      MaxTableColumns: 200
      MaxTableColumnNameLength: 255
      MaxTableKeyColumns: 30
      MaxTableIndices: 20
      MaxShards: 200000
      MaxShardsInPath: 35000
      MaxConsistentCopyTargets: 10000
      MaxPathElementLength: 255
      ExtraPathSymbolsAllowed: "!\"#$%&\'()*+,-.:;<=>?@[\\]^_`{|}~"
      MaxPQPartitions: 1000000
      MaxTableCdcStreams: 5
      MaxExports: 10
      MaxImports: 10
      MaxColumnTableColumns: 10000
    }
  }
}
Path: "/Root/PQ/rt3.dc2--test-topic"
 name rt3.dc2--test-topic version1
CallPersQueueGRPC request to localhost:14811
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc2--test-topic"
  }
}
2025-11-03T16:56:36.370818Z node 1 :PERSQUEUE TRACE: msgbus_server_scheme_request.cpp:218: TMessageBusServerProxy::Handle
2025-11-03T16:56:36.370849Z node 1 :PERSQUEUE TRACE: msgbus_server_scheme_request.cpp:230: TMessageBusServerProxy::Handle CreateMessageBusServerPersQueue
2025-11-03T16:56:36.370909Z node 1 :PERSQUEUE TRACE: msgbus_server_persqueue.cpp:178: Send to PqMetaCache TEvDescribeTopicsRequest
2025-11-03T16:56:36.370933Z node 1 :PERSQUEUE TRACE: msgbus_server_persqueue.cpp:185: Send to PqMetaCache TEvDescribeTopicsRequest Result:1
2025-11-03T16:56:36.372018Z node 1 :PERSQUEUE TRACE: msgbus_server_persqueue.cpp:325: TPersQueueBaseRequestProcessor::CreateChildren
2025-11-03T16:56:36.372059Z node 1 :PERSQUEUE TRACE: msgbus_server_persqueue.cpp:357: TPersQueueBaseRequestProcessor::CreateChildrenIfNeeded topics count = 1
2025-11-03T16:56:36.372072Z node 1 :PERSQUEUE TRACE: msgbus_server_persqueue.cpp:387: CreateTopicSubactor for topic rt3.dc2--test-topic
2025-11-03T16:56:36.372301Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
MetaResponse {
  CmdGetTopicMetadataResult {
    TopicInfo {
      Topic: "rt3.dc2--test-topic"
      NumPartitions: 1
      Config {
        PartitionConfig {
          LifetimeSeconds: 86400
          LowWatermark: 8388608
          SourceIdLifetimeSeconds: 86400
          WriteSpeedInBytesPerSecond: 20000000
          BurstSize: 20000000
          SourceIdMaxCounts: 6000000
        }
        Version: 1
        LocalDC: true
        Codecs {
          Ids: 0
          Ids: 1
          Ids: 2
          Codecs: "raw"
          Codecs: "gzip"
          Codecs: "lzop"
        }
        TopicPath: "/Root/PQ/rt3.dc2--test-topic"
        YdbDatabasePath: "/Root"
        Consumers {
          Name: "user"
          ReadFromTimestampsMs: 0
          FormatVersion: 0
          Version: 0
        }
      }
      ErrorCode: OK
    }
  }
}
=== Topic created, have version: 1
2025-11-03T16:56:36.381103Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:36.381163Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:36.381187Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:36.381234Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:36.381250Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:36.381269Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:36.381294Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:36.381356Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:36.381372Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:36.381402Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:36.384941Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: try to update token
2025-11-03T16:56:36.385908Z :INFO: [] MessageGroupId [src] SessionId [] Write session: Do CDS request
2025-11-03T16:56:36.385952Z :INFO: [] MessageGroupId [src] SessionId [] Start write session. Will connect to endpoint: localhost:14811
2025-11-03T16:56:36.400398Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-11-03T16:56:36.400440Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1
2025-11-03T16:56:36.415072Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src" }
2025-11-03T16:56:36.415990Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src" }
2025-11-03T16:56:36.416171Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1 topic: "test-topic" message_group_id: "src" from ipv6:[::1]:43202
2025-11-03T16:56:36.416191Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:43202 proto=v1  topic=test-topic durationSec=0
2025-11-03T16:56:36.416203Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-11-03T16:56:36.417896Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1 sessionId:  describe result for acl check
2025-11-03T16:56:36.418067Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-11-03T16:56:36.418116Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-11-03T16:56:36.418130Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-11-03T16:56:36.418162Z node 1 :PQ_PARTITION_CHOOSER TRACE: partition_chooser_impl__abstract_chooser_actor.h:88: TPartitionChooser [1:7568544109252344735:2459] (SourceId=src, PreferedPartition=(NULL)) InitTable: SourceId=src TopicsAreFirstClassCitizen=0 UseSrcIdMetaMappingInFirstClass=1
2025-11-03T16:56:36.418177Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7568544109252344735:2459] (SourceId=src, PreferedPartition=(NULL)) StartKqpSession
2025-11-03T16:56:36.423867Z node 1 :PQ_PARTITION_CHOOSER TRACE: partition_chooser_impl__abstract_chooser_actor.h:132: StateCreateKqpSession, received event# 271646728, Sender [1:7568544053417768053:2268], Recipient [1:7568544109252344735:2459]: NKikimrKqp.TEvCreateSessionResponse Error: "" Response { SessionId: "ydb://session/3?node_id=1&id=ZTU0MWIwNDItZWMxYWY1NzQtM2IwNjEyNDYtOGUzNDkwNWU=" NodeId: 1 } YdbStatus: SUCCESS ResourceExhausted: false
2025-11-03T16:56:36.423910Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7568544109252344735:2459] (SourceId=src, PreferedPartition=(NULL)) Select from the table
2025-11-03T16:56:36.484299Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:36.484370Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:36.484393Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:36.484418Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:36.484431Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:36.484441Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:36.484462Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:36.484514Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:36.484527Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:36.484547Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:36.585238Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:36.585309Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:36.585331Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:36.585362Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:36.585374Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:36.585385Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:36.585404Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:36.585457Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:36.585470Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:36.585490Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:36.632282Z node 1 :PQ_PARTITION_CHOOSER TRACE: partition_chooser_impl__abstract_chooser_actor.h:163: StateSelect, received event# 271646721, Sender [1:7568544053417768053:2268], Recipient [1:7568544109252344735:2459]: NKikimrKqp.TEvQueryResponse Response { SessionId: "ydb://session/3?node_id=1&id=ZTU0MWIwNDItZWMxYWY1NzQtM2IwNjEyNDYtOGUzNDkwNWU=" PreparedQuery: "bf547082-be61c135-9226a4-6fe85003" QueryParameters { Name: "$Hash" Type { Kind: Data Data { Scheme: 2 } } } QueryParameters { Name: "$Topic" Type { Kind: Data Data { Scheme: 4608 } } } QueryParameters { Name: "$SourceId" Type { Kind: Data Data { Scheme: 4608 } } } TxMeta { id: "01k95acc0eect27s0w1kynb6sh" } YdbResults { columns { name: "Partition" type { optional_type { item { type_id: UINT32 } } } } columns { name: "CreateTime" type { optional_type { item { type_id: UINT64 } } } } columns { name: "AccessTime" type { optional_type { item { type_id: UINT64 } } } } columns { name: "SeqNo" type { optional_type { item { type_id: UINT64 } } } } format: FORMAT_VALUE } QueryDiagnostics: "" } YdbStatus: SUCCESS ConsumedRu: 129
2025-11-03T16:56:36.632436Z node 1 :PQ_PARTITION_CHOOSER TRACE: partition_chooser_impl__abstract_chooser_actor.h:151: TPartitionChooser [1:7568544109252344735:2459] (SourceId=src, PreferedPartition=(NULL)) Selected from table PartitionId=(NULL) SeqNo=(NULL)
2025-11-03T16:56:36.632466Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [1:7568544109252344735:2459] (SourceId=src, PreferedPartition=(NULL)) RequestPQRB
2025-11-03T16:56:36.634595Z node 1 :PQ_PARTITION_CHOOSER TRACE: partition_chooser_impl__old_chooser_actor.h:101: StatePQRB, received event# 269877760, Sender [1:7568544109252344772:2459], Recipient [1:7568544109252344735:2459]: NKikimr::TEvTabletPipe::TEvClientConnected { TabletId: 72075186224037893 Status: OK ServerId: [1:7568544109252344773:3347] Leader: 1 Dead: 0 Generation: 1 VersionInfo:  }
2025-11-03T16:56:36.634663Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1655: [72075186224037893][rt3.dc2--test-topic] pipe [1:7568544109252344772:2459] connected; active server actors: 1
2025-11-03T16:56:36.634927Z node 1 :PQ_PARTITION_CHOOSER TRACE: partition_chooser_impl__old_chooser_actor.h:101: StatePQRB, received event# 271187996, Sender [1:7568544109252344581:2441], Recipient [1:7568544109252344735:2459]: NKikimrPQ.TGetPartitionIdForWriteResponse PartitionId: 0
2025-11-03T16:56:36.634958Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [1:7568544109252344735:2459] (SourceId=src, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=src
2025-11-03T16:56:36.634974Z node 1 :PQ_PARTITION_CHOOSER TRACE: partition_chooser_impl__old_chooser_actor.h:113: TPartitionChooser [1:7568544109252344735:2459] (SourceId=src, PreferedPartition=(NULL)) OnPartitionChosen
2025-11-03T16:56:36.634997Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7568544109252344735:2459] (SourceId=src, PreferedPartition=(NULL)) Update the table
2025-11-03T16:56:36.635271Z node 1 :PQ_PARTITION_CHOOSER TRACE: partition_chooser_impl__abstract_chooser_actor.h:212: StateUpdate, received event# 269877763, Sender [1:7568544109252344772:2459], Recipient [1:7568544109252344735:2459]: NKikimr::TEvTabletPipe::TEvClientDestroyed { TabletId: 72075186224037893 ClientId: [1:7568544109252344772:2459] ServerId: [1:7568544109252344773:3347] }
2025-11-03T16:56:36.640083Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1659: [72075186224037893][rt3.dc2--test-topic] pipe [1:7568544109252344772:2459] disconnected.
2025-11-03T16:56:36.640133Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1670: [72075186224037893][rt3.dc2--test-topic] pipe [1:7568544109252344772:2459] disconnected; active server actors: 1
2025-11-03T16:56:36.640155Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1695: [72075186224037893][rt3.dc2--test-topic] pipe [1:7568544109252344772:2459] disconnected no session
2025-11-03T16:56:36.685706Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:36.685768Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:36.685787Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:36.685816Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:36.685828Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:36.685839Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:36.685859Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:36.685914Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:36.685927Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:36.685946Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:36.754090Z node 1 :PQ_PARTITION_CHOOSER TRACE: partition_chooser_impl__abstract_chooser_actor.h:212: StateUpdate, received event# 271646721, Sender [1:7568544053417768053:2268], Recipient [1:7568544109252344735:2459]: NKikimrKqp.TEvQueryResponse Response { SessionId: "ydb://session/3?node_id=1&id=ZTU0MWIwNDItZWMxYWY1NzQtM2IwNjEyNDYtOGUzNDkwNWU=" PreparedQuery: "34f6fc20-f975aeb1-f34c103e-7f2bd9da" QueryParameters { Name: "$AccessTime" Type { Kind: Data Data { Scheme: 4 } } } QueryParameters { Name: "$CreateTime" Type { Kind: Data Data { Scheme: 4 } } } QueryParameters { Name: "$Hash" Type { Kind: Data Data { Scheme: 2 } } } QueryParameters { Name: "$Partition" Type { Kind: Data Data { Scheme: 2 } } } QueryParameters { Name: "$SeqNo" Type { Kind: Data Data { Scheme: 4 } } } QueryParameters { Name: "$SourceId" Type { Kind: Data Data { Scheme: 4608 } } } QueryParameters { Name: "$Topic" Type { Kind: Data Data { Scheme: 4608 } } } TxMeta { } QueryDiagnostics: "" } YdbStatus: SUCCESS ConsumedRu: 65
2025-11-03T16:56:36.754147Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7568544109252344735:2459] (SourceId=src, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-11-03T16:56:36.754176Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7568544109252344735:2459] (SourceId=src, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-11-03T16:56:36.754197Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7568544109252344735:2459] (SourceId=src, PreferedPartition=(NULL)) Start idle
2025-11-03T16:56:36.756314Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-11-03T16:56:36.757533Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 269877761, Sender [2:7568544108397207349:2421], Recipient [2:7568544108397207262:2383]: NKikimr::TEvTabletPipe::TEvServerConnected
2025-11-03T16:56:36.757578Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5330: HandleHook, processing event TEvTabletPipe::TEvServerConnected
2025-11-03T16:56:36.757591Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:2716: [PQ: 72075186224037892] Handle TEvTabletPipe::TEvServerConnected
2025-11-03T16:56:36.757618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [1:7568544109252344797:2459], now have 1 active actors on pipe
2025-11-03T16:56:36.757634Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1
2025-11-03T16:56:36.758115Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271187968, Sender [1:7568544109252344796:2459], Recipient [2:7568544108397207349:2421]
2025-11-03T16:56:36.758144Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5316: HandleHook, processing event TEvPersQueue::TEvRequest
2025-11-03T16:56:36.758236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc2--test-topic' requestId: <none>
2025-11-03T16:56:36.758267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc2--test-topic' partition 0
2025-11-03T16:56:36.758347Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188498 (NKikimr::TEvPQ::TEvChangeOwner), Tablet [2:7568544108397207262:2383], Partition 0, Sender [2:7568544108397207262:2383], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:36.758385Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188498, Sender [2:7568544108397207262:2383], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvChangeOwner
2025-11-03T16:56:36.758414Z node 2 :PERSQUEUE TRACE: partition.h:642: StateIdle, processing event TEvPQ::TEvChangeOwner
2025-11-03T16:56:36.758445Z node 2 :PERSQUEUE TRACE: partition_write.cpp:154: [72075186224037892][Partition][0][StateIdle] TPartition::HandleOnWrite TEvChangeOwner.
2025-11-03T16:56:36.758477Z node 2 :PERSQUEUE TRACE: partition_write.cpp:873: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessChangeOwnerRequests.
2025-11-03T16:56:36.758491Z node 2 :PERSQUEUE TRACE: partition_write.cpp:107: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessChangeOwnerRequest.
2025-11-03T16:56:36.758544Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src|e0469af1-9a9fa7e1-ce36600e-f096a41c_0 generated for partition 0 topic 'rt3.dc2--test-topic' owner src
2025-11-03T16:56:36.758582Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:36.758612Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:36.758642Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:36.758653Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-03T16:56:36.758710Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:36.758735Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:36.758812Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:36.758831Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:36.758853Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:36.758875Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=1
2025-11-03T16:56:36.758901Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-03T16:56:36.758969Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188562 (NKikimr::TEvPQ::TEvTxBatchComplete), Tablet [2:7568544108397207262:2383], Partition 0, Sender [2:7568544108397207303:2383], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:36.759011Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188562, Sender [2:7568544108397207303:2383], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvTxBatchComplete
2025-11-03T16:56:36.759049Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271188493, Sender [2:7568544108397207303:2383], Recipient [2:7568544108397207262:2383]: NKikimr::TEvPQ::TEvProxyResponse
2025-11-03T16:56:36.759070Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5335: HandleHook, processing event TEvPQ::TEvProxyResponse
2025-11-03T16:56:36.759095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc2--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-03T16:56:36.759636Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271187968, Sender [1:7568544109252344796:2459], Recipient [2:7568544108397207349:2421]
2025-11-03T16:56:36.759655Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5316: HandleHook, processing event TEvPersQueue::TEvRequest
2025-11-03T16:56:36.759693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc2--test-topic' requestId: <none>
2025-11-03T16:56:36.759710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc2--test-topic' partition 0
2025-11-03T16:56:36.759784Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188486 (NKikimr::TEvPQ::TEvGetMaxSeqNoRequest), Tablet [2:7568544108397207262:2383], Partition 0, Sender [2:7568544108397207262:2383], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:36.759819Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188486, Sender [2:7568544108397207262:2383], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvGetMaxSeqNoRequest
2025-11-03T16:56:36.759835Z node 2 :PERSQUEUE TRACE: partition.h:634: StateIdle, processing event TEvPQ::TEvGetMaxSeqNoRequest
2025-11-03T16:56:36.759883Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271188493, Sender [2:7568544108397207303:2383], Recipient [2:7568544108397207262:2383]: NKikimr::TEvPQ::TEvProxyResponse
2025-11-03T16:56:36.759893Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5335: HandleHook, processing event TEvPQ::TEvProxyResponse
2025-11-03T16:56:36.759925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc2--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-03T16:56:36.760528Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1 partition: 0 MaxSeqNo: 0 sessionId: src|e0469af1-9a9fa7e1-ce36600e-f096a41c_0
2025-11-03T16:56:36.764452Z :INFO: [] MessageGroupId [src] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1762188996764 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-11-03T16:56:36.764577Z :INFO: [] MessageGroupId [src] SessionId [] Write session established. Init response: session_id: "src|e0469af1-9a9fa7e1-ce36600e-f096a41c_0" topic: "test-topic" cluster: "dc2" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-11-03T16:56:36.766171Z :INFO: [] MessageGroupId [src] SessionId [src|e0469af1-9a9fa7e1-ce36600e-f096a41c_0] Write session: close. Timeout = 0 ms
2025-11-03T16:56:36.766221Z :INFO: [] MessageGroupId [src] SessionId [src|e0469af1-9a9fa7e1-ce36600e-f096a41c_0] Write session will now close
2025-11-03T16:56:36.766257Z :DEBUG: [] MessageGroupId [src] SessionId [src|e0469af1-9a9fa7e1-ce36600e-f096a41c_0] Write session: aborting
2025-11-03T16:56:36.766684Z :INFO: [] MessageGroupId [src] SessionId [src|e0469af1-9a9fa7e1-ce36600e-f096a41c_0] Write session: gracefully shut down, all writes complete
2025-11-03T16:56:36.766725Z :DEBUG: [] MessageGroupId [src] SessionId [src|e0469af1-9a9fa7e1-ce36600e-f096a41c_0] Write session: destroy
2025-11-03T16:56:36.786277Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:36.786344Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:36.786375Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:36.786404Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:36.786416Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:36.786425Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:36.786454Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:36.786509Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:36.786520Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:36.786539Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:36.786611Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 269877764, Sender [2:7568544108397207349:2421], Recipient [2:7568544108397207262:2383]: NKikimr::TEvTabletPipe::TEvServerDisconnected
2025-11-03T16:56:36.786638Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5331: HandleHook, processing event TEvTabletPipe::TEvServerDisconnected
2025-11-03T16:56:36.786655Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:2729: [PQ: 72075186224037892] Handle TEvTabletPipe::TEvServerDisconnected
2025-11-03T16:56:36.786684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [1:7568544109252344797:2459] destroyed
2025-11-03T16:56:36.786729Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188506 (NKikimr::TEvPQ::TEvPipeDisconnected), Tablet [2:7568544108397207262:2383], Partition 0, Sender [2:7568544108397207262:2383], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:36.786758Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188506, Sender [2:7568544108397207262:2383], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvPipeDisconnected
2025-11-03T16:56:36.786774Z node 2 :PERSQUEUE TRACE: partition.h:651: StateIdle, processing event TEvPQ::TEvPipeDisconnected
2025-11-03T16:56:36.786792Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-11-03T16:56:36.786836Z node 2 :PERSQUEUE TRACE: partition_write.cpp:873: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessChangeOwnerRequests.
2025-11-03T16:56:36.786856Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:36.786870Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:36.786883Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:36.786897Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:36.786938Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:36.786952Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:36.786973Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:36.768238Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId: src|e0469af1-9a9fa7e1-ce36600e-f096a41c_0 grpc read done: success: 0 data: 
2025-11-03T16:56:36.768266Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 1 sessionId: src|e0469af1-9a9fa7e1-ce36600e-f096a41c_0 grpc read failed
2025-11-03T16:56:36.768302Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 1 sessionId: src|e0469af1-9a9fa7e1-ce36600e-f096a41c_0 grpc closed
2025-11-03T16:56:36.768319Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1 sessionId: src|e0469af1-9a9fa7e1-ce36600e-f096a41c_0 is DEAD
2025-11-03T16:56:36.784616Z node 1 :PQ_PARTITION_CHOOSER TRACE: partition_chooser_impl__abstract_chooser_actor.h:278: StateIdle, received event# 65543, Sender [1:7568544109252344733:2459], Recipient [1:7568544109252344735:2459]: NActors::TEvents::TEvPoison
2025-11-03T16:56:36.784676Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-11-03T16:56:36.892183Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:36.892255Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:36.892273Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:36.892304Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:36.892315Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:36.892324Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:36.892345Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:36.892402Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:36.892413Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:36.892430Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:36.993237Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:36.999119Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:36.999157Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:36.999191Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:36.999204Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:36.999214Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:36.999235Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:36.999293Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:36.999305Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:36.999327Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:37.100952Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:37.101013Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:37.101033Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:37.101065Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:37.101076Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:37.101084Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:37.101102Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:37.101158Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:37.101169Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:37.101188Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:37.204303Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:37.204380Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:37.204398Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:37.204428Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:37.204440Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:37.204450Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:37.204470Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:37.204530Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:37.204542Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:37.204561Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:37.284305Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188544 (NKikimr::NPQ::NReadQuoterEvents::TEvQuotaCountersUpdated), Tablet [2:7568544108397207262:2383], Partition 0, Sender [2:7568544108397207306:2383], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:37.284364Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188544, Sender [2:7568544108397207306:2383], Recipient [2:7568544108397207303:2383]: NKikimr::NPQ::NReadQuoterEvents::TEvQuotaCountersUpdated
2025-11-03T16:56:37.284388Z node 2 :PERSQUEUE TRACE: partition.h:671: StateIdle, processing event NReadQuoterEvents::TEvQuotaCountersUpdated
2025-11-03T16:56:37.305295Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:37.305368Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:37.305388Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:37.305444Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:37.305455Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:37.305464Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:37.305484Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:37.305539Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:37.305550Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:37.305568Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:37.406826Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:37.406898Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:37.406917Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:37.406946Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:37.406957Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:37.406967Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:37.406987Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:37.407040Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:37.407051Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:37.407070Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:37.507170Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:37.507236Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:37.507258Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:37.507289Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:37.507304Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:37.507315Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:37.507346Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:37.507408Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:37.507419Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:37.507439Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:37.610402Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:37.610464Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:37.610485Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:37.610516Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:37.610529Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:37.610538Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:37.610556Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:37.610610Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:37.610624Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:37.610640Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:37.712113Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:37.712174Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:37.712193Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:37.712222Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:37.712233Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:37.712243Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:37.712262Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:37.712319Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:37.712331Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:37.712349Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:37.816119Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:37.816183Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:37.816202Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:37.816228Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:37.816240Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:37.816249Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:37.816268Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:37.816323Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:37.816335Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:37.816355Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:37.831065Z node 3 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[3:7568544115039159394:2155];send_to=[0:7307199536658146131:7762515];
2025-11-03T16:56:37.831435Z node 3 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
2025-11-03T16:56:37.838184Z node 3 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:123: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, got undelivered to scheme cache: ActorUnknown
2025-11-03T16:56:37.841825Z node 3 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-11-03T16:56:37.843669Z node 4 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[4:7568544115031613383:2077];send_to=[0:7307199536658146131:7762515];
test_client.cpp: SetPath # /home/runner/.ya/build/build_root/7jz3/00196f/r3tmp/tmpXEHU0A/pdisk_1.dat
2025-11-03T16:56:37.875655Z node 4 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
2025-11-03T16:56:37.882191Z node 4 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-11-03T16:56:37.883203Z node 4 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-11-03T16:56:37.895322Z node 3 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-11-03T16:56:37.919102Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:37.919162Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:37.919180Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:37.919208Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:37.919218Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:37.919227Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:37.919246Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:37.919298Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:37.919309Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:37.919328Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:37.983577Z node 3 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
2025-11-03T16:56:38.020274Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:38.020319Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:38.020333Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:38.020364Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:38.020373Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:38.020379Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:38.020395Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:38.020440Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:38.020448Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:38.055270Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:38.055320Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(3, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-11-03T16:56:38.055418Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(3, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-11-03T16:56:38.057049Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(4, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-11-03T16:56:38.057139Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(4, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-11-03T16:56:38.067045Z node 3 :HIVE WARN: hive_impl.cpp:811: HIVE#72057594037968897 Handle TEvInterconnect::TEvNodeConnected, NodeId 4 Cookie 4
2025-11-03T16:56:38.067357Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(3, (0,0,0,0)) VolatileState: Connecting -> Connected
2025-11-03T16:56:38.068015Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(4, (0,0,0,0)) VolatileState: Connecting -> Connected
TServer::EnableGrpc on GrpcPort 13111, node 3
2025-11-03T16:56:38.124012Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:38.124073Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:38.124094Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:38.124128Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:38.124166Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:38.124177Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:38.124196Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:38.124250Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:38.124263Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:38.124281Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:38.136357Z node 4 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-11-03T16:56:38.144175Z node 3 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-11-03T16:56:38.144761Z node 3 :NET_CLASSIFIER WARN: net_classifier.cpp:190: distributable config is empty, broken or outdated, will use file: /home/runner/.ya/build/build_root/7jz3/00196f/r3tmp/yandexZl7EP6.tmp
2025-11-03T16:56:38.144775Z node 3 :NET_CLASSIFIER WARN: net_classifier.cpp:196: will try to initialize from file: /home/runner/.ya/build/build_root/7jz3/00196f/r3tmp/yandexZl7EP6.tmp
2025-11-03T16:56:38.144907Z node 3 :NET_CLASSIFIER WARN: net_classifier.cpp:202: successfully initialized from file: /home/runner/.ya/build/build_root/7jz3/00196f/r3tmp/yandexZl7EP6.tmp
2025-11-03T16:56:38.145047Z node 3 :NET_CLASSIFIER ERROR: net_classifier.cpp:228: got bad distributable configuration
2025-11-03T16:56:38.179392Z INFO: TTestServer started on Port 4042 GrpcPort 13111
2025-11-03T16:56:38.225181Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:38.225248Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:38.225268Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:38.225331Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:38.225345Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:38.225355Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:38.225374Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:38.225455Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:38.225473Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:38.225492Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:38.284709Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188544 (NKikimr::NPQ::NReadQuoterEvents::TEvQuotaCountersUpdated), Tablet [2:7568544108397207262:2383], Partition 0, Sender [2:7568544108397207306:2383], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:38.284770Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188544, Sender [2:7568544108397207306:2383], Recipient [2:7568544108397207303:2383]: NKikimr::NPQ::NReadQuoterEvents::TEvQuotaCountersUpdated
2025-11-03T16:56:38.284790Z node 2 :PERSQUEUE TRACE: partition.h:671: StateIdle, processing event NReadQuoterEvents::TEvQuotaCountersUpdated
2025-11-03T16:56:38.326921Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:38.326988Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:38.327011Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:38.327051Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:38.327065Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:38.327076Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:38.327096Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:38.327155Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:38.327168Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:38.327189Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
TClient is connected to server localhost:4042
2025-11-03T16:56:38.400892Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard_impl.cpp:7727: Cannot get console configs
2025-11-03T16:56:38.400926Z node 1 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
PQClient connected to localhost:13111
WaitRootIsUp 'Root'...
TClient::Ls request: Root
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "Root"
    PathId: 1
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 1
    CreateStep: 0
    ParentPathId: 1
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 1
      SubDomainVersion: 0
      SecurityStateVersion: 0
    }
    ChildrenExist: false
  }
  Children {
    Name: ".sys"
    PathId: 18446744073709551615
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 0
    CreateStep: 0
    ParentPathId: 18446744073709551615
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 0
      Pl...
(TRUNCATED)
WaitRootIsUp 'Root' success.
2025-11-03T16:56:38.427431Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:38.427498Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:38.427519Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:38.427550Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:38.427563Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:38.427574Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:38.427593Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:38.427653Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:38.427668Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:38.427686Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:38.428556Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpAlterSubDomain, opId: 281474976720657:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_alter_subdomain.cpp:311)
waiting...
waiting...
waiting...
waiting...
2025-11-03T16:56:38.528159Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:38.528228Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:38.528251Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:38.528280Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:38.528293Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:38.528305Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:38.528327Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:38.528388Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:38.528402Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:38.528421Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:38.628278Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:38.628345Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:38.628367Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:38.628425Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:38.628454Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:38.628464Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:38.628485Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:38.628540Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:38.628561Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:38.628593Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:38.728725Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:38.728788Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:38.728812Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:38.728846Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:38.728861Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:38.728873Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:38.728911Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:38.729011Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:38.729035Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:38.729065Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:38.831895Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:38.831951Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:38.831972Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:38.832017Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:38.832030Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:38.832040Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:38.832058Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:38.832106Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:38.832118Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:38.832142Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:38.832144Z node 3 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-11-03T16:56:38.877739Z node 4 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-11-03T16:56:38.932154Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:38.932223Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:38.932250Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:38.932279Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:38.932318Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:38.932344Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:38.932365Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:38.932422Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:38.932434Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:38.932455Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:39.033340Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:39.033430Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:39.033485Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:39.033518Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:39.033543Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:39.033556Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:39.033577Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:39.033644Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:39.033663Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:39.033684Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:39.133844Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:39.133949Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:39.133980Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:39.134010Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:39.134031Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:39.134045Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:39.134067Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:39.134126Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:39.134140Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:39.134160Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:39.234509Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:39.234581Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:39.234607Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:39.234675Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:39.234692Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:39.234705Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:39.234735Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:39.234830Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:39.234847Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:39.234869Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:39.290702Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188544 (NKikimr::NPQ::NReadQuoterEvents::TEvQuotaCountersUpdated), Tablet [2:7568544108397207262:2383], Partition 0, Sender [2:7568544108397207306:2383], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:39.290799Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188544, Sender [2:7568544108397207306:2383], Recipient [2:7568544108397207303:2383]: NKikimr::NPQ::NReadQuoterEvents::TEvQuotaCountersUpdated
2025-11-03T16:56:39.290858Z node 2 :PERSQUEUE TRACE: partition.h:671: StateIdle, processing event NReadQuoterEvents::TEvQuotaCountersUpdated
2025-11-03T16:56:39.336552Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:39.336628Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:39.336651Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:39.336698Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:39.336712Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:39.336722Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:39.336751Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:39.336840Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:39.336855Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:39.336886Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:39.440170Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:39.440249Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:39.440272Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:39.440305Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:39.440322Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:39.440347Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:39.440383Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:39.440452Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:39.440474Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:39.440505Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:39.544895Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:39.544962Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:39.544985Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:39.545014Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:39.545031Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:39.545040Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:39.545060Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:39.545115Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:39.545127Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:39.545166Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:39.647381Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:39.647455Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:39.647482Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:39.647514Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:39.647541Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:39.647553Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:39.647574Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:39.647633Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:39.647644Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:39.647694Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:39.751455Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:39.751521Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:39.751540Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:39.751568Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:39.751584Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:39.751601Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:39.751639Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:39.751706Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:39.751718Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:39.751737Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:39.851919Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:39.851995Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:39.852017Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:39.852045Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:39.852058Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:39.852070Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:39.852098Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:39.852174Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:39.852219Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:39.852245Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:39.960209Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:39.960295Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:39.960329Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:39.960358Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:39.960373Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:39.960386Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:39.960410Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:39.960470Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:39.960484Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:39.960504Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:40.062079Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:40.062155Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:40.062179Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:40.062204Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:40.062216Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:40.062232Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:40.062270Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:40.062319Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:40.062330Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:40.062349Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:40.165965Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:40.166049Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:40.166076Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:40.166104Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:40.166118Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:40.166129Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:40.166156Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:40.166213Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:40.166225Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:40.166246Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:40.264540Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:40.264611Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:40.264633Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:40.264659Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:40.264672Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:40.264683Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:40.264701Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:40.264750Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:40.264763Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:40.264782Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:40.287743Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188544 (NKikimr::NPQ::NReadQuoterEvents::TEvQuotaCountersUpdated), Tablet [2:7568544108397207262:2383], Partition 0, Sender [2:7568544108397207306:2383], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:40.287811Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188544, Sender [2:7568544108397207306:2383], Recipient [2:7568544108397207303:2383]: NKikimr::NPQ::NReadQuoterEvents::TEvQuotaCountersUpdated
2025-11-03T16:56:40.287831Z node 2 :PERSQUEUE TRACE: partition.h:671: StateIdle, processing event NReadQuoterEvents::TEvQuotaCountersUpdated
2025-11-03T16:56:40.364911Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:40.364974Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:40.364998Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:40.365024Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:40.365038Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:40.365049Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:40.365069Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:40.365150Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:40.365165Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:40.365197Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:40.468104Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:40.468205Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:40.468326Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:40.468353Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:40.468365Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:40.468375Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:40.468400Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:40.468456Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:40.468468Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:40.468484Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:40.572138Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:40.572222Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:40.572246Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:40.572277Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:40.572291Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:40.572304Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:40.572325Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:40.572378Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:40.572392Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:40.572412Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:40.676118Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:40.676180Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:40.676205Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:40.676232Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:40.676245Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:40.676255Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:40.676281Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:40.676338Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:40.676351Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:40.676370Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:40.773407Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:40.773476Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:40.773498Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:40.773528Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:40.773541Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:40.773552Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:40.773571Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:40.773623Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:40.773636Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:40.773655Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:40.880141Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:40.880205Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:40.880228Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:40.880255Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:40.880268Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:40.880279Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:40.880306Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:40.880359Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:40.880371Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:40.880390Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:40.980413Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:40.980479Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:40.980504Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:40.980535Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:40.980549Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:40.980561Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:40.980583Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:40.980641Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:40.980666Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:40.980686Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:41.084024Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:41.084096Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:41.084122Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:41.084155Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:41.084173Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:41.084185Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:41.084206Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:41.084263Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:41.084275Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:41.084295Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:41.186941Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:41.187011Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:41.187034Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:41.187064Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:41.187077Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:41.187087Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:41.187111Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:41.187172Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:41.187185Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:41.187205Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:41.243564Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 65538, Sender [0:0:0], Recipient [2:7568544108397207262:2383]: NActors::TEvents::TEvWakeup
2025-11-03T16:56:41.284161Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 65538 (NActors::TEvents::TEvWakeup), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:41.284249Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 65538, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NActors::TEvents::TEvWakeup
2025-11-03T16:56:41.284434Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:183: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:56:41.284508Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271188501, Sender [2:7568544108397207303:2383], Recipient [2:7568544108397207262:2383]: NKikimr::TEvPQ::TEvPartitionCounters
2025-11-03T16:56:41.284534Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5324: HandleHook, processing event TEvPQ::TEvPartitionCounters
2025-11-03T16:56:41.284550Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:1078: [PQ: 72075186224037892] Handle TEvPQ::TEvPartitionCounters PartitionId 0
2025-11-03T16:56:41.284760Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271188503, Sender [2:7568544108397207303:2383], Recipient [2:7568544108397207262:2383]: NKikimr::TEvPQ::TEvPartitionLabeledCounters
2025-11-03T16:56:41.284777Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5326: HandleHook, processing event TEvPQ::TEvPartitionLabeledCounters
2025-11-03T16:56:41.288106Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:41.288166Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:41.288187Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:41.288217Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:41.288230Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:41.288241Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:41.288274Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:41.288334Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:41.288344Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:41.288361Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:41.288429Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188544 (NKikimr::NPQ::NReadQuoterEvents::TEvQuotaCountersUpdated), Tablet [2:7568544108397207262:2383], Partition 0, Sender [2:7568544108397207306:2383], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:41.288455Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188544, Sender [2:7568544108397207306:2383], Recipient [2:7568544108397207303:2383]: NKikimr::NPQ::NReadQuoterEvents::TEvQuotaCountersUpdated
2025-11-03T16:56:41.288472Z node 2 :PERSQUEUE TRACE: partition.h:671: StateIdle, processing event NReadQuoterEvents::TEvQuotaCountersUpdated
2025-11-03T16:56:41.388098Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:41.388159Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:41.388183Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:41.388214Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:41.388227Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:41.388238Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:41.388273Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:41.388335Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:41.388347Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:41.388366Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:41.488334Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:41.488405Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:41.488427Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:41.488457Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:41.488470Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:41.488481Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:41.488503Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:41.488562Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:41.488575Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:41.488597Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:41.588654Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:41.588724Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:41.588745Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:41.588773Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:41.588785Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:41.588796Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:41.588815Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:41.588865Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:41.588876Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:41.588893Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:41.692141Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:41.692210Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:41.692233Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:41.692267Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:41.692280Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:41.692292Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:41.692314Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:41.692384Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:41.692399Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:41.692418Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:41.796144Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:41.796209Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:41.796230Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:41.796261Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:41.796274Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:41.796285Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:41.796308Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:41.796361Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:41.796375Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:41.796395Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:41.896349Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:41.896397Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:41.896413Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:41.896439Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:41.896449Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:41.896456Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:41.896470Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:41.896511Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:41.896520Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:41.896534Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:41.997818Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:41.997865Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:41.997882Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:41.997905Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:41.997914Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:41.997922Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:41.997938Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:41.997983Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:41.997992Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:41.998005Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:42.102634Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:42.102680Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:42.102697Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:42.102720Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:42.102730Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:42.102738Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:42.102753Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:42.102793Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:42.102802Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:42.102816Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:42.204869Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:42.204942Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:42.204966Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:42.205001Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:42.205014Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:42.205026Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:42.205049Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:42.205112Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:42.205122Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:42.205145Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:42.290050Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188544 (NKikimr::NPQ::NReadQuoterEvents::TEvQuotaCountersUpdated), Tablet [2:7568544108397207262:2383], Partition 0, Sender [2:7568544108397207306:2383], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:42.290117Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188544, Sender [2:7568544108397207306:2383], Recipient [2:7568544108397207303:2383]: NKikimr::NPQ::NReadQuoterEvents::TEvQuotaCountersUpdated
2025-11-03T16:56:42.290146Z node 2 :PERSQUEUE TRACE: partition.h:671: StateIdle, processing event NReadQuoterEvents::TEvQuotaCountersUpdated
2025-11-03T16:56:42.290575Z node 4 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [4:7568544136506450201:2303], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-03T16:56:42.290644Z node 4 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [4:7568544136506450185:2300], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-03T16:56:42.290711Z node 4 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-03T16:56:42.290955Z node 4 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [4:7568544136506450208:2305], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-03T16:56:42.291005Z node 4 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-03T16:56:42.299337Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateResourcePool, opId: 281474976715657:3, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_resource_pool.cpp:179)
2025-11-03T16:56:42.306048Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:42.306110Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:42.306130Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:42.306160Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:42.306188Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:42.306200Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:42.306221Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:42.306285Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:42.306298Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:42.306316Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:42.328630Z node 4 :KQP_WORKLOAD_SERVICE WARN: helpers.h:73: [WorkloadService] [TPoolCreatorActor] ActorId: [4:7568544136506450207:2304], DatabaseId: /Root, PoolId: default, Scheduled retry for error: { <main>: Error: Transaction 281474976715657 completed, doublechecking }
2025-11-03T16:56:42.406439Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:42.406511Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:42.406537Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:42.406567Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:42.406579Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:42.406589Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:42.406611Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:42.406690Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:42.406710Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:42.406729Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:42.419748Z node 4 :TX_PROXY ERROR: schemereq.cpp:593: Actor# [4:7568544136506450237:2142] txid# 281474976715658, issues: { message: "Check failed: path: \'/Root/.metadata/workload_manager/pools/default\', error: path exist, request accepts it (id: [OwnerId: 72057594046644480, LocalPathId: 8], type: EPathTypeResourcePool, state: EPathStateNoChanges)" severity: 1 }
2025-11-03T16:56:42.508117Z node 4 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:570: Compilation failed, self: [4:7568544136506450244:2309], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-11-03T16:56:42.508375Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:42.508457Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:42.508490Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:42.508528Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:42.508543Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:42.508555Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:42.508575Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:42.508633Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:42.508658Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:42.508681Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:42.510409Z node 4 :KQP_SESSION WARN: kqp_session_actor.cpp:2506: SessionId: ydb://session/3?node_id=4&id=YWQ5MTI3MTUtNTcyYzMyMGYtYzBlYzFhNWQtNmZkZjhhZjM=, ActorId: [4:7568544136506450177:2299], ActorState: ExecuteState, TraceId: 01k95achhgcjtvxe44rx5b07cz, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-11-03T16:56:42.510874Z node 4 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-11-03T16:56:42.514349Z node 3 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:570: Compilation failed, self: [3:7568544136513996830:2334], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-11-03T16:56:42.516722Z node 3 :KQP_SESSION WARN: kqp_session_actor.cpp:2506: SessionId: ydb://session/3?node_id=3&id=YjYwNDVkOGQtMjZmYzVmYjItMTUyZGFmY2ItZThkNzA3MGQ=, ActorId: [3:7568544136513996800:2326], ActorState: ExecuteState, TraceId: 01k95achp60rgw294d5yy207zz, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-11-03T16:56:42.517155Z node 3 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-11-03T16:56:42.528098Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720661:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:690)
2025-11-03T16:56:42.608998Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:42.609059Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:42.609081Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:42.609111Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:42.609124Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:42.609135Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:42.609155Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:42.609210Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:42.609231Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:42.609251Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:42.659193Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720662:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:690)
2025-11-03T16:56:42.709417Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:42.709484Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:42.709506Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:42.709534Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:42.709547Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:42.709559Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:42.709580Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:42.709630Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:42.709644Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:42.709662Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:42.816943Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:42.817006Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:42.817027Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:42.817060Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:42.817073Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:42.817084Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:42.817103Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:42.817155Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:42.817168Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:42.817196Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:42.832302Z node 3 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[3:7568544115039159394:2155];send_to=[0:7307199536658146131:7762515];
2025-11-03T16:56:42.832369Z node 3 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
2025-11-03T16:56:42.833686Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720663:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:690)
2025-11-03T16:56:42.842643Z node 4 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[4:7568544115031613383:2077];send_to=[0:7307199536658146131:7762515];
2025-11-03T16:56:42.842705Z node 4 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
2025-11-03T16:56:42.916800Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:42.916909Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:42.916930Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:42.916957Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:42.916969Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:42.916979Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:42.916999Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:42.917070Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:42.917082Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:42.917103Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
=== Init DC: UPSERT INTO `/Root/PQ/Config/V2/Cluster` (name, balancer, local, enabled, weight) VALUES ("dc1", "localhost:13111", true, true, 1000), ("dc2", "localhost:14811", false, true, 1000);
2025-11-03T16:56:43.019579Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:43.019645Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:43.019665Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:43.019699Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:43.019713Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:43.019724Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:43.019743Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:43.019796Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:43.019806Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:43.019824Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:43.121847Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:43.121915Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:43.121974Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:43.122034Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:43.122050Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:43.122060Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:43.122080Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:43.122131Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:43.122143Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:43.122160Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:43.224355Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:43.224441Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:43.224479Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:43.224512Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:43.224535Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:43.224547Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:43.224569Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:43.224650Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:43.224670Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:43.224690Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:43.275727Z node 3 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976720664. Ctx: { TraceId: 01k95acj8y0s5h219qqg291215, Database: , SessionId: ydb://session/3?node_id=3&id=YjkwNWJkYWItZGU0MDMwZDgtMzY2MDE2YmEtZjlhM2JlZGY=, PoolId: default, DatabaseId: /Root}. Database not set, use /Root
2025-11-03T16:56:43.291716Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188544 (NKikimr::NPQ::NReadQuoterEvents::TEvQuotaCountersUpdated), Tablet [2:7568544108397207262:2383], Partition 0, Sender [2:7568544108397207306:2383], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:43.291771Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188544, Sender [2:7568544108397207306:2383], Recipient [2:7568544108397207303:2383]: NKikimr::NPQ::NReadQuoterEvents::TEvQuotaCountersUpdated
2025-11-03T16:56:43.291789Z node 2 :PERSQUEUE TRACE: partition.h:671: StateIdle, processing event NReadQuoterEvents::TEvQuotaCountersUpdated
=== CheckClustersList. Subcribe to ClusterTracker from [3:7568544140808964545:2979] 
2025-11-03T16:56:43.325510Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:43.325593Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:43.325629Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:43.325660Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:43.325672Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:43.325681Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:43.325699Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:43.325749Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:43.325760Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:43.325778Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:43.427108Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:43.427167Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:43.427185Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:43.427212Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:43.427223Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:43.427232Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:43.427248Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:43.427301Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:43.427319Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:43.427338Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:43.532656Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:43.532724Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:43.532748Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:43.532781Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:43.532799Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:43.532811Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:43.532832Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:43.532893Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:43.532908Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:43.532931Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:43.636385Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:43.636455Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:43.636478Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:43.636546Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:43.636561Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:43.636572Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:43.636593Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:43.636654Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:43.636665Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:43.636685Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:43.739804Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:43.739870Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:43.739890Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:43.739914Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:43.739926Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:43.739936Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:43.739955Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:43.740027Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:43.740041Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:43.740059Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:43.840966Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:43.841016Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:43.841032Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:43.841052Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:43.841062Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:43.841070Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:43.841083Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:43.841124Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:43.841133Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:43.841147Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:43.941596Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:43.941678Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:43.941705Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:43.941736Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:43.941749Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:43.941760Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:43.941783Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:43.941844Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:43.941856Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:43.941877Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:44.042806Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:44.042898Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:44.042916Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:44.042940Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:44.042949Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:44.042956Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:44.042971Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:44.043027Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:44.043038Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:44.043055Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:44.146298Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:44.146365Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:44.146392Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:44.146424Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:44.146439Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:44.146452Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:44.146474Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:44.146532Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:44.146545Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:44.146566Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:44.247216Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:44.247288Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:44.247313Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:44.247350Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:44.247366Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:44.247376Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:44.247399Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:44.247454Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:44.247467Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:44.247486Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:44.291991Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188544 (NKikimr::NPQ::NReadQuoterEvents::TEvQuotaCountersUpdated), Tablet [2:7568544108397207262:2383], Partition 0, Sender [2:7568544108397207306:2383], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:44.292050Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188544, Sender [2:7568544108397207306:2383], Recipient [2:7568544108397207303:2383]: NKikimr::NPQ::NReadQuoterEvents::TEvQuotaCountersUpdated
2025-11-03T16:56:44.292071Z node 2 :PERSQUEUE TRACE: partition.h:671: StateIdle, processing event NReadQuoterEvents::TEvQuotaCountersUpdated
2025-11-03T16:56:44.349563Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:44.349643Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:44.349677Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:44.349708Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:44.349722Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:44.349741Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:44.349762Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:44.349830Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:44.349843Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:44.349864Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:44.453587Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:44.453654Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:44.453674Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:44.453720Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:44.453732Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:44.453743Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:44.453773Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:44.453836Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:44.453848Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:44.453867Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:44.553132Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:44.553233Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:44.553256Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:44.553286Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:44.553299Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:44.553309Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:44.553330Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:44.553390Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:44.553422Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:44.553441Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:44.653518Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:44.653585Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:44.653606Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:44.653670Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:44.653685Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:44.653697Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:44.653719Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:44.653776Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:44.653787Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:44.653820Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:44.756587Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:44.756651Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:44.756672Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:44.756702Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:44.756714Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:44.756725Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:44.756744Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:44.756802Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:44.756813Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:44.756832Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:44.860042Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:44.860108Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:44.860133Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:44.860166Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:44.860181Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:44.860192Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:44.860219Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:44.860281Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:44.860293Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:44.860313Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:44.964122Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:44.964189Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:44.964212Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:44.964244Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:44.964255Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:44.964266Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:44.964288Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:44.964347Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:44.964358Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:44.964377Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:45.065162Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:45.065224Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:45.065244Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:45.065271Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:45.065284Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:45.065295Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:45.065315Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:45.065370Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:45.065380Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:45.065400Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:45.165705Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:45.165776Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:45.165820Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:45.165849Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:45.165862Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:45.165871Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:45.165891Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:45.165950Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:45.165961Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:45.165980Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:45.268127Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:45.268192Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:45.268211Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:45.268236Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:45.268247Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:45.268257Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:45.268288Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:45.268343Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:45.268352Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:45.268370Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:45.296160Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188544 (NKikimr::NPQ::NReadQuoterEvents::TEvQuotaCountersUpdated), Tablet [2:7568544108397207262:2383], Partition 0, Sender [2:7568544108397207306:2383], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:45.296216Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188544, Sender [2:7568544108397207306:2383], Recipient [2:7568544108397207303:2383]: NKikimr::NPQ::NReadQuoterEvents::TEvQuotaCountersUpdated
2025-11-03T16:56:45.296236Z node 2 :PERSQUEUE TRACE: partition.h:671: StateIdle, processing event NReadQuoterEvents::TEvQuotaCountersUpdated
2025-11-03T16:56:45.368228Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:45.368292Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:45.368315Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:45.368345Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:45.368359Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:45.368379Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:45.368400Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:45.368458Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:45.368470Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:45.368488Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:45.469906Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:45.469980Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:45.470003Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:45.470032Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:45.470043Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:45.470052Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:45.470072Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:45.470131Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:45.470148Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:45.470167Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:45.570545Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:45.570621Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:45.570652Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:45.570692Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:45.570707Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:45.570717Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:45.570745Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:45.570829Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:45.570861Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:45.570893Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:45.670863Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:45.670932Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:45.670966Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:45.671008Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:45.671021Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:45.671030Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:45.671050Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:45.671113Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:45.671123Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:45.671144Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:45.771199Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:45.771251Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:45.771267Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:45.771291Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:45.771299Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:45.771306Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:45.771322Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:45.771365Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:45.771373Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:45.771386Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:45.871519Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:45.871582Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:45.871604Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:45.871632Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:45.871643Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:45.871652Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:45.871671Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:45.871711Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:45.871720Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:45.871736Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:45.974496Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:45.974559Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:45.974578Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:45.974604Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:45.974617Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:45.974629Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:45.974648Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:45.974714Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:45.974725Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:45.974744Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:46.074778Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:46.074854Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:46.074877Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:46.074906Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:46.074919Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:46.074930Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:46.074950Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:46.075025Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:46.075038Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:46.075058Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:46.176104Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:46.176175Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:46.176200Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:46.176237Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:46.176251Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:46.176265Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:46.176287Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:46.176349Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:46.176370Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:46.176404Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:46.232558Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 270794759, Sender [2:7568544108397207278:2384], Recipient [2:7568544108397207262:2383]: NKikimr::NKeyValue::TChannelBalancer::TEvUpdateWeights
2025-11-03T16:56:46.244579Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 65538, Sender [0:0:0], Recipient [2:7568544108397207262:2383]: NActors::TEvents::TEvWakeup
2025-11-03T16:56:46.276561Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:46.276631Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:46.276665Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:46.276698Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:46.276711Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:46.276722Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:46.276744Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:46.276804Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:46.276817Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:46.276838Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:46.285627Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 65538 (NActors::TEvents::TEvWakeup), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:46.285692Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 65538, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NActors::TEvents::TEvWakeup
2025-11-03T16:56:46.285883Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:183: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:56:46.286026Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271188501, Sender [2:7568544108397207303:2383], Recipient [2:7568544108397207262:2383]: NKikimr::TEvPQ::TEvPartitionCounters
2025-11-03T16:56:46.286057Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5324: HandleHook, processing event TEvPQ::TEvPartitionCounters
2025-11-03T16:56:46.286073Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:1078: [PQ: 72075186224037892] Handle TEvPQ::TEvPartitionCounters PartitionId 0
2025-11-03T16:56:46.286244Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271188503, Sender [2:7568544108397207303:2383], Recipient [2:7568544108397207262:2383]: NKikimr::TEvPQ::TEvPartitionLabeledCounters
2025-11-03T16:56:46.286258Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5326: HandleHook, processing event TEvPQ::TEvPartitionLabeledCounters
2025-11-03T16:56:46.298810Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188544 (NKikimr::NPQ::NReadQuoterEvents::TEvQuotaCountersUpdated), Tablet [2:7568544108397207262:2383], Partition 0, Sender [2:7568544108397207306:2383], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:46.298894Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188544, Sender [2:7568544108397207306:2383], Recipient [2:7568544108397207303:2383]: NKikimr::NPQ::NReadQuoterEvents::TEvQuotaCountersUpdated
2025-11-03T16:56:46.298918Z node 2 :PERSQUEUE TRACE: partition.h:671: StateIdle, processing event NReadQuoterEvents::TEvQuotaCountersUpdated
2025-11-03T16:56:46.377463Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:46.377533Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:46.377557Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:46.377589Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:46.377604Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:46.377614Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:46.377636Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:46.377700Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:46.377712Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:46.377734Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:46.480246Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:46.480317Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:46.480343Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:46.480381Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:46.480396Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:46.480409Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:46.480434Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:46.480495Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:46.480509Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:46.480536Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:46.578691Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:46.578758Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:46.578783Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:46.578814Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:46.578829Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:46.578856Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:46.578877Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:46.578942Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:46.578953Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:46.578974Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:46.679075Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:46.679156Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:46.679181Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:46.679208Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:46.679232Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:46.679244Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:46.679264Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:46.679335Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:46.679349Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:46.679367Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:46.779426Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:46.779487Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:46.779511Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:46.779539Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:46.779555Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:46.779579Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:46.779600Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:46.779667Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:46.779679Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:46.779700Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:46.880436Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:46.880500Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:46.880523Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:46.880553Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:46.880566Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:46.880578Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:46.880598Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:46.880652Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:46.880668Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:46.880688Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:46.980504Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:46.980569Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:46.980594Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:46.980623Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:46.980648Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:46.980661Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:46.980683Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:46.980741Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:46.980756Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:46.980789Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:47.081003Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:47.081072Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:47.081093Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:47.081125Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:47.081138Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:47.081149Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:47.081169Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:47.081229Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:47.081242Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:47.081261Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:47.182042Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:47.182107Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:47.182132Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:47.182165Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:47.182181Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:47.182193Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:47.182215Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:47.182280Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:47.182293Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:47.182317Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:47.282776Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:47.282856Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:47.282878Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:47.282911Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:47.282924Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:47.282936Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:47.282968Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:47.283035Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:47.283048Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:47.283067Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:47.299489Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188544 (NKikimr::NPQ::NReadQuoterEvents::TEvQuotaCountersUpdated), Tablet [2:7568544108397207262:2383], Partition 0, Sender [2:7568544108397207306:2383], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:47.299550Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188544, Sender [2:7568544108397207306:2383], Recipient [2:7568544108397207303:2383]: NKikimr::NPQ::NReadQuoterEvents::TEvQuotaCountersUpdated
2025-11-03T16:56:47.299571Z node 2 :PERSQUEUE TRACE: partition.h:671: StateIdle, processing event NReadQuoterEvents::TEvQuotaCountersUpdated
2025-11-03T16:56:47.383203Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:47.383278Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:47.383310Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:47.383339Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:47.383355Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:47.383370Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:47.383391Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:47.383448Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:47.383461Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:47.383480Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:47.483847Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:47.483922Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:47.483948Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:47.483993Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:47.484009Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:47.484020Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:47.484043Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:47.484099Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:47.484112Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:47.484137Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:47.588039Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:47.588108Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:47.588130Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:47.588164Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:47.588180Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:47.588192Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:47.588215Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:47.588272Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:47.588284Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:47.588304Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:47.691220Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:47.691288Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:47.691308Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:47.691338Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:47.691350Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:47.691362Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:47.691381Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:47.691440Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:47.691453Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:47.691471Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:47.792141Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:47.792211Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:47.792242Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:47.792272Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:47.792287Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:47.792298Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:47.792317Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:47.792374Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:47.792387Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:47.792408Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:47.892390Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:47.892461Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:47.892488Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:47.892522Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:47.892535Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:47.892546Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:47.892567Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:47.892632Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:47.892644Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:47.892662Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:47.992928Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:47.992990Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:47.993011Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:47.993036Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:47.993048Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:47.993058Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:47.993078Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:47.993134Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:47.993147Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:47.993166Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:48.096368Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:48.096439Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:48.096462Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:48.096492Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:48.096506Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:48.096518Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:48.096538Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:48.096596Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:48.096609Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:48.096628Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:48.200233Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:48.200303Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:48.200341Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:48.200373Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:48.200388Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:48.200403Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:48.200426Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:48.200489Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:48.200504Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:48.200525Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:48.300247Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188544 (NKikimr::NPQ::NReadQuoterEvents::TEvQuotaCountersUpdated), Tablet [2:7568544108397207262:2383], Partition 0, Sender [2:7568544108397207306:2383], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:48.300313Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188544, Sender [2:7568544108397207306:2383], Recipient [2:7568544108397207303:2383]: NKikimr::NPQ::NReadQuoterEvents::TEvQuotaCountersUpdated
2025-11-03T16:56:48.300335Z node 2 :PERSQUEUE TRACE: partition.h:671: StateIdle, processing event NReadQuoterEvents::TEvQuotaCountersUpdated
2025-11-03T16:56:48.304310Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:48.304357Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:48.304382Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:48.304413Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:48.304426Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:48.304438Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:48.304462Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:48.304514Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:48.304527Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:48.304550Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:48.404878Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:48.404952Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:48.404984Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:48.405024Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:48.405045Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:48.405056Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:48.405079Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:48.405150Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:48.405167Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:48.405194Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:48.508133Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:48.508200Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:48.508223Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:48.508255Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:48.508268Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:48.508280Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:48.508301Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:48.508359Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:48.508374Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:48.508395Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:48.608628Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:48.608693Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:48.608713Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:48.608743Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:48.608756Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:48.608768Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:48.608789Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:48.608852Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:48.608865Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:48.608887Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:48.713539Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:48.713626Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:48.713648Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:48.713678Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:48.713698Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:48.713711Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:48.713733Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:48.713789Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:48.713802Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:48.713821Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:48.814702Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:48.814766Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:48.814786Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:48.814817Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:48.814830Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:48.814844Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:48.814893Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:48.814974Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:48.814990Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:48.815009Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:48.914327Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:48.914391Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:48.914408Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:48.914435Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:48.914447Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:48.914457Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:48.914478Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:48.914542Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:48.914557Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:48.914585Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:49.014654Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:49.014701Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:49.014716Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:49.014742Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:49.014755Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:49.014764Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:49.014782Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:49.014845Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:49.014870Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:49.014889Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:49.115062Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:49.115537Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:49.115560Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:49.115587Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:49.115600Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:49.115610Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:49.115630Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:49.115684Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:49.115707Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:49.115724Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:49.215962Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:49.216073Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:49.216095Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:49.216124Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:49.216139Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:49.216149Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:49.216170Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:49.216227Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:49.216238Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:49.216270Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:49.304174Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188544 (NKikimr::NPQ::NReadQuoterEvents::TEvQuotaCountersUpdated), Tablet [2:7568544108397207262:2383], Partition 0, Sender [2:7568544108397207306:2383], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:49.304252Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188544, Sender [2:7568544108397207306:2383], Recipient [2:7568544108397207303:2383]: NKikimr::NPQ::NReadQuoterEvents::TEvQuotaCountersUpdated
2025-11-03T16:56:49.304276Z node 2 :PERSQUEUE TRACE: partition.h:671: StateIdle, processing event NReadQuoterEvents::TEvQuotaCountersUpdated
2025-11-03T16:56:49.317250Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:49.317316Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:49.317336Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:49.317363Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:49.317376Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:49.317389Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:49.317417Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:49.317481Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:49.317494Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:49.317526Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:49.419481Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:49.419548Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:49.419572Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:49.419603Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:49.419617Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:49.419628Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:49.419647Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:49.419713Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:49.419725Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:49.419744Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:49.519672Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:49.519747Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:49.519768Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:49.519800Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:49.519814Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:49.519825Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:49.519856Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:49.519914Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:49.519925Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:49.519944Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:49.622379Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:49.622453Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:49.622486Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:49.622516Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:49.622530Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:49.622542Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:49.622564Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:49.622624Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:49.622639Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:49.622660Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:49.724390Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:49.724478Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:49.724519Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:49.724563Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:49.724594Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:49.724606Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:49.724630Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:49.724689Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:49.724702Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:49.724725Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:49.825903Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:49.825976Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:49.825999Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:49.826043Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:49.826058Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:49.826070Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:49.826092Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:49.826150Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:49.826163Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:49.826183Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:49.928148Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:49.928222Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:49.928242Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:49.928275Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:49.928296Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:49.928309Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:49.928330Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:49.928386Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:49.928399Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:49.928421Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:50.036094Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:50.036152Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:50.036172Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:50.036202Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:50.036215Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:50.036225Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:50.036245Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:50.036299Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:50.036316Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:50.036338Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
=== CheckClustersList. Ok
2025-11-03T16:56:50.054812Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720669:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:690)
waiting...
2025-11-03T16:56:50.132880Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:50.132952Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:50.132973Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:50.133001Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:50.133013Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:50.133023Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:50.133042Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:50.133092Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:50.133107Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:50.133125Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
PQ Client: create topic: rt3.dc1--test-topic with 1 partitions
CallPersQueueGRPC request to localhost:13111
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-11-03T16:56:50.161134Z node 3 :PERSQUEUE TRACE: msgbus_server_scheme_request.cpp:218: TMessageBusServerProxy::Handle
2025-11-03T16:56:50.161176Z node 3 :PERSQUEUE TRACE: msgbus_server_scheme_request.cpp:230: TMessageBusServerProxy::Handle CreateMessageBusServerPersQueue
2025-11-03T16:56:50.161238Z node 3 :PERSQUEUE TRACE: msgbus_server_persqueue.cpp:178: Send to PqMetaCache TEvDescribeTopicsRequest
2025-11-03T16:56:50.161263Z node 3 :PERSQUEUE TRACE: msgbus_server_persqueue.cpp:185: Send to PqMetaCache TEvDescribeTopicsRequest Result:1
2025-11-03T16:56:50.163730Z node 3 :PERSQUEUE TRACE: msgbus_server_persqueue.cpp:325: TPersQueueBaseRequestProcessor::CreateChildren
2025-11-03T16:56:50.163760Z node 3 :PERSQUEUE TRACE: msgbus_server_persqueue.cpp:357: TPersQueueBaseRequestProcessor::CreateChildrenIfNeeded topics count = 0
2025-11-03T16:56:50.163785Z node 3 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
CallPersQueueGRPC request to localhost:13111
MetaRequest {
  CmdCreateTopic {
    Topic: "rt3.dc1--test-topic"
    NumPartitions: 1
    Config {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
  }
}
2025-11-03T16:56:50.174378Z node 3 :PERSQUEUE TRACE: msgbus_server_scheme_request.cpp:218: TMessageBusServerProxy::Handle
2025-11-03T16:56:50.174409Z node 3 :PERSQUEUE TRACE: msgbus_server_scheme_request.cpp:225: TMessageBusServerProxy::Handle new TMessageBusServerSchemeRequest
CallPersQueueGRPC response:
Status: 129
ProxyErrorCode: 53
SchemeStatus: 1
FlatTxId {
  TxId: 281474976720670
  SchemeShardTabletId: 72057594046644480
  PathId: 13
}
ErrorCode: OK
AddTopic: rt3.dc1--test-topic
===Run query:``DECLARE $version as Int64; DECLARE $path AS Utf8; DECLARE $cluster as Utf8; UPSERT INTO `/Root/PQ/Config/V2/Topics` (path, dc) VALUES ($path, $cluster); UPSERT INTO `/Root/PQ/Config/V2/Versions` (name, version) VALUES ("Topics", $version);`` with topic = test-topic, dc = dc1
2025-11-03T16:56:50.223755Z node 3 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1655: [72075186224037893][] pipe [3:7568544170873736035:3246] connected; active server actors: 1
2025-11-03T16:56:50.223931Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1519: [72075186224037893][rt3.dc1--test-topic] updating configuration. Deleted partitions []. Added partitions [0]
2025-11-03T16:56:50.226875Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:971: [72075186224037893][rt3.dc1--test-topic] Discovered subdomain [OwnerId: 72057594046644480, LocalPathId: 1] state, outOfSpace = 0 at RB 72075186224037893
2025-11-03T16:56:50.233411Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:50.233484Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:50.233516Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:50.233546Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:50.233570Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:50.233584Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:50.233607Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:50.233664Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:50.233680Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:50.233702Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:50.233553Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:140: [72075186224037893][rt3.dc1--test-topic] BALANCER INIT DONE for rt3.dc1--test-topic: (0, 72075186224037892) 
2025-11-03T16:56:50.243479Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 268632582, Sender [4:7568544170866189043:2382], Recipient [4:7568544170866189024:2388]: TEvCollectGarbageResult {TabletId# 72075186224037892 RecordGeneration# 1 PerGenerationCounter# 0 Channel# 2 Status# OK}
2025-11-03T16:56:50.243545Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 268632582, Sender [4:7568544170866189044:2383], Recipient [4:7568544170866189024:2388]: TEvCollectGarbageResult {TabletId# 72075186224037892 RecordGeneration# 1 PerGenerationCounter# 1 Channel# 2 Status# OK}
2025-11-03T16:56:50.248127Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 131085, Sender [4:7568544115031613336:2073], Recipient [4:7568544170866189024:2388]: NActors::TEvInterconnect::TEvNodeInfo
2025-11-03T16:56:50.248158Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5315: HandleHook, processing event TEvInterconnect::TEvNodeInfo
2025-11-03T16:56:50.248174Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2960: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-11-03T16:56:50.248255Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 269746185, Sender [4:7568544136506450246:2147], Recipient [4:7568544170866189024:2388]: NKikimr::TEvTxProxySchemeCache::TEvWatchNotifyUpdated
2025-11-03T16:56:50.248270Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5347: HandleHook, processing event TEvTxProxySchemeCache::TEvWatchNotifyUpdated
2025-11-03T16:56:50.248434Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 270794752, Sender [4:7568544170866189024:2388], Recipient [4:7568544170866189024:2388]: NKikimrClient.TKeyValueRequest Cookie: 3 CmdRead { Key: "_config" } CmdRead { Key: "_state" } CmdRead { Key: "_txinfo" } CmdSetExecutorFastLogPolicy { IsAllowed: false }
2025-11-03T16:56:50.248590Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 270794753, Sender [4:7568544170866189051:2388], Recipient [4:7568544170866189024:2388]: NKikimr::TEvKeyValue::TEvIntermediate
2025-11-03T16:56:50.252058Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 270270976, Sender [4:7568544115031613328:2065], Recipient [4:7568544170866189024:2388]: {TEvRegisterTabletResult TabletId# 72075186224037892 Entry# 1762189010190}
2025-11-03T16:56:50.252088Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5349: HandleHook, processing event TEvMediatorTimecast::TEvRegisterTabletResult
2025-11-03T16:56:50.253092Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 270795264, Sender [4:7568544170866189024:2388], Recipient [4:7568544170866189024:2388]: NKikimrClient.TResponse Status: 1 Cookie: 3 ReadResult { Status: 5 Message: "No such key Marker# KV48 (_config)" } ReadResult { Status: 5 Message: "No such key Marker# KV48 (_state)" } ReadResult { Status: 5 Message: "No such key Marker# KV48 (_txinfo)" } SetExecutorFastLogPolicyResult { Status: 0 }
2025-11-03T16:56:50.253117Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5322: HandleHook, processing event TEvKeyValue::TEvResponse
2025-11-03T16:56:50.253173Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2992: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-11-03T16:56:50.253277Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 270794752, Sender [4:7568544170866189024:2388], Recipient [4:7568544170866189024:2388]: NKikimrClient.TKeyValueRequest Cookie: 6 CmdReadRange { Range { From: "tx_00000000000000000000" IncludeFrom: true To: "tx_18446744073709551615" IncludeTo: true } IncludeData: true } CmdSetExecutorFastLogPolicy { IsAllowed: false }
2025-11-03T16:56:50.253432Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 270794753, Sender [4:7568544170866189054:2388], Recipient [4:7568544170866189024:2388]: NKikimr::TEvKeyValue::TEvIntermediate
2025-11-03T16:56:50.253652Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 270795264, Sender [4:7568544170866189024:2388], Recipient [4:7568544170866189024:2388]: NKikimrClient.TResponse Status: 1 Cookie: 6 ReadRangeResult { Status: 5 } SetExecutorFastLogPolicyResult { Status: 0 }
2025-11-03T16:56:50.253665Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5322: HandleHook, processing event TEvKeyValue::TEvResponse
2025-11-03T16:56:50.253684Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:787: [PQ: 72075186224037892] no config, start with empty partitions and default config
2025-11-03T16:56:50.253708Z node 4 :PERSQUEUE NOTICE: pq_impl.cpp:913: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-11-03T16:56:50.253745Z node 4 :PERSQUEUE INFO: pq_impl.cpp:612: [PQ: 72075186224037892] doesn't have tx writes info
2025-11-03T16:56:50.255407Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 269877761, Sender [4:7568544170866189035:2378], Recipient [4:7568544170866189024:2388]: NKikimr::TEvTabletPipe::TEvServerConnected
2025-11-03T16:56:50.255428Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5330: HandleHook, processing event TEvTabletPipe::TEvServerConnected
2025-11-03T16:56:50.255442Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:2716: [PQ: 72075186224037892] Handle TEvTabletPipe::TEvServerConnected
2025-11-03T16:56:50.255465Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [3:7568544170873736066:2434], now have 1 active actors on pipe
2025-11-03T16:56:50.255253Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:404: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 4, Generation 1
2025-11-03T16:56:50.257478Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271188536, Sender [3:7568544170873736026:2434], Recipient [4:7568544170866189035:2378]
2025-11-03T16:56:50.257500Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5345: HandleHook, processing event TEvPQ::TEvSubDomainStatus
2025-11-03T16:56:50.257562Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 269877761, Sender [4:7568544170866189055:2391], Recipient [4:7568544170866189024:2388]: NKikimr::TEvTabletPipe::TEvServerConnected
2025-11-03T16:56:50.257576Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5330: HandleHook, processing event TEvTabletPipe::TEvServerConnected
2025-11-03T16:56:50.257587Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:2716: [PQ: 72075186224037892] Handle TEvTabletPipe::TEvServerConnected
2025-11-03T16:56:50.257619Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [3:7568544170873736034:3245], now have 1 active actors on pipe
2025-11-03T16:56:50.257997Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271187998, Sender [3:7568544115039159638:2211], Recipient [4:7568544170866189055:2391]
2025-11-03T16:56:50.258026Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5337: HandleHook, processing event TEvPersQueue::TEvProposeTransaction
2025-11-03T16:56:50.258327Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-03T16:56:50.258476Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 270794752, Sender [4:7568544170866189024:2388], Recipient [4:7568544170866189024:2388]: NKikimrClient.TKeyValueRequest Cookie: 5 CmdWrite { Key: "tx_00000281474976720670" Value: "\010\236\316\200\200\200\200@\020\002\030\216\312\231\325\2443 \377\377\377\377\377\377\377\377\377\001X\002b\260\001\022\037\030\200\243\005(\200\200\200\0040\200\243\0058\200\332\304\t@\200\332\304\th\001\370\001\200\233\356\002\030\000\"\023rt3.dc1--test-topic(\0000\001\252\001\027\010\000\010\001\010\002\022\003raw\022\004gzip\022\004lzop\272\001\034/Root/PQ/rt3.dc1--test-topic\322\001\000\332\001\000\342\001\000\352\001\005/Root\372\001\010\010\000\030\0010\0018\000\242\002\010\010\000\030\0010\0018\000\252\002\016\n\004user\020\000\030\0008\000@\000\312\002\000j\000r\022\tVE\310\323\305\336\010i\021\243\010\000\000\003\000\000\000\202\001\000" } CmdWrite { Key: "_txinfo" Value: "\020\000\030\000(\240\215\0060\0008\000" StorageChannel: INLINE }
2025-11-03T16:56:50.261165Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 270794753, Sender [4:7568544170866189056:2388], Recipient [4:7568544170866189024:2388]: NKikimr::TEvKeyValue::TEvIntermediate
2025-11-03T16:56:50.264422Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 270795264, Sender [4:7568544170866189024:2388], Recipient [4:7568544170866189024:2388]: NKikimrClient.TResponse Status: 1 Cookie: 5 WriteResult { Status: 0 StatusFlags: 1 } WriteResult { Status: 0 StatusFlags: 1 }
2025-11-03T16:56:50.264450Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5322: HandleHook, processing event TEvKeyValue::TEvResponse
2025-11-03T16:56:50.264467Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-03T16:56:50.271207Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 269550082, Sender [3:7568544115039159638:2211], Recipient [4:7568544170866189055:2391]
2025-11-03T16:56:50.271232Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5346: HandleHook, processing event TEvPersQueue::TEvProposeTransactionAttach
2025-11-03T16:56:50.277098Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 269877761, Sender [4:7568544170866189060:2395], Recipient [4:7568544170866189024:2388]: NKikimr::TEvTabletPipe::TEvServerConnected
2025-11-03T16:56:50.277130Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5330: HandleHook, processing event TEvTabletPipe::TEvServerConnected
2025-11-03T16:56:50.277153Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:2716: [PQ: 72075186224037892] Handle TEvTabletPipe::TEvServerConnected
2025-11-03T16:56:50.277183Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [3:7568544170873736101:3296], now have 1 active actors on pipe
2025-11-03T16:56:50.277211Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 269287424, Sender [3:7568544119334127181:2388], Recipient [4:7568544170866189060:2395]
2025-11-03T16:56:50.277224Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5339: HandleHook, processing event TEvTxProcessing::TEvPlanStep
2025-11-03T16:56:50.277444Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-03T16:56:50.277602Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 270794752, Sender [4:7568544170866189024:2388], Recipient [4:7568544170866189024:2388]: NKikimrClient.TKeyValueRequest Cookie: 5 CmdWrite { Key: "tx_00000281474976720670" Value: "\010\236\316\200\200\200\200@\020\004\030\216\312\231\325\2443 \377\377\377\377\377\377\377\377\377\001@\214\313\231\325\2443X\002b\260\001\022\037\030\200\243\005(\200\200\200\0040\200\243\0058\200\332\304\t@\200\332\304\th\001\370\001\200\233\356\002\030\000\"\023rt3.dc1--test-topic(\0000\001\252\001\027\010\000\010\001\010\002\022\003raw\022\004gzip\022\004lzop\272\001\034/Root/PQ/rt3.dc1--test-topic\322\001\000\332\001\000\342\001\000\352\001\005/Root\372\001\010\010\000\030\0010\0018\000\242\002\010\010\000\030\0010\0018\000\252\002\016\n\004user\020\000\030\0008\000@\000\312\002\000j\000r\022\tVE\310\323\305\336\010i\021\243\010\000\000\003\000\000\000\202\001\000" } CmdWrite { Key: "_txinfo" Value: "\020\214\313\231\325\2443\030\236\316\200\200\200\200@(\240\215\0060\0008\000" StorageChannel: INLINE }
2025-11-03T16:56:50.288771Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 270794753, Sender [4:7568544170866189061:2388], Recipient [4:7568544170866189024:2388]: NKikimr::TEvKeyValue::TEvIntermediate
2025-11-03T16:56:50.296155Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 270795264, Sender [4:7568544170866189024:2388], Recipient [4:7568544170866189024:2388]: NKikimrClient.TResponse Status: 1 Cookie: 5 WriteResult { Status: 0 StatusFlags: 1 } WriteResult { Status: 0 StatusFlags: 1 }
2025-11-03T16:56:50.296188Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5322: HandleHook, processing event TEvKeyValue::TEvResponse
2025-11-03T16:56:50.296204Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-03T16:56:50.296987Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 270794756, Sender [4:7568544170866189024:2388], Recipient [4:7568544170866189024:2388]: NKikimr::TEvKeyValue::TEvCollect
2025-11-03T16:56:50.297037Z node 4 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-11-03T16:56:50.297097Z node 4 :PERSQUEUE TRACE: partition.h:573: StateInit event# 271188530 (NKikimr::TEvPQ::TEvProposePartitionConfig), Tablet [4:7568544170866189024:2388], Partition 0, Sender [4:7568544170866189024:2388], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:56:50.297129Z node 4 :PERSQUEUE TRACE: partition.h:575: StateInit, received event# 271188530, Sender [4:7568544170866189024:2388], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvProposePartitionConfig
2025-11-03T16:56:50.297154Z node 4 :PERSQUEUE TRACE: partition.h:589: StateInit, processing event TEvPQ::TEvProposePartitionConfig
2025-11-03T16:56:50.297173Z node 4 :PERSQUEUE DEBUG: partition.cpp:1312: [72075186224037892][Partition][0][StateInit] HandleOnInit TEvPQ::TEvProposePartitionConfig
2025-11-03T16:56:50.297247Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 270794752, Sender [4:7568544170866189065:2388], Recipient [4:7568544170866189024:2388]: NKikimrClient.TKeyValueRequest CmdRead { Key: "_config_0" }
2025-11-03T16:56:50.297377Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 270794753, Sender [4:7568544170866189067:2388], Recipient [4:7568544170866189024:2388]: NKikimr::TEvKeyValue::TEvIntermediate
2025-11-03T16:56:50.297554Z node 4 :PERSQUEUE TRACE: partition.h:573: StateInit event# 270795264 (NKikimr::TEvKeyValue::TEvResponse), Tablet [4:7568544170866189024:2388], Partition 0, Sender [4:7568544170866189024:2388], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:56:50.297625Z node 4 :PERSQUEUE TRACE: partition.h:575: StateInit, received event# 270795264, Sender [4:7568544170866189024:2388], Recipient [4:7568544170866189065:2388]: NKikimrClient.TResponse Status: 1 ReadResult { Status: 5 Message: "No such key Marker# KV48 (_config_0)" }
2025-11-03T16:56:50.297685Z node 4 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-11-03T16:56:50.297852Z node 4 :PERSQUEUE INFO: partition_init.cpp:1101: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [4:7568544170866189065:2388]
2025-11-03T16:56:50.301124Z node 4 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-11-03T16:56:50.301155Z node 4 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-11-03T16:56:50.301177Z node 4 :PERSQUEUE INFO: partition.cpp:707: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1 [4:7568544170866189065:2388]
2025-11-03T16:56:50.301201Z node 4 :PERSQUEUE DEBUG: partition.cpp:727: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 0 Head Offset 0 PartNo 0 PackedSize 0 count 0 nextOffset 0 batches 0
2025-11-03T16:56:50.301229Z node 4 :PERSQUEUE DEBUG: partition_mlp.cpp:83: [72075186224037892][Partition][0][StateIdle] Initializing MLP Consumers: 0
2025-11-03T16:56:50.302411Z node 4 :PERSQUEUE DEBUG: partition.cpp:4273: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 1
2025-11-03T16:56:50.302441Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:50.302512Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:50.302533Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-03T16:56:50.302552Z node 4 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-11-03T16:56:50.302564Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:50.305020Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188544 (NKikimr::NPQ::NReadQuoterEvents::TEvQuotaCountersUpdated), Tablet [2:7568544108397207262:2383], Partition 0, Sender [2:7568544108397207306:2383], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:50.305093Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188544, Sender [2:7568544108397207306:2383], Recipient [2:7568544108397207303:2383]: NKikimr::NPQ::NReadQuoterEvents::TEvQuotaCountersUpdated
2025-11-03T16:56:50.305116Z node 2 :PERSQUEUE TRACE: partition.h:671: StateIdle, processing event NReadQuoterEvents::TEvQuotaCountersUpdated
2025-11-03T16:56:50.302573Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:50.302583Z node 4 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-11-03T16:56:50.302609Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:923: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-11-03T16:56:50.302641Z node 4 :PERSQUEUE DEBUG: partition_mlp.cpp:60: [72075186224037892][Partition][0][StateIdle] Process MLP pending events. Count 0
2025-11-03T16:56:50.302773Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271188531, Sender [4:7568544170866189065:2388], Recipient [4:7568544170866189024:2388]: NKikimr::TEvPQ::TEvProposePartitionConfigResult
2025-11-03T16:56:50.302790Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5343: HandleHook, processing event TEvPQ::TEvProposePartitionConfigResult
2025-11-03T16:56:50.302978Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-03T16:56:50.303026Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188562 (NKikimr::TEvPQ::TEvTxBatchComplete), Tablet [4:7568544170866189024:2388], Partition 0, Sender [4:7568544170866189065:2388], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:56:50.303057Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188562, Sender [4:7568544170866189065:2388], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvTxBatchComplete
2025-11-03T16:56:50.303092Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 65538 (NActors::TEvents::TEvWakeup), Tablet [4:7568544170866189024:2388], Partition 0, Sender [4:7568544170866189065:2388], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:56:50.303117Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 65538, Sender [4:7568544170866189065:2388], Recipient [4:7568544170866189065:2388]: NActors::TEvents::TEvWakeup
2025-11-03T16:56:50.303247Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:183: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:56:50.303286Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271188497, Sender [4:7568544170866189065:2388], Recipient [4:7568544170866189024:2388]: NKikimr::TEvPQ::TEvInitComplete
2025-11-03T16:56:50.303301Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5323: HandleHook, processing event TEvPQ::TEvInitComplete
2025-11-03T16:56:50.303342Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271188503, Sender [4:7568544170866189065:2388], Recipient [4:7568544170866189024:2388]: NKikimr::TEvPQ::TEvPartitionLabeledCounters
2025-11-03T16:56:50.303353Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5326: HandleHook, processing event TEvPQ::TEvPartitionLabeledCounters
2025-11-03T16:56:50.303396Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271188503, Sender [4:7568544170866189065:2388], Recipient [4:7568544170866189024:2388]: NKikimr::TEvPQ::TEvPartitionLabeledCounters
2025-11-03T16:56:50.303407Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5326: HandleHook, processing event TEvPQ::TEvPartitionLabeledCounters
2025-11-03T16:56:50.303445Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271188503, Sender [4:7568544170866189065:2388], Recipient [4:7568544170866189024:2388]: NKikimr::TEvPQ::TEvPartitionLabeledCounters
2025-11-03T16:56:50.303456Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5326: HandleHook, processing event TEvPQ::TEvPartitionLabeledCounters
2025-11-03T16:56:50.303604Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 270794752, Sender [4:7568544170866189024:2388], Recipient [4:7568544170866189024:2388]: NKikimrClient.TKeyValueRequest Cookie: 5 CmdWrite { Key: "tx_00000281474976720670" Value: "\010\236\316\200\200\200\200@\020\006\030\216\312\231\325\2443 \377\377\377\377\377\377\377\377\377\001@\214\313\231\325\2443H\001X\002b\260\001\022\037\030\200\243\005(\200\200\200\0040\200\243\0058\200\332\304\t@\200\332\304\th\001\370\001\200\233\356\002\030\000\"\023rt3.dc1--test-topic(\0000\001\252\001\027\010\000\010\001\010\002\022\003raw\022\004gzip\022\004lzop\272\001\034/Root/PQ/rt3.dc1--test-topic\322\001\000\332\001\000\342\001\000\352\001\005/Root\372\001\010\010\000\030\0010\0018\000\242\002\010\010\000\030\0010\0018\000\252\002\016\n\004user\020\000\030\0008\000@\000\312\002\000j\000r\022\tVE\310\323\305\336\010i\021\243\010\000\000\003\000\000\000\202\001\004\n\002\010\000" } CmdWrite { Key: "_txinfo" Value: "\020\214\313\231\325\2443\030\236\316\200\200\200\200@(\240\215\0060\214\313\231\325\24438\236\316\200\200\200\200@" StorageChannel: INLINE }
2025-11-03T16:56:50.303718Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271188501, Sender [4:7568544170866189065:2388], Recipient [4:7568544170866189024:2388]: NKikimr::TEvPQ::TEvPartitionCounters
2025-11-03T16:56:50.303731Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5324: HandleHook, processing event TEvPQ::TEvPartitionCounters
2025-11-03T16:56:50.303743Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:1078: [PQ: 72075186224037892] Handle TEvPQ::TEvPartitionCounters PartitionId 0
2025-11-03T16:56:50.308825Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 270794760, Sender [4:7568544170866189066:2390], Recipient [4:7568544170866189024:2388]: NKikimr::TEvKeyValue::TEvCompleteGC
2025-11-03T16:56:50.311256Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 270794753, Sender [4:7568544170866189070:2388], Recipient [4:7568544170866189024:2388]: NKikimr::TEvKeyValue::TEvIntermediate
2025-11-03T16:56:50.318260Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 270794756, Sender [4:7568544170866189024:2388], Recipient [4:7568544170866189024:2388]: NKikimr::TEvKeyValue::TEvCollect
2025-11-03T16:56:50.318467Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 270795264, Sender [4:7568544170866189024:2388], Recipient [4:7568544170866189024:2388]: NKikimrClient.TResponse Status: 1 Cookie: 5 WriteResult { Status: 0 StatusFlags: 1 } WriteResult { Status: 0 StatusFlags: 1 }
2025-11-03T16:56:50.318489Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5322: HandleHook, processing event TEvKeyValue::TEvResponse
2025-11-03T16:56:50.318506Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-03T16:56:50.318573Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:4082: [PQ: 72075186224037892] Commit tx 281474976720670
2025-11-03T16:56:50.318674Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188532 (NKikimr::TEvPQ::TEvTxCommit), Tablet [4:7568544170866189024:2388], Partition 0, Sender [4:7568544170866189024:2388], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:56:50.318715Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188532, Sender [4:7568544170866189024:2388], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvTxCommit
2025-11-03T16:56:50.318732Z node 4 :PERSQUEUE TRACE: partition.h:664: StateIdle, processing event TEvPQ::TEvTxCommit
2025-11-03T16:56:50.318753Z node 4 :PERSQUEUE DEBUG: partition.cpp:1416: [72075186224037892][Partition][0][StateIdle] Handle TEvPQ::TEvTxCommit Step 1762189010316, TxId 281474976720670
2025-11-03T16:56:50.318773Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:50.318783Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:50.318912Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:50.318954Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:50.318991Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:50.319003Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:50.319161Z node 4 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-03T16:56:50.319406Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 270794752, Sender [4:7568544170866189047:2388], Recipient [4:7568544170866189024:2388]: NKikimrClient.TKeyValueRequest Cookie: 0 CmdWrite { Key: "i0000000000" Value: "\030\000(\000" StorageChannel: INLINE } CmdWrite { Key: "I0000000000" Value: "\010\214\313\231\325\2443\020\236\316\200\200\200\200@" StorageChannel: INLINE } CmdWrite { Key: "m0000000000cuser" Value: "\010\000\020\000\030\000\"\000(\0000\000@\000" StorageChannel: INLINE } CmdWrite { Key: "m0000000000uuser" Value: "\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000" StorageChannel: INLINE } CmdWrite { Key: "_config_0" Value: "\022\037\030\200\243\005(\200\200\200\0040\200\243\0058\200\332\304\t@\200\332\304\th\001\370\001\200\233\356\002\030\000\"\023rt3.dc1--test-topic(\0000\001\252\001\027\010\000\010\001\010\002\022\003raw\022\004gzip\022\004lzop\272\001\034/Root/PQ/rt3.dc1--test-topic\322\001\000\332\001\000\342\001\000\352\001\005/Root\372\001\010\010\000\030\0010\0018\000\242\002\010\010\000\030\0010\0018\000\252\002\016\n\004user\020\000\030\0008\000@\000\312\002\000" StorageChannel: INL
2025-11-03T16:56:50.319567Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 270794753, Sender [4:7568544170866189080:2388], Recipient [4:7568544170866189024:2388]: NKikimr::TEvKeyValue::TEvIntermediate
2025-11-03T16:56:50.323460Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 270794760, Sender [4:7568544170866189078:2391], Recipient [4:7568544170866189024:2388]: NKikimr::TEvKeyValue::TEvCompleteGC
2025-11-03T16:56:50.323820Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 270795264 (NKikimr::TEvKeyValue::TEvResponse), Tablet [4:7568544170866189024:2388], Partition 0, Sender [4:7568544170866189047:2388], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:56:50.323957Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 270795264, Sender [4:7568544170866189047:2388], Recipient [4:7568544170866189065:2388]: NKikimrClient.TResponse Status: 1 WriteResult { Status: 0 StatusFlags: 1 } WriteResult { Status: 0 StatusFlags: 1 } WriteResult { Status: 0 StatusFlags: 1 } WriteResult { Status: 0 StatusFlags: 1 } WriteResult { Status: 0 StatusFlags: 1 }
2025-11-03T16:56:50.323998Z node 4 :PERSQUEUE TRACE: partition.h:625: StateIdle, processing event TEvKeyValue::TEvResponse
2025-11-03T16:56:50.324013Z node 4 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-03T16:56:50.324142Z node 4 :PERSQUEUE DEBUG: partition_mlp.cpp:83: [72075186224037892][Partition][0][StateIdle] Initializing MLP Consumers: 0
2025-11-03T16:56:50.324231Z node 4 :PERSQUEUE TRACE: partition_write.cpp:518: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse.
2025-11-03T16:56:50.324271Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-11-03T16:56:50.324283Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:50.324292Z node 4 :PERSQUEUE TRACE: partition_write.cpp:424: [72075186224037892][Partition][0][StateIdle] TPartition::SyncMemoryStateWithKVState.
2025-11-03T16:56:50.324312Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:50.324323Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:50.324334Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:50.324352Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:50.324392Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:50.324402Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:50.324415Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:50.324434Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:183: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:56:50.324526Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271188533, Sender [4:7568544170866189065:2388], Recipient [4:7568544170866189024:2388]: NKikimr::TEvPQ::TEvTxCommitDone
2025-11-03T16:56:50.324541Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5344: HandleHook, processing event TEvPQ::TEvTxCommitDone
2025-11-03T16:56:50.324766Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:398: [PQ: 72075186224037892] Apply new config PartitionConfig { LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 } PartitionIds: 0 TopicName: "rt3.dc1--test-topic" Version: 0 LocalDC: true Codecs { Ids: 0 Ids: 1 Ids: 2 Codecs: "raw" Codecs: "gzip" Codecs: "lzop" } TopicPath: "/Root/PQ/rt3.dc1--test-topic" YcCloudId: "" YcFolderId: "" YdbDatabaseId: "" YdbDatabasePath: "/Root" Partitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } AllPartitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } Consumers { Name: "user" ReadFromTimestampsMs: 0 FormatVersion: 0 Version: 0 Generation: 0 } MonitoringProjectId: ""
2025-11-03T16:56:50.324841Z node 4 :PERSQUEUE NOTICE: pq_impl.cpp:913: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-11-03T16:56:50.325043Z node 4 :PERSQUEUE TRACE: pq_l2_cache.h:116: StateFunc, received event# 271450112, Sender [4:7568544170866189047:2388], Recipient [4:7568544115031613334:2071]: NKikimr::NPQ::TEvPqCache::TEvCacheL2Request
2025-11-03T16:56:50.325050Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-03T16:56:50.325064Z node 4 :PERSQUEUE TRACE: pq_l2_cache.h:119: StateFunc, processing event TEvPqCache::TEvCacheL2Request
2025-11-03T16:56:50.325095Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271188503, Sender [4:7568544170866189065:2388], Recipient [4:7568544170866189024:2388]: NKikimr::TEvPQ::TEvPartitionLabeledCounters
2025-11-03T16:56:50.325107Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5326: HandleHook, processing event TEvPQ::TEvPartitionLabeledCounters
2025-11-03T16:56:50.325249Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 270794752, Sender [4:7568544170866189024:2388], Recipient [4:7568544170866189024:2388]: NKikimrClient.TKeyValueRequest Cookie: 5 CmdWrite { Key: "tx_00000281474976720670" Value: "\010\236\316\200\200\200\200@\020\t\030\216\312\231\325\2443 \377\377\377\377\377\377\377\377\377\001@\214\313\231\325\2443H\001X\002b\260\001\022\037\030\200\243\005(\200\200\200\0040\200\243\0058\200\332\304\t@\200\332\304\th\001\370\001\200\233\356\002\030\000\"\023rt3.dc1--test-topic(\0000\001\252\001\027\010\000\010\001\010\002\022\003raw\022\004gzip\022\004lzop\272\001\034/Root/PQ/rt3.dc1--test-topic\322\001\000\332\001\000\342\001\000\352\001\005/Root\372\001\010\010\000\030\0010\0018\000\242\002\010\010\000\030\0010\0018\000\252\002\016\n\004user\020\000\030\0008\000@\000\312\002\000j\000r\022\tVE\310\323\305\336\010i\021\243\010\000\000\003\000\000\000\202\001\004\n\002\010\000" } CmdWrite { Key: "_txinfo" Value: "\020\214\313\231\325\2443\030\236\316\200\200\200\200@(\240\215\0060\214\313\231\325\24438\236\316\200\200\200\200@" StorageChannel: INLINE } CmdWrite { Key: "_config" Value: "
2025-11-03T16:56:50.328745Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 270794753, Sender [4:7568544170866189085:2388], Recipient [4:7568544170866189024:2388]: NKikimr::TEvKeyValue::TEvIntermediate
2025-11-03T16:56:50.333677Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:50.333759Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:50.333784Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:50.333827Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:50.333844Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:50.333857Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:50.333882Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:50.333939Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:50.333953Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:50.333973Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:50.334255Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 270795264, Sender [4:7568544170866189024:2388], Recipient [4:7568544170866189024:2388]: NKikimrClient.TResponse Status: 1 Cookie: 5 WriteResult { Status: 0 StatusFlags: 1 } WriteResult { Status: 0 StatusFlags: 1 } WriteResult { Status: 0 StatusFlags: 1 }
2025-11-03T16:56:50.334287Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5322: HandleHook, processing event TEvKeyValue::TEvResponse
2025-11-03T16:56:50.334302Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-03T16:56:50.334378Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-03T16:56:50.334428Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 270794756, Sender [4:7568544170866189024:2388], Recipient [4:7568544170866189024:2388]: NKikimr::TEvKeyValue::TEvCollect
2025-11-03T16:56:50.334570Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 270794752, Sender [4:7568544170866189024:2388], Recipient [4:7568544170866189024:2388]: NKikimrClient.TKeyValueRequest Cookie: 5 CmdDeleteRange { Range { From: "tx_00000281474976720670" IncludeFrom: true To: "tx_00000281474976720670" IncludeTo: true } } CmdWrite { Key: "_txinfo" Value: "\020\214\313\231\325\2443\030\236\316\200\200\200\200@(\240\215\0060\214\313\231\325\24438\236\316\200\200\200\200@" StorageChannel: INLINE }
2025-11-03T16:56:50.334697Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 270794753, Sender [4:7568544170866189091:2388], Recipient [4:7568544170866189024:2388]: NKikimr::TEvKeyValue::TEvIntermediate
2025-11-03T16:56:50.336165Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 270794760, Sender [4:7568544170866189089:2392], Recipient [4:7568544170866189024:2388]: NKikimr::TEvKeyValue::TEvCompleteGC
2025-11-03T16:56:50.339803Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 270795264, Sender [4:7568544170866189024:2388], Recipient [4:7568544170866189024:2388]: NKikimrClient.TResponse Status: 1 Cookie: 5 DeleteRangeResult { Status: 0 } WriteResult { Status: 0 StatusFlags: 1 }
2025-11-03T16:56:50.339831Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5322: HandleHook, processing event TEvKeyValue::TEvResponse
2025-11-03T16:56:50.339846Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-03T16:56:50.340011Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 270794756, Sender [4:7568544170866189024:2388], Recipient [4:7568544170866189024:2388]: NKikimr::TEvKeyValue::TEvCollect
2025-11-03T16:56:50.341221Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 270794760, Sender [4:7568544170866189096:2393], Recipient [4:7568544170866189024:2388]: NKikimr::TEvKeyValue::TEvCompleteGC
2025-11-03T16:56:50.363897Z node 3 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976720671. Ctx: { TraceId: 01k95acs978p825337ax96vrrb, Database: , SessionId: ydb://session/3?node_id=3&id=ZGUyMWFlODktNzJmZjlkNzgtZmMzYzY0YTQtZmYzM2QzOTU=, PoolId: default, DatabaseId: /Root}. Database not set, use /Root
2025-11-03T16:56:50.403812Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [4:7568544170866189024:2388], Partition 0, Sender [0:0:0], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:56:50.403875Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:50.403895Z node 4 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:50.403924Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:50.403938Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:50.403949Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:50.403969Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:50.404046Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:50.404059Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:50.404079Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
===Query complete
TClient::Ls request: /Root/PQ/rt3.dc1--test-topic
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976720670
    CreateStep: 1762189010316
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts...
(TRUNCATED)
GetTopicVersionFromPath:  record Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976720670
    CreateStep: 1762189010316
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      YdbDatabasePath: "/Root"
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
    Partitions {
      PartitionId: 0
      TabletId: 72075186224037892
      Status: Active
    }
    AlterVersion: 1
    BalancerTabletID: 72075186224037893
    NextPartitionId: 1
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 1
      PlanResolution: 7
      Coordinators: 72057594046316545
      TimeCastBucketsPerMediator: 2
      Mediators: 72057594046382081
    }
    DomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    PathsInside: 12
    PathsLimit: 10000
    ShardsInside: 6
    ShardsLimit: 200000
    ResourcesDomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    DiskSpaceUsage {
      Tables {
        TotalSize: 0
        DataSize: 0
        IndexSize: 0
      }
      Topics {
        ReserveSize: 0
        AccountSize: 0
        DataSize: 0
        UsedReserveSize: 0
      }
    }
    PQPartitionsInside: 1
    PQPartitionsLimit: 1000000
    SchemeLimits {
      MaxDepth: 32
      MaxPaths: 10000
      MaxChildrenInDir: 100000
      MaxAclBytesSize: 10240
      MaxTableColumns: 200
      MaxTableColumnNameLength: 255
      MaxTableKeyColumns: 30
      MaxTableIndices: 20
      MaxShards: 200000
      MaxShardsInPath: 35000
      MaxConsistentCopyTargets: 10000
      MaxPathElementLength: 255
      ExtraPathSymbolsAllowed: "!\"#$%&\'()*+,-.:;<=>?@[\\]^_`{|}~"
      MaxPQPartitions: 1000000
      MaxTableCdcStreams: 5
      MaxExports: 10
      MaxImports: 10
      MaxColumnTableColumns: 10000
    }
  }
}
Path: "/Root/PQ/rt3.dc1--test-topic"
 name rt3.dc1--test-topic version1
CallPersQueueGRPC request to localhost:13111
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-11-03T16:56:50.420109Z node 3 :PERSQUEUE TRACE: msgbus_server_scheme_request.cpp:218: TMessageBusServerProxy::Handle
2025-11-03T16:56:50.420139Z node 3 :PERSQUEUE TRACE: msgbus_server_scheme_request.cpp:230: TMessageBusServerProxy::Handle CreateMessageBusServerPersQueue
2025-11-03T16:56:50.420200Z node 3 :PERSQUEUE TRACE: msgbus_server_persqueue.cpp:178: Send to PqMetaCache TEvDescribeTopicsRequest
2025-11-03T16:56:50.420229Z node 3 :PERSQUEUE TRACE: msgbus_server_persqueue.cpp:185: Send to PqMetaCache TEvDescribeTopicsRequest Result:1
2025-11-03T16:56:50.421134Z node 3 :PERSQUEUE TRACE: msgbus_server_persqueue.cpp:325: TPersQueueBaseRequestProcessor::CreateChildren
2025-11-03T16:56:50.421173Z node 3 :PERSQUEUE TRACE: msgbus_server_persqueue.cpp:357: TPersQueueBaseRequestProcessor::CreateChildrenIfNeeded topics count = 1
2025-11-03T16:56:50.421185Z node 3 :PERSQUEUE TRACE: msgbus_server_persqueue.cpp:387: CreateTopicSubactor for topic rt3.dc1--test-topic
2025-11-03T16:56:50.421380Z node 3 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
MetaResponse {
  CmdGetTopicMetadataResult {
    TopicInfo {
      Topic: "rt3.dc1--test-topic"
      NumPartitions: 1
      Config {
        PartitionConfig {
          LifetimeSeconds: 86400
          LowWatermark: 8388608
          SourceIdLifetimeSeconds: 86400
          WriteSpeedInBytesPerSecond: 20000000
          BurstSize: 20000000
          SourceIdMaxCounts: 6000000
        }
        Version: 1
        LocalDC: true
        Codecs {
          Ids: 0
          Ids: 1
          Ids: 2
          Codecs: "raw"
          Codecs: "gzip"
          Codecs: "lzop"
        }
        TopicPath: "/Root/PQ/rt3.dc1--test-topic"
        YdbDatabasePath: "/Root"
        Consumers {
          Name: "user"
          ReadFromTimestampsMs: 0
          FormatVersion: 0
          Version: 0
        }
      }
      ErrorCode: OK
    }
  }
}
=== Topic created, have version: 1
2025-11-03T16:56:50.433976Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: try to update token
2025-11-03T16:56:50.436136Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:50.436205Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:50.436231Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:50.436261Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:50.436279Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:50.436291Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:50.436313Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:50.436373Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:50.436386Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:50.436409Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:50.437665Z :INFO: [] MessageGroupId [src] SessionId [] Write session: Do CDS request
2025-11-03T16:56:50.437720Z :INFO: [] MessageGroupId [src] SessionId [] Start write session. Will connect to endpoint: localhost:13111
2025-11-03T16:56:50.456844Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src" }
2025-11-03T16:56:50.458916Z node 3 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-11-03T16:56:50.458954Z node 3 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1
2025-11-03T16:56:50.459500Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src" }
2025-11-03T16:56:50.459627Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1 topic: "test-topic" message_group_id: "src" from ipv6:[::1]:52454
2025-11-03T16:56:50.459644Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:52454 proto=v1  topic=test-topic durationSec=0
2025-11-03T16:56:50.459654Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-11-03T16:56:50.461246Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1 sessionId:  describe result for acl check
2025-11-03T16:56:50.461376Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-11-03T16:56:50.461387Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-11-03T16:56:50.461397Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-11-03T16:56:50.461416Z node 3 :PQ_PARTITION_CHOOSER TRACE: partition_chooser_impl__abstract_chooser_actor.h:88: TPartitionChooser [3:7568544170873736174:2452] (SourceId=src, PreferedPartition=(NULL)) InitTable: SourceId=src TopicsAreFirstClassCitizen=0 UseSrcIdMetaMappingInFirstClass=1
2025-11-03T16:56:50.461430Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [3:7568544170873736174:2452] (SourceId=src, PreferedPartition=(NULL)) StartKqpSession
2025-11-03T16:56:50.469903Z node 3 :PQ_PARTITION_CHOOSER TRACE: partition_chooser_impl__abstract_chooser_actor.h:132: StateCreateKqpSession, received event# 271646728, Sender [3:7568544115039159497:2257], Recipient [3:7568544170873736174:2452]: NKikimrKqp.TEvCreateSessionResponse Error: "" Response { SessionId: "ydb://session/3?node_id=3&id=YWMyZWE1YjQtOGE5M2VlYTQtNmJlNTE0MmQtZWE0Mzk2NTk=" NodeId: 3 } YdbStatus: SUCCESS ResourceExhausted: false
2025-11-03T16:56:50.469944Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [3:7568544170873736174:2452] (SourceId=src, PreferedPartition=(NULL)) Select from the table
2025-11-03T16:56:50.506400Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [4:7568544170866189024:2388], Partition 0, Sender [0:0:0], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:56:50.506494Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:50.506523Z node 4 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:50.506553Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:50.506569Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:50.506584Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:50.506607Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:50.506671Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:50.506687Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:50.506709Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:50.537031Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:50.537117Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:50.537144Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:50.537177Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:50.537192Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:50.537204Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:50.537226Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:50.537282Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:50.537296Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:50.537318Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:50.605488Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [4:7568544170866189024:2388], Partition 0, Sender [0:0:0], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:56:50.605561Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:50.605589Z node 4 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:50.605618Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:50.605643Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:50.605658Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:50.605680Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:50.605738Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:50.605751Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:50.605772Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:50.637451Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:50.637515Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:50.637541Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:50.637587Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:50.637603Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:50.637617Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:50.637640Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:50.637700Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:50.637715Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:50.637738Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:50.641066Z node 3 :PQ_PARTITION_CHOOSER TRACE: partition_chooser_impl__abstract_chooser_actor.h:163: StateSelect, received event# 271646721, Sender [3:7568544115039159497:2257], Recipient [3:7568544170873736174:2452]: NKikimrKqp.TEvQueryResponse Response { SessionId: "ydb://session/3?node_id=3&id=YWMyZWE1YjQtOGE5M2VlYTQtNmJlNTE0MmQtZWE0Mzk2NTk=" PreparedQuery: "442ea808-d7231069-9c6e0723-bcf815" QueryParameters { Name: "$Hash" Type { Kind: Data Data { Scheme: 2 } } } QueryParameters { Name: "$Topic" Type { Kind: Data Data { Scheme: 4608 } } } QueryParameters { Name: "$SourceId" Type { Kind: Data Data { Scheme: 4608 } } } TxMeta { id: "01k95acsp3eebrb1yxv7ndv308" } YdbResults { columns { name: "Partition" type { optional_type { item { type_id: UINT32 } } } } columns { name: "CreateTime" type { optional_type { item { type_id: UINT64 } } } } columns { name: "AccessTime" type { optional_type { item { type_id: UINT64 } } } } columns { name: "SeqNo" type { optional_type { item { type_id: UINT64 } } } } format: FORMAT_VALUE } QueryDiagnostics: "" } YdbStatus: SUCCESS ConsumedRu: 103
2025-11-03T16:56:50.641209Z node 3 :PQ_PARTITION_CHOOSER TRACE: partition_chooser_impl__abstract_chooser_actor.h:151: TPartitionChooser [3:7568544170873736174:2452] (SourceId=src, PreferedPartition=(NULL)) Selected from table PartitionId=(NULL) SeqNo=(NULL)
2025-11-03T16:56:50.641225Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [3:7568544170873736174:2452] (SourceId=src, PreferedPartition=(NULL)) RequestPQRB
2025-11-03T16:56:50.642917Z node 3 :PQ_PARTITION_CHOOSER TRACE: partition_chooser_impl__old_chooser_actor.h:101: StatePQRB, received event# 269877760, Sender [3:7568544170873736211:2452], Recipient [3:7568544170873736174:2452]: NKikimr::TEvTabletPipe::TEvClientConnected { TabletId: 72075186224037893 Status: OK ServerId: [3:7568544170873736212:3360] Leader: 1 Dead: 0 Generation: 1 VersionInfo:  }
2025-11-03T16:56:50.642977Z node 3 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1655: [72075186224037893][rt3.dc1--test-topic] pipe [3:7568544170873736211:2452] connected; active server actors: 1
2025-11-03T16:56:50.643121Z node 3 :PQ_PARTITION_CHOOSER TRACE: partition_chooser_impl__old_chooser_actor.h:101: StatePQRB, received event# 271187996, Sender [3:7568544170873736026:2434], Recipient [3:7568544170873736174:2452]: NKikimrPQ.TGetPartitionIdForWriteResponse PartitionId: 0
2025-11-03T16:56:50.643144Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [3:7568544170873736174:2452] (SourceId=src, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=src
2025-11-03T16:56:50.643159Z node 3 :PQ_PARTITION_CHOOSER TRACE: partition_chooser_impl__old_chooser_actor.h:113: TPartitionChooser [3:7568544170873736174:2452] (SourceId=src, PreferedPartition=(NULL)) OnPartitionChosen
2025-11-03T16:56:50.643174Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [3:7568544170873736174:2452] (SourceId=src, PreferedPartition=(NULL)) Update the table
2025-11-03T16:56:50.643481Z node 3 :PQ_PARTITION_CHOOSER TRACE: partition_chooser_impl__abstract_chooser_actor.h:212: StateUpdate, received event# 269877763, Sender [3:7568544170873736211:2452], Recipient [3:7568544170873736174:2452]: NKikimr::TEvTabletPipe::TEvClientDestroyed { TabletId: 72075186224037893 ClientId: [3:7568544170873736211:2452] ServerId: [3:7568544170873736212:3360] }
2025-11-03T16:56:50.669497Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1659: [72075186224037893][rt3.dc1--test-topic] pipe [3:7568544170873736211:2452] disconnected.
2025-11-03T16:56:50.669545Z node 3 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1670: [72075186224037893][rt3.dc1--test-topic] pipe [3:7568544170873736211:2452] disconnected; active server actors: 1
2025-11-03T16:56:50.669565Z node 3 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1695: [72075186224037893][rt3.dc1--test-topic] pipe [3:7568544170873736211:2452] disconnected no session
2025-11-03T16:56:50.708136Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [4:7568544170866189024:2388], Partition 0, Sender [0:0:0], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:56:50.708207Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:50.708232Z node 4 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:50.708262Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:50.708277Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:50.708290Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:50.708314Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:50.708375Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:50.708389Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:50.708411Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:50.738257Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:50.738328Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:50.738355Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:50.738387Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:50.738401Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:50.738414Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:50.738437Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:50.738496Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:50.738509Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:50.738530Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:50.787950Z node 3 :PQ_PARTITION_CHOOSER TRACE: partition_chooser_impl__abstract_chooser_actor.h:212: StateUpdate, received event# 271646721, Sender [3:7568544115039159497:2257], Recipient [3:7568544170873736174:2452]: NKikimrKqp.TEvQueryResponse Response { SessionId: "ydb://session/3?node_id=3&id=YWMyZWE1YjQtOGE5M2VlYTQtNmJlNTE0MmQtZWE0Mzk2NTk=" PreparedQuery: "72f7e762-c46fa14f-e3d2f842-88a42755" QueryParameters { Name: "$AccessTime" Type { Kind: Data Data { Scheme: 4 } } } QueryParameters { Name: "$CreateTime" Type { Kind: Data Data { Scheme: 4 } } } QueryParameters { Name: "$Hash" Type { Kind: Data Data { Scheme: 2 } } } QueryParameters { Name: "$Partition" Type { Kind: Data Data { Scheme: 2 } } } QueryParameters { Name: "$SeqNo" Type { Kind: Data Data { Scheme: 4 } } } QueryParameters { Name: "$SourceId" Type { Kind: Data Data { Scheme: 4608 } } } QueryParameters { Name: "$Topic" Type { Kind: Data Data { Scheme: 4608 } } } TxMeta { } QueryDiagnostics: "" } YdbStatus: SUCCESS ConsumedRu: 87
2025-11-03T16:56:50.788026Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [3:7568544170873736174:2452] (SourceId=src, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-11-03T16:56:50.788055Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [3:7568544170873736174:2452] (SourceId=src, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-11-03T16:56:50.788073Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [3:7568544170873736174:2452] (SourceId=src, PreferedPartition=(NULL)) Start idle
2025-11-03T16:56:50.788108Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-11-03T16:56:50.791244Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 4, Generation: 1
2025-11-03T16:56:50.792117Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 269877761, Sender [4:7568544170866189111:2433], Recipient [4:7568544170866189024:2388]: NKikimr::TEvTabletPipe::TEvServerConnected
2025-11-03T16:56:50.792156Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5330: HandleHook, processing event TEvTabletPipe::TEvServerConnected
2025-11-03T16:56:50.792172Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:2716: [PQ: 72075186224037892] Handle TEvTabletPipe::TEvServerConnected
2025-11-03T16:56:50.792202Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [3:7568544170873736238:2452], now have 1 active actors on pipe
2025-11-03T16:56:50.792231Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271187968, Sender [3:7568544170873736237:2452], Recipient [4:7568544170866189111:2433]
2025-11-03T16:56:50.792246Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5316: HandleHook, processing event TEvPersQueue::TEvRequest
2025-11-03T16:56:50.792296Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:56:50.792318Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:56:50.792382Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188498 (NKikimr::TEvPQ::TEvChangeOwner), Tablet [4:7568544170866189024:2388], Partition 0, Sender [4:7568544170866189024:2388], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:56:50.792416Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188498, Sender [4:7568544170866189024:2388], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvChangeOwner
2025-11-03T16:56:50.792433Z node 4 :PERSQUEUE TRACE: partition.h:642: StateIdle, processing event TEvPQ::TEvChangeOwner
2025-11-03T16:56:50.792449Z node 4 :PERSQUEUE TRACE: partition_write.cpp:154: [72075186224037892][Partition][0][StateIdle] TPartition::HandleOnWrite TEvChangeOwner.
2025-11-03T16:56:50.792469Z node 4 :PERSQUEUE TRACE: partition_write.cpp:873: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessChangeOwnerRequests.
2025-11-03T16:56:50.792482Z node 4 :PERSQUEUE TRACE: partition_write.cpp:107: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessChangeOwnerRequest.
2025-11-03T16:56:50.792525Z node 4 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src|19a23ec8-a3325427-b1fd9466-1d7db523_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src
2025-11-03T16:56:50.792545Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:50.792571Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:50.792592Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:50.792601Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-03T16:56:50.792640Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:50.792655Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:50.792708Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:50.792719Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:50.792735Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:50.792754Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=1
2025-11-03T16:56:50.792776Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-03T16:56:50.792834Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188562 (NKikimr::TEvPQ::TEvTxBatchComplete), Tablet [4:7568544170866189024:2388], Partition 0, Sender [4:7568544170866189065:2388], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:56:50.792864Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188562, Sender [4:7568544170866189065:2388], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvTxBatchComplete
2025-11-03T16:56:50.792902Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271188493, Sender [4:7568544170866189065:2388], Recipient [4:7568544170866189024:2388]: NKikimr::TEvPQ::TEvProxyResponse
2025-11-03T16:56:50.792918Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5335: HandleHook, processing event TEvPQ::TEvProxyResponse
2025-11-03T16:56:50.792943Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-03T16:56:50.800554Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271187968, Sender [3:7568544170873736237:2452], Recipient [4:7568544170866189111:2433]
2025-11-03T16:56:50.800582Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5316: HandleHook, processing event TEvPersQueue::TEvRequest
2025-11-03T16:56:50.800636Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:56:50.800660Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:56:50.800758Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188486 (NKikimr::TEvPQ::TEvGetMaxSeqNoRequest), Tablet [4:7568544170866189024:2388], Partition 0, Sender [4:7568544170866189024:2388], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:56:50.800798Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188486, Sender [4:7568544170866189024:2388], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvGetMaxSeqNoRequest
2025-11-03T16:56:50.800818Z node 4 :PERSQUEUE TRACE: partition.h:634: StateIdle, processing event TEvPQ::TEvGetMaxSeqNoRequest
2025-11-03T16:56:50.800889Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271188493, Sender [4:7568544170866189065:2388], Recipient [4:7568544170866189024:2388]: NKikimr::TEvPQ::TEvProxyResponse
2025-11-03T16:56:50.800907Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5335: HandleHook, processing event TEvPQ::TEvProxyResponse
2025-11-03T16:56:50.800932Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-03T16:56:50.801612Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1 partition: 0 MaxSeqNo: 0 sessionId: src|19a23ec8-a3325427-b1fd9466-1d7db523_0
2025-11-03T16:56:50.804654Z :INFO: [] MessageGroupId [src] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1762189010804 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-11-03T16:56:50.804783Z :INFO: [] MessageGroupId [src] SessionId [] Write session established. Init response: session_id: "src|19a23ec8-a3325427-b1fd9466-1d7db523_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-11-03T16:56:50.806843Z :INFO: [] MessageGroupId [src] SessionId [src|19a23ec8-a3325427-b1fd9466-1d7db523_0] Write session: close. Timeout = 0 ms
2025-11-03T16:56:50.806930Z :INFO: [] MessageGroupId [src] SessionId [src|19a23ec8-a3325427-b1fd9466-1d7db523_0] Write session will now close
2025-11-03T16:56:50.806983Z :DEBUG: [] MessageGroupId [src] SessionId [src|19a23ec8-a3325427-b1fd9466-1d7db523_0] Write session: aborting
2025-11-03T16:56:50.807489Z :INFO: [] MessageGroupId [src] SessionId [src|19a23ec8-a3325427-b1fd9466-1d7db523_0] Write session: gracefully shut down, all writes complete
2025-11-03T16:56:50.807538Z :DEBUG: [] MessageGroupId [src] SessionId [src|19a23ec8-a3325427-b1fd9466-1d7db523_0] Write session: destroy
2025-11-03T16:56:50.809086Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [4:7568544170866189024:2388], Partition 0, Sender [0:0:0], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:56:50.809149Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:50.809173Z node 4 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:50.809202Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:50.809217Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:50.809230Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:50.809252Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:50.809308Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:50.809321Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:50.809343Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
====TYdbPqTestRetryPolicy()
====TYdbPqTestRetryPolicy()
2025-11-03T16:56:50.822023Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId: src|19a23ec8-a3325427-b1fd9466-1d7db523_0 grpc read done: success: 0 data: 
2025-11-03T16:56:50.822061Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 1 sessionId: src|19a23ec8-a3325427-b1fd9466-1d7db523_0 grpc read failed
2025-11-03T16:56:50.822136Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 1 sessionId: src|19a23ec8-a3325427-b1fd9466-1d7db523_0 grpc closed
2025-11-03T16:56:50.822154Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1 sessionId: src|19a23ec8-a3325427-b1fd9466-1d7db523_0 is DEAD
2025-11-03T16:56:50.822672Z node 3 :PQ_PARTITION_CHOOSER TRACE: partition_chooser_impl__abstract_chooser_actor.h:278: StateIdle, received event# 65543, Sender [3:7568544170873736172:2452], Recipient [3:7568544170873736174:2452]: NActors::TEvents::TEvPoison
2025-11-03T16:56:50.822712Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-11-03T16:56:50.824722Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 269877764, Sender [4:7568544170866189111:2433], Recipient [4:7568544170866189024:2388]: NKikimr::TEvTabletPipe::TEvServerDisconnected
2025-11-03T16:56:50.824767Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5331: HandleHook, processing event TEvTabletPipe::TEvServerDisconnected
2025-11-03T16:56:50.824785Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:2729: [PQ: 72075186224037892] Handle TEvTabletPipe::TEvServerDisconnected
2025-11-03T16:56:50.824817Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [3:7568544170873736238:2452] destroyed
2025-11-03T16:56:50.824878Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188506 (NKikimr::TEvPQ::TEvPipeDisconnected), Tablet [4:7568544170866189024:2388], Partition 0, Sender [4:7568544170866189024:2388], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:56:50.824916Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188506, Sender [4:7568544170866189024:2388], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvPipeDisconnected
2025-11-03T16:56:50.824941Z node 4 :PERSQUEUE TRACE: partition.h:651: StateIdle, processing event TEvPQ::TEvPipeDisconnected
2025-11-03T16:56:50.824963Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-11-03T16:56:50.824983Z node 4 :PERSQUEUE TRACE: partition_write.cpp:873: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessChangeOwnerRequests.
2025-11-03T16:56:50.825002Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:50.825017Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:50.825031Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:50.825049Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:50.825110Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:50.825133Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:50.825153Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
===Write 10 messages into every writer
2025-11-03T16:56:50.839649Z :TWriteSession_SeqNoShift INFO: Enqueue message with sequence number 1
2025-11-03T16:56:50.840148Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:50.840216Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:50.840241Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:50.840307Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:50.840322Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:50.840336Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:50.840615Z :DEBUG: [/Root] MessageGroupId [test-message-group-id2] SessionId [] Write session: try to update token
2025-11-03T16:56:50.840360Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:50.840420Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:50.840433Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:50.840453Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:50.842910Z :INFO: [/Root] MessageGroupId [test-message-group-id2] SessionId [] Write session: Do CDS request
2025-11-03T16:56:50.843033Z :INFO: [/Root] MessageGroupId [test-message-group-id2] SessionId [] Do schedule cds request after 0 ms
2025-11-03T16:56:50.843179Z :DEBUG: [/Root] MessageGroupId [test-message-group-id1] SessionId [] Write session: try to update token
2025-11-03T16:56:50.843182Z :TWriteSession_SeqNoShift INFO: Wait for writer event
2025-11-03T16:56:50.843275Z :INFO: [/Root] MessageGroupId [test-message-group-id1] SessionId [] Write session: Do CDS request
2025-11-03T16:56:50.843312Z :INFO: [/Root] MessageGroupId [test-message-group-id1] SessionId [] Do schedule cds request after 0 ms
2025-11-03T16:56:50.843698Z :INFO: [/Root] MessageGroupId [test-message-group-id2] Running cds request ms
2025-11-03T16:56:50.843839Z :TWriteSession_SeqNoShift INFO: Wait for writer event
2025-11-03T16:56:50.844159Z :INFO: [/Root] MessageGroupId [test-message-group-id1] Running cds request ms
2025-11-03T16:56:50.862209Z :INFO: [/Root] MessageGroupId [test-message-group-id1] SessionId [] Got CDS response: 
write_sessions_clusters { clusters { endpoint: "localhost:13111" name: "dc1" available: true } clusters { endpoint: "localhost:14811" name: "dc2" available: true } primary_cluster_selection_reason: CLIENT_PREFERENCE } version: 1
2025-11-03T16:56:50.862296Z :INFO: [/Root] MessageGroupId [test-message-group-id1] SessionId [] Start write session. Will connect to endpoint: localhost:13111
2025-11-03T16:56:50.866967Z :INFO: [/Root] MessageGroupId [test-message-group-id2] SessionId [] Got CDS response: 
write_sessions_clusters { clusters { endpoint: "localhost:13111" name: "dc1" available: true } clusters { endpoint: "localhost:14811" name: "dc2" available: true } primary_cluster_selection_reason: CLIENT_PREFERENCE } version: 1
2025-11-03T16:56:50.867030Z :INFO: [/Root] MessageGroupId [test-message-group-id2] SessionId [] Start write session. Will connect to endpoint: localhost:13111
2025-11-03T16:56:50.887558Z :DEBUG: [/Root] MessageGroupId [test-message-group-id1] SessionId [] Write session: send init request: init_request { topic: "test-topic" message_group_id: "test-message-group-id1" preferred_cluster: "dc1" }
2025-11-03T16:56:50.888050Z :DEBUG: [/Root] MessageGroupId [test-message-group-id2] SessionId [] Write session: send init request: init_request { topic: "test-topic" message_group_id: "test-message-group-id2" preferred_cluster: "dc1" }
2025-11-03T16:56:50.886485Z node 3 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-11-03T16:56:50.886522Z node 3 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2
2025-11-03T16:56:50.886598Z node 3 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-11-03T16:56:50.886606Z node 3 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3
2025-11-03T16:56:50.888549Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "test-message-group-id1" preferred_cluster: "dc1" }
2025-11-03T16:56:50.888704Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2 topic: "test-topic" message_group_id: "test-message-group-id1" preferred_cluster: "dc1" from ipv6:[::1]:52486
2025-11-03T16:56:50.888721Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:52486 proto=v1  topic=test-topic durationSec=0
2025-11-03T16:56:50.888732Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-11-03T16:56:50.888798Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "test-message-group-id2" preferred_cluster: "dc1" }
2025-11-03T16:56:50.888866Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3 topic: "test-topic" message_group_id: "test-message-group-id2" preferred_cluster: "dc1" from ipv6:[::1]:52486
2025-11-03T16:56:50.888894Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:52486 proto=v1  topic=test-topic durationSec=0
2025-11-03T16:56:50.888899Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-11-03T16:56:50.890658Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2 sessionId:  describe result for acl check
2025-11-03T16:56:50.890781Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-11-03T16:56:50.890791Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-11-03T16:56:50.890801Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-11-03T16:56:50.890823Z node 3 :PQ_PARTITION_CHOOSER TRACE: partition_chooser_impl__abstract_chooser_actor.h:88: TPartitionChooser [3:7568544170873736259:2471] (SourceId=test-message-group-id1, PreferedPartition=(NULL)) InitTable: SourceId=test-message-group-id1 TopicsAreFirstClassCitizen=0 UseSrcIdMetaMappingInFirstClass=1
2025-11-03T16:56:50.890839Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [3:7568544170873736259:2471] (SourceId=test-message-group-id1, PreferedPartition=(NULL)) StartKqpSession
2025-11-03T16:56:50.893715Z node 3 :PQ_PARTITION_CHOOSER TRACE: partition_chooser_impl__abstract_chooser_actor.h:132: StateCreateKqpSession, received event# 271646728, Sender [3:7568544115039159497:2257], Recipient [3:7568544170873736259:2471]: NKikimrKqp.TEvCreateSessionResponse Error: "" Response { SessionId: "ydb://session/3?node_id=3&id=YmVjODI4NWQtOWUyYWI2ZGEtNDQ0MjJiMS01ZWU0ODkwZA==" NodeId: 3 } YdbStatus: SUCCESS ResourceExhausted: false
2025-11-03T16:56:50.893762Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [3:7568544170873736259:2471] (SourceId=test-message-group-id1, PreferedPartition=(NULL)) Select from the table
2025-11-03T16:56:50.896073Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3 sessionId:  describe result for acl check
2025-11-03T16:56:50.896234Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-11-03T16:56:50.896245Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-11-03T16:56:50.896253Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-11-03T16:56:50.896281Z node 3 :PQ_PARTITION_CHOOSER TRACE: partition_chooser_impl__abstract_chooser_actor.h:88: TPartitionChooser [3:7568544170873736266:2472] (SourceId=test-message-group-id2, PreferedPartition=(NULL)) InitTable: SourceId=test-message-group-id2 TopicsAreFirstClassCitizen=0 UseSrcIdMetaMappingInFirstClass=1
2025-11-03T16:56:50.896294Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [3:7568544170873736266:2472] (SourceId=test-message-group-id2, PreferedPartition=(NULL)) StartKqpSession
2025-11-03T16:56:50.898812Z node 3 :PQ_PARTITION_CHOOSER TRACE: partition_chooser_impl__abstract_chooser_actor.h:132: StateCreateKqpSession, received event# 271646728, Sender [3:7568544115039159497:2257], Recipient [3:7568544170873736266:2472]: NKikimrKqp.TEvCreateSessionResponse Error: "" Response { SessionId: "ydb://session/3?node_id=3&id=MjEzZjA1YmItNzViZWE0NGEtNGI2NWM4M2MtZGVmNDhlYjY=" NodeId: 3 } YdbStatus: SUCCESS ResourceExhausted: false
2025-11-03T16:56:50.898836Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [3:7568544170873736266:2472] (SourceId=test-message-group-id2, PreferedPartition=(NULL)) Select from the table
2025-11-03T16:56:50.909055Z node 3 :PQ_PARTITION_CHOOSER TRACE: partition_chooser_impl__abstract_chooser_actor.h:163: StateSelect, received event# 271646721, Sender [3:7568544115039159497:2257], Recipient [3:7568544170873736259:2471]: NKikimrKqp.TEvQueryResponse Response { SessionId: "ydb://session/3?node_id=3&id=YmVjODI4NWQtOWUyYWI2ZGEtNDQ0MjJiMS01ZWU0ODkwZA==" PreparedQuery: "442ea808-d7231069-9c6e0723-bcf815" QueryParameters { Name: "$Hash" Type { Kind: Data Data { Scheme: 2 } } } QueryParameters { Name: "$Topic" Type { Kind: Data Data { Scheme: 4608 } } } QueryParameters { Name: "$SourceId" Type { Kind: Data Data { Scheme: 4608 } } } TxMeta { id: "01k95acsyefsk0qx26g4tcxc7c" } YdbResults { columns { name: "Partition" type { optional_type { item { type_id: UINT32 } } } } columns { name: "CreateTime" type { optional_type { item { type_id: UINT64 } } } } columns { name: "AccessTime" type { optional_type { item { type_id: UINT64 } } } } columns { name: "SeqNo" type { optional_type { item { type_id: UINT64 } } } } format: FORMAT_VALUE } QueryDiagnostics: "" } YdbStatus: SUCCESS ConsumedRu: 1
2025-11-03T16:56:50.909179Z node 3 :PQ_PARTITION_CHOOSER TRACE: partition_chooser_impl__abstract_chooser_actor.h:151: TPartitionChooser [3:7568544170873736259:2471] (SourceId=test-message-group-id1, PreferedPartition=(NULL)) Selected from table PartitionId=(NULL) SeqNo=(NULL)
2025-11-03T16:56:50.909195Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [3:7568544170873736259:2471] (SourceId=test-message-group-id1, PreferedPartition=(NULL)) RequestPQRB
2025-11-03T16:56:50.912158Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [4:7568544170866189024:2388], Partition 0, Sender [0:0:0], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:56:50.912216Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:50.911780Z node 3 :PQ_PARTITION_CHOOSER TRACE: partition_chooser_impl__abstract_chooser_actor.h:163: StateSelect, received event# 271646721, Sender [3:7568544115039159497:2257], Recipient [3:7568544170873736266:2472]: NKikimrKqp.TEvQueryResponse Response { SessionId: "ydb://session/3?node_id=3&id=MjEzZjA1YmItNzViZWE0NGEtNGI2NWM4M2MtZGVmNDhlYjY=" PreparedQuery: "442ea808-d7231069-9c6e0723-bcf815" QueryParameters { Name: "$Hash" Type { Kind: Data Data { Scheme: 2 } } } QueryParameters { Name: "$Topic" Type { Kind: Data Data { Scheme: 4608 } } } QueryParameters { Name: "$SourceId" Type { Kind: Data Data { Scheme: 4608 } } } TxMeta { id: "01k95acsymc4jrkxj4q8py0r8h" } YdbResults { columns { name: "Partition" type { optional_type { item { type_id: UINT32 } } } } columns { name: "CreateTime" type { optional_type { item { type_id: UINT64 } } } } columns { name: "AccessTime" type { optional_type { item { type_id: UINT64 } } } } columns { name: "SeqNo" type { optional_type { item { type_id: UINT64 } } } } format: FORMAT_VALUE } QueryDiagnostics: "" } YdbStatus: SUCCESS ConsumedRu: 1
2025-11-03T16:56:50.912238Z node 4 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:50.911892Z node 3 :PQ_PARTITION_CHOOSER TRACE: partition_chooser_impl__abstract_chooser_actor.h:151: TPartitionChooser [3:7568544170873736266:2472] (SourceId=test-message-group-id2, PreferedPartition=(NULL)) Selected from table PartitionId=(NULL) SeqNo=(NULL)
2025-11-03T16:56:50.912271Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:50.912285Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:50.911907Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [3:7568544170873736266:2472] (SourceId=test-message-group-id2, PreferedPartition=(NULL)) RequestPQRB
2025-11-03T16:56:50.912295Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:50.912315Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:50.912370Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:50.912382Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:50.912403Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:50.912789Z node 3 :PQ_PARTITION_CHOOSER TRACE: partition_chooser_impl__old_chooser_actor.h:101: StatePQRB, received event# 269877760, Sender [3:7568544170873736295:2471], Recipient [3:7568544170873736259:2471]: NKikimr::TEvTabletPipe::TEvClientConnected { TabletId: 72075186224037893 Status: OK ServerId: [3:7568544170873736297:3393] Leader: 1 Dead: 0 Generation: 1 VersionInfo:  }
2025-11-03T16:56:50.912834Z node 3 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1655: [72075186224037893][rt3.dc1--test-topic] pipe [3:7568544170873736295:2471] connected; active server actors: 1
2025-11-03T16:56:50.913058Z node 3 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1655: [72075186224037893][rt3.dc1--test-topic] pipe [3:7568544170873736296:2472] connected; active server actors: 1
2025-11-03T16:56:50.913110Z node 3 :PQ_PARTITION_CHOOSER TRACE: partition_chooser_impl__old_chooser_actor.h:101: StatePQRB, received event# 269877760, Sender [3:7568544170873736296:2472], Recipient [3:7568544170873736266:2472]: NKikimr::TEvTabletPipe::TEvClientConnected { TabletId: 72075186224037893 Status: OK ServerId: [3:7568544170873736298:3394] Leader: 1 Dead: 0 Generation: 1 VersionInfo:  }
2025-11-03T16:56:50.913162Z node 3 :PQ_PARTITION_CHOOSER TRACE: partition_chooser_impl__old_chooser_actor.h:101: StatePQRB, received event# 271187996, Sender [3:7568544170873736026:2434], Recipient [3:7568544170873736259:2471]: NKikimrPQ.TGetPartitionIdForWriteResponse PartitionId: 0
2025-11-03T16:56:50.913185Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [3:7568544170873736259:2471] (SourceId=test-message-group-id1, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=test-message-group-id1
2025-11-03T16:56:50.913200Z node 3 :PQ_PARTITION_CHOOSER TRACE: partition_chooser_impl__old_chooser_actor.h:113: TPartitionChooser [3:7568544170873736259:2471] (SourceId=test-message-group-id1, PreferedPartition=(NULL)) OnPartitionChosen
2025-11-03T16:56:50.913215Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [3:7568544170873736259:2471] (SourceId=test-message-group-id1, PreferedPartition=(NULL)) Update the table
2025-11-03T16:56:50.913431Z node 3 :PQ_PARTITION_CHOOSER TRACE: partition_chooser_impl__abstract_chooser_actor.h:212: StateUpdate, received event# 269877763, Sender [3:7568544170873736295:2471], Recipient [3:7568544170873736259:2471]: NKikimr::TEvTabletPipe::TEvClientDestroyed { TabletId: 72075186224037893 ClientId: [3:7568544170873736295:2471] ServerId: [3:7568544170873736297:3393] }
2025-11-03T16:56:50.914520Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1659: [72075186224037893][rt3.dc1--test-topic] pipe [3:7568544170873736295:2471] disconnected.
2025-11-03T16:56:50.914542Z node 3 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1670: [72075186224037893][rt3.dc1--test-topic] pipe [3:7568544170873736295:2471] disconnected; active server actors: 1
2025-11-03T16:56:50.914569Z node 3 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1695: [72075186224037893][rt3.dc1--test-topic] pipe [3:7568544170873736295:2471] disconnected no session
2025-11-03T16:56:50.915347Z node 3 :PQ_PARTITION_CHOOSER TRACE: partition_chooser_impl__old_chooser_actor.h:101: StatePQRB, received event# 271187996, Sender [3:7568544170873736026:2434], Recipient [3:7568544170873736266:2472]: NKikimrPQ.TGetPartitionIdForWriteResponse PartitionId: 0
2025-11-03T16:56:50.915367Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [3:7568544170873736266:2472] (SourceId=test-message-group-id2, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=test-message-group-id2
2025-11-03T16:56:50.915379Z node 3 :PQ_PARTITION_CHOOSER TRACE: partition_chooser_impl__old_chooser_actor.h:113: TPartitionChooser [3:7568544170873736266:2472] (SourceId=test-message-group-id2, PreferedPartition=(NULL)) OnPartitionChosen
2025-11-03T16:56:50.915392Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [3:7568544170873736266:2472] (SourceId=test-message-group-id2, PreferedPartition=(NULL)) Update the table
2025-11-03T16:56:50.915590Z node 3 :PQ_PARTITION_CHOOSER TRACE: partition_chooser_impl__abstract_chooser_actor.h:212: StateUpdate, received event# 269877763, Sender [3:7568544170873736296:2472], Recipient [3:7568544170873736266:2472]: NKikimr::TEvTabletPipe::TEvClientDestroyed { TabletId: 72075186224037893 ClientId: [3:7568544170873736296:2472] ServerId: [3:7568544170873736298:3394] }
2025-11-03T16:56:50.916016Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1659: [72075186224037893][rt3.dc1--test-topic] pipe [3:7568544170873736296:2472] disconnected.
2025-11-03T16:56:50.916031Z node 3 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1670: [72075186224037893][rt3.dc1--test-topic] pipe [3:7568544170873736296:2472] disconnected; active server actors: 1
2025-11-03T16:56:50.916043Z node 3 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1695: [72075186224037893][rt3.dc1--test-topic] pipe [3:7568544170873736296:2472] disconnected no session
2025-11-03T16:56:50.927851Z node 3 :PQ_PARTITION_CHOOSER TRACE: partition_chooser_impl__abstract_chooser_actor.h:212: StateUpdate, received event# 271646721, Sender [3:7568544115039159497:2257], Recipient [3:7568544170873736259:2471]: NKikimrKqp.TEvQueryResponse Response { SessionId: "ydb://session/3?node_id=3&id=YmVjODI4NWQtOWUyYWI2ZGEtNDQ0MjJiMS01ZWU0ODkwZA==" PreparedQuery: "72f7e762-c46fa14f-e3d2f842-88a42755" QueryParameters { Name: "$AccessTime" Type { Kind: Data Data { Scheme: 4 } } } QueryParameters { Name: "$CreateTime" Type { Kind: Data Data { Scheme: 4 } } } QueryParameters { Name: "$Hash" Type { Kind: Data Data { Scheme: 2 } } } QueryParameters { Name: "$Partition" Type { Kind: Data Data { Scheme: 2 } } } QueryParameters { Name: "$SeqNo" Type { Kind: Data Data { Scheme: 4 } } } QueryParameters { Name: "$SourceId" Type { Kind: Data Data { Scheme: 4608 } } } QueryParameters { Name: "$Topic" Type { Kind: Data Data { Scheme: 4608 } } } TxMeta { } QueryDiagnostics: "" } YdbStatus: SUCCESS ConsumedRu: 1
2025-11-03T16:56:50.927895Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [3:7568544170873736259:2471] (SourceId=test-message-group-id1, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-11-03T16:56:50.927920Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [3:7568544170873736259:2471] (SourceId=test-message-group-id1, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-11-03T16:56:50.927941Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [3:7568544170873736259:2471] (SourceId=test-message-group-id1, PreferedPartition=(NULL)) Start idle
2025-11-03T16:56:50.927973Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-11-03T16:56:50.931755Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 269877761, Sender [4:7568544170866189114:2436], Recipient [4:7568544170866189024:2388]: NKikimr::TEvTabletPipe::TEvServerConnected
2025-11-03T16:56:50.931791Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5330: HandleHook, processing event TEvTabletPipe::TEvServerConnected
2025-11-03T16:56:50.931810Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:2716: [PQ: 72075186224037892] Handle TEvTabletPipe::TEvServerConnected
2025-11-03T16:56:50.931838Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [3:7568544170873736325:2471], now have 1 active actors on pipe
2025-11-03T16:56:50.932673Z node 3 :PQ_PARTITION_CHOOSER TRACE: partition_chooser_impl__abstract_chooser_actor.h:212: StateUpdate, received event# 271646721, Sender [3:7568544115039159497:2257], Recipient [3:7568544170873736266:2472]: NKikimrKqp.TEvQueryResponse Response { SessionId: "ydb://session/3?node_id=3&id=MjEzZjA1YmItNzViZWE0NGEtNGI2NWM4M2MtZGVmNDhlYjY=" PreparedQuery: "72f7e762-c46fa14f-e3d2f842-88a42755" QueryParameters { Name: "$AccessTime" Type { Kind: Data Data { Scheme: 4 } } } QueryParameters { Name: "$CreateTime" Type { Kind: Data Data { Scheme: 4 } } } QueryParameters { Name: "$Hash" Type { Kind: Data Data { Scheme: 2 } } } QueryParameters { Name: "$Partition" Type { Kind: Data Data { Scheme: 2 } } } QueryParameters { Name: "$SeqNo" Type { Kind: Data Data { Scheme: 4 } } } QueryParameters { Name: "$SourceId" Type { Kind: Data Data { Scheme: 4608 } } } QueryParameters { Name: "$Topic" Type { Kind: Data Data { Scheme: 4608 } } } TxMeta { } QueryDiagnostics: "" } YdbStatus: SUCCESS ConsumedRu: 1
2025-11-03T16:56:50.932708Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [3:7568544170873736266:2472] (SourceId=test-message-group-id2, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-11-03T16:56:50.932730Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [3:7568544170873736266:2472] (SourceId=test-message-group-id2, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-11-03T16:56:50.932744Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [3:7568544170873736266:2472] (SourceId=test-message-group-id2, PreferedPartition=(NULL)) Start idle
2025-11-03T16:56:50.932770Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-11-03T16:56:50.933135Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 4, Generation: 1
2025-11-03T16:56:50.933439Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271187968, Sender [3:7568544170873736324:2471], Recipient [4:7568544170866189114:2436]
2025-11-03T16:56:50.933465Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5316: HandleHook, processing event TEvPersQueue::TEvRequest
2025-11-03T16:56:50.933551Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:56:50.933577Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:56:50.933659Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188498 (NKikimr::TEvPQ::TEvChangeOwner), Tablet [4:7568544170866189024:2388], Partition 0, Sender [4:7568544170866189024:2388], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:56:50.933696Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188498, Sender [4:7568544170866189024:2388], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvChangeOwner
2025-11-03T16:56:50.933714Z node 4 :PERSQUEUE TRACE: partition.h:642: StateIdle, processing event TEvPQ::TEvChangeOwner
2025-11-03T16:56:50.933727Z node 4 :PERSQUEUE TRACE: partition_write.cpp:154: [72075186224037892][Partition][0][StateIdle] TPartition::HandleOnWrite TEvChangeOwner.
2025-11-03T16:56:50.933743Z node 4 :PERSQUEUE TRACE: partition_write.cpp:873: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessChangeOwnerRequests.
2025-11-03T16:56:50.933755Z node 4 :PERSQUEUE TRACE: partition_write.cpp:107: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessChangeOwnerRequest.
2025-11-03T16:56:50.934565Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 4, Generation: 1
2025-11-03T16:56:50.933821Z node 4 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie test-message-group-id1|f1b47779-84f57a92-ac9e6f8a-5d32ebe8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner test-message-group-id1
2025-11-03T16:56:50.933844Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:50.933866Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:50.933884Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:50.933895Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-03T16:56:50.933938Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:50.933953Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:50.934004Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:50.934014Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:50.934028Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:50.934046Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=1
2025-11-03T16:56:50.934071Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-03T16:56:50.934124Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188562 (NKikimr::TEvPQ::TEvTxBatchComplete), Tablet [4:7568544170866189024:2388], Partition 0, Sender [4:7568544170866189065:2388], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:56:50.934155Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188562, Sender [4:7568544170866189065:2388], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvTxBatchComplete
2025-11-03T16:56:50.934193Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271188493, Sender [4:7568544170866189065:2388], Recipient [4:7568544170866189024:2388]: NKikimr::TEvPQ::TEvProxyResponse
2025-11-03T16:56:50.934208Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5335: HandleHook, processing event TEvPQ::TEvProxyResponse
2025-11-03T16:56:50.934231Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-03T16:56:50.934321Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 269877761, Sender [4:7568544170866189115:2437], Recipient [4:7568544170866189024:2388]: NKikimr::TEvTabletPipe::TEvServerConnected
2025-11-03T16:56:50.934334Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5330: HandleHook, processing event TEvTabletPipe::TEvServerConnected
2025-11-03T16:56:50.934345Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:2716: [PQ: 72075186224037892] Handle TEvTabletPipe::TEvServerConnected
2025-11-03T16:56:50.934367Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [3:7568544170873736329:2472], now have 1 active actors on pipe
2025-11-03T16:56:50.934813Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271187968, Sender [3:7568544170873736328:2472], Recipient [4:7568544170866189115:2437]
2025-11-03T16:56:50.934833Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5316: HandleHook, processing event TEvPersQueue::TEvRequest
2025-11-03T16:56:50.934884Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:56:50.934905Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:56:50.934937Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271187968, Sender [3:7568544170873736324:2471], Recipient [4:7568544170866189114:2436]
2025-11-03T16:56:50.934949Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5316: HandleHook, processing event TEvPersQueue::TEvRequest
2025-11-03T16:56:50.934978Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:56:50.934990Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:56:50.935072Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188498 (NKikimr::TEvPQ::TEvChangeOwner), Tablet [4:7568544170866189024:2388], Partition 0, Sender [4:7568544170866189024:2388], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:56:50.935105Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188498, Sender [4:7568544170866189024:2388], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvChangeOwner
2025-11-03T16:56:50.935123Z node 4 :PERSQUEUE TRACE: partition.h:642: StateIdle, processing event TEvPQ::TEvChangeOwner
2025-11-03T16:56:50.935134Z node 4 :PERSQUEUE TRACE: partition_write.cpp:154: [72075186224037892][Partition][0][StateIdle] TPartition::HandleOnWrite TEvChangeOwner.
2025-11-03T16:56:50.935149Z node 4 :PERSQUEUE TRACE: partition_write.cpp:873: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessChangeOwnerRequests.
2025-11-03T16:56:50.935160Z node 4 :PERSQUEUE TRACE: partition_write.cpp:107: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessChangeOwnerRequest.
2025-11-03T16:56:50.935200Z node 4 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie test-message-group-id2|d956c290-47a73c9e-b109a607-e01775e1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner test-message-group-id2
2025-11-03T16:56:50.935212Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:50.935231Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:50.935248Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:50.935258Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-03T16:56:50.935286Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:50.935299Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:50.935339Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:50.935349Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:50.935364Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:50.935378Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=1
2025-11-03T16:56:50.935397Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-03T16:56:50.935447Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188486 (NKikimr::TEvPQ::TEvGetMaxSeqNoRequest), Tablet [4:7568544170866189024:2388], Partition 0, Sender [4:7568544170866189024:2388], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:56:50.935474Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188486, Sender [4:7568544170866189024:2388], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvGetMaxSeqNoRequest
2025-11-03T16:56:50.935487Z node 4 :PERSQUEUE TRACE: partition.h:634: StateIdle, processing event TEvPQ::TEvGetMaxSeqNoRequest
2025-11-03T16:56:50.935525Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188562 (NKikimr::TEvPQ::TEvTxBatchComplete), Tablet [4:7568544170866189024:2388], Partition 0, Sender [4:7568544170866189065:2388], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:56:50.935551Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188562, Sender [4:7568544170866189065:2388], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvTxBatchComplete
2025-11-03T16:56:50.935606Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271188493, Sender [4:7568544170866189065:2388], Recipient [4:7568544170866189024:2388]: NKikimr::TEvPQ::TEvProxyResponse
2025-11-03T16:56:50.935622Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5335: HandleHook, processing event TEvPQ::TEvProxyResponse
2025-11-03T16:56:50.935642Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-03T16:56:50.935706Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271188493, Sender [4:7568544170866189065:2388], Recipient [4:7568544170866189024:2388]: NKikimr::TEvPQ::TEvProxyResponse
2025-11-03T16:56:50.935717Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5335: HandleHook, processing event TEvPQ::TEvProxyResponse
2025-11-03T16:56:50.935734Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-03T16:56:50.937918Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2 partition: 0 MaxSeqNo: 0 sessionId: test-message-group-id1|f1b47779-84f57a92-ac9e6f8a-5d32ebe8_0
2025-11-03T16:56:50.938070Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271187968, Sender [3:7568544170873736328:2472], Recipient [4:7568544170866189115:2437]
2025-11-03T16:56:50.938104Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5316: HandleHook, processing event TEvPersQueue::TEvRequest
2025-11-03T16:56:50.938141Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:56:50.938161Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:56:50.938227Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188486 (NKikimr::TEvPQ::TEvGetMaxSeqNoRequest), Tablet [4:7568544170866189024:2388], Partition 0, Sender [4:7568544170866189024:2388], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:56:50.938259Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188486, Sender [4:7568544170866189024:2388], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvGetMaxSeqNoRequest
2025-11-03T16:56:50.938277Z node 4 :PERSQUEUE TRACE: partition.h:634: StateIdle, processing event TEvPQ::TEvGetMaxSeqNoRequest
2025-11-03T16:56:50.938329Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271188493, Sender [4:7568544170866189065:2388], Recipient [4:7568544170866189024:2388]: NKikimr::TEvPQ::TEvProxyResponse
2025-11-03T16:56:50.938346Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5335: HandleHook, processing event TEvPQ::TEvProxyResponse
2025-11-03T16:56:50.938367Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-03T16:56:50.938903Z :INFO: [/Root] MessageGroupId [test-message-group-id1] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1762189010938 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-11-03T16:56:50.939040Z :INFO: [/Root] MessageGroupId [test-message-group-id1] SessionId [] Write session established. Init response: session_id: "test-message-group-id1|f1b47779-84f57a92-ac9e6f8a-5d32ebe8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-11-03T16:56:50.939250Z :TWriteSession_SeqNoShift INFO: Got new continue token
2025-11-03T16:56:50.939347Z :DEBUG: [/Root] MessageGroupId [test-message-group-id1] SessionId [test-message-group-id1|f1b47779-84f57a92-ac9e6f8a-5d32ebe8_0] Write 1 messages with Id from 1 to 1
2025-11-03T16:56:50.939026Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3 partition: 0 MaxSeqNo: 0 sessionId: test-message-group-id2|d956c290-47a73c9e-b109a607-e01775e1_0
2025-11-03T16:56:50.939461Z :TWriteSession_SeqNoShift INFO: Wait for writer event
2025-11-03T16:56:50.939486Z :TWriteSession_SeqNoShift INFO: Got new continue token
2025-11-03T16:56:50.943567Z :DEBUG: [/Root] MessageGroupId [test-message-group-id1] SessionId [test-message-group-id1|f1b47779-84f57a92-ac9e6f8a-5d32ebe8_0] Write session: try to update token
2025-11-03T16:56:50.943637Z :DEBUG: [/Root] MessageGroupId [test-message-group-id1] SessionId [test-message-group-id1|f1b47779-84f57a92-ac9e6f8a-5d32ebe8_0] Send 1 message(s) (0 left), first sequence number is 1
2025-11-03T16:56:50.944190Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:50.944560Z :INFO: [/Root] MessageGroupId [test-message-group-id2] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1762189010944 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-11-03T16:56:50.944264Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:50.944289Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:50.944321Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:50.944336Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:50.944348Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:50.944373Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:50.944670Z :INFO: [/Root] MessageGroupId [test-message-group-id2] SessionId [] Write session established. Init response: session_id: "test-message-group-id2|d956c290-47a73c9e-b109a607-e01775e1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-11-03T16:56:50.944920Z :TWriteSession_SeqNoShift INFO: Got new continue token
2025-11-03T16:56:50.944434Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:50.944447Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:50.944467Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:50.946899Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: test-message-group-id1|f1b47779-84f57a92-ac9e6f8a-5d32ebe8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:56:50.947229Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:56:50.948344Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271187968, Sender [3:7568544170873736324:2471], Recipient [4:7568544170866189114:2436]
2025-11-03T16:56:50.948378Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5316: HandleHook, processing event TEvPersQueue::TEvRequest
2025-11-03T16:56:50.948436Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:56:50.948459Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:56:50.948546Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188507 (NKikimr::TEvPQ::TEvReserveBytes), Tablet [4:7568544170866189024:2388], Partition 0, Sender [4:7568544170866189024:2388], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:56:50.948629Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188507, Sender [4:7568544170866189024:2388], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvReserveBytes
2025-11-03T16:56:50.948658Z node 4 :PERSQUEUE TRACE: partition.h:650: StateIdle, processing event TEvPQ::TEvReserveBytes
2025-11-03T16:56:50.948683Z node 4 :PERSQUEUE TRACE: partition_write.cpp:220: [72075186224037892][Partition][0][StateIdle] TPartition::HandleOnWrite TEvReserveBytes.
2025-11-03T16:56:50.948718Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:50.948796Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271188493, Sender [4:7568544170866189065:2388], Recipient [4:7568544170866189024:2388]: NKikimr::TEvPQ::TEvProxyResponse
2025-11-03T16:56:50.949082Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:56:50.948816Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5335: HandleHook, processing event TEvPQ::TEvProxyResponse
2025-11-03T16:56:50.948846Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-11-03T16:56:50.949653Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271187968, Sender [3:7568544170873736324:2471], Recipient [4:7568544170866189114:2436]
2025-11-03T16:56:50.949671Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5316: HandleHook, processing event TEvPersQueue::TEvRequest
2025-11-03T16:56:50.949852Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:56:50.949870Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:56:50.950330Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0test-message-group-id1' SeqNo: 1 partNo : 0 messageNo: 1 size 98 offset: -1
2025-11-03T16:56:50.950413Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188480 (NKikimr::TEvPQ::TEvWrite), Tablet [4:7568544170866189024:2388], Partition 0, Sender [4:7568544170866189024:2388], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:56:50.950447Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188480, Sender [4:7568544170866189024:2388], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvWrite
2025-11-03T16:56:50.950465Z node 4 :PERSQUEUE TRACE: partition.h:628: StateIdle, processing event TEvPQ::TEvWrite
2025-11-03T16:56:50.950488Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:56:50.950538Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:50.950565Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:50.950584Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-03T16:56:50.950649Z node 4 :PERSQUEUE TRACE: partition_write.cpp:1168: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 process write for '\0test-message-group-id1' DisableDeduplication=0 SeqNo=1 LocalSeqNo=(NULL) InitialSeqNo=(NULL) EnableKafkaDeduplication=0 ProducerEpoch=(empty maybe)
2025-11-03T16:56:50.950734Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0test-message-group-id1' seqNo 1 partNo 0
2025-11-03T16:56:51.017641Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0test-message-group-id1' seqNo 1 partNo 0 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 188 count 1 nextOffset 1 batches 1
2025-11-03T16:56:51.017703Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:51.017725Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 1 items to delete old stuff
2025-11-03T16:56:51.017835Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 1 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest CmdDeleteRange { Range { From: "x0000000000" IncludeFrom: true To: "x0000000001" IncludeTo: false } }
2025-11-03T16:56:51.017850Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:51.018441Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 0,1 HeadOffset 0 endOffset 0 curOffset 1 d0000000000_00000000000000000000_00000_0000000001_00000? size 176 WTime 1762189011017
2025-11-03T16:56:51.018461Z node 4 :PERSQUEUE TRACE: partition_write.cpp:1459: [72075186224037892][Partition][0][StateIdle] TPartition::AddNewFastWriteBlob
2025-11-03T16:56:51.018559Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:51.018707Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188562 (NKikimr::TEvPQ::TEvTxBatchComplete), Tablet [4:7568544170866189024:2388], Partition 0, Sender [4:7568544170866189065:2388], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:56:51.018745Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188562, Sender [4:7568544170866189065:2388], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvTxBatchComplete
2025-11-03T16:56:51.018783Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [4:7568544170866189024:2388], Partition 0, Sender [0:0:0], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:56:51.018808Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:51.018824Z node 4 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:51.018849Z node 4 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:56:51.018884Z node 4 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-03T16:56:51.019034Z node 4 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 0 partNo 0 count 1 size 176
2025-11-03T16:56:51.019220Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 270794752, Sender [4:7568544170866189047:2388], Recipient [4:7568544170866189024:2388]: NKikimrClient.TKeyValueRequest Cookie: 1 CmdDeleteRange { Range { From: "x0000000000" IncludeFrom: true To: "x0000000001" IncludeTo: false } } CmdWrite { Key: "m0000000000p\000test-message-group-id1" Value: "\010\001\020\000\030\366\231\231\320\271\326\220\003 \366\231\231\320\271\326\220\003(\000H\001" StorageChannel: INLINE } CmdWrite { Key: "d0000000000_00000000000000000000_00000_0000000001_00000?" Value: "\022\000\010\000\020\000\030\001 \000(\234\0010\234\0018\000@\000\234\000\000\000\001\000\000\000\000\000\000\000\016\003h\246J\232\001\000\000\227g\246J\232\001\000\000\007\000\000\000\027\000\000test-message-group-id1\010\001\030\227\317\231\325\2443B\020ipv6:[::1]:52486P\001\342\007$\n\020ipv6:[::1]:52486\032\007unknown\"\007unknown\372\007\033\037\213\010\000\000\000\000\000\000\003\313M-.NLO\005\000\1770\275\266\007\000\000\000" StorageChannel: INLINE } CmdWrite { Key: "i0000000000" Value: "\030\000(\203\320\231\325\2443" StorageChannel: INLINE }
2025-11-03T16:56:51.019395Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 270794753, Sender [4:7568544175161156427:2388], Recipient [4:7568544170866189024:2388]: NKikimr::TEvKeyValue::TEvIntermediate
2025-11-03T16:56:51.026328Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 0 count 1 size 176 actorID [4:7568544170866189047:2388]
2025-11-03T16:56:51.026464Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 270795264 (NKikimr::TEvKeyValue::TEvResponse), Tablet [4:7568544170866189024:2388], Partition 0, Sender [4:7568544170866189047:2388], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:56:51.026619Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 270795264, Sender [4:7568544170866189047:2388], Recipient [4:7568544170866189065:2388]: NKikimrClient.TResponse Status: 1 DeleteRangeResult { Status: 0 } WriteResult { Status: 0 StatusFlags: 1 } WriteResult { Status: 0 StatusFlags: 1 } WriteResult { Status: 0 StatusFlags: 1 }
2025-11-03T16:56:51.026640Z node 4 :PERSQUEUE TRACE: partition.h:625: StateIdle, processing event TEvKeyValue::TEvResponse
2025-11-03T16:56:51.026658Z node 4 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-03T16:56:51.026683Z node 4 :PERSQUEUE TRACE: partition_write.cpp:518: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse.
2025-11-03T16:56:51.026725Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 121 WriteNewSizeFromSupportivePartitions# 0
2025-11-03T16:56:51.026742Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=1
2025-11-03T16:56:51.026786Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:56:51.026838Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0test-message-group-id1', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 1, partNo: 0, Offset: 0 is stored on disk
2025-11-03T16:56:51.026854Z node 4 :PERSQUEUE TRACE: partition_write.cpp:424: [72075186224037892][Partition][0][StateIdle] TPartition::SyncMemoryStateWithKVState.
2025-11-03T16:56:51.026852Z node 4 :PERSQUEUE TRACE: pq_l2_cache.h:116: StateFunc, received event# 271450112, Sender [4:7568544170866189047:2388], Recipient [4:7568544115031613334:2071]: NKikimr::NPQ::TEvPqCache::TEvCacheL2Request
2025-11-03T16:56:51.026889Z node 4 :PERSQUEUE TRACE: pq_l2_cache.h:119: StateFunc, processing event TEvPqCache::TEvCacheL2Request
2025-11-03T16:56:51.026962Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 0 suffix '63' size 176
2025-11-03T16:56:51.027127Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:923: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-11-03T16:56:51.027166Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:965: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-11-03T16:56:51.027190Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:51.027204Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:51.027217Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:51.027234Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:51.027274Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:51.027286Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:51.027306Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:51.027332Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:56:51.027415Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271188493, Sender [4:7568544170866189065:2388], Recipient [4:7568544170866189024:2388]: NKikimr::TEvPQ::TEvProxyResponse
2025-11-03T16:56:51.027438Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5335: HandleHook, processing event TEvPQ::TEvProxyResponse
2025-11-03T16:56:51.027466Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1  requestId: <none> cookie: 1
2025-11-03T16:56:51.027545Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188481 (NKikimr::TEvPQ::TEvRead), Tablet [4:7568544170866189024:2388], Partition 0, Sender [4:7568544170866189065:2388], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:56:51.027581Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188481, Sender [4:7568544170866189065:2388], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvRead
2025-11-03T16:56:51.027597Z node 4 :PERSQUEUE TRACE: partition.h:629: StateIdle, processing event TEvPQ::TEvRead
2025-11-03T16:56:51.027684Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188542 (NKikimr::NPQ::NReadQuoterEvents::TEvQuotaUpdated), Tablet [4:7568544170866189024:2388], Partition 0, Sender [4:7568544170866189068:2388], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:56:51.027728Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188542, Sender [4:7568544170866189068:2388], Recipient [4:7568544170866189065:2388]: NKikimr::NPQ::NReadQuoterEvents::TEvQuotaUpdated
2025-11-03T16:56:51.027746Z node 4 :PERSQUEUE TRACE: partition.h:669: StateIdle, processing event NReadQuoterEvents::TEvQuotaUpdated
2025-11-03T16:56:51.027783Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188539 (NKikimr::TEvPQ::TEvApproveReadQuota), Tablet [4:7568544170866189024:2388], Partition 0, Sender [4:7568544170866189068:2388], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:56:51.027815Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188539, Sender [4:7568544170866189068:2388], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvApproveReadQuota
2025-11-03T16:56:51.027836Z node 4 :PERSQUEUE TRACE: partition.h:630: StateIdle, processing event TEvPQ::TEvApproveReadQuota
2025-11-03T16:56:51.027867Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:880: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 partno 0 count 1 size 1024000 endOffset 1 max time lag 0ms effective offset 0
2025-11-03T16:56:51.028143Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:1105: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 176 count 1 last offset 0, current partition end offset: 1
2025-11-03T16:56:51.028182Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:1121: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-11-03T16:56:51.028234Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 0 partno 0 count 1 parts_count 0 source 1 size 176 accessed 0 times before, last time 2025-11-03T16:56:51.000000Z
2025-11-03T16:56:51.028272Z node 4 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 3. All 1 blobs are from cache.
2025-11-03T16:56:51.028336Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188496 (NKikimr::TEvPQ::TEvBlobResponse), Tablet [4:7568544170866189024:2388], Partition 0, Sender [4:7568544170866189047:2388], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:56:51.028370Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188496, Sender [4:7568544170866189047:2388], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvBlobResponse
2025-11-03T16:56:51.028390Z node 4 :PERSQUEUE TRACE: partition.h:627: StateIdle, processing event TEvPQ::TEvBlobResponse
2025-11-03T16:56:51.028398Z node 4 :PERSQUEUE TRACE: pq_l2_cache.h:116: StateFunc, received event# 271450112, Sender [4:7568544170866189047:2388], Recipient [4:7568544115031613334:2071]: NKikimr::NPQ::TEvPqCache::TEvCacheL2Request
2025-11-03T16:56:51.028417Z node 4 :PERSQUEUE TRACE: pq_l2_cache.h:119: StateFunc, processing event TEvPqCache::TEvCacheL2Request
2025-11-03T16:56:51.028199Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:56:51.028421Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:572: FormAnswer for 1 blobs
2025-11-03T16:56:51.028487Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 0 suffix '63'
2025-11-03T16:56:51.028591Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 0 totakecount 1 count 1 size 156 from pos 0 cbcount 1
2025-11-03T16:56:51.028680Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188493 (NKikimr::TEvPQ::TEvProxyResponse), Tablet [4:7568544170866189024:2388], Partition 0, Sender [4:7568544170866189065:2388], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:56:51.028715Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188493, Sender [4:7568544170866189065:2388], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvProxyResponse
2025-11-03T16:56:51.028734Z node 4 :PERSQUEUE TRACE: partition.h:646: StateIdle, processing event TEvPQ::TEvProxyResponse
2025-11-03T16:56:51.028754Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:1015: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1762189010947 queuesize 0 startOffset 0
2025-11-03T16:56:51.029138Z :DEBUG: [/Root] MessageGroupId [test-message-group-id1] SessionId [test-message-group-id1|f1b47779-84f57a92-ac9e6f8a-5d32ebe8_0] Write session got write response: sequence_numbers: 1 offsets: 0 already_written: false write_statistics { persist_duration_ms: 9 queued_in_partition_duration_ms: 69 }
2025-11-03T16:56:51.029197Z :DEBUG: [/Root] MessageGroupId [test-message-group-id1] SessionId [test-message-group-id1|f1b47779-84f57a92-ac9e6f8a-5d32ebe8_0] Write session: acknoledged message 1
2025-11-03T16:56:51.032075Z :TWriteSession_SeqNoShift INFO: Enqueue message with sequence number 1
2025-11-03T16:56:51.032335Z :DEBUG: [/Root] MessageGroupId [test-message-group-id2] SessionId [test-message-group-id2|d956c290-47a73c9e-b109a607-e01775e1_0] Write 1 messages with Id from 1 to 1
2025-11-03T16:56:51.032432Z :TWriteSession_SeqNoShift INFO: Wait for writer event
2025-11-03T16:56:51.032468Z :TWriteSession_SeqNoShift INFO: Got new continue token
2025-11-03T16:56:51.034213Z :DEBUG: [/Root] MessageGroupId [test-message-group-id2] SessionId [test-message-group-id2|d956c290-47a73c9e-b109a607-e01775e1_0] Write session: try to update token
2025-11-03T16:56:51.034270Z :DEBUG: [/Root] MessageGroupId [test-message-group-id2] SessionId [test-message-group-id2|d956c290-47a73c9e-b109a607-e01775e1_0] Send 1 message(s) (0 left), first sequence number is 1
2025-11-03T16:56:51.034987Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3 sessionId: test-message-group-id2|d956c290-47a73c9e-b109a607-e01775e1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:56:51.035210Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:56:51.036335Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271187968, Sender [3:7568544170873736328:2472], Recipient [4:7568544170866189115:2437]
2025-11-03T16:56:51.036367Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5316: HandleHook, processing event TEvPersQueue::TEvRequest
2025-11-03T16:56:51.036422Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:56:51.036448Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:56:51.036522Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188507 (NKikimr::TEvPQ::TEvReserveBytes), Tablet [4:7568544170866189024:2388], Partition 0, Sender [4:7568544170866189024:2388], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:56:51.036559Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188507, Sender [4:7568544170866189024:2388], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvReserveBytes
2025-11-03T16:56:51.036576Z node 4 :PERSQUEUE TRACE: partition.h:650: StateIdle, processing event TEvPQ::TEvReserveBytes
2025-11-03T16:56:51.036592Z node 4 :PERSQUEUE TRACE: partition_write.cpp:220: [72075186224037892][Partition][0][StateIdle] TPartition::HandleOnWrite TEvReserveBytes.
2025-11-03T16:56:51.036610Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:51.036669Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271188493, Sender [4:7568544170866189065:2388], Recipient [4:7568544170866189024:2388]: NKikimr::TEvPQ::TEvProxyResponse
2025-11-03T16:56:51.036688Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5335: HandleHook, processing event TEvPQ::TEvProxyResponse
2025-11-03T16:56:51.036704Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-11-03T16:56:51.037996Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:56:51.038391Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271187968, Sender [3:7568544170873736328:2472], Recipient [4:7568544170866189115:2437]
2025-11-03T16:56:51.038418Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5316: HandleHook, processing event TEvPersQueue::TEvRequest
2025-11-03T16:56:51.038472Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:56:51.038492Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:56:51.038542Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0test-message-group-id2' SeqNo: 1 partNo : 0 messageNo: 1 size 98 offset: -1
2025-11-03T16:56:51.038602Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188480 (NKikimr::TEvPQ::TEvWrite), Tablet [4:7568544170866189024:2388], Partition 0, Sender [4:7568544170866189024:2388], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:56:51.038635Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188480, Sender [4:7568544170866189024:2388], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvWrite
2025-11-03T16:56:51.038650Z node 4 :PERSQUEUE TRACE: partition.h:628: StateIdle, processing event TEvPQ::TEvWrite
2025-11-03T16:56:51.038665Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:56:51.038703Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:51.038724Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:51.038735Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-03T16:56:51.038811Z node 4 :PERSQUEUE TRACE: partition_write.cpp:1168: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 process write for '\0test-message-group-id2' DisableDeduplication=0 SeqNo=1 LocalSeqNo=(NULL) InitialSeqNo=(NULL) EnableKafkaDeduplication=0 ProducerEpoch=(empty maybe)
2025-11-03T16:56:51.038887Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0test-message-group-id2' seqNo 1 partNo 0
2025-11-03T16:56:51.039922Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0test-message-group-id2' seqNo 1 partNo 0 FormedBlobsCount 0 NewHead: Offset 1 PartNo 0 PackedSize 188 count 1 nextOffset 2 batches 1
2025-11-03T16:56:51.039953Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:51.039968Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 1 items to delete old stuff
2025-11-03T16:56:51.040103Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 1 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest CmdDeleteRange { Range { From: "x0000000000" IncludeFrom: true To: "x0000000001" IncludeTo: false } }
2025-11-03T16:56:51.040115Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:51.040500Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 1,1 HeadOffset 1 endOffset 1 curOffset 2 d0000000000_00000000000000000001_00000_0000000001_00000? size 176 WTime 1762189011040
2025-11-03T16:56:51.040516Z node 4 :PERSQUEUE TRACE: partition_write.cpp:1459: [72075186224037892][Partition][0][StateIdle] TPartition::AddNewFastWriteBlob
2025-11-03T16:56:51.040587Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:51.040673Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188562 (NKikimr::TEvPQ::TEvTxBatchComplete), Tablet [4:7568544170866189024:2388], Partition 0, Sender [4:7568544170866189065:2388], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:56:51.040704Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188562, Sender [4:7568544170866189065:2388], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvTxBatchComplete
2025-11-03T16:56:51.040723Z node 4 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-03T16:56:51.040811Z node 4 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 1 partNo 0 count 1 size 176
2025-11-03T16:56:51.040991Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 270794752, Sender [4:7568544170866189047:2388], Recipient [4:7568544170866189024:2388]: NKikimrClient.TKeyValueRequest Cookie: 2 CmdDeleteRange { Range { From: "x0000000000" IncludeFrom: true To: "x0000000001" IncludeTo: false } } CmdWrite { Key: "m0000000000p\000test-message-group-id2" Value: "\010\001\020\001\030\207\342\236\320\271\326\220\003 \207\342\236\320\271\326\220\003(\000H\001" StorageChannel: INLINE } CmdWrite { Key: "d0000000000_00000000000000000001_00000_0000000001_00000?" Value: "\022\000\010\001\020\000\030\001 \000(\234\0010\234\0018\000@\000\234\000\000\000\001\000\000\000\000\000\000\000\016^h\246J\232\001\000\000Xh\246J\232\001\000\000\007\000\000\000\027\000\000test-message-group-id2\010\001\030\330\320\231\325\2443B\020ipv6:[::1]:52486P\001\342\007$\n\020ipv6:[::1]:52486\032\007unknown\"\007unknown\372\007\033\037\213\010\000\000\000\000\000\000\003\313M-.NLO\005\000\1770\275\266\007\000\000\000" StorageChannel: INLINE } CmdWrite { Key: "i0000000000" Value: "\030\000(\336\320\231\325\2443" StorageChannel: INLINE }
2025-11-03T16:56:51.041159Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 270794753, Sender [4:7568544175161156434:2388], Recipient [4:7568544170866189024:2388]: NKikimr::TEvKeyValue::TEvIntermediate
2025-11-03T16:56:51.045687Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:51.045749Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:51.045774Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:51.045801Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:51.045815Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:51.045826Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:51.045848Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:51.045902Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:51.045915Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:51.045935Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:51.045482Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 1 count 1 size 176 actorID [4:7568544170866189047:2388]
2025-11-03T16:56:51.045569Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 270795264 (NKikimr::TEvKeyValue::TEvResponse), Tablet [4:7568544170866189024:2388], Partition 0, Sender [4:7568544170866189047:2388], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:56:51.045684Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 270795264, Sender [4:7568544170866189047:2388], Recipient [4:7568544170866189065:2388]: NKikimrClient.TResponse Status: 1 DeleteRangeResult { Status: 0 } WriteResult { Status: 0 StatusFlags: 1 } WriteResult { Status: 0 StatusFlags: 1 } WriteResult { Status: 0 StatusFlags: 1 }
2025-11-03T16:56:51.045703Z node 4 :PERSQUEUE TRACE: partition.h:625: StateIdle, processing event TEvKeyValue::TEvResponse
2025-11-03T16:56:51.045717Z node 4 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-03T16:56:51.045738Z node 4 :PERSQUEUE TRACE: partition_write.cpp:518: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse.
2025-11-03T16:56:51.045771Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 121 WriteNewSizeFromSupportivePartitions# 0
2025-11-03T16:56:51.045785Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=1
2025-11-03T16:56:51.045811Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:56:51.045846Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0test-message-group-id2', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 1, partNo: 0, Offset: 1 is stored on disk
2025-11-03T16:56:51.045862Z node 4 :PERSQUEUE TRACE: partition_write.cpp:424: [72075186224037892][Partition][0][StateIdle] TPartition::SyncMemoryStateWithKVState.
2025-11-03T16:56:51.046018Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:51.046033Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:51.046044Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:51.046060Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:51.046096Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:51.046108Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:51.046124Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:51.046142Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:56:51.046206Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271188493, Sender [4:7568544170866189065:2388], Recipient [4:7568544170866189024:2388]: NKikimr::TEvPQ::TEvProxyResponse
2025-11-03T16:56:51.046225Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5335: HandleHook, processing event TEvPQ::TEvProxyResponse
2025-11-03T16:56:51.046248Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1  requestId: <none> cookie: 1
2025-11-03T16:56:51.046882Z node 4 :PERSQUEUE TRACE: pq_l2_cache.h:116: StateFunc, received event# 271450112, Sender [4:7568544170866189047:2388], Recipient [4:7568544115031613334:2071]: NKikimr::NPQ::TEvPqCache::TEvCacheL2Request
2025-11-03T16:56:51.046910Z node 4 :PERSQUEUE TRACE: pq_l2_cache.h:119: StateFunc, processing event TEvPqCache::TEvCacheL2Request
2025-11-03T16:56:51.046968Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 1 partno 0 count 1 parts 0 suffix '63' size 176
2025-11-03T16:56:51.048095Z :DEBUG: [/Root] MessageGroupId [test-message-group-id2] SessionId [test-message-group-id2|d956c290-47a73c9e-b109a607-e01775e1_0] Write session got write response: sequence_numbers: 1 offsets: 1 already_written: false write_statistics { persist_duration_ms: 6 queued_in_partition_duration_ms: 1 }
2025-11-03T16:56:51.048149Z :DEBUG: [/Root] MessageGroupId [test-message-group-id2] SessionId [test-message-group-id2|d956c290-47a73c9e-b109a607-e01775e1_0] Write session: acknoledged message 1
2025-11-03T16:56:51.047288Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:56:51.052065Z :TWriteSession_SeqNoShift INFO: Enqueue message with sequence number 2
2025-11-03T16:56:51.052193Z :DEBUG: [/Root] MessageGroupId [test-message-group-id1] SessionId [test-message-group-id1|f1b47779-84f57a92-ac9e6f8a-5d32ebe8_0] Write 1 messages with Id from 2 to 2
2025-11-03T16:56:51.052275Z :TWriteSession_SeqNoShift INFO: Wait for writer event
2025-11-03T16:56:51.052310Z :TWriteSession_SeqNoShift INFO: Got new continue token
2025-11-03T16:56:51.056340Z :DEBUG: [/Root] MessageGroupId [test-message-group-id1] SessionId [test-message-group-id1|f1b47779-84f57a92-ac9e6f8a-5d32ebe8_0] Write session: try to update token
2025-11-03T16:56:51.056411Z :DEBUG: [/Root] MessageGroupId [test-message-group-id1] SessionId [test-message-group-id1|f1b47779-84f57a92-ac9e6f8a-5d32ebe8_0] Send 1 message(s) (0 left), first sequence number is 2
2025-11-03T16:56:51.059778Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: test-message-group-id1|f1b47779-84f57a92-ac9e6f8a-5d32ebe8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:56:51.060100Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:56:51.060854Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271187968, Sender [3:7568544170873736324:2471], Recipient [4:7568544170866189114:2436]
2025-11-03T16:56:51.060893Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5316: HandleHook, processing event TEvPersQueue::TEvRequest
2025-11-03T16:56:51.060944Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:56:51.060968Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:56:51.061040Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188507 (NKikimr::TEvPQ::TEvReserveBytes), Tablet [4:7568544170866189024:2388], Partition 0, Sender [4:7568544170866189024:2388], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:56:51.061075Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188507, Sender [4:7568544170866189024:2388], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvReserveBytes
2025-11-03T16:56:51.061107Z node 4 :PERSQUEUE TRACE: partition.h:650: StateIdle, processing event TEvPQ::TEvReserveBytes
2025-11-03T16:56:51.061122Z node 4 :PERSQUEUE TRACE: partition_write.cpp:220: [72075186224037892][Partition][0][StateIdle] TPartition::HandleOnWrite TEvReserveBytes.
2025-11-03T16:56:51.061138Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:51.061192Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271188493, Sender [4:7568544170866189065:2388], Recipient [4:7568544170866189024:2388]: NKikimr::TEvPQ::TEvProxyResponse
2025-11-03T16:56:51.061208Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5335: HandleHook, processing event TEvPQ::TEvProxyResponse
2025-11-03T16:56:51.061222Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 2  requestId: <none> cookie: 2
2025-11-03T16:56:51.064958Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:56:51.065476Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271187968, Sender [3:7568544170873736324:2471], Recipient [4:7568544170866189114:2436]
2025-11-03T16:56:51.065508Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5316: HandleHook, processing event TEvPersQueue::TEvRequest
2025-11-03T16:56:51.065570Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:56:51.065596Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:56:51.065652Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0test-message-group-id1' SeqNo: 2 partNo : 0 messageNo: 3 size 98 offset: -1
2025-11-03T16:56:51.065719Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188480 (NKikimr::TEvPQ::TEvWrite), Tablet [4:7568544170866189024:2388], Partition 0, Sender [4:7568544170866189024:2388], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:56:51.065773Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188480, Sender [4:7568544170866189024:2388], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvWrite
2025-11-03T16:56:51.065791Z node 4 :PERSQUEUE TRACE: partition.h:628: StateIdle, processing event TEvPQ::TEvWrite
2025-11-03T16:56:51.065805Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:56:51.065845Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:51.065864Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:51.065874Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-03T16:56:51.065926Z node 4 :PERSQUEUE TRACE: partition_write.cpp:1168: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 process write for '\0test-message-group-id1' DisableDeduplication=0 SeqNo=2 LocalSeqNo=1 InitialSeqNo=(NULL) EnableKafkaDeduplication=0 ProducerEpoch=(empty maybe)
2025-11-03T16:56:51.065987Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0test-message-group-id1' seqNo 2 partNo 0
2025-11-03T16:56:51.066836Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0test-message-group-id1' seqNo 2 partNo 0 FormedBlobsCount 0 NewHead: Offset 2 PartNo 0 PackedSize 188 count 1 nextOffset 3 batches 1
2025-11-03T16:56:51.066893Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:51.066907Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 1 items to delete old stuff
2025-11-03T16:56:51.066996Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 1 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest CmdDeleteRange { Range { From: "x0000000000" IncludeFrom: true To: "x0000000001" IncludeTo: false } }
2025-11-03T16:56:51.067008Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:51.067372Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 2,1 HeadOffset 2 endOffset 2 curOffset 3 d0000000000_00000000000000000002_00000_0000000001_00000? size 176 WTime 1762189011066
2025-11-03T16:56:51.067383Z node 4 :PERSQUEUE TRACE: partition_write.cpp:1459: [72075186224037892][Partition][0][StateIdle] TPartition::AddNewFastWriteBlob
2025-11-03T16:56:51.067454Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:51.067537Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188562 (NKikimr::TEvPQ::TEvTxBatchComplete), Tablet [4:7568544170866189024:2388], Partition 0, Sender [4:7568544170866189065:2388], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:56:51.067570Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188562, Sender [4:7568544170866189065:2388], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvTxBatchComplete
2025-11-03T16:56:51.067592Z node 4 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-03T16:56:51.067683Z node 4 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 2 partNo 0 count 1 size 176
2025-11-03T16:56:51.067842Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 270794752, Sender [4:7568544170866189047:2388], Recipient [4:7568544170866189024:2388]: NKikimrClient.TKeyValueRequest Cookie: 3 CmdDeleteRange { Range { From: "x0000000000" IncludeFrom: true To: "x0000000001" IncludeTo: false } } CmdWrite { Key: "m0000000000p\000test-message-group-id1" Value: "\010\002\020\002\030\236\267\240\320\271\326\220\003 \366\231\231\320\271\326\220\003(\000H\001" StorageChannel: INLINE } CmdWrite { Key: "d0000000000_00000000000000000002_00000_0000000001_00000?" Value: "\022\000\010\002\020\000\030\001 \000(\234\0010\234\0018\000@\000\234\000\000\000\002\000\000\000\000\000\000\000\016yh\246J\232\001\000\000lh\246J\232\001\000\000\007\000\000\000\027\000\000test-message-group-id1\010\002\030\354\320\231\325\2443B\020ipv6:[::1]:52486P\001\342\007$\n\020ipv6:[::1]:52486\032\007unknown\"\007unknown\372\007\033\037\213\010\000\000\000\000\000\000\003\313M-.NLO\005\000\1770\275\266\007\000\000\000" StorageChannel: INLINE } CmdWrite { Key: "i0000000000" Value: "\030\000(\371\320\231\325\2443" StorageChannel: INLINE }
2025-11-03T16:56:51.068013Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 270794753, Sender [4:7568544175161156437:2388], Recipient [4:7568544170866189024:2388]: NKikimr::TEvKeyValue::TEvIntermediate
2025-11-03T16:56:51.077439Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 2 count 1 size 176 actorID [4:7568544170866189047:2388]
2025-11-03T16:56:51.077562Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 270795264 (NKikimr::TEvKeyValue::TEvResponse), Tablet [4:7568544170866189024:2388], Partition 0, Sender [4:7568544170866189047:2388], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:56:51.077699Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 270795264, Sender [4:7568544170866189047:2388], Recipient [4:7568544170866189065:2388]: NKikimrClient.TResponse Status: 1 DeleteRangeResult { Status: 0 } WriteResult { Status: 0 StatusFlags: 1 } WriteResult { Status: 0 StatusFlags: 1 } WriteResult { Status: 0 StatusFlags: 1 }
2025-11-03T16:56:51.077720Z node 4 :PERSQUEUE TRACE: partition.h:625: StateIdle, processing event TEvKeyValue::TEvResponse
2025-11-03T16:56:51.077736Z node 4 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-03T16:56:51.077757Z node 4 :PERSQUEUE TRACE: partition_write.cpp:518: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse.
2025-11-03T16:56:51.077790Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 121 WriteNewSizeFromSupportivePartitions# 0
2025-11-03T16:56:51.077804Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=1
2025-11-03T16:56:51.077838Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:56:51.077874Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0test-message-group-id1', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 2, partNo: 0, Offset: 2 is stored on disk
2025-11-03T16:56:51.077890Z node 4 :PERSQUEUE TRACE: partition_write.cpp:424: [72075186224037892][Partition][0][StateIdle] TPartition::SyncMemoryStateWithKVState.
2025-11-03T16:56:51.078041Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:51.078054Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:51.078066Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:51.078085Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:51.078122Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:51.078133Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:51.078148Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:51.078165Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:56:51.078229Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271188493, Sender [4:7568544170866189065:2388], Recipient [4:7568544170866189024:2388]: NKikimr::TEvPQ::TEvProxyResponse
2025-11-03T16:56:51.078245Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5335: HandleHook, processing event TEvPQ::TEvProxyResponse
2025-11-03T16:56:51.078268Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 3  requestId: <none> cookie: 2
2025-11-03T16:56:51.078391Z node 4 :PERSQUEUE TRACE: pq_l2_cache.h:116: StateFunc, received event# 271450112, Sender [4:7568544170866189047:2388], Recipient [4:7568544115031613334:2071]: NKikimr::NPQ::TEvPqCache::TEvCacheL2Request
2025-11-03T16:56:51.078410Z node 4 :PERSQUEUE TRACE: pq_l2_cache.h:119: StateFunc, processing event TEvPqCache::TEvCacheL2Request
2025-11-03T16:56:51.078452Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 2 partno 0 count 1 parts 0 suffix '63' size 176
2025-11-03T16:56:51.080216Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:56:51.081223Z :DEBUG: [/Root] MessageGroupId [test-message-group-id1] SessionId [test-message-group-id1|f1b47779-84f57a92-ac9e6f8a-5d32ebe8_0] Write session got write response: sequence_numbers: 2 offsets: 2 already_written: false write_statistics { persist_duration_ms: 11 }
2025-11-03T16:56:51.081274Z :DEBUG: [/Root] MessageGroupId [test-message-group-id1] SessionId [test-message-group-id1|f1b47779-84f57a92-ac9e6f8a-5d32ebe8_0] Write session: acknoledged message 2
2025-11-03T16:56:51.084068Z :TWriteSession_SeqNoShift INFO: Enqueue message with sequence number 2
2025-11-03T16:56:51.085428Z :DEBUG: [/Root] MessageGroupId [test-message-group-id2] SessionId [test-message-group-id2|d956c290-47a73c9e-b109a607-e01775e1_0] Write 1 messages with Id from 2 to 2
2025-11-03T16:56:51.085542Z :TWriteSession_SeqNoShift INFO: Wait for writer event
2025-11-03T16:56:51.085581Z :TWriteSession_SeqNoShift INFO: Got new continue token
2025-11-03T16:56:51.088879Z :DEBUG: [/Root] MessageGroupId [test-message-group-id2] SessionId [test-message-group-id2|d956c290-47a73c9e-b109a607-e01775e1_0] Write session: try to update token
2025-11-03T16:56:51.088929Z :DEBUG: [/Root] MessageGroupId [test-message-group-id2] SessionId [test-message-group-id2|d956c290-47a73c9e-b109a607-e01775e1_0] Send 1 message(s) (0 left), first sequence number is 2
2025-11-03T16:56:51.089672Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3 sessionId: test-message-group-id2|d956c290-47a73c9e-b109a607-e01775e1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:56:51.089890Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:56:51.090384Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271187968, Sender [3:7568544170873736328:2472], Recipient [4:7568544170866189115:2437]
2025-11-03T16:56:51.090414Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5316: HandleHook, processing event TEvPersQueue::TEvRequest
2025-11-03T16:56:51.090459Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:56:51.090484Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:56:51.090548Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188507 (NKikimr::TEvPQ::TEvReserveBytes), Tablet [4:7568544170866189024:2388], Partition 0, Sender [4:7568544170866189024:2388], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:56:51.090591Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188507, Sender [4:7568544170866189024:2388], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvReserveBytes
2025-11-03T16:56:51.091992Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:56:51.090609Z node 4 :PERSQUEUE TRACE: partition.h:650: StateIdle, processing event TEvPQ::TEvReserveBytes
2025-11-03T16:56:51.090637Z node 4 :PERSQUEUE TRACE: partition_write.cpp:220: [72075186224037892][Partition][0][StateIdle] TPartition::HandleOnWrite TEvReserveBytes.
2025-11-03T16:56:51.090656Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:51.090711Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271188493, Sender [4:7568544170866189065:2388], Recipient [4:7568544170866189024:2388]: NKikimr::TEvPQ::TEvProxyResponse
2025-11-03T16:56:51.090728Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5335: HandleHook, processing event TEvPQ::TEvProxyResponse
2025-11-03T16:56:51.090743Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 2  requestId: <none> cookie: 2
2025-11-03T16:56:51.092442Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271187968, Sender [3:7568544170873736328:2472], Recipient [4:7568544170866189115:2437]
2025-11-03T16:56:51.092464Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5316: HandleHook, processing event TEvPersQueue::TEvRequest
2025-11-03T16:56:51.092513Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:56:51.092532Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:56:51.092577Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0test-message-group-id2' SeqNo: 2 partNo : 0 messageNo: 3 size 98 offset: -1
2025-11-03T16:56:51.092633Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188480 (NKikimr::TEvPQ::TEvWrite), Tablet [4:7568544170866189024:2388], Partition 0, Sender [4:7568544170866189024:2388], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:56:51.092668Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188480, Sender [4:7568544170866189024:2388], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvWrite
2025-11-03T16:56:51.092683Z node 4 :PERSQUEUE TRACE: partition.h:628: StateIdle, processing event TEvPQ::TEvWrite
2025-11-03T16:56:51.092696Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:56:51.092736Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:51.092756Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:51.092766Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-03T16:56:51.092821Z node 4 :PERSQUEUE TRACE: partition_write.cpp:1168: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 process write for '\0test-message-group-id2' DisableDeduplication=0 SeqNo=2 LocalSeqNo=1 InitialSeqNo=(NULL) EnableKafkaDeduplication=0 ProducerEpoch=(empty maybe)
2025-11-03T16:56:51.092880Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0test-message-group-id2' seqNo 2 partNo 0
2025-11-03T16:56:51.139029Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0test-message-group-id2' seqNo 2 partNo 0 FormedBlobsCount 0 NewHead: Offset 3 PartNo 0 PackedSize 188 count 1 nextOffset 4 batches 1
2025-11-03T16:56:51.139089Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:51.139103Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 1 items to delete old stuff
2025-11-03T16:56:51.139190Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 1 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest CmdDeleteRange { Range { From: "x0000000000" IncludeFrom: true To: "x0000000001" IncludeTo: false } }
2025-11-03T16:56:51.139201Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:51.139538Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 3,1 HeadOffset 3 endOffset 3 curOffset 4 d0000000000_00000000000000000003_00000_0000000001_00000? size 176 WTime 1762189011139
2025-11-03T16:56:51.139549Z node 4 :PERSQUEUE TRACE: partition_write.cpp:1459: [72075186224037892][Partition][0][StateIdle] TPartition::AddNewFastWriteBlob
2025-11-03T16:56:51.139615Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:51.139723Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188562 (NKikimr::TEvPQ::TEvTxBatchComplete), Tablet [4:7568544170866189024:2388], Partition 0, Sender [4:7568544170866189065:2388], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:56:51.139757Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188562, Sender [4:7568544170866189065:2388], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvTxBatchComplete
2025-11-03T16:56:51.139790Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [4:7568544170866189024:2388], Partition 0, Sender [0:0:0], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:56:51.139815Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:51.139830Z node 4 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:51.139848Z node 4 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:56:51.139864Z node 4 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-03T16:56:51.139948Z node 4 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 3 partNo 0 count 1 size 176
2025-11-03T16:56:51.140501Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 270794752, Sender [4:7568544170866189047:2388], Recipient [4:7568544170866189024:2388]: NKikimrClient.TKeyValueRequest Cookie: 4 CmdDeleteRange { Range { From: "x0000000000" IncludeFrom: true To: "x0000000001" IncludeTo: false } } CmdWrite { Key: "m0000000000p\000test-message-group-id2" Value: "\010\002\020\003\030\360\201\242\320\271\326\220\003 \207\342\236\320\271\326\220\003(\000H\001" StorageChannel: INLINE } CmdWrite { Key: "d0000000000_00000000000000000003_00000_0000000001_00000?" Value: "\022\000\010\003\020\000\030\001 \000(\234\0010\234\0018\000@\000\234\000\000\000\002\000\000\000\000\000\000\000\016\223h\246J\232\001\000\000\214h\246J\232\001\000\000\007\000\000\000\027\000\000test-message-group-id2\010\002\030\214\321\231\325\2443B\020ipv6:[::1]:52486P\001\342\007$\n\020ipv6:[::1]:52486\032\007unknown\"\007unknown\372\007\033\037\213\010\000\000\000\000\000\000\003\313M-.NLO\005\000\1770\275\266\007\000\000\000" StorageChannel: INLINE } CmdWrite { Key: "i0000000000" Value: "\030\000(\223\321\231\325\2443" StorageChannel: INLINE }
2025-11-03T16:56:51.140664Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 270794753, Sender [4:7568544175161156440:2388], Recipient [4:7568544170866189024:2388]: NKikimr::TEvKeyValue::TEvIntermediate
2025-11-03T16:56:51.143200Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 3 count 1 size 176 actorID [4:7568544170866189047:2388]
2025-11-03T16:56:51.143285Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 270795264 (NKikimr::TEvKeyValue::TEvResponse), Tablet [4:7568544170866189024:2388], Partition 0, Sender [4:7568544170866189047:2388], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:56:51.143404Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 270795264, Sender [4:7568544170866189047:2388], Recipient [4:7568544170866189065:2388]: NKikimrClient.TResponse Status: 1 DeleteRangeResult { Status: 0 } WriteResult { Status: 0 StatusFlags: 1 } WriteResult { Status: 0 StatusFlags: 1 } WriteResult { Status: 0 StatusFlags: 1 }
2025-11-03T16:56:51.143425Z node 4 :PERSQUEUE TRACE: partition.h:625: StateIdle, processing event TEvKeyValue::TEvResponse
2025-11-03T16:56:51.143440Z node 4 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-03T16:56:51.143476Z node 4 :PERSQUEUE TRACE: partition_write.cpp:518: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse.
2025-11-03T16:56:51.143512Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 121 WriteNewSizeFromSupportivePartitions# 0
2025-11-03T16:56:51.143527Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=1
2025-11-03T16:56:51.143554Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:56:51.143590Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0test-message-group-id2', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 2, partNo: 0, Offset: 3 is stored on disk
2025-11-03T16:56:51.143606Z node 4 :PERSQUEUE TRACE: partition_write.cpp:424: [72075186224037892][Partition][0][StateIdle] TPartition::SyncMemoryStateWithKVState.
2025-11-03T16:56:51.143753Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:51.143767Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:51.143780Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:51.143795Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:51.143826Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:51.143840Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:51.143854Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:51.143870Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:56:51.143921Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271188493, Sender [4:7568544170866189065:2388], Recipient [4:7568544170866189024:2388]: NKikimr::TEvPQ::TEvProxyResponse
2025-11-03T16:56:51.143939Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5335: HandleHook, processing event TEvPQ::TEvProxyResponse
2025-11-03T16:56:51.143960Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 3  requestId: <none> cookie: 2
2025-11-03T16:56:51.144784Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:56:51.145578Z :DEBUG: [/Root] MessageGroupId [test-message-group-id2] SessionId [test-message-group-id2|d956c290-47a73c9e-b109a607-e01775e1_0] Write session got write response: sequence_numbers: 2 offsets: 3 already_written: false write_statistics { persist_duration_ms: 4 queued_in_partition_duration_ms: 47 }
2025-11-03T16:56:51.145642Z :DEBUG: [/Root] MessageGroupId [test-message-group-id2] SessionId [test-message-group-id2|d956c290-47a73c9e-b109a607-e01775e1_0] Write session: acknoledged message 2
2025-11-03T16:56:51.144539Z node 4 :PERSQUEUE TRACE: pq_l2_cache.h:116: StateFunc, received event# 271450112, Sender [4:7568544170866189047:2388], Recipient [4:7568544115031613334:2071]: NKikimr::NPQ::TEvPqCache::TEvCacheL2Request
2025-11-03T16:56:51.144562Z node 4 :PERSQUEUE TRACE: pq_l2_cache.h:119: StateFunc, processing event TEvPqCache::TEvCacheL2Request
2025-11-03T16:56:51.144606Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 3 partno 0 count 1 parts 0 suffix '63' size 176
2025-11-03T16:56:51.148042Z :TWriteSession_SeqNoShift INFO: Enqueue message with sequence number 3
2025-11-03T16:56:51.148148Z :DEBUG: [/Root] MessageGroupId [test-message-group-id1] SessionId [test-message-group-id1|f1b47779-84f57a92-ac9e6f8a-5d32ebe8_0] Write 1 messages with Id from 3 to 3
2025-11-03T16:56:51.148224Z :TWriteSession_SeqNoShift INFO: Wait for writer event
2025-11-03T16:56:51.148259Z :TWriteSession_SeqNoShift INFO: Got new continue token
2025-11-03T16:56:51.148646Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:51.148715Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:51.148736Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:51.148769Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:51.148784Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:51.148797Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:51.148818Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:51.148874Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:51.148886Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:51.148909Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:51.152368Z :DEBUG: [/Root] MessageGroupId [test-message-group-id1] SessionId [test-message-group-id1|f1b47779-84f57a92-ac9e6f8a-5d32ebe8_0] Write session: try to update token
2025-11-03T16:56:51.152417Z :DEBUG: [/Root] MessageGroupId [test-message-group-id1] SessionId [test-message-group-id1|f1b47779-84f57a92-ac9e6f8a-5d32ebe8_0] Send 1 message(s) (0 left), first sequence number is 3
2025-11-03T16:56:51.153993Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: test-message-group-id1|f1b47779-84f57a92-ac9e6f8a-5d32ebe8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:56:51.154228Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:56:51.156154Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271187968, Sender [3:7568544170873736324:2471], Recipient [4:7568544170866189114:2436]
2025-11-03T16:56:51.156188Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5316: HandleHook, processing event TEvPersQueue::TEvRequest
2025-11-03T16:56:51.156243Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:56:51.156267Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:56:51.156349Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188507 (NKikimr::TEvPQ::TEvReserveBytes), Tablet [4:7568544170866189024:2388], Partition 0, Sender [4:7568544170866189024:2388], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:56:51.156388Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188507, Sender [4:7568544170866189024:2388], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvReserveBytes
2025-11-03T16:56:51.156406Z node 4 :PERSQUEUE TRACE: partition.h:650: StateIdle, processing event TEvPQ::TEvReserveBytes
2025-11-03T16:56:51.156421Z node 4 :PERSQUEUE TRACE: partition_write.cpp:220: [72075186224037892][Partition][0][StateIdle] TPartition::HandleOnWrite TEvReserveBytes.
2025-11-03T16:56:51.156439Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:51.156494Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271188493, Sender [4:7568544170866189065:2388], Recipient [4:7568544170866189024:2388]: NKikimr::TEvPQ::TEvProxyResponse
2025-11-03T16:56:51.156512Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5335: HandleHook, processing event TEvPQ::TEvProxyResponse
2025-11-03T16:56:51.156527Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 4  requestId: <none> cookie: 3
2025-11-03T16:56:51.161510Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:56:51.163566Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271187968, Sender [3:7568544170873736324:2471], Recipient [4:7568544170866189114:2436]
2025-11-03T16:56:51.163596Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5316: HandleHook, processing event TEvPersQueue::TEvRequest
2025-11-03T16:56:51.163664Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:56:51.163699Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:56:51.163748Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0test-message-group-id1' SeqNo: 3 partNo : 0 messageNo: 5 size 98 offset: -1
2025-11-03T16:56:51.163841Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188480 (NKikimr::TEvPQ::TEvWrite), Tablet [4:7568544170866189024:2388], Partition 0, Sender [4:7568544170866189024:2388], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:56:51.163877Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188480, Sender [4:7568544170866189024:2388], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvWrite
2025-11-03T16:56:51.163893Z node 4 :PERSQUEUE TRACE: partition.h:628: StateIdle, processing event TEvPQ::TEvWrite
2025-11-03T16:56:51.163906Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:56:51.163947Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:51.163967Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:51.163991Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-03T16:56:51.164044Z node 4 :PERSQUEUE TRACE: partition_write.cpp:1168: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 process write for '\0test-message-group-id1' DisableDeduplication=0 SeqNo=3 LocalSeqNo=2 InitialSeqNo=(NULL) EnableKafkaDeduplication=0 ProducerEpoch=(empty maybe)
2025-11-03T16:56:51.164101Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0test-message-group-id1' seqNo 3 partNo 0
2025-11-03T16:56:51.164971Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0test-message-group-id1' seqNo 3 partNo 0 FormedBlobsCount 0 NewHead: Offset 4 PartNo 0 PackedSize 188 count 1 nextOffset 5 batches 1
2025-11-03T16:56:51.165017Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:51.165032Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 1 items to delete old stuff
2025-11-03T16:56:51.165126Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 1 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest CmdDeleteRange { Range { From: "x0000000000" IncludeFrom: true To: "x0000000001" IncludeTo: false } }
2025-11-03T16:56:51.165138Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:51.165501Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 4,1 HeadOffset 4 endOffset 4 curOffset 5 d0000000000_00000000000000000004_00000_0000000001_00000? size 176 WTime 1762189011165
2025-11-03T16:56:51.165512Z node 4 :PERSQUEUE TRACE: partition_write.cpp:1459: [72075186224037892][Partition][0][StateIdle] TPartition::AddNewFastWriteBlob
2025-11-03T16:56:51.165579Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:51.165669Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188562 (NKikimr::TEvPQ::TEvTxBatchComplete), Tablet [4:7568544170866189024:2388], Partition 0, Sender [4:7568544170866189065:2388], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:56:51.165705Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188562, Sender [4:7568544170866189065:2388], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvTxBatchComplete
2025-11-03T16:56:51.165739Z node 4 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-03T16:56:51.165831Z node 4 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 4 partNo 0 count 1 size 176
2025-11-03T16:56:51.165999Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 270794752, Sender [4:7568544170866189047:2388], Recipient [4:7568544170866189024:2388]: NKikimrClient.TKeyValueRequest Cookie: 5 CmdDeleteRange { Range { From: "x0000000000" IncludeFrom: true To: "x0000000001" IncludeTo: false } } CmdWrite { Key: "m0000000000p\000test-message-group-id1" Value: "\010\003\020\004\030\370\265\246\320\271\326\220\003 \366\231\231\320\271\326\220\003(\000H\001" StorageChannel: INLINE } CmdWrite { Key: "d0000000000_00000000000000000004_00000_0000000001_00000?" Value: "\022\000\010\004\020\000\030\001 \000(\234\0010\234\0018\000@\000\234\000\000\000\003\000\000\000\000\000\000\000\016\333h\246J\232\001\000\000\314h\246J\232\001\000\000\007\000\000\000\027\000\000test-message-group-id1\010\003\030\314\321\231\325\2443B\020ipv6:[::1]:52486P\001\342\007$\n\020ipv6:[::1]:52486\032\007unknown\"\007unknown\372\007\033\037\213\010\000\000\000\000\000\000\003\313M-.NLO\005\000\1770\275\266\007\000\000\000" StorageChannel: INLINE } CmdWrite { Key: "i0000000000" Value: "\030\000(\333\321\231\325\2443" StorageChannel: INLINE }
2025-11-03T16:56:51.166163Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 270794753, Sender [4:7568544175161156444:2388], Recipient [4:7568544170866189024:2388]: NKikimr::TEvKeyValue::TEvIntermediate
2025-11-03T16:56:51.175919Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 4 count 1 size 176 actorID [4:7568544170866189047:2388]
2025-11-03T16:56:51.176043Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 270795264 (NKikimr::TEvKeyValue::TEvResponse), Tablet [4:7568544170866189024:2388], Partition 0, Sender [4:7568544170866189047:2388], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:56:51.176184Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 270795264, Sender [4:7568544170866189047:2388], Recipient [4:7568544170866189065:2388]: NKikimrClient.TResponse Status: 1 DeleteRangeResult { Status: 0 } WriteResult { Status: 0 StatusFlags: 1 } WriteResult { Status: 0 StatusFlags: 1 } WriteResult { Status: 0 StatusFlags: 1 }
2025-11-03T16:56:51.176209Z node 4 :PERSQUEUE TRACE: partition.h:625: StateIdle, processing event TEvKeyValue::TEvResponse
2025-11-03T16:56:51.176224Z node 4 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-03T16:56:51.176248Z node 4 :PERSQUEUE TRACE: partition_write.cpp:518: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse.
2025-11-03T16:56:51.176284Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 121 WriteNewSizeFromSupportivePartitions# 0
2025-11-03T16:56:51.176300Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=1
2025-11-03T16:56:51.176337Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:56:51.176373Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0test-message-group-id1', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 3, partNo: 0, Offset: 4 is stored on disk
2025-11-03T16:56:51.176391Z node 4 :PERSQUEUE TRACE: partition_write.cpp:424: [72075186224037892][Partition][0][StateIdle] TPartition::SyncMemoryStateWithKVState.
2025-11-03T16:56:51.177206Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:56:51.176538Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:51.176559Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:51.176570Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:51.176586Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:51.176622Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:51.176635Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:51.176652Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:51.176668Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:56:51.176733Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271188493, Sender [4:7568544170866189065:2388], Recipient [4:7568544170866189024:2388]: NKikimr::TEvPQ::TEvProxyResponse
2025-11-03T16:56:51.176753Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5335: HandleHook, processing event TEvPQ::TEvProxyResponse
2025-11-03T16:56:51.176779Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 5  requestId: <none> cookie: 3
2025-11-03T16:56:51.176922Z node 4 :PERSQUEUE TRACE: pq_l2_cache.h:116: StateFunc, received event# 271450112, Sender [4:7568544170866189047:2388], Recipient [4:7568544115031613334:2071]: NKikimr::NPQ::TEvPqCache::TEvCacheL2Request
2025-11-03T16:56:51.176942Z node 4 :PERSQUEUE TRACE: pq_l2_cache.h:119: StateFunc, processing event TEvPqCache::TEvCacheL2Request
2025-11-03T16:56:51.176993Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 4 partno 0 count 1 parts 0 suffix '63' size 176
2025-11-03T16:56:51.181152Z :DEBUG: [/Root] MessageGroupId [test-message-group-id1] SessionId [test-message-group-id1|f1b47779-84f57a92-ac9e6f8a-5d32ebe8_0] Write session got write response: sequence_numbers: 3 offsets: 4 already_written: false write_statistics { persist_duration_ms: 11 queued_in_partition_duration_ms: 1 }
2025-11-03T16:56:51.181197Z :DEBUG: [/Root] MessageGroupId [test-message-group-id1] SessionId [test-message-group-id1|f1b47779-84f57a92-ac9e6f8a-5d32ebe8_0] Write session: acknoledged message 3
2025-11-03T16:56:51.185222Z :TWriteSession_SeqNoShift INFO: Enqueue message with sequence number 3
2025-11-03T16:56:51.185335Z :DEBUG: [/Root] MessageGroupId [test-message-group-id2] SessionId [test-message-group-id2|d956c290-47a73c9e-b109a607-e01775e1_0] Write 1 messages with Id from 3 to 3
2025-11-03T16:56:51.185466Z :TWriteSession_SeqNoShift INFO: Wait for writer event
2025-11-03T16:56:51.185506Z :TWriteSession_SeqNoShift INFO: Got new continue token
2025-11-03T16:56:51.188158Z :DEBUG: [/Root] MessageGroupId [test-message-group-id2] SessionId [test-message-group-id2|d956c290-47a73c9e-b109a607-e01775e1_0] Write session: try to update token
2025-11-03T16:56:51.188223Z :DEBUG: [/Root] MessageGroupId [test-message-group-id2] SessionId [test-message-group-id2|d956c290-47a73c9e-b109a607-e01775e1_0] Send 1 message(s) (0 left), first sequence number is 3
2025-11-03T16:56:51.188898Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3 sessionId: test-message-group-id2|d956c290-47a73c9e-b109a607-e01775e1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:56:51.189172Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:56:51.190161Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271187968, Sender [3:7568544170873736328:2472], Recipient [4:7568544170866189115:2437]
2025-11-03T16:56:51.190192Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5316: HandleHook, processing event TEvPersQueue::TEvRequest
2025-11-03T16:56:51.190238Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:56:51.190261Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:56:51.190328Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188507 (NKikimr::TEvPQ::TEvReserveBytes), Tablet [4:7568544170866189024:2388], Partition 0, Sender [4:7568544170866189024:2388], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:56:51.190364Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188507, Sender [4:7568544170866189024:2388], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvReserveBytes
2025-11-03T16:56:51.190382Z node 4 :PERSQUEUE TRACE: partition.h:650: StateIdle, processing event TEvPQ::TEvReserveBytes
2025-11-03T16:56:51.190397Z node 4 :PERSQUEUE TRACE: partition_write.cpp:220: [72075186224037892][Partition][0][StateIdle] TPartition::HandleOnWrite TEvReserveBytes.
2025-11-03T16:56:51.190414Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:51.190467Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271188493, Sender [4:7568544170866189065:2388], Recipient [4:7568544170866189024:2388]: NKikimr::TEvPQ::TEvProxyResponse
2025-11-03T16:56:51.190484Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5335: HandleHook, processing event TEvPQ::TEvProxyResponse
2025-11-03T16:56:51.190500Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 4  requestId: <none> cookie: 3
2025-11-03T16:56:51.191750Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:56:51.192175Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271187968, Sender [3:7568544170873736328:2472], Recipient [4:7568544170866189115:2437]
2025-11-03T16:56:51.192195Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5316: HandleHook, processing event TEvPersQueue::TEvRequest
2025-11-03T16:56:51.192242Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:56:51.192262Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:56:51.192310Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0test-message-group-id2' SeqNo: 3 partNo : 0 messageNo: 5 size 98 offset: -1
2025-11-03T16:56:51.192367Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188480 (NKikimr::TEvPQ::TEvWrite), Tablet [4:7568544170866189024:2388], Partition 0, Sender [4:7568544170866189024:2388], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:56:51.192397Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188480, Sender [4:7568544170866189024:2388], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvWrite
2025-11-03T16:56:51.192425Z node 4 :PERSQUEUE TRACE: partition.h:628: StateIdle, processing event TEvPQ::TEvWrite
2025-11-03T16:56:51.192437Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:56:51.192479Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:51.192499Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:51.192510Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-03T16:56:51.192562Z node 4 :PERSQUEUE TRACE: partition_write.cpp:1168: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 process write for '\0test-message-group-id2' DisableDeduplication=0 SeqNo=3 LocalSeqNo=2 InitialSeqNo=(NULL) EnableKafkaDeduplication=0 ProducerEpoch=(empty maybe)
2025-11-03T16:56:51.192619Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0test-message-group-id2' seqNo 3 partNo 0
2025-11-03T16:56:51.231188Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 270794757, Sender [0:0:0], Recipient [2:7568544108397207262:2383]: NKikimr::TEvKeyValue::TEvPeriodicRefresh
2025-11-03T16:56:51.240663Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0test-message-group-id2' seqNo 3 partNo 0 FormedBlobsCount 0 NewHead: Offset 5 PartNo 0 PackedSize 188 count 1 nextOffset 6 batches 1
2025-11-03T16:56:51.240739Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:51.240753Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 1 items to delete old stuff
2025-11-03T16:56:51.240843Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 1 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest CmdDeleteRange { Range { From: "x0000000000" IncludeFrom: true To: "x0000000001" IncludeTo: false } }
2025-11-03T16:56:51.240853Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:51.241183Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 5,1 HeadOffset 5 endOffset 5 curOffset 6 d0000000000_00000000000000000005_00000_0000000001_00000? size 176 WTime 1762189011234
2025-11-03T16:56:51.241193Z node 4 :PERSQUEUE TRACE: partition_write.cpp:1459: [72075186224037892][Partition][0][StateIdle] TPartition::AddNewFastWriteBlob
2025-11-03T16:56:51.241259Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:51.241377Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188562 (NKikimr::TEvPQ::TEvTxBatchComplete), Tablet [4:7568544170866189024:2388], Partition 0, Sender [4:7568544170866189065:2388], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:56:51.241413Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188562, Sender [4:7568544170866189065:2388], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvTxBatchComplete
2025-11-03T16:56:51.241435Z node 4 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-03T16:56:51.241517Z node 4 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 5 partNo 0 count 1 size 176
2025-11-03T16:56:51.241688Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 270794752, Sender [4:7568544170866189047:2388], Recipient [4:7568544170866189024:2388]: NKikimrClient.TKeyValueRequest Cookie: 6 CmdDeleteRange { Range { From: "x0000000000" IncludeFrom: true To: "x0000000001" IncludeTo: false } } CmdWrite { Key: "m0000000000p\000test-message-group-id2" Value: "\010\003\020\005\030\315\221\250\320\271\326\220\003 \207\342\236\320\271\326\220\003(\000H\001" StorageChannel: INLINE } CmdWrite { Key: "d0000000000_00000000000000000005_00000_0000000001_00000?" Value: "\022\000\010\005\020\000\030\001 \000(\234\0010\234\0018\000@\000\234\000\000\000\003\000\000\000\000\000\000\000\016\370h\246J\232\001\000\000\361h\246J\232\001\000\000\007\000\000\000\027\000\000test-message-group-id2\010\003\030\361\321\231\325\2443B\020ipv6:[::1]:52486P\001\342\007$\n\020ipv6:[::1]:52486\032\007unknown\"\007unknown\372\007\033\037\213\010\000\000\000\000\000\000\003\313M-.NLO\005\000\1770\275\266\007\000\000\000" StorageChannel: INLINE } CmdWrite { Key: "i0000000000" Value: "\030\000(\370\321\231\325\2443" StorageChannel: INLINE }
2025-11-03T16:56:51.245127Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 65538, Sender [0:0:0], Recipient [2:7568544108397207262:2383]: NActors::TEvents::TEvWakeup
2025-11-03T16:56:51.241846Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 270794753, Sender [4:7568544175161156447:2388], Recipient [4:7568544170866189024:2388]: NKikimr::TEvKeyValue::TEvIntermediate
2025-11-03T16:56:51.244397Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [4:7568544170866189024:2388], Partition 0, Sender [0:0:0], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:56:51.244444Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:51.244462Z node 4 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:51.244486Z node 4 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:56:51.249944Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:51.250005Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:51.250032Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:51.250065Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:51.250079Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:51.250090Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:51.250111Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:51.250432Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:51.250445Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:51.250465Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:51.255739Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 5 count 1 size 176 actorID [4:7568544170866189047:2388]
2025-11-03T16:56:51.255847Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 270795264 (NKikimr::TEvKeyValue::TEvResponse), Tablet [4:7568544170866189024:2388], Partition 0, Sender [4:7568544170866189047:2388], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:56:51.255907Z node 4 :PERSQUEUE TRACE: pq_l2_cache.h:116: StateFunc, received event# 271450112, Sender [4:7568544170866189047:2388], Recipient [4:7568544115031613334:2071]: NKikimr::NPQ::TEvPqCache::TEvCacheL2Request
2025-11-03T16:56:51.255931Z node 4 :PERSQUEUE TRACE: pq_l2_cache.h:119: StateFunc, processing event TEvPqCache::TEvCacheL2Request
2025-11-03T16:56:51.255973Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 270795264, Sender [4:7568544170866189047:2388], Recipient [4:7568544170866189065:2388]: NKikimrClient.TResponse Status: 1 DeleteRangeResult { Status: 0 } WriteResult { Status: 0 StatusFlags: 1 } WriteResult { Status: 0 StatusFlags: 1 } WriteResult { Status: 0 StatusFlags: 1 }
2025-11-03T16:56:51.255998Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 5 partno 0 count 1 parts 0 suffix '63' size 176
2025-11-03T16:56:51.256006Z node 4 :PERSQUEUE TRACE: partition.h:625: StateIdle, processing event TEvKeyValue::TEvResponse
2025-11-03T16:56:51.256023Z node 4 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-03T16:56:51.256045Z node 4 :PERSQUEUE TRACE: partition_write.cpp:518: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse.
2025-11-03T16:56:51.256080Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 121 WriteNewSizeFromSupportivePartitions# 0
2025-11-03T16:56:51.256096Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=1
2025-11-03T16:56:51.256130Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:56:51.256163Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0test-message-group-id2', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 3, partNo: 0, Offset: 5 is stored on disk
2025-11-03T16:56:51.256180Z node 4 :PERSQUEUE TRACE: partition_write.cpp:424: [72075186224037892][Partition][0][StateIdle] TPartition::SyncMemoryStateWithKVState.
2025-11-03T16:56:51.256323Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:51.256335Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:51.256345Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:51.256361Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:51.256393Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:51.256405Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:51.256420Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:51.256438Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:56:51.256498Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271188493, Sender [4:7568544170866189065:2388], Recipient [4:7568544170866189024:2388]: NKikimr::TEvPQ::TEvProxyResponse
2025-11-03T16:56:51.256525Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5335: HandleHook, processing event TEvPQ::TEvProxyResponse
2025-11-03T16:56:51.256548Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 5  requestId: <none> cookie: 3
2025-11-03T16:56:51.257485Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:56:51.259655Z :DEBUG: [/Root] MessageGroupId [test-message-group-id2] SessionId [test-message-group-id2|d956c290-47a73c9e-b109a607-e01775e1_0] Write session got write response: sequence_numbers: 3 offsets: 5 already_written: false write_statistics { persist_duration_ms: 21 queued_in_partition_duration_ms: 42 }
2025-11-03T16:56:51.259688Z :DEBUG: [/Root] MessageGroupId [test-message-group-id2] SessionId [test-message-group-id2|d956c290-47a73c9e-b109a607-e01775e1_0] Write session: acknoledged message 3
2025-11-03T16:56:51.260100Z :TWriteSession_SeqNoShift INFO: Enqueue message with sequence number 4
2025-11-03T16:56:51.260202Z :DEBUG: [/Root] MessageGroupId [test-message-group-id1] SessionId [test-message-group-id1|f1b47779-84f57a92-ac9e6f8a-5d32ebe8_0] Write 1 messages with Id from 4 to 4
2025-11-03T16:56:51.260263Z :TWriteSession_SeqNoShift INFO: Wait for writer event
2025-11-03T16:56:51.260302Z :TWriteSession_SeqNoShift INFO: Got new continue token
2025-11-03T16:56:51.262107Z :DEBUG: [/Root] MessageGroupId [test-message-group-id1] SessionId [test-message-group-id1|f1b47779-84f57a92-ac9e6f8a-5d32ebe8_0] Write session: try to update token
2025-11-03T16:56:51.262156Z :DEBUG: [/Root] MessageGroupId [test-message-group-id1] SessionId [test-message-group-id1|f1b47779-84f57a92-ac9e6f8a-5d32ebe8_0] Send 1 message(s) (0 left), first sequence number is 4
2025-11-03T16:56:51.262739Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: test-message-group-id1|f1b47779-84f57a92-ac9e6f8a-5d32ebe8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:56:51.262990Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:56:51.263488Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271187968, Sender [3:7568544170873736324:2471], Recipient [4:7568544170866189114:2436]
2025-11-03T16:56:51.263516Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5316: HandleHook, processing event TEvPersQueue::TEvRequest
2025-11-03T16:56:51.263567Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:56:51.263592Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:56:51.263660Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188507 (NKikimr::TEvPQ::TEvReserveBytes), Tablet [4:7568544170866189024:2388], Partition 0, Sender [4:7568544170866189024:2388], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:56:51.263697Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188507, Sender [4:7568544170866189024:2388], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvReserveBytes
2025-11-03T16:56:51.263715Z node 4 :PERSQUEUE TRACE: partition.h:650: StateIdle, processing event TEvPQ::TEvReserveBytes
2025-11-03T16:56:51.263731Z node 4 :PERSQUEUE TRACE: partition_write.cpp:220: [72075186224037892][Partition][0][StateIdle] TPartition::HandleOnWrite TEvReserveBytes.
2025-11-03T16:56:51.263748Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:51.264079Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271188493, Sender [4:7568544170866189065:2388], Recipient [4:7568544170866189024:2388]: NKikimr::TEvPQ::TEvProxyResponse
2025-11-03T16:56:51.264106Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5335: HandleHook, processing event TEvPQ::TEvProxyResponse
2025-11-03T16:56:51.264122Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 6  requestId: <none> cookie: 4
2025-11-03T16:56:51.264694Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:56:51.265107Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271187968, Sender [3:7568544170873736324:2471], Recipient [4:7568544170866189114:2436]
2025-11-03T16:56:51.265128Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5316: HandleHook, processing event TEvPersQueue::TEvRequest
2025-11-03T16:56:51.265180Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:56:51.265197Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:56:51.265248Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0test-message-group-id1' SeqNo: 4 partNo : 0 messageNo: 7 size 98 offset: -1
2025-11-03T16:56:51.265304Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188480 (NKikimr::TEvPQ::TEvWrite), Tablet [4:7568544170866189024:2388], Partition 0, Sender [4:7568544170866189024:2388], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:56:51.265340Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188480, Sender [4:7568544170866189024:2388], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvWrite
2025-11-03T16:56:51.265356Z node 4 :PERSQUEUE TRACE: partition.h:628: StateIdle, processing event TEvPQ::TEvWrite
2025-11-03T16:56:51.265373Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:56:51.265414Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:51.265436Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:51.265447Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-03T16:56:51.265506Z node 4 :PERSQUEUE TRACE: partition_write.cpp:1168: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 process write for '\0test-message-group-id1' DisableDeduplication=0 SeqNo=4 LocalSeqNo=3 InitialSeqNo=(NULL) EnableKafkaDeduplication=0 ProducerEpoch=(empty maybe)
2025-11-03T16:56:51.265564Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0test-message-group-id1' seqNo 4 partNo 0
2025-11-03T16:56:51.266564Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0test-message-group-id1' seqNo 4 partNo 0 FormedBlobsCount 0 NewHead: Offset 6 PartNo 0 PackedSize 188 count 1 nextOffset 7 batches 1
2025-11-03T16:56:51.266600Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:51.266614Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 1 items to delete old stuff
2025-11-03T16:56:51.266712Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 1 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest CmdDeleteRange { Range { From: "x0000000000" IncludeFrom: true To: "x0000000001" IncludeTo: false } }
2025-11-03T16:56:51.266723Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:51.267122Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 6,1 HeadOffset 6 endOffset 6 curOffset 7 d0000000000_00000000000000000006_00000_0000000001_00000? size 176 WTime 1762189011265
2025-11-03T16:56:51.267134Z node 4 :PERSQUEUE TRACE: partition_write.cpp:1459: [72075186224037892][Partition][0][StateIdle] TPartition::AddNewFastWriteBlob
2025-11-03T16:56:51.267200Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:51.267288Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188562 (NKikimr::TEvPQ::TEvTxBatchComplete), Tablet [4:7568544170866189024:2388], Partition 0, Sender [4:7568544170866189065:2388], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:56:51.267324Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188562, Sender [4:7568544170866189065:2388], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvTxBatchComplete
2025-11-03T16:56:51.267346Z node 4 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-03T16:56:51.267451Z node 4 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 6 partNo 0 count 1 size 176
2025-11-03T16:56:51.267640Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 270794752, Sender [4:7568544170866189047:2388], Recipient [4:7568544170866189024:2388]: NKikimrClient.TKeyValueRequest Cookie: 7 CmdDeleteRange { Range { From: "x0000000000" IncludeFrom: true To: "x0000000001" IncludeTo: false } } CmdWrite { Key: "m0000000000p\000test-message-group-id1" Value: "\010\004\020\006\030\273\316\254\320\271\326\220\003 \366\231\231\320\271\326\220\003(\000H\001" StorageChannel: INLINE } CmdWrite { Key: "d0000000000_00000000000000000006_00000_0000000001_00000?" Value: "\022\000\010\006\020\000\030\001 \000(\234\0010\234\0018\000@\000\234\000\000\000\004\000\000\000\000\000\000\000\016Ai\246J\232\001\000\000<i\246J\232\001\000\000\007\000\000\000\027\000\000test-message-group-id1\010\004\030\274\322\231\325\2443B\020ipv6:[::1]:52486P\001\342\007$\n\020ipv6:[::1]:52486\032\007unknown\"\007unknown\372\007\033\037\213\010\000\000\000\000\000\000\003\313M-.NLO\005\000\1770\275\266\007\000\000\000" StorageChannel: INLINE } CmdWrite { Key: "i0000000000" Value: "\030\000(\301\322\231\325\2443" StorageChannel: INLINE }
2025-11-03T16:56:51.267817Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 270794753, Sender [4:7568544175161156450:2388], Recipient [4:7568544170866189024:2388]: NKikimr::TEvKeyValue::TEvIntermediate
2025-11-03T16:56:51.273047Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 6 count 1 size 176 actorID [4:7568544170866189047:2388]
2025-11-03T16:56:51.273154Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 270795264 (NKikimr::TEvKeyValue::TEvResponse), Tablet [4:7568544170866189024:2388], Partition 0, Sender [4:7568544170866189047:2388], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:56:51.273286Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 270795264, Sender [4:7568544170866189047:2388], Recipient [4:7568544170866189065:2388]: NKikimrClient.TResponse Status: 1 DeleteRangeResult { Status: 0 } WriteResult { Status: 0 StatusFlags: 1 } WriteResult { Status: 0 StatusFlags: 1 } WriteResult { Status: 0 StatusFlags: 1 }
2025-11-03T16:56:51.273310Z node 4 :PERSQUEUE TRACE: partition.h:625: StateIdle, processing event TEvKeyValue::TEvResponse
2025-11-03T16:56:51.273328Z node 4 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-03T16:56:51.273352Z node 4 :PERSQUEUE TRACE: partition_write.cpp:518: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse.
2025-11-03T16:56:51.273387Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 121 WriteNewSizeFromSupportivePartitions# 0
2025-11-03T16:56:51.273403Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=1
2025-11-03T16:56:51.273436Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:56:51.273473Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0test-message-group-id1', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 4, partNo: 0, Offset: 6 is stored on disk
2025-11-03T16:56:51.273491Z node 4 :PERSQUEUE TRACE: partition_write.cpp:424: [72075186224037892][Partition][0][StateIdle] TPartition::SyncMemoryStateWithKVState.
2025-11-03T16:56:51.273648Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:51.273660Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:51.273673Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:51.273688Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:51.273726Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:51.273738Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:51.273754Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:51.273771Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:56:51.273834Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271188493, Sender [4:7568544170866189065:2388], Recipient [4:7568544170866189024:2388]: NKikimr::TEvPQ::TEvProxyResponse
2025-11-03T16:56:51.273852Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5335: HandleHook, processing event TEvPQ::TEvProxyResponse
2025-11-03T16:56:51.273875Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 7  requestId: <none> cookie: 4
2025-11-03T16:56:51.274018Z node 4 :PERSQUEUE TRACE: pq_l2_cache.h:116: StateFunc, received event# 271450112, Sender [4:7568544170866189047:2388], Recipient [4:7568544115031613334:2071]: NKikimr::NPQ::TEvPqCache::TEvCacheL2Request
2025-11-03T16:56:51.274041Z node 4 :PERSQUEUE TRACE: pq_l2_cache.h:119: StateFunc, processing event TEvPqCache::TEvCacheL2Request
2025-11-03T16:56:51.274091Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 6 partno 0 count 1 parts 0 suffix '63' size 176
2025-11-03T16:56:51.274587Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:56:51.275815Z :DEBUG: [/Root] MessageGroupId [test-message-group-id1] SessionId [test-message-group-id1|f1b47779-84f57a92-ac9e6f8a-5d32ebe8_0] Write session got write response: sequence_numbers: 4 offsets: 6 already_written: false write_statistics { persist_duration_ms: 6 }
2025-11-03T16:56:51.275868Z :DEBUG: [/Root] MessageGroupId [test-message-group-id1] SessionId [test-message-group-id1|f1b47779-84f57a92-ac9e6f8a-5d32ebe8_0] Write session: acknoledged message 4
2025-11-03T16:56:51.276516Z :TWriteSession_SeqNoShift INFO: Enqueue message with sequence number 4
2025-11-03T16:56:51.276618Z :DEBUG: [/Root] MessageGroupId [test-message-group-id2] SessionId [test-message-group-id2|d956c290-47a73c9e-b109a607-e01775e1_0] Write 1 messages with Id from 4 to 4
2025-11-03T16:56:51.276746Z :TWriteSession_SeqNoShift INFO: Wait for writer event
2025-11-03T16:56:51.276793Z :TWriteSession_SeqNoShift INFO: Got new continue token
2025-11-03T16:56:51.277463Z :DEBUG: [/Root] MessageGroupId [test-message-group-id2] SessionId [test-message-group-id2|d956c290-47a73c9e-b109a607-e01775e1_0] Write session: try to update token
2025-11-03T16:56:51.277519Z :DEBUG: [/Root] MessageGroupId [test-message-group-id2] SessionId [test-message-group-id2|d956c290-47a73c9e-b109a607-e01775e1_0] Send 1 message(s) (0 left), first sequence number is 4
2025-11-03T16:56:51.282148Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3 sessionId: test-message-group-id2|d956c290-47a73c9e-b109a607-e01775e1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:56:51.282431Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:56:51.284382Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271187968, Sender [3:7568544170873736328:2472], Recipient [4:7568544170866189115:2437]
2025-11-03T16:56:51.284410Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5316: HandleHook, processing event TEvPersQueue::TEvRequest
2025-11-03T16:56:51.284462Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:56:51.284487Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:56:51.284565Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188507 (NKikimr::TEvPQ::TEvReserveBytes), Tablet [4:7568544170866189024:2388], Partition 0, Sender [4:7568544170866189024:2388], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:56:51.284601Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188507, Sender [4:7568544170866189024:2388], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvReserveBytes
2025-11-03T16:56:51.284617Z node 4 :PERSQUEUE TRACE: partition.h:650: StateIdle, processing event TEvPQ::TEvReserveBytes
2025-11-03T16:56:51.284632Z node 4 :PERSQUEUE TRACE: partition_write.cpp:220: [72075186224037892][Partition][0][StateIdle] TPartition::HandleOnWrite TEvReserveBytes.
2025-11-03T16:56:51.284650Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:51.284708Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271188493, Sender [4:7568544170866189065:2388], Recipient [4:7568544170866189024:2388]: NKikimr::TEvPQ::TEvProxyResponse
2025-11-03T16:56:51.284726Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5335: HandleHook, processing event TEvPQ::TEvProxyResponse
2025-11-03T16:56:51.284742Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 6  requestId: <none> cookie: 4
2025-11-03T16:56:51.288187Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:56:51.288976Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 65538 (NActors::TEvents::TEvWakeup), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:51.289038Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 65538, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NActors::TEvents::TEvWakeup
2025-11-03T16:56:51.289216Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:183: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:56:51.289278Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271188501, Sender [2:7568544108397207303:2383], Recipient [2:7568544108397207262:2383]: NKikimr::TEvPQ::TEvPartitionCounters
2025-11-03T16:56:51.289304Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5324: HandleHook, processing event TEvPQ::TEvPartitionCounters
2025-11-03T16:56:51.289010Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271187968, Sender [3:7568544170873736328:2472], Recipient [4:7568544170866189115:2437]
2025-11-03T16:56:51.289322Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:1078: [PQ: 72075186224037892] Handle TEvPQ::TEvPartitionCounters PartitionId 0
2025-11-03T16:56:51.289040Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5316: HandleHook, processing event TEvPersQueue::TEvRequest
2025-11-03T16:56:51.289526Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271188503, Sender [2:7568544108397207303:2383], Recipient [2:7568544108397207262:2383]: NKikimr::TEvPQ::TEvPartitionLabeledCounters
2025-11-03T16:56:51.289102Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:56:51.289541Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5326: HandleHook, processing event TEvPQ::TEvPartitionLabeledCounters
2025-11-03T16:56:51.289127Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:56:51.289176Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0test-message-group-id2' SeqNo: 4 partNo : 0 messageNo: 7 size 98 offset: -1
2025-11-03T16:56:51.289241Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188480 (NKikimr::TEvPQ::TEvWrite), Tablet [4:7568544170866189024:2388], Partition 0, Sender [4:7568544170866189024:2388], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:56:51.289277Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188480, Sender [4:7568544170866189024:2388], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvWrite
2025-11-03T16:56:51.289293Z node 4 :PERSQUEUE TRACE: partition.h:628: StateIdle, processing event TEvPQ::TEvWrite
2025-11-03T16:56:51.289309Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:56:51.289354Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:51.289376Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:51.289388Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-03T16:56:51.289445Z node 4 :PERSQUEUE TRACE: partition_write.cpp:1168: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 process write for '\0test-message-group-id2' DisableDeduplication=0 SeqNo=4 LocalSeqNo=3 InitialSeqNo=(NULL) EnableKafkaDeduplication=0 ProducerEpoch=(empty maybe)
2025-11-03T16:56:51.289504Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0test-message-group-id2' seqNo 4 partNo 0
2025-11-03T16:56:51.290437Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0test-message-group-id2' seqNo 4 partNo 0 FormedBlobsCount 0 NewHead: Offset 7 PartNo 0 PackedSize 188 count 1 nextOffset 8 batches 1
2025-11-03T16:56:51.290474Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:51.290488Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 1 items to delete old stuff
2025-11-03T16:56:51.290582Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 1 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest CmdDeleteRange { Range { From: "x0000000000" IncludeFrom: true To: "x0000000001" IncludeTo: false } }
2025-11-03T16:56:51.290593Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:51.291001Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 7,1 HeadOffset 7 endOffset 7 curOffset 8 d0000000000_00000000000000000007_00000_0000000001_00000? size 176 WTime 1762189011290
2025-11-03T16:56:51.291013Z node 4 :PERSQUEUE TRACE: partition_write.cpp:1459: [72075186224037892][Partition][0][StateIdle] TPartition::AddNewFastWriteBlob
2025-11-03T16:56:51.291077Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:51.291166Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188562 (NKikimr::TEvPQ::TEvTxBatchComplete), Tablet [4:7568544170866189024:2388], Partition 0, Sender [4:7568544170866189065:2388], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:56:51.291198Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188562, Sender [4:7568544170866189065:2388], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvTxBatchComplete
2025-11-03T16:56:51.291221Z node 4 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-03T16:56:51.291311Z node 4 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 7 partNo 0 count 1 size 176
2025-11-03T16:56:51.291484Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 270794752, Sender [4:7568544170866189047:2388], Recipient [4:7568544170866189024:2388]: NKikimrClient.TKeyValueRequest Cookie: 8 CmdDeleteRange { Range { From: "x0000000000" IncludeFrom: true To: "x0000000001" IncludeTo: false } } CmdWrite { Key: "m0000000000p\000test-message-group-id2" Value: "\010\004\020\007\030\225\212\256\320\271\326\220\003 \207\342\236\320\271\326\220\003(\000H\001" StorageChannel: INLINE } CmdWrite { Key: "d0000000000_00000000000000000007_00000_0000000001_00000?" Value: "\022\000\010\007\020\000\030\001 \000(\234\0010\234\0018\000@\000\234\000\000\000\004\000\000\000\000\000\000\000\016Yi\246J\232\001\000\000Li\246J\232\001\000\000\007\000\000\000\027\000\000test-message-group-id2\010\004\030\314\322\231\325\2443B\020ipv6:[::1]:52486P\001\342\007$\n\020ipv6:[::1]:52486\032\007unknown\"\007unknown\372\007\033\037\213\010\000\000\000\000\000\000\003\313M-.NLO\005\000\1770\275\266\007\000\000\000" StorageChannel: INLINE } CmdWrite { Key: "i0000000000" Value: "\030\000(\331\322\231\325\2443" StorageChannel: INLINE }
2025-11-03T16:56:51.291634Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 270794753, Sender [4:7568544175161156453:2388], Recipient [4:7568544170866189024:2388]: NKikimr::TEvKeyValue::TEvIntermediate
2025-11-03T16:56:51.302239Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 7 count 1 size 176 actorID [4:7568544170866189047:2388]
2025-11-03T16:56:51.302351Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 270795264 (NKikimr::TEvKeyValue::TEvResponse), Tablet [4:7568544170866189024:2388], Partition 0, Sender [4:7568544170866189047:2388], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:56:51.302496Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 270795264, Sender [4:7568544170866189047:2388], Recipient [4:7568544170866189065:2388]: NKikimrClient.TResponse Status: 1 DeleteRangeResult { Status: 0 } WriteResult { Status: 0 StatusFlags: 1 } WriteResult { Status: 0 StatusFlags: 1 } WriteResult { Status: 0 StatusFlags: 1 }
2025-11-03T16:56:51.302518Z node 4 :PERSQUEUE TRACE: partition.h:625: StateIdle, processing event TEvKeyValue::TEvResponse
2025-11-03T16:56:51.302545Z node 4 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-03T16:56:51.302572Z node 4 :PERSQUEUE TRACE: partition_write.cpp:518: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse.
2025-11-03T16:56:51.302611Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 121 WriteNewSizeFromSupportivePartitions# 0
2025-11-03T16:56:51.302627Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=1
2025-11-03T16:56:51.302662Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:56:51.302700Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0test-message-group-id2', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 4, partNo: 0, Offset: 7 is stored on disk
2025-11-03T16:56:51.302718Z node 4 :PERSQUEUE TRACE: partition_write.cpp:424: [72075186224037892][Partition][0][StateIdle] TPartition::SyncMemoryStateWithKVState.
2025-11-03T16:56:51.302885Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:51.302899Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:51.302912Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:51.302928Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:51.302966Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:51.302980Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:51.302996Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:51.303012Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:56:51.303071Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271188493, Sender [4:7568544170866189065:2388], Recipient [4:7568544170866189024:2388]: NKikimr::TEvPQ::TEvProxyResponse
2025-11-03T16:56:51.303088Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5335: HandleHook, processing event TEvPQ::TEvProxyResponse
2025-11-03T16:56:51.303110Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 7  requestId: <none> cookie: 4
2025-11-03T16:56:51.303202Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188544 (NKikimr::NPQ::NReadQuoterEvents::TEvQuotaCountersUpdated), Tablet [4:7568544170866189024:2388], Partition 0, Sender [4:7568544170866189068:2388], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:56:51.303232Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188544, Sender [4:7568544170866189068:2388], Recipient [4:7568544170866189065:2388]: NKikimr::NPQ::NReadQuoterEvents::TEvQuotaCountersUpdated
2025-11-03T16:56:51.303247Z node 4 :PERSQUEUE TRACE: partition.h:671: StateIdle, processing event NReadQuoterEvents::TEvQuotaCountersUpdated
2025-11-03T16:56:51.304298Z node 4 :PERSQUEUE TRACE: pq_l2_cache.h:116: StateFunc, received event# 271450112, Sender [4:7568544170866189047:2388], Recipient [4:7568544115031613334:2071]: NKikimr::NPQ::TEvPqCache::TEvCacheL2Request
2025-11-03T16:56:51.304332Z node 4 :PERSQUEUE TRACE: pq_l2_cache.h:119: StateFunc, processing event TEvPqCache::TEvCacheL2Request
2025-11-03T16:56:51.304389Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 7 partno 0 count 1 parts 0 suffix '63' size 176
2025-11-03T16:56:51.308228Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:56:51.305382Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188544 (NKikimr::NPQ::NReadQuoterEvents::TEvQuotaCountersUpdated), Tablet [2:7568544108397207262:2383], Partition 0, Sender [2:7568544108397207306:2383], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:51.305441Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188544, Sender [2:7568544108397207306:2383], Recipient [2:7568544108397207303:2383]: NKikimr::NPQ::NReadQuoterEvents::TEvQuotaCountersUpdated
2025-11-03T16:56:51.305464Z node 2 :PERSQUEUE TRACE: partition.h:671: StateIdle, processing event NReadQuoterEvents::TEvQuotaCountersUpdated
2025-11-03T16:56:51.309476Z :DEBUG: [/Root] MessageGroupId [test-message-group-id2] SessionId [test-message-group-id2|d956c290-47a73c9e-b109a607-e01775e1_0] Write session got write response: sequence_numbers: 4 offsets: 7 already_written: false write_statistics { persist_duration_ms: 11 queued_in_partition_duration_ms: 1 }
2025-11-03T16:56:51.309527Z :DEBUG: [/Root] MessageGroupId [test-message-group-id2] SessionId [test-message-group-id2|d956c290-47a73c9e-b109a607-e01775e1_0] Write session: acknoledged message 4
2025-11-03T16:56:51.309828Z :TWriteSession_SeqNoShift INFO: Enqueue message with sequence number 5
2025-11-03T16:56:51.309920Z :DEBUG: [/Root] MessageGroupId [test-message-group-id1] SessionId [test-message-group-id1|f1b47779-84f57a92-ac9e6f8a-5d32ebe8_0] Write 1 messages with Id from 5 to 5
2025-11-03T16:56:51.309987Z :TWriteSession_SeqNoShift INFO: Wait for writer event
2025-11-03T16:56:51.310043Z :TWriteSession_SeqNoShift INFO: Got new continue token
2025-11-03T16:56:51.311249Z :DEBUG: [/Root] MessageGroupId [test-message-group-id1] SessionId [test-message-group-id1|f1b47779-84f57a92-ac9e6f8a-5d32ebe8_0] Write session: try to update token
2025-11-03T16:56:51.311293Z :DEBUG: [/Root] MessageGroupId [test-message-group-id1] SessionId [test-message-group-id1|f1b47779-84f57a92-ac9e6f8a-5d32ebe8_0] Send 1 message(s) (0 left), first sequence number is 5
2025-11-03T16:56:51.311929Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: test-message-group-id1|f1b47779-84f57a92-ac9e6f8a-5d32ebe8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:56:51.312226Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:56:51.313780Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271187968, Sender [3:7568544170873736324:2471], Recipient [4:7568544170866189114:2436]
2025-11-03T16:56:51.313810Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5316: HandleHook, processing event TEvPersQueue::TEvRequest
2025-11-03T16:56:51.313862Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:56:51.313884Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:56:51.313962Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188507 (NKikimr::TEvPQ::TEvReserveBytes), Tablet [4:7568544170866189024:2388], Partition 0, Sender [4:7568544170866189024:2388], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:56:51.314007Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188507, Sender [4:7568544170866189024:2388], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvReserveBytes
2025-11-03T16:56:51.314028Z node 4 :PERSQUEUE TRACE: partition.h:650: StateIdle, processing event TEvPQ::TEvReserveBytes
2025-11-03T16:56:51.314044Z node 4 :PERSQUEUE TRACE: partition_write.cpp:220: [72075186224037892][Partition][0][StateIdle] TPartition::HandleOnWrite TEvReserveBytes.
2025-11-03T16:56:51.314066Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:51.314129Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271188493, Sender [4:7568544170866189065:2388], Recipient [4:7568544170866189024:2388]: NKikimr::TEvPQ::TEvProxyResponse
2025-11-03T16:56:51.314150Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5335: HandleHook, processing event TEvPQ::TEvProxyResponse
2025-11-03T16:56:51.314167Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 8  requestId: <none> cookie: 5
2025-11-03T16:56:51.315311Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:56:51.315718Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271187968, Sender [3:7568544170873736324:2471], Recipient [4:7568544170866189114:2436]
2025-11-03T16:56:51.315739Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5316: HandleHook, processing event TEvPersQueue::TEvRequest
2025-11-03T16:56:51.315789Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:56:51.315807Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:56:51.315854Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0test-message-group-id1' SeqNo: 5 partNo : 0 messageNo: 9 size 98 offset: -1
2025-11-03T16:56:51.315908Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188480 (NKikimr::TEvPQ::TEvWrite), Tablet [4:7568544170866189024:2388], Partition 0, Sender [4:7568544170866189024:2388], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:56:51.315940Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188480, Sender [4:7568544170866189024:2388], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvWrite
2025-11-03T16:56:51.315957Z node 4 :PERSQUEUE TRACE: partition.h:628: StateIdle, processing event TEvPQ::TEvWrite
2025-11-03T16:56:51.315969Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:56:51.316032Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:51.316052Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:51.316062Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-03T16:56:51.316119Z node 4 :PERSQUEUE TRACE: partition_write.cpp:1168: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 process write for '\0test-message-group-id1' DisableDeduplication=0 SeqNo=5 LocalSeqNo=4 InitialSeqNo=(NULL) EnableKafkaDeduplication=0 ProducerEpoch=(empty maybe)
2025-11-03T16:56:51.316183Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0test-message-group-id1' seqNo 5 partNo 0
2025-11-03T16:56:51.354053Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:51.354151Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:51.354193Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:51.354245Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:51.354268Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:51.354288Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:51.354318Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:51.354391Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:51.354406Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:51.354441Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:51.375842Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0test-message-group-id1' seqNo 5 partNo 0 FormedBlobsCount 0 NewHead: Offset 8 PartNo 0 PackedSize 188 count 1 nextOffset 9 batches 1
2025-11-03T16:56:51.375905Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:51.375919Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 1 items to delete old stuff
2025-11-03T16:56:51.376180Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 1 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest CmdDeleteRange { Range { From: "x0000000000" IncludeFrom: true To: "x0000000001" IncludeTo: false } }
2025-11-03T16:56:51.376197Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:51.376550Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 8,1 HeadOffset 8 endOffset 8 curOffset 9 d0000000000_00000000000000000008_00000_0000000001_00000? size 176 WTime 1762189011372
2025-11-03T16:56:51.376562Z node 4 :PERSQUEUE TRACE: partition_write.cpp:1459: [72075186224037892][Partition][0][StateIdle] TPartition::AddNewFastWriteBlob
2025-11-03T16:56:51.376630Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:51.376855Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188562 (NKikimr::TEvPQ::TEvTxBatchComplete), Tablet [4:7568544170866189024:2388], Partition 0, Sender [4:7568544170866189065:2388], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:56:51.376897Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188562, Sender [4:7568544170866189065:2388], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvTxBatchComplete
2025-11-03T16:56:51.376937Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [4:7568544170866189024:2388], Partition 0, Sender [0:0:0], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:56:51.376964Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:51.376979Z node 4 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:51.376998Z node 4 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:56:51.377016Z node 4 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-03T16:56:51.377110Z node 4 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 8 partNo 0 count 1 size 176
2025-11-03T16:56:51.377289Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 270794752, Sender [4:7568544170866189047:2388], Recipient [4:7568544170866189024:2388]: NKikimrClient.TKeyValueRequest Cookie: 9 CmdDeleteRange { Range { From: "x0000000000" IncludeFrom: true To: "x0000000001" IncludeTo: false } } CmdWrite { Key: "m0000000000p\000test-message-group-id1" Value: "\010\005\020\010\030\242\316\257\320\271\326\220\003 \366\231\231\320\271\326\220\003(\000H\001" StorageChannel: INLINE } CmdWrite { Key: "d0000000000_00000000000000000008_00000_0000000001_00000?" Value: "\022\000\010\010\020\000\030\001 \000(\234\0010\234\0018\000@\000\234\000\000\000\005\000\000\000\000\000\000\000\016ri\246J\232\001\000\000mi\246J\232\001\000\000\007\000\000\000\027\000\000test-message-group-id1\010\005\030\355\322\231\325\2443B\020ipv6:[::1]:52486P\001\342\007$\n\020ipv6:[::1]:52486\032\007unknown\"\007unknown\372\007\033\037\213\010\000\000\000\000\000\000\003\313M-.NLO\005\000\1770\275\266\007\000\000\000" StorageChannel: INLINE } CmdWrite { Key: "i0000000000" Value: "\030\000(\362\322\231\325\2443" StorageChannel: INLINE }
2025-11-03T16:56:51.377454Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 270794753, Sender [4:7568544175161156457:2388], Recipient [4:7568544170866189024:2388]: NKikimr::TEvKeyValue::TEvIntermediate
2025-11-03T16:56:51.385455Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 8 count 1 size 176 actorID [4:7568544170866189047:2388]
2025-11-03T16:56:51.385554Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 270795264 (NKikimr::TEvKeyValue::TEvResponse), Tablet [4:7568544170866189024:2388], Partition 0, Sender [4:7568544170866189047:2388], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:56:51.385556Z node 4 :PERSQUEUE TRACE: pq_l2_cache.h:116: StateFunc, received event# 271450112, Sender [4:7568544170866189047:2388], Recipient [4:7568544115031613334:2071]: NKikimr::NPQ::TEvPqCache::TEvCacheL2Request
2025-11-03T16:56:51.385576Z node 4 :PERSQUEUE TRACE: pq_l2_cache.h:119: StateFunc, processing event TEvPqCache::TEvCacheL2Request
2025-11-03T16:56:51.385625Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 8 partno 0 count 1 parts 0 suffix '63' size 176
2025-11-03T16:56:51.385689Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 270795264, Sender [4:7568544170866189047:2388], Recipient [4:7568544170866189065:2388]: NKikimrClient.TResponse Status: 1 DeleteRangeResult { Status: 0 } WriteResult { Status: 0 StatusFlags: 1 } WriteResult { Status: 0 StatusFlags: 1 } WriteResult { Status: 0 StatusFlags: 1 }
2025-11-03T16:56:51.385709Z node 4 :PERSQUEUE TRACE: partition.h:625: StateIdle, processing event TEvKeyValue::TEvResponse
2025-11-03T16:56:51.385725Z node 4 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-03T16:56:51.385745Z node 4 :PERSQUEUE TRACE: partition_write.cpp:518: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse.
2025-11-03T16:56:51.385780Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 121 WriteNewSizeFromSupportivePartitions# 0
2025-11-03T16:56:51.385796Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=1
2025-11-03T16:56:51.385827Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:56:51.385862Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0test-message-group-id1', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 5, partNo: 0, Offset: 8 is stored on disk
2025-11-03T16:56:51.385880Z node 4 :PERSQUEUE TRACE: partition_write.cpp:424: [72075186224037892][Partition][0][StateIdle] TPartition::SyncMemoryStateWithKVState.
2025-11-03T16:56:51.386027Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:51.386039Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:51.386050Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:51.386066Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:51.386103Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:51.386116Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:51.386132Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:51.386148Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:56:51.387367Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:56:51.388220Z :DEBUG: [/Root] MessageGroupId [test-message-group-id1] SessionId [test-message-group-id1|f1b47779-84f57a92-ac9e6f8a-5d32ebe8_0] Write session got write response: sequence_numbers: 5 offsets: 8 already_written: false write_statistics { persist_duration_ms: 11 queued_in_partition_duration_ms: 58 }
2025-11-03T16:56:51.388268Z :DEBUG: [/Root] MessageGroupId [test-message-group-id1] SessionId [test-message-group-id1|f1b47779-84f57a92-ac9e6f8a-5d32ebe8_0] Write session: acknoledged message 5
2025-11-03T16:56:51.386211Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271188493, Sender [4:7568544170866189065:2388], Recipient [4:7568544170866189024:2388]: NKikimr::TEvPQ::TEvProxyResponse
2025-11-03T16:56:51.386240Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5335: HandleHook, processing event TEvPQ::TEvProxyResponse
2025-11-03T16:56:51.386264Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 9  requestId: <none> cookie: 5
2025-11-03T16:56:51.390375Z :TWriteSession_SeqNoShift INFO: Enqueue message with sequence number 5
2025-11-03T16:56:51.390466Z :DEBUG: [/Root] MessageGroupId [test-message-group-id2] SessionId [test-message-group-id2|d956c290-47a73c9e-b109a607-e01775e1_0] Write 1 messages with Id from 5 to 5
2025-11-03T16:56:51.390582Z :TWriteSession_SeqNoShift INFO: Wait for writer event
2025-11-03T16:56:51.390628Z :TWriteSession_SeqNoShift INFO: Got new continue token
2025-11-03T16:56:51.393865Z :DEBUG: [/Root] MessageGroupId [test-message-group-id2] SessionId [test-message-group-id2|d956c290-47a73c9e-b109a607-e01775e1_0] Write session: try to update token
2025-11-03T16:56:51.393934Z :DEBUG: [/Root] MessageGroupId [test-message-group-id2] SessionId [test-message-group-id2|d956c290-47a73c9e-b109a607-e01775e1_0] Send 1 message(s) (0 left), first sequence number is 5
2025-11-03T16:56:51.394882Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3 sessionId: test-message-group-id2|d956c290-47a73c9e-b109a607-e01775e1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:56:51.395140Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:56:51.396400Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271187968, Sender [3:7568544170873736328:2472], Recipient [4:7568544170866189115:2437]
2025-11-03T16:56:51.396431Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5316: HandleHook, processing event TEvPersQueue::TEvRequest
2025-11-03T16:56:51.396483Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:56:51.396509Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:56:51.396590Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188507 (NKikimr::TEvPQ::TEvReserveBytes), Tablet [4:7568544170866189024:2388], Partition 0, Sender [4:7568544170866189024:2388], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:56:51.396630Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188507, Sender [4:7568544170866189024:2388], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvReserveBytes
2025-11-03T16:56:51.396670Z node 4 :PERSQUEUE TRACE: partition.h:650: StateIdle, processing event TEvPQ::TEvReserveBytes
2025-11-03T16:56:51.396684Z node 4 :PERSQUEUE TRACE: partition_write.cpp:220: [72075186224037892][Partition][0][StateIdle] TPartition::HandleOnWrite TEvReserveBytes.
2025-11-03T16:56:51.396701Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:51.396762Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271188493, Sender [4:7568544170866189065:2388], Recipient [4:7568544170866189024:2388]: NKikimr::TEvPQ::TEvProxyResponse
2025-11-03T16:56:51.396780Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5335: HandleHook, processing event TEvPQ::TEvProxyResponse
2025-11-03T16:56:51.396795Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 8  requestId: <none> cookie: 5
2025-11-03T16:56:51.397359Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:56:51.397822Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271187968, Sender [3:7568544170873736328:2472], Recipient [4:7568544170866189115:2437]
2025-11-03T16:56:51.397842Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5316: HandleHook, processing event TEvPersQueue::TEvRequest
2025-11-03T16:56:51.397888Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:56:51.397904Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:56:51.397951Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0test-message-group-id2' SeqNo: 5 partNo : 0 messageNo: 9 size 98 offset: -1
2025-11-03T16:56:51.398008Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188480 (NKikimr::TEvPQ::TEvWrite), Tablet [4:7568544170866189024:2388], Partition 0, Sender [4:7568544170866189024:2388], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:56:51.398042Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188480, Sender [4:7568544170866189024:2388], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvWrite
2025-11-03T16:56:51.398057Z node 4 :PERSQUEUE TRACE: partition.h:628: StateIdle, processing event TEvPQ::TEvWrite
2025-11-03T16:56:51.398071Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:56:51.398112Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:51.398130Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:51.398141Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-03T16:56:51.398197Z node 4 :PERSQUEUE TRACE: partition_write.cpp:1168: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 process write for '\0test-message-group-id2' DisableDeduplication=0 SeqNo=5 LocalSeqNo=4 InitialSeqNo=(NULL) EnableKafkaDeduplication=0 ProducerEpoch=(empty maybe)
2025-11-03T16:56:51.398274Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0test-message-group-id2' seqNo 5 partNo 0
2025-11-03T16:56:51.399135Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0test-message-group-id2' seqNo 5 partNo 0 FormedBlobsCount 0 NewHead: Offset 9 PartNo 0 PackedSize 188 count 1 nextOffset 10 batches 1
2025-11-03T16:56:51.399169Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:51.399184Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 1 items to delete old stuff
2025-11-03T16:56:51.399278Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 1 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest CmdDeleteRange { Range { From: "x0000000000" IncludeFrom: true To: "x0000000001" IncludeTo: false } }
2025-11-03T16:56:51.399290Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:51.399680Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 9,1 HeadOffset 9 endOffset 9 curOffset 10 d0000000000_00000000000000000009_00000_0000000001_00000? size 176 WTime 1762189011396
2025-11-03T16:56:51.399692Z node 4 :PERSQUEUE TRACE: partition_write.cpp:1459: [72075186224037892][Partition][0][StateIdle] TPartition::AddNewFastWriteBlob
2025-11-03T16:56:51.399757Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:51.399841Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188562 (NKikimr::TEvPQ::TEvTxBatchComplete), Tablet [4:7568544170866189024:2388], Partition 0, Sender [4:7568544170866189065:2388], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:56:51.399877Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188562, Sender [4:7568544170866189065:2388], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvTxBatchComplete
2025-11-03T16:56:51.399899Z node 4 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-03T16:56:51.400007Z node 4 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 9 partNo 0 count 1 size 176
2025-11-03T16:56:51.400191Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 270794752, Sender [4:7568544170866189047:2388], Recipient [4:7568544170866189024:2388]: NKikimrClient.TKeyValueRequest Cookie: 10 CmdDeleteRange { Range { From: "x0000000000" IncludeFrom: true To: "x0000000001" IncludeTo: false } } CmdWrite { Key: "m0000000000p\000test-message-group-id2" Value: "\010\005\020\t\030\315\321\264\320\271\326\220\003 \207\342\236\320\271\326\220\003(\000H\001" StorageChannel: INLINE } CmdWrite { Key: "d0000000000_00000000000000000009_00000_0000000001_00000?" Value: "\022\000\010\t\020\000\030\001 \000(\234\0010\234\0018\000@\000\234\000\000\000\005\000\000\000\000\000\000\000\016\304i\246J\232\001\000\000\276i\246J\232\001\000\000\007\000\000\000\027\000\000test-message-group-id2\010\005\030\276\323\231\325\2443B\020ipv6:[::1]:52486P\001\342\007$\n\020ipv6:[::1]:52486\032\007unknown\"\007unknown\372\007\033\037\213\010\000\000\000\000\000\000\003\313M-.NLO\005\000\1770\275\266\007\000\000\000" StorageChannel: INLINE } CmdWrite { Key: "i0000000000" Value: "\030\000(\304\323\231\325\2443" StorageChannel: INLINE }
2025-11-03T16:56:51.400357Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 270794753, Sender [4:7568544175161156478:2388], Recipient [4:7568544170866189024:2388]: NKikimr::TEvKeyValue::TEvIntermediate
2025-11-03T16:56:51.405439Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 9 count 1 size 176 actorID [4:7568544170866189047:2388]
2025-11-03T16:56:51.405533Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 270795264 (NKikimr::TEvKeyValue::TEvResponse), Tablet [4:7568544170866189024:2388], Partition 0, Sender [4:7568544170866189047:2388], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:56:51.405656Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 270795264, Sender [4:7568544170866189047:2388], Recipient [4:7568544170866189065:2388]: NKikimrClient.TResponse Status: 1 DeleteRangeResult { Status: 0 } WriteResult { Status: 0 StatusFlags: 1 } WriteResult { Status: 0 StatusFlags: 1 } WriteResult { Status: 0 StatusFlags: 1 }
2025-11-03T16:56:51.405676Z node 4 :PERSQUEUE TRACE: partition.h:625: StateIdle, processing event TEvKeyValue::TEvResponse
2025-11-03T16:56:51.405691Z node 4 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-03T16:56:51.405715Z node 4 :PERSQUEUE TRACE: partition_write.cpp:518: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse.
2025-11-03T16:56:51.405746Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 121 WriteNewSizeFromSupportivePartitions# 0
2025-11-03T16:56:51.405762Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=1
2025-11-03T16:56:51.405795Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:56:51.405828Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0test-message-group-id2', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 5, partNo: 0, Offset: 9 is stored on disk
2025-11-03T16:56:51.405843Z node 4 :PERSQUEUE TRACE: partition_write.cpp:424: [72075186224037892][Partition][0][StateIdle] TPartition::SyncMemoryStateWithKVState.
2025-11-03T16:56:51.405981Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:51.405994Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:51.406005Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:51.406020Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:51.406053Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:51.406064Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:51.406078Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:51.406093Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:56:51.406150Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271188493, Sender [4:7568544170866189065:2388], Recipient [4:7568544170866189024:2388]: NKikimr::TEvPQ::TEvProxyResponse
2025-11-03T16:56:51.406168Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5335: HandleHook, processing event TEvPQ::TEvProxyResponse
2025-11-03T16:56:51.406189Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 9  requestId: <none> cookie: 5
2025-11-03T16:56:51.406338Z node 4 :PERSQUEUE TRACE: pq_l2_cache.h:116: StateFunc, received event# 271450112, Sender [4:7568544170866189047:2388], Recipient [4:7568544115031613334:2071]: NKikimr::NPQ::TEvPqCache::TEvCacheL2Request
2025-11-03T16:56:51.406366Z node 4 :PERSQUEUE TRACE: pq_l2_cache.h:119: StateFunc, processing event TEvPqCache::TEvCacheL2Request
2025-11-03T16:56:51.406411Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 9 partno 0 count 1 parts 0 suffix '63' size 176
2025-11-03T16:56:51.406640Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:56:51.407683Z :DEBUG: [/Root] MessageGroupId [test-message-group-id2] SessionId [test-message-group-id2|d956c290-47a73c9e-b109a607-e01775e1_0] Write session got write response: sequence_numbers: 5 offsets: 9 already_written: false write_statistics { persist_duration_ms: 3 }
2025-11-03T16:56:51.407727Z :DEBUG: [/Root] MessageGroupId [test-message-group-id2] SessionId [test-message-group-id2|d956c290-47a73c9e-b109a607-e01775e1_0] Write session: acknoledged message 5
2025-11-03T16:56:51.408001Z :TWriteSession_SeqNoShift INFO: Enqueue message with sequence number 6
2025-11-03T16:56:51.408221Z :DEBUG: [/Root] MessageGroupId [test-message-group-id1] SessionId [test-message-group-id1|f1b47779-84f57a92-ac9e6f8a-5d32ebe8_0] Write 1 messages with Id from 6 to 6
2025-11-03T16:56:51.408301Z :TWriteSession_SeqNoShift INFO: Wait for writer event
2025-11-03T16:56:51.408331Z :TWriteSession_SeqNoShift INFO: Got new continue token
2025-11-03T16:56:51.410903Z :DEBUG: [/Root] MessageGroupId [test-message-group-id1] SessionId [test-message-group-id1|f1b47779-84f57a92-ac9e6f8a-5d32ebe8_0] Write session: try to update token
2025-11-03T16:56:51.410944Z :DEBUG: [/Root] MessageGroupId [test-message-group-id1] SessionId [test-message-group-id1|f1b47779-84f57a92-ac9e6f8a-5d32ebe8_0] Send 1 message(s) (0 left), first sequence number is 6
2025-11-03T16:56:51.411795Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: test-message-group-id1|f1b47779-84f57a92-ac9e6f8a-5d32ebe8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:56:51.412086Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:56:51.413282Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:56:51.412726Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271187968, Sender [3:7568544170873736324:2471], Recipient [4:7568544170866189114:2436]
2025-11-03T16:56:51.412757Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5316: HandleHook, processing event TEvPersQueue::TEvRequest
2025-11-03T16:56:51.412806Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:56:51.412830Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:56:51.412900Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188507 (NKikimr::TEvPQ::TEvReserveBytes), Tablet [4:7568544170866189024:2388], Partition 0, Sender [4:7568544170866189024:2388], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:56:51.412936Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188507, Sender [4:7568544170866189024:2388], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvReserveBytes
2025-11-03T16:56:51.412955Z node 4 :PERSQUEUE TRACE: partition.h:650: StateIdle, processing event TEvPQ::TEvReserveBytes
2025-11-03T16:56:51.412970Z node 4 :PERSQUEUE TRACE: partition_write.cpp:220: [72075186224037892][Partition][0][StateIdle] TPartition::HandleOnWrite TEvReserveBytes.
2025-11-03T16:56:51.412984Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:51.413041Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271188493, Sender [4:7568544170866189065:2388], Recipient [4:7568544170866189024:2388]: NKikimr::TEvPQ::TEvProxyResponse
2025-11-03T16:56:51.413059Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5335: HandleHook, processing event TEvPQ::TEvProxyResponse
2025-11-03T16:56:51.413073Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 10  requestId: <none> cookie: 6
2025-11-03T16:56:51.413651Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271187968, Sender [3:7568544170873736324:2471], Recipient [4:7568544170866189114:2436]
2025-11-03T16:56:51.413667Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5316: HandleHook, processing event TEvPersQueue::TEvRequest
2025-11-03T16:56:51.413712Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:56:51.413728Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:56:51.413780Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0test-message-group-id1' SeqNo: 6 partNo : 0 messageNo: 11 size 98 offset: -1
2025-11-03T16:56:51.413828Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188480 (NKikimr::TEvPQ::TEvWrite), Tablet [4:7568544170866189024:2388], Partition 0, Sender [4:7568544170866189024:2388], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:56:51.413861Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188480, Sender [4:7568544170866189024:2388], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvWrite
2025-11-03T16:56:51.413874Z node 4 :PERSQUEUE TRACE: partition.h:628: StateIdle, processing event TEvPQ::TEvWrite
2025-11-03T16:56:51.413887Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:56:51.413925Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:51.413948Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:51.413960Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-03T16:56:51.414018Z node 4 :PERSQUEUE TRACE: partition_write.cpp:1168: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 process write for '\0test-message-group-id1' DisableDeduplication=0 SeqNo=6 LocalSeqNo=5 InitialSeqNo=(NULL) EnableKafkaDeduplication=0 ProducerEpoch=(empty maybe)
2025-11-03T16:56:51.414079Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0test-message-group-id1' seqNo 6 partNo 0
2025-11-03T16:56:51.415120Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0test-message-group-id1' seqNo 6 partNo 0 FormedBlobsCount 0 NewHead: Offset 10 PartNo 0 PackedSize 188 count 1 nextOffset 11 batches 1
2025-11-03T16:56:51.415159Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:51.415173Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 1 items to delete old stuff
2025-11-03T16:56:51.415273Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 1 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest CmdDeleteRange { Range { From: "x0000000000" IncludeFrom: true To: "x0000000001" IncludeTo: false } }
2025-11-03T16:56:51.415286Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:51.415698Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 10,1 HeadOffset 10 endOffset 10 curOffset 11 d0000000000_00000000000000000010_00000_0000000001_00000? size 176 WTime 1762189011412
2025-11-03T16:56:51.415710Z node 4 :PERSQUEUE TRACE: partition_write.cpp:1459: [72075186224037892][Partition][0][StateIdle] TPartition::AddNewFastWriteBlob
2025-11-03T16:56:51.415780Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:51.415871Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188562 (NKikimr::TEvPQ::TEvTxBatchComplete), Tablet [4:7568544170866189024:2388], Partition 0, Sender [4:7568544170866189065:2388], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:56:51.415907Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188562, Sender [4:7568544170866189065:2388], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvTxBatchComplete
2025-11-03T16:56:51.415930Z node 4 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-03T16:56:51.416035Z node 4 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 10 partNo 0 count 1 size 176
2025-11-03T16:56:51.416218Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 270794752, Sender [4:7568544170866189047:2388], Recipient [4:7568544170866189024:2388]: NKikimrClient.TKeyValueRequest Cookie: 11 CmdDeleteRange { Range { From: "x0000000000" IncludeFrom: true To: "x0000000001" IncludeTo: false } } CmdWrite { Key: "m0000000000p\000test-message-group-id1" Value: "\010\006\020\n\030\260\312\265\320\271\326\220\003 \366\231\231\320\271\326\220\003(\000H\001" StorageChannel: INLINE } CmdWrite { Key: "d0000000000_00000000000000000010_00000_0000000001_00000?" Value: "\022\000\010\n\020\000\030\001 \000(\234\0010\234\0018\000@\000\234\000\000\000\006\000\000\000\000\000\000\000\016\324i\246J\232\001\000\000\320i\246J\232\001\000\000\007\000\000\000\027\000\000test-message-group-id1\010\006\030\320\323\231\325\2443B\020ipv6:[::1]:52486P\001\342\007$\n\020ipv6:[::1]:52486\032\007unknown\"\007unknown\372\007\033\037\213\010\000\000\000\000\000\000\003\313M-.NLO\005\000\1770\275\266\007\000\000\000" StorageChannel: INLINE } CmdWrite { Key: "i0000000000" Value: "\030\000(\324\323\231\325\2443" StorageChannel: INLINE }
2025-11-03T16:56:51.416363Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 270794753, Sender [4:7568544175161156481:2388], Recipient [4:7568544170866189024:2388]: NKikimr::TEvKeyValue::TEvIntermediate
2025-11-03T16:56:51.421199Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 10 count 1 size 176 actorID [4:7568544170866189047:2388]
2025-11-03T16:56:51.421301Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 270795264 (NKikimr::TEvKeyValue::TEvResponse), Tablet [4:7568544170866189024:2388], Partition 0, Sender [4:7568544170866189047:2388], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:56:51.421428Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 270795264, Sender [4:7568544170866189047:2388], Recipient [4:7568544170866189065:2388]: NKikimrClient.TResponse Status: 1 DeleteRangeResult { Status: 0 } WriteResult { Status: 0 StatusFlags: 1 } WriteResult { Status: 0 StatusFlags: 1 } WriteResult { Status: 0 StatusFlags: 1 }
2025-11-03T16:56:51.421449Z node 4 :PERSQUEUE TRACE: partition.h:625: StateIdle, processing event TEvKeyValue::TEvResponse
2025-11-03T16:56:51.421465Z node 4 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-03T16:56:51.421488Z node 4 :PERSQUEUE TRACE: partition_write.cpp:518: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse.
2025-11-03T16:56:51.421521Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 121 WriteNewSizeFromSupportivePartitions# 0
2025-11-03T16:56:51.421535Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=1
2025-11-03T16:56:51.421565Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:56:51.421597Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0test-message-group-id1', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 6, partNo: 0, Offset: 10 is stored on disk
2025-11-03T16:56:51.421615Z node 4 :PERSQUEUE TRACE: partition_write.cpp:424: [72075186224037892][Partition][0][StateIdle] TPartition::SyncMemoryStateWithKVState.
2025-11-03T16:56:51.421757Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:51.421770Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:51.421780Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:51.421796Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:51.421827Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:51.421838Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:51.421851Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:51.421867Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:56:51.421922Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271188493, Sender [4:7568544170866189065:2388], Recipient [4:7568544170866189024:2388]: NKikimr::TEvPQ::TEvProxyResponse
2025-11-03T16:56:51.421940Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5335: HandleHook, processing event TEvPQ::TEvProxyResponse
2025-11-03T16:56:51.421962Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 11  requestId: <none> cookie: 6
2025-11-03T16:56:51.422536Z node 4 :PERSQUEUE TRACE: pq_l2_cache.h:116: StateFunc, received event# 271450112, Sender [4:7568544170866189047:2388], Recipient [4:7568544115031613334:2071]: NKikimr::NPQ::TEvPqCache::TEvCacheL2Request
2025-11-03T16:56:51.422564Z node 4 :PERSQUEUE TRACE: pq_l2_cache.h:119: StateFunc, processing event TEvPqCache::TEvCacheL2Request
2025-11-03T16:56:51.422619Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 10 partno 0 count 1 parts 0 suffix '63' size 176
2025-11-03T16:56:51.422900Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:56:51.428296Z :DEBUG: [/Root] MessageGroupId [test-message-group-id1] SessionId [test-message-group-id1|f1b47779-84f57a92-ac9e6f8a-5d32ebe8_0] Write session got write response: sequence_numbers: 6 offsets: 10 already_written: false write_statistics { persist_duration_ms: 7 }
2025-11-03T16:56:51.428355Z :DEBUG: [/Root] MessageGroupId [test-message-group-id1] SessionId [test-message-group-id1|f1b47779-84f57a92-ac9e6f8a-5d32ebe8_0] Write session: acknoledged message 6
2025-11-03T16:56:51.431813Z :TWriteSession_SeqNoShift INFO: Enqueue message with sequence number 6
2025-11-03T16:56:51.431947Z :DEBUG: [/Root] MessageGroupId [test-message-group-id2] SessionId [test-message-group-id2|d956c290-47a73c9e-b109a607-e01775e1_0] Write 1 messages with Id from 6 to 6
2025-11-03T16:56:51.432064Z :TWriteSession_SeqNoShift INFO: Wait for writer event
2025-11-03T16:56:51.432106Z :TWriteSession_SeqNoShift INFO: Got new continue token
2025-11-03T16:56:51.433345Z :DEBUG: [/Root] MessageGroupId [test-message-group-id2] SessionId [test-message-group-id2|d956c290-47a73c9e-b109a607-e01775e1_0] Write session: try to update token
2025-11-03T16:56:51.433396Z :DEBUG: [/Root] MessageGroupId [test-message-group-id2] SessionId [test-message-group-id2|d956c290-47a73c9e-b109a607-e01775e1_0] Send 1 message(s) (0 left), first sequence number is 6
2025-11-03T16:56:51.436270Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3 sessionId: test-message-group-id2|d956c290-47a73c9e-b109a607-e01775e1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:56:51.436562Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:56:51.440109Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271187968, Sender [3:7568544170873736328:2472], Recipient [4:7568544170866189115:2437]
2025-11-03T16:56:51.440146Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5316: HandleHook, processing event TEvPersQueue::TEvRequest
2025-11-03T16:56:51.440201Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:56:51.440226Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:56:51.440302Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188507 (NKikimr::TEvPQ::TEvReserveBytes), Tablet [4:7568544170866189024:2388], Partition 0, Sender [4:7568544170866189024:2388], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:56:51.440335Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188507, Sender [4:7568544170866189024:2388], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvReserveBytes
2025-11-03T16:56:51.440353Z node 4 :PERSQUEUE TRACE: partition.h:650: StateIdle, processing event TEvPQ::TEvReserveBytes
2025-11-03T16:56:51.440366Z node 4 :PERSQUEUE TRACE: partition_write.cpp:220: [72075186224037892][Partition][0][StateIdle] TPartition::HandleOnWrite TEvReserveBytes.
2025-11-03T16:56:51.440382Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:51.440434Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271188493, Sender [4:7568544170866189065:2388], Recipient [4:7568544170866189024:2388]: NKikimr::TEvPQ::TEvProxyResponse
2025-11-03T16:56:51.440452Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5335: HandleHook, processing event TEvPQ::TEvProxyResponse
2025-11-03T16:56:51.440467Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 10  requestId: <none> cookie: 6
2025-11-03T16:56:51.441067Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:56:51.444093Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271187968, Sender [3:7568544170873736328:2472], Recipient [4:7568544170866189115:2437]
2025-11-03T16:56:51.444125Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5316: HandleHook, processing event TEvPersQueue::TEvRequest
2025-11-03T16:56:51.444186Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:56:51.444209Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:56:51.444263Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0test-message-group-id2' SeqNo: 6 partNo : 0 messageNo: 11 size 98 offset: -1
2025-11-03T16:56:51.444333Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188480 (NKikimr::TEvPQ::TEvWrite), Tablet [4:7568544170866189024:2388], Partition 0, Sender [4:7568544170866189024:2388], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:56:51.444366Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188480, Sender [4:7568544170866189024:2388], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvWrite
2025-11-03T16:56:51.444383Z node 4 :PERSQUEUE TRACE: partition.h:628: StateIdle, processing event TEvPQ::TEvWrite
2025-11-03T16:56:51.444396Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:56:51.444440Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:51.444461Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:51.444472Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-03T16:56:51.444526Z node 4 :PERSQUEUE TRACE: partition_write.cpp:1168: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 process write for '\0test-message-group-id2' DisableDeduplication=0 SeqNo=6 LocalSeqNo=5 InitialSeqNo=(NULL) EnableKafkaDeduplication=0 ProducerEpoch=(empty maybe)
2025-11-03T16:56:51.444584Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0test-message-group-id2' seqNo 6 partNo 0
2025-11-03T16:56:51.445485Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0test-message-group-id2' seqNo 6 partNo 0 FormedBlobsCount 0 NewHead: Offset 11 PartNo 0 PackedSize 188 count 1 nextOffset 12 batches 1
2025-11-03T16:56:51.445515Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:51.445528Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 1 items to delete old stuff
2025-11-03T16:56:51.445619Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 1 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest CmdDeleteRange { Range { From: "x0000000000" IncludeFrom: true To: "x0000000001" IncludeTo: false } }
2025-11-03T16:56:51.445631Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:51.445973Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 11,1 HeadOffset 11 endOffset 11 curOffset 12 d0000000000_00000000000000000011_00000_0000000001_00000? size 176 WTime 1762189011443
2025-11-03T16:56:51.445983Z node 4 :PERSQUEUE TRACE: partition_write.cpp:1459: [72075186224037892][Partition][0][StateIdle] TPartition::AddNewFastWriteBlob
2025-11-03T16:56:51.446047Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:51.446129Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188562 (NKikimr::TEvPQ::TEvTxBatchComplete), Tablet [4:7568544170866189024:2388], Partition 0, Sender [4:7568544170866189065:2388], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:56:51.446161Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188562, Sender [4:7568544170866189065:2388], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvTxBatchComplete
2025-11-03T16:56:51.446185Z node 4 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-03T16:56:51.446279Z node 4 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 11 partNo 0 count 1 size 176
2025-11-03T16:56:51.446456Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 270794752, Sender [4:7568544170866189047:2388], Recipient [4:7568544170866189024:2388]: NKikimrClient.TKeyValueRequest Cookie: 12 CmdDeleteRange { Range { From: "x0000000000" IncludeFrom: true To: "x0000000001" IncludeTo: false } } CmdWrite { Key: "m0000000000p\000test-message-group-id2" Value: "\010\006\020\013\030\302\276\267\320\271\326\220\003 \207\342\236\320\271\326\220\003(\000H\001" StorageChannel: INLINE } CmdWrite { Key: "d0000000000_00000000000000000011_00000_0000000001_00000?" Value: "\022\000\010\013\020\000\030\001 \000(\234\0010\234\0018\000@\000\234\000\000\000\006\000\000\000\000\000\000\000\016\363i\246J\232\001\000\000\347i\246J\232\001\000\000\007\000\000\000\027\000\000test-message-group-id2\010\006\030\347\323\231\325\2443B\020ipv6:[::1]:52486P\001\342\007$\n\020ipv6:[::1]:52486\032\007unknown\"\007unknown\372\007\033\037\213\010\000\000\000\000\000\000\003\313M-.NLO\005\000\1770\275\266\007\000\000\000" StorageChannel: INLINE } CmdWrite { Key: "i0000000000" Value: "\030\000(\363\323\231\325\2443" StorageChannel: INLINE }
2025-11-03T16:56:51.446610Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 270794753, Sender [4:7568544175161156484:2388], Recipient [4:7568544170866189024:2388]: NKikimr::TEvKeyValue::TEvIntermediate
2025-11-03T16:56:51.453257Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:51.453325Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:51.453346Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:51.453375Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:51.453388Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:51.453400Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:51.453420Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:51.453475Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:51.453488Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:51.453507Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:51.457451Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 11 count 1 size 176 actorID [4:7568544170866189047:2388]
2025-11-03T16:56:51.457556Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 270795264 (NKikimr::TEvKeyValue::TEvResponse), Tablet [4:7568544170866189024:2388], Partition 0, Sender [4:7568544170866189047:2388], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:56:51.457686Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 270795264, Sender [4:7568544170866189047:2388], Recipient [4:7568544170866189065:2388]: NKikimrClient.TResponse Status: 1 DeleteRangeResult { Status: 0 } WriteResult { Status: 0 StatusFlags: 1 } WriteResult { Status: 0 StatusFlags: 1 } WriteResult { Status: 0 StatusFlags: 1 }
2025-11-03T16:56:51.457706Z node 4 :PERSQUEUE TRACE: partition.h:625: StateIdle, processing event TEvKeyValue::TEvResponse
2025-11-03T16:56:51.457722Z node 4 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-03T16:56:51.457743Z node 4 :PERSQUEUE TRACE: partition_write.cpp:518: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse.
2025-11-03T16:56:51.457744Z node 4 :PERSQUEUE TRACE: pq_l2_cache.h:116: StateFunc, received event# 271450112, Sender [4:7568544170866189047:2388], Recipient [4:7568544115031613334:2071]: NKikimr::NPQ::TEvPqCache::TEvCacheL2Request
2025-11-03T16:56:51.457767Z node 4 :PERSQUEUE TRACE: pq_l2_cache.h:119: StateFunc, processing event TEvPqCache::TEvCacheL2Request
2025-11-03T16:56:51.457775Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 121 WriteNewSizeFromSupportivePartitions# 0
2025-11-03T16:56:51.457792Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=1
2025-11-03T16:56:51.457822Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:56:51.457827Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 11 partno 0 count 1 parts 0 suffix '63' size 176
2025-11-03T16:56:51.457864Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0test-message-group-id2', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 6, partNo: 0, Offset: 11 is stored on disk
2025-11-03T16:56:51.457881Z node 4 :PERSQUEUE TRACE: partition_write.cpp:424: [72075186224037892][Partition][0][StateIdle] TPartition::SyncMemoryStateWithKVState.
2025-11-03T16:56:51.458022Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:51.458034Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:51.458046Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:51.458062Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:51.458098Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:51.458110Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:51.458126Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:51.458143Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:56:51.458201Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271188493, Sender [4:7568544170866189065:2388], Recipient [4:7568544170866189024:2388]: NKikimr::TEvPQ::TEvProxyResponse
2025-11-03T16:56:51.458217Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5335: HandleHook, processing event TEvPQ::TEvProxyResponse
2025-11-03T16:56:51.458240Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 11  requestId: <none> cookie: 6
2025-11-03T16:56:51.461593Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:56:51.468647Z :DEBUG: [/Root] MessageGroupId [test-message-group-id2] SessionId [test-message-group-id2|d956c290-47a73c9e-b109a607-e01775e1_0] Write session got write response: sequence_numbers: 6 offsets: 11 already_written: false write_statistics { persist_duration_ms: 13 }
2025-11-03T16:56:51.468702Z :DEBUG: [/Root] MessageGroupId [test-message-group-id2] SessionId [test-message-group-id2|d956c290-47a73c9e-b109a607-e01775e1_0] Write session: acknoledged message 6
2025-11-03T16:56:51.472008Z :TWriteSession_SeqNoShift INFO: Enqueue message with sequence number 7
2025-11-03T16:56:51.472235Z :DEBUG: [/Root] MessageGroupId [test-message-group-id1] SessionId [test-message-group-id1|f1b47779-84f57a92-ac9e6f8a-5d32ebe8_0] Write 1 messages with Id from 7 to 7
2025-11-03T16:56:51.472327Z :TWriteSession_SeqNoShift INFO: Wait for writer event
2025-11-03T16:56:51.472369Z :TWriteSession_SeqNoShift INFO: Got new continue token
2025-11-03T16:56:51.473894Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [4:7568544170866189024:2388], Partition 0, Sender [0:0:0], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:56:51.473956Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:51.473977Z node 4 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:51.474006Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:51.474022Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:51.474034Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:51.474055Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:51.474106Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:51.474119Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:51.474139Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:51.476330Z :DEBUG: [/Root] MessageGroupId [test-message-group-id1] SessionId [test-message-group-id1|f1b47779-84f57a92-ac9e6f8a-5d32ebe8_0] Write session: try to update token
2025-11-03T16:56:51.476404Z :DEBUG: [/Root] MessageGroupId [test-message-group-id1] SessionId [test-message-group-id1|f1b47779-84f57a92-ac9e6f8a-5d32ebe8_0] Send 1 message(s) (0 left), first sequence number is 7
2025-11-03T16:56:51.480269Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: test-message-group-id1|f1b47779-84f57a92-ac9e6f8a-5d32ebe8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:56:51.480538Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:56:51.481146Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271187968, Sender [3:7568544170873736324:2471], Recipient [4:7568544170866189114:2436]
2025-11-03T16:56:51.481174Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5316: HandleHook, processing event TEvPersQueue::TEvRequest
2025-11-03T16:56:51.481222Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:56:51.481247Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:56:51.481317Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188507 (NKikimr::TEvPQ::TEvReserveBytes), Tablet [4:7568544170866189024:2388], Partition 0, Sender [4:7568544170866189024:2388], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:56:51.481359Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188507, Sender [4:7568544170866189024:2388], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvReserveBytes
2025-11-03T16:56:51.481381Z node 4 :PERSQUEUE TRACE: partition.h:650: StateIdle, processing event TEvPQ::TEvReserveBytes
2025-11-03T16:56:51.481396Z node 4 :PERSQUEUE TRACE: partition_write.cpp:220: [72075186224037892][Partition][0][StateIdle] TPartition::HandleOnWrite TEvReserveBytes.
2025-11-03T16:56:51.481414Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:51.481473Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271188493, Sender [4:7568544170866189065:2388], Recipient [4:7568544170866189024:2388]: NKikimr::TEvPQ::TEvProxyResponse
2025-11-03T16:56:51.481491Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5335: HandleHook, processing event TEvPQ::TEvProxyResponse
2025-11-03T16:56:51.481506Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 12  requestId: <none> cookie: 7
2025-11-03T16:56:51.481706Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:56:51.482074Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271187968, Sender [3:7568544170873736324:2471], Recipient [4:7568544170866189114:2436]
2025-11-03T16:56:51.482091Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5316: HandleHook, processing event TEvPersQueue::TEvRequest
2025-11-03T16:56:51.482132Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:56:51.482162Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:56:51.482216Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0test-message-group-id1' SeqNo: 7 partNo : 0 messageNo: 13 size 98 offset: -1
2025-11-03T16:56:51.482271Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188480 (NKikimr::TEvPQ::TEvWrite), Tablet [4:7568544170866189024:2388], Partition 0, Sender [4:7568544170866189024:2388], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:56:51.482310Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188480, Sender [4:7568544170866189024:2388], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvWrite
2025-11-03T16:56:51.482325Z node 4 :PERSQUEUE TRACE: partition.h:628: StateIdle, processing event TEvPQ::TEvWrite
2025-11-03T16:56:51.482339Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:56:51.482379Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:51.482400Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:51.482410Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-03T16:56:51.482466Z node 4 :PERSQUEUE TRACE: partition_write.cpp:1168: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 process write for '\0test-message-group-id1' DisableDeduplication=0 SeqNo=7 LocalSeqNo=6 InitialSeqNo=(NULL) EnableKafkaDeduplication=0 ProducerEpoch=(empty maybe)
2025-11-03T16:56:51.482526Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0test-message-group-id1' seqNo 7 partNo 0
2025-11-03T16:56:51.483379Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0test-message-group-id1' seqNo 7 partNo 0 FormedBlobsCount 0 NewHead: Offset 12 PartNo 0 PackedSize 188 count 1 nextOffset 13 batches 1
2025-11-03T16:56:51.483412Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:51.483426Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 1 items to delete old stuff
2025-11-03T16:56:51.483524Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 1 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest CmdDeleteRange { Range { From: "x0000000000" IncludeFrom: true To: "x0000000001" IncludeTo: false } }
2025-11-03T16:56:51.483536Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:51.483921Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 12,1 HeadOffset 12 endOffset 12 curOffset 13 d0000000000_00000000000000000012_00000_0000000001_00000? size 176 WTime 1762189011483
2025-11-03T16:56:51.483932Z node 4 :PERSQUEUE TRACE: partition_write.cpp:1459: [72075186224037892][Partition][0][StateIdle] TPartition::AddNewFastWriteBlob
2025-11-03T16:56:51.484018Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:51.484100Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188562 (NKikimr::TEvPQ::TEvTxBatchComplete), Tablet [4:7568544170866189024:2388], Partition 0, Sender [4:7568544170866189065:2388], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:56:51.484136Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188562, Sender [4:7568544170866189065:2388], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvTxBatchComplete
2025-11-03T16:56:51.484156Z node 4 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-03T16:56:51.484247Z node 4 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 12 partNo 0 count 1 size 176
2025-11-03T16:56:51.484469Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 270794752, Sender [4:7568544170866189047:2388], Recipient [4:7568544170866189024:2388]: NKikimrClient.TKeyValueRequest Cookie: 13 CmdDeleteRange { Range { From: "x0000000000" IncludeFrom: true To: "x0000000001" IncludeTo: false } } CmdWrite { Key: "m0000000000p\000test-message-group-id1" Value: "\010\007\020\014\030\311\336\271\320\271\326\220\003 \366\231\231\320\271\326\220\003(\000H\001" StorageChannel: INLINE } CmdWrite { Key: "d0000000000_00000000000000000012_00000_0000000001_00000?" Value: "\022\000\010\014\020\000\030\001 \000(\234\0010\234\0018\000@\000\234\000\000\000\007\000\000\000\000\000\000\000\016\030j\246J\232\001\000\000\020j\246J\232\001\000\000\007\000\000\000\027\000\000test-message-group-id1\010\007\030\220\324\231\325\2443B\020ipv6:[::1]:52486P\001\342\007$\n\020ipv6:[::1]:52486\032\007unknown\"\007unknown\372\007\033\037\213\010\000\000\000\000\000\000\003\313M-.NLO\005\000\1770\275\266\007\000\000\000" StorageChannel: INLINE } CmdWrite { Key: "i0000000000" Value: "\030\000(\230\324\231\325\2443" StorageChannel: INLINE }
2025-11-03T16:56:51.484629Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 270794753, Sender [4:7568544175161156496:2388], Recipient [4:7568544170866189024:2388]: NKikimr::TEvKeyValue::TEvIntermediate
2025-11-03T16:56:51.489207Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 12 count 1 size 176 actorID [4:7568544170866189047:2388]
2025-11-03T16:56:51.489322Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 270795264 (NKikimr::TEvKeyValue::TEvResponse), Tablet [4:7568544170866189024:2388], Partition 0, Sender [4:7568544170866189047:2388], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:56:51.489457Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 270795264, Sender [4:7568544170866189047:2388], Recipient [4:7568544170866189065:2388]: NKikimrClient.TResponse Status: 1 DeleteRangeResult { Status: 0 } WriteResult { Status: 0 StatusFlags: 1 } WriteResult { Status: 0 StatusFlags: 1 } WriteResult { Status: 0 StatusFlags: 1 }
2025-11-03T16:56:51.489478Z node 4 :PERSQUEUE TRACE: partition.h:625: StateIdle, processing event TEvKeyValue::TEvResponse
2025-11-03T16:56:51.489495Z node 4 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-03T16:56:51.489519Z node 4 :PERSQUEUE TRACE: partition_write.cpp:518: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse.
2025-11-03T16:56:51.489558Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 121 WriteNewSizeFromSupportivePartitions# 0
2025-11-03T16:56:51.489573Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=1
2025-11-03T16:56:51.489606Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:56:51.489654Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0test-message-group-id1', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 7, partNo: 0, Offset: 12 is stored on disk
2025-11-03T16:56:51.489672Z node 4 :PERSQUEUE TRACE: partition_write.cpp:424: [72075186224037892][Partition][0][StateIdle] TPartition::SyncMemoryStateWithKVState.
2025-11-03T16:56:51.489819Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:51.489834Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:51.489847Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:51.489864Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:51.489896Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:51.489908Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:51.489924Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:51.489940Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:56:51.489998Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271188493, Sender [4:7568544170866189065:2388], Recipient [4:7568544170866189024:2388]: NKikimr::TEvPQ::TEvProxyResponse
2025-11-03T16:56:51.490017Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5335: HandleHook, processing event TEvPQ::TEvProxyResponse
2025-11-03T16:56:51.490041Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 13  requestId: <none> cookie: 7
2025-11-03T16:56:51.490182Z node 4 :PERSQUEUE TRACE: pq_l2_cache.h:116: StateFunc, received event# 271450112, Sender [4:7568544170866189047:2388], Recipient [4:7568544115031613334:2071]: NKikimr::NPQ::TEvPqCache::TEvCacheL2Request
2025-11-03T16:56:51.490204Z node 4 :PERSQUEUE TRACE: pq_l2_cache.h:119: StateFunc, processing event TEvPqCache::TEvCacheL2Request
2025-11-03T16:56:51.490248Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 12 partno 0 count 1 parts 0 suffix '63' size 176
2025-11-03T16:56:51.490433Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:56:51.496213Z :DEBUG: [/Root] MessageGroupId [test-message-group-id1] SessionId [test-message-group-id1|f1b47779-84f57a92-ac9e6f8a-5d32ebe8_0] Write session got write response: sequence_numbers: 7 offsets: 12 already_written: false write_statistics { persist_duration_ms: 7 }
2025-11-03T16:56:51.496278Z :DEBUG: [/Root] MessageGroupId [test-message-group-id1] SessionId [test-message-group-id1|f1b47779-84f57a92-ac9e6f8a-5d32ebe8_0] Write session: acknoledged message 7
2025-11-03T16:56:51.496842Z :TWriteSession_SeqNoShift INFO: Enqueue message with sequence number 7
2025-11-03T16:56:51.496945Z :DEBUG: [/Root] MessageGroupId [test-message-group-id2] SessionId [test-message-group-id2|d956c290-47a73c9e-b109a607-e01775e1_0] Write 1 messages with Id from 7 to 7
2025-11-03T16:56:51.497060Z :TWriteSession_SeqNoShift INFO: Wait for writer event
2025-11-03T16:56:51.497097Z :TWriteSession_SeqNoShift INFO: Got new continue token
2025-11-03T16:56:51.497352Z :DEBUG: [/Root] MessageGroupId [test-message-group-id2] SessionId [test-message-group-id2|d956c290-47a73c9e-b109a607-e01775e1_0] Write session: try to update token
2025-11-03T16:56:51.497405Z :DEBUG: [/Root] MessageGroupId [test-message-group-id2] SessionId [test-message-group-id2|d956c290-47a73c9e-b109a607-e01775e1_0] Send 1 message(s) (0 left), first sequence number is 7
2025-11-03T16:56:51.498407Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3 sessionId: test-message-group-id2|d956c290-47a73c9e-b109a607-e01775e1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:56:51.498661Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:56:51.499267Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271187968, Sender [3:7568544170873736328:2472], Recipient [4:7568544170866189115:2437]
2025-11-03T16:56:51.499300Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5316: HandleHook, processing event TEvPersQueue::TEvRequest
2025-11-03T16:56:51.499350Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:56:51.499373Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:56:51.499441Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188507 (NKikimr::TEvPQ::TEvReserveBytes), Tablet [4:7568544170866189024:2388], Partition 0, Sender [4:7568544170866189024:2388], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:56:51.499484Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188507, Sender [4:7568544170866189024:2388], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvReserveBytes
2025-11-03T16:56:51.499507Z node 4 :PERSQUEUE TRACE: partition.h:650: StateIdle, processing event TEvPQ::TEvReserveBytes
2025-11-03T16:56:51.499524Z node 4 :PERSQUEUE TRACE: partition_write.cpp:220: [72075186224037892][Partition][0][StateIdle] TPartition::HandleOnWrite TEvReserveBytes.
2025-11-03T16:56:51.499543Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:51.499602Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271188493, Sender [4:7568544170866189065:2388], Recipient [4:7568544170866189024:2388]: NKikimr::TEvPQ::TEvProxyResponse
2025-11-03T16:56:51.499624Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5335: HandleHook, processing event TEvPQ::TEvProxyResponse
2025-11-03T16:56:51.499639Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 12  requestId: <none> cookie: 7
2025-11-03T16:56:51.499844Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:56:51.500165Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271187968, Sender [3:7568544170873736328:2472], Recipient [4:7568544170866189115:2437]
2025-11-03T16:56:51.500186Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5316: HandleHook, processing event TEvPersQueue::TEvRequest
2025-11-03T16:56:51.500224Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:56:51.500238Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:56:51.500294Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0test-message-group-id2' SeqNo: 7 partNo : 0 messageNo: 13 size 98 offset: -1
2025-11-03T16:56:51.500347Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188480 (NKikimr::TEvPQ::TEvWrite), Tablet [4:7568544170866189024:2388], Partition 0, Sender [4:7568544170866189024:2388], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:56:51.500383Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188480, Sender [4:7568544170866189024:2388], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvWrite
2025-11-03T16:56:51.500403Z node 4 :PERSQUEUE TRACE: partition.h:628: StateIdle, processing event TEvPQ::TEvWrite
2025-11-03T16:56:51.500414Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:56:51.500450Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:51.500475Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:51.500490Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-03T16:56:51.500545Z node 4 :PERSQUEUE TRACE: partition_write.cpp:1168: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 process write for '\0test-message-group-id2' DisableDeduplication=0 SeqNo=7 LocalSeqNo=6 InitialSeqNo=(NULL) EnableKafkaDeduplication=0 ProducerEpoch=(empty maybe)
2025-11-03T16:56:51.500608Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0test-message-group-id2' seqNo 7 partNo 0
2025-11-03T16:56:51.542216Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0test-message-group-id2' seqNo 7 partNo 0 FormedBlobsCount 0 NewHead: Offset 13 PartNo 0 PackedSize 188 count 1 nextOffset 14 batches 1
2025-11-03T16:56:51.542283Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:51.542298Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 1 items to delete old stuff
2025-11-03T16:56:51.542393Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 1 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest CmdDeleteRange { Range { From: "x0000000000" IncludeFrom: true To: "x0000000001" IncludeTo: false } }
2025-11-03T16:56:51.542404Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:51.542773Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 13,1 HeadOffset 13 endOffset 13 curOffset 14 d0000000000_00000000000000000013_00000_0000000001_00000? size 176 WTime 1762189011542
2025-11-03T16:56:51.542791Z node 4 :PERSQUEUE TRACE: partition_write.cpp:1459: [72075186224037892][Partition][0][StateIdle] TPartition::AddNewFastWriteBlob
2025-11-03T16:56:51.542854Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:51.542993Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188562 (NKikimr::TEvPQ::TEvTxBatchComplete), Tablet [4:7568544170866189024:2388], Partition 0, Sender [4:7568544170866189065:2388], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:56:51.543034Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188562, Sender [4:7568544170866189065:2388], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvTxBatchComplete
2025-11-03T16:56:51.543056Z node 4 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-03T16:56:51.543332Z node 4 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 13 partNo 0 count 1 size 176
2025-11-03T16:56:51.543513Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 270794752, Sender [4:7568544170866189047:2388], Recipient [4:7568544170866189024:2388]: NKikimrClient.TKeyValueRequest Cookie: 14 CmdDeleteRange { Range { From: "x0000000000" IncludeFrom: true To: "x0000000001" IncludeTo: false } } CmdWrite { Key: "m0000000000p\000test-message-group-id2" Value: "\010\007\020\r\030\245\372\272\320\271\326\220\003 \207\342\236\320\271\326\220\003(\000H\001" StorageChannel: INLINE } CmdWrite { Key: "d0000000000_00000000000000000013_00000_0000000001_00000?" Value: "\022\000\010\r\020\000\030\001 \000(\234\0010\234\0018\000@\000\234\000\000\000\007\000\000\000\000\000\000\000\016,j\246J\232\001\000\000(j\246J\232\001\000\000\007\000\000\000\027\000\000test-message-group-id2\010\007\030\250\324\231\325\2443B\020ipv6:[::1]:52486P\001\342\007$\n\020ipv6:[::1]:52486\032\007unknown\"\007unknown\372\007\033\037\213\010\000\000\000\000\000\000\003\313M-.NLO\005\000\1770\275\266\007\000\000\000" StorageChannel: INLINE } CmdWrite { Key: "i0000000000" Value: "\030\000(\254\324\231\325\2443" StorageChannel: INLINE }
2025-11-03T16:56:51.543671Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 270794753, Sender [4:7568544175161156499:2388], Recipient [4:7568544170866189024:2388]: NKikimr::TEvKeyValue::TEvIntermediate
2025-11-03T16:56:51.546122Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 13 count 1 size 176 actorID [4:7568544170866189047:2388]
2025-11-03T16:56:51.546209Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 270795264 (NKikimr::TEvKeyValue::TEvResponse), Tablet [4:7568544170866189024:2388], Partition 0, Sender [4:7568544170866189047:2388], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:56:51.546326Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 270795264, Sender [4:7568544170866189047:2388], Recipient [4:7568544170866189065:2388]: NKikimrClient.TResponse Status: 1 DeleteRangeResult { Status: 0 } WriteResult { Status: 0 StatusFlags: 1 } WriteResult { Status: 0 StatusFlags: 1 } WriteResult { Status: 0 StatusFlags: 1 }
2025-11-03T16:56:51.546345Z node 4 :PERSQUEUE TRACE: partition.h:625: StateIdle, processing event TEvKeyValue::TEvResponse
2025-11-03T16:56:51.546361Z node 4 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-03T16:56:51.546382Z node 4 :PERSQUEUE TRACE: partition_write.cpp:518: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse.
2025-11-03T16:56:51.546416Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 121 WriteNewSizeFromSupportivePartitions# 0
2025-11-03T16:56:51.546432Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=1
2025-11-03T16:56:51.546466Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:56:51.546503Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0test-message-group-id2', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 7, partNo: 0, Offset: 13 is stored on disk
2025-11-03T16:56:51.546520Z node 4 :PERSQUEUE TRACE: partition_write.cpp:424: [72075186224037892][Partition][0][StateIdle] TPartition::SyncMemoryStateWithKVState.
2025-11-03T16:56:51.546665Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:51.546677Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:51.546688Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:51.546705Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:51.546737Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:51.546752Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:51.546768Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:51.546784Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:56:51.546834Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271188493, Sender [4:7568544170866189065:2388], Recipient [4:7568544170866189024:2388]: NKikimr::TEvPQ::TEvProxyResponse
2025-11-03T16:56:51.546852Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5335: HandleHook, processing event TEvPQ::TEvProxyResponse
2025-11-03T16:56:51.546895Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 13  requestId: <none> cookie: 7
2025-11-03T16:56:51.547019Z node 4 :PERSQUEUE TRACE: pq_l2_cache.h:116: StateFunc, received event# 271450112, Sender [4:7568544170866189047:2388], Recipient [4:7568544115031613334:2071]: NKikimr::NPQ::TEvPqCache::TEvCacheL2Request
2025-11-03T16:56:51.547039Z node 4 :PERSQUEUE TRACE: pq_l2_cache.h:119: StateFunc, processing event TEvPqCache::TEvCacheL2Request
2025-11-03T16:56:51.547083Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 13 partno 0 count 1 parts 0 suffix '63' size 176
2025-11-03T16:56:51.547247Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:56:51.548239Z :DEBUG: [/Root] MessageGroupId [test-message-group-id2] SessionId [test-message-group-id2|d956c290-47a73c9e-b109a607-e01775e1_0] Write session got write response: sequence_numbers: 7 offsets: 13 already_written: false write_statistics { persist_duration_ms: 4 queued_in_partition_duration_ms: 41 }
2025-11-03T16:56:51.548297Z :DEBUG: [/Root] MessageGroupId [test-message-group-id2] SessionId [test-message-group-id2|d956c290-47a73c9e-b109a607-e01775e1_0] Write session: acknoledged message 7
2025-11-03T16:56:51.548871Z :TWriteSession_SeqNoShift INFO: Enqueue message with sequence number 8
2025-11-03T16:56:51.548967Z :DEBUG: [/Root] MessageGroupId [test-message-group-id1] SessionId [test-message-group-id1|f1b47779-84f57a92-ac9e6f8a-5d32ebe8_0] Write 1 messages with Id from 8 to 8
2025-11-03T16:56:51.549051Z :TWriteSession_SeqNoShift INFO: Wait for writer event
2025-11-03T16:56:51.549094Z :TWriteSession_SeqNoShift INFO: Got new continue token
2025-11-03T16:56:51.552362Z :DEBUG: [/Root] MessageGroupId [test-message-group-id1] SessionId [test-message-group-id1|f1b47779-84f57a92-ac9e6f8a-5d32ebe8_0] Write session: try to update token
2025-11-03T16:56:51.552409Z :DEBUG: [/Root] MessageGroupId [test-message-group-id1] SessionId [test-message-group-id1|f1b47779-84f57a92-ac9e6f8a-5d32ebe8_0] Send 1 message(s) (0 left), first sequence number is 8
2025-11-03T16:56:51.553813Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:51.553889Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:51.553910Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:51.553941Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:51.553955Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:51.553967Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:51.553987Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:51.554044Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:51.554068Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:51.554090Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:51.556215Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: test-message-group-id1|f1b47779-84f57a92-ac9e6f8a-5d32ebe8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:56:51.556622Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:56:51.558395Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271187968, Sender [3:7568544170873736324:2471], Recipient [4:7568544170866189114:2436]
2025-11-03T16:56:51.558431Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5316: HandleHook, processing event TEvPersQueue::TEvRequest
2025-11-03T16:56:51.558499Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:56:51.558533Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:56:51.558611Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188507 (NKikimr::TEvPQ::TEvReserveBytes), Tablet [4:7568544170866189024:2388], Partition 0, Sender [4:7568544170866189024:2388], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:56:51.558661Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188507, Sender [4:7568544170866189024:2388], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvReserveBytes
2025-11-03T16:56:51.558678Z node 4 :PERSQUEUE TRACE: partition.h:650: StateIdle, processing event TEvPQ::TEvReserveBytes
2025-11-03T16:56:51.558704Z node 4 :PERSQUEUE TRACE: partition_write.cpp:220: [72075186224037892][Partition][0][StateIdle] TPartition::HandleOnWrite TEvReserveBytes.
2025-11-03T16:56:51.558722Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:51.558788Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271188493, Sender [4:7568544170866189065:2388], Recipient [4:7568544170866189024:2388]: NKikimr::TEvPQ::TEvProxyResponse
2025-11-03T16:56:51.558806Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5335: HandleHook, processing event TEvPQ::TEvProxyResponse
2025-11-03T16:56:51.558823Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 14  requestId: <none> cookie: 8
2025-11-03T16:56:51.566775Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:56:51.568037Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271187968, Sender [3:7568544170873736324:2471], Recipient [4:7568544170866189114:2436]
2025-11-03T16:56:51.568072Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5316: HandleHook, processing event TEvPersQueue::TEvRequest
2025-11-03T16:56:51.568151Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:56:51.568179Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:56:51.568245Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0test-message-group-id1' SeqNo: 8 partNo : 0 messageNo: 15 size 98 offset: -1
2025-11-03T16:56:51.568323Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188480 (NKikimr::TEvPQ::TEvWrite), Tablet [4:7568544170866189024:2388], Partition 0, Sender [4:7568544170866189024:2388], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:56:51.568374Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188480, Sender [4:7568544170866189024:2388], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvWrite
2025-11-03T16:56:51.568391Z node 4 :PERSQUEUE TRACE: partition.h:628: StateIdle, processing event TEvPQ::TEvWrite
2025-11-03T16:56:51.568414Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:56:51.568456Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:51.568478Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:51.568488Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-03T16:56:51.568547Z node 4 :PERSQUEUE TRACE: partition_write.cpp:1168: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 process write for '\0test-message-group-id1' DisableDeduplication=0 SeqNo=8 LocalSeqNo=7 InitialSeqNo=(NULL) EnableKafkaDeduplication=0 ProducerEpoch=(empty maybe)
2025-11-03T16:56:51.568614Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0test-message-group-id1' seqNo 8 partNo 0
2025-11-03T16:56:51.569598Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0test-message-group-id1' seqNo 8 partNo 0 FormedBlobsCount 0 NewHead: Offset 14 PartNo 0 PackedSize 188 count 1 nextOffset 15 batches 1
2025-11-03T16:56:51.569637Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:51.569652Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 1 items to delete old stuff
2025-11-03T16:56:51.569756Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 1 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest CmdDeleteRange { Range { From: "x0000000000" IncludeFrom: true To: "x0000000001" IncludeTo: false } }
2025-11-03T16:56:51.569770Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:51.570159Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 14,1 HeadOffset 14 endOffset 14 curOffset 15 d0000000000_00000000000000000014_00000_0000000001_00000? size 176 WTime 1762189011567
2025-11-03T16:56:51.570172Z node 4 :PERSQUEUE TRACE: partition_write.cpp:1459: [72075186224037892][Partition][0][StateIdle] TPartition::AddNewFastWriteBlob
2025-11-03T16:56:51.570253Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:51.570357Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188562 (NKikimr::TEvPQ::TEvTxBatchComplete), Tablet [4:7568544170866189024:2388], Partition 0, Sender [4:7568544170866189065:2388], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:56:51.570395Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188562, Sender [4:7568544170866189065:2388], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvTxBatchComplete
2025-11-03T16:56:51.570419Z node 4 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-03T16:56:51.570511Z node 4 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 14 partNo 0 count 1 size 176
2025-11-03T16:56:51.570693Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 270794752, Sender [4:7568544170866189047:2388], Recipient [4:7568544170866189024:2388]: NKikimrClient.TKeyValueRequest Cookie: 15 CmdDeleteRange { Range { From: "x0000000000" IncludeFrom: true To: "x0000000001" IncludeTo: false } } CmdWrite { Key: "m0000000000p\000test-message-group-id1" Value: "\010\010\020\016\030\363\211\277\320\271\326\220\003 \366\231\231\320\271\326\220\003(\000H\001" StorageChannel: INLINE } CmdWrite { Key: "d0000000000_00000000000000000014_00000_0000000001_00000?" Value: "\022\000\010\016\020\000\030\001 \000(\234\0010\234\0018\000@\000\234\000\000\000\010\000\000\000\000\000\000\000\016oj\246J\232\001\000\000\\j\246J\232\001\000\000\007\000\000\000\027\000\000test-message-group-id1\010\010\030\334\324\231\325\2443B\020ipv6:[::1]:52486P\001\342\007$\n\020ipv6:[::1]:52486\032\007unknown\"\007unknown\372\007\033\037\213\010\000\000\000\000\000\000\003\313M-.NLO\005\000\1770\275\266\007\000\000\000" StorageChannel: INLINE } CmdWrite { Key: "i0000000000" Value: "\030\000(\357\324\231\325\2443" StorageChannel: INLINE }
2025-11-03T16:56:51.570935Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 270794753, Sender [4:7568544175161156503:2388], Recipient [4:7568544170866189024:2388]: NKikimr::TEvKeyValue::TEvIntermediate
2025-11-03T16:56:51.574089Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 14 count 1 size 176 actorID [4:7568544170866189047:2388]
2025-11-03T16:56:51.574178Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 270795264 (NKikimr::TEvKeyValue::TEvResponse), Tablet [4:7568544170866189024:2388], Partition 0, Sender [4:7568544170866189047:2388], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:56:51.574302Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 270795264, Sender [4:7568544170866189047:2388], Recipient [4:7568544170866189065:2388]: NKikimrClient.TResponse Status: 1 DeleteRangeResult { Status: 0 } WriteResult { Status: 0 StatusFlags: 1 } WriteResult { Status: 0 StatusFlags: 1 } WriteResult { Status: 0 StatusFlags: 1 }
2025-11-03T16:56:51.574322Z node 4 :PERSQUEUE TRACE: partition.h:625: StateIdle, processing event TEvKeyValue::TEvResponse
2025-11-03T16:56:51.574338Z node 4 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-03T16:56:51.574361Z node 4 :PERSQUEUE TRACE: partition_write.cpp:518: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse.
2025-11-03T16:56:51.574394Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 121 WriteNewSizeFromSupportivePartitions# 0
2025-11-03T16:56:51.574409Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=1
2025-11-03T16:56:51.574439Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:56:51.574473Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0test-message-group-id1', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 8, partNo: 0, Offset: 14 is stored on disk
2025-11-03T16:56:51.574490Z node 4 :PERSQUEUE TRACE: partition_write.cpp:424: [72075186224037892][Partition][0][StateIdle] TPartition::SyncMemoryStateWithKVState.
2025-11-03T16:56:51.574631Z node 4 :PERSQUEUE TRACE: pq_l2_cache.h:116: StateFunc, received event# 271450112, Sender [4:7568544170866189047:2388], Recipient [4:7568544115031613334:2071]: NKikimr::NPQ::TEvPqCache::TEvCacheL2Request
2025-11-03T16:56:51.574650Z node 4 :PERSQUEUE TRACE: pq_l2_cache.h:119: StateFunc, processing event TEvPqCache::TEvCacheL2Request
2025-11-03T16:56:51.574695Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 1 parts 0 suffix '63' size 176
2025-11-03T16:56:51.575216Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:51.575238Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:51.575253Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:51.575269Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:51.575305Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:51.575318Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:51.575333Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:51.575349Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:56:51.575397Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [4:7568544170866189024:2388], Partition 0, Sender [0:0:0], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:56:51.575432Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:51.575447Z node 4 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:51.575465Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:51.575485Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:51.575495Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:51.575510Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:51.575533Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:51.575543Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:51.575558Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:51.575881Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:56:51.575603Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271188493, Sender [4:7568544170866189065:2388], Recipient [4:7568544170866189024:2388]: NKikimr::TEvPQ::TEvProxyResponse
2025-11-03T16:56:51.575621Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5335: HandleHook, processing event TEvPQ::TEvProxyResponse
2025-11-03T16:56:51.575645Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 15  requestId: <none> cookie: 8
2025-11-03T16:56:51.576563Z :DEBUG: [/Root] MessageGroupId [test-message-group-id1] SessionId [test-message-group-id1|f1b47779-84f57a92-ac9e6f8a-5d32ebe8_0] Write session got write response: sequence_numbers: 8 offsets: 14 already_written: false write_statistics { persist_duration_ms: 6 }
2025-11-03T16:56:51.576605Z :DEBUG: [/Root] MessageGroupId [test-message-group-id1] SessionId [test-message-group-id1|f1b47779-84f57a92-ac9e6f8a-5d32ebe8_0] Write session: acknoledged message 8
2025-11-03T16:56:51.576884Z :TWriteSession_SeqNoShift INFO: Enqueue message with sequence number 8
2025-11-03T16:56:51.576966Z :DEBUG: [/Root] MessageGroupId [test-message-group-id2] SessionId [test-message-group-id2|d956c290-47a73c9e-b109a607-e01775e1_0] Write 1 messages with Id from 8 to 8
2025-11-03T16:56:51.577106Z :TWriteSession_SeqNoShift INFO: Wait for writer event
2025-11-03T16:56:51.577152Z :TWriteSession_SeqNoShift INFO: Got new continue token
2025-11-03T16:56:51.580358Z :DEBUG: [/Root] MessageGroupId [test-message-group-id2] SessionId [test-message-group-id2|d956c290-47a73c9e-b109a607-e01775e1_0] Write session: try to update token
2025-11-03T16:56:51.580402Z :DEBUG: [/Root] MessageGroupId [test-message-group-id2] SessionId [test-message-group-id2|d956c290-47a73c9e-b109a607-e01775e1_0] Send 1 message(s) (0 left), first sequence number is 8
2025-11-03T16:56:51.581244Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3 sessionId: test-message-group-id2|d956c290-47a73c9e-b109a607-e01775e1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:56:51.581895Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:56:51.585472Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271187968, Sender [3:7568544170873736328:2472], Recipient [4:7568544170866189115:2437]
2025-11-03T16:56:51.585520Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5316: HandleHook, processing event TEvPersQueue::TEvRequest
2025-11-03T16:56:51.585593Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:56:51.585622Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:56:51.585709Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188507 (NKikimr::TEvPQ::TEvReserveBytes), Tablet [4:7568544170866189024:2388], Partition 0, Sender [4:7568544170866189024:2388], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:56:51.585748Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188507, Sender [4:7568544170866189024:2388], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvReserveBytes
2025-11-03T16:56:51.585767Z node 4 :PERSQUEUE TRACE: partition.h:650: StateIdle, processing event TEvPQ::TEvReserveBytes
2025-11-03T16:56:51.585783Z node 4 :PERSQUEUE TRACE: partition_write.cpp:220: [72075186224037892][Partition][0][StateIdle] TPartition::HandleOnWrite TEvReserveBytes.
2025-11-03T16:56:51.585803Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:51.585861Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271188493, Sender [4:7568544170866189065:2388], Recipient [4:7568544170866189024:2388]: NKikimr::TEvPQ::TEvProxyResponse
2025-11-03T16:56:51.585881Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5335: HandleHook, processing event TEvPQ::TEvProxyResponse
2025-11-03T16:56:51.585895Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 14  requestId: <none> cookie: 8
2025-11-03T16:56:51.586149Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:56:51.586526Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271187968, Sender [3:7568544170873736328:2472], Recipient [4:7568544170866189115:2437]
2025-11-03T16:56:51.586543Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5316: HandleHook, processing event TEvPersQueue::TEvRequest
2025-11-03T16:56:51.586588Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:56:51.586616Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:56:51.586664Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0test-message-group-id2' SeqNo: 8 partNo : 0 messageNo: 15 size 98 offset: -1
2025-11-03T16:56:51.586716Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188480 (NKikimr::TEvPQ::TEvWrite), Tablet [4:7568544170866189024:2388], Partition 0, Sender [4:7568544170866189024:2388], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:56:51.586752Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188480, Sender [4:7568544170866189024:2388], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvWrite
2025-11-03T16:56:51.586766Z node 4 :PERSQUEUE TRACE: partition.h:628: StateIdle, processing event TEvPQ::TEvWrite
2025-11-03T16:56:51.586779Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:56:51.586820Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:51.586843Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:51.586854Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-03T16:56:51.586929Z node 4 :PERSQUEUE TRACE: partition_write.cpp:1168: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 process write for '\0test-message-group-id2' DisableDeduplication=0 SeqNo=8 LocalSeqNo=7 InitialSeqNo=(NULL) EnableKafkaDeduplication=0 ProducerEpoch=(empty maybe)
2025-11-03T16:56:51.586990Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0test-message-group-id2' seqNo 8 partNo 0
2025-11-03T16:56:51.587883Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0test-message-group-id2' seqNo 8 partNo 0 FormedBlobsCount 0 NewHead: Offset 15 PartNo 0 PackedSize 188 count 1 nextOffset 16 batches 1
2025-11-03T16:56:51.587916Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:51.587931Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 1 items to delete old stuff
2025-11-03T16:56:51.588066Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 1 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest CmdDeleteRange { Range { From: "x0000000000" IncludeFrom: true To: "x0000000001" IncludeTo: false } }
2025-11-03T16:56:51.588079Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:51.588474Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 15,1 HeadOffset 15 endOffset 15 curOffset 16 d0000000000_00000000000000000015_00000_0000000001_00000? size 176 WTime 1762189011588
2025-11-03T16:56:51.588488Z node 4 :PERSQUEUE TRACE: partition_write.cpp:1459: [72075186224037892][Partition][0][StateIdle] TPartition::AddNewFastWriteBlob
2025-11-03T16:56:51.588565Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:51.588654Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188562 (NKikimr::TEvPQ::TEvTxBatchComplete), Tablet [4:7568544170866189024:2388], Partition 0, Sender [4:7568544170866189065:2388], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:56:51.588687Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188562, Sender [4:7568544170866189065:2388], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvTxBatchComplete
2025-11-03T16:56:51.588708Z node 4 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-03T16:56:51.588807Z node 4 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 15 partNo 0 count 1 size 176
2025-11-03T16:56:51.588980Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 270794752, Sender [4:7568544170866189047:2388], Recipient [4:7568544170866189024:2388]: NKikimrClient.TKeyValueRequest Cookie: 16 CmdDeleteRange { Range { From: "x0000000000" IncludeFrom: true To: "x0000000001" IncludeTo: false } } CmdWrite { Key: "m0000000000p\000test-message-group-id2" Value: "\010\010\020\017\030\227\232\300\320\271\326\220\003 \207\342\236\320\271\326\220\003(\000H\001" StorageChannel: INLINE } CmdWrite { Key: "d0000000000_00000000000000000015_00000_0000000001_00000?" Value: "\022\000\010\017\020\000\030\001 \000(\234\0010\234\0018\000@\000\234\000\000\000\010\000\000\000\000\000\000\000\016\202j\246J\232\001\000\000xj\246J\232\001\000\000\007\000\000\000\027\000\000test-message-group-id2\010\010\030\370\324\231\325\2443B\020ipv6:[::1]:52486P\001\342\007$\n\020ipv6:[::1]:52486\032\007unknown\"\007unknown\372\007\033\037\213\010\000\000\000\000\000\000\003\313M-.NLO\005\000\1770\275\266\007\000\000\000" StorageChannel: INLINE } CmdWrite { Key: "i0000000000" Value: "\030\000(\202\325\231\325\2443" StorageChannel: INLINE }
2025-11-03T16:56:51.589142Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 270794753, Sender [4:7568544175161156506:2388], Recipient [4:7568544170866189024:2388]: NKikimr::TEvKeyValue::TEvIntermediate
2025-11-03T16:56:51.598064Z :DEBUG: [/Root] MessageGroupId [test-message-group-id2] SessionId [test-message-group-id2|d956c290-47a73c9e-b109a607-e01775e1_0] Write session got write response: sequence_numbers: 8 offsets: 15 already_written: false write_statistics { persist_duration_ms: 6 queued_in_partition_duration_ms: 1 }
2025-11-03T16:56:51.598125Z :DEBUG: [/Root] MessageGroupId [test-message-group-id2] SessionId [test-message-group-id2|d956c290-47a73c9e-b109a607-e01775e1_0] Write session: acknoledged message 8
2025-11-03T16:56:51.599227Z :TWriteSession_SeqNoShift INFO: Enqueue message with sequence number 9
2025-11-03T16:56:51.599328Z :DEBUG: [/Root] MessageGroupId [test-message-group-id1] SessionId [test-message-group-id1|f1b47779-84f57a92-ac9e6f8a-5d32ebe8_0] Write 1 messages with Id from 9 to 9
2025-11-03T16:56:51.599422Z :TWriteSession_SeqNoShift INFO: Wait for writer event
2025-11-03T16:56:51.599461Z :TWriteSession_SeqNoShift INFO: Got new continue token
2025-11-03T16:56:51.596247Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:56:51.595105Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 15 count 1 size 176 actorID [4:7568544170866189047:2388]
2025-11-03T16:56:51.595219Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 270795264 (NKikimr::TEvKeyValue::TEvResponse), Tablet [4:7568544170866189024:2388], Partition 0, Sender [4:7568544170866189047:2388], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:56:51.595360Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 270795264, Sender [4:7568544170866189047:2388], Recipient [4:7568544170866189065:2388]: NKikimrClient.TResponse Status: 1 DeleteRangeResult { Status: 0 } WriteResult { Status: 0 StatusFlags: 1 } WriteResult { Status: 0 StatusFlags: 1 } WriteResult { Status: 0 StatusFlags: 1 }
2025-11-03T16:56:51.595381Z node 4 :PERSQUEUE TRACE: partition.h:625: StateIdle, processing event TEvKeyValue::TEvResponse
2025-11-03T16:56:51.595397Z node 4 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-03T16:56:51.595419Z node 4 :PERSQUEUE TRACE: partition_write.cpp:518: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse.
2025-11-03T16:56:51.595417Z node 4 :PERSQUEUE TRACE: pq_l2_cache.h:116: StateFunc, received event# 271450112, Sender [4:7568544170866189047:2388], Recipient [4:7568544115031613334:2071]: NKikimr::NPQ::TEvPqCache::TEvCacheL2Request
2025-11-03T16:56:51.595441Z node 4 :PERSQUEUE TRACE: pq_l2_cache.h:119: StateFunc, processing event TEvPqCache::TEvCacheL2Request
2025-11-03T16:56:51.600334Z :DEBUG: [/Root] MessageGroupId [test-message-group-id1] SessionId [test-message-group-id1|f1b47779-84f57a92-ac9e6f8a-5d32ebe8_0] Write session: try to update token
2025-11-03T16:56:51.595457Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 121 WriteNewSizeFromSupportivePartitions# 0
2025-11-03T16:56:51.595473Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=1
2025-11-03T16:56:51.600371Z :DEBUG: [/Root] MessageGroupId [test-message-group-id1] SessionId [test-message-group-id1|f1b47779-84f57a92-ac9e6f8a-5d32ebe8_0] Send 1 message(s) (0 left), first sequence number is 9
2025-11-03T16:56:51.595494Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 15 partno 0 count 1 parts 0 suffix '63' size 176
2025-11-03T16:56:51.595506Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:56:51.595544Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0test-message-group-id2', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 8, partNo: 0, Offset: 15 is stored on disk
2025-11-03T16:56:51.595562Z node 4 :PERSQUEUE TRACE: partition_write.cpp:424: [72075186224037892][Partition][0][StateIdle] TPartition::SyncMemoryStateWithKVState.
2025-11-03T16:56:51.595718Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:51.595731Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:51.595743Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:51.595759Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:51.595795Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:51.595810Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:51.595826Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:51.595844Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:56:51.595914Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271188493, Sender [4:7568544170866189065:2388], Recipient [4:7568544170866189024:2388]: NKikimr::TEvPQ::TEvProxyResponse
2025-11-03T16:56:51.595933Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5335: HandleHook, processing event TEvPQ::TEvProxyResponse
2025-11-03T16:56:51.595954Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 15  requestId: <none> cookie: 8
2025-11-03T16:56:51.601192Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: test-message-group-id1|f1b47779-84f57a92-ac9e6f8a-5d32ebe8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:56:51.601438Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:56:51.605918Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:56:51.604996Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271187968, Sender [3:7568544170873736324:2471], Recipient [4:7568544170866189114:2436]
2025-11-03T16:56:51.605036Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5316: HandleHook, processing event TEvPersQueue::TEvRequest
2025-11-03T16:56:51.605103Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:56:51.605129Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:56:51.605229Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188507 (NKikimr::TEvPQ::TEvReserveBytes), Tablet [4:7568544170866189024:2388], Partition 0, Sender [4:7568544170866189024:2388], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:56:51.605273Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188507, Sender [4:7568544170866189024:2388], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvReserveBytes
2025-11-03T16:56:51.605295Z node 4 :PERSQUEUE TRACE: partition.h:650: StateIdle, processing event TEvPQ::TEvReserveBytes
2025-11-03T16:56:51.605311Z node 4 :PERSQUEUE TRACE: partition_write.cpp:220: [72075186224037892][Partition][0][StateIdle] TPartition::HandleOnWrite TEvReserveBytes.
2025-11-03T16:56:51.605331Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:51.605393Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271188493, Sender [4:7568544170866189065:2388], Recipient [4:7568544170866189024:2388]: NKikimr::TEvPQ::TEvProxyResponse
2025-11-03T16:56:51.605416Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5335: HandleHook, processing event TEvPQ::TEvProxyResponse
2025-11-03T16:56:51.605433Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 16  requestId: <none> cookie: 9
2025-11-03T16:56:51.606467Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271187968, Sender [3:7568544170873736324:2471], Recipient [4:7568544170866189114:2436]
2025-11-03T16:56:51.606489Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5316: HandleHook, processing event TEvPersQueue::TEvRequest
2025-11-03T16:56:51.606538Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:56:51.606558Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:56:51.606610Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0test-message-group-id1' SeqNo: 9 partNo : 0 messageNo: 17 size 98 offset: -1
2025-11-03T16:56:51.606667Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188480 (NKikimr::TEvPQ::TEvWrite), Tablet [4:7568544170866189024:2388], Partition 0, Sender [4:7568544170866189024:2388], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:56:51.606703Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188480, Sender [4:7568544170866189024:2388], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvWrite
2025-11-03T16:56:51.606733Z node 4 :PERSQUEUE TRACE: partition.h:628: StateIdle, processing event TEvPQ::TEvWrite
2025-11-03T16:56:51.606748Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:56:51.606786Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:51.606818Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:51.606830Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-03T16:56:51.606911Z node 4 :PERSQUEUE TRACE: partition_write.cpp:1168: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 process write for '\0test-message-group-id1' DisableDeduplication=0 SeqNo=9 LocalSeqNo=8 InitialSeqNo=(NULL) EnableKafkaDeduplication=0 ProducerEpoch=(empty maybe)
2025-11-03T16:56:51.606976Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0test-message-group-id1' seqNo 9 partNo 0
2025-11-03T16:56:51.654045Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:51.654095Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:51.654110Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:51.654134Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:51.654145Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:51.654153Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:51.654169Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:51.654214Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:51.654222Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:51.654239Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:51.679199Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0test-message-group-id1' seqNo 9 partNo 0 FormedBlobsCount 0 NewHead: Offset 16 PartNo 0 PackedSize 188 count 1 nextOffset 17 batches 1
2025-11-03T16:56:51.679270Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:51.679286Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 1 items to delete old stuff
2025-11-03T16:56:51.679383Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 1 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest CmdDeleteRange { Range { From: "x0000000000" IncludeFrom: true To: "x0000000001" IncludeTo: false } }
2025-11-03T16:56:51.679393Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:51.679792Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 16,1 HeadOffset 16 endOffset 16 curOffset 17 d0000000000_00000000000000000016_00000_0000000001_00000? size 176 WTime 1762189011671
2025-11-03T16:56:51.679805Z node 4 :PERSQUEUE TRACE: partition_write.cpp:1459: [72075186224037892][Partition][0][StateIdle] TPartition::AddNewFastWriteBlob
2025-11-03T16:56:51.679874Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:51.680292Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188562 (NKikimr::TEvPQ::TEvTxBatchComplete), Tablet [4:7568544170866189024:2388], Partition 0, Sender [4:7568544170866189065:2388], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:56:51.680339Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188562, Sender [4:7568544170866189065:2388], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvTxBatchComplete
2025-11-03T16:56:51.680365Z node 4 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-03T16:56:51.680467Z node 4 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 16 partNo 0 count 1 size 176
2025-11-03T16:56:51.680518Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [4:7568544170866189024:2388], Partition 0, Sender [0:0:0], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:56:51.680547Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:51.680563Z node 4 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:51.680584Z node 4 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:56:51.680761Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 270794752, Sender [4:7568544170866189047:2388], Recipient [4:7568544170866189024:2388]: NKikimrClient.TKeyValueRequest Cookie: 17 CmdDeleteRange { Range { From: "x0000000000" IncludeFrom: true To: "x0000000001" IncludeTo: false } } CmdWrite { Key: "m0000000000p\000test-message-group-id1" Value: "\010\t\020\020\030\221\272\301\320\271\326\220\003 \366\231\231\320\271\326\220\003(\000H\001" StorageChannel: INLINE } CmdWrite { Key: "d0000000000_00000000000000000016_00000_0000000001_00000?" Value: "\022\000\010\020\020\000\030\001 \000(\234\0010\234\0018\000@\000\234\000\000\000\t\000\000\000\000\000\000\000\016\226j\246J\232\001\000\000\217j\246J\232\001\000\000\007\000\000\000\027\000\000test-message-group-id1\010\t\030\217\325\231\325\2443B\020ipv6:[::1]:52486P\001\342\007$\n\020ipv6:[::1]:52486\032\007unknown\"\007unknown\372\007\033\037\213\010\000\000\000\000\000\000\003\313M-.NLO\005\000\1770\275\266\007\000\000\000" StorageChannel: INLINE } CmdWrite { Key: "i0000000000" Value: "\030\000(\226\325\231\325\2443" StorageChannel: INLINE }
2025-11-03T16:56:51.680933Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 270794753, Sender [4:7568544175161156510:2388], Recipient [4:7568544170866189024:2388]: NKikimr::TEvKeyValue::TEvIntermediate
2025-11-03T16:56:51.692212Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 16 count 1 size 176 actorID [4:7568544170866189047:2388]
2025-11-03T16:56:51.692330Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 270795264 (NKikimr::TEvKeyValue::TEvResponse), Tablet [4:7568544170866189024:2388], Partition 0, Sender [4:7568544170866189047:2388], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:56:51.692483Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 270795264, Sender [4:7568544170866189047:2388], Recipient [4:7568544170866189065:2388]: NKikimrClient.TResponse Status: 1 DeleteRangeResult { Status: 0 } WriteResult { Status: 0 StatusFlags: 1 } WriteResult { Status: 0 StatusFlags: 1 } WriteResult { Status: 0 StatusFlags: 1 }
2025-11-03T16:56:51.692508Z node 4 :PERSQUEUE TRACE: partition.h:625: StateIdle, processing event TEvKeyValue::TEvResponse
2025-11-03T16:56:51.692525Z node 4 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-03T16:56:51.692548Z node 4 :PERSQUEUE TRACE: partition_write.cpp:518: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse.
2025-11-03T16:56:51.692585Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 121 WriteNewSizeFromSupportivePartitions# 0
2025-11-03T16:56:51.692603Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=1
2025-11-03T16:56:51.692637Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:56:51.692676Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0test-message-group-id1', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 9, partNo: 0, Offset: 16 is stored on disk
2025-11-03T16:56:51.692696Z node 4 :PERSQUEUE TRACE: partition_write.cpp:424: [72075186224037892][Partition][0][StateIdle] TPartition::SyncMemoryStateWithKVState.
2025-11-03T16:56:51.692862Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:51.692877Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:51.692891Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:51.692910Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:51.692954Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:51.692969Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:51.692986Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:51.693004Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:56:51.693075Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271188493, Sender [4:7568544170866189065:2388], Recipient [4:7568544170866189024:2388]: NKikimr::TEvPQ::TEvProxyResponse
2025-11-03T16:56:51.693100Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5335: HandleHook, processing event TEvPQ::TEvProxyResponse
2025-11-03T16:56:51.693127Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 17  requestId: <none> cookie: 9
2025-11-03T16:56:51.693778Z node 4 :PERSQUEUE TRACE: pq_l2_cache.h:116: StateFunc, received event# 271450112, Sender [4:7568544170866189047:2388], Recipient [4:7568544115031613334:2071]: NKikimr::NPQ::TEvPqCache::TEvCacheL2Request
2025-11-03T16:56:51.693812Z node 4 :PERSQUEUE TRACE: pq_l2_cache.h:119: StateFunc, processing event TEvPqCache::TEvCacheL2Request
2025-11-03T16:56:51.693864Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 16 partno 0 count 1 parts 0 suffix '63' size 176
2025-11-03T16:56:51.694167Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:56:51.695248Z :DEBUG: [/Root] MessageGroupId [test-message-group-id1] SessionId [test-message-group-id1|f1b47779-84f57a92-ac9e6f8a-5d32ebe8_0] Write session got write response: sequence_numbers: 9 offsets: 16 already_written: false write_statistics { persist_duration_ms: 20 queued_in_partition_duration_ms: 65 }
2025-11-03T16:56:51.695303Z :DEBUG: [/Root] MessageGroupId [test-message-group-id1] SessionId [test-message-group-id1|f1b47779-84f57a92-ac9e6f8a-5d32ebe8_0] Write session: acknoledged message 9
2025-11-03T16:56:51.708067Z :TWriteSession_SeqNoShift INFO: Enqueue message with sequence number 9
2025-11-03T16:56:51.708179Z :DEBUG: [/Root] MessageGroupId [test-message-group-id2] SessionId [test-message-group-id2|d956c290-47a73c9e-b109a607-e01775e1_0] Write 1 messages with Id from 9 to 9
2025-11-03T16:56:51.708292Z :TWriteSession_SeqNoShift INFO: Wait for writer event
2025-11-03T16:56:51.708339Z :TWriteSession_SeqNoShift INFO: Got new continue token
2025-11-03T16:56:51.709866Z :DEBUG: [/Root] MessageGroupId [test-message-group-id2] SessionId [test-message-group-id2|d956c290-47a73c9e-b109a607-e01775e1_0] Write session: try to update token
2025-11-03T16:56:51.709925Z :DEBUG: [/Root] MessageGroupId [test-message-group-id2] SessionId [test-message-group-id2|d956c290-47a73c9e-b109a607-e01775e1_0] Send 1 message(s) (0 left), first sequence number is 9
2025-11-03T16:56:51.710707Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3 sessionId: test-message-group-id2|d956c290-47a73c9e-b109a607-e01775e1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:56:51.711017Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:56:51.711476Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271187968, Sender [3:7568544170873736328:2472], Recipient [4:7568544170866189115:2437]
2025-11-03T16:56:51.711512Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5316: HandleHook, processing event TEvPersQueue::TEvRequest
2025-11-03T16:56:51.711571Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:56:51.711609Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:56:51.711692Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188507 (NKikimr::TEvPQ::TEvReserveBytes), Tablet [4:7568544170866189024:2388], Partition 0, Sender [4:7568544170866189024:2388], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:56:51.711739Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188507, Sender [4:7568544170866189024:2388], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvReserveBytes
2025-11-03T16:56:51.711761Z node 4 :PERSQUEUE TRACE: partition.h:650: StateIdle, processing event TEvPQ::TEvReserveBytes
2025-11-03T16:56:51.711777Z node 4 :PERSQUEUE TRACE: partition_write.cpp:220: [72075186224037892][Partition][0][StateIdle] TPartition::HandleOnWrite TEvReserveBytes.
2025-11-03T16:56:51.711795Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:51.711855Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271188493, Sender [4:7568544170866189065:2388], Recipient [4:7568544170866189024:2388]: NKikimr::TEvPQ::TEvProxyResponse
2025-11-03T16:56:51.711880Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5335: HandleHook, processing event TEvPQ::TEvProxyResponse
2025-11-03T16:56:51.711896Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 16  requestId: <none> cookie: 9
2025-11-03T16:56:51.712208Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:56:51.712488Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271187968, Sender [3:7568544170873736328:2472], Recipient [4:7568544170866189115:2437]
2025-11-03T16:56:51.712511Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5316: HandleHook, processing event TEvPersQueue::TEvRequest
2025-11-03T16:56:51.712559Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:56:51.712576Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:56:51.712634Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0test-message-group-id2' SeqNo: 9 partNo : 0 messageNo: 17 size 98 offset: -1
2025-11-03T16:56:51.712685Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188480 (NKikimr::TEvPQ::TEvWrite), Tablet [4:7568544170866189024:2388], Partition 0, Sender [4:7568544170866189024:2388], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:56:51.712718Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188480, Sender [4:7568544170866189024:2388], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvWrite
2025-11-03T16:56:51.712732Z node 4 :PERSQUEUE TRACE: partition.h:628: StateIdle, processing event TEvPQ::TEvWrite
2025-11-03T16:56:51.712745Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:56:51.712787Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:51.712810Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:51.712822Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-03T16:56:51.712880Z node 4 :PERSQUEUE TRACE: partition_write.cpp:1168: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 process write for '\0test-message-group-id2' DisableDeduplication=0 SeqNo=9 LocalSeqNo=8 InitialSeqNo=(NULL) EnableKafkaDeduplication=0 ProducerEpoch=(empty maybe)
2025-11-03T16:56:51.712941Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0test-message-group-id2' seqNo 9 partNo 0
2025-11-03T16:56:51.713908Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0test-message-group-id2' seqNo 9 partNo 0 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 188 count 1 nextOffset 18 batches 1
2025-11-03T16:56:51.713946Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:51.713962Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 1 items to delete old stuff
2025-11-03T16:56:51.714067Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 1 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest CmdDeleteRange { Range { From: "x0000000000" IncludeFrom: true To: "x0000000001" IncludeTo: false } }
2025-11-03T16:56:51.714080Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:51.714489Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 17,1 HeadOffset 17 endOffset 17 curOffset 18 d0000000000_00000000000000000017_00000_0000000001_00000? size 176 WTime 1762189011714
2025-11-03T16:56:51.714501Z node 4 :PERSQUEUE TRACE: partition_write.cpp:1459: [72075186224037892][Partition][0][StateIdle] TPartition::AddNewFastWriteBlob
2025-11-03T16:56:51.714574Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:51.714654Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188562 (NKikimr::TEvPQ::TEvTxBatchComplete), Tablet [4:7568544170866189024:2388], Partition 0, Sender [4:7568544170866189065:2388], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:56:51.714685Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188562, Sender [4:7568544170866189065:2388], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvTxBatchComplete
2025-11-03T16:56:51.714706Z node 4 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-03T16:56:51.714794Z node 4 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 1 size 176
2025-11-03T16:56:51.714998Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 270794752, Sender [4:7568544170866189047:2388], Recipient [4:7568544170866189024:2388]: NKikimrClient.TKeyValueRequest Cookie: 18 CmdDeleteRange { Range { From: "x0000000000" IncludeFrom: true To: "x0000000001" IncludeTo: false } } CmdWrite { Key: "m0000000000p\000test-message-group-id2" Value: "\010\t\020\021\030\274\306\307\320\271\326\220\003 \207\342\236\320\271\326\220\003(\000H\001" StorageChannel: INLINE } CmdWrite { Key: "d0000000000_00000000000000000017_00000_0000000001_00000?" Value: "\022\000\010\021\020\000\030\001 \000(\234\0010\234\0018\000@\000\234\000\000\000\t\000\000\000\000\000\000\000\016\372j\246J\232\001\000\000\374j\246J\232\001\000\000\007\000\000\000\027\000\000test-message-group-id2\010\t\030\374\325\231\325\2443B\020ipv6:[::1]:52486P\001\342\007$\n\020ipv6:[::1]:52486\032\007unknown\"\007unknown\372\007\033\037\213\010\000\000\000\000\000\000\003\313M-.NLO\005\000\1770\275\266\007\000\000\000" StorageChannel: INLINE } CmdWrite { Key: "i0000000000" Value: "\030\000(\372\325\231\325\2443" StorageChannel: INLINE }
2025-11-03T16:56:51.715162Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 270794753, Sender [4:7568544175161156513:2388], Recipient [4:7568544170866189024:2388]: NKikimr::TEvKeyValue::TEvIntermediate
2025-11-03T16:56:51.721201Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 17 count 1 size 176 actorID [4:7568544170866189047:2388]
2025-11-03T16:56:51.721317Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 270795264 (NKikimr::TEvKeyValue::TEvResponse), Tablet [4:7568544170866189024:2388], Partition 0, Sender [4:7568544170866189047:2388], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:56:51.721446Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 270795264, Sender [4:7568544170866189047:2388], Recipient [4:7568544170866189065:2388]: NKikimrClient.TResponse Status: 1 DeleteRangeResult { Status: 0 } WriteResult { Status: 0 StatusFlags: 1 } WriteResult { Status: 0 StatusFlags: 1 } WriteResult { Status: 0 StatusFlags: 1 }
2025-11-03T16:56:51.721469Z node 4 :PERSQUEUE TRACE: partition.h:625: StateIdle, processing event TEvKeyValue::TEvResponse
2025-11-03T16:56:51.721485Z node 4 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-03T16:56:51.721508Z node 4 :PERSQUEUE TRACE: partition_write.cpp:518: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse.
2025-11-03T16:56:51.721544Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 121 WriteNewSizeFromSupportivePartitions# 0
2025-11-03T16:56:51.721560Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=1
2025-11-03T16:56:51.721592Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:56:51.721631Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0test-message-group-id2', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 9, partNo: 0, Offset: 17 is stored on disk
2025-11-03T16:56:51.721643Z node 4 :PERSQUEUE TRACE: pq_l2_cache.h:116: StateFunc, received event# 271450112, Sender [4:7568544170866189047:2388], Recipient [4:7568544115031613334:2071]: NKikimr::NPQ::TEvPqCache::TEvCacheL2Request
2025-11-03T16:56:51.721647Z node 4 :PERSQUEUE TRACE: partition_write.cpp:424: [72075186224037892][Partition][0][StateIdle] TPartition::SyncMemoryStateWithKVState.
2025-11-03T16:56:51.721668Z node 4 :PERSQUEUE TRACE: pq_l2_cache.h:119: StateFunc, processing event TEvPqCache::TEvCacheL2Request
2025-11-03T16:56:51.721735Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 17 partno 0 count 1 parts 0 suffix '63' size 176
2025-11-03T16:56:51.721812Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:51.721828Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:51.721841Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:51.721861Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:51.721895Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:51.721908Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:51.721924Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:51.721944Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:56:51.722010Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271188493, Sender [4:7568544170866189065:2388], Recipient [4:7568544170866189024:2388]: NKikimr::TEvPQ::TEvProxyResponse
2025-11-03T16:56:51.722028Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5335: HandleHook, processing event TEvPQ::TEvProxyResponse
2025-11-03T16:56:51.722050Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 17  requestId: <none> cookie: 9
2025-11-03T16:56:51.722922Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:56:51.723783Z :DEBUG: [/Root] MessageGroupId [test-message-group-id2] SessionId [test-message-group-id2|d956c290-47a73c9e-b109a607-e01775e1_0] Write session got write response: sequence_numbers: 9 offsets: 17 already_written: false write_statistics { persist_duration_ms: 14 }
2025-11-03T16:56:51.723830Z :DEBUG: [/Root] MessageGroupId [test-message-group-id2] SessionId [test-message-group-id2|d956c290-47a73c9e-b109a607-e01775e1_0] Write session: acknoledged message 9
2025-11-03T16:56:51.724413Z :TWriteSession_SeqNoShift INFO: Enqueue message with sequence number 10
2025-11-03T16:56:51.724502Z :DEBUG: [/Root] MessageGroupId [test-message-group-id1] SessionId [test-message-group-id1|f1b47779-84f57a92-ac9e6f8a-5d32ebe8_0] Write 1 messages with Id from 10 to 10
2025-11-03T16:56:51.724580Z :TWriteSession_SeqNoShift INFO: Wait for writer event
2025-11-03T16:56:51.724621Z :TWriteSession_SeqNoShift INFO: Got new continue token
2025-11-03T16:56:51.725406Z :DEBUG: [/Root] MessageGroupId [test-message-group-id1] SessionId [test-message-group-id1|f1b47779-84f57a92-ac9e6f8a-5d32ebe8_0] Write session: try to update token
2025-11-03T16:56:51.725449Z :DEBUG: [/Root] MessageGroupId [test-message-group-id1] SessionId [test-message-group-id1|f1b47779-84f57a92-ac9e6f8a-5d32ebe8_0] Send 1 message(s) (0 left), first sequence number is 10
2025-11-03T16:56:51.728413Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: test-message-group-id1|f1b47779-84f57a92-ac9e6f8a-5d32ebe8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:56:51.728670Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:56:51.729920Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:56:51.729348Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271187968, Sender [3:7568544170873736324:2471], Recipient [4:7568544170866189114:2436]
2025-11-03T16:56:51.729381Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5316: HandleHook, processing event TEvPersQueue::TEvRequest
2025-11-03T16:56:51.729431Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:56:51.729456Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:56:51.729527Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188507 (NKikimr::TEvPQ::TEvReserveBytes), Tablet [4:7568544170866189024:2388], Partition 0, Sender [4:7568544170866189024:2388], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:56:51.729576Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188507, Sender [4:7568544170866189024:2388], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvReserveBytes
2025-11-03T16:56:51.729596Z node 4 :PERSQUEUE TRACE: partition.h:650: StateIdle, processing event TEvPQ::TEvReserveBytes
2025-11-03T16:56:51.729612Z node 4 :PERSQUEUE TRACE: partition_write.cpp:220: [72075186224037892][Partition][0][StateIdle] TPartition::HandleOnWrite TEvReserveBytes.
2025-11-03T16:56:51.729629Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:51.729686Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271188493, Sender [4:7568544170866189065:2388], Recipient [4:7568544170866189024:2388]: NKikimr::TEvPQ::TEvProxyResponse
2025-11-03T16:56:51.729706Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5335: HandleHook, processing event TEvPQ::TEvProxyResponse
2025-11-03T16:56:51.729721Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 18  requestId: <none> cookie: 10
2025-11-03T16:56:51.730303Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271187968, Sender [3:7568544170873736324:2471], Recipient [4:7568544170866189114:2436]
2025-11-03T16:56:51.730317Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5316: HandleHook, processing event TEvPersQueue::TEvRequest
2025-11-03T16:56:51.730359Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:56:51.730377Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:56:51.730425Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0test-message-group-id1' SeqNo: 10 partNo : 0 messageNo: 19 size 98 offset: -1
2025-11-03T16:56:51.730475Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188480 (NKikimr::TEvPQ::TEvWrite), Tablet [4:7568544170866189024:2388], Partition 0, Sender [4:7568544170866189024:2388], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:56:51.730509Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188480, Sender [4:7568544170866189024:2388], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvWrite
2025-11-03T16:56:51.730524Z node 4 :PERSQUEUE TRACE: partition.h:628: StateIdle, processing event TEvPQ::TEvWrite
2025-11-03T16:56:51.730537Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:56:51.730573Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:51.730597Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:51.730610Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-03T16:56:51.730668Z node 4 :PERSQUEUE TRACE: partition_write.cpp:1168: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 process write for '\0test-message-group-id1' DisableDeduplication=0 SeqNo=10 LocalSeqNo=9 InitialSeqNo=(NULL) EnableKafkaDeduplication=0 ProducerEpoch=(empty maybe)
2025-11-03T16:56:51.730730Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0test-message-group-id1' seqNo 10 partNo 0
2025-11-03T16:56:51.731931Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0test-message-group-id1' seqNo 10 partNo 0 FormedBlobsCount 0 NewHead: Offset 18 PartNo 0 PackedSize 188 count 1 nextOffset 19 batches 1
2025-11-03T16:56:51.731971Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:51.732000Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 1 items to delete old stuff
2025-11-03T16:56:51.732089Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 1 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest CmdDeleteRange { Range { From: "x0000000000" IncludeFrom: true To: "x0000000001" IncludeTo: false } }
2025-11-03T16:56:51.732103Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:51.732504Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 18,1 HeadOffset 18 endOffset 18 curOffset 19 d0000000000_00000000000000000018_00000_0000000001_00000? size 176 WTime 1762189011732
2025-11-03T16:56:51.732517Z node 4 :PERSQUEUE TRACE: partition_write.cpp:1459: [72075186224037892][Partition][0][StateIdle] TPartition::AddNewFastWriteBlob
2025-11-03T16:56:51.732584Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:51.732666Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188562 (NKikimr::TEvPQ::TEvTxBatchComplete), Tablet [4:7568544170866189024:2388], Partition 0, Sender [4:7568544170866189065:2388], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:56:51.732701Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188562, Sender [4:7568544170866189065:2388], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvTxBatchComplete
2025-11-03T16:56:51.732721Z node 4 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-03T16:56:51.732812Z node 4 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 18 partNo 0 count 1 size 176
2025-11-03T16:56:51.732989Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 270794752, Sender [4:7568544170866189047:2388], Recipient [4:7568544170866189024:2388]: NKikimrClient.TKeyValueRequest Cookie: 19 CmdDeleteRange { Range { From: "x0000000000" IncludeFrom: true To: "x0000000001" IncludeTo: false } } CmdWrite { Key: "m0000000000p\000test-message-group-id1" Value: "\010\n\020\022\030\356\372\310\320\271\326\220\003 \366\231\231\320\271\326\220\003(\000H\001" StorageChannel: INLINE } CmdWrite { Key: "d0000000000_00000000000000000018_00000_0000000001_00000?" Value: "\022\000\010\022\020\000\030\001 \000(\234\0010\234\0018\000@\000\234\000\000\000\n\000\000\000\000\000\000\000\016\021k\246J\232\001\000\000\014k\246J\232\001\000\000\007\000\000\000\027\000\000test-message-group-id1\010\n\030\214\326\231\325\2443B\020ipv6:[::1]:52486P\001\342\007$\n\020ipv6:[::1]:52486\032\007unknown\"\007unknown\372\007\033\037\213\010\000\000\000\000\000\000\003\313M-.NLO\005\000\1770\275\266\007\000\000\000" StorageChannel: INLINE } CmdWrite { Key: "i0000000000" Value: "\030\000(\221\326\231\325\2443" StorageChannel: INLINE }
2025-11-03T16:56:51.733151Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 270794753, Sender [4:7568544175161156517:2388], Recipient [4:7568544170866189024:2388]: NKikimr::TEvKeyValue::TEvIntermediate
2025-11-03T16:56:51.741279Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 18 count 1 size 176 actorID [4:7568544170866189047:2388]
2025-11-03T16:56:51.741397Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 270795264 (NKikimr::TEvKeyValue::TEvResponse), Tablet [4:7568544170866189024:2388], Partition 0, Sender [4:7568544170866189047:2388], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:56:51.741557Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 270795264, Sender [4:7568544170866189047:2388], Recipient [4:7568544170866189065:2388]: NKikimrClient.TResponse Status: 1 DeleteRangeResult { Status: 0 } WriteResult { Status: 0 StatusFlags: 1 } WriteResult { Status: 0 StatusFlags: 1 } WriteResult { Status: 0 StatusFlags: 1 }
2025-11-03T16:56:51.741580Z node 4 :PERSQUEUE TRACE: partition.h:625: StateIdle, processing event TEvKeyValue::TEvResponse
2025-11-03T16:56:51.741596Z node 4 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-03T16:56:51.741621Z node 4 :PERSQUEUE TRACE: partition_write.cpp:518: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse.
2025-11-03T16:56:51.741659Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 121 WriteNewSizeFromSupportivePartitions# 0
2025-11-03T16:56:51.741977Z node 4 :PERSQUEUE TRACE: pq_l2_cache.h:116: StateFunc, received event# 271450112, Sender [4:7568544170866189047:2388], Recipient [4:7568544115031613334:2071]: NKikimr::NPQ::TEvPqCache::TEvCacheL2Request
2025-11-03T16:56:51.742004Z node 4 :PERSQUEUE TRACE: pq_l2_cache.h:119: StateFunc, processing event TEvPqCache::TEvCacheL2Request
2025-11-03T16:56:51.742053Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 18 partno 0 count 1 parts 0 suffix '63' size 176
2025-11-03T16:56:51.742174Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=1
2025-11-03T16:56:51.742216Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:56:51.742254Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0test-message-group-id1', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 10, partNo: 0, Offset: 18 is stored on disk
2025-11-03T16:56:51.742271Z node 4 :PERSQUEUE TRACE: partition_write.cpp:424: [72075186224037892][Partition][0][StateIdle] TPartition::SyncMemoryStateWithKVState.
2025-11-03T16:56:51.742417Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:51.742430Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:51.742443Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:51.742458Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:51.742511Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:51.742525Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:51.742542Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:51.742559Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:56:51.742624Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271188493, Sender [4:7568544170866189065:2388], Recipient [4:7568544170866189024:2388]: NKikimr::TEvPQ::TEvProxyResponse
2025-11-03T16:56:51.742646Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5335: HandleHook, processing event TEvPQ::TEvProxyResponse
2025-11-03T16:56:51.742669Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 19  requestId: <none> cookie: 10
2025-11-03T16:56:51.748261Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:56:51.749708Z :DEBUG: [/Root] MessageGroupId [test-message-group-id1] SessionId [test-message-group-id1|f1b47779-84f57a92-ac9e6f8a-5d32ebe8_0] Write session got write response: sequence_numbers: 10 offsets: 18 already_written: false write_statistics { persist_duration_ms: 8 queued_in_partition_duration_ms: 1 }
2025-11-03T16:56:51.749758Z :DEBUG: [/Root] MessageGroupId [test-message-group-id1] SessionId [test-message-group-id1|f1b47779-84f57a92-ac9e6f8a-5d32ebe8_0] Write session: acknoledged message 10
2025-11-03T16:56:51.752053Z :TWriteSession_SeqNoShift INFO: Enqueue message with sequence number 10
2025-11-03T16:56:51.752155Z :DEBUG: [/Root] MessageGroupId [test-message-group-id2] SessionId [test-message-group-id2|d956c290-47a73c9e-b109a607-e01775e1_0] Write 1 messages with Id from 10 to 10
2025-11-03T16:56:51.752253Z :TWriteSession_SeqNoShift INFO: Wait for writer event
2025-11-03T16:56:51.752300Z :TWriteSession_SeqNoShift INFO: Got new continue token
2025-11-03T16:56:51.754467Z :DEBUG: [/Root] MessageGroupId [test-message-group-id2] SessionId [test-message-group-id2|d956c290-47a73c9e-b109a607-e01775e1_0] Write session: try to update token
2025-11-03T16:56:51.754520Z :DEBUG: [/Root] MessageGroupId [test-message-group-id2] SessionId [test-message-group-id2|d956c290-47a73c9e-b109a607-e01775e1_0] Send 1 message(s) (0 left), first sequence number is 10
2025-11-03T16:56:51.756131Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:51.756201Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:51.756224Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:51.756256Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:51.756270Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:51.756283Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:51.756304Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:51.756364Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:51.756376Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:51.756395Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:51.756249Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3 sessionId: test-message-group-id2|d956c290-47a73c9e-b109a607-e01775e1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:56:51.756567Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:56:51.760144Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271187968, Sender [3:7568544170873736328:2472], Recipient [4:7568544170866189115:2437]
2025-11-03T16:56:51.760180Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5316: HandleHook, processing event TEvPersQueue::TEvRequest
2025-11-03T16:56:51.760239Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:56:51.760263Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:56:51.760356Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188507 (NKikimr::TEvPQ::TEvReserveBytes), Tablet [4:7568544170866189024:2388], Partition 0, Sender [4:7568544170866189024:2388], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:56:51.760394Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188507, Sender [4:7568544170866189024:2388], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvReserveBytes
2025-11-03T16:56:51.760412Z node 4 :PERSQUEUE TRACE: partition.h:650: StateIdle, processing event TEvPQ::TEvReserveBytes
2025-11-03T16:56:51.760428Z node 4 :PERSQUEUE TRACE: partition_write.cpp:220: [72075186224037892][Partition][0][StateIdle] TPartition::HandleOnWrite TEvReserveBytes.
2025-11-03T16:56:51.760446Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:51.760505Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271188493, Sender [4:7568544170866189065:2388], Recipient [4:7568544170866189024:2388]: NKikimr::TEvPQ::TEvProxyResponse
2025-11-03T16:56:51.760523Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5335: HandleHook, processing event TEvPQ::TEvProxyResponse
2025-11-03T16:56:51.760537Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 18  requestId: <none> cookie: 10
2025-11-03T16:56:51.762584Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:56:51.763069Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271187968, Sender [3:7568544170873736328:2472], Recipient [4:7568544170866189115:2437]
2025-11-03T16:56:51.763095Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5316: HandleHook, processing event TEvPersQueue::TEvRequest
2025-11-03T16:56:51.763153Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:56:51.763177Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:56:51.763229Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0test-message-group-id2' SeqNo: 10 partNo : 0 messageNo: 19 size 98 offset: -1
2025-11-03T16:56:51.763296Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188480 (NKikimr::TEvPQ::TEvWrite), Tablet [4:7568544170866189024:2388], Partition 0, Sender [4:7568544170866189024:2388], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:56:51.763337Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188480, Sender [4:7568544170866189024:2388], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvWrite
2025-11-03T16:56:51.763354Z node 4 :PERSQUEUE TRACE: partition.h:628: StateIdle, processing event TEvPQ::TEvWrite
2025-11-03T16:56:51.763369Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:56:51.763414Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:51.763437Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:51.763447Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-03T16:56:51.763505Z node 4 :PERSQUEUE TRACE: partition_write.cpp:1168: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 process write for '\0test-message-group-id2' DisableDeduplication=0 SeqNo=10 LocalSeqNo=9 InitialSeqNo=(NULL) EnableKafkaDeduplication=0 ProducerEpoch=(empty maybe)
2025-11-03T16:56:51.763570Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0test-message-group-id2' seqNo 10 partNo 0
2025-11-03T16:56:51.839076Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0test-message-group-id2' seqNo 10 partNo 0 FormedBlobsCount 0 NewHead: Offset 19 PartNo 0 PackedSize 188 count 1 nextOffset 20 batches 1
2025-11-03T16:56:51.839143Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:51.839159Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 1 items to delete old stuff
2025-11-03T16:56:51.839266Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 1 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest CmdDeleteRange { Range { From: "x0000000000" IncludeFrom: true To: "x0000000001" IncludeTo: false } }
2025-11-03T16:56:51.839279Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:51.839703Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 19,1 HeadOffset 19 endOffset 19 curOffset 20 d0000000000_00000000000000000019_00000_0000000001_00000? size 176 WTime 1762189011839
2025-11-03T16:56:51.839716Z node 4 :PERSQUEUE TRACE: partition_write.cpp:1459: [72075186224037892][Partition][0][StateIdle] TPartition::AddNewFastWriteBlob
2025-11-03T16:56:51.839792Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:51.839943Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188562 (NKikimr::TEvPQ::TEvTxBatchComplete), Tablet [4:7568544170866189024:2388], Partition 0, Sender [4:7568544170866189065:2388], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:56:51.840299Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188562, Sender [4:7568544170866189065:2388], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvTxBatchComplete
2025-11-03T16:56:51.840359Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [4:7568544170866189024:2388], Partition 0, Sender [0:0:0], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:56:51.840392Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:51.840411Z node 4 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:51.840433Z node 4 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:56:51.840452Z node 4 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-03T16:56:51.840560Z node 4 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 19 partNo 0 count 1 size 176
2025-11-03T16:56:51.840772Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 270794752, Sender [4:7568544170866189047:2388], Recipient [4:7568544170866189024:2388]: NKikimrClient.TKeyValueRequest Cookie: 20 CmdDeleteRange { Range { From: "x0000000000" IncludeFrom: true To: "x0000000001" IncludeTo: false } } CmdWrite { Key: "m0000000000p\000test-message-group-id2" Value: "\010\n\020\023\030\353\375\312\320\271\326\220\003 \207\342\236\320\271\326\220\003(\000H\001" StorageChannel: INLINE } CmdWrite { Key: "d0000000000_00000000000000000019_00000_0000000001_00000?" Value: "\022\000\010\023\020\000\030\001 \000(\234\0010\234\0018\000@\000\234\000\000\000\n\000\000\000\000\000\000\000\0162k\246J\232\001\000\000(k\246J\232\001\000\000\007\000\000\000\027\000\000test-message-group-id2\010\n\030\250\326\231\325\2443B\020ipv6:[::1]:52486P\001\342\007$\n\020ipv6:[::1]:52486\032\007unknown\"\007unknown\372\007\033\037\213\010\000\000\000\000\000\000\003\313M-.NLO\005\000\1770\275\266\007\000\000\000" StorageChannel: INLINE } CmdWrite { Key: "i0000000000" Value: "\030\000(\262\326\231\325\2443" StorageChannel: INLINE }
2025-11-03T16:56:51.840958Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 270794753, Sender [4:7568544175161156522:2388], Recipient [4:7568544170866189024:2388]: NKikimr::TEvKeyValue::TEvIntermediate
2025-11-03T16:56:51.844507Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 19 count 1 size 176 actorID [4:7568544170866189047:2388]
2025-11-03T16:56:51.844604Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 270795264 (NKikimr::TEvKeyValue::TEvResponse), Tablet [4:7568544170866189024:2388], Partition 0, Sender [4:7568544170866189047:2388], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:56:51.844724Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 270795264, Sender [4:7568544170866189047:2388], Recipient [4:7568544170866189065:2388]: NKikimrClient.TResponse Status: 1 DeleteRangeResult { Status: 0 } WriteResult { Status: 0 StatusFlags: 1 } WriteResult { Status: 0 StatusFlags: 1 } WriteResult { Status: 0 StatusFlags: 1 }
2025-11-03T16:56:51.844747Z node 4 :PERSQUEUE TRACE: partition.h:625: StateIdle, processing event TEvKeyValue::TEvResponse
2025-11-03T16:56:51.844765Z node 4 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-03T16:56:51.844794Z node 4 :PERSQUEUE TRACE: partition_write.cpp:518: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse.
2025-11-03T16:56:51.844836Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 121 WriteNewSizeFromSupportivePartitions# 0
2025-11-03T16:56:51.844855Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=1
2025-11-03T16:56:51.844890Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:56:51.844929Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0test-message-group-id2', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 10, partNo: 0, Offset: 19 is stored on disk
2025-11-03T16:56:51.844946Z node 4 :PERSQUEUE TRACE: partition_write.cpp:424: [72075186224037892][Partition][0][StateIdle] TPartition::SyncMemoryStateWithKVState.
2025-11-03T16:56:51.845105Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:51.845119Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:51.845134Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:51.845152Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:51.845164Z node 4 :PERSQUEUE TRACE: pq_l2_cache.h:116: StateFunc, received event# 271450112, Sender [4:7568544170866189047:2388], Recipient [4:7568544115031613334:2071]: NKikimr::NPQ::TEvPqCache::TEvCacheL2Request
2025-11-03T16:56:51.845187Z node 4 :PERSQUEUE TRACE: pq_l2_cache.h:119: StateFunc, processing event TEvPqCache::TEvCacheL2Request
2025-11-03T16:56:51.845194Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:51.845208Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:51.845225Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:51.845242Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:56:51.845245Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 19 partno 0 count 1 parts 0 suffix '63' size 176
2025-11-03T16:56:51.845306Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271188493, Sender [4:7568544170866189065:2388], Recipient [4:7568544170866189024:2388]: NKikimr::TEvPQ::TEvProxyResponse
2025-11-03T16:56:51.845325Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5335: HandleHook, processing event TEvPQ::TEvProxyResponse
2025-11-03T16:56:51.845349Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 19  requestId: <none> cookie: 10
2025-11-03T16:56:51.845584Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:56:51.848183Z :DEBUG: [/Root] MessageGroupId [test-message-group-id2] SessionId [test-message-group-id2|d956c290-47a73c9e-b109a607-e01775e1_0] Write session got write response: sequence_numbers: 10 offsets: 19 already_written: false write_statistics { persist_duration_ms: 5 queued_in_partition_duration_ms: 75 }
2025-11-03T16:56:51.848233Z :DEBUG: [/Root] MessageGroupId [test-message-group-id2] SessionId [test-message-group-id2|d956c290-47a73c9e-b109a607-e01775e1_0] Write session: acknoledged message 10
===Messages were written
===Disable dc1
====ExpectBreakDown
====ExpectBreakDown
===Update clusters: UPDATE `/Root/PQ/Config/V2/Cluster` SET enabled = false where name = "dc1";
2025-11-03T16:56:51.858090Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:51.858175Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:51.858197Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:51.858230Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:51.858244Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:51.858256Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:51.858279Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:51.858342Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:51.858357Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:51.858383Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:51.940167Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [4:7568544170866189024:2388], Partition 0, Sender [0:0:0], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:56:51.940236Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:51.940257Z node 4 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:51.940286Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:51.940299Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:51.940312Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:51.940333Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:51.940393Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:51.940406Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:51.940427Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:51.940180Z node 3 :PQ_PARTITION_CHOOSER TRACE: partition_chooser_impl__abstract_chooser_actor.h:278: StateIdle, received event# 278396931, Sender [3:7568544170873736256:2471], Recipient [3:7568544170873736259:2471]: NKikimr::NPQ::TEvPartitionChooser::TEvRefreshRequest
2025-11-03T16:56:51.940226Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [3:7568544170873736259:2471] (SourceId=test-message-group-id1, PreferedPartition=(NULL)) Update the table
2025-11-03T16:56:51.940493Z node 3 :PQ_PARTITION_CHOOSER TRACE: partition_chooser_impl__abstract_chooser_actor.h:278: StateIdle, received event# 278396931, Sender [3:7568544170873736257:2472], Recipient [3:7568544170873736266:2472]: NKikimr::NPQ::TEvPartitionChooser::TEvRefreshRequest
2025-11-03T16:56:51.940508Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [3:7568544170873736266:2472] (SourceId=test-message-group-id2, PreferedPartition=(NULL)) Update the table
2025-11-03T16:56:51.959626Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:51.959687Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:51.959708Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:51.959736Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:51.959750Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:51.959761Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:51.959782Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:51.959835Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:51.959846Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:51.959864Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:52.040605Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [4:7568544170866189024:2388], Partition 0, Sender [0:0:0], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:56:52.040668Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:52.040691Z node 4 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:52.040736Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:52.040750Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:52.040769Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:52.040789Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:52.040850Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:52.040863Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:52.040885Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:52.060211Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:52.060273Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:52.060294Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:52.060326Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:52.060340Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:52.060352Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:52.060372Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:52.060445Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:52.060457Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:52.060476Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:52.110792Z node 3 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976720679. Ctx: { TraceId: 01k95actxefre7n30gpewbcg1z, Database: , SessionId: ydb://session/3?node_id=3&id=OGEzOWQ1OTktN2Y0M2FjYTgtOGMyNTgxOTgtMmQzNDg3NGQ=, PoolId: default, DatabaseId: /Root}. Database not set, use /Root
2025-11-03T16:56:52.142749Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [4:7568544170866189024:2388], Partition 0, Sender [0:0:0], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:56:52.142809Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:52.142828Z node 4 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:52.142856Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:52.142894Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:52.142905Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:52.142926Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:52.142989Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:52.143001Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:52.143020Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:52.161441Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:52.161489Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:52.161505Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:52.161528Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:52.161538Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:52.161546Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:52.161561Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:52.161606Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:52.161616Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:52.161632Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:52.242907Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [4:7568544170866189024:2388], Partition 0, Sender [0:0:0], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:56:52.242971Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:52.242996Z node 4 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:52.243030Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:52.243045Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:52.243056Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:52.243078Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:52.243137Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:52.243150Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:52.243171Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:52.261794Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:52.261861Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:52.261886Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:52.261917Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:52.261933Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:52.261958Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:52.261980Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:52.262038Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:52.262051Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:52.262071Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:52.303296Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188544 (NKikimr::NPQ::NReadQuoterEvents::TEvQuotaCountersUpdated), Tablet [4:7568544170866189024:2388], Partition 0, Sender [4:7568544170866189068:2388], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:56:52.303370Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188544, Sender [4:7568544170866189068:2388], Recipient [4:7568544170866189065:2388]: NKikimr::NPQ::NReadQuoterEvents::TEvQuotaCountersUpdated
2025-11-03T16:56:52.303394Z node 4 :PERSQUEUE TRACE: partition.h:671: StateIdle, processing event NReadQuoterEvents::TEvQuotaCountersUpdated
2025-11-03T16:56:52.305853Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188544 (NKikimr::NPQ::NReadQuoterEvents::TEvQuotaCountersUpdated), Tablet [2:7568544108397207262:2383], Partition 0, Sender [2:7568544108397207306:2383], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:52.305911Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188544, Sender [2:7568544108397207306:2383], Recipient [2:7568544108397207303:2383]: NKikimr::NPQ::NReadQuoterEvents::TEvQuotaCountersUpdated
2025-11-03T16:56:52.305932Z node 2 :PERSQUEUE TRACE: partition.h:671: StateIdle, processing event NReadQuoterEvents::TEvQuotaCountersUpdated
2025-11-03T16:56:52.343240Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [4:7568544170866189024:2388], Partition 0, Sender [0:0:0], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:56:52.343316Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:52.343343Z node 4 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:52.343379Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:52.343394Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:52.343408Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:52.343433Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:52.343495Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:52.343512Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:52.343535Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:52.362137Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:52.362202Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:52.362226Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:52.362256Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:52.362271Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:52.362284Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:52.362304Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:52.362361Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:52.362374Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:52.362395Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:52.393072Z node 3 :PQ_PARTITION_CHOOSER TRACE: partition_chooser_impl__abstract_chooser_actor.h:212: StateUpdate, received event# 271646721, Sender [3:7568544115039159497:2257], Recipient [3:7568544170873736266:2472]: NKikimrKqp.TEvQueryResponse Response { PreparedQuery: "57f30a7a-7adee75-3e71fa96-6ac4c743" QueryIssues { position { row: 2 column: 115 } message: "Symbol $CreateTime is not used" end_position { row: 2 column: 115 } issue_code: 4527 severity: 2 } QueryParameters { Name: "$Hash" Type { Kind: Data Data { Scheme: 2 } } } QueryParameters { Name: "$Topic" Type { Kind: Data Data { Scheme: 4608 } } } QueryParameters { Name: "$SourceId" Type { Kind: Data Data { Scheme: 4608 } } } QueryParameters { Name: "$Partition" Type { Kind: Data Data { Scheme: 2 } } } QueryParameters { Name: "$AccessTime" Type { Kind: Data Data { Scheme: 4 } } } TxMeta { } QueryDiagnostics: "" } YdbStatus: SUCCESS ConsumedRu: 271
2025-11-03T16:56:52.393117Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [3:7568544170873736266:2472] (SourceId=test-message-group-id2, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=1 Status=SUCCESS
2025-11-03T16:56:52.393129Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [3:7568544170873736266:2472] (SourceId=test-message-group-id2, PreferedPartition=(NULL)) Start idle
2025-11-03T16:56:52.393305Z node 3 :PQ_PARTITION_CHOOSER TRACE: partition_chooser_impl__abstract_chooser_actor.h:212: StateUpdate, received event# 271646721, Sender [3:7568544115039159497:2257], Recipient [3:7568544170873736259:2471]: NKikimrKqp.TEvQueryResponse Response { PreparedQuery: "57f30a7a-7adee75-3e71fa96-6ac4c743" QueryIssues { position { row: 2 column: 115 } message: "Symbol $CreateTime is not used" end_position { row: 2 column: 115 } issue_code: 4527 severity: 2 } QueryParameters { Name: "$Hash" Type { Kind: Data Data { Scheme: 2 } } } QueryParameters { Name: "$Topic" Type { Kind: Data Data { Scheme: 4608 } } } QueryParameters { Name: "$SourceId" Type { Kind: Data Data { Scheme: 4608 } } } QueryParameters { Name: "$Partition" Type { Kind: Data Data { Scheme: 2 } } } QueryParameters { Name: "$AccessTime" Type { Kind: Data Data { Scheme: 4 } } } TxMeta { } QueryDiagnostics: "" } YdbStatus: SUCCESS ConsumedRu: 275
2025-11-03T16:56:52.393346Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [3:7568544170873736259:2471] (SourceId=test-message-group-id1, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=1 Status=SUCCESS
2025-11-03T16:56:52.393359Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [3:7568544170873736259:2471] (SourceId=test-message-group-id1, PreferedPartition=(NULL)) Start idle
2025-11-03T16:56:52.447405Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [4:7568544170866189024:2388], Partition 0, Sender [0:0:0], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:56:52.447477Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:52.447515Z node 4 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:52.447548Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:52.447565Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:52.447578Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:52.447600Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:52.447657Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:52.447671Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:52.447692Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:52.462502Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:52.462566Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:52.462587Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:52.462617Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:52.462632Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:52.462645Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:52.462665Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:52.462739Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:52.462752Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:52.462771Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:52.548251Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [4:7568544170866189024:2388], Partition 0, Sender [0:0:0], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:56:52.548325Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:52.548367Z node 4 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:52.548399Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:52.548417Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:52.548430Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:52.548454Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:52.548515Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:52.548532Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:52.548557Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:52.565854Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:52.565920Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:52.565940Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:52.565969Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:52.565981Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:52.565993Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:52.566014Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:52.566070Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:52.566084Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:52.566102Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:52.652155Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [4:7568544170866189024:2388], Partition 0, Sender [0:0:0], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:56:52.652230Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:52.652256Z node 4 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:52.652287Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:52.652304Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:52.652320Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:52.652343Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:52.652403Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:52.652418Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:52.652438Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:52.667097Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:52.667174Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:52.667194Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:52.667222Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:52.667236Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:52.667329Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:52.667356Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:52.667426Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:52.667439Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:52.667459Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:52.752915Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [4:7568544170866189024:2388], Partition 0, Sender [0:0:0], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:56:52.752981Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:52.753004Z node 4 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:52.753033Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:52.753048Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:52.753061Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:52.753080Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:52.753131Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:52.753144Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:52.753166Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:52.767522Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:52.767594Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:52.767618Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:52.767646Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:52.767661Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:52.767671Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:52.767690Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:52.767746Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:52.767758Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:52.767777Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:52.842334Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 269877764, Sender [4:7568544170866189114:2436], Recipient [4:7568544170866189024:2388]: NKikimr::TEvTabletPipe::TEvServerDisconnected
2025-11-03T16:56:52.842365Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5331: HandleHook, processing event TEvTabletPipe::TEvServerDisconnected
2025-11-03T16:56:52.842377Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:2729: [PQ: 72075186224037892] Handle TEvTabletPipe::TEvServerDisconnected
2025-11-03T16:56:52.842396Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [3:7568544170873736325:2471] destroyed
2025-11-03T16:56:52.842421Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 269877764, Sender [4:7568544170866189115:2437], Recipient [4:7568544170866189024:2388]: NKikimr::TEvTabletPipe::TEvServerDisconnected
2025-11-03T16:56:52.842428Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5331: HandleHook, processing event TEvTabletPipe::TEvServerDisconnected
2025-11-03T16:56:52.842434Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:2729: [PQ: 72075186224037892] Handle TEvTabletPipe::TEvServerDisconnected
2025-11-03T16:56:52.842443Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [3:7568544170873736329:2472] destroyed
2025-11-03T16:56:52.842477Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188506 (NKikimr::TEvPQ::TEvPipeDisconnected), Tablet [4:7568544170866189024:2388], Partition 0, Sender [4:7568544170866189024:2388], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:56:52.842498Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188506, Sender [4:7568544170866189024:2388], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvPipeDisconnected
2025-11-03T16:56:52.842512Z node 4 :PERSQUEUE TRACE: partition.h:651: StateIdle, processing event TEvPQ::TEvPipeDisconnected
2025-11-03T16:56:52.842527Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-11-03T16:56:52.842544Z node 4 :PERSQUEUE TRACE: partition_write.cpp:873: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessChangeOwnerRequests.
2025-11-03T16:56:52.842557Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:52.842567Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:52.842576Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:52.842592Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:52.842646Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:52.842659Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:52.842678Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:52.842716Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188506 (NKikimr::TEvPQ::TEvPipeDisconnected), Tablet [4:7568544170866189024:2388], Partition 0, Sender [4:7568544170866189024:2388], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:56:52.842742Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188506, Sender [4:7568544170866189024:2388], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvPipeDisconnected
2025-11-03T16:56:52.842753Z node 4 :PERSQUEUE TRACE: partition.h:651: StateIdle, processing event TEvPQ::TEvPipeDisconnected
2025-11-03T16:56:52.842764Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-11-03T16:56:52.842777Z node 4 :PERSQUEUE TRACE: partition_write.cpp:873: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessChangeOwnerRequests.
2025-11-03T16:56:52.842787Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:52.842795Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:52.842800Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:52.842807Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:52.842821Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:52.842826Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:52.842835Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:52.841222Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2 reason: cluster disabled sessionId: test-message-group-id1|f1b47779-84f57a92-ac9e6f8a-5d32ebe8_0
2025-11-03T16:56:52.841497Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2 sessionId: test-message-group-id1|f1b47779-84f57a92-ac9e6f8a-5d32ebe8_0 is DEAD
2025-11-03T16:56:52.841499Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3 reason: cluster disabled sessionId: test-message-group-id2|d956c290-47a73c9e-b109a607-e01775e1_0
2025-11-03T16:56:52.841787Z node 3 :PQ_PARTITION_CHOOSER TRACE: partition_chooser_impl__abstract_chooser_actor.h:278: StateIdle, received event# 65543, Sender [3:7568544170873736256:2471], Recipient [3:7568544170873736259:2471]: NActors::TEvents::TEvPoison
2025-11-03T16:56:52.841813Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3 sessionId: test-message-group-id2|d956c290-47a73c9e-b109a607-e01775e1_0 is DEAD
2025-11-03T16:56:52.841823Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-11-03T16:56:52.842061Z node 3 :PQ_PARTITION_CHOOSER TRACE: partition_chooser_impl__abstract_chooser_actor.h:278: StateIdle, received event# 65543, Sender [3:7568544170873736257:2472], Recipient [3:7568544170873736266:2472]: NActors::TEvents::TEvPoison
2025-11-03T16:56:52.842100Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
====CreateRetryState
Test retry state: get retry delay
2025-11-03T16:56:52.844589Z :INFO: [/Root] MessageGroupId [test-message-group-id1] SessionId [test-message-group-id1|f1b47779-84f57a92-ac9e6f8a-5d32ebe8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: cluster disabled, code: 500020 
2025-11-03T16:56:52.844645Z :INFO: [/Root] MessageGroupId [test-message-group-id1] SessionId [test-message-group-id1|f1b47779-84f57a92-ac9e6f8a-5d32ebe8_0] Write session will restart in 2.000000s
2025-11-03T16:56:52.844741Z :INFO: [/Root] MessageGroupId [test-message-group-id1] SessionId [test-message-group-id1|f1b47779-84f57a92-ac9e6f8a-5d32ebe8_0] Write session: Do CDS request
2025-11-03T16:56:52.844788Z :INFO: [/Root] MessageGroupId [test-message-group-id1] SessionId [test-message-group-id1|f1b47779-84f57a92-ac9e6f8a-5d32ebe8_0] Do schedule cds request after 2000 ms
====CreateRetryState
Test retry state: get retry delay
2025-11-03T16:56:52.844942Z :INFO: [/Root] MessageGroupId [test-message-group-id2] SessionId [test-message-group-id2|d956c290-47a73c9e-b109a607-e01775e1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: cluster disabled, code: 500020 
2025-11-03T16:56:52.844967Z :INFO: [/Root] MessageGroupId [test-message-group-id2] SessionId [test-message-group-id2|d956c290-47a73c9e-b109a607-e01775e1_0] Write session will restart in 2.000000s
2025-11-03T16:56:52.845010Z :INFO: [/Root] MessageGroupId [test-message-group-id2] SessionId [test-message-group-id2|d956c290-47a73c9e-b109a607-e01775e1_0] Write session: Do CDS request
2025-11-03T16:56:52.845035Z :INFO: [/Root] MessageGroupId [test-message-group-id2] SessionId [test-message-group-id2|d956c290-47a73c9e-b109a607-e01775e1_0] Do schedule cds request after 2000 ms
2025-11-03T16:56:52.853405Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [4:7568544170866189024:2388], Partition 0, Sender [0:0:0], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:56:52.853464Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:52.853488Z node 4 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:52.853513Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:52.853529Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:52.853540Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:52.853561Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:52.853603Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:52.853615Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:52.853631Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:52.868017Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:52.868083Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:52.868106Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:52.868136Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:52.868151Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:52.868172Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:52.868194Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:52.868262Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:52.868275Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:52.868297Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:52.954530Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [4:7568544170866189024:2388], Partition 0, Sender [0:0:0], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:56:52.954589Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:52.954609Z node 4 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:52.954637Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:52.954651Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:52.954662Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:52.954680Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:52.954737Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:52.954748Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:52.954768Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:52.959375Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard_impl.cpp:7727: Cannot get console configs
2025-11-03T16:56:52.959402Z node 3 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
2025-11-03T16:56:52.974015Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:52.974085Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:52.974108Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:52.974139Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:52.974153Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:52.974164Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:52.974188Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:52.974245Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:52.974259Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:52.974286Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:53.055813Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [4:7568544170866189024:2388], Partition 0, Sender [0:0:0], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:56:53.055878Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:53.055898Z node 4 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:53.055928Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:53.055941Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:53.055952Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:53.055970Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:53.056045Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:53.056056Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:53.056074Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:53.076167Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:53.076242Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:53.076266Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:53.076295Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:53.076311Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:53.076323Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:53.076344Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:53.076399Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:53.076413Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:53.076432Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:53.157665Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [4:7568544170866189024:2388], Partition 0, Sender [0:0:0], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:56:53.157735Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:53.157756Z node 4 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:53.157787Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:53.157800Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:53.157811Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:53.157831Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:53.157891Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:53.157902Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:53.157922Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:53.180122Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:53.180195Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:53.180216Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:53.180246Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:53.180261Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:53.180272Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:53.180294Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:53.180356Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:53.180368Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:53.180388Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:53.260068Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [4:7568544170866189024:2388], Partition 0, Sender [0:0:0], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:56:53.260139Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:53.260160Z node 4 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:53.260196Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:53.260209Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:53.260221Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:53.260245Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:53.260305Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:53.260317Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:53.260339Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:53.284998Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:53.285067Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:53.285092Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:53.285121Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:53.285136Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:53.285150Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:53.285171Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:53.285225Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:53.285239Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:53.285258Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:53.305105Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188544 (NKikimr::NPQ::NReadQuoterEvents::TEvQuotaCountersUpdated), Tablet [4:7568544170866189024:2388], Partition 0, Sender [4:7568544170866189068:2388], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:56:53.305171Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188544, Sender [4:7568544170866189068:2388], Recipient [4:7568544170866189065:2388]: NKikimr::NPQ::NReadQuoterEvents::TEvQuotaCountersUpdated
2025-11-03T16:56:53.305201Z node 4 :PERSQUEUE TRACE: partition.h:671: StateIdle, processing event NReadQuoterEvents::TEvQuotaCountersUpdated
2025-11-03T16:56:53.312356Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188544 (NKikimr::NPQ::NReadQuoterEvents::TEvQuotaCountersUpdated), Tablet [2:7568544108397207262:2383], Partition 0, Sender [2:7568544108397207306:2383], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:53.312431Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188544, Sender [2:7568544108397207306:2383], Recipient [2:7568544108397207303:2383]: NKikimr::NPQ::NReadQuoterEvents::TEvQuotaCountersUpdated
2025-11-03T16:56:53.312455Z node 2 :PERSQUEUE TRACE: partition.h:671: StateIdle, processing event NReadQuoterEvents::TEvQuotaCountersUpdated
2025-11-03T16:56:53.362111Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [4:7568544170866189024:2388], Partition 0, Sender [0:0:0], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:56:53.362183Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:53.362210Z node 4 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:53.362241Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:53.362258Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:53.362270Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:53.362291Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:53.362353Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:53.362377Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:53.362397Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:53.384961Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:53.385033Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:53.385060Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:53.385090Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:53.385116Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:53.385131Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:53.385152Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:53.385209Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:53.385225Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:53.385248Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:53.467660Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [4:7568544170866189024:2388], Partition 0, Sender [0:0:0], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:56:53.467733Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:53.467759Z node 4 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:53.467790Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:53.467805Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:53.467819Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:53.467840Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:53.467897Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:53.467910Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:53.467930Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:53.487082Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:53.487152Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:53.487176Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:53.487205Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:53.487222Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:53.487235Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:53.487258Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:53.487316Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:53.487329Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:53.487349Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:53.567933Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [4:7568544170866189024:2388], Partition 0, Sender [0:0:0], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:56:53.568469Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:53.568502Z node 4 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:53.568531Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:53.568547Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:53.568559Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:53.568581Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:53.568646Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:53.568659Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:53.568680Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:53.587256Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:53.587319Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:53.587345Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:53.587377Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:53.587393Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:53.587406Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:53.587426Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:53.587483Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:53.587497Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:53.587515Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:53.669511Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [4:7568544170866189024:2388], Partition 0, Sender [0:0:0], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:56:53.669582Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:53.669606Z node 4 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:53.669637Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:53.669651Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:53.669664Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:53.669689Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:53.669743Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:53.669757Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:53.669778Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:53.692125Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:53.692196Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:53.692219Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:53.692250Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:53.692265Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:53.692276Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:53.692296Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:53.692352Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:53.692368Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:53.692389Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:53.772193Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [4:7568544170866189024:2388], Partition 0, Sender [0:0:0], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:56:53.772254Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:53.772275Z node 4 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:53.772307Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:53.772320Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:53.772333Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:53.772355Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:53.772411Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:53.772424Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:53.772444Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:53.792457Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:53.792519Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:53.792542Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:53.792573Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:53.792587Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:53.792600Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:53.792621Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:53.792681Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:53.792696Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:53.792717Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:53.876116Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [4:7568544170866189024:2388], Partition 0, Sender [0:0:0], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:56:53.876183Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:53.876204Z node 4 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:53.876236Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:53.876250Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:53.876261Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:53.876282Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:53.876342Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:53.876354Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:53.876373Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:53.893044Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:53.893115Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:53.893136Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:53.893178Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:53.893198Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:53.893212Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:53.893234Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:53.893293Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:53.893307Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:53.893337Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:53.977672Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [4:7568544170866189024:2388], Partition 0, Sender [0:0:0], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:56:53.977733Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:53.977756Z node 4 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:53.977784Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:53.977800Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:53.977812Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:53.977834Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:53.977893Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:53.977906Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:53.977930Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:53.996963Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:53.997071Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:53.997098Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:53.997127Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:53.997142Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:53.997154Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:53.997176Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:53.997239Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:53.997262Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:53.997285Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:54.079753Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [4:7568544170866189024:2388], Partition 0, Sender [0:0:0], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:56:54.079826Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:54.079847Z node 4 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:54.079876Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:54.079889Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:54.079900Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:54.079920Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:54.080005Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:54.080017Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:54.080038Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:54.097719Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:54.097789Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:54.097816Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:54.097847Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:54.097862Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:54.097875Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:54.097898Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:54.097957Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:54.097970Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:54.098017Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:54.181273Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [4:7568544170866189024:2388], Partition 0, Sender [0:0:0], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:56:54.181346Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:54.181368Z node 4 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:54.181397Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:54.181420Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:54.181432Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:54.181451Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:54.181519Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:54.181533Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:54.181571Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:54.198980Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:54.199055Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:54.199079Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:54.199109Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:54.199124Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:54.199135Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:54.199157Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:54.199237Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:54.199251Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:54.199270Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:54.281674Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [4:7568544170866189024:2388], Partition 0, Sender [0:0:0], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:56:54.281740Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:54.281767Z node 4 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:54.281796Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:54.281813Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:54.281826Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:54.281847Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:54.281911Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:54.281925Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:54.281954Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:54.300279Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:54.300349Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:54.300370Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:54.304729Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188544 (NKikimr::NPQ::NReadQuoterEvents::TEvQuotaCountersUpdated), Tablet [4:7568544170866189024:2388], Partition 0, Sender [4:7568544170866189068:2388], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:56:54.304797Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188544, Sender [4:7568544170866189068:2388], Recipient [4:7568544170866189065:2388]: NKikimr::NPQ::NReadQuoterEvents::TEvQuotaCountersUpdated
2025-11-03T16:56:54.304818Z node 4 :PERSQUEUE TRACE: partition.h:671: StateIdle, processing event NReadQuoterEvents::TEvQuotaCountersUpdated
2025-11-03T16:56:54.300402Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:54.300417Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:54.300430Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:54.300453Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:54.300512Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:54.300528Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:54.300550Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:54.316163Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188544 (NKikimr::NPQ::NReadQuoterEvents::TEvQuotaCountersUpdated), Tablet [2:7568544108397207262:2383], Partition 0, Sender [2:7568544108397207306:2383], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:54.316231Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188544, Sender [2:7568544108397207306:2383], Recipient [2:7568544108397207303:2383]: NKikimr::NPQ::NReadQuoterEvents::TEvQuotaCountersUpdated
2025-11-03T16:56:54.316252Z node 2 :PERSQUEUE TRACE: partition.h:671: StateIdle, processing event NReadQuoterEvents::TEvQuotaCountersUpdated
2025-11-03T16:56:54.384152Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [4:7568544170866189024:2388], Partition 0, Sender [0:0:0], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:56:54.384217Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:54.384243Z node 4 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:54.384274Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:54.384290Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:54.384313Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:54.384335Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:54.384388Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:54.384401Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:54.384420Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:54.400123Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:54.400191Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:54.400213Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:54.400242Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:54.400256Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:54.400267Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:54.400287Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:54.400343Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:54.400356Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:54.400375Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:54.487849Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [4:7568544170866189024:2388], Partition 0, Sender [0:0:0], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:56:54.487919Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:54.487946Z node 4 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:54.487993Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:54.488010Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:54.488024Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:54.488046Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:54.488106Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:54.488118Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:54.488140Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:54.501258Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:54.501323Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:54.501344Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:54.501369Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:54.501388Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:54.501396Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:54.501410Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:54.501459Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:54.501466Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:54.501479Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:54.587692Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [4:7568544170866189024:2388], Partition 0, Sender [0:0:0], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:56:54.587763Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:54.587790Z node 4 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:54.587822Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:54.587839Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:54.587852Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:54.587873Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:54.587934Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:54.587947Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:54.587968Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:54.601671Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:54.601735Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:54.601759Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:54.601790Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:54.601804Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:54.601816Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:54.601837Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:54.601901Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:54.601915Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:54.601937Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:54.688210Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [4:7568544170866189024:2388], Partition 0, Sender [0:0:0], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:56:54.688283Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:54.688304Z node 4 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:54.688348Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:54.688361Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:54.688372Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:54.688391Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:54.688457Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:54.688469Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:54.688488Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:54.704161Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:54.704228Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:54.704249Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:54.704280Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:54.704294Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:54.704304Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:54.704326Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:54.704384Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:54.704397Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:54.704417Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:54.788805Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [4:7568544170866189024:2388], Partition 0, Sender [0:0:0], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:56:54.788868Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:54.788893Z node 4 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:54.788924Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:54.788937Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:54.788948Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:54.788969Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:54.789038Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:54.789054Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:54.789074Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:54.812518Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:54.812589Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:54.812611Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:54.812644Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:54.812660Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:54.812671Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:54.812693Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:54.812748Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:54.812763Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:54.812783Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:54.845209Z :INFO: [/Root] MessageGroupId [test-message-group-id1] Running cds request ms
2025-11-03T16:56:54.847332Z :INFO: [/Root] MessageGroupId [test-message-group-id2] Running cds request ms
2025-11-03T16:56:54.849738Z :INFO: [/Root] MessageGroupId [test-message-group-id1] SessionId [test-message-group-id1|f1b47779-84f57a92-ac9e6f8a-5d32ebe8_0] Got CDS response: 
write_sessions_clusters { clusters { endpoint: "localhost:13111" name: "dc1" } clusters { endpoint: "localhost:14811" name: "dc2" available: true } primary_cluster_selection_reason: CLIENT_PREFERENCE } version: 1
2025-11-03T16:56:54.849802Z :INFO: [/Root] MessageGroupId [test-message-group-id1] SessionId [test-message-group-id1|f1b47779-84f57a92-ac9e6f8a-5d32ebe8_0] Start write session. Will connect to endpoint: localhost:14811
2025-11-03T16:56:54.851347Z :INFO: [/Root] MessageGroupId [test-message-group-id2] SessionId [test-message-group-id2|d956c290-47a73c9e-b109a607-e01775e1_0] Got CDS response: 
write_sessions_clusters { clusters { endpoint: "localhost:13111" name: "dc1" } clusters { endpoint: "localhost:14811" name: "dc2" available: true } primary_cluster_selection_reason: CLIENT_PREFERENCE } version: 1
2025-11-03T16:56:54.851385Z :INFO: [/Root] MessageGroupId [test-message-group-id2] SessionId [test-message-group-id2|d956c290-47a73c9e-b109a607-e01775e1_0] Start write session. Will connect to endpoint: localhost:14811
2025-11-03T16:56:54.871230Z :DEBUG: [/Root] MessageGroupId [test-message-group-id1] SessionId [test-message-group-id1|f1b47779-84f57a92-ac9e6f8a-5d32ebe8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "test-message-group-id1" preferred_cluster: "dc1" }
2025-11-03T16:56:54.873118Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-11-03T16:56:54.873156Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2
2025-11-03T16:56:54.875197Z :DEBUG: [/Root] MessageGroupId [test-message-group-id2] SessionId [test-message-group-id2|d956c290-47a73c9e-b109a607-e01775e1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "test-message-group-id2" preferred_cluster: "dc1" }
2025-11-03T16:56:54.881116Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "test-message-group-id1" preferred_cluster: "dc1" }
2025-11-03T16:56:54.881249Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2 topic: "test-topic" message_group_id: "test-message-group-id1" preferred_cluster: "dc1" from ipv6:[::1]:55004
2025-11-03T16:56:54.881265Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:55004 proto=v1  topic=test-topic durationSec=0
2025-11-03T16:56:54.881275Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-11-03T16:56:54.881421Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-11-03T16:56:54.881434Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3
2025-11-03T16:56:54.885181Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "test-message-group-id2" preferred_cluster: "dc1" }
2025-11-03T16:56:54.885342Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3 topic: "test-topic" message_group_id: "test-message-group-id2" preferred_cluster: "dc1" from ipv6:[::1]:55004
2025-11-03T16:56:54.885359Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:55004 proto=v1  topic=test-topic durationSec=0
2025-11-03T16:56:54.885371Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-11-03T16:56:54.886481Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2 sessionId:  describe result for acl check
2025-11-03T16:56:54.886640Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-11-03T16:56:54.886650Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-11-03T16:56:54.886665Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-11-03T16:56:54.886683Z node 1 :PQ_PARTITION_CHOOSER TRACE: partition_chooser_impl__abstract_chooser_actor.h:88: TPartitionChooser [1:7568544186561756816:2618] (SourceId=test-message-group-id1, PreferedPartition=(NULL)) InitTable: SourceId=test-message-group-id1 TopicsAreFirstClassCitizen=0 UseSrcIdMetaMappingInFirstClass=1
2025-11-03T16:56:54.886696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7568544186561756816:2618] (SourceId=test-message-group-id1, PreferedPartition=(NULL)) StartKqpSession
2025-11-03T16:56:54.888828Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [4:7568544170866189024:2388], Partition 0, Sender [0:0:0], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:56:54.888887Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:54.888912Z node 4 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:54.888942Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:54.888957Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:54.888969Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:54.888989Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:54.889055Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:54.889069Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:54.889089Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:54.890840Z node 1 :PQ_PARTITION_CHOOSER TRACE: partition_chooser_impl__abstract_chooser_actor.h:132: StateCreateKqpSession, received event# 271646728, Sender [1:7568544053417768053:2268], Recipient [1:7568544186561756816:2618]: NKikimrKqp.TEvCreateSessionResponse Error: "" Response { SessionId: "ydb://session/3?node_id=1&id=ZGVhMzlkMTAtNTI4ZWUzN2QtOTIyNGRlMmEtOTA5MjlhMw==" NodeId: 1 } YdbStatus: SUCCESS ResourceExhausted: false
2025-11-03T16:56:54.890892Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7568544186561756816:2618] (SourceId=test-message-group-id1, PreferedPartition=(NULL)) Select from the table
2025-11-03T16:56:54.890894Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3 sessionId:  describe result for acl check
2025-11-03T16:56:54.890992Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-11-03T16:56:54.891032Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-11-03T16:56:54.891045Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-11-03T16:56:54.891064Z node 1 :PQ_PARTITION_CHOOSER TRACE: partition_chooser_impl__abstract_chooser_actor.h:88: TPartitionChooser [1:7568544186561756821:2619] (SourceId=test-message-group-id2, PreferedPartition=(NULL)) InitTable: SourceId=test-message-group-id2 TopicsAreFirstClassCitizen=0 UseSrcIdMetaMappingInFirstClass=1
2025-11-03T16:56:54.891077Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7568544186561756821:2619] (SourceId=test-message-group-id2, PreferedPartition=(NULL)) StartKqpSession
2025-11-03T16:56:54.894080Z node 1 :PQ_PARTITION_CHOOSER TRACE: partition_chooser_impl__abstract_chooser_actor.h:132: StateCreateKqpSession, received event# 271646728, Sender [1:7568544053417768053:2268], Recipient [1:7568544186561756821:2619]: NKikimrKqp.TEvCreateSessionResponse Error: "" Response { SessionId: "ydb://session/3?node_id=1&id=NTZlYTM4ZDItZWYwMjQ3YjYtZTEwOWE5MzQtNmExZmIwMTM=" NodeId: 1 } YdbStatus: SUCCESS ResourceExhausted: false
2025-11-03T16:56:54.894113Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7568544186561756821:2619] (SourceId=test-message-group-id2, PreferedPartition=(NULL)) Select from the table
2025-11-03T16:56:54.910713Z node 1 :PQ_PARTITION_CHOOSER TRACE: partition_chooser_impl__abstract_chooser_actor.h:163: StateSelect, received event# 271646721, Sender [1:7568544053417768053:2268], Recipient [1:7568544186561756816:2618]: NKikimrKqp.TEvQueryResponse Response { SessionId: "ydb://session/3?node_id=1&id=ZGVhMzlkMTAtNTI4ZWUzN2QtOTIyNGRlMmEtOTA5MjlhMw==" PreparedQuery: "bf547082-be61c135-9226a4-6fe85003" QueryParameters { Name: "$Hash" Type { Kind: Data Data { Scheme: 2 } } } QueryParameters { Name: "$Topic" Type { Kind: Data Data { Scheme: 4608 } } } QueryParameters { Name: "$SourceId" Type { Kind: Data Data { Scheme: 4608 } } } TxMeta { id: "01k95acxve4zp3tkyx478m03v3" } YdbResults { columns { name: "Partition" type { optional_type { item { type_id: UINT32 } } } } columns { name: "CreateTime" type { optional_type { item { type_id: UINT64 } } } } columns { name: "AccessTime" type { optional_type { item { type_id: UINT64 } } } } columns { name: "SeqNo" type { optional_type { item { type_id: UINT64 } } } } format: FORMAT_VALUE } QueryDiagnostics: "" } YdbStatus: SUCCESS ConsumedRu: 1
2025-11-03T16:56:54.910835Z node 1 :PQ_PARTITION_CHOOSER TRACE: partition_chooser_impl__abstract_chooser_actor.h:151: TPartitionChooser [1:7568544186561756816:2618] (SourceId=test-message-group-id1, PreferedPartition=(NULL)) Selected from table PartitionId=(NULL) SeqNo=(NULL)
2025-11-03T16:56:54.910849Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [1:7568544186561756816:2618] (SourceId=test-message-group-id1, PreferedPartition=(NULL)) RequestPQRB
2025-11-03T16:56:54.912887Z node 1 :PQ_PARTITION_CHOOSER TRACE: partition_chooser_impl__abstract_chooser_actor.h:163: StateSelect, received event# 271646721, Sender [1:7568544053417768053:2268], Recipient [1:7568544186561756821:2619]: NKikimrKqp.TEvQueryResponse Response { SessionId: "ydb://session/3?node_id=1&id=NTZlYTM4ZDItZWYwMjQ3YjYtZTEwOWE5MzQtNmExZmIwMTM=" PreparedQuery: "bf547082-be61c135-9226a4-6fe85003" QueryParameters { Name: "$Hash" Type { Kind: Data Data { Scheme: 2 } } } QueryParameters { Name: "$Topic" Type { Kind: Data Data { Scheme: 4608 } } } QueryParameters { Name: "$SourceId" Type { Kind: Data Data { Scheme: 4608 } } } TxMeta { id: "01k95acxveb36b7f5vh43s4vhp" } YdbResults { columns { name: "Partition" type { optional_type { item { type_id: UINT32 } } } } columns { name: "CreateTime" type { optional_type { item { type_id: UINT64 } } } } columns { name: "AccessTime" type { optional_type { item { type_id: UINT64 } } } } columns { name: "SeqNo" type { optional_type { item { type_id: UINT64 } } } } format: FORMAT_VALUE } QueryDiagnostics: "" } YdbStatus: SUCCESS ConsumedRu: 1
2025-11-03T16:56:54.912996Z node 1 :PQ_PARTITION_CHOOSER TRACE: partition_chooser_impl__abstract_chooser_actor.h:151: TPartitionChooser [1:7568544186561756821:2619] (SourceId=test-message-group-id2, PreferedPartition=(NULL)) Selected from table PartitionId=(NULL) SeqNo=(NULL)
2025-11-03T16:56:54.913625Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:54.913008Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [1:7568544186561756821:2619] (SourceId=test-message-group-id2, PreferedPartition=(NULL)) RequestPQRB
2025-11-03T16:56:54.913689Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:54.913712Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:54.913742Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:54.913554Z node 1 :PQ_PARTITION_CHOOSER TRACE: partition_chooser_impl__old_chooser_actor.h:101: StatePQRB, received event# 269877760, Sender [1:7568544186561756860:2618], Recipient [1:7568544186561756816:2618]: NKikimr::TEvTabletPipe::TEvClientConnected { TabletId: 72075186224037893 Status: OK ServerId: [1:7568544186561756862:3728] Leader: 1 Dead: 0 Generation: 1 VersionInfo:  }
2025-11-03T16:56:54.913760Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:54.913773Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:54.913594Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1655: [72075186224037893][rt3.dc2--test-topic] pipe [1:7568544186561756860:2618] connected; active server actors: 1
2025-11-03T16:56:54.913808Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:54.913863Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:54.913763Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1655: [72075186224037893][rt3.dc2--test-topic] pipe [1:7568544186561756861:2619] connected; active server actors: 1
2025-11-03T16:56:54.913878Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:54.913899Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:54.913831Z node 1 :PQ_PARTITION_CHOOSER TRACE: partition_chooser_impl__old_chooser_actor.h:101: StatePQRB, received event# 269877760, Sender [1:7568544186561756861:2619], Recipient [1:7568544186561756821:2619]: NKikimr::TEvTabletPipe::TEvClientConnected { TabletId: 72075186224037893 Status: OK ServerId: [1:7568544186561756863:3729] Leader: 1 Dead: 0 Generation: 1 VersionInfo:  }
2025-11-03T16:56:54.913882Z node 1 :PQ_PARTITION_CHOOSER TRACE: partition_chooser_impl__old_chooser_actor.h:101: StatePQRB, received event# 271187996, Sender [1:7568544109252344581:2441], Recipient [1:7568544186561756816:2618]: NKikimrPQ.TGetPartitionIdForWriteResponse PartitionId: 0
2025-11-03T16:56:54.913899Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [1:7568544186561756816:2618] (SourceId=test-message-group-id1, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=test-message-group-id1
2025-11-03T16:56:54.913914Z node 1 :PQ_PARTITION_CHOOSER TRACE: partition_chooser_impl__old_chooser_actor.h:113: TPartitionChooser [1:7568544186561756816:2618] (SourceId=test-message-group-id1, PreferedPartition=(NULL)) OnPartitionChosen
2025-11-03T16:56:54.913928Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7568544186561756816:2618] (SourceId=test-message-group-id1, PreferedPartition=(NULL)) Update the table
2025-11-03T16:56:54.914134Z node 1 :PQ_PARTITION_CHOOSER TRACE: partition_chooser_impl__abstract_chooser_actor.h:212: StateUpdate, received event# 269877763, Sender [1:7568544186561756860:2618], Recipient [1:7568544186561756816:2618]: NKikimr::TEvTabletPipe::TEvClientDestroyed { TabletId: 72075186224037893 ClientId: [1:7568544186561756860:2618] ServerId: [1:7568544186561756862:3728] }
2025-11-03T16:56:54.914817Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1659: [72075186224037893][rt3.dc2--test-topic] pipe [1:7568544186561756860:2618] disconnected.
2025-11-03T16:56:54.914836Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1670: [72075186224037893][rt3.dc2--test-topic] pipe [1:7568544186561756860:2618] disconnected; active server actors: 1
2025-11-03T16:56:54.914854Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1695: [72075186224037893][rt3.dc2--test-topic] pipe [1:7568544186561756860:2618] disconnected no session
2025-11-03T16:56:54.915492Z node 1 :PQ_PARTITION_CHOOSER TRACE: partition_chooser_impl__old_chooser_actor.h:101: StatePQRB, received event# 271187996, Sender [1:7568544109252344581:2441], Recipient [1:7568544186561756821:2619]: NKikimrPQ.TGetPartitionIdForWriteResponse PartitionId: 0
2025-11-03T16:56:54.915515Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [1:7568544186561756821:2619] (SourceId=test-message-group-id2, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=test-message-group-id2
2025-11-03T16:56:54.915527Z node 1 :PQ_PARTITION_CHOOSER TRACE: partition_chooser_impl__old_chooser_actor.h:113: TPartitionChooser [1:7568544186561756821:2619] (SourceId=test-message-group-id2, PreferedPartition=(NULL)) OnPartitionChosen
2025-11-03T16:56:54.915540Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7568544186561756821:2619] (SourceId=test-message-group-id2, PreferedPartition=(NULL)) Update the table
2025-11-03T16:56:54.915741Z node 1 :PQ_PARTITION_CHOOSER TRACE: partition_chooser_impl__abstract_chooser_actor.h:212: StateUpdate, received event# 269877763, Sender [1:7568544186561756861:2619], Recipient [1:7568544186561756821:2619]: NKikimr::TEvTabletPipe::TEvClientDestroyed { TabletId: 72075186224037893 ClientId: [1:7568544186561756861:2619] ServerId: [1:7568544186561756863:3729] }
2025-11-03T16:56:54.916403Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1659: [72075186224037893][rt3.dc2--test-topic] pipe [1:7568544186561756861:2619] disconnected.
2025-11-03T16:56:54.916433Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1670: [72075186224037893][rt3.dc2--test-topic] pipe [1:7568544186561756861:2619] disconnected; active server actors: 1
2025-11-03T16:56:54.916451Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1695: [72075186224037893][rt3.dc2--test-topic] pipe [1:7568544186561756861:2619] disconnected no session
2025-11-03T16:56:54.929670Z node 1 :PQ_PARTITION_CHOOSER TRACE: partition_chooser_impl__abstract_chooser_actor.h:212: StateUpdate, received event# 271646721, Sender [1:7568544053417768053:2268], Recipient [1:7568544186561756821:2619]: NKikimrKqp.TEvQueryResponse Response { SessionId: "ydb://session/3?node_id=1&id=NTZlYTM4ZDItZWYwMjQ3YjYtZTEwOWE5MzQtNmExZmIwMTM=" PreparedQuery: "34f6fc20-f975aeb1-f34c103e-7f2bd9da" QueryParameters { Name: "$AccessTime" Type { Kind: Data Data { Scheme: 4 } } } QueryParameters { Name: "$CreateTime" Type { Kind: Data Data { Scheme: 4 } } } QueryParameters { Name: "$Hash" Type { Kind: Data Data { Scheme: 2 } } } QueryParameters { Name: "$Partition" Type { Kind: Data Data { Scheme: 2 } } } QueryParameters { Name: "$SeqNo" Type { Kind: Data Data { Scheme: 4 } } } QueryParameters { Name: "$SourceId" Type { Kind: Data Data { Scheme: 4608 } } } QueryParameters { Name: "$Topic" Type { Kind: Data Data { Scheme: 4608 } } } TxMeta { } QueryDiagnostics: "" } YdbStatus: SUCCESS ConsumedRu: 1
2025-11-03T16:56:54.929713Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7568544186561756821:2619] (SourceId=test-message-group-id2, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-11-03T16:56:54.929737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7568544186561756821:2619] (SourceId=test-message-group-id2, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-11-03T16:56:54.929752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7568544186561756821:2619] (SourceId=test-message-group-id2, PreferedPartition=(NULL)) Start idle
2025-11-03T16:56:54.929782Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-11-03T16:56:54.930062Z node 1 :PQ_PARTITION_CHOOSER TRACE: partition_chooser_impl__abstract_chooser_actor.h:212: StateUpdate, received event# 271646721, Sender [1:7568544053417768053:2268], Recipient [1:7568544186561756816:2618]: NKikimrKqp.TEvQueryResponse Response { SessionId: "ydb://session/3?node_id=1&id=ZGVhMzlkMTAtNTI4ZWUzN2QtOTIyNGRlMmEtOTA5MjlhMw==" PreparedQuery: "34f6fc20-f975aeb1-f34c103e-7f2bd9da" QueryParameters { Name: "$AccessTime" Type { Kind: Data Data { Scheme: 4 } } } QueryParameters { Name: "$CreateTime" Type { Kind: Data Data { Scheme: 4 } } } QueryParameters { Name: "$Hash" Type { Kind: Data Data { Scheme: 2 } } } QueryParameters { Name: "$Partition" Type { Kind: Data Data { Scheme: 2 } } } QueryParameters { Name: "$SeqNo" Type { Kind: Data Data { Scheme: 4 } } } QueryParameters { Name: "$SourceId" Type { Kind: Data Data { Scheme: 4608 } } } QueryParameters { Name: "$Topic" Type { Kind: Data Data { Scheme: 4608 } } } TxMeta { } QueryDiagnostics: "" } YdbStatus: SUCCESS ConsumedRu: 1
2025-11-03T16:56:54.930083Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7568544186561756816:2618] (SourceId=test-message-group-id1, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-11-03T16:56:54.930103Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7568544186561756816:2618] (SourceId=test-message-group-id1, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-11-03T16:56:54.930117Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7568544186561756816:2618] (SourceId=test-message-group-id1, PreferedPartition=(NULL)) Start idle
2025-11-03T16:56:54.930139Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-11-03T16:56:54.931799Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1
2025-11-03T16:56:54.931849Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1
2025-11-03T16:56:54.933388Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 269877761, Sender [2:7568544185706619447:2826], Recipient [2:7568544108397207262:2383]: NKikimr::TEvTabletPipe::TEvServerConnected
2025-11-03T16:56:54.933420Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5330: HandleHook, processing event TEvTabletPipe::TEvServerConnected
2025-11-03T16:56:54.933436Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:2716: [PQ: 72075186224037892] Handle TEvTabletPipe::TEvServerConnected
2025-11-03T16:56:54.933464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [1:7568544186561756888:2619], now have 1 active actors on pipe
2025-11-03T16:56:54.933500Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 269877761, Sender [2:7568544185706619448:2827], Recipient [2:7568544108397207262:2383]: NKikimr::TEvTabletPipe::TEvServerConnected
2025-11-03T16:56:54.933514Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5330: HandleHook, processing event TEvTabletPipe::TEvServerConnected
2025-11-03T16:56:54.933525Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:2716: [PQ: 72075186224037892] Handle TEvTabletPipe::TEvServerConnected
2025-11-03T16:56:54.933540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [1:7568544186561756892:2618], now have 1 active actors on pipe
2025-11-03T16:56:54.933564Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271187968, Sender [1:7568544186561756887:2619], Recipient [2:7568544185706619447:2826]
2025-11-03T16:56:54.933577Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5316: HandleHook, processing event TEvPersQueue::TEvRequest
2025-11-03T16:56:54.933620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc2--test-topic' requestId: <none>
2025-11-03T16:56:54.933643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc2--test-topic' partition 0
2025-11-03T16:56:54.933700Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271187968, Sender [1:7568544186561756891:2618], Recipient [2:7568544185706619448:2827]
2025-11-03T16:56:54.933712Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5316: HandleHook, processing event TEvPersQueue::TEvRequest
2025-11-03T16:56:54.933735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc2--test-topic' requestId: <none>
2025-11-03T16:56:54.933747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc2--test-topic' partition 0
2025-11-03T16:56:54.933805Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188498 (NKikimr::TEvPQ::TEvChangeOwner), Tablet [2:7568544108397207262:2383], Partition 0, Sender [2:7568544108397207262:2383], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:54.933842Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188498, Sender [2:7568544108397207262:2383], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvChangeOwner
2025-11-03T16:56:54.933864Z node 2 :PERSQUEUE TRACE: partition.h:642: StateIdle, processing event TEvPQ::TEvChangeOwner
2025-11-03T16:56:54.933881Z node 2 :PERSQUEUE TRACE: partition_write.cpp:154: [72075186224037892][Partition][0][StateIdle] TPartition::HandleOnWrite TEvChangeOwner.
2025-11-03T16:56:54.933899Z node 2 :PERSQUEUE TRACE: partition_write.cpp:873: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessChangeOwnerRequests.
2025-11-03T16:56:54.933912Z node 2 :PERSQUEUE TRACE: partition_write.cpp:107: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessChangeOwnerRequest.
2025-11-03T16:56:54.933956Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie test-message-group-id2|2a3ddb18-284f8129-92b73a41-cb6fc24_0 generated for partition 0 topic 'rt3.dc2--test-topic' owner test-message-group-id2
2025-11-03T16:56:54.933978Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:54.934000Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:54.934019Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:54.934032Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-03T16:56:54.934072Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:54.934086Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:54.934148Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:54.934160Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:54.934175Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:54.934192Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=1
2025-11-03T16:56:54.934215Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-03T16:56:54.934270Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188498 (NKikimr::TEvPQ::TEvChangeOwner), Tablet [2:7568544108397207262:2383], Partition 0, Sender [2:7568544108397207262:2383], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:54.934301Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188498, Sender [2:7568544108397207262:2383], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvChangeOwner
2025-11-03T16:56:54.934313Z node 2 :PERSQUEUE TRACE: partition.h:642: StateIdle, processing event TEvPQ::TEvChangeOwner
2025-11-03T16:56:54.934323Z node 2 :PERSQUEUE TRACE: partition_write.cpp:154: [72075186224037892][Partition][0][StateIdle] TPartition::HandleOnWrite TEvChangeOwner.
2025-11-03T16:56:54.934334Z node 2 :PERSQUEUE TRACE: partition_write.cpp:873: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessChangeOwnerRequests.
2025-11-03T16:56:54.934343Z node 2 :PERSQUEUE TRACE: partition_write.cpp:107: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessChangeOwnerRequest.
2025-11-03T16:56:54.934369Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie test-message-group-id1|31eb54da-a2be9e52-c5e60e6f-6d616617_0 generated for partition 0 topic 'rt3.dc2--test-topic' owner test-message-group-id1
2025-11-03T16:56:54.934378Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:54.934391Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:54.934402Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:54.934410Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-03T16:56:54.934428Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:54.934439Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:54.934463Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:54.934473Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:54.934482Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:54.934494Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=1
2025-11-03T16:56:54.934506Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-03T16:56:54.934546Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188562 (NKikimr::TEvPQ::TEvTxBatchComplete), Tablet [2:7568544108397207262:2383], Partition 0, Sender [2:7568544108397207303:2383], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:54.934574Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188562, Sender [2:7568544108397207303:2383], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvTxBatchComplete
2025-11-03T16:56:54.934610Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271188493, Sender [2:7568544108397207303:2383], Recipient [2:7568544108397207262:2383]: NKikimr::TEvPQ::TEvProxyResponse
2025-11-03T16:56:54.934626Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5335: HandleHook, processing event TEvPQ::TEvProxyResponse
2025-11-03T16:56:54.934647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc2--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-03T16:56:54.934732Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188562 (NKikimr::TEvPQ::TEvTxBatchComplete), Tablet [2:7568544108397207262:2383], Partition 0, Sender [2:7568544108397207303:2383], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:54.934755Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188562, Sender [2:7568544108397207303:2383], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvTxBatchComplete
2025-11-03T16:56:54.934787Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271188493, Sender [2:7568544108397207303:2383], Recipient [2:7568544108397207262:2383]: NKikimr::TEvPQ::TEvProxyResponse
2025-11-03T16:56:54.934797Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5335: HandleHook, processing event TEvPQ::TEvProxyResponse
2025-11-03T16:56:54.934809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc2--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-03T16:56:54.935314Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271187968, Sender [1:7568544186561756887:2619], Recipient [2:7568544185706619447:2826]
2025-11-03T16:56:54.935334Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5316: HandleHook, processing event TEvPersQueue::TEvRequest
2025-11-03T16:56:54.935399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc2--test-topic' requestId: <none>
2025-11-03T16:56:54.935414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc2--test-topic' partition 0
2025-11-03T16:56:54.935445Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271187968, Sender [1:7568544186561756891:2618], Recipient [2:7568544185706619448:2827]
2025-11-03T16:56:54.935455Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5316: HandleHook, processing event TEvPersQueue::TEvRequest
2025-11-03T16:56:54.935474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc2--test-topic' requestId: <none>
2025-11-03T16:56:54.935483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc2--test-topic' partition 0
2025-11-03T16:56:54.935526Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188486 (NKikimr::TEvPQ::TEvGetMaxSeqNoRequest), Tablet [2:7568544108397207262:2383], Partition 0, Sender [2:7568544108397207262:2383], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:54.935559Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188486, Sender [2:7568544108397207262:2383], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvGetMaxSeqNoRequest
2025-11-03T16:56:54.935574Z node 2 :PERSQUEUE TRACE: partition.h:634: StateIdle, processing event TEvPQ::TEvGetMaxSeqNoRequest
2025-11-03T16:56:54.935618Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188486 (NKikimr::TEvPQ::TEvGetMaxSeqNoRequest), Tablet [2:7568544108397207262:2383], Partition 0, Sender [2:7568544108397207262:2383], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:54.935652Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188486, Sender [2:7568544108397207262:2383], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvGetMaxSeqNoRequest
2025-11-03T16:56:54.935669Z node 2 :PERSQUEUE TRACE: partition.h:634: StateIdle, processing event TEvPQ::TEvGetMaxSeqNoRequest
2025-11-03T16:56:54.935714Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271188493, Sender [2:7568544108397207303:2383], Recipient [2:7568544108397207262:2383]: NKikimr::TEvPQ::TEvProxyResponse
2025-11-03T16:56:54.935732Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5335: HandleHook, processing event TEvPQ::TEvProxyResponse
2025-11-03T16:56:54.935761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc2--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-03T16:56:54.935818Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271188493, Sender [2:7568544108397207303:2383], Recipient [2:7568544108397207262:2383]: NKikimr::TEvPQ::TEvProxyResponse
2025-11-03T16:56:54.935832Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5335: HandleHook, processing event TEvPQ::TEvProxyResponse
2025-11-03T16:56:54.935848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc2--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-03T16:56:54.936187Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3 partition: 0 MaxSeqNo: 0 sessionId: test-message-group-id2|2a3ddb18-284f8129-92b73a41-cb6fc24_0
2025-11-03T16:56:54.936213Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2 partition: 0 MaxSeqNo: 0 sessionId: test-message-group-id1|31eb54da-a2be9e52-c5e60e6f-6d616617_0
2025-11-03T16:56:54.937461Z :INFO: [/Root] MessageGroupId [test-message-group-id1] SessionId [test-message-group-id1|f1b47779-84f57a92-ac9e6f8a-5d32ebe8_0] Write session established. Init response: session_id: "test-message-group-id1|31eb54da-a2be9e52-c5e60e6f-6d616617_0" topic: "test-topic" cluster: "dc2" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-11-03T16:56:54.937643Z :INFO: [/Root] MessageGroupId [test-message-group-id2] SessionId [test-message-group-id2|d956c290-47a73c9e-b109a607-e01775e1_0] Write session established. Init response: session_id: "test-message-group-id2|2a3ddb18-284f8129-92b73a41-cb6fc24_0" topic: "test-topic" cluster: "dc2" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-11-03T16:56:54.989293Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [4:7568544170866189024:2388], Partition 0, Sender [0:0:0], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:56:54.989369Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:54.989396Z node 4 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:54.989424Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:54.989439Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:54.989451Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:54.989473Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:54.989529Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:54.989543Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:54.989562Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:55.013967Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:55.014039Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:55.014073Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:55.014107Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:55.014122Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:55.014135Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:55.014174Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:55.014234Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:55.014249Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:55.014272Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:55.091204Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [4:7568544170866189024:2388], Partition 0, Sender [0:0:0], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:56:55.091282Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:55.091311Z node 4 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:55.091343Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:55.091360Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:55.091373Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:55.091397Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:55.091457Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:55.091471Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:55.091491Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:55.114216Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:55.114294Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:55.114332Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:55.114375Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:55.114390Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:55.114403Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:55.114424Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:55.114482Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:55.114510Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:55.114532Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:55.191817Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [4:7568544170866189024:2388], Partition 0, Sender [0:0:0], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:56:55.191893Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:55.191921Z node 4 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:55.191955Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:55.191972Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:55.192006Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:55.192031Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:55.192098Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:55.192113Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:55.192138Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:55.218254Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:55.218331Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:55.218356Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:55.218387Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:55.218403Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:55.218414Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:55.218435Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:55.218494Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:55.218510Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:55.218533Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:55.248720Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 65538, Sender [0:0:0], Recipient [4:7568544170866189024:2388]: NActors::TEvents::TEvWakeup
2025-11-03T16:56:55.296132Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [4:7568544170866189024:2388], Partition 0, Sender [0:0:0], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:56:55.296199Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:55.296223Z node 4 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:55.296254Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:55.296269Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:55.296281Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:55.296302Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:55.296357Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:55.296369Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:55.296390Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:55.304244Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 65538 (NActors::TEvents::TEvWakeup), Tablet [4:7568544170866189024:2388], Partition 0, Sender [0:0:0], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:56:55.304304Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 65538, Sender [0:0:0], Recipient [4:7568544170866189065:2388]: NActors::TEvents::TEvWakeup
2025-11-03T16:56:55.304560Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:56:55.304619Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271188501, Sender [4:7568544170866189065:2388], Recipient [4:7568544170866189024:2388]: NKikimr::TEvPQ::TEvPartitionCounters
2025-11-03T16:56:55.304642Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5324: HandleHook, processing event TEvPQ::TEvPartitionCounters
2025-11-03T16:56:55.304658Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:1078: [PQ: 72075186224037892] Handle TEvPQ::TEvPartitionCounters PartitionId 0
2025-11-03T16:56:55.304841Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271188503, Sender [4:7568544170866189065:2388], Recipient [4:7568544170866189024:2388]: NKikimr::TEvPQ::TEvPartitionLabeledCounters
2025-11-03T16:56:55.304858Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5326: HandleHook, processing event TEvPQ::TEvPartitionLabeledCounters
2025-11-03T16:56:55.304896Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271188503, Sender [4:7568544170866189065:2388], Recipient [4:7568544170866189024:2388]: NKikimr::TEvPQ::TEvPartitionLabeledCounters
2025-11-03T16:56:55.304907Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5326: HandleHook, processing event TEvPQ::TEvPartitionLabeledCounters
2025-11-03T16:56:55.312159Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188544 (NKikimr::NPQ::NReadQuoterEvents::TEvQuotaCountersUpdated), Tablet [4:7568544170866189024:2388], Partition 0, Sender [4:7568544170866189068:2388], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:56:55.312222Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188544, Sender [4:7568544170866189068:2388], Recipient [4:7568544170866189065:2388]: NKikimr::NPQ::NReadQuoterEvents::TEvQuotaCountersUpdated
2025-11-03T16:56:55.312245Z node 4 :PERSQUEUE TRACE: partition.h:671: StateIdle, processing event NReadQuoterEvents::TEvQuotaCountersUpdated
2025-11-03T16:56:55.316171Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188544 (NKikimr::NPQ::NReadQuoterEvents::TEvQuotaCountersUpdated), Tablet [2:7568544108397207262:2383], Partition 0, Sender [2:7568544108397207306:2383], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:55.316243Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188544, Sender [2:7568544108397207306:2383], Recipient [2:7568544108397207303:2383]: NKikimr::NPQ::NReadQuoterEvents::TEvQuotaCountersUpdated
2025-11-03T16:56:55.316265Z node 2 :PERSQUEUE TRACE: partition.h:671: StateIdle, processing event NReadQuoterEvents::TEvQuotaCountersUpdated
2025-11-03T16:56:55.323378Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:55.323448Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:55.323471Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:55.323503Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:55.323518Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:55.323530Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:55.325840Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:55.325939Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:55.325954Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:55.325976Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:55.396120Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [4:7568544170866189024:2388], Partition 0, Sender [0:0:0], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:56:55.396184Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:55.396213Z node 4 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:55.396244Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:55.396258Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:55.396270Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:55.396290Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:55.396353Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:55.396367Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:55.396385Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:55.428578Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:55.428659Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:55.428690Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:55.428727Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:55.428754Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:55.428772Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:55.428802Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:55.428879Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:55.428899Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:55.428923Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:55.500127Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [4:7568544170866189024:2388], Partition 0, Sender [0:0:0], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:56:55.500195Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:55.500216Z node 4 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:55.500243Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:55.500256Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:55.500268Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:55.500288Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:55.500345Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:55.500357Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:55.500377Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:55.531831Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:55.531899Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:55.531920Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:55.531948Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:55.531963Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:55.532952Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:55.532984Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:55.533030Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:55.533043Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:55.533064Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:55.598217Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [4:7568544170866189024:2388], Partition 0, Sender [0:0:0], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:56:55.598285Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:55.598307Z node 4 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:55.598336Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:55.598351Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:55.598363Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:55.598383Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:55.598438Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:55.598450Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:55.598470Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:55.632292Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:55.632355Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:55.632376Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:55.632406Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:55.632421Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:55.632433Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:55.632463Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:55.632520Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:55.632535Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:55.632555Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:55.700668Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [4:7568544170866189024:2388], Partition 0, Sender [0:0:0], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:56:55.700727Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:55.700747Z node 4 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:55.700771Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:55.700786Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:55.700797Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:55.700816Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:55.700865Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:55.700879Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:55.700898Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:55.732632Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:55.732704Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:55.732728Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:55.732761Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:55.732776Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:55.732790Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:55.732812Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:55.732870Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:55.732884Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:55.732906Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:55.800942Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [4:7568544170866189024:2388], Partition 0, Sender [0:0:0], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:56:55.801010Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:55.801037Z node 4 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:55.801066Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:55.801082Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:55.801096Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:55.801117Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:55.801175Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:55.801190Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:55.801213Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:55.838396Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:55.838467Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:55.838491Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:55.838524Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:55.838539Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:55.838553Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:55.838575Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:55.838633Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:55.838646Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:55.838671Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:55.904247Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [4:7568544170866189024:2388], Partition 0, Sender [0:0:0], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:56:55.904329Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:55.904362Z node 4 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:55.904397Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:55.904411Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:55.904431Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:55.904454Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:55.904522Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:55.904534Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:55.904554Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:55.936403Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:55.936469Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:55.936491Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:55.936520Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:55.936533Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:55.936544Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:55.936564Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:55.936631Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:55.936644Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:55.936662Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:55.940139Z node 1 :PQ_PARTITION_CHOOSER TRACE: partition_chooser_impl__abstract_chooser_actor.h:278: StateIdle, received event# 278396931, Sender [1:7568544186561756813:2619], Recipient [1:7568544186561756821:2619]: NKikimr::NPQ::TEvPartitionChooser::TEvRefreshRequest
2025-11-03T16:56:55.940180Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7568544186561756821:2619] (SourceId=test-message-group-id2, PreferedPartition=(NULL)) Update the table
2025-11-03T16:56:55.940390Z node 1 :PQ_PARTITION_CHOOSER TRACE: partition_chooser_impl__abstract_chooser_actor.h:278: StateIdle, received event# 278396931, Sender [1:7568544186561756811:2618], Recipient [1:7568544186561756816:2618]: NKikimr::NPQ::TEvPartitionChooser::TEvRefreshRequest
2025-11-03T16:56:55.940403Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7568544186561756816:2618] (SourceId=test-message-group-id1, PreferedPartition=(NULL)) Update the table
2025-11-03T16:56:56.005870Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [4:7568544170866189024:2388], Partition 0, Sender [0:0:0], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:56:56.005936Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:56.005958Z node 4 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:56.005985Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:56.005999Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:56.006012Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:56.006031Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:56.006080Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:56.006093Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:56.006114Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:56.036790Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:56.036858Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:56.036884Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:56.036923Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:56.036941Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:56.036955Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:56.036977Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:56.037047Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:56.037062Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:56.037086Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:56.106405Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [4:7568544170866189024:2388], Partition 0, Sender [0:0:0], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:56:56.106472Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:56.106494Z node 4 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:56.106526Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:56.106568Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:56.106585Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:56.106618Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:56.106687Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:56.106700Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:56.106720Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:56.137155Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:56.137226Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:56.137255Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:56.137289Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:56.137306Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:56.137319Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:56.137343Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:56.137399Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:56.137413Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:56.137437Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:56.206715Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [4:7568544170866189024:2388], Partition 0, Sender [0:0:0], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:56:56.206781Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:56.206802Z node 4 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:56.206832Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:56.206844Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:56.206854Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:56.206874Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:56.206943Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:56.206955Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:56.206974Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:56.228035Z node 1 :PQ_PARTITION_CHOOSER TRACE: partition_chooser_impl__abstract_chooser_actor.h:212: StateUpdate, received event# 271646721, Sender [1:7568544053417768053:2268], Recipient [1:7568544186561756816:2618]: NKikimrKqp.TEvQueryResponse Response { PreparedQuery: "8f4644d2-9efda7ea-94da0694-a038dd4d" QueryIssues { position { row: 2 column: 115 } message: "Symbol $CreateTime is not used" end_position { row: 2 column: 115 } issue_code: 4527 severity: 2 } QueryParameters { Name: "$Hash" Type { Kind: Data Data { Scheme: 2 } } } QueryParameters { Name: "$Topic" Type { Kind: Data Data { Scheme: 4608 } } } QueryParameters { Name: "$SourceId" Type { Kind: Data Data { Scheme: 4608 } } } QueryParameters { Name: "$Partition" Type { Kind: Data Data { Scheme: 2 } } } QueryParameters { Name: "$AccessTime" Type { Kind: Data Data { Scheme: 4 } } } TxMeta { } QueryDiagnostics: "" } YdbStatus: SUCCESS ConsumedRu: 168
2025-11-03T16:56:56.228075Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7568544186561756816:2618] (SourceId=test-message-group-id1, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=1 Status=SUCCESS
2025-11-03T16:56:56.228088Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7568544186561756816:2618] (SourceId=test-message-group-id1, PreferedPartition=(NULL)) Start idle
2025-11-03T16:56:56.228714Z node 1 :PQ_PARTITION_CHOOSER TRACE: partition_chooser_impl__abstract_chooser_actor.h:212: StateUpdate, received event# 271646721, Sender [1:7568544053417768053:2268], Recipient [1:7568544186561756821:2619]: NKikimrKqp.TEvQueryResponse Response { PreparedQuery: "8f4644d2-9efda7ea-94da0694-a038dd4d" QueryIssues { position { row: 2 column: 115 } message: "Symbol $CreateTime is not used" end_position { row: 2 column: 115 } issue_code: 4527 severity: 2 } QueryParameters { Name: "$Hash" Type { Kind: Data Data { Scheme: 2 } } } QueryParameters { Name: "$Topic" Type { Kind: Data Data { Scheme: 4608 } } } QueryParameters { Name: "$SourceId" Type { Kind: Data Data { Scheme: 4608 } } } QueryParameters { Name: "$Partition" Type { Kind: Data Data { Scheme: 2 } } } QueryParameters { Name: "$AccessTime" Type { Kind: Data Data { Scheme: 4 } } } TxMeta { } QueryDiagnostics: "" } YdbStatus: SUCCESS ConsumedRu: 167
2025-11-03T16:56:56.228746Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7568544186561756821:2619] (SourceId=test-message-group-id2, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=1 Status=SUCCESS
2025-11-03T16:56:56.228758Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7568544186561756821:2619] (SourceId=test-message-group-id2, PreferedPartition=(NULL)) Start idle
2025-11-03T16:56:56.233345Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 270794759, Sender [2:7568544108397207278:2384], Recipient [2:7568544108397207262:2383]: NKikimr::NKeyValue::TChannelBalancer::TEvUpdateWeights
2025-11-03T16:56:56.238785Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:56.238855Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:56.238900Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:56.238931Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:56.238946Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:56.238960Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:56.238982Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:56.239040Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:56.239056Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:56.239076Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:56.248163Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 65538, Sender [0:0:0], Recipient [2:7568544108397207262:2383]: NActors::TEvents::TEvWakeup
2025-11-03T16:56:56.289221Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 65538 (NActors::TEvents::TEvWakeup), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:56.289293Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 65538, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NActors::TEvents::TEvWakeup
2025-11-03T16:56:56.289485Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:183: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:56:56.289544Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271188501, Sender [2:7568544108397207303:2383], Recipient [2:7568544108397207262:2383]: NKikimr::TEvPQ::TEvPartitionCounters
2025-11-03T16:56:56.289571Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5324: HandleHook, processing event TEvPQ::TEvPartitionCounters
2025-11-03T16:56:56.289593Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:1078: [PQ: 72075186224037892] Handle TEvPQ::TEvPartitionCounters PartitionId 0
2025-11-03T16:56:56.289764Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271188503, Sender [2:7568544108397207303:2383], Recipient [2:7568544108397207262:2383]: NKikimr::TEvPQ::TEvPartitionLabeledCounters
2025-11-03T16:56:56.289780Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5326: HandleHook, processing event TEvPQ::TEvPartitionLabeledCounters
2025-11-03T16:56:56.309847Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [4:7568544170866189024:2388], Partition 0, Sender [0:0:0], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:56:56.309920Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:56.309942Z node 4 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:56.309972Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:56.309986Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:56.309999Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:56.310020Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:56.310076Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:56.310088Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:56.310107Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:56.312098Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188544 (NKikimr::NPQ::NReadQuoterEvents::TEvQuotaCountersUpdated), Tablet [4:7568544170866189024:2388], Partition 0, Sender [4:7568544170866189068:2388], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:56:56.312152Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188544, Sender [4:7568544170866189068:2388], Recipient [4:7568544170866189065:2388]: NKikimr::NPQ::NReadQuoterEvents::TEvQuotaCountersUpdated
2025-11-03T16:56:56.312170Z node 4 :PERSQUEUE TRACE: partition.h:671: StateIdle, processing event NReadQuoterEvents::TEvQuotaCountersUpdated
2025-11-03T16:56:56.317388Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188544 (NKikimr::NPQ::NReadQuoterEvents::TEvQuotaCountersUpdated), Tablet [2:7568544108397207262:2383], Partition 0, Sender [2:7568544108397207306:2383], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:56.317452Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188544, Sender [2:7568544108397207306:2383], Recipient [2:7568544108397207303:2383]: NKikimr::NPQ::NReadQuoterEvents::TEvQuotaCountersUpdated
2025-11-03T16:56:56.317477Z node 2 :PERSQUEUE TRACE: partition.h:671: StateIdle, processing event NReadQuoterEvents::TEvQuotaCountersUpdated
2025-11-03T16:56:56.339291Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:56.339360Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:56.339386Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:56.339416Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:56.339432Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:56.339445Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:56.339467Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:56.339524Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:56.339536Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:56.339556Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:56.348532Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2 reason: Session preferred cluster "dc1" is enabled for at least 1.000000s and session is older than 1.000000s sessionId: test-message-group-id1|31eb54da-a2be9e52-c5e60e6f-6d616617_0
2025-11-03T16:56:56.348894Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2 sessionId: test-message-group-id1|31eb54da-a2be9e52-c5e60e6f-6d616617_0 is DEAD
2025-11-03T16:56:56.349150Z node 1 :PQ_PARTITION_CHOOSER TRACE: partition_chooser_impl__abstract_chooser_actor.h:278: StateIdle, received event# 65543, Sender [1:7568544186561756811:2618], Recipient [1:7568544186561756816:2618]: NActors::TEvents::TEvPoison
2025-11-03T16:56:56.349201Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-11-03T16:56:56.349288Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3 reason: Session preferred cluster "dc1" is enabled for at least 1.000000s and session is older than 1.000000s sessionId: test-message-group-id2|2a3ddb18-284f8129-92b73a41-cb6fc24_0
2025-11-03T16:56:56.349465Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3 sessionId: test-message-group-id2|2a3ddb18-284f8129-92b73a41-cb6fc24_0 is DEAD
2025-11-03T16:56:56.349623Z node 1 :PQ_PARTITION_CHOOSER TRACE: partition_chooser_impl__abstract_chooser_actor.h:278: StateIdle, received event# 65543, Sender [1:7568544186561756813:2619], Recipient [1:7568544186561756821:2619]: NActors::TEvents::TEvPoison
2025-11-03T16:56:56.349651Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-11-03T16:56:56.349637Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 269877764, Sender [2:7568544185706619448:2827], Recipient [2:7568544108397207262:2383]: NKikimr::TEvTabletPipe::TEvServerDisconnected
2025-11-03T16:56:56.349676Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5331: HandleHook, processing event TEvTabletPipe::TEvServerDisconnected
2025-11-03T16:56:56.349691Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:2729: [PQ: 72075186224037892] Handle TEvTabletPipe::TEvServerDisconnected
2025-11-03T16:56:56.349717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [1:7568544186561756892:2618] destroyed
2025-11-03T16:56:56.349773Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188506 (NKikimr::TEvPQ::TEvPipeDisconnected), Tablet [2:7568544108397207262:2383], Partition 0, Sender [2:7568544108397207262:2383], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:56.349808Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188506, Sender [2:7568544108397207262:2383], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvPipeDisconnected
2025-11-03T16:56:56.349830Z node 2 :PERSQUEUE TRACE: partition.h:651: StateIdle, processing event TEvPQ::TEvPipeDisconnected
2025-11-03T16:56:56.349851Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-11-03T16:56:56.349869Z node 2 :PERSQUEUE TRACE: partition_write.cpp:873: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessChangeOwnerRequests.
2025-11-03T16:56:56.349900Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:56.349914Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:56.349925Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:56.349944Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:56.350012Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:56.350022Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:56.350055Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:56.350346Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 269877764, Sender [2:7568544185706619447:2826], Recipient [2:7568544108397207262:2383]: NKikimr::TEvTabletPipe::TEvServerDisconnected
2025-11-03T16:56:56.350362Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5331: HandleHook, processing event TEvTabletPipe::TEvServerDisconnected
2025-11-03T16:56:56.350375Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:2729: [PQ: 72075186224037892] Handle TEvTabletPipe::TEvServerDisconnected
2025-11-03T16:56:56.350406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [1:7568544186561756888:2619] destroyed
2025-11-03T16:56:56.350450Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188506 (NKikimr::TEvPQ::TEvPipeDisconnected), Tablet [2:7568544108397207262:2383], Partition 0, Sender [2:7568544108397207262:2383], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:56.350488Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188506, Sender [2:7568544108397207262:2383], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvPipeDisconnected
2025-11-03T16:56:56.350504Z node 2 :PERSQUEUE TRACE: partition.h:651: StateIdle, processing event TEvPQ::TEvPipeDisconnected
2025-11-03T16:56:56.350517Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-11-03T16:56:56.350530Z node 2 :PERSQUEUE TRACE: partition_write.cpp:873: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessChangeOwnerRequests.
2025-11-03T16:56:56.350543Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:56.350567Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:56.350578Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:56.350591Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:56.350624Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:56.350633Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:56.350648Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
====CreateRetryState
Test retry state: get retry delay
2025-11-03T16:56:56.353827Z :INFO: [/Root] MessageGroupId [test-message-group-id1] SessionId [test-message-group-id1|31eb54da-a2be9e52-c5e60e6f-6d616617_0] Got error. Status: ABORTED, Description: <main>: Error: Session preferred cluster "dc1" is enabled for at least 1.000000s and session is older than 1.000000s, code: 500026 
2025-11-03T16:56:56.353881Z :INFO: [/Root] MessageGroupId [test-message-group-id1] SessionId [test-message-group-id1|31eb54da-a2be9e52-c5e60e6f-6d616617_0] Write session will restart in 2.000000s
2025-11-03T16:56:56.353936Z :INFO: [/Root] MessageGroupId [test-message-group-id1] SessionId [test-message-group-id1|31eb54da-a2be9e52-c5e60e6f-6d616617_0] Write session: Do CDS request
2025-11-03T16:56:56.353974Z :INFO: [/Root] MessageGroupId [test-message-group-id1] SessionId [test-message-group-id1|31eb54da-a2be9e52-c5e60e6f-6d616617_0] Do schedule cds request after 2000 ms
====CreateRetryState
Test retry state: get retry delay
2025-11-03T16:56:56.354604Z :INFO: [/Root] MessageGroupId [test-message-group-id2] SessionId [test-message-group-id2|2a3ddb18-284f8129-92b73a41-cb6fc24_0] Got error. Status: ABORTED, Description: <main>: Error: Session preferred cluster "dc1" is enabled for at least 1.000000s and session is older than 1.000000s, code: 500026 
2025-11-03T16:56:56.354633Z :INFO: [/Root] MessageGroupId [test-message-group-id2] SessionId [test-message-group-id2|2a3ddb18-284f8129-92b73a41-cb6fc24_0] Write session will restart in 2.000000s
2025-11-03T16:56:56.354693Z :INFO: [/Root] MessageGroupId [test-message-group-id2] SessionId [test-message-group-id2|2a3ddb18-284f8129-92b73a41-cb6fc24_0] Write session: Do CDS request
2025-11-03T16:56:56.354725Z :INFO: [/Root] MessageGroupId [test-message-group-id2] SessionId [test-message-group-id2|2a3ddb18-284f8129-92b73a41-cb6fc24_0] Do schedule cds request after 2000 ms
===Recreate writers
====TYdbPqTestRetryPolicy()
2025-11-03T16:56:56.355389Z :TWriteSession_SeqNoShift INFO: Wait for client write event loop to stop
2025-11-03T16:56:56.355398Z :TWriteSession_SeqNoShift DEBUG: Close writer (stop)
2025-11-03T16:56:56.355492Z :INFO: [/Root] MessageGroupId [test-message-group-id1] SessionId [test-message-group-id1|31eb54da-a2be9e52-c5e60e6f-6d616617_0] Write session: close. Timeout = 0 ms
2025-11-03T16:56:56.355593Z :INFO: [/Root] MessageGroupId [test-message-group-id1] SessionId [test-message-group-id1|31eb54da-a2be9e52-c5e60e6f-6d616617_0] Write session will now close
2025-11-03T16:56:56.355647Z :DEBUG: [/Root] MessageGroupId [test-message-group-id1] SessionId [test-message-group-id1|31eb54da-a2be9e52-c5e60e6f-6d616617_0] Write session: aborting
2025-11-03T16:56:56.355954Z :DEBUG: [/Root] MessageGroupId [test-message-group-id1] SessionId [] Write session: try to update token
2025-11-03T16:56:56.356057Z :INFO: [/Root] MessageGroupId [test-message-group-id1] SessionId [] Write session: Do CDS request
2025-11-03T16:56:56.356096Z :INFO: [/Root] MessageGroupId [test-message-group-id1] SessionId [] Do schedule cds request after 0 ms
2025-11-03T16:56:56.356162Z :TWriteSession_SeqNoShift INFO: Wait for writer event
2025-11-03T16:56:56.356390Z :INFO: [/Root] MessageGroupId [test-message-group-id1] SessionId [test-message-group-id1|31eb54da-a2be9e52-c5e60e6f-6d616617_0] Write session: gracefully shut down, all writes complete
2025-11-03T16:56:56.356449Z :DEBUG: [/Root] MessageGroupId [test-message-group-id1] SessionId [test-message-group-id1|31eb54da-a2be9e52-c5e60e6f-6d616617_0] Write session: destroy
2025-11-03T16:56:56.356578Z :TWriteSession_SeqNoShift DEBUG: Writer closed
2025-11-03T16:56:56.359875Z :TWriteSession_SeqNoShift INFO: Client write event loop stopped
====TYdbPqTestRetryPolicy()
2025-11-03T16:56:56.360170Z :TWriteSession_SeqNoShift INFO: Wait for client write event loop to stop
2025-11-03T16:56:56.360179Z :TWriteSession_SeqNoShift DEBUG: Close writer (stop)
2025-11-03T16:56:56.360047Z :INFO: [/Root] MessageGroupId [test-message-group-id1] Running cds request ms
2025-11-03T16:56:56.360251Z :INFO: [/Root] MessageGroupId [test-message-group-id2] SessionId [test-message-group-id2|2a3ddb18-284f8129-92b73a41-cb6fc24_0] Write session: close. Timeout = 0 ms
2025-11-03T16:56:56.366367Z :INFO: [/Root] MessageGroupId [test-message-group-id2] SessionId [test-message-group-id2|2a3ddb18-284f8129-92b73a41-cb6fc24_0] Write session will now close
2025-11-03T16:56:56.366412Z :DEBUG: [/Root] MessageGroupId [test-message-group-id2] SessionId [test-message-group-id2|2a3ddb18-284f8129-92b73a41-cb6fc24_0] Write session: aborting
2025-11-03T16:56:56.367094Z :INFO: [/Root] MessageGroupId [test-message-group-id2] SessionId [test-message-group-id2|2a3ddb18-284f8129-92b73a41-cb6fc24_0] Write session: gracefully shut down, all writes complete
2025-11-03T16:56:56.367152Z :DEBUG: [/Root] MessageGroupId [test-message-group-id2] SessionId [test-message-group-id2|2a3ddb18-284f8129-92b73a41-cb6fc24_0] Write session: destroy
2025-11-03T16:56:56.367255Z :TWriteSession_SeqNoShift DEBUG: Writer closed
2025-11-03T16:56:56.367846Z :DEBUG: [/Root] MessageGroupId [test-message-group-id2] SessionId [] Write session: try to update token
2025-11-03T16:56:56.368153Z :INFO: [/Root] MessageGroupId [test-message-group-id2] SessionId [] Write session: Do CDS request
2025-11-03T16:56:56.368194Z :INFO: [/Root] MessageGroupId [test-message-group-id2] SessionId [] Do schedule cds request after 0 ms
2025-11-03T16:56:56.368255Z :TWriteSession_SeqNoShift INFO: Wait for writer event
2025-11-03T16:56:56.368310Z :INFO: [/Root] MessageGroupId [test-message-group-id2] Running cds request ms
2025-11-03T16:56:56.376079Z :TWriteSession_SeqNoShift INFO: Client write event loop stopped
===Write one message into every writer
2025-11-03T16:56:56.376197Z :TWriteSession_SeqNoShift INFO: Enqueue message with sequence number 1
2025-11-03T16:56:56.381172Z :INFO: [/Root] MessageGroupId [test-message-group-id2] SessionId [] Got CDS response: 
write_sessions_clusters { clusters { endpoint: "localhost:13111" name: "dc1" } clusters { endpoint: "localhost:14811" name: "dc2" available: true } primary_cluster_selection_reason: CLIENT_LOCATION } version: 1
2025-11-03T16:56:56.381234Z :INFO: [/Root] MessageGroupId [test-message-group-id2] SessionId [] Start write session. Will connect to endpoint: localhost:14811
2025-11-03T16:56:56.382098Z :INFO: [/Root] MessageGroupId [test-message-group-id1] SessionId [] Got CDS response: 
write_sessions_clusters { clusters { endpoint: "localhost:13111" name: "dc1" } clusters { endpoint: "localhost:14811" name: "dc2" available: true } primary_cluster_selection_reason: CLIENT_LOCATION } version: 1
2025-11-03T16:56:56.382143Z :INFO: [/Root] MessageGroupId [test-message-group-id1] SessionId [] Start write session. Will connect to endpoint: localhost:14811
2025-11-03T16:56:56.386144Z :DEBUG: [/Root] MessageGroupId [test-message-group-id1] SessionId [] Write session: send init request: init_request { topic: "test-topic" message_group_id: "test-message-group-id1" preferred_cluster: "dc1" }
2025-11-03T16:56:56.386145Z :DEBUG: [/Root] MessageGroupId [test-message-group-id2] SessionId [] Write session: send init request: init_request { topic: "test-topic" message_group_id: "test-message-group-id2" preferred_cluster: "dc1" }
2025-11-03T16:56:56.387482Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-11-03T16:56:56.387518Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 4
2025-11-03T16:56:56.387590Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-11-03T16:56:56.387599Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 5
2025-11-03T16:56:56.388019Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 4 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "test-message-group-id1" preferred_cluster: "dc1" }
2025-11-03T16:56:56.388157Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 4 topic: "test-topic" message_group_id: "test-message-group-id1" preferred_cluster: "dc1" from ipv6:[::1]:55012
2025-11-03T16:56:56.388181Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=4 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:55012 proto=v1  topic=test-topic durationSec=0
2025-11-03T16:56:56.388192Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-11-03T16:56:56.388275Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 5 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "test-message-group-id2" preferred_cluster: "dc1" }
2025-11-03T16:56:56.388350Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 5 topic: "test-topic" message_group_id: "test-message-group-id2" preferred_cluster: "dc1" from ipv6:[::1]:55012
2025-11-03T16:56:56.388370Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=5 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:55012 proto=v1  topic=test-topic durationSec=0
2025-11-03T16:56:56.388377Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-11-03T16:56:56.389861Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 4 sessionId:  describe result for acl check
2025-11-03T16:56:56.389950Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 5 sessionId:  describe result for acl check
2025-11-03T16:56:56.389980Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-11-03T16:56:56.389992Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-11-03T16:56:56.390000Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-11-03T16:56:56.390006Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-11-03T16:56:56.390015Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-11-03T16:56:56.390017Z node 1 :PQ_PARTITION_CHOOSER TRACE: partition_chooser_impl__abstract_chooser_actor.h:88: TPartitionChooser [1:7568544195151691593:2647] (SourceId=test-message-group-id1, PreferedPartition=(NULL)) InitTable: SourceId=test-message-group-id1 TopicsAreFirstClassCitizen=0 UseSrcIdMetaMappingInFirstClass=1
2025-11-03T16:56:56.390021Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-11-03T16:56:56.390031Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7568544195151691593:2647] (SourceId=test-message-group-id1, PreferedPartition=(NULL)) StartKqpSession
2025-11-03T16:56:56.390034Z node 1 :PQ_PARTITION_CHOOSER TRACE: partition_chooser_impl__abstract_chooser_actor.h:88: TPartitionChooser [1:7568544195151691594:2648] (SourceId=test-message-group-id2, PreferedPartition=(NULL)) InitTable: SourceId=test-message-group-id2 TopicsAreFirstClassCitizen=0 UseSrcIdMetaMappingInFirstClass=1
2025-11-03T16:56:56.390044Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7568544195151691594:2648] (SourceId=test-message-group-id2, PreferedPartition=(NULL)) StartKqpSession
2025-11-03T16:56:56.393393Z node 1 :PQ_PARTITION_CHOOSER TRACE: partition_chooser_impl__abstract_chooser_actor.h:132: StateCreateKqpSession, received event# 271646728, Sender [1:7568544053417768053:2268], Recipient [1:7568544195151691593:2647]: NKikimrKqp.TEvCreateSessionResponse Error: "" Response { SessionId: "ydb://session/3?node_id=1&id=N2E4YmRkNTMtMjBjMTkyNzEtZDEwMzk4ODgtYzJjNWY1YjE=" NodeId: 1 } YdbStatus: SUCCESS ResourceExhausted: false
2025-11-03T16:56:56.393431Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7568544195151691593:2647] (SourceId=test-message-group-id1, PreferedPartition=(NULL)) Select from the table
2025-11-03T16:56:56.395751Z node 1 :PQ_PARTITION_CHOOSER TRACE: partition_chooser_impl__abstract_chooser_actor.h:132: StateCreateKqpSession, received event# 271646728, Sender [1:7568544053417768053:2268], Recipient [1:7568544195151691594:2648]: NKikimrKqp.TEvCreateSessionResponse Error: "" Response { SessionId: "ydb://session/3?node_id=1&id=MWNlZTM5YTAtYzE4ZjA2NmMtMzY2ZWRjYTQtODA5Y2Y3MzU=" NodeId: 1 } YdbStatus: SUCCESS ResourceExhausted: false
2025-11-03T16:56:56.395785Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7568544195151691594:2648] (SourceId=test-message-group-id2, PreferedPartition=(NULL)) Select from the table
2025-11-03T16:56:56.401976Z node 1 :PQ_PARTITION_CHOOSER TRACE: partition_chooser_impl__abstract_chooser_actor.h:163: StateSelect, received event# 271646721, Sender [1:7568544053417768053:2268], Recipient [1:7568544195151691594:2648]: NKikimrKqp.TEvQueryResponse Response { SessionId: "ydb://session/3?node_id=1&id=MWNlZTM5YTAtYzE4ZjA2NmMtMzY2ZWRjYTQtODA5Y2Y3MzU=" PreparedQuery: "bf547082-be61c135-9226a4-6fe85003" QueryParameters { Name: "$Hash" Type { Kind: Data Data { Scheme: 2 } } } QueryParameters { Name: "$Topic" Type { Kind: Data Data { Scheme: 4608 } } } QueryParameters { Name: "$SourceId" Type { Kind: Data Data { Scheme: 4608 } } } TxMeta { id: "01k95aczac51s75n4ajh93t205" } YdbResults { columns { name: "Partition" type { optional_type { item { type_id: UINT32 } } } } columns { name: "CreateTime" type { optional_type { item { type_id: UINT64 } } } } columns { name: "AccessTime" type { optional_type { item { type_id: UINT64 } } } } columns { name: "SeqNo" type { optional_type { item { type_id: UINT64 } } } } rows { items { uint32_value: 0 } items { uint64_value: 1762189014912 } items { uint64_value: 1762189015940 } items { uint64_value: 0 } } format: FORMAT_VALUE } QueryDiagnostics: "" } YdbStatus: SUCCESS Cons
2025-11-03T16:56:56.402132Z node 1 :PQ_PARTITION_CHOOSER TRACE: partition_chooser_impl__abstract_chooser_actor.h:151: TPartitionChooser [1:7568544195151691594:2648] (SourceId=test-message-group-id2, PreferedPartition=(NULL)) Selected from table PartitionId=0 SeqNo=0
2025-11-03T16:56:56.402150Z node 1 :PQ_PARTITION_CHOOSER TRACE: partition_chooser_impl__old_chooser_actor.h:113: TPartitionChooser [1:7568544195151691594:2648] (SourceId=test-message-group-id2, PreferedPartition=(NULL)) OnPartitionChosen
2025-11-03T16:56:56.402174Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7568544195151691594:2648] (SourceId=test-message-group-id2, PreferedPartition=(NULL)) Update the table
2025-11-03T16:56:56.402403Z node 1 :PQ_PARTITION_CHOOSER TRACE: partition_chooser_impl__abstract_chooser_actor.h:163: StateSelect, received event# 271646721, Sender [1:7568544053417768053:2268], Recipient [1:7568544195151691593:2647]: NKikimrKqp.TEvQueryResponse Response { SessionId: "ydb://session/3?node_id=1&id=N2E4YmRkNTMtMjBjMTkyNzEtZDEwMzk4ODgtYzJjNWY1YjE=" PreparedQuery: "bf547082-be61c135-9226a4-6fe85003" QueryParameters { Name: "$Hash" Type { Kind: Data Data { Scheme: 2 } } } QueryParameters { Name: "$Topic" Type { Kind: Data Data { Scheme: 4608 } } } QueryParameters { Name: "$SourceId" Type { Kind: Data Data { Scheme: 4608 } } } TxMeta { id: "01k95aczac7zkwzg9cgh4s1xgw" } YdbResults { columns { name: "Partition" type { optional_type { item { type_id: UINT32 } } } } columns { name: "CreateTime" type { optional_type { item { type_id: UINT64 } } } } columns { name: "AccessTime" type { optional_type { item { type_id: UINT64 } } } } columns { name: "SeqNo" type { optional_type { item { type_id: UINT64 } } } } rows { items { uint32_value: 0 } items { uint64_value: 1762189014910 } items { uint64_value: 1762189015940 } items { uint64_value: 0 } } format: FORMAT_VALUE } QueryDiagnostics: "" } YdbStatus: SUCCESS Cons
2025-11-03T16:56:56.402518Z node 1 :PQ_PARTITION_CHOOSER TRACE: partition_chooser_impl__abstract_chooser_actor.h:151: TPartitionChooser [1:7568544195151691593:2647] (SourceId=test-message-group-id1, PreferedPartition=(NULL)) Selected from table PartitionId=0 SeqNo=0
2025-11-03T16:56:56.402532Z node 1 :PQ_PARTITION_CHOOSER TRACE: partition_chooser_impl__old_chooser_actor.h:113: TPartitionChooser [1:7568544195151691593:2647] (SourceId=test-message-group-id1, PreferedPartition=(NULL)) OnPartitionChosen
2025-11-03T16:56:56.402544Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7568544195151691593:2647] (SourceId=test-message-group-id1, PreferedPartition=(NULL)) Update the table
2025-11-03T16:56:56.409998Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [4:7568544170866189024:2388], Partition 0, Sender [0:0:0], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:56:56.410056Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:56.410079Z node 4 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:56.410109Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:56.410136Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:56.410150Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:56.410174Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:56.410231Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:56.410253Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:56.410280Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:56.414531Z node 1 :PQ_PARTITION_CHOOSER TRACE: partition_chooser_impl__abstract_chooser_actor.h:212: StateUpdate, received event# 271646721, Sender [1:7568544053417768053:2268], Recipient [1:7568544195151691593:2647]: NKikimrKqp.TEvQueryResponse Response { SessionId: "ydb://session/3?node_id=1&id=N2E4YmRkNTMtMjBjMTkyNzEtZDEwMzk4ODgtYzJjNWY1YjE=" PreparedQuery: "34f6fc20-f975aeb1-f34c103e-7f2bd9da" QueryParameters { Name: "$AccessTime" Type { Kind: Data Data { Scheme: 4 } } } QueryParameters { Name: "$CreateTime" Type { Kind: Data Data { Scheme: 4 } } } QueryParameters { Name: "$Hash" Type { Kind: Data Data { Scheme: 2 } } } QueryParameters { Name: "$Partition" Type { Kind: Data Data { Scheme: 2 } } } QueryParameters { Name: "$SeqNo" Type { Kind: Data Data { Scheme: 4 } } } QueryParameters { Name: "$SourceId" Type { Kind: Data Data { Scheme: 4608 } } } QueryParameters { Name: "$Topic" Type { Kind: Data Data { Scheme: 4608 } } } TxMeta { } QueryDiagnostics: "" } YdbStatus: SUCCESS ConsumedRu: 1
2025-11-03T16:56:56.414575Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7568544195151691593:2647] (SourceId=test-message-group-id1, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-11-03T16:56:56.414598Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7568544195151691593:2647] (SourceId=test-message-group-id1, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-11-03T16:56:56.414615Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7568544195151691593:2647] (SourceId=test-message-group-id1, PreferedPartition=(NULL)) Start idle
2025-11-03T16:56:56.414643Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 4 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-11-03T16:56:56.416150Z node 1 :PQ_PARTITION_CHOOSER TRACE: partition_chooser_impl__abstract_chooser_actor.h:212: StateUpdate, received event# 271646721, Sender [1:7568544053417768053:2268], Recipient [1:7568544195151691594:2648]: NKikimrKqp.TEvQueryResponse Response { SessionId: "ydb://session/3?node_id=1&id=MWNlZTM5YTAtYzE4ZjA2NmMtMzY2ZWRjYTQtODA5Y2Y3MzU=" PreparedQuery: "34f6fc20-f975aeb1-f34c103e-7f2bd9da" QueryParameters { Name: "$AccessTime" Type { Kind: Data Data { Scheme: 4 } } } QueryParameters { Name: "$CreateTime" Type { Kind: Data Data { Scheme: 4 } } } QueryParameters { Name: "$Hash" Type { Kind: Data Data { Scheme: 2 } } } QueryParameters { Name: "$Partition" Type { Kind: Data Data { Scheme: 2 } } } QueryParameters { Name: "$SeqNo" Type { Kind: Data Data { Scheme: 4 } } } QueryParameters { Name: "$SourceId" Type { Kind: Data Data { Scheme: 4608 } } } QueryParameters { Name: "$Topic" Type { Kind: Data Data { Scheme: 4608 } } } TxMeta { } QueryDiagnostics: "" } YdbStatus: SUCCESS ConsumedRu: 1
2025-11-03T16:56:56.416185Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7568544195151691594:2648] (SourceId=test-message-group-id2, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-11-03T16:56:56.416206Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7568544195151691594:2648] (SourceId=test-message-group-id2, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-11-03T16:56:56.416223Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7568544195151691594:2648] (SourceId=test-message-group-id2, PreferedPartition=(NULL)) Start idle
2025-11-03T16:56:56.416247Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 5 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-11-03T16:56:56.418918Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1
2025-11-03T16:56:56.418999Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1
2025-11-03T16:56:56.418815Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 269877761, Sender [2:7568544194296554099:2857], Recipient [2:7568544108397207262:2383]: NKikimr::TEvTabletPipe::TEvServerConnected
2025-11-03T16:56:56.418857Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5330: HandleHook, processing event TEvTabletPipe::TEvServerConnected
2025-11-03T16:56:56.418875Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:2716: [PQ: 72075186224037892] Handle TEvTabletPipe::TEvServerConnected
2025-11-03T16:56:56.418917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [1:7568544195151691647:2647], now have 1 active actors on pipe
2025-11-03T16:56:56.418959Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 269877761, Sender [2:7568544194296554100:2858], Recipient [2:7568544108397207262:2383]: NKikimr::TEvTabletPipe::TEvServerConnected
2025-11-03T16:56:56.418971Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5330: HandleHook, processing event TEvTabletPipe::TEvServerConnected
2025-11-03T16:56:56.418983Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:2716: [PQ: 72075186224037892] Handle TEvTabletPipe::TEvServerConnected
2025-11-03T16:56:56.419001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [1:7568544195151691650:2648], now have 1 active actors on pipe
2025-11-03T16:56:56.419846Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271187968, Sender [1:7568544195151691646:2647], Recipient [2:7568544194296554099:2857]
2025-11-03T16:56:56.419874Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5316: HandleHook, processing event TEvPersQueue::TEvRequest
2025-11-03T16:56:56.419921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc2--test-topic' requestId: <none>
2025-11-03T16:56:56.419943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc2--test-topic' partition 0
2025-11-03T16:56:56.419995Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271187968, Sender [1:7568544195151691649:2648], Recipient [2:7568544194296554100:2858]
2025-11-03T16:56:56.420009Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5316: HandleHook, processing event TEvPersQueue::TEvRequest
2025-11-03T16:56:56.420032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc2--test-topic' requestId: <none>
2025-11-03T16:56:56.420042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc2--test-topic' partition 0
2025-11-03T16:56:56.420119Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188498 (NKikimr::TEvPQ::TEvChangeOwner), Tablet [2:7568544108397207262:2383], Partition 0, Sender [2:7568544108397207262:2383], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:56.420157Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188498, Sender [2:7568544108397207262:2383], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvChangeOwner
2025-11-03T16:56:56.420176Z node 2 :PERSQUEUE TRACE: partition.h:642: StateIdle, processing event TEvPQ::TEvChangeOwner
2025-11-03T16:56:56.420189Z node 2 :PERSQUEUE TRACE: partition_write.cpp:154: [72075186224037892][Partition][0][StateIdle] TPartition::HandleOnWrite TEvChangeOwner.
2025-11-03T16:56:56.420205Z node 2 :PERSQUEUE TRACE: partition_write.cpp:873: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessChangeOwnerRequests.
2025-11-03T16:56:56.420226Z node 2 :PERSQUEUE TRACE: partition_write.cpp:107: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessChangeOwnerRequest.
2025-11-03T16:56:56.420267Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie test-message-group-id1|f3af300a-53329ef6-b5d9f61a-1e4014ed_0 generated for partition 0 topic 'rt3.dc2--test-topic' owner test-message-group-id1
2025-11-03T16:56:56.420288Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:56.420310Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:56.420328Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:56.420339Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-03T16:56:56.421441Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:56.421461Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:56.421514Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:56.421525Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:56.421542Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:56.421560Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=1
2025-11-03T16:56:56.421583Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-03T16:56:56.421668Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188498 (NKikimr::TEvPQ::TEvChangeOwner), Tablet [2:7568544108397207262:2383], Partition 0, Sender [2:7568544108397207262:2383], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:56.421705Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188498, Sender [2:7568544108397207262:2383], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvChangeOwner
2025-11-03T16:56:56.421721Z node 2 :PERSQUEUE TRACE: partition.h:642: StateIdle, processing event TEvPQ::TEvChangeOwner
2025-11-03T16:56:56.421733Z node 2 :PERSQUEUE TRACE: partition_write.cpp:154: [72075186224037892][Partition][0][StateIdle] TPartition::HandleOnWrite TEvChangeOwner.
2025-11-03T16:56:56.421756Z node 2 :PERSQUEUE TRACE: partition_write.cpp:873: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessChangeOwnerRequests.
2025-11-03T16:56:56.421771Z node 2 :PERSQUEUE TRACE: partition_write.cpp:107: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessChangeOwnerRequest.
2025-11-03T16:56:56.421808Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie test-message-group-id2|6c37dca8-a3d62436-12bc1555-8864442b_0 generated for partition 0 topic 'rt3.dc2--test-topic' owner test-message-group-id2
2025-11-03T16:56:56.421822Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:56.421841Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:56.421855Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:56.421865Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-03T16:56:56.421887Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:56.421899Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:56.421926Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:56.421934Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:56.421945Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:56.421957Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=1
2025-11-03T16:56:56.421970Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-03T16:56:56.422020Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188562 (NKikimr::TEvPQ::TEvTxBatchComplete), Tablet [2:7568544108397207262:2383], Partition 0, Sender [2:7568544108397207303:2383], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:56.422127Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188562, Sender [2:7568544108397207303:2383], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvTxBatchComplete
2025-11-03T16:56:56.422173Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271188493, Sender [2:7568544108397207303:2383], Recipient [2:7568544108397207262:2383]: NKikimr::TEvPQ::TEvProxyResponse
2025-11-03T16:56:56.422191Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5335: HandleHook, processing event TEvPQ::TEvProxyResponse
2025-11-03T16:56:56.422215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc2--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-03T16:56:56.422305Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188562 (NKikimr::TEvPQ::TEvTxBatchComplete), Tablet [2:7568544108397207262:2383], Partition 0, Sender [2:7568544108397207303:2383], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:56.422332Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188562, Sender [2:7568544108397207303:2383], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvTxBatchComplete
2025-11-03T16:56:56.422363Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271188493, Sender [2:7568544108397207303:2383], Recipient [2:7568544108397207262:2383]: NKikimr::TEvPQ::TEvProxyResponse
2025-11-03T16:56:56.422374Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5335: HandleHook, processing event TEvPQ::TEvProxyResponse
2025-11-03T16:56:56.422386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc2--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-03T16:56:56.425443Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271187968, Sender [1:7568544195151691649:2648], Recipient [2:7568544194296554100:2858]
2025-11-03T16:56:56.425474Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5316: HandleHook, processing event TEvPersQueue::TEvRequest
2025-11-03T16:56:56.425519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc2--test-topic' requestId: <none>
2025-11-03T16:56:56.425541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc2--test-topic' partition 0
2025-11-03T16:56:56.425579Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271187968, Sender [1:7568544195151691646:2647], Recipient [2:7568544194296554099:2857]
2025-11-03T16:56:56.425601Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5316: HandleHook, processing event TEvPersQueue::TEvRequest
2025-11-03T16:56:56.425622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc2--test-topic' requestId: <none>
2025-11-03T16:56:56.425633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc2--test-topic' partition 0
2025-11-03T16:56:56.425685Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188486 (NKikimr::TEvPQ::TEvGetMaxSeqNoRequest), Tablet [2:7568544108397207262:2383], Partition 0, Sender [2:7568544108397207262:2383], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:56.425716Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188486, Sender [2:7568544108397207262:2383], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvGetMaxSeqNoRequest
2025-11-03T16:56:56.425744Z node 2 :PERSQUEUE TRACE: partition.h:634: StateIdle, processing event TEvPQ::TEvGetMaxSeqNoRequest
2025-11-03T16:56:56.426333Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 5 partition: 0 MaxSeqNo: 0 sessionId: test-message-group-id2|6c37dca8-a3d62436-12bc1555-8864442b_0
2025-11-03T16:56:56.425793Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188486 (NKikimr::TEvPQ::TEvGetMaxSeqNoRequest), Tablet [2:7568544108397207262:2383], Partition 0, Sender [2:7568544108397207262:2383], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:56.425835Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188486, Sender [2:7568544108397207262:2383], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvGetMaxSeqNoRequest
2025-11-03T16:56:56.426337Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 4 partition: 0 MaxSeqNo: 0 sessionId: test-message-group-id1|f3af300a-53329ef6-b5d9f61a-1e4014ed_0
2025-11-03T16:56:56.425844Z node 2 :PERSQUEUE TRACE: partition.h:634: StateIdle, processing event TEvPQ::TEvGetMaxSeqNoRequest
2025-11-03T16:56:56.425891Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271188493, Sender [2:7568544108397207303:2383], Recipient [2:7568544108397207262:2383]: NKikimr::TEvPQ::TEvProxyResponse
2025-11-03T16:56:56.425907Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5335: HandleHook, processing event TEvPQ::TEvProxyResponse
2025-11-03T16:56:56.425929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc2--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-03T16:56:56.425988Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271188493, Sender [2:7568544108397207303:2383], Recipient [2:7568544108397207262:2383]: NKikimr::TEvPQ::TEvProxyResponse
2025-11-03T16:56:56.425999Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5335: HandleHook, processing event TEvPQ::TEvProxyResponse
2025-11-03T16:56:56.426011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc2--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-03T16:56:56.429615Z :INFO: [/Root] MessageGroupId [test-message-group-id1] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1762189016429 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-11-03T16:56:56.429731Z :INFO: [/Root] MessageGroupId [test-message-group-id1] SessionId [] Write session established. Init response: session_id: "test-message-group-id1|f3af300a-53329ef6-b5d9f61a-1e4014ed_0" topic: "test-topic" cluster: "dc2" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-11-03T16:56:56.429929Z :INFO: [/Root] MessageGroupId [test-message-group-id2] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1762189016429 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-11-03T16:56:56.429938Z :TWriteSession_SeqNoShift INFO: Got new continue token
2025-11-03T16:56:56.430004Z :INFO: [/Root] MessageGroupId [test-message-group-id2] SessionId [] Write session established. Init response: session_id: "test-message-group-id2|6c37dca8-a3d62436-12bc1555-8864442b_0" topic: "test-topic" cluster: "dc2" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-11-03T16:56:56.430016Z :DEBUG: [/Root] MessageGroupId [test-message-group-id1] SessionId [test-message-group-id1|f3af300a-53329ef6-b5d9f61a-1e4014ed_0] Write 1 messages with Id from 1 to 1
2025-11-03T16:56:56.430116Z :TWriteSession_SeqNoShift INFO: Wait for writer event
2025-11-03T16:56:56.430144Z :TWriteSession_SeqNoShift INFO: Got new continue token
2025-11-03T16:56:56.430155Z :TWriteSession_SeqNoShift INFO: Got new continue token
2025-11-03T16:56:56.430445Z :DEBUG: [/Root] MessageGroupId [test-message-group-id1] SessionId [test-message-group-id1|f3af300a-53329ef6-b5d9f61a-1e4014ed_0] Write session: try to update token
2025-11-03T16:56:56.430493Z :DEBUG: [/Root] MessageGroupId [test-message-group-id1] SessionId [test-message-group-id1|f3af300a-53329ef6-b5d9f61a-1e4014ed_0] Send 1 message(s) (0 left), first sequence number is 1
2025-11-03T16:56:56.437445Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271187968, Sender [1:7568544195151691646:2647], Recipient [2:7568544194296554099:2857]
2025-11-03T16:56:56.437493Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5316: HandleHook, processing event TEvPersQueue::TEvRequest
2025-11-03T16:56:56.437542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc2--test-topic' requestId: <none>
2025-11-03T16:56:56.437566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc2--test-topic' partition 0
2025-11-03T16:56:56.437640Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188507 (NKikimr::TEvPQ::TEvReserveBytes), Tablet [2:7568544108397207262:2383], Partition 0, Sender [2:7568544108397207262:2383], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:56.437690Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188507, Sender [2:7568544108397207262:2383], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvReserveBytes
2025-11-03T16:56:56.437724Z node 2 :PERSQUEUE TRACE: partition.h:650: StateIdle, processing event TEvPQ::TEvReserveBytes
2025-11-03T16:56:56.437741Z node 2 :PERSQUEUE TRACE: partition_write.cpp:220: [72075186224037892][Partition][0][StateIdle] TPartition::HandleOnWrite TEvReserveBytes.
2025-11-03T16:56:56.437764Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:56.437828Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271188493, Sender [2:7568544108397207303:2383], Recipient [2:7568544108397207262:2383]: NKikimr::TEvPQ::TEvProxyResponse
2025-11-03T16:56:56.437844Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5335: HandleHook, processing event TEvPQ::TEvProxyResponse
2025-11-03T16:56:56.437860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc2--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-11-03T16:56:56.438320Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271187968, Sender [1:7568544195151691646:2647], Recipient [2:7568544194296554099:2857]
2025-11-03T16:56:56.438343Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5316: HandleHook, processing event TEvPersQueue::TEvRequest
2025-11-03T16:56:56.438392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc2--test-topic' requestId: <none>
2025-11-03T16:56:56.438417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc2--test-topic' partition 0
2025-11-03T16:56:56.438673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc2--test-topic partition: 0 SourceId: '\0test-message-group-id1' SeqNo: 1 partNo : 0 messageNo: 1 size 98 offset: -1
2025-11-03T16:56:56.438737Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188480 (NKikimr::TEvPQ::TEvWrite), Tablet [2:7568544108397207262:2383], Partition 0, Sender [2:7568544108397207262:2383], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:56.438773Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188480, Sender [2:7568544108397207262:2383], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvWrite
2025-11-03T16:56:56.438788Z node 2 :PERSQUEUE TRACE: partition.h:628: StateIdle, processing event TEvPQ::TEvWrite
2025-11-03T16:56:56.438801Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:56:56.438842Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:56.438871Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:56.438891Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-03T16:56:56.438949Z node 2 :PERSQUEUE TRACE: partition_write.cpp:1168: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc2--test-topic' partition 0 process write for '\0test-message-group-id1' DisableDeduplication=0 SeqNo=1 LocalSeqNo=(NULL) InitialSeqNo=0 EnableKafkaDeduplication=0 ProducerEpoch=(empty maybe)
2025-11-03T16:56:56.439018Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc2--test-topic' partition 0 part blob processing sourceId '\0test-message-group-id1' seqNo 1 partNo 0
2025-11-03T16:56:56.436637Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 4 sessionId: test-message-group-id1|f3af300a-53329ef6-b5d9f61a-1e4014ed_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:56:56.436979Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:56:56.438063Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:56:56.483730Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc2--test-topic' partition 0 part blob complete sourceId '\0test-message-group-id1' seqNo 1 partNo 0 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 188 count 1 nextOffset 1 batches 1
2025-11-03T16:56:56.483866Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:56.483885Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 1 items to delete old stuff
2025-11-03T16:56:56.483993Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 1 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest CmdDeleteRange { Range { From: "x0000000000" IncludeFrom: true To: "x0000000001" IncludeTo: false } }
2025-11-03T16:56:56.484010Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:56.484289Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc2--test-topic' partition 0 compactOffset 0,1 HeadOffset 0 endOffset 0 curOffset 1 d0000000000_00000000000000000000_00000_0000000001_00000? size 176 WTime 1762189016484
2025-11-03T16:56:56.484307Z node 2 :PERSQUEUE TRACE: partition_write.cpp:1459: [72075186224037892][Partition][0][StateIdle] TPartition::AddNewFastWriteBlob
2025-11-03T16:56:56.484355Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:56.484456Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188562 (NKikimr::TEvPQ::TEvTxBatchComplete), Tablet [2:7568544108397207262:2383], Partition 0, Sender [2:7568544108397207303:2383], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:56.484486Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188562, Sender [2:7568544108397207303:2383], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvTxBatchComplete
2025-11-03T16:56:56.484512Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:56.484530Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:56.484542Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:56.484555Z node 2 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:56:56.484566Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-03T16:56:56.484642Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 0 partNo 0 count 1 size 176
2025-11-03T16:56:56.484776Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 270794752, Sender [2:7568544108397207286:2383], Recipient [2:7568544108397207262:2383]: NKikimrClient.TKeyValueRequest Cookie: 1 CmdDeleteRange { Range { From: "x0000000000" IncludeFrom: true To: "x0000000001" IncludeTo: false } } CmdWrite { Key: "m0000000000p\000test-message-group-id1" Value: "\010\001\020\000\030\243\232\350\322\271\326\220\003 \243\232\350\322\271\326\220\003(\000H\001" StorageChannel: INLINE } CmdWrite { Key: "d0000000000_00000000000000000000_00000_0000000001_00000?" Value: "\022\000\010\000\020\000\030\001 \000(\234\0010\234\0018\000@\000\234\000\000\000\001\000\000\000\000\000\000\000\016t}\246J\232\001\000\0008}\246J\232\001\000\000\007\000\000\000\027\000\000test-message-group-id1\010\001\030\270\372\231\325\2443B\020ipv6:[::1]:55012P\001\342\007$\n\020ipv6:[::1]:55012\032\007unknown\"\007unknown\372\007\033\037\213\010\000\000\000\000\000\000\003\313M-.NLO\005\000\1770\275\266\007\000\000\000" StorageChannel: INLINE } CmdWrite { Key: "i0000000000" Value: "\030\000(\364\372\231\325\2443" StorageChannel: INLINE }
2025-11-03T16:56:56.484923Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 270794753, Sender [2:7568544194296554101:2383], Recipient [2:7568544108397207262:2383]: NKikimr::TEvKeyValue::TEvIntermediate
2025-11-03T16:56:56.487577Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 0 count 1 size 176 actorID [2:7568544108397207286:2383]
2025-11-03T16:56:56.487691Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 270795264 (NKikimr::TEvKeyValue::TEvResponse), Tablet [2:7568544108397207262:2383], Partition 0, Sender [2:7568544108397207286:2383], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:56.487695Z node 2 :PERSQUEUE TRACE: pq_l2_cache.h:116: StateFunc, received event# 271450112, Sender [2:7568544108397207286:2383], Recipient [2:7568544048267664305:2071]: NKikimr::NPQ::TEvPqCache::TEvCacheL2Request
2025-11-03T16:56:56.487717Z node 2 :PERSQUEUE TRACE: pq_l2_cache.h:119: StateFunc, processing event TEvPqCache::TEvCacheL2Request
2025-11-03T16:56:56.487766Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 0 suffix '63' size 176
2025-11-03T16:56:56.487813Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 270795264, Sender [2:7568544108397207286:2383], Recipient [2:7568544108397207303:2383]: NKikimrClient.TResponse Status: 1 DeleteRangeResult { Status: 0 } WriteResult { Status: 0 StatusFlags: 1 } WriteResult { Status: 0 StatusFlags: 1 } WriteResult { Status: 0 StatusFlags: 1 }
2025-11-03T16:56:56.487833Z node 2 :PERSQUEUE TRACE: partition.h:625: StateIdle, processing event TEvKeyValue::TEvResponse
2025-11-03T16:56:56.487849Z node 2 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-03T16:56:56.487872Z node 2 :PERSQUEUE TRACE: partition_write.cpp:518: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse.
2025-11-03T16:56:56.487903Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 121 WriteNewSizeFromSupportivePartitions# 0
2025-11-03T16:56:56.487926Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=1
2025-11-03T16:56:56.487953Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:56:56.488005Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0test-message-group-id1', Topic: 'rt3.dc2--test-topic', Partition: 0, SeqNo: 1, partNo: 0, Offset: 0 is stored on disk
2025-11-03T16:56:56.488019Z node 2 :PERSQUEUE TRACE: partition_write.cpp:424: [72075186224037892][Partition][0][StateIdle] TPartition::SyncMemoryStateWithKVState.
2025-11-03T16:56:56.488165Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:923: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc2--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-11-03T16:56:56.488182Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:965: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc2--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-11-03T16:56:56.488202Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:56.488214Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:56.488226Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:56.488240Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:56.488271Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:56.488282Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:56.488297Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:56.488313Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:56:56.488378Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271188502, Sender [2:7568544108397207286:2383], Recipient [2:7568544108397207262:2383]: NKikimr::TEvPQ::TEvTabletCacheCounters
2025-11-03T16:56:56.488407Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5328: HandleHook, processing event TEvPQ::TEvTabletCacheCounters
2025-11-03T16:56:56.488430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1186: [PQ: 72075186224037892] Topic 'rt3.dc2--test-topic' counters. CacheSize 176 CachedBlobs 1
2025-11-03T16:56:56.488464Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271188493, Sender [2:7568544108397207303:2383], Recipient [2:7568544108397207262:2383]: NKikimr::TEvPQ::TEvProxyResponse
2025-11-03T16:56:56.488477Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5335: HandleHook, processing event TEvPQ::TEvProxyResponse
2025-11-03T16:56:56.488499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc2--test-topic' partition: 0 messageNo: 1  requestId: <none> cookie: 1
2025-11-03T16:56:56.488566Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188481 (NKikimr::TEvPQ::TEvRead), Tablet [2:7568544108397207262:2383], Partition 0, Sender [2:7568544108397207303:2383], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:56.488597Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188481, Sender [2:7568544108397207303:2383], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvRead
2025-11-03T16:56:56.488610Z node 2 :PERSQUEUE TRACE: partition.h:629: StateIdle, processing event TEvPQ::TEvRead
2025-11-03T16:56:56.488690Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188542 (NKikimr::NPQ::NReadQuoterEvents::TEvQuotaUpdated), Tablet [2:7568544108397207262:2383], Partition 0, Sender [2:7568544108397207306:2383], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:56.488722Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188542, Sender [2:7568544108397207306:2383], Recipient [2:7568544108397207303:2383]: NKikimr::NPQ::NReadQuoterEvents::TEvQuotaUpdated
2025-11-03T16:56:56.488736Z node 2 :PERSQUEUE TRACE: partition.h:669: StateIdle, processing event NReadQuoterEvents::TEvQuotaUpdated
2025-11-03T16:56:56.488775Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188539 (NKikimr::TEvPQ::TEvApproveReadQuota), Tablet [2:7568544108397207262:2383], Partition 0, Sender [2:7568544108397207306:2383], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:56.488802Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188539, Sender [2:7568544108397207306:2383], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvApproveReadQuota
2025-11-03T16:56:56.488814Z node 2 :PERSQUEUE TRACE: partition.h:630: StateIdle, processing event TEvPQ::TEvApproveReadQuota
2025-11-03T16:56:56.488838Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:880: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc2--test-topic' partition 0 user user offset 0 partno 0 count 1 size 1024000 endOffset 1 max time lag 0ms effective offset 0
2025-11-03T16:56:56.489000Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1105: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 176 count 1 last offset 0, current partition end offset: 1
2025-11-03T16:56:56.489023Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1121: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-11-03T16:56:56.489064Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 0 partno 0 count 1 parts_count 0 source 1 size 176 accessed 0 times before, last time 2025-11-03T16:56:56.000000Z
2025-11-03T16:56:56.489097Z node 2 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 3. All 1 blobs are from cache.
2025-11-03T16:56:56.489139Z node 2 :PERSQUEUE TRACE: pq_l2_cache.h:116: StateFunc, received event# 271450112, Sender [2:7568544108397207286:2383], Recipient [2:7568544048267664305:2071]: NKikimr::NPQ::TEvPqCache::TEvCacheL2Request
2025-11-03T16:56:56.489150Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188496 (NKikimr::TEvPQ::TEvBlobResponse), Tablet [2:7568544108397207262:2383], Partition 0, Sender [2:7568544108397207286:2383], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:56.489158Z node 2 :PERSQUEUE TRACE: pq_l2_cache.h:119: StateFunc, processing event TEvPqCache::TEvCacheL2Request
2025-11-03T16:56:56.489180Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188496, Sender [2:7568544108397207286:2383], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvBlobResponse
2025-11-03T16:56:56.489189Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 0 suffix '63'
2025-11-03T16:56:56.489193Z node 2 :PERSQUEUE TRACE: partition.h:627: StateIdle, processing event TEvPQ::TEvBlobResponse
2025-11-03T16:56:56.489213Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:572: FormAnswer for 1 blobs
2025-11-03T16:56:56.489311Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 0 totakecount 1 count 1 size 156 from pos 0 cbcount 1
2025-11-03T16:56:56.489379Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188493 (NKikimr::TEvPQ::TEvProxyResponse), Tablet [2:7568544108397207262:2383], Partition 0, Sender [2:7568544108397207303:2383], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:56.489406Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188493, Sender [2:7568544108397207303:2383], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvProxyResponse
2025-11-03T16:56:56.489421Z node 2 :PERSQUEUE TRACE: partition.h:646: StateIdle, processing event TEvPQ::TEvProxyResponse
2025-11-03T16:56:56.489436Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1015: Topic 'rt3.dc2--test-topic' partition 0 user user readTimeStamp done, result 1762189016436 queuesize 0 startOffset 0
2025-11-03T16:56:56.489310Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:56:56.490086Z :DEBUG: [/Root] MessageGroupId [test-message-group-id1] SessionId [test-message-group-id1|f3af300a-53329ef6-b5d9f61a-1e4014ed_0] Write session got write response: sequence_numbers: 1 offsets: 0 already_written: false write_statistics { persist_duration_ms: 4 queued_in_partition_duration_ms: 47 }
2025-11-03T16:56:56.490149Z :DEBUG: [/Root] MessageGroupId [test-message-group-id1] SessionId [test-message-group-id1|f3af300a-53329ef6-b5d9f61a-1e4014ed_0] Write session: acknoledged message 1
2025-11-03T16:56:56.496067Z :TWriteSession_SeqNoShift INFO: Enqueue message with sequence number 1
2025-11-03T16:56:56.496209Z :DEBUG: [/Root] MessageGroupId [test-message-group-id2] SessionId [test-message-group-id2|6c37dca8-a3d62436-12bc1555-8864442b_0] Write 1 messages with Id from 1 to 1
2025-11-03T16:56:56.496319Z :TWriteSession_SeqNoShift INFO: Wait for writer event
2025-11-03T16:56:56.496358Z :TWriteSession_SeqNoShift INFO: Got new continue token
2025-11-03T16:56:56.497302Z :DEBUG: [/Root] MessageGroupId [test-message-group-id2] SessionId [test-message-group-id2|6c37dca8-a3d62436-12bc1555-8864442b_0] Write session: try to update token
2025-11-03T16:56:56.497368Z :DEBUG: [/Root] MessageGroupId [test-message-group-id2] SessionId [test-message-group-id2|6c37dca8-a3d62436-12bc1555-8864442b_0] Send 1 message(s) (0 left), first sequence number is 1
2025-11-03T16:56:56.497999Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 5 sessionId: test-message-group-id2|6c37dca8-a3d62436-12bc1555-8864442b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:56:56.498283Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:56:56.498778Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271187968, Sender [1:7568544195151691649:2648], Recipient [2:7568544194296554100:2858]
2025-11-03T16:56:56.498810Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5316: HandleHook, processing event TEvPersQueue::TEvRequest
2025-11-03T16:56:56.498861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc2--test-topic' requestId: <none>
2025-11-03T16:56:56.498922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc2--test-topic' partition 0
2025-11-03T16:56:56.498991Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188507 (NKikimr::TEvPQ::TEvReserveBytes), Tablet [2:7568544108397207262:2383], Partition 0, Sender [2:7568544108397207262:2383], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:56.499020Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188507, Sender [2:7568544108397207262:2383], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvReserveBytes
2025-11-03T16:56:56.499032Z node 2 :PERSQUEUE TRACE: partition.h:650: StateIdle, processing event TEvPQ::TEvReserveBytes
2025-11-03T16:56:56.499043Z node 2 :PERSQUEUE TRACE: partition_write.cpp:220: [72075186224037892][Partition][0][StateIdle] TPartition::HandleOnWrite TEvReserveBytes.
2025-11-03T16:56:56.499067Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:56.499120Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271188493, Sender [2:7568544108397207303:2383], Recipient [2:7568544108397207262:2383]: NKikimr::TEvPQ::TEvProxyResponse
2025-11-03T16:56:56.499136Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5335: HandleHook, processing event TEvPQ::TEvProxyResponse
2025-11-03T16:56:56.499147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc2--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-11-03T16:56:56.499596Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:56:56.499939Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271187968, Sender [1:7568544195151691649:2648], Recipient [2:7568544194296554100:2858]
2025-11-03T16:56:56.499961Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5316: HandleHook, processing event TEvPersQueue::TEvRequest
2025-11-03T16:56:56.500026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc2--test-topic' requestId: <none>
2025-11-03T16:56:56.500044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc2--test-topic' partition 0
2025-11-03T16:56:56.500096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc2--test-topic partition: 0 SourceId: '\0test-message-group-id2' SeqNo: 1 partNo : 0 messageNo: 1 size 98 offset: -1
2025-11-03T16:56:56.500162Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188480 (NKikimr::TEvPQ::TEvWrite), Tablet [2:7568544108397207262:2383], Partition 0, Sender [2:7568544108397207262:2383], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:56.500197Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188480, Sender [2:7568544108397207262:2383], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvWrite
2025-11-03T16:56:56.500217Z node 2 :PERSQUEUE TRACE: partition.h:628: StateIdle, processing event TEvPQ::TEvWrite
2025-11-03T16:56:56.500229Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:56:56.500272Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:56.500301Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:56.500311Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-03T16:56:56.500379Z node 2 :PERSQUEUE TRACE: partition_write.cpp:1168: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc2--test-topic' partition 0 process write for '\0test-message-group-id2' DisableDeduplication=0 SeqNo=1 LocalSeqNo=(NULL) InitialSeqNo=0 EnableKafkaDeduplication=0 ProducerEpoch=(empty maybe)
2025-11-03T16:56:56.500447Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc2--test-topic' partition 0 part blob processing sourceId '\0test-message-group-id2' seqNo 1 partNo 0
2025-11-03T16:56:56.501363Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc2--test-topic' partition 0 part blob complete sourceId '\0test-message-group-id2' seqNo 1 partNo 0 FormedBlobsCount 0 NewHead: Offset 1 PartNo 0 PackedSize 188 count 1 nextOffset 2 batches 1
2025-11-03T16:56:56.501407Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:56.501425Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 1 items to delete old stuff
2025-11-03T16:56:56.501525Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 1 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest CmdDeleteRange { Range { From: "x0000000000" IncludeFrom: true To: "x0000000001" IncludeTo: false } }
2025-11-03T16:56:56.501544Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:56.504117Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc2--test-topic' partition 0 compactOffset 1,1 HeadOffset 1 endOffset 1 curOffset 2 d0000000000_00000000000000000001_00000_0000000001_00000? size 176 WTime 1762189016504
2025-11-03T16:56:56.504144Z node 2 :PERSQUEUE TRACE: partition_write.cpp:1459: [72075186224037892][Partition][0][StateIdle] TPartition::AddNewFastWriteBlob
2025-11-03T16:56:56.504225Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:56.504333Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188562 (NKikimr::TEvPQ::TEvTxBatchComplete), Tablet [2:7568544108397207262:2383], Partition 0, Sender [2:7568544108397207303:2383], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:56.504372Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188562, Sender [2:7568544108397207303:2383], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvTxBatchComplete
2025-11-03T16:56:56.504393Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-03T16:56:56.504484Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 1 partNo 0 count 1 size 176
2025-11-03T16:56:56.504698Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 270794752, Sender [2:7568544108397207286:2383], Recipient [2:7568544108397207262:2383]: NKikimrClient.TKeyValueRequest Cookie: 2 CmdDeleteRange { Range { From: "x0000000000" IncludeFrom: true To: "x0000000001" IncludeTo: false } } CmdWrite { Key: "m0000000000p\000test-message-group-id2" Value: "\010\001\020\001\030\225\216\354\322\271\326\220\003 \225\216\354\322\271\326\220\003(\000H\001" StorageChannel: INLINE } CmdWrite { Key: "d0000000000_00000000000000000001_00000_0000000001_00000?" Value: "\022\000\010\001\020\000\030\001 \000(\234\0010\234\0018\000@\000\234\000\000\000\001\000\000\000\000\000\000\000\016\263}\246J\232\001\000\000\260}\246J\232\001\000\000\007\000\000\000\027\000\000test-message-group-id2\010\001\030\260\373\231\325\2443B\020ipv6:[::1]:55012P\001\342\007$\n\020ipv6:[::1]:55012\032\007unknown\"\007unknown\372\007\033\037\213\010\000\000\000\000\000\000\003\313M-.NLO\005\000\1770\275\266\007\000\000\000" StorageChannel: INLINE } CmdWrite { Key: "i0000000000" Value: "\030\000(\263\373\231\325\2443" StorageChannel: INLINE }
2025-11-03T16:56:56.504874Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 270794753, Sender [2:7568544194296554104:2383], Recipient [2:7568544108397207262:2383]: NKikimr::TEvKeyValue::TEvIntermediate
2025-11-03T16:56:56.508860Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 1 count 1 size 176 actorID [2:7568544108397207286:2383]
2025-11-03T16:56:56.508936Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 270795264 (NKikimr::TEvKeyValue::TEvResponse), Tablet [2:7568544108397207262:2383], Partition 0, Sender [2:7568544108397207286:2383], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:56.509033Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 270795264, Sender [2:7568544108397207286:2383], Recipient [2:7568544108397207303:2383]: NKikimrClient.TResponse Status: 1 DeleteRangeResult { Status: 0 } WriteResult { Status: 0 StatusFlags: 1 } WriteResult { Status: 0 StatusFlags: 1 } WriteResult { Status: 0 StatusFlags: 1 }
2025-11-03T16:56:56.509048Z node 2 :PERSQUEUE TRACE: partition.h:625: StateIdle, processing event TEvKeyValue::TEvResponse
2025-11-03T16:56:56.509059Z node 2 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-03T16:56:56.509076Z node 2 :PERSQUEUE TRACE: partition_write.cpp:518: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse.
2025-11-03T16:56:56.509103Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 121 WriteNewSizeFromSupportivePartitions# 0
2025-11-03T16:56:56.509113Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=1
2025-11-03T16:56:56.509134Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:56:56.509156Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0test-message-group-id2', Topic: 'rt3.dc2--test-topic', Partition: 0, SeqNo: 1, partNo: 0, Offset: 1 is stored on disk
2025-11-03T16:56:56.509166Z node 2 :PERSQUEUE TRACE: partition_write.cpp:424: [72075186224037892][Partition][0][StateIdle] TPartition::SyncMemoryStateWithKVState.
2025-11-03T16:56:56.509279Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:56.509293Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:56.509301Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:56.509315Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:56.509340Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:56.509348Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:56.509360Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:56.509371Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:56:56.509422Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271188493, Sender [2:7568544108397207303:2383], Recipient [2:7568544108397207262:2383]: NKikimr::TEvPQ::TEvProxyResponse
2025-11-03T16:56:56.509439Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5335: HandleHook, processing event TEvPQ::TEvProxyResponse
2025-11-03T16:56:56.509448Z node 2 :PERSQUEUE TRACE: pq_l2_cache.h:116: StateFunc, received event# 271450112, Sender [2:7568544108397207286:2383], Recipient [2:7568544048267664305:2071]: NKikimr::NPQ::TEvPqCache::TEvCacheL2Request
2025-11-03T16:56:56.509471Z node 2 :PERSQUEUE TRACE: pq_l2_cache.h:119: StateFunc, processing event TEvPqCache::TEvCacheL2Request
2025-11-03T16:56:56.509473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc2--test-topic' partition: 0 messageNo: 1  requestId: <none> cookie: 1
2025-11-03T16:56:56.509533Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 1 partno 0 count 1 parts 0 suffix '63' size 176
2025-11-03T16:56:56.509742Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:56:56.510715Z :DEBUG: [/Root] MessageGroupId [test-message-group-id2] SessionId [test-message-group-id2|6c37dca8-a3d62436-12bc1555-8864442b_0] Write session got write response: sequence_numbers: 1 offsets: 1 already_written: false write_statistics { persist_duration_ms: 7 queued_in_partition_duration_ms: 1 }
2025-11-03T16:56:56.510771Z :DEBUG: [/Root] MessageGroupId [test-message-group-id2] SessionId [test-message-group-id2|6c37dca8-a3d62436-12bc1555-8864442b_0] Write session: acknoledged message 1
===Messages were written
====ExpectBreakDown
====ExpectBreakDown
===Disable dc2
===Update clusters: UPDATE `/Root/PQ/Config/V2/Cluster` SET enabled = false where name = "dc2";
2025-11-03T16:56:56.514284Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [4:7568544170866189024:2388], Partition 0, Sender [0:0:0], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:56:56.514345Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:56.514367Z node 4 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:56.514398Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:56.514411Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:56.514424Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:56.514444Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:56.514495Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:56.514508Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:56.514530Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:56.588121Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:56.588174Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:56.588191Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:56.588216Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:56.588228Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:56.588236Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:56.588253Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:56.588300Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:56.588310Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:56.588324Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:56.617608Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [4:7568544170866189024:2388], Partition 0, Sender [0:0:0], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:56:56.617673Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:56.617697Z node 4 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:56.617724Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:56.617738Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:56.617751Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:56.617772Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:56.617825Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:56.617836Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:56.617855Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:56.688691Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:56.689071Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:56.689098Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:56.689142Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:56.689158Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:56.689170Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:56.689192Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:56.689347Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:56.689362Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:56.689383Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:56.720150Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [4:7568544170866189024:2388], Partition 0, Sender [0:0:0], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:56:56.720231Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:56.720255Z node 4 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:56.720287Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:56.720303Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:56.720315Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:56.720338Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:56.720406Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:56.720418Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:56.720439Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:56.789446Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:56.789512Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:56.789535Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:56.789580Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:56.789594Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:56.789608Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:56.789632Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:56.789700Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:56.789712Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:56.789734Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:56.819644Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [4:7568544170866189024:2388], Partition 0, Sender [0:0:0], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:56:56.819708Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:56.819730Z node 4 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:56.819766Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:56.819781Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:56.819795Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:56.819815Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:56.819872Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:56.819897Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:56.819919Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:56.890046Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:56.890120Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:56.890144Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:56.890177Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:56.890191Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:56.890204Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:56.890227Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:56.890286Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:56.890303Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:56.890325Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:56.894201Z node 3 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976720685. Ctx: { TraceId: 01k95aczfe61jz7d4nmgfpfjh2, Database: , SessionId: ydb://session/3?node_id=3&id=ZWQxZWVjZTEtMWZlMjM5ZTItZjAxZWQ2NS1lZWIzZTUwMQ==, PoolId: default, DatabaseId: /Root}. Database not set, use /Root
2025-11-03T16:56:56.924632Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [4:7568544170866189024:2388], Partition 0, Sender [0:0:0], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:56:56.924694Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:56.924717Z node 4 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:56.924744Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:56.924760Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:56.924773Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:56.924795Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:56.924851Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:56.924864Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:56.924883Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
===Wait for retries after initial dc2 shutdown
2025-11-03T16:56:56.990693Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:56.990765Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:56.990790Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:56.990823Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:56.990839Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:56.990852Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:56.990875Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:56.990944Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:56.990959Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:56.990980Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:57.024506Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [4:7568544170866189024:2388], Partition 0, Sender [0:0:0], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:56:57.024573Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:57.024599Z node 4 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:57.024626Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:57.024649Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:57.024662Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:57.024684Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:57.024752Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:57.024785Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:57.024807Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:57.096067Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:57.096146Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:57.096169Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:57.096198Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:57.096212Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:57.096223Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:57.096245Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:57.096300Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:57.096321Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:57.096342Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:57.126843Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [4:7568544170866189024:2388], Partition 0, Sender [0:0:0], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:56:57.126921Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:57.126945Z node 4 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:57.126969Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:57.126981Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:57.126993Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:57.127011Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:57.127062Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:57.127074Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:57.127093Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:57.200101Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:57.200164Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:57.200183Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:57.200209Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:57.200222Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:57.200236Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:57.200257Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:57.200315Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:57.200329Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:57.200347Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:57.227205Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [4:7568544170866189024:2388], Partition 0, Sender [0:0:0], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:56:57.227266Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:57.227288Z node 4 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:57.227313Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:57.227325Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:57.227337Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:57.227358Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:57.227410Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:57.227423Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:57.227442Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:57.303371Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:57.303440Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:57.303462Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:57.303492Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:57.303507Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:57.303522Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:57.303544Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:57.303619Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:57.303631Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:57.303661Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:57.312613Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188544 (NKikimr::NPQ::NReadQuoterEvents::TEvQuotaCountersUpdated), Tablet [4:7568544170866189024:2388], Partition 0, Sender [4:7568544170866189068:2388], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:56:57.312680Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188544, Sender [4:7568544170866189068:2388], Recipient [4:7568544170866189065:2388]: NKikimr::NPQ::NReadQuoterEvents::TEvQuotaCountersUpdated
2025-11-03T16:56:57.312704Z node 4 :PERSQUEUE TRACE: partition.h:671: StateIdle, processing event NReadQuoterEvents::TEvQuotaCountersUpdated
2025-11-03T16:56:57.323732Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188544 (NKikimr::NPQ::NReadQuoterEvents::TEvQuotaCountersUpdated), Tablet [2:7568544108397207262:2383], Partition 0, Sender [2:7568544108397207306:2383], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:57.323816Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188544, Sender [2:7568544108397207306:2383], Recipient [2:7568544108397207303:2383]: NKikimr::NPQ::NReadQuoterEvents::TEvQuotaCountersUpdated
2025-11-03T16:56:57.323842Z node 2 :PERSQUEUE TRACE: partition.h:671: StateIdle, processing event NReadQuoterEvents::TEvQuotaCountersUpdated
2025-11-03T16:56:57.327522Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [4:7568544170866189024:2388], Partition 0, Sender [0:0:0], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:56:57.327585Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:57.327612Z node 4 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:57.327644Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:57.327666Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:57.327678Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:57.327701Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:57.327767Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:57.327781Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:57.327803Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:57.403838Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:57.403902Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:57.403926Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:57.403956Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:57.403970Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:57.403996Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:57.404016Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:57.404075Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:57.404087Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:57.404106Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:57.427923Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [4:7568544170866189024:2388], Partition 0, Sender [0:0:0], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:56:57.428021Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:57.428046Z node 4 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:57.428076Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:57.428091Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:57.428105Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:57.428127Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:57.428186Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:57.428200Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:57.428221Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:57.431477Z node 1 :PQ_PARTITION_CHOOSER TRACE: partition_chooser_impl__abstract_chooser_actor.h:278: StateIdle, received event# 278396931, Sender [1:7568544195151691589:2647], Recipient [1:7568544195151691593:2647]: NKikimr::NPQ::TEvPartitionChooser::TEvRefreshRequest
2025-11-03T16:56:57.431514Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7568544195151691593:2647] (SourceId=test-message-group-id1, PreferedPartition=(NULL)) Update the table
2025-11-03T16:56:57.431823Z node 1 :PQ_PARTITION_CHOOSER TRACE: partition_chooser_impl__abstract_chooser_actor.h:278: StateIdle, received event# 278396931, Sender [1:7568544195151691590:2648], Recipient [1:7568544195151691594:2648]: NKikimr::NPQ::TEvPartitionChooser::TEvRefreshRequest
2025-11-03T16:56:57.431836Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7568544195151691594:2648] (SourceId=test-message-group-id2, PreferedPartition=(NULL)) Update the table
2025-11-03T16:56:57.457264Z node 1 :PQ_PARTITION_CHOOSER TRACE: partition_chooser_impl__abstract_chooser_actor.h:212: StateUpdate, received event# 271646721, Sender [1:7568544053417768053:2268], Recipient [1:7568544195151691593:2647]: NKikimrKqp.TEvQueryResponse Response { PreparedQuery: "8f4644d2-9efda7ea-94da0694-a038dd4d" QueryIssues { position { row: 2 column: 115 } message: "Symbol $CreateTime is not used" end_position { row: 2 column: 115 } issue_code: 4527 severity: 2 } QueryParameters { Name: "$Hash" Type { Kind: Data Data { Scheme: 2 } } } QueryParameters { Name: "$Topic" Type { Kind: Data Data { Scheme: 4608 } } } QueryParameters { Name: "$SourceId" Type { Kind: Data Data { Scheme: 4608 } } } QueryParameters { Name: "$Partition" Type { Kind: Data Data { Scheme: 2 } } } QueryParameters { Name: "$AccessTime" Type { Kind: Data Data { Scheme: 4 } } } TxMeta { } QueryDiagnostics: "" } YdbStatus: SUCCESS ConsumedRu: 2
2025-11-03T16:56:57.457326Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7568544195151691593:2647] (SourceId=test-message-group-id1, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=1 Status=SUCCESS
2025-11-03T16:56:57.457342Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7568544195151691593:2647] (SourceId=test-message-group-id1, PreferedPartition=(NULL)) Start idle
2025-11-03T16:56:57.458014Z node 1 :PQ_PARTITION_CHOOSER TRACE: partition_chooser_impl__abstract_chooser_actor.h:212: StateUpdate, received event# 271646721, Sender [1:7568544053417768053:2268], Recipient [1:7568544195151691594:2648]: NKikimrKqp.TEvQueryResponse Response { PreparedQuery: "8f4644d2-9efda7ea-94da0694-a038dd4d" QueryIssues { position { row: 2 column: 115 } message: "Symbol $CreateTime is not used" end_position { row: 2 column: 115 } issue_code: 4527 severity: 2 } QueryParameters { Name: "$Hash" Type { Kind: Data Data { Scheme: 2 } } } QueryParameters { Name: "$Topic" Type { Kind: Data Data { Scheme: 4608 } } } QueryParameters { Name: "$SourceId" Type { Kind: Data Data { Scheme: 4608 } } } QueryParameters { Name: "$Partition" Type { Kind: Data Data { Scheme: 2 } } } QueryParameters { Name: "$AccessTime" Type { Kind: Data Data { Scheme: 4 } } } TxMeta { } QueryDiagnostics: "" } YdbStatus: SUCCESS ConsumedRu: 1
2025-11-03T16:56:57.458035Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7568544195151691594:2648] (SourceId=test-message-group-id2, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=1 Status=SUCCESS
2025-11-03T16:56:57.458045Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7568544195151691594:2648] (SourceId=test-message-group-id2, PreferedPartition=(NULL)) Start idle
2025-11-03T16:56:57.508145Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:57.508215Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:57.508241Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:57.508273Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:57.508289Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:57.508302Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:57.508328Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:57.508388Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:57.508399Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:57.508422Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:57.528441Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [4:7568544170866189024:2388], Partition 0, Sender [0:0:0], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:56:57.528545Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:57.528569Z node 4 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:57.528596Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:57.528611Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:57.528622Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:57.528641Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:57.528693Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:57.528705Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:57.528737Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:57.609534Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:57.609610Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:57.609638Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:57.609671Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:57.609687Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:57.609700Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:57.609726Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:57.609790Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:57.609822Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:57.609846Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:57.632130Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [4:7568544170866189024:2388], Partition 0, Sender [0:0:0], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:56:57.632199Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:57.632224Z node 4 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:57.632257Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:57.632271Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:57.632283Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:57.632303Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:57.632363Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:57.632377Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:57.632398Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:57.712836Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:57.712889Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:57.712907Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:57.712930Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:57.712941Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:57.712948Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:57.712967Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:57.713032Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:57.713044Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:57.713065Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:57.732526Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [4:7568544170866189024:2388], Partition 0, Sender [0:0:0], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:56:57.732584Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:57.732606Z node 4 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:57.732639Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:57.732656Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:57.732668Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:57.732699Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:57.732812Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:57.732827Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:57.732847Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:57.773084Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 4 reason: Session preferred cluster "dc1" is enabled for at least 1.000000s and session is older than 1.000000s sessionId: test-message-group-id1|f3af300a-53329ef6-b5d9f61a-1e4014ed_0
====CreateRetryState
====CreateRetryState Initialized
Test retry state: get retry delay
2025-11-03T16:56:57.773881Z :INFO: [/Root] MessageGroupId [test-message-group-id1] SessionId [test-message-group-id1|f3af300a-53329ef6-b5d9f61a-1e4014ed_0] Got error. Status: ABORTED, Description: <main>: Error: Session preferred cluster "dc1" is enabled for at least 1.000000s and session is older than 1.000000s, code: 500026 
2025-11-03T16:56:57.773907Z :INFO: [/Root] MessageGroupId [test-message-group-id1] SessionId [test-message-group-id1|f3af300a-53329ef6-b5d9f61a-1e4014ed_0] Write session will restart in 2.000000s
2025-11-03T16:56:57.773947Z :INFO: [/Root] MessageGroupId [test-message-group-id1] SessionId [test-message-group-id1|f3af300a-53329ef6-b5d9f61a-1e4014ed_0] Write session: Do CDS request
2025-11-03T16:56:57.773971Z :INFO: [/Root] MessageGroupId [test-message-group-id1] SessionId [test-message-group-id1|f3af300a-53329ef6-b5d9f61a-1e4014ed_0] Do schedule cds request after 2000 ms
2025-11-03T16:56:57.773441Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 4 sessionId: test-message-group-id1|f3af300a-53329ef6-b5d9f61a-1e4014ed_0 is DEAD
2025-11-03T16:56:57.773505Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 5 reason: Session preferred cluster "dc1" is enabled for at least 1.000000s and session is older than 1.000000s sessionId: test-message-group-id2|6c37dca8-a3d62436-12bc1555-8864442b_0
2025-11-03T16:56:57.773668Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 5 sessionId: test-message-group-id2|6c37dca8-a3d62436-12bc1555-8864442b_0 is DEAD
2025-11-03T16:56:57.773701Z node 1 :PQ_PARTITION_CHOOSER TRACE: partition_chooser_impl__abstract_chooser_actor.h:278: StateIdle, received event# 65543, Sender [1:7568544195151691589:2647], Recipient [1:7568544195151691593:2647]: NActors::TEvents::TEvPoison
2025-11-03T16:56:57.773742Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-11-03T16:56:57.773855Z node 1 :PQ_PARTITION_CHOOSER TRACE: partition_chooser_impl__abstract_chooser_actor.h:278: StateIdle, received event# 65543, Sender [1:7568544195151691590:2648], Recipient [1:7568544195151691594:2648]: NActors::TEvents::TEvPoison
2025-11-03T16:56:57.773892Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-11-03T16:56:57.774175Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 269877764, Sender [2:7568544194296554099:2857], Recipient [2:7568544108397207262:2383]: NKikimr::TEvTabletPipe::TEvServerDisconnected
2025-11-03T16:56:57.774209Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5331: HandleHook, processing event TEvTabletPipe::TEvServerDisconnected
2025-11-03T16:56:57.774224Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:2729: [PQ: 72075186224037892] Handle TEvTabletPipe::TEvServerDisconnected
2025-11-03T16:56:57.774252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [1:7568544195151691647:2647] destroyed
2025-11-03T16:56:57.774285Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 269877764, Sender [2:7568544194296554100:2858], Recipient [2:7568544108397207262:2383]: NKikimr::TEvTabletPipe::TEvServerDisconnected
2025-11-03T16:56:57.774298Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5331: HandleHook, processing event TEvTabletPipe::TEvServerDisconnected
2025-11-03T16:56:57.774307Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:2729: [PQ: 72075186224037892] Handle TEvTabletPipe::TEvServerDisconnected
2025-11-03T16:56:57.774322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [1:7568544195151691650:2648] destroyed
2025-11-03T16:56:57.774375Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188506 (NKikimr::TEvPQ::TEvPipeDisconnected), Tablet [2:7568544108397207262:2383], Partition 0, Sender [2:7568544108397207262:2383], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:57.774407Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188506, Sender [2:7568544108397207262:2383], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvPipeDisconnected
2025-11-03T16:56:57.774426Z node 2 :PERSQUEUE TRACE: partition.h:651: StateIdle, processing event TEvPQ::TEvPipeDisconnected
2025-11-03T16:56:57.774445Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-11-03T16:56:57.774466Z node 2 :PERSQUEUE TRACE: partition_write.cpp:873: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessChangeOwnerRequests.
2025-11-03T16:56:57.774484Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:57.774497Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:57.774508Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:57.774525Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:57.774580Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:57.774591Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:57.774613Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:57.774666Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188506 (NKikimr::TEvPQ::TEvPipeDisconnected), Tablet [2:7568544108397207262:2383], Partition 0, Sender [2:7568544108397207262:2383], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:57.774703Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188506, Sender [2:7568544108397207262:2383], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvPipeDisconnected
2025-11-03T16:56:57.774718Z node 2 :PERSQUEUE TRACE: partition.h:651: StateIdle, processing event TEvPQ::TEvPipeDisconnected
2025-11-03T16:56:57.774730Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-11-03T16:56:57.774745Z node 2 :PERSQUEUE TRACE: partition_write.cpp:873: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessChangeOwnerRequests.
2025-11-03T16:56:57.774757Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:57.774767Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:57.774775Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:57.774787Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:57.774813Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:57.774821Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:57.774832Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
====CreateRetryState
====CreateRetryState Initialized
Test retry state: get retry delay
2025-11-03T16:56:57.776526Z :INFO: [/Root] MessageGroupId [test-message-group-id2] SessionId [test-message-group-id2|6c37dca8-a3d62436-12bc1555-8864442b_0] Got error. Status: ABORTED, Description: <main>: Error: Session preferred cluster "dc1" is enabled for at least 1.000000s and session is older than 1.000000s, code: 500026 
2025-11-03T16:56:57.776562Z :INFO: [/Root] MessageGroupId [test-message-group-id2] SessionId [test-message-group-id2|6c37dca8-a3d62436-12bc1555-8864442b_0] Write session will restart in 2.000000s
2025-11-03T16:56:57.776628Z :INFO: [/Root] MessageGroupId [test-message-group-id2] SessionId [test-message-group-id2|6c37dca8-a3d62436-12bc1555-8864442b_0] Write session: Do CDS request
2025-11-03T16:56:57.776665Z :INFO: [/Root] MessageGroupId [test-message-group-id2] SessionId [test-message-group-id2|6c37dca8-a3d62436-12bc1555-8864442b_0] Do schedule cds request after 2000 ms
===Write four async message into every writer
2025-11-03T16:56:57.776799Z :TWriteSession_SeqNoShift INFO: Enqueue message with sequence number 2
2025-11-03T16:56:57.776870Z :TWriteSession_SeqNoShift INFO: Enqueue message with sequence number 2
2025-11-03T16:56:57.776896Z :DEBUG: [/Root] MessageGroupId [test-message-group-id1] SessionId [test-message-group-id1|f3af300a-53329ef6-b5d9f61a-1e4014ed_0] Write 1 messages with Id from 2 to 2
2025-11-03T16:56:57.776931Z :TWriteSession_SeqNoShift INFO: Enqueue message with sequence number 3
2025-11-03T16:56:57.776985Z :DEBUG: [/Root] MessageGroupId [test-message-group-id2] SessionId [test-message-group-id2|6c37dca8-a3d62436-12bc1555-8864442b_0] Write 1 messages with Id from 2 to 2
2025-11-03T16:56:57.777027Z :TWriteSession_SeqNoShift INFO: Wait for writer event
2025-11-03T16:56:57.777019Z :TWriteSession_SeqNoShift INFO: Enqueue message with sequence number 3
2025-11-03T16:56:57.777103Z :TWriteSession_SeqNoShift INFO: Got new continue token
2025-11-03T16:56:57.777113Z :TWriteSession_SeqNoShift INFO: Enqueue message with sequence number 4
2025-11-03T16:56:57.777142Z :TWriteSession_SeqNoShift INFO: Wait for writer event
2025-11-03T16:56:57.777156Z :DEBUG: [/Root] MessageGroupId [test-message-group-id1] SessionId [test-message-group-id1|f3af300a-53329ef6-b5d9f61a-1e4014ed_0] Write 1 messages with Id from 3 to 3
2025-11-03T16:56:57.777175Z :TWriteSession_SeqNoShift INFO: Enqueue message with sequence number 4
2025-11-03T16:56:57.777211Z :TWriteSession_SeqNoShift INFO: Got new continue token
2025-11-03T16:56:57.777233Z :TWriteSession_SeqNoShift INFO: Wait for writer event
2025-11-03T16:56:57.777240Z :TWriteSession_SeqNoShift INFO: Enqueue message with sequence number 5
2025-11-03T16:56:57.777264Z :DEBUG: [/Root] MessageGroupId [test-message-group-id2] SessionId [test-message-group-id2|6c37dca8-a3d62436-12bc1555-8864442b_0] Write 1 messages with Id from 3 to 3
2025-11-03T16:56:57.777293Z :TWriteSession_SeqNoShift INFO: Got new continue token
2025-11-03T16:56:57.777306Z :TWriteSession_SeqNoShift INFO: Enqueue message with sequence number 5
===Enable dc2
2025-11-03T16:56:57.777330Z :DEBUG: [/Root] MessageGroupId [test-message-group-id1] SessionId [test-message-group-id1|f3af300a-53329ef6-b5d9f61a-1e4014ed_0] Write 1 messages with Id from 4 to 4
===Update clusters: UPDATE `/Root/PQ/Config/V2/Cluster` SET enabled = true where name = "dc1";
2025-11-03T16:56:57.777341Z :TWriteSession_SeqNoShift INFO: Wait for writer event
2025-11-03T16:56:57.777390Z :TWriteSession_SeqNoShift INFO: Wait for writer event
2025-11-03T16:56:57.777400Z :TWriteSession_SeqNoShift INFO: Got new continue token
2025-11-03T16:56:57.777432Z :TWriteSession_SeqNoShift INFO: Got new continue token
2025-11-03T16:56:57.777460Z :DEBUG: [/Root] MessageGroupId [test-message-group-id2] SessionId [test-message-group-id2|6c37dca8-a3d62436-12bc1555-8864442b_0] Write 1 messages with Id from 4 to 4
2025-11-03T16:56:57.777497Z :DEBUG: [/Root] MessageGroupId [test-message-group-id1] SessionId [test-message-group-id1|f3af300a-53329ef6-b5d9f61a-1e4014ed_0] Write 1 messages with Id from 5 to 5
2025-11-03T16:56:57.777525Z :TWriteSession_SeqNoShift INFO: Wait for writer event
2025-11-03T16:56:57.777566Z :TWriteSession_SeqNoShift INFO: Wait for writer event
2025-11-03T16:56:57.777566Z :TWriteSession_SeqNoShift INFO: Got new continue token
2025-11-03T16:56:57.777639Z :TWriteSession_SeqNoShift INFO: Got new continue token
2025-11-03T16:56:57.777652Z :DEBUG: [/Root] MessageGroupId [test-message-group-id2] SessionId [test-message-group-id2|6c37dca8-a3d62436-12bc1555-8864442b_0] Write 1 messages with Id from 5 to 5
2025-11-03T16:56:57.777737Z :TWriteSession_SeqNoShift INFO: Wait for writer event
2025-11-03T16:56:57.777785Z :TWriteSession_SeqNoShift INFO: Got new continue token
2025-11-03T16:56:57.814418Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:57.814477Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:57.814500Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:57.814529Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:57.814543Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:57.814555Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:57.814577Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:57.814636Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:57.814649Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:57.814672Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:57.836139Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [4:7568544170866189024:2388], Partition 0, Sender [0:0:0], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:56:57.836206Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:57.836230Z node 4 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:57.836260Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:57.836275Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:57.836287Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:57.836309Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:57.836371Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:57.836385Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:57.836406Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:57.916317Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:57.916387Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:57.916413Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:57.916445Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:57.916475Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:57.916487Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:57.916507Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:57.916564Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:57.916577Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:57.916608Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:57.936418Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [4:7568544170866189024:2388], Partition 0, Sender [0:0:0], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:56:57.936471Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:57.936497Z node 4 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:57.936517Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:57.936527Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:57.936535Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:57.936549Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:57.936600Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:57.936609Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:57.936624Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:58.019224Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:58.019294Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:58.019321Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:58.019354Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:58.019369Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:58.019385Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:58.019410Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:58.019468Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:58.019481Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:58.019501Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:58.039910Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [4:7568544170866189024:2388], Partition 0, Sender [0:0:0], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:56:58.040001Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:58.040027Z node 4 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:58.040057Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:58.040071Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:58.040087Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:58.040108Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:58.040164Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:58.040178Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:58.040233Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:58.074850Z node 3 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976720687. Ctx: { TraceId: 01k95ad0q54akvevgnsm6pwm0q, Database: , SessionId: ydb://session/3?node_id=3&id=OTkxNGZiZDQtYWM1ZjdiYzktZTU5ZDE1NWMtZDBjOWQ0Ng==, PoolId: default, DatabaseId: /Root}. Database not set, use /Root
===Wait for writes to complete
2025-11-03T16:56:58.120267Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:58.120342Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:58.120370Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:58.120398Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:58.120416Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:58.120428Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:58.120450Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:58.120505Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:58.120518Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:58.120538Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:58.140718Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [4:7568544170866189024:2388], Partition 0, Sender [0:0:0], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:56:58.140796Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:58.140824Z node 4 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:58.140856Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:58.140873Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:58.140888Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:58.140912Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:58.140980Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:58.140993Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:58.141016Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:58.219963Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:58.220052Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:58.220088Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:58.220123Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:58.220139Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:58.220164Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:58.220190Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:58.220249Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:58.220263Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:58.220301Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:58.243750Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [4:7568544170866189024:2388], Partition 0, Sender [0:0:0], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:56:58.243817Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:58.243839Z node 4 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:58.243866Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:58.243880Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:58.243893Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:58.243915Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:58.243987Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:58.244000Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:58.244020Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:58.316166Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188544 (NKikimr::NPQ::NReadQuoterEvents::TEvQuotaCountersUpdated), Tablet [4:7568544170866189024:2388], Partition 0, Sender [4:7568544170866189068:2388], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:56:58.316231Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188544, Sender [4:7568544170866189068:2388], Recipient [4:7568544170866189065:2388]: NKikimr::NPQ::NReadQuoterEvents::TEvQuotaCountersUpdated
2025-11-03T16:56:58.316255Z node 4 :PERSQUEUE TRACE: partition.h:671: StateIdle, processing event NReadQuoterEvents::TEvQuotaCountersUpdated
2025-11-03T16:56:58.320583Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:58.320670Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:58.320697Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:58.320728Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:58.320746Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:58.320761Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:58.320784Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:58.320862Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:58.320886Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:58.320911Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:58.326525Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188544 (NKikimr::NPQ::NReadQuoterEvents::TEvQuotaCountersUpdated), Tablet [2:7568544108397207262:2383], Partition 0, Sender [2:7568544108397207306:2383], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:58.326582Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188544, Sender [2:7568544108397207306:2383], Recipient [2:7568544108397207303:2383]: NKikimr::NPQ::NReadQuoterEvents::TEvQuotaCountersUpdated
2025-11-03T16:56:58.326604Z node 2 :PERSQUEUE TRACE: partition.h:671: StateIdle, processing event NReadQuoterEvents::TEvQuotaCountersUpdated
2025-11-03T16:56:58.348118Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [4:7568544170866189024:2388], Partition 0, Sender [0:0:0], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:56:58.348214Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:58.348236Z node 4 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:58.348264Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:58.348280Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:58.348291Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:58.348314Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:58.348382Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:58.348395Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:58.348414Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:58.357114Z :INFO: [/Root] MessageGroupId [test-message-group-id1] Running cds request ms
2025-11-03T16:56:58.358973Z :INFO: [/Root] MessageGroupId [test-message-group-id2] Running cds request ms
2025-11-03T16:56:58.422689Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:58.422761Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:58.422784Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:58.422814Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:58.422830Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:58.422844Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:58.422865Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:58.422937Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:58.422952Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:58.422974Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:58.452129Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [4:7568544170866189024:2388], Partition 0, Sender [0:0:0], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:56:58.452201Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:58.452225Z node 4 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:58.452253Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:58.452270Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:58.452282Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:58.452305Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:58.452364Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:58.452376Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:58.452397Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:58.523092Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:58.523157Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:58.523178Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:58.523207Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:58.523220Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:58.523231Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:58.523250Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:58.523313Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:58.523326Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:58.523346Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:58.551730Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [4:7568544170866189024:2388], Partition 0, Sender [0:0:0], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:56:58.551803Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:58.551825Z node 4 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:58.551853Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:58.551867Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:58.551879Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:58.551899Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:58.551966Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:58.551997Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:58.552019Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:58.625500Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:58.625566Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:58.625591Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:58.625620Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:58.625635Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:58.625647Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:58.625669Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:58.625729Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:58.625742Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:58.625765Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:58.652303Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [4:7568544170866189024:2388], Partition 0, Sender [0:0:0], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:56:58.652368Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:58.652391Z node 4 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:58.652434Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:58.652449Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:58.652462Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:58.652487Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:58.652550Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:58.652565Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:58.652587Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:58.728297Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:58.728346Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:58.728364Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:58.728386Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:58.728397Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:58.728406Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:58.728424Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:58.728500Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:58.728513Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:58.728529Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:58.754523Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [4:7568544170866189024:2388], Partition 0, Sender [0:0:0], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:56:58.754586Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:58.754612Z node 4 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:58.754641Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:58.754656Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:58.754669Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:58.754691Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:58.754749Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:58.754763Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:58.754784Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:58.832131Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:58.832203Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:58.832227Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:58.832259Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:58.832274Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:58.832287Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:58.832308Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:58.832372Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:58.832395Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:58.832419Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:58.857239Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [4:7568544170866189024:2388], Partition 0, Sender [0:0:0], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:56:58.857320Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:58.857345Z node 4 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:58.857373Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:58.857389Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:58.857400Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:58.857422Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:58.857486Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:58.857502Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:58.857523Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:58.933407Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:58.933481Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:58.933514Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:58.933544Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:58.933558Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:58.933569Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:58.933589Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:58.933656Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:58.933676Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:58.933697Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:58.960780Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [4:7568544170866189024:2388], Partition 0, Sender [0:0:0], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:56:58.960857Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:58.960882Z node 4 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:58.960913Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:58.960928Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:58.960942Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:58.960966Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:58.961027Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:58.961043Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:58.961063Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:59.034652Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:59.034721Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:59.034745Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:59.034778Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:59.034792Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:59.034803Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:59.034825Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:59.034904Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:59.034918Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:59.034938Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:59.060672Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [4:7568544170866189024:2388], Partition 0, Sender [0:0:0], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:56:59.060747Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:59.060775Z node 4 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:59.060807Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:59.060822Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:59.060835Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:59.060860Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:59.060918Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:59.060933Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:59.060958Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:59.134921Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:59.134987Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:59.135036Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:59.135069Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:59.135082Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:59.135094Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:59.135115Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:59.135174Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:59.135188Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:59.135208Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:59.164140Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [4:7568544170866189024:2388], Partition 0, Sender [0:0:0], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:56:59.164218Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:59.164244Z node 4 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:59.164274Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:59.164290Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:59.164305Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:59.164330Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:59.164397Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:59.164411Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:59.164432Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:59.237546Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:59.237612Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:59.237635Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:59.237666Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:59.237679Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:59.237692Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:59.237713Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:59.237771Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:59.237783Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:59.237803Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:59.264233Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [4:7568544170866189024:2388], Partition 0, Sender [0:0:0], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:56:59.264307Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:59.264334Z node 4 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:59.264362Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:59.264376Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:59.264389Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:59.264419Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:59.264477Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:59.264491Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:59.264512Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:59.320204Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188544 (NKikimr::NPQ::NReadQuoterEvents::TEvQuotaCountersUpdated), Tablet [4:7568544170866189024:2388], Partition 0, Sender [4:7568544170866189068:2388], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:56:59.320275Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188544, Sender [4:7568544170866189068:2388], Recipient [4:7568544170866189065:2388]: NKikimr::NPQ::NReadQuoterEvents::TEvQuotaCountersUpdated
2025-11-03T16:56:59.320302Z node 4 :PERSQUEUE TRACE: partition.h:671: StateIdle, processing event NReadQuoterEvents::TEvQuotaCountersUpdated
2025-11-03T16:56:59.328704Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188544 (NKikimr::NPQ::NReadQuoterEvents::TEvQuotaCountersUpdated), Tablet [2:7568544108397207262:2383], Partition 0, Sender [2:7568544108397207306:2383], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:59.328786Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188544, Sender [2:7568544108397207306:2383], Recipient [2:7568544108397207303:2383]: NKikimr::NPQ::NReadQuoterEvents::TEvQuotaCountersUpdated
2025-11-03T16:56:59.328811Z node 2 :PERSQUEUE TRACE: partition.h:671: StateIdle, processing event NReadQuoterEvents::TEvQuotaCountersUpdated
2025-11-03T16:56:59.338116Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:59.338177Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:59.338202Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:59.338269Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:59.338285Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:59.338299Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:59.338321Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:59.338379Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:59.338398Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:59.338420Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:59.373273Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [4:7568544170866189024:2388], Partition 0, Sender [0:0:0], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:56:59.373347Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:59.373375Z node 4 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:59.373407Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:59.373424Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:59.373438Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:59.373463Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:59.373524Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:59.373539Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:59.373561Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:59.438576Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:59.438645Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:59.438670Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:59.438712Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:59.438726Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:59.438739Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:59.438761Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:59.438824Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:59.438848Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:59.438869Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:59.476175Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [4:7568544170866189024:2388], Partition 0, Sender [0:0:0], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:56:59.476249Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:59.476278Z node 4 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:59.476310Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:59.476327Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:59.476339Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:59.476362Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:59.476417Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:59.476436Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:59.476457Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:59.540135Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:59.540206Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:59.540232Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:59.540263Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:59.540278Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:59.540292Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:59.540316Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:59.540381Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:59.540396Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:59.540417Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:59.585743Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [4:7568544170866189024:2388], Partition 0, Sender [0:0:0], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:56:59.585818Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:59.585849Z node 4 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:59.585877Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:59.585894Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:59.585907Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:59.585931Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:59.585990Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:59.586004Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:59.586027Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:59.640835Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:59.640914Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:59.640936Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:59.640966Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:59.640980Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:59.640992Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:59.641020Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:59.641080Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:59.641100Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:59.641119Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:59.689475Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [4:7568544170866189024:2388], Partition 0, Sender [0:0:0], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:56:59.689549Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:59.689574Z node 4 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:59.689603Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:59.689617Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:59.689631Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:59.689653Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:59.689723Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:59.689737Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:59.689758Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:59.741175Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:59.741249Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:59.741274Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:59.741306Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:59.741327Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:59.741340Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:59.741362Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:59.741428Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:59.741534Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:59.741573Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:59.776478Z :INFO: [/Root] MessageGroupId [test-message-group-id1] Running cds request ms
2025-11-03T16:56:59.777198Z :INFO: [/Root] MessageGroupId [test-message-group-id2] Running cds request ms
2025-11-03T16:56:59.791851Z :INFO: [/Root] MessageGroupId [test-message-group-id2] SessionId [test-message-group-id2|6c37dca8-a3d62436-12bc1555-8864442b_0] Got CDS response: 
write_sessions_clusters { clusters { endpoint: "localhost:13111" name: "dc1" available: true } clusters { endpoint: "localhost:14811" name: "dc2" } primary_cluster_selection_reason: CLIENT_LOCATION } version: 1
2025-11-03T16:56:59.791914Z :INFO: [/Root] MessageGroupId [test-message-group-id2] SessionId [test-message-group-id2|6c37dca8-a3d62436-12bc1555-8864442b_0] Start write session. Will connect to endpoint: localhost:13111
2025-11-03T16:56:59.795239Z :DEBUG: [/Root] MessageGroupId [test-message-group-id2] SessionId [test-message-group-id2|6c37dca8-a3d62436-12bc1555-8864442b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "test-message-group-id2" preferred_cluster: "dc1" }
2025-11-03T16:56:59.795311Z :INFO: [/Root] MessageGroupId [test-message-group-id1] SessionId [test-message-group-id1|f3af300a-53329ef6-b5d9f61a-1e4014ed_0] Got CDS response: 
write_sessions_clusters { clusters { endpoint: "localhost:13111" name: "dc1" available: true } clusters { endpoint: "localhost:14811" name: "dc2" } primary_cluster_selection_reason: CLIENT_LOCATION } version: 1
2025-11-03T16:56:59.795353Z :INFO: [/Root] MessageGroupId [test-message-group-id1] SessionId [test-message-group-id1|f3af300a-53329ef6-b5d9f61a-1e4014ed_0] Start write session. Will connect to endpoint: localhost:13111
2025-11-03T16:56:59.792308Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [4:7568544170866189024:2388], Partition 0, Sender [0:0:0], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:56:59.792386Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:59.792413Z node 4 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:59.792443Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:59.792462Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:59.792476Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:59.792499Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:59.792557Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:59.792572Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:59.792593Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:59.800185Z node 3 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-11-03T16:56:59.800220Z node 3 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 4
2025-11-03T16:56:59.800468Z node 3 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-11-03T16:56:59.800478Z node 3 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 5
2025-11-03T16:56:59.800626Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 4 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "test-message-group-id2" preferred_cluster: "dc1" }
2025-11-03T16:56:59.800750Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 4 topic: "test-topic" message_group_id: "test-message-group-id2" preferred_cluster: "dc1" from ipv6:[::1]:58284
2025-11-03T16:56:59.800766Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=4 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:58284 proto=v1  topic=test-topic durationSec=0
2025-11-03T16:56:59.800777Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-11-03T16:56:59.801236Z :DEBUG: [/Root] MessageGroupId [test-message-group-id1] SessionId [test-message-group-id1|f3af300a-53329ef6-b5d9f61a-1e4014ed_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "test-message-group-id1" preferred_cluster: "dc1" }
2025-11-03T16:56:59.805845Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 4 sessionId:  describe result for acl check
2025-11-03T16:56:59.805980Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-11-03T16:56:59.805991Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-11-03T16:56:59.806001Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-11-03T16:56:59.806021Z node 3 :PQ_PARTITION_CHOOSER TRACE: partition_chooser_impl__abstract_chooser_actor.h:88: TPartitionChooser [3:7568544209528442519:2597] (SourceId=test-message-group-id2, PreferedPartition=(NULL)) InitTable: SourceId=test-message-group-id2 TopicsAreFirstClassCitizen=0 UseSrcIdMetaMappingInFirstClass=1
2025-11-03T16:56:59.806037Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [3:7568544209528442519:2597] (SourceId=test-message-group-id2, PreferedPartition=(NULL)) StartKqpSession
2025-11-03T16:56:59.816084Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 5 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "test-message-group-id1" preferred_cluster: "dc1" }
2025-11-03T16:56:59.816237Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 5 topic: "test-topic" message_group_id: "test-message-group-id1" preferred_cluster: "dc1" from ipv6:[::1]:58284
2025-11-03T16:56:59.816253Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=5 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:58284 proto=v1  topic=test-topic durationSec=0
2025-11-03T16:56:59.816263Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-11-03T16:56:59.816405Z node 3 :PQ_PARTITION_CHOOSER TRACE: partition_chooser_impl__abstract_chooser_actor.h:132: StateCreateKqpSession, received event# 271646728, Sender [3:7568544115039159497:2257], Recipient [3:7568544209528442519:2597]: NKikimrKqp.TEvCreateSessionResponse Error: "" Response { SessionId: "ydb://session/3?node_id=3&id=NDBiMzkyYmMtNTBiOTQxMzEtZjUzYWUyZDUtMzc5YjdjNzM=" NodeId: 3 } YdbStatus: SUCCESS ResourceExhausted: false
2025-11-03T16:56:59.816428Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [3:7568544209528442519:2597] (SourceId=test-message-group-id2, PreferedPartition=(NULL)) Select from the table
2025-11-03T16:56:59.819358Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 5 sessionId:  describe result for acl check
2025-11-03T16:56:59.819472Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-11-03T16:56:59.819481Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-11-03T16:56:59.819490Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-11-03T16:56:59.819507Z node 3 :PQ_PARTITION_CHOOSER TRACE: partition_chooser_impl__abstract_chooser_actor.h:88: TPartitionChooser [3:7568544209528442527:2598] (SourceId=test-message-group-id1, PreferedPartition=(NULL)) InitTable: SourceId=test-message-group-id1 TopicsAreFirstClassCitizen=0 UseSrcIdMetaMappingInFirstClass=1
2025-11-03T16:56:59.819520Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [3:7568544209528442527:2598] (SourceId=test-message-group-id1, PreferedPartition=(NULL)) StartKqpSession
2025-11-03T16:56:59.822184Z node 3 :PQ_PARTITION_CHOOSER TRACE: partition_chooser_impl__abstract_chooser_actor.h:132: StateCreateKqpSession, received event# 271646728, Sender [3:7568544115039159497:2257], Recipient [3:7568544209528442527:2598]: NKikimrKqp.TEvCreateSessionResponse Error: "" Response { SessionId: "ydb://session/3?node_id=3&id=ZTE2OTVjYTEtZDA4ZGUzMGQtYWY3NzUxZTQtODRmYTUzYWQ=" NodeId: 3 } YdbStatus: SUCCESS ResourceExhausted: false
2025-11-03T16:56:59.822207Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [3:7568544209528442527:2598] (SourceId=test-message-group-id1, PreferedPartition=(NULL)) Select from the table
2025-11-03T16:56:59.831370Z node 3 :PQ_PARTITION_CHOOSER TRACE: partition_chooser_impl__abstract_chooser_actor.h:163: StateSelect, received event# 271646721, Sender [3:7568544115039159497:2257], Recipient [3:7568544209528442519:2597]: NKikimrKqp.TEvQueryResponse Response { SessionId: "ydb://session/3?node_id=3&id=NDBiMzkyYmMtNTBiOTQxMzEtZjUzYWUyZDUtMzc5YjdjNzM=" PreparedQuery: "442ea808-d7231069-9c6e0723-bcf815" QueryParameters { Name: "$Hash" Type { Kind: Data Data { Scheme: 2 } } } QueryParameters { Name: "$Topic" Type { Kind: Data Data { Scheme: 4608 } } } QueryParameters { Name: "$SourceId" Type { Kind: Data Data { Scheme: 4608 } } } TxMeta { id: "01k95ad2na8ex8yfg7pc0ze1z8" } YdbResults { columns { name: "Partition" type { optional_type { item { type_id: UINT32 } } } } columns { name: "CreateTime" type { optional_type { item { type_id: UINT64 } } } } columns { name: "AccessTime" type { optional_type { item { type_id: UINT64 } } } } columns { name: "SeqNo" type { optional_type { item { type_id: UINT64 } } } } rows { items { uint32_value: 0 } items { uint64_value: 1762189010911 } items { uint64_value: 1762189011940 } items { uint64_value: 0 } } format: FORMAT_VALUE } QueryDiagnostics: "" } YdbStatus: SUCCESS Cons
2025-11-03T16:56:59.831524Z node 3 :PQ_PARTITION_CHOOSER TRACE: partition_chooser_impl__abstract_chooser_actor.h:151: TPartitionChooser [3:7568544209528442519:2597] (SourceId=test-message-group-id2, PreferedPartition=(NULL)) Selected from table PartitionId=0 SeqNo=0
2025-11-03T16:56:59.831539Z node 3 :PQ_PARTITION_CHOOSER TRACE: partition_chooser_impl__old_chooser_actor.h:113: TPartitionChooser [3:7568544209528442519:2597] (SourceId=test-message-group-id2, PreferedPartition=(NULL)) OnPartitionChosen
2025-11-03T16:56:59.831552Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [3:7568544209528442519:2597] (SourceId=test-message-group-id2, PreferedPartition=(NULL)) Update the table
2025-11-03T16:56:59.835867Z node 3 :PQ_PARTITION_CHOOSER TRACE: partition_chooser_impl__abstract_chooser_actor.h:163: StateSelect, received event# 271646721, Sender [3:7568544115039159497:2257], Recipient [3:7568544209528442527:2598]: NKikimrKqp.TEvQueryResponse Response { SessionId: "ydb://session/3?node_id=3&id=ZTE2OTVjYTEtZDA4ZGUzMGQtYWY3NzUxZTQtODRmYTUzYWQ=" PreparedQuery: "442ea808-d7231069-9c6e0723-bcf815" QueryParameters { Name: "$Hash" Type { Kind: Data Data { Scheme: 2 } } } QueryParameters { Name: "$Topic" Type { Kind: Data Data { Scheme: 4608 } } } QueryParameters { Name: "$SourceId" Type { Kind: Data Data { Scheme: 4608 } } } TxMeta { id: "01k95ad2ngfck1v449w8rqe8tf" } YdbResults { columns { name: "Partition" type { optional_type { item { type_id: UINT32 } } } } columns { name: "CreateTime" type { optional_type { item { type_id: UINT64 } } } } columns { name: "AccessTime" type { optional_type { item { type_id: UINT64 } } } } columns { name: "SeqNo" type { optional_type { item { type_id: UINT64 } } } } rows { items { uint32_value: 0 } items { uint64_value: 1762189010909 } items { uint64_value: 1762189011940 } items { uint64_value: 0 } } format: FORMAT_VALUE } QueryDiagnostics: "" } YdbStatus: SUCCESS Cons
2025-11-03T16:56:59.836438Z node 3 :PQ_PARTITION_CHOOSER TRACE: partition_chooser_impl__abstract_chooser_actor.h:151: TPartitionChooser [3:7568544209528442527:2598] (SourceId=test-message-group-id1, PreferedPartition=(NULL)) Selected from table PartitionId=0 SeqNo=0
2025-11-03T16:56:59.836460Z node 3 :PQ_PARTITION_CHOOSER TRACE: partition_chooser_impl__old_chooser_actor.h:113: TPartitionChooser [3:7568544209528442527:2598] (SourceId=test-message-group-id1, PreferedPartition=(NULL)) OnPartitionChosen
2025-11-03T16:56:59.836473Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [3:7568544209528442527:2598] (SourceId=test-message-group-id1, PreferedPartition=(NULL)) Update the table
2025-11-03T16:56:59.841995Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:59.842064Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:59.842090Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:59.842120Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:59.842137Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:59.842150Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:59.842172Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:59.842237Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:59.842250Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:59.842273Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:59.847619Z node 3 :PQ_PARTITION_CHOOSER TRACE: partition_chooser_impl__abstract_chooser_actor.h:212: StateUpdate, received event# 271646721, Sender [3:7568544115039159497:2257], Recipient [3:7568544209528442519:2597]: NKikimrKqp.TEvQueryResponse Response { SessionId: "ydb://session/3?node_id=3&id=NDBiMzkyYmMtNTBiOTQxMzEtZjUzYWUyZDUtMzc5YjdjNzM=" PreparedQuery: "72f7e762-c46fa14f-e3d2f842-88a42755" QueryParameters { Name: "$AccessTime" Type { Kind: Data Data { Scheme: 4 } } } QueryParameters { Name: "$CreateTime" Type { Kind: Data Data { Scheme: 4 } } } QueryParameters { Name: "$Hash" Type { Kind: Data Data { Scheme: 2 } } } QueryParameters { Name: "$Partition" Type { Kind: Data Data { Scheme: 2 } } } QueryParameters { Name: "$SeqNo" Type { Kind: Data Data { Scheme: 4 } } } QueryParameters { Name: "$SourceId" Type { Kind: Data Data { Scheme: 4608 } } } QueryParameters { Name: "$Topic" Type { Kind: Data Data { Scheme: 4608 } } } TxMeta { } QueryDiagnostics: "" } YdbStatus: SUCCESS ConsumedRu: 1
2025-11-03T16:56:59.847664Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [3:7568544209528442519:2597] (SourceId=test-message-group-id2, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-11-03T16:56:59.847688Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [3:7568544209528442519:2597] (SourceId=test-message-group-id2, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-11-03T16:56:59.847706Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [3:7568544209528442519:2597] (SourceId=test-message-group-id2, PreferedPartition=(NULL)) Start idle
2025-11-03T16:56:59.847737Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 4 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-11-03T16:56:59.850392Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 269877761, Sender [4:7568544209520895222:2680], Recipient [4:7568544170866189024:2388]: NKikimr::TEvTabletPipe::TEvServerConnected
2025-11-03T16:56:59.850423Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5330: HandleHook, processing event TEvTabletPipe::TEvServerConnected
2025-11-03T16:56:59.850439Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:2716: [PQ: 72075186224037892] Handle TEvTabletPipe::TEvServerConnected
2025-11-03T16:56:59.850470Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [3:7568544209528442580:2597], now have 1 active actors on pipe
2025-11-03T16:56:59.850731Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271187968, Sender [3:7568544209528442579:2597], Recipient [4:7568544209520895222:2680]
2025-11-03T16:56:59.850759Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5316: HandleHook, processing event TEvPersQueue::TEvRequest
2025-11-03T16:56:59.850799Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:56:59.850826Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:56:59.850887Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188498 (NKikimr::TEvPQ::TEvChangeOwner), Tablet [4:7568544170866189024:2388], Partition 0, Sender [4:7568544170866189024:2388], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:56:59.850932Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188498, Sender [4:7568544170866189024:2388], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvChangeOwner
2025-11-03T16:56:59.850948Z node 4 :PERSQUEUE TRACE: partition.h:642: StateIdle, processing event TEvPQ::TEvChangeOwner
2025-11-03T16:56:59.850963Z node 4 :PERSQUEUE TRACE: partition_write.cpp:154: [72075186224037892][Partition][0][StateIdle] TPartition::HandleOnWrite TEvChangeOwner.
2025-11-03T16:56:59.850981Z node 4 :PERSQUEUE TRACE: partition_write.cpp:873: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessChangeOwnerRequests.
2025-11-03T16:56:59.850994Z node 4 :PERSQUEUE TRACE: partition_write.cpp:107: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessChangeOwnerRequest.
2025-11-03T16:56:59.851038Z node 4 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie test-message-group-id2|6160131f-a6fd3c42-69db7e8f-68435845_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner test-message-group-id2
2025-11-03T16:56:59.851055Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:59.851070Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:59.851082Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:59.851089Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-03T16:56:59.851121Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:59.851131Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:59.851170Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:59.851179Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:59.851192Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:59.851204Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=1
2025-11-03T16:56:59.851221Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-03T16:56:59.851261Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188562 (NKikimr::TEvPQ::TEvTxBatchComplete), Tablet [4:7568544170866189024:2388], Partition 0, Sender [4:7568544170866189065:2388], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:56:59.851280Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188562, Sender [4:7568544170866189065:2388], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvTxBatchComplete
2025-11-03T16:56:59.851305Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271188493, Sender [4:7568544170866189065:2388], Recipient [4:7568544170866189024:2388]: NKikimr::TEvPQ::TEvProxyResponse
2025-11-03T16:56:59.851315Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5335: HandleHook, processing event TEvPQ::TEvProxyResponse
2025-11-03T16:56:59.851330Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-03T16:56:59.850492Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 4, Generation: 1
2025-11-03T16:56:59.851796Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271187968, Sender [3:7568544209528442579:2597], Recipient [4:7568544209520895222:2680]
2025-11-03T16:56:59.851824Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5316: HandleHook, processing event TEvPersQueue::TEvRequest
2025-11-03T16:56:59.851865Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:56:59.851888Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:56:59.851992Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188486 (NKikimr::TEvPQ::TEvGetMaxSeqNoRequest), Tablet [4:7568544170866189024:2388], Partition 0, Sender [4:7568544170866189024:2388], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:56:59.852033Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188486, Sender [4:7568544170866189024:2388], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvGetMaxSeqNoRequest
2025-11-03T16:56:59.852058Z node 4 :PERSQUEUE TRACE: partition.h:634: StateIdle, processing event TEvPQ::TEvGetMaxSeqNoRequest
2025-11-03T16:56:59.852130Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271188493, Sender [4:7568544170866189065:2388], Recipient [4:7568544170866189024:2388]: NKikimr::TEvPQ::TEvProxyResponse
2025-11-03T16:56:59.852147Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5335: HandleHook, processing event TEvPQ::TEvProxyResponse
2025-11-03T16:56:59.852179Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-03T16:56:59.853647Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 4 partition: 0 MaxSeqNo: 10 sessionId: test-message-group-id2|6160131f-a6fd3c42-69db7e8f-68435845_0
2025-11-03T16:56:59.855137Z node 3 :PQ_PARTITION_CHOOSER TRACE: partition_chooser_impl__abstract_chooser_actor.h:212: StateUpdate, received event# 271646721, Sender [3:7568544115039159497:2257], Recipient [3:7568544209528442527:2598]: NKikimrKqp.TEvQueryResponse Response { SessionId: "ydb://session/3?node_id=3&id=ZTE2OTVjYTEtZDA4ZGUzMGQtYWY3NzUxZTQtODRmYTUzYWQ=" PreparedQuery: "72f7e762-c46fa14f-e3d2f842-88a42755" QueryParameters { Name: "$AccessTime" Type { Kind: Data Data { Scheme: 4 } } } QueryParameters { Name: "$CreateTime" Type { Kind: Data Data { Scheme: 4 } } } QueryParameters { Name: "$Hash" Type { Kind: Data Data { Scheme: 2 } } } QueryParameters { Name: "$Partition" Type { Kind: Data Data { Scheme: 2 } } } QueryParameters { Name: "$SeqNo" Type { Kind: Data Data { Scheme: 4 } } } QueryParameters { Name: "$SourceId" Type { Kind: Data Data { Scheme: 4608 } } } QueryParameters { Name: "$Topic" Type { Kind: Data Data { Scheme: 4608 } } } TxMeta { } QueryDiagnostics: "" } YdbStatus: SUCCESS ConsumedRu: 1
2025-11-03T16:56:59.855204Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [3:7568544209528442527:2598] (SourceId=test-message-group-id1, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-11-03T16:56:59.855228Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [3:7568544209528442527:2598] (SourceId=test-message-group-id1, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-11-03T16:56:59.855246Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [3:7568544209528442527:2598] (SourceId=test-message-group-id1, PreferedPartition=(NULL)) Start idle
2025-11-03T16:56:59.855276Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 5 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-11-03T16:56:59.857568Z :INFO: [/Root] MessageGroupId [test-message-group-id2] SessionId [test-message-group-id2|6c37dca8-a3d62436-12bc1555-8864442b_0] Write session established. Init response: last_sequence_number: 10 session_id: "test-message-group-id2|6160131f-a6fd3c42-69db7e8f-68435845_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-11-03T16:56:59.857759Z :DEBUG: [/Root] MessageGroupId [test-message-group-id2] SessionId [test-message-group-id2|6160131f-a6fd3c42-69db7e8f-68435845_0] Write session: try to update token
2025-11-03T16:56:59.857847Z :DEBUG: [/Root] MessageGroupId [test-message-group-id2] SessionId [test-message-group-id2|6160131f-a6fd3c42-69db7e8f-68435845_0] Send 4 message(s) (0 left), first sequence number is 11
2025-11-03T16:56:59.858591Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 269877761, Sender [4:7568544209520895223:2681], Recipient [4:7568544170866189024:2388]: NKikimr::TEvTabletPipe::TEvServerConnected
2025-11-03T16:56:59.858622Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5330: HandleHook, processing event TEvTabletPipe::TEvServerConnected
2025-11-03T16:56:59.858639Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:2716: [PQ: 72075186224037892] Handle TEvTabletPipe::TEvServerConnected
2025-11-03T16:56:59.858668Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [3:7568544209528442586:2598], now have 1 active actors on pipe
2025-11-03T16:56:59.858884Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 4, Generation: 1
2025-11-03T16:56:59.859329Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271187968, Sender [3:7568544209528442585:2598], Recipient [4:7568544209520895223:2681]
2025-11-03T16:56:59.859361Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5316: HandleHook, processing event TEvPersQueue::TEvRequest
2025-11-03T16:56:59.859413Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:56:59.859437Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:56:59.859509Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188498 (NKikimr::TEvPQ::TEvChangeOwner), Tablet [4:7568544170866189024:2388], Partition 0, Sender [4:7568544170866189024:2388], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:56:59.859547Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188498, Sender [4:7568544170866189024:2388], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvChangeOwner
2025-11-03T16:56:59.859566Z node 4 :PERSQUEUE TRACE: partition.h:642: StateIdle, processing event TEvPQ::TEvChangeOwner
2025-11-03T16:56:59.859579Z node 4 :PERSQUEUE TRACE: partition_write.cpp:154: [72075186224037892][Partition][0][StateIdle] TPartition::HandleOnWrite TEvChangeOwner.
2025-11-03T16:56:59.859598Z node 4 :PERSQUEUE TRACE: partition_write.cpp:873: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessChangeOwnerRequests.
2025-11-03T16:56:59.859607Z node 4 :PERSQUEUE TRACE: partition_write.cpp:107: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessChangeOwnerRequest.
2025-11-03T16:56:59.859639Z node 4 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie test-message-group-id1|bb79c232-820d67a4-af8eac61-e41d2e7b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner test-message-group-id1
2025-11-03T16:56:59.859650Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:59.859668Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:59.859681Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:59.859688Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-03T16:56:59.859714Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:59.859725Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:59.859765Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:59.859775Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:59.859794Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:59.859807Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=1
2025-11-03T16:56:59.859824Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-03T16:56:59.859867Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188562 (NKikimr::TEvPQ::TEvTxBatchComplete), Tablet [4:7568544170866189024:2388], Partition 0, Sender [4:7568544170866189065:2388], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:56:59.859894Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188562, Sender [4:7568544170866189065:2388], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvTxBatchComplete
2025-11-03T16:56:59.859932Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271188493, Sender [4:7568544170866189065:2388], Recipient [4:7568544170866189024:2388]: NKikimr::TEvPQ::TEvProxyResponse
2025-11-03T16:56:59.859947Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5335: HandleHook, processing event TEvPQ::TEvProxyResponse
2025-11-03T16:56:59.859968Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-03T16:56:59.860703Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 4 sessionId: test-message-group-id2|6160131f-a6fd3c42-69db7e8f-68435845_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:56:59.861005Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:56:59.861297Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271187968, Sender [3:7568544209528442579:2597], Recipient [4:7568544209520895222:2680]
2025-11-03T16:56:59.861316Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5316: HandleHook, processing event TEvPersQueue::TEvRequest
2025-11-03T16:56:59.861351Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:56:59.861371Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:56:59.861430Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188507 (NKikimr::TEvPQ::TEvReserveBytes), Tablet [4:7568544170866189024:2388], Partition 0, Sender [4:7568544170866189024:2388], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:56:59.861462Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188507, Sender [4:7568544170866189024:2388], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvReserveBytes
2025-11-03T16:56:59.861478Z node 4 :PERSQUEUE TRACE: partition.h:650: StateIdle, processing event TEvPQ::TEvReserveBytes
2025-11-03T16:56:59.861490Z node 4 :PERSQUEUE TRACE: partition_write.cpp:220: [72075186224037892][Partition][0][StateIdle] TPartition::HandleOnWrite TEvReserveBytes.
2025-11-03T16:56:59.861507Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:59.861563Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271188493, Sender [4:7568544170866189065:2388], Recipient [4:7568544170866189024:2388]: NKikimr::TEvPQ::TEvProxyResponse
2025-11-03T16:56:59.861577Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5335: HandleHook, processing event TEvPQ::TEvProxyResponse
2025-11-03T16:56:59.861590Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-11-03T16:56:59.861821Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:56:59.861757Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271187968, Sender [3:7568544209528442585:2598], Recipient [4:7568544209520895223:2681]
2025-11-03T16:56:59.861773Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5316: HandleHook, processing event TEvPersQueue::TEvRequest
2025-11-03T16:56:59.861801Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:56:59.861816Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:56:59.861867Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188486 (NKikimr::TEvPQ::TEvGetMaxSeqNoRequest), Tablet [4:7568544170866189024:2388], Partition 0, Sender [4:7568544170866189024:2388], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:56:59.861901Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188486, Sender [4:7568544170866189024:2388], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvGetMaxSeqNoRequest
2025-11-03T16:56:59.861917Z node 4 :PERSQUEUE TRACE: partition.h:634: StateIdle, processing event TEvPQ::TEvGetMaxSeqNoRequest
2025-11-03T16:56:59.861968Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271188493, Sender [4:7568544170866189065:2388], Recipient [4:7568544170866189024:2388]: NKikimr::TEvPQ::TEvProxyResponse
2025-11-03T16:56:59.861981Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5335: HandleHook, processing event TEvPQ::TEvProxyResponse
2025-11-03T16:56:59.861999Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-03T16:56:59.862375Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 5 partition: 0 MaxSeqNo: 10 sessionId: test-message-group-id1|bb79c232-820d67a4-af8eac61-e41d2e7b_0
2025-11-03T16:56:59.862238Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271187968, Sender [3:7568544209528442579:2597], Recipient [4:7568544209520895222:2680]
2025-11-03T16:56:59.862264Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5316: HandleHook, processing event TEvPersQueue::TEvRequest
2025-11-03T16:56:59.862327Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:56:59.862338Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:56:59.862397Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0test-message-group-id2' SeqNo: 11 partNo : 0 messageNo: 1 size 98 offset: -1
2025-11-03T16:56:59.862419Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0test-message-group-id2' SeqNo: 12 partNo : 0 messageNo: 1 size 98 offset: -1
2025-11-03T16:56:59.862441Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0test-message-group-id2' SeqNo: 13 partNo : 0 messageNo: 1 size 98 offset: -1
2025-11-03T16:56:59.862458Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0test-message-group-id2' SeqNo: 14 partNo : 0 messageNo: 1 size 98 offset: -1
2025-11-03T16:56:59.862511Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188480 (NKikimr::TEvPQ::TEvWrite), Tablet [4:7568544170866189024:2388], Partition 0, Sender [4:7568544170866189024:2388], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:56:59.862540Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188480, Sender [4:7568544170866189024:2388], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvWrite
2025-11-03T16:56:59.862553Z node 4 :PERSQUEUE TRACE: partition.h:628: StateIdle, processing event TEvPQ::TEvWrite
2025-11-03T16:56:59.862565Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:56:59.862634Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:59.862669Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:59.862679Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (4)
2025-11-03T16:56:59.862731Z node 4 :PERSQUEUE TRACE: partition_write.cpp:1168: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 process write for '\0test-message-group-id2' DisableDeduplication=0 SeqNo=11 LocalSeqNo=10 InitialSeqNo=0 EnableKafkaDeduplication=0 ProducerEpoch=(empty maybe)
2025-11-03T16:56:59.862792Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0test-message-group-id2' seqNo 11 partNo 0
2025-11-03T16:56:59.863736Z :INFO: [/Root] MessageGroupId [test-message-group-id1] SessionId [test-message-group-id1|f3af300a-53329ef6-b5d9f61a-1e4014ed_0] Write session established. Init response: last_sequence_number: 10 session_id: "test-message-group-id1|bb79c232-820d67a4-af8eac61-e41d2e7b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-11-03T16:56:59.863867Z :DEBUG: [/Root] MessageGroupId [test-message-group-id1] SessionId [test-message-group-id1|bb79c232-820d67a4-af8eac61-e41d2e7b_0] Write session: try to update token
2025-11-03T16:56:59.863914Z :DEBUG: [/Root] MessageGroupId [test-message-group-id1] SessionId [test-message-group-id1|bb79c232-820d67a4-af8eac61-e41d2e7b_0] Send 4 message(s) (0 left), first sequence number is 11
2025-11-03T16:56:59.864551Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 5 sessionId: test-message-group-id1|bb79c232-820d67a4-af8eac61-e41d2e7b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:56:59.864794Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:56:59.863736Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0test-message-group-id2' seqNo 11 partNo 0 FormedBlobsCount 0 NewHead: Offset 20 PartNo 0 PackedSize 188 count 1 nextOffset 21 batches 1
2025-11-03T16:56:59.863795Z node 4 :PERSQUEUE TRACE: partition_write.cpp:1168: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 process write for '\0test-message-group-id2' DisableDeduplication=0 SeqNo=12 LocalSeqNo=11 InitialSeqNo=0 EnableKafkaDeduplication=0 ProducerEpoch=(empty maybe)
2025-11-03T16:56:59.863812Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0test-message-group-id2' seqNo 12 partNo 0
2025-11-03T16:56:59.863846Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0test-message-group-id2' seqNo 12 partNo 0 FormedBlobsCount 0 NewHead: Offset 20 PartNo 0 PackedSize 344 count 2 nextOffset 22 batches 1
2025-11-03T16:56:59.863871Z node 4 :PERSQUEUE TRACE: partition_write.cpp:1168: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 process write for '\0test-message-group-id2' DisableDeduplication=0 SeqNo=13 LocalSeqNo=12 InitialSeqNo=0 EnableKafkaDeduplication=0 ProducerEpoch=(empty maybe)
2025-11-03T16:56:59.863887Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0test-message-group-id2' seqNo 13 partNo 0
2025-11-03T16:56:59.863913Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0test-message-group-id2' seqNo 13 partNo 0 FormedBlobsCount 0 NewHead: Offset 20 PartNo 0 PackedSize 500 count 3 nextOffset 23 batches 1
2025-11-03T16:56:59.863943Z node 4 :PERSQUEUE TRACE: partition_write.cpp:1168: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 process write for '\0test-message-group-id2' DisableDeduplication=0 SeqNo=14 LocalSeqNo=13 InitialSeqNo=0 EnableKafkaDeduplication=0 ProducerEpoch=(empty maybe)
2025-11-03T16:56:59.863958Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0test-message-group-id2' seqNo 14 partNo 0
2025-11-03T16:56:59.863999Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0test-message-group-id2' seqNo 14 partNo 0 FormedBlobsCount 0 NewHead: Offset 20 PartNo 0 PackedSize 656 count 4 nextOffset 24 batches 1
2025-11-03T16:56:59.864013Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:59.864028Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 1 items to delete old stuff
2025-11-03T16:56:59.864102Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 1 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest CmdDeleteRange { Range { From: "x0000000000" IncludeFrom: true To: "x0000000001" IncludeTo: false } }
2025-11-03T16:56:59.864115Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:59.864534Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 20,4 HeadOffset 20 endOffset 20 curOffset 24 d0000000000_00000000000000000020_00000_0000000004_00000? size 536 WTime 1762189019864
2025-11-03T16:56:59.864547Z node 4 :PERSQUEUE TRACE: partition_write.cpp:1459: [72075186224037892][Partition][0][StateIdle] TPartition::AddNewFastWriteBlob
2025-11-03T16:56:59.864621Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:59.864707Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188562 (NKikimr::TEvPQ::TEvTxBatchComplete), Tablet [4:7568544170866189024:2388], Partition 0, Sender [4:7568544170866189065:2388], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:56:59.864743Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188562, Sender [4:7568544170866189065:2388], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvTxBatchComplete
2025-11-03T16:56:59.864761Z node 4 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-03T16:56:59.864861Z node 4 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 0 count 4 size 536
2025-11-03T16:56:59.865036Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 270794752, Sender [4:7568544170866189047:2388], Recipient [4:7568544170866189024:2388]: NKikimrClient.TKeyValueRequest Cookie: 21 CmdDeleteRange { Range { From: "x0000000000" IncludeFrom: true To: "x0000000001" IncludeTo: false } } CmdWrite { Key: "m0000000000p\000test-message-group-id2" Value: "\010\016\020\027\030\207\252\271\324\271\326\220\003 \207\342\236\320\271\326\220\003(\000H\001" StorageChannel: INLINE } CmdWrite { Key: "d0000000000_00000000000000000020_00000_0000000004_00000?" Value: "\022\000\010\024\020\000\030\004 \000(\360\0040\204\0048\001@\000\010\000\000\000\036\000\000\001\002\003\001\004\035\000\000\000\024\000\000test-message-group-id2\027\000\000\000\006\000\000\000\037\000\013\001\001\001\232\001\000\000\024\000\010\013\030\260\205\232\325\2443B\020ipv6:[::1]:58284P\001\342\007$\n\020ipv6:[::1]:58284\032\007unknown\"\007unknown\372\007\033\037\213\010\000\000\000\000\000\000\003\313M-.NLO\005\000\1770\275\266\007\000\000\000\010\014\030\261\205\232\325\2443B\020ipv6:[::1]:58284P\001\342\007$\n\020ipv6:[::1]:58284\032\007unknown\"\007unknown\372\007
2025-11-03T16:56:59.865159Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 270794753, Sender [4:7568544209520895224:2388], Recipient [4:7568544170866189024:2388]: NKikimr::TEvKeyValue::TEvIntermediate
2025-11-03T16:56:59.868124Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271187968, Sender [3:7568544209528442585:2598], Recipient [4:7568544209520895223:2681]
2025-11-03T16:56:59.868149Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5316: HandleHook, processing event TEvPersQueue::TEvRequest
2025-11-03T16:56:59.868202Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:56:59.868229Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:56:59.868292Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188507 (NKikimr::TEvPQ::TEvReserveBytes), Tablet [4:7568544170866189024:2388], Partition 0, Sender [4:7568544170866189024:2388], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:56:59.868334Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188507, Sender [4:7568544170866189024:2388], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvReserveBytes
2025-11-03T16:56:59.868354Z node 4 :PERSQUEUE TRACE: partition.h:650: StateIdle, processing event TEvPQ::TEvReserveBytes
2025-11-03T16:56:59.868366Z node 4 :PERSQUEUE TRACE: partition_write.cpp:220: [72075186224037892][Partition][0][StateIdle] TPartition::HandleOnWrite TEvReserveBytes.
2025-11-03T16:56:59.868393Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:59.868454Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271188493, Sender [4:7568544170866189065:2388], Recipient [4:7568544170866189024:2388]: NKikimr::TEvPQ::TEvProxyResponse
2025-11-03T16:56:59.868478Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5335: HandleHook, processing event TEvPQ::TEvProxyResponse
2025-11-03T16:56:59.868494Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-11-03T16:56:59.868769Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:56:59.869366Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271187968, Sender [3:7568544209528442585:2598], Recipient [4:7568544209520895223:2681]
2025-11-03T16:56:59.869388Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5316: HandleHook, processing event TEvPersQueue::TEvRequest
2025-11-03T16:56:59.869460Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:56:59.869482Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:56:59.869535Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0test-message-group-id1' SeqNo: 11 partNo : 0 messageNo: 1 size 98 offset: -1
2025-11-03T16:56:59.869563Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0test-message-group-id1' SeqNo: 12 partNo : 0 messageNo: 1 size 98 offset: -1
2025-11-03T16:56:59.869586Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0test-message-group-id1' SeqNo: 13 partNo : 0 messageNo: 1 size 98 offset: -1
2025-11-03T16:56:59.874068Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:56:59.869608Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0test-message-group-id1' SeqNo: 14 partNo : 0 messageNo: 1 size 98 offset: -1
2025-11-03T16:56:59.869684Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 20 count 4 size 536 actorID [4:7568544170866189047:2388]
2025-11-03T16:56:59.869737Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188480 (NKikimr::TEvPQ::TEvWrite), Tablet [4:7568544170866189024:2388], Partition 0, Sender [4:7568544170866189024:2388], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:56:59.869761Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188480, Sender [4:7568544170866189024:2388], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvWrite
2025-11-03T16:56:59.869772Z node 4 :PERSQUEUE TRACE: partition.h:628: StateIdle, processing event TEvPQ::TEvWrite
2025-11-03T16:56:59.869781Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:56:59.869826Z node 4 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-03T16:56:59.869853Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 270795264 (NKikimr::TEvKeyValue::TEvResponse), Tablet [4:7568544170866189024:2388], Partition 0, Sender [4:7568544170866189047:2388], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:56:59.869945Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 270795264, Sender [4:7568544170866189047:2388], Recipient [4:7568544170866189065:2388]: NKikimrClient.TResponse Status: 1 DeleteRangeResult { Status: 0 } WriteResult { Status: 0 StatusFlags: 1 } WriteResult { Status: 0 StatusFlags: 1 } WriteResult { Status: 0 StatusFlags: 1 }
2025-11-03T16:56:59.869956Z node 4 :PERSQUEUE TRACE: partition.h:625: StateIdle, processing event TEvKeyValue::TEvResponse
2025-11-03T16:56:59.869966Z node 4 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-03T16:56:59.869981Z node 4 :PERSQUEUE TRACE: partition_write.cpp:518: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse.
2025-11-03T16:56:59.870014Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 484 WriteNewSizeFromSupportivePartitions# 0
2025-11-03T16:56:59.870024Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=4
2025-11-03T16:56:59.870057Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:56:59.870088Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0test-message-group-id2', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 11, partNo: 0, Offset: 20 is stored on disk
2025-11-03T16:56:59.870102Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:56:59.870119Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0test-message-group-id2', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 12, partNo: 0, Offset: 21 is stored on disk
2025-11-03T16:56:59.870126Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:56:59.870141Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0test-message-group-id2', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 13, partNo: 0, Offset: 22 is stored on disk
2025-11-03T16:56:59.870151Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:56:59.870165Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0test-message-group-id2', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 14, partNo: 0, Offset: 23 is stored on disk
2025-11-03T16:56:59.870171Z node 4 :PERSQUEUE TRACE: partition_write.cpp:424: [72075186224037892][Partition][0][StateIdle] TPartition::SyncMemoryStateWithKVState.
2025-11-03T16:56:59.870281Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:59.870305Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:59.870326Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (4)
2025-11-03T16:56:59.870379Z node 4 :PERSQUEUE TRACE: partition_write.cpp:1168: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 process write for '\0test-message-group-id1' DisableDeduplication=0 SeqNo=11 LocalSeqNo=10 InitialSeqNo=0 EnableKafkaDeduplication=0 ProducerEpoch=(empty maybe)
2025-11-03T16:56:59.870445Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0test-message-group-id1' seqNo 11 partNo 0
2025-11-03T16:56:59.871282Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0test-message-group-id1' seqNo 11 partNo 0 FormedBlobsCount 0 NewHead: Offset 24 PartNo 0 PackedSize 188 count 1 nextOffset 25 batches 1
2025-11-03T16:56:59.871333Z node 4 :PERSQUEUE TRACE: partition_write.cpp:1168: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 process write for '\0test-message-group-id1' DisableDeduplication=0 SeqNo=12 LocalSeqNo=11 InitialSeqNo=0 EnableKafkaDeduplication=0 ProducerEpoch=(empty maybe)
2025-11-03T16:56:59.871346Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0test-message-group-id1' seqNo 12 partNo 0
2025-11-03T16:56:59.871369Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0test-message-group-id1' seqNo 12 partNo 0 FormedBlobsCount 0 NewHead: Offset 24 PartNo 0 PackedSize 344 count 2 nextOffset 26 batches 1
2025-11-03T16:56:59.871385Z node 4 :PERSQUEUE TRACE: partition_write.cpp:1168: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 process write for '\0test-message-group-id1' DisableDeduplication=0 SeqNo=13 LocalSeqNo=12 InitialSeqNo=0 EnableKafkaDeduplication=0 ProducerEpoch=(empty maybe)
2025-11-03T16:56:59.871394Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0test-message-group-id1' seqNo 13 partNo 0
2025-11-03T16:56:59.871412Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0test-message-group-id1' seqNo 13 partNo 0 FormedBlobsCount 0 NewHead: Offset 24 PartNo 0 PackedSize 500 count 3 nextOffset 27 batches 1
2025-11-03T16:56:59.871433Z node 4 :PERSQUEUE TRACE: partition_write.cpp:1168: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 process write for '\0test-message-group-id1' DisableDeduplication=0 SeqNo=14 LocalSeqNo=13 InitialSeqNo=0 EnableKafkaDeduplication=0 ProducerEpoch=(empty maybe)
2025-11-03T16:56:59.871446Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0test-message-group-id1' seqNo 14 partNo 0
2025-11-03T16:56:59.871462Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0test-message-group-id1' seqNo 14 partNo 0 FormedBlobsCount 0 NewHead: Offset 24 PartNo 0 PackedSize 656 count 4 nextOffset 28 batches 1
2025-11-03T16:56:59.871473Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:59.871484Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 1 items to delete old stuff
2025-11-03T16:56:59.871567Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 1 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest CmdDeleteRange { Range { From: "x0000000000" IncludeFrom: true To: "x0000000001" IncludeTo: false } }
2025-11-03T16:56:59.871580Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:59.872112Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,4 HeadOffset 24 endOffset 24 curOffset 28 d0000000000_00000000000000000024_00000_0000000004_00000? size 536 WTime 1762189019871
2025-11-03T16:56:59.872130Z node 4 :PERSQUEUE TRACE: partition_write.cpp:1459: [72075186224037892][Partition][0][StateIdle] TPartition::AddNewFastWriteBlob
2025-11-03T16:56:59.872220Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:59.872264Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:56:59.872322Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271188502, Sender [4:7568544170866189047:2388], Recipient [4:7568544170866189024:2388]: NKikimr::TEvPQ::TEvTabletCacheCounters
2025-11-03T16:56:59.872334Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5328: HandleHook, processing event TEvPQ::TEvTabletCacheCounters
2025-11-03T16:56:59.872346Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:1186: [PQ: 72075186224037892] Topic 'rt3.dc1--test-topic' counters. CacheSize 4056 CachedBlobs 21
2025-11-03T16:56:59.872369Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271188493, Sender [4:7568544170866189065:2388], Recipient [4:7568544170866189024:2388]: NKikimr::TEvPQ::TEvProxyResponse
2025-11-03T16:56:59.872378Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5335: HandleHook, processing event TEvPQ::TEvProxyResponse
2025-11-03T16:56:59.872413Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271188493, Sender [4:7568544170866189065:2388], Recipient [4:7568544170866189024:2388]: NKikimr::TEvPQ::TEvProxyResponse
2025-11-03T16:56:59.872419Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5335: HandleHook, processing event TEvPQ::TEvProxyResponse
2025-11-03T16:56:59.872443Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271188493, Sender [4:7568544170866189065:2388], Recipient [4:7568544170866189024:2388]: NKikimr::TEvPQ::TEvProxyResponse
2025-11-03T16:56:59.872451Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5335: HandleHook, processing event TEvPQ::TEvProxyResponse
2025-11-03T16:56:59.872474Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271188493, Sender [4:7568544170866189065:2388], Recipient [4:7568544170866189024:2388]: NKikimr::TEvPQ::TEvProxyResponse
2025-11-03T16:56:59.872481Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5335: HandleHook, processing event TEvPQ::TEvProxyResponse
2025-11-03T16:56:59.872494Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1  requestId: <none> cookie: 1
2025-11-03T16:56:59.872547Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188562 (NKikimr::TEvPQ::TEvTxBatchComplete), Tablet [4:7568544170866189024:2388], Partition 0, Sender [4:7568544170866189065:2388], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:56:59.872565Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188562, Sender [4:7568544170866189065:2388], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvTxBatchComplete
2025-11-03T16:56:59.872579Z node 4 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-03T16:56:59.872665Z node 4 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 0 count 4 size 536
2025-11-03T16:56:59.872803Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 270794752, Sender [4:7568544170866189047:2388], Recipient [4:7568544170866189024:2388]: NKikimrClient.TKeyValueRequest Cookie: 22 CmdDeleteRange { Range { From: "x0000000000" IncludeFrom: true To: "x0000000001" IncludeTo: false } } CmdWrite { Key: "m0000000000p\000test-message-group-id1" Value: "\010\016\020\033\030\207\346\271\324\271\326\220\003 \366\231\231\320\271\326\220\003(\000H\001" StorageChannel: INLINE } CmdWrite { Key: "d0000000000_00000000000000000024_00000_0000000004_00000?" Value: "\022\000\010\030\020\000\030\004 \000(\360\0040\204\0048\001@\000\010\000\000\000\036\000\000\001\002\003\001\004\035\000\000\000\024\000\000test-message-group-id1\027\000\000\000\006\000\000\000\037\000\013\001\001\001\232\001\000\000\024\000\010\013\030\260\205\232\325\2443B\020ipv6:[::1]:58284P\001\342\007$\n\020ipv6:[::1]:58284\032\007unknown\"\007unknown\372\007\033\037\213\010\000\000\000\000\000\000\003\313M-.NLO\005\000\1770\275\266\007\000\000\000\010\014\030\260\205\232\325\2443B\020ipv6:[::1]:58284P\001\342\007$\n\020ipv6:[::1]:58284\032\007unknown\"\007unknown\372\007
2025-11-03T16:56:59.872941Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 270794753, Sender [4:7568544209520895227:2388], Recipient [4:7568544170866189024:2388]: NKikimr::TEvKeyValue::TEvIntermediate
2025-11-03T16:56:59.873309Z node 4 :PERSQUEUE TRACE: pq_l2_cache.h:116: StateFunc, received event# 271450112, Sender [4:7568544170866189047:2388], Recipient [4:7568544115031613334:2071]: NKikimr::NPQ::TEvPqCache::TEvCacheL2Request
2025-11-03T16:56:59.873323Z node 4 :PERSQUEUE TRACE: pq_l2_cache.h:119: StateFunc, processing event TEvPqCache::TEvCacheL2Request
2025-11-03T16:56:59.875691Z :DEBUG: [/Root] MessageGroupId [test-message-group-id2] SessionId [test-message-group-id2|6160131f-a6fd3c42-69db7e8f-68435845_0] Write session got write response: sequence_numbers: 11 sequence_numbers: 12 sequence_numbers: 13 sequence_numbers: 14 offsets: 20 offsets: 21 offsets: 22 offsets: 23 already_written: false already_written: false already_written: false already_written: false write_statistics { persist_duration_ms: 6 queued_in_partition_duration_ms: 1 }
2025-11-03T16:56:59.875738Z :DEBUG: [/Root] MessageGroupId [test-message-group-id2] SessionId [test-message-group-id2|6160131f-a6fd3c42-69db7e8f-68435845_0] Write session: acknoledged message 2
2025-11-03T16:56:59.875777Z :DEBUG: [/Root] MessageGroupId [test-message-group-id2] SessionId [test-message-group-id2|6160131f-a6fd3c42-69db7e8f-68435845_0] Write session: acknoledged message 3
2025-11-03T16:56:59.875800Z :DEBUG: [/Root] MessageGroupId [test-message-group-id2] SessionId [test-message-group-id2|6160131f-a6fd3c42-69db7e8f-68435845_0] Write session: acknoledged message 4
2025-11-03T16:56:59.875833Z :DEBUG: [/Root] MessageGroupId [test-message-group-id2] SessionId [test-message-group-id2|6160131f-a6fd3c42-69db7e8f-68435845_0] Write session: acknoledged message 5
2025-11-03T16:56:59.873359Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 20 partno 0 count 4 parts 0 suffix '63' size 536
2025-11-03T16:56:59.880283Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 24 count 4 size 536 actorID [4:7568544170866189047:2388]
2025-11-03T16:56:59.880398Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 270795264 (NKikimr::TEvKeyValue::TEvResponse), Tablet [4:7568544170866189024:2388], Partition 0, Sender [4:7568544170866189047:2388], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:56:59.880531Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 270795264, Sender [4:7568544170866189047:2388], Recipient [4:7568544170866189065:2388]: NKikimrClient.TResponse Status: 1 DeleteRangeResult { Status: 0 } WriteResult { Status: 0 StatusFlags: 1 } WriteResult { Status: 0 StatusFlags: 1 } WriteResult { Status: 0 StatusFlags: 1 }
2025-11-03T16:56:59.880552Z node 4 :PERSQUEUE TRACE: partition.h:625: StateIdle, processing event TEvKeyValue::TEvResponse
2025-11-03T16:56:59.880570Z node 4 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-03T16:56:59.880596Z node 4 :PERSQUEUE TRACE: partition_write.cpp:518: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse.
2025-11-03T16:56:59.880631Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 484 WriteNewSizeFromSupportivePartitions# 0
2025-11-03T16:56:59.880649Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=4
2025-11-03T16:56:59.880683Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:56:59.880718Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0test-message-group-id1', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 11, partNo: 0, Offset: 24 is stored on disk
2025-11-03T16:56:59.880738Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:56:59.880768Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0test-message-group-id1', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 12, partNo: 0, Offset: 25 is stored on disk
2025-11-03T16:56:59.880781Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:56:59.880804Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0test-message-group-id1', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 13, partNo: 0, Offset: 26 is stored on disk
2025-11-03T16:56:59.880820Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:56:59.880843Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0test-message-group-id1', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 14, partNo: 0, Offset: 27 is stored on disk
2025-11-03T16:56:59.880853Z node 4 :PERSQUEUE TRACE: partition_write.cpp:424: [72075186224037892][Partition][0][StateIdle] TPartition::SyncMemoryStateWithKVState.
2025-11-03T16:56:59.881017Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:59.881031Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:59.881043Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:59.881057Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:59.881116Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:59.881130Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:59.881149Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:59.881165Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:56:59.881233Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271188493, Sender [4:7568544170866189065:2388], Recipient [4:7568544170866189024:2388]: NKikimr::TEvPQ::TEvProxyResponse
2025-11-03T16:56:59.881250Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5335: HandleHook, processing event TEvPQ::TEvProxyResponse
2025-11-03T16:56:59.881296Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271188493, Sender [4:7568544170866189065:2388], Recipient [4:7568544170866189024:2388]: NKikimr::TEvPQ::TEvProxyResponse
2025-11-03T16:56:59.881306Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5335: HandleHook, processing event TEvPQ::TEvProxyResponse
2025-11-03T16:56:59.881339Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271188493, Sender [4:7568544170866189065:2388], Recipient [4:7568544170866189024:2388]: NKikimr::TEvPQ::TEvProxyResponse
2025-11-03T16:56:59.881348Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5335: HandleHook, processing event TEvPQ::TEvProxyResponse
2025-11-03T16:56:59.881379Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271188493, Sender [4:7568544170866189065:2388], Recipient [4:7568544170866189024:2388]: NKikimr::TEvPQ::TEvProxyResponse
2025-11-03T16:56:59.881389Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5335: HandleHook, processing event TEvPQ::TEvProxyResponse
2025-11-03T16:56:59.881405Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1  requestId: <none> cookie: 1
2025-11-03T16:56:59.881984Z node 4 :PERSQUEUE TRACE: pq_l2_cache.h:116: StateFunc, received event# 271450112, Sender [4:7568544170866189047:2388], Recipient [4:7568544115031613334:2071]: NKikimr::NPQ::TEvPqCache::TEvCacheL2Request
2025-11-03T16:56:59.882011Z node 4 :PERSQUEUE TRACE: pq_l2_cache.h:119: StateFunc, processing event TEvPqCache::TEvCacheL2Request
2025-11-03T16:56:59.882057Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 24 partno 0 count 4 parts 0 suffix '63' size 536
2025-11-03T16:56:59.883119Z :DEBUG: [/Root] MessageGroupId [test-message-group-id1] SessionId [test-message-group-id1|bb79c232-820d67a4-af8eac61-e41d2e7b_0] Write session got write response: sequence_numbers: 11 sequence_numbers: 12 sequence_numbers: 13 sequence_numbers: 14 offsets: 24 offsets: 25 offsets: 26 offsets: 27 already_written: false already_written: false already_written: false already_written: false write_statistics { persist_duration_ms: 8 queued_in_partition_duration_ms: 1 }
2025-11-03T16:56:59.883178Z :DEBUG: [/Root] MessageGroupId [test-message-group-id1] SessionId [test-message-group-id1|bb79c232-820d67a4-af8eac61-e41d2e7b_0] Write session: acknoledged message 2
2025-11-03T16:56:59.883213Z :DEBUG: [/Root] MessageGroupId [test-message-group-id1] SessionId [test-message-group-id1|bb79c232-820d67a4-af8eac61-e41d2e7b_0] Write session: acknoledged message 3
2025-11-03T16:56:59.883249Z :DEBUG: [/Root] MessageGroupId [test-message-group-id1] SessionId [test-message-group-id1|bb79c232-820d67a4-af8eac61-e41d2e7b_0] Write session: acknoledged message 4
2025-11-03T16:56:59.883284Z :DEBUG: [/Root] MessageGroupId [test-message-group-id1] SessionId [test-message-group-id1|bb79c232-820d67a4-af8eac61-e41d2e7b_0] Write session: acknoledged message 5
===Messages were written
2025-11-03T16:56:59.883523Z :TWriteSession_SeqNoShift DEBUG: Close writer (stop)
2025-11-03T16:56:59.882271Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:56:59.883532Z :TWriteSession_SeqNoShift INFO: Wait for client write event loop to stop
2025-11-03T16:56:59.883578Z :INFO: [/Root] MessageGroupId [test-message-group-id1] SessionId [test-message-group-id1|bb79c232-820d67a4-af8eac61-e41d2e7b_0] Write session: close. Timeout = 0 ms
2025-11-03T16:56:59.883607Z :INFO: [/Root] MessageGroupId [test-message-group-id1] SessionId [test-message-group-id1|bb79c232-820d67a4-af8eac61-e41d2e7b_0] Write session will now close
2025-11-03T16:56:59.883642Z :DEBUG: [/Root] MessageGroupId [test-message-group-id1] SessionId [test-message-group-id1|bb79c232-820d67a4-af8eac61-e41d2e7b_0] Write session: aborting
2025-11-03T16:56:59.884182Z :INFO: [/Root] MessageGroupId [test-message-group-id1] SessionId [test-message-group-id1|bb79c232-820d67a4-af8eac61-e41d2e7b_0] Write session: gracefully shut down, all writes complete
2025-11-03T16:56:59.884231Z :DEBUG: [/Root] MessageGroupId [test-message-group-id1] SessionId [test-message-group-id1|bb79c232-820d67a4-af8eac61-e41d2e7b_0] Write session: destroy
2025-11-03T16:56:59.884312Z :TWriteSession_SeqNoShift DEBUG: Writer closed
2025-11-03T16:56:59.886236Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 5 sessionId: test-message-group-id1|bb79c232-820d67a4-af8eac61-e41d2e7b_0 grpc read done: success: 0 data: 
2025-11-03T16:56:59.886265Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 5 sessionId: test-message-group-id1|bb79c232-820d67a4-af8eac61-e41d2e7b_0 grpc read failed
2025-11-03T16:56:59.886298Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 5 sessionId: test-message-group-id1|bb79c232-820d67a4-af8eac61-e41d2e7b_0 grpc closed
2025-11-03T16:56:59.886316Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 5 sessionId: test-message-group-id1|bb79c232-820d67a4-af8eac61-e41d2e7b_0 is DEAD
2025-11-03T16:56:59.887013Z node 3 :PQ_PARTITION_CHOOSER TRACE: partition_chooser_impl__abstract_chooser_actor.h:278: StateIdle, received event# 65543, Sender [3:7568544209528442517:2598], Recipient [3:7568544209528442527:2598]: NActors::TEvents::TEvPoison
2025-11-03T16:56:59.887059Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-11-03T16:56:59.888120Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 269877764, Sender [4:7568544209520895223:2681], Recipient [4:7568544170866189024:2388]: NKikimr::TEvTabletPipe::TEvServerDisconnected
2025-11-03T16:56:59.888170Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5331: HandleHook, processing event TEvTabletPipe::TEvServerDisconnected
2025-11-03T16:56:59.888190Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:2729: [PQ: 72075186224037892] Handle TEvTabletPipe::TEvServerDisconnected
2025-11-03T16:56:59.888223Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [3:7568544209528442586:2598] destroyed
2025-11-03T16:56:59.888295Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188506 (NKikimr::TEvPQ::TEvPipeDisconnected), Tablet [4:7568544170866189024:2388], Partition 0, Sender [4:7568544170866189024:2388], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:56:59.888330Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188506, Sender [4:7568544170866189024:2388], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvPipeDisconnected
2025-11-03T16:56:59.888357Z node 4 :PERSQUEUE TRACE: partition.h:651: StateIdle, processing event TEvPQ::TEvPipeDisconnected
2025-11-03T16:56:59.888377Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-11-03T16:56:59.888402Z node 4 :PERSQUEUE TRACE: partition_write.cpp:873: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessChangeOwnerRequests.
2025-11-03T16:56:59.888419Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:59.888432Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:59.888445Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:59.888470Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:59.888524Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:59.888537Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:59.888563Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:59.893617Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [4:7568544170866189024:2388], Partition 0, Sender [0:0:0], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:56:59.893673Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:59.893694Z node 4 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:59.893718Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:59.893733Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:59.893747Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:59.893767Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:59.893819Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:59.893841Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:59.893864Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:59.895685Z :TWriteSession_SeqNoShift INFO: Client write event loop stopped
===Writer 1 closed
====ExpectBreakDown
===Disable dc1
===Update clusters: UPDATE `/Root/PQ/Config/V2/Cluster` SET enabled = false where name = "dc1";
2025-11-03T16:56:59.942376Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:56:59.942439Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:59.942470Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:59.942499Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:59.942515Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:59.942526Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:59.942548Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:59.942605Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:59.942619Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:59.942640Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:56:59.993604Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [4:7568544170866189024:2388], Partition 0, Sender [0:0:0], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:56:59.993660Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:59.993683Z node 4 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:56:59.993710Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:56:59.993724Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:56:59.993737Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:56:59.993757Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:56:59.993806Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:56:59.993819Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:56:59.993839Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:57:00.042810Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:57:00.042873Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:00.042893Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:00.042939Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:57:00.042954Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:57:00.042966Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:57:00.042985Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:57:00.043042Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:57:00.043054Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:57:00.043074Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:57:00.094006Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [4:7568544170866189024:2388], Partition 0, Sender [0:0:0], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:57:00.094064Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:00.094085Z node 4 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:00.094110Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:57:00.094123Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:57:00.094137Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:57:00.094156Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:57:00.094225Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:57:00.094239Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:57:00.094258Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:57:00.128375Z node 3 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976720693. Ctx: { TraceId: 01k95ad2rq66wvb260ev321fks, Database: , SessionId: ydb://session/3?node_id=3&id=NDgyNDhjNWItODBkNDMyZjctZDcxMTkzNTgtMjk5ZTAxMDU=, PoolId: default, DatabaseId: /Root}. Database not set, use /Root
2025-11-03T16:57:00.145655Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:57:00.145721Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:00.145757Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:00.145790Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:57:00.145804Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:57:00.145815Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:57:00.145836Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:57:00.145889Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:57:00.145900Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:57:00.145933Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
===Wait for retries after dc1 shutdown
2025-11-03T16:57:00.196126Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [4:7568544170866189024:2388], Partition 0, Sender [0:0:0], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:57:00.196196Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:00.196223Z node 4 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:00.196252Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:57:00.196268Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:57:00.196282Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:57:00.196304Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:57:00.196360Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:57:00.196374Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:57:00.196395Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:57:00.240373Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 270794759, Sender [4:7568544170866189040:2389], Recipient [4:7568544170866189024:2388]: NKikimr::NKeyValue::TChannelBalancer::TEvUpdateWeights
2025-11-03T16:57:00.249951Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:57:00.250033Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:00.250057Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:00.250091Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:57:00.250106Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:57:00.250119Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:57:00.250139Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:57:00.250225Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:57:00.250247Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:57:00.250270Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:57:00.256224Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 65538, Sender [0:0:0], Recipient [4:7568544170866189024:2388]: NActors::TEvents::TEvWakeup
2025-11-03T16:57:00.297909Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [4:7568544170866189024:2388], Partition 0, Sender [0:0:0], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:57:00.297975Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:00.297999Z node 4 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:00.298027Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:57:00.298041Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:57:00.298053Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:57:00.298074Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:57:00.298129Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:57:00.298143Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:57:00.298165Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:57:00.307965Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 65538 (NActors::TEvents::TEvWakeup), Tablet [4:7568544170866189024:2388], Partition 0, Sender [0:0:0], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:57:00.308056Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 65538, Sender [0:0:0], Recipient [4:7568544170866189065:2388]: NActors::TEvents::TEvWakeup
2025-11-03T16:57:00.308268Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:57:00.308368Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271188501, Sender [4:7568544170866189065:2388], Recipient [4:7568544170866189024:2388]: NKikimr::TEvPQ::TEvPartitionCounters
2025-11-03T16:57:00.308395Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5324: HandleHook, processing event TEvPQ::TEvPartitionCounters
2025-11-03T16:57:00.308411Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:1078: [PQ: 72075186224037892] Handle TEvPQ::TEvPartitionCounters PartitionId 0
2025-11-03T16:57:00.308599Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271188503, Sender [4:7568544170866189065:2388], Recipient [4:7568544170866189024:2388]: NKikimr::TEvPQ::TEvPartitionLabeledCounters
2025-11-03T16:57:00.308624Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5326: HandleHook, processing event TEvPQ::TEvPartitionLabeledCounters
2025-11-03T16:57:00.308665Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271188503, Sender [4:7568544170866189065:2388], Recipient [4:7568544170866189024:2388]: NKikimr::TEvPQ::TEvPartitionLabeledCounters
2025-11-03T16:57:00.308676Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5326: HandleHook, processing event TEvPQ::TEvPartitionLabeledCounters
2025-11-03T16:57:00.321668Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188544 (NKikimr::NPQ::NReadQuoterEvents::TEvQuotaCountersUpdated), Tablet [4:7568544170866189024:2388], Partition 0, Sender [4:7568544170866189068:2388], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:57:00.321736Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188544, Sender [4:7568544170866189068:2388], Recipient [4:7568544170866189065:2388]: NKikimr::NPQ::NReadQuoterEvents::TEvQuotaCountersUpdated
2025-11-03T16:57:00.321761Z node 4 :PERSQUEUE TRACE: partition.h:671: StateIdle, processing event NReadQuoterEvents::TEvQuotaCountersUpdated
2025-11-03T16:57:00.332180Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188544 (NKikimr::NPQ::NReadQuoterEvents::TEvQuotaCountersUpdated), Tablet [2:7568544108397207262:2383], Partition 0, Sender [2:7568544108397207306:2383], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:57:00.332251Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188544, Sender [2:7568544108397207306:2383], Recipient [2:7568544108397207303:2383]: NKikimr::NPQ::NReadQuoterEvents::TEvQuotaCountersUpdated
2025-11-03T16:57:00.332274Z node 2 :PERSQUEUE TRACE: partition.h:671: StateIdle, processing event NReadQuoterEvents::TEvQuotaCountersUpdated
2025-11-03T16:57:00.350381Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:57:00.350457Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:00.350480Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:00.350512Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:57:00.350526Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:57:00.350538Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:57:00.350569Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:57:00.350630Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:57:00.350641Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:57:00.350671Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:57:00.398190Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [4:7568544170866189024:2388], Partition 0, Sender [0:0:0], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:57:00.398250Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:00.398281Z node 4 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:00.398320Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:57:00.398333Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:57:00.398346Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:57:00.398367Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:57:00.398423Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:57:00.398435Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:57:00.398457Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:57:00.453844Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:57:00.453923Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:00.453949Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:00.453982Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:57:00.453998Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:57:00.454010Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:57:00.454032Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:57:00.454094Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:57:00.454110Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:57:00.454134Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:57:00.498520Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [4:7568544170866189024:2388], Partition 0, Sender [0:0:0], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:57:00.498587Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:00.498624Z node 4 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:00.498669Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:57:00.498684Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:57:00.498696Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:57:00.498716Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:57:00.498776Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:57:00.498789Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:57:00.498809Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:57:00.555808Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:57:00.555889Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:00.555910Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:00.555947Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:57:00.555962Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:57:00.555991Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:57:00.556016Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:57:00.556078Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:57:00.556092Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:57:00.556112Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:57:00.599905Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [4:7568544170866189024:2388], Partition 0, Sender [0:0:0], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:57:00.599955Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:00.599995Z node 4 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:00.600024Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:57:00.600038Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:57:00.600049Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:57:00.600072Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:57:00.600133Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:57:00.600147Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:57:00.600170Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:57:00.655849Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:57:00.655924Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:00.655949Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:00.655996Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:57:00.656010Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:57:00.656023Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:57:00.656043Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:57:00.656107Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:57:00.656120Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:57:00.656142Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:57:00.704177Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [4:7568544170866189024:2388], Partition 0, Sender [0:0:0], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:57:00.704254Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:00.704280Z node 4 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:00.704315Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:57:00.704331Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:57:00.704345Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:57:00.704381Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:57:00.704449Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:57:00.704462Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:57:00.704485Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:57:00.760613Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:57:00.760693Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:00.760720Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:00.760754Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:57:00.760771Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:57:00.760786Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:57:00.760811Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:57:00.760873Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:57:00.760888Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:57:00.760912Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:57:00.813801Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [4:7568544170866189024:2388], Partition 0, Sender [0:0:0], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:57:00.813870Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:00.813899Z node 4 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:00.813929Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:57:00.813947Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:57:00.813962Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:57:00.813984Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:57:00.814058Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:57:00.814074Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:57:00.814097Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:57:00.856959Z node 3 :PQ_PARTITION_CHOOSER TRACE: partition_chooser_impl__abstract_chooser_actor.h:278: StateIdle, received event# 278396931, Sender [3:7568544209528442516:2597], Recipient [3:7568544209528442519:2597]: NKikimr::NPQ::TEvPartitionChooser::TEvRefreshRequest
2025-11-03T16:57:00.856999Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [3:7568544209528442519:2597] (SourceId=test-message-group-id2, PreferedPartition=(NULL)) Update the table
2025-11-03T16:57:00.860346Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:57:00.860414Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:00.860436Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:00.860472Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:57:00.860488Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:57:00.860502Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:57:00.860524Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:57:00.860582Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:57:00.860596Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:57:00.860619Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:57:00.889048Z node 3 :PQ_PARTITION_CHOOSER TRACE: partition_chooser_impl__abstract_chooser_actor.h:212: StateUpdate, received event# 271646721, Sender [3:7568544115039159497:2257], Recipient [3:7568544209528442519:2597]: NKikimrKqp.TEvQueryResponse Response { PreparedQuery: "57f30a7a-7adee75-3e71fa96-6ac4c743" QueryIssues { position { row: 2 column: 115 } message: "Symbol $CreateTime is not used" end_position { row: 2 column: 115 } issue_code: 4527 severity: 2 } QueryParameters { Name: "$Hash" Type { Kind: Data Data { Scheme: 2 } } } QueryParameters { Name: "$Topic" Type { Kind: Data Data { Scheme: 4608 } } } QueryParameters { Name: "$SourceId" Type { Kind: Data Data { Scheme: 4608 } } } QueryParameters { Name: "$Partition" Type { Kind: Data Data { Scheme: 2 } } } QueryParameters { Name: "$AccessTime" Type { Kind: Data Data { Scheme: 4 } } } TxMeta { } QueryDiagnostics: "" } YdbStatus: SUCCESS ConsumedRu: 2
2025-11-03T16:57:00.889096Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [3:7568544209528442519:2597] (SourceId=test-message-group-id2, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=1 Status=SUCCESS
2025-11-03T16:57:00.889109Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [3:7568544209528442519:2597] (SourceId=test-message-group-id2, PreferedPartition=(NULL)) Start idle
2025-11-03T16:57:00.913648Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [4:7568544170866189024:2388], Partition 0, Sender [0:0:0], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:57:00.913720Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:00.913757Z node 4 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:00.913789Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:57:00.913805Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:57:00.913820Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:57:00.913855Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:57:00.913912Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:57:00.913935Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:57:00.913957Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:57:00.960643Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:57:00.960706Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:00.960727Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:00.960758Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:57:00.960784Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:57:00.960798Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:57:00.960819Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:57:00.960874Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:57:00.960887Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:57:00.960909Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:57:01.014085Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [4:7568544170866189024:2388], Partition 0, Sender [0:0:0], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:57:01.014167Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:01.014196Z node 4 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:01.014223Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:57:01.014241Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:57:01.014256Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:57:01.014296Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:57:01.014357Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:57:01.014372Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:57:01.014396Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:57:01.062392Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:57:01.062470Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:01.062496Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:01.062528Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:57:01.062543Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:57:01.062558Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:57:01.062583Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:57:01.062645Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:57:01.062661Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:57:01.062684Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:57:01.120163Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [4:7568544170866189024:2388], Partition 0, Sender [0:0:0], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:57:01.120244Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:01.120272Z node 4 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:01.120300Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:57:01.120312Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:57:01.120322Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:57:01.120338Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:57:01.120383Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:57:01.120393Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:57:01.120409Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:57:01.167478Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:57:01.167552Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:01.167580Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:01.167616Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:57:01.167633Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:57:01.167649Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:57:01.167674Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:57:01.167735Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:57:01.167750Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:57:01.167773Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:57:01.220839Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [4:7568544170866189024:2388], Partition 0, Sender [0:0:0], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:57:01.220906Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:01.220930Z node 4 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:01.220964Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:57:01.220978Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:57:01.221002Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:57:01.221025Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:57:01.221098Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:57:01.221112Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:57:01.221141Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:57:01.248880Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 65538, Sender [0:0:0], Recipient [2:7568544108397207262:2383]: NActors::TEvents::TEvWakeup
2025-11-03T16:57:01.268545Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:57:01.268622Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:01.268663Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:01.268694Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:57:01.268723Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:57:01.268736Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:57:01.268759Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:57:01.268818Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:57:01.268832Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:57:01.268852Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:57:01.290027Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 65538 (NActors::TEvents::TEvWakeup), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:57:01.290089Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 65538, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NActors::TEvents::TEvWakeup
2025-11-03T16:57:01.290324Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:57:01.290391Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271188501, Sender [2:7568544108397207303:2383], Recipient [2:7568544108397207262:2383]: NKikimr::TEvPQ::TEvPartitionCounters
2025-11-03T16:57:01.290416Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5324: HandleHook, processing event TEvPQ::TEvPartitionCounters
2025-11-03T16:57:01.290438Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:1078: [PQ: 72075186224037892] Handle TEvPQ::TEvPartitionCounters PartitionId 0
2025-11-03T16:57:01.290618Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271188503, Sender [2:7568544108397207303:2383], Recipient [2:7568544108397207262:2383]: NKikimr::TEvPQ::TEvPartitionLabeledCounters
2025-11-03T16:57:01.290634Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5326: HandleHook, processing event TEvPQ::TEvPartitionLabeledCounters
2025-11-03T16:57:01.290674Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271188503, Sender [2:7568544108397207303:2383], Recipient [2:7568544108397207262:2383]: NKikimr::TEvPQ::TEvPartitionLabeledCounters
2025-11-03T16:57:01.290686Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5326: HandleHook, processing event TEvPQ::TEvPartitionLabeledCounters
2025-11-03T16:57:01.321277Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [4:7568544170866189024:2388], Partition 0, Sender [0:0:0], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:57:01.321338Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:01.321360Z node 4 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:01.321387Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:57:01.321401Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:57:01.321413Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:57:01.321433Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:57:01.321502Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:57:01.321513Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:57:01.321534Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:57:01.321603Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188544 (NKikimr::NPQ::NReadQuoterEvents::TEvQuotaCountersUpdated), Tablet [4:7568544170866189024:2388], Partition 0, Sender [4:7568544170866189068:2388], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:57:01.321632Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188544, Sender [4:7568544170866189068:2388], Recipient [4:7568544170866189065:2388]: NKikimr::NPQ::NReadQuoterEvents::TEvQuotaCountersUpdated
2025-11-03T16:57:01.321647Z node 4 :PERSQUEUE TRACE: partition.h:671: StateIdle, processing event NReadQuoterEvents::TEvQuotaCountersUpdated
2025-11-03T16:57:01.333519Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188544 (NKikimr::NPQ::NReadQuoterEvents::TEvQuotaCountersUpdated), Tablet [2:7568544108397207262:2383], Partition 0, Sender [2:7568544108397207306:2383], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:57:01.333568Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188544, Sender [2:7568544108397207306:2383], Recipient [2:7568544108397207303:2383]: NKikimr::NPQ::NReadQuoterEvents::TEvQuotaCountersUpdated
2025-11-03T16:57:01.333584Z node 2 :PERSQUEUE TRACE: partition.h:671: StateIdle, processing event NReadQuoterEvents::TEvQuotaCountersUpdated
2025-11-03T16:57:01.378606Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:57:01.378685Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:01.378709Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:01.378739Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:57:01.378753Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:57:01.378765Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:57:01.378787Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:57:01.378847Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:57:01.378860Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:57:01.378879Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:57:01.424345Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [4:7568544170866189024:2388], Partition 0, Sender [0:0:0], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:57:01.424417Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:01.424440Z node 4 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:01.424481Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:57:01.424494Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:57:01.424507Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:57:01.424526Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:57:01.424584Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:57:01.424596Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:57:01.424616Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:57:01.480160Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:57:01.480231Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:01.480253Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:01.480279Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:57:01.480292Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:57:01.480302Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:57:01.480322Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:57:01.480377Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:57:01.480389Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:57:01.480410Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:57:01.528169Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [4:7568544170866189024:2388], Partition 0, Sender [0:0:0], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:57:01.528244Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:01.528268Z node 4 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:01.528299Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:57:01.528318Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:57:01.528332Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:57:01.528353Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:57:01.528413Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:57:01.528427Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:57:01.528448Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:57:01.571316Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 269877764, Sender [4:7568544209520895222:2680], Recipient [4:7568544170866189024:2388]: NKikimr::TEvTabletPipe::TEvServerDisconnected
2025-11-03T16:57:01.571356Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5331: HandleHook, processing event TEvTabletPipe::TEvServerDisconnected
2025-11-03T16:57:01.571373Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:2729: [PQ: 72075186224037892] Handle TEvTabletPipe::TEvServerDisconnected
2025-11-03T16:57:01.571399Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [3:7568544209528442580:2597] destroyed
2025-11-03T16:57:01.571460Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188506 (NKikimr::TEvPQ::TEvPipeDisconnected), Tablet [4:7568544170866189024:2388], Partition 0, Sender [4:7568544170866189024:2388], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:57:01.571497Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188506, Sender [4:7568544170866189024:2388], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvPipeDisconnected
2025-11-03T16:57:01.571517Z node 4 :PERSQUEUE TRACE: partition.h:651: StateIdle, processing event TEvPQ::TEvPipeDisconnected
2025-11-03T16:57:01.571539Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-11-03T16:57:01.571563Z node 4 :PERSQUEUE TRACE: partition_write.cpp:873: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessChangeOwnerRequests.
2025-11-03T16:57:01.571583Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:57:01.571598Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:57:01.571610Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:57:01.571630Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:57:01.571685Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:57:01.571698Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:57:01.571718Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:57:01.570224Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 4 reason: cluster disabled sessionId: test-message-group-id2|6160131f-a6fd3c42-69db7e8f-68435845_0
2025-11-03T16:57:01.570562Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 4 sessionId: test-message-group-id2|6160131f-a6fd3c42-69db7e8f-68435845_0 is DEAD
2025-11-03T16:57:01.570855Z node 3 :PQ_PARTITION_CHOOSER TRACE: partition_chooser_impl__abstract_chooser_actor.h:278: StateIdle, received event# 65543, Sender [3:7568544209528442516:2597], Recipient [3:7568544209528442519:2597]: NActors::TEvents::TEvPoison
2025-11-03T16:57:01.570900Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
====CreateRetryState
====CreateRetryState Initialized
Test retry state: get retry delay
2025-11-03T16:57:01.573558Z :INFO: [/Root] MessageGroupId [test-message-group-id2] SessionId [test-message-group-id2|6160131f-a6fd3c42-69db7e8f-68435845_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: cluster disabled, code: 500020 
2025-11-03T16:57:01.573595Z :INFO: [/Root] MessageGroupId [test-message-group-id2] SessionId [test-message-group-id2|6160131f-a6fd3c42-69db7e8f-68435845_0] Write session will restart in 2.000000s
2025-11-03T16:57:01.573656Z :INFO: [/Root] MessageGroupId [test-message-group-id2] SessionId [test-message-group-id2|6160131f-a6fd3c42-69db7e8f-68435845_0] Write session: Do CDS request
2025-11-03T16:57:01.573702Z :INFO: [/Root] MessageGroupId [test-message-group-id2] SessionId [test-message-group-id2|6160131f-a6fd3c42-69db7e8f-68435845_0] Do schedule cds request after 2000 ms
===Write four async messages into writer2
2025-11-03T16:57:01.576061Z :TWriteSession_SeqNoShift INFO: Enqueue message with sequence number 6
2025-11-03T16:57:01.576119Z :TWriteSession_SeqNoShift INFO: Enqueue message with sequence number 7
2025-11-03T16:57:01.576168Z :TWriteSession_SeqNoShift INFO: Enqueue message with sequence number 8
2025-11-03T16:57:01.576161Z :DEBUG: [/Root] MessageGroupId [test-message-group-id2] SessionId [test-message-group-id2|6160131f-a6fd3c42-69db7e8f-68435845_0] Write 1 messages with Id from 6 to 6
2025-11-03T16:57:01.576197Z :TWriteSession_SeqNoShift INFO: Enqueue message with sequence number 9
===Enable dc2
===Update clusters: UPDATE `/Root/PQ/Config/V2/Cluster` SET enabled = true where name = "dc2";
2025-11-03T16:57:01.576265Z :TWriteSession_SeqNoShift INFO: Wait for writer event
2025-11-03T16:57:01.576304Z :TWriteSession_SeqNoShift INFO: Got new continue token
2025-11-03T16:57:01.576343Z :DEBUG: [/Root] MessageGroupId [test-message-group-id2] SessionId [test-message-group-id2|6160131f-a6fd3c42-69db7e8f-68435845_0] Write 1 messages with Id from 7 to 7
2025-11-03T16:57:01.576398Z :TWriteSession_SeqNoShift INFO: Wait for writer event
2025-11-03T16:57:01.576428Z :TWriteSession_SeqNoShift INFO: Got new continue token
2025-11-03T16:57:01.576460Z :DEBUG: [/Root] MessageGroupId [test-message-group-id2] SessionId [test-message-group-id2|6160131f-a6fd3c42-69db7e8f-68435845_0] Write 1 messages with Id from 8 to 8
2025-11-03T16:57:01.576484Z :TWriteSession_SeqNoShift INFO: Wait for writer event
2025-11-03T16:57:01.576504Z :TWriteSession_SeqNoShift INFO: Got new continue token
2025-11-03T16:57:01.576528Z :DEBUG: [/Root] MessageGroupId [test-message-group-id2] SessionId [test-message-group-id2|6160131f-a6fd3c42-69db7e8f-68435845_0] Write 1 messages with Id from 9 to 9
2025-11-03T16:57:01.576554Z :TWriteSession_SeqNoShift INFO: Wait for writer event
2025-11-03T16:57:01.576577Z :TWriteSession_SeqNoShift INFO: Got new continue token
2025-11-03T16:57:01.580219Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:57:01.580287Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:01.580310Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:01.580340Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:57:01.580356Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:57:01.580370Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:57:01.580393Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:57:01.580451Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:57:01.580464Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:57:01.580485Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:57:01.628498Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [4:7568544170866189024:2388], Partition 0, Sender [0:0:0], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:57:01.628567Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:01.628590Z node 4 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:01.628619Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:57:01.628634Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:57:01.628646Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:57:01.628667Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:57:01.628725Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:57:01.628738Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:57:01.628757Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:57:01.682141Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:57:01.682207Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:01.682231Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:01.682260Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:57:01.682274Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:57:01.682286Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:57:01.682308Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:57:01.682362Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:57:01.682375Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:57:01.682394Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:57:01.730342Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [4:7568544170866189024:2388], Partition 0, Sender [0:0:0], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:57:01.730465Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:01.730489Z node 4 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:01.730518Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:57:01.730534Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:57:01.730547Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:57:01.730568Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:57:01.730626Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:57:01.730638Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:57:01.730659Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:57:01.784137Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:57:01.784203Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:01.784226Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:01.784256Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:57:01.784271Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:57:01.784284Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:57:01.784305Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:57:01.784361Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:57:01.784373Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:57:01.784393Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:57:01.809919Z node 3 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976720697. Ctx: { TraceId: 01k95ad4dddssrt9wg6zzjy16d, Database: , SessionId: ydb://session/3?node_id=3&id=NDViZmQ4M2YtNmFiYTJjMjMtM2ZhNzcwMDYtMzEzOTM2ODE=, PoolId: default, DatabaseId: /Root}. Database not set, use /Root
2025-11-03T16:57:01.832194Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [4:7568544170866189024:2388], Partition 0, Sender [0:0:0], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:57:01.832302Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:01.832328Z node 4 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:01.832356Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:57:01.832371Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:57:01.832384Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:57:01.832408Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:57:01.832469Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:57:01.832483Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:57:01.832507Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:57:01.887862Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:57:01.887936Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:01.887959Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:01.888006Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:57:01.888022Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:57:01.888035Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:57:01.888058Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:57:01.888120Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:57:01.888136Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:57:01.888158Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:57:01.936264Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [4:7568544170866189024:2388], Partition 0, Sender [0:0:0], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:57:01.936338Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:01.936358Z node 4 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:01.936389Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:57:01.936401Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:57:01.936414Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:57:01.936433Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:57:01.936492Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:57:01.936504Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:57:01.936526Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:57:01.988239Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:57:01.988313Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:01.988334Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:01.988365Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:57:01.988379Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:57:01.988391Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:57:01.988411Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:57:01.988470Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:57:01.988483Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:57:01.988503Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:57:02.040703Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [4:7568544170866189024:2388], Partition 0, Sender [0:0:0], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:57:02.040788Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:02.040818Z node 4 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:02.040860Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:57:02.040878Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:57:02.040893Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:57:02.040916Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:57:02.040980Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:57:02.040996Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:57:02.041021Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:57:02.092245Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:57:02.092313Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:02.092337Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:02.092367Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:57:02.092380Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:57:02.092391Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:57:02.092412Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:57:02.092470Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:57:02.092482Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:57:02.092502Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:57:02.141110Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [4:7568544170866189024:2388], Partition 0, Sender [0:0:0], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:57:02.141180Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:02.141217Z node 4 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:02.141250Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:57:02.141267Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:57:02.141286Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:57:02.141310Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:57:02.141374Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:57:02.141389Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:57:02.141414Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:57:02.195363Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:57:02.195436Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:02.195457Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:02.195491Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:57:02.195506Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:57:02.195519Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:57:02.195540Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:57:02.195604Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:57:02.195617Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:57:02.195639Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:57:02.241282Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [4:7568544170866189024:2388], Partition 0, Sender [0:0:0], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:57:02.241376Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:02.241406Z node 4 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:02.241438Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:57:02.241455Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:57:02.241470Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:57:02.241497Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:57:02.241579Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:57:02.241596Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:57:02.241620Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:57:02.296145Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:57:02.296217Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:02.296241Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:02.296275Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:57:02.296291Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:57:02.296306Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:57:02.296330Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:57:02.296391Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:57:02.296404Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:57:02.296426Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:57:02.324226Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188544 (NKikimr::NPQ::NReadQuoterEvents::TEvQuotaCountersUpdated), Tablet [4:7568544170866189024:2388], Partition 0, Sender [4:7568544170866189068:2388], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:57:02.324318Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188544, Sender [4:7568544170866189068:2388], Recipient [4:7568544170866189065:2388]: NKikimr::NPQ::NReadQuoterEvents::TEvQuotaCountersUpdated
2025-11-03T16:57:02.324343Z node 4 :PERSQUEUE TRACE: partition.h:671: StateIdle, processing event NReadQuoterEvents::TEvQuotaCountersUpdated
2025-11-03T16:57:02.338381Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188544 (NKikimr::NPQ::NReadQuoterEvents::TEvQuotaCountersUpdated), Tablet [2:7568544108397207262:2383], Partition 0, Sender [2:7568544108397207306:2383], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:57:02.338450Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188544, Sender [2:7568544108397207306:2383], Recipient [2:7568544108397207303:2383]: NKikimr::NPQ::NReadQuoterEvents::TEvQuotaCountersUpdated
2025-11-03T16:57:02.338473Z node 2 :PERSQUEUE TRACE: partition.h:671: StateIdle, processing event NReadQuoterEvents::TEvQuotaCountersUpdated
2025-11-03T16:57:02.344267Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [4:7568544170866189024:2388], Partition 0, Sender [0:0:0], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:57:02.344335Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:02.344361Z node 4 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:02.344402Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:57:02.344418Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:57:02.344434Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:57:02.344467Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:57:02.344527Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:57:02.344543Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:57:02.344565Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:57:02.398321Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:57:02.398396Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:02.398423Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:02.398463Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:57:02.398480Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:57:02.398493Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:57:02.398519Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:57:02.398582Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:57:02.398612Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:57:02.398634Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:57:02.444609Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [4:7568544170866189024:2388], Partition 0, Sender [0:0:0], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:57:02.444726Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:02.444768Z node 4 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:02.444813Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:57:02.444830Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:57:02.444843Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:57:02.444866Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:57:02.444924Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:57:02.444941Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:57:02.444963Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:57:02.500169Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:57:02.500248Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:02.500275Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:02.500310Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:57:02.500326Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:57:02.500338Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:57:02.500363Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:57:02.500429Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:57:02.500447Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:57:02.500472Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:57:02.546228Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [4:7568544170866189024:2388], Partition 0, Sender [0:0:0], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:57:02.546298Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:02.546329Z node 4 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:02.546365Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:57:02.546381Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:57:02.546393Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:57:02.546415Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:57:02.546473Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:57:02.546486Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:57:02.546507Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:57:02.604169Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:57:02.604246Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:02.604273Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:02.604310Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:57:02.604326Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:57:02.604342Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:57:02.604368Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:57:02.604433Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:57:02.604448Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:57:02.604470Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:57:02.647593Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [4:7568544170866189024:2388], Partition 0, Sender [0:0:0], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:57:02.647668Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:02.647706Z node 4 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:02.647734Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:57:02.647750Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:57:02.647764Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:57:02.647789Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:57:02.647848Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:57:02.647863Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:57:02.647884Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:57:02.704313Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:57:02.704388Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:02.704419Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:02.704459Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:57:02.704476Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:57:02.704492Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:57:02.704515Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:57:02.704576Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:57:02.704590Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:57:02.704613Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:57:02.752240Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [4:7568544170866189024:2388], Partition 0, Sender [0:0:0], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:57:02.752306Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:02.752332Z node 4 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:02.752361Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:57:02.752377Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:57:02.752392Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:57:02.752415Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:57:02.752477Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:57:02.752492Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:57:02.752515Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:57:02.804487Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:57:02.804556Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:02.804584Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:02.804614Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:57:02.804628Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:57:02.804641Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:57:02.804663Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:57:02.804722Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:57:02.804737Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:57:02.804760Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:57:02.853750Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [4:7568544170866189024:2388], Partition 0, Sender [0:0:0], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:57:02.853848Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:02.853871Z node 4 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:02.853903Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:57:02.853918Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:57:02.853931Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:57:02.853956Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:57:02.854015Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:57:02.854030Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:57:02.854050Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:57:02.906816Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:57:02.906881Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:02.906902Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:02.906949Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:57:02.906965Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:57:02.906980Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:57:02.907002Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:57:02.907070Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:57:02.907088Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:57:02.907109Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:57:02.954418Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [4:7568544170866189024:2388], Partition 0, Sender [0:0:0], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:57:02.954478Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:02.954513Z node 4 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:02.954540Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:57:02.954553Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:57:02.954565Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:57:02.954587Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:57:02.954643Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:57:02.954657Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:57:02.954690Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:57:03.007296Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:57:03.007367Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:03.007393Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:03.007426Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:57:03.007442Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:57:03.007456Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:57:03.007478Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:57:03.007541Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:57:03.007556Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:57:03.007578Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:57:03.056311Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [4:7568544170866189024:2388], Partition 0, Sender [0:0:0], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:57:03.056378Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:03.056401Z node 4 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:03.056432Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:57:03.056449Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:57:03.056462Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:57:03.056484Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:57:03.056543Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:57:03.056558Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:57:03.056580Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:57:03.108113Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:57:03.108190Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:03.108211Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:03.108241Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:57:03.108255Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:57:03.108266Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:57:03.108287Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:57:03.108346Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:57:03.108359Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:57:03.108379Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:57:03.156856Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [4:7568544170866189024:2388], Partition 0, Sender [0:0:0], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:57:03.156922Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:03.156948Z node 4 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:03.156977Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:57:03.156993Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:57:03.157007Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:57:03.157027Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:57:03.157084Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:57:03.157097Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:57:03.157118Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:57:03.208455Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:57:03.208519Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:03.208544Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:03.208574Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:57:03.208588Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:57:03.208601Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:57:03.208622Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:57:03.208691Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:57:03.208705Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:57:03.208726Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:57:03.256975Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [4:7568544170866189024:2388], Partition 0, Sender [0:0:0], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:57:03.257030Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:03.257053Z node 4 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:03.257083Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:57:03.257096Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:57:03.257107Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:57:03.257127Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:57:03.257192Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:57:03.257207Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:57:03.257227Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:57:03.310826Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:57:03.310891Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:03.310925Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:03.310946Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:57:03.310956Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:57:03.310966Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:57:03.310981Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:57:03.311023Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:57:03.311033Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:57:03.311047Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:57:03.324731Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188544 (NKikimr::NPQ::NReadQuoterEvents::TEvQuotaCountersUpdated), Tablet [4:7568544170866189024:2388], Partition 0, Sender [4:7568544170866189068:2388], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:57:03.324788Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188544, Sender [4:7568544170866189068:2388], Recipient [4:7568544170866189065:2388]: NKikimr::NPQ::NReadQuoterEvents::TEvQuotaCountersUpdated
2025-11-03T16:57:03.324807Z node 4 :PERSQUEUE TRACE: partition.h:671: StateIdle, processing event NReadQuoterEvents::TEvQuotaCountersUpdated
2025-11-03T16:57:03.336503Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188544 (NKikimr::NPQ::NReadQuoterEvents::TEvQuotaCountersUpdated), Tablet [2:7568544108397207262:2383], Partition 0, Sender [2:7568544108397207306:2383], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:57:03.336584Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188544, Sender [2:7568544108397207306:2383], Recipient [2:7568544108397207303:2383]: NKikimr::NPQ::NReadQuoterEvents::TEvQuotaCountersUpdated
2025-11-03T16:57:03.336611Z node 2 :PERSQUEUE TRACE: partition.h:671: StateIdle, processing event NReadQuoterEvents::TEvQuotaCountersUpdated
2025-11-03T16:57:03.357383Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [4:7568544170866189024:2388], Partition 0, Sender [0:0:0], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:57:03.357459Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:03.357486Z node 4 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:03.357529Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:57:03.357544Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:57:03.357556Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:57:03.357580Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:57:03.357638Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:57:03.357651Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:57:03.357674Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:57:03.411139Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:57:03.411212Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:03.411239Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:03.411272Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:57:03.411287Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:57:03.411300Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:57:03.411323Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:57:03.411379Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:57:03.411392Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:57:03.411414Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:57:03.458027Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [4:7568544170866189024:2388], Partition 0, Sender [0:0:0], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:57:03.458098Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:03.458123Z node 4 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:03.458152Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:57:03.458169Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:57:03.458193Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:57:03.458216Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:57:03.458273Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:57:03.458286Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:57:03.458308Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:57:03.511493Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:57:03.511561Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:03.511584Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:03.511620Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:57:03.511634Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:57:03.511649Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:57:03.511669Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:57:03.511729Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:57:03.511743Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:57:03.511765Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:57:03.562450Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [4:7568544170866189024:2388], Partition 0, Sender [0:0:0], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:57:03.562518Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:03.562542Z node 4 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:03.562574Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:57:03.562591Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:57:03.562605Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:57:03.562628Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:57:03.562689Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:57:03.562703Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:57:03.562723Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:57:03.574581Z :INFO: [/Root] MessageGroupId [test-message-group-id2] Running cds request ms
2025-11-03T16:57:03.580334Z :INFO: [/Root] MessageGroupId [test-message-group-id2] SessionId [test-message-group-id2|6160131f-a6fd3c42-69db7e8f-68435845_0] Got CDS response: 
write_sessions_clusters { clusters { endpoint: "localhost:13111" name: "dc1" } clusters { endpoint: "localhost:14811" name: "dc2" available: true } primary_cluster_selection_reason: CLIENT_LOCATION } version: 1
2025-11-03T16:57:03.580403Z :INFO: [/Root] MessageGroupId [test-message-group-id2] SessionId [test-message-group-id2|6160131f-a6fd3c42-69db7e8f-68435845_0] Start write session. Will connect to endpoint: localhost:14811
2025-11-03T16:57:03.584905Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-11-03T16:57:03.584934Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 6
2025-11-03T16:57:03.586612Z :DEBUG: [/Root] MessageGroupId [test-message-group-id2] SessionId [test-message-group-id2|6160131f-a6fd3c42-69db7e8f-68435845_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "test-message-group-id2" preferred_cluster: "dc1" }
2025-11-03T16:57:03.587316Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 6 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "test-message-group-id2" preferred_cluster: "dc1" }
2025-11-03T16:57:03.587454Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 6 topic: "test-topic" message_group_id: "test-message-group-id2" preferred_cluster: "dc1" from ipv6:[::1]:55020
2025-11-03T16:57:03.587472Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=6 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:55020 proto=v1  topic=test-topic durationSec=0
2025-11-03T16:57:03.587482Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-11-03T16:57:03.588868Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 6 sessionId:  describe result for acl check
2025-11-03T16:57:03.588946Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-11-03T16:57:03.588953Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-11-03T16:57:03.588960Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-11-03T16:57:03.588974Z node 1 :PQ_PARTITION_CHOOSER TRACE: partition_chooser_impl__abstract_chooser_actor.h:88: TPartitionChooser [1:7568544225216463025:2709] (SourceId=test-message-group-id2, PreferedPartition=(NULL)) InitTable: SourceId=test-message-group-id2 TopicsAreFirstClassCitizen=0 UseSrcIdMetaMappingInFirstClass=1
2025-11-03T16:57:03.588981Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7568544225216463025:2709] (SourceId=test-message-group-id2, PreferedPartition=(NULL)) StartKqpSession
2025-11-03T16:57:03.590808Z node 1 :PQ_PARTITION_CHOOSER TRACE: partition_chooser_impl__abstract_chooser_actor.h:132: StateCreateKqpSession, received event# 271646728, Sender [1:7568544053417768053:2268], Recipient [1:7568544225216463025:2709]: NKikimrKqp.TEvCreateSessionResponse Error: "" Response { SessionId: "ydb://session/3?node_id=1&id=YjYxNjQ5Y2UtMTRiMzAyMjktZDkxYzE3NGUtMzEzNjBjNGQ=" NodeId: 1 } YdbStatus: SUCCESS ResourceExhausted: false
2025-11-03T16:57:03.590823Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7568544225216463025:2709] (SourceId=test-message-group-id2, PreferedPartition=(NULL)) Select from the table
2025-11-03T16:57:03.600968Z node 1 :PQ_PARTITION_CHOOSER TRACE: partition_chooser_impl__abstract_chooser_actor.h:163: StateSelect, received event# 271646721, Sender [1:7568544053417768053:2268], Recipient [1:7568544225216463025:2709]: NKikimrKqp.TEvQueryResponse Response { SessionId: "ydb://session/3?node_id=1&id=YjYxNjQ5Y2UtMTRiMzAyMjktZDkxYzE3NGUtMzEzNjBjNGQ=" PreparedQuery: "bf547082-be61c135-9226a4-6fe85003" QueryParameters { Name: "$Hash" Type { Kind: Data Data { Scheme: 2 } } } QueryParameters { Name: "$Topic" Type { Kind: Data Data { Scheme: 4608 } } } QueryParameters { Name: "$SourceId" Type { Kind: Data Data { Scheme: 4608 } } } TxMeta { id: "01k95ad6b8f5pt1hqydcahdfeb" } YdbResults { columns { name: "Partition" type { optional_type { item { type_id: UINT32 } } } } columns { name: "CreateTime" type { optional_type { item { type_id: UINT64 } } } } columns { name: "AccessTime" type { optional_type { item { type_id: UINT64 } } } } columns { name: "SeqNo" type { optional_type { item { type_id: UINT64 } } } } rows { items { uint32_value: 0 } items { uint64_value: 1762189014912 } items { uint64_value: 1762189017431 } items { uint64_value: 0 } } format: FORMAT_VALUE } QueryDiagnostics: "" } YdbStatus: SUCCESS Cons
2025-11-03T16:57:03.601129Z node 1 :PQ_PARTITION_CHOOSER TRACE: partition_chooser_impl__abstract_chooser_actor.h:151: TPartitionChooser [1:7568544225216463025:2709] (SourceId=test-message-group-id2, PreferedPartition=(NULL)) Selected from table PartitionId=0 SeqNo=0
2025-11-03T16:57:03.601145Z node 1 :PQ_PARTITION_CHOOSER TRACE: partition_chooser_impl__old_chooser_actor.h:113: TPartitionChooser [1:7568544225216463025:2709] (SourceId=test-message-group-id2, PreferedPartition=(NULL)) OnPartitionChosen
2025-11-03T16:57:03.601160Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7568544225216463025:2709] (SourceId=test-message-group-id2, PreferedPartition=(NULL)) Update the table
2025-11-03T16:57:03.610197Z node 1 :PQ_PARTITION_CHOOSER TRACE: partition_chooser_impl__abstract_chooser_actor.h:212: StateUpdate, received event# 271646721, Sender [1:7568544053417768053:2268], Recipient [1:7568544225216463025:2709]: NKikimrKqp.TEvQueryResponse Response { SessionId: "ydb://session/3?node_id=1&id=YjYxNjQ5Y2UtMTRiMzAyMjktZDkxYzE3NGUtMzEzNjBjNGQ=" PreparedQuery: "34f6fc20-f975aeb1-f34c103e-7f2bd9da" QueryParameters { Name: "$AccessTime" Type { Kind: Data Data { Scheme: 4 } } } QueryParameters { Name: "$CreateTime" Type { Kind: Data Data { Scheme: 4 } } } QueryParameters { Name: "$Hash" Type { Kind: Data Data { Scheme: 2 } } } QueryParameters { Name: "$Partition" Type { Kind: Data Data { Scheme: 2 } } } QueryParameters { Name: "$SeqNo" Type { Kind: Data Data { Scheme: 4 } } } QueryParameters { Name: "$SourceId" Type { Kind: Data Data { Scheme: 4608 } } } QueryParameters { Name: "$Topic" Type { Kind: Data Data { Scheme: 4608 } } } TxMeta { } QueryDiagnostics: "" } YdbStatus: SUCCESS ConsumedRu: 1
2025-11-03T16:57:03.610237Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7568544225216463025:2709] (SourceId=test-message-group-id2, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-11-03T16:57:03.610260Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7568544225216463025:2709] (SourceId=test-message-group-id2, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-11-03T16:57:03.610278Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7568544225216463025:2709] (SourceId=test-message-group-id2, PreferedPartition=(NULL)) Start idle
2025-11-03T16:57:03.610309Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 6 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-11-03T16:57:03.611844Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:57:03.611925Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:03.611948Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:03.611999Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:57:03.612015Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:57:03.612028Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:57:03.612047Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:57:03.612114Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:57:03.612127Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:57:03.612148Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:57:03.612222Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 269877761, Sender [2:7568544224361325473:3023], Recipient [2:7568544108397207262:2383]: NKikimr::TEvTabletPipe::TEvServerConnected
2025-11-03T16:57:03.612248Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5330: HandleHook, processing event TEvTabletPipe::TEvServerConnected
2025-11-03T16:57:03.612263Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:2716: [PQ: 72075186224037892] Handle TEvTabletPipe::TEvServerConnected
2025-11-03T16:57:03.612239Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1
2025-11-03T16:57:03.612287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [1:7568544225216463059:2709], now have 1 active actors on pipe
2025-11-03T16:57:03.612481Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271187968, Sender [1:7568544225216463058:2709], Recipient [2:7568544224361325473:3023]
2025-11-03T16:57:03.612517Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5316: HandleHook, processing event TEvPersQueue::TEvRequest
2025-11-03T16:57:03.612562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc2--test-topic' requestId: <none>
2025-11-03T16:57:03.612594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc2--test-topic' partition 0
2025-11-03T16:57:03.612678Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188498 (NKikimr::TEvPQ::TEvChangeOwner), Tablet [2:7568544108397207262:2383], Partition 0, Sender [2:7568544108397207262:2383], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:57:03.612725Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188498, Sender [2:7568544108397207262:2383], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvChangeOwner
2025-11-03T16:57:03.612750Z node 2 :PERSQUEUE TRACE: partition.h:642: StateIdle, processing event TEvPQ::TEvChangeOwner
2025-11-03T16:57:03.612766Z node 2 :PERSQUEUE TRACE: partition_write.cpp:154: [72075186224037892][Partition][0][StateIdle] TPartition::HandleOnWrite TEvChangeOwner.
2025-11-03T16:57:03.612786Z node 2 :PERSQUEUE TRACE: partition_write.cpp:873: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessChangeOwnerRequests.
2025-11-03T16:57:03.612799Z node 2 :PERSQUEUE TRACE: partition_write.cpp:107: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessChangeOwnerRequest.
2025-11-03T16:57:03.612843Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie test-message-group-id2|fa5b977c-bfa74910-1b9ac645-40134b58_0 generated for partition 0 topic 'rt3.dc2--test-topic' owner test-message-group-id2
2025-11-03T16:57:03.612865Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:57:03.612886Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:57:03.612904Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:57:03.612915Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-03T16:57:03.612953Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:57:03.612968Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:57:03.613017Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:57:03.613036Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:57:03.613054Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:57:03.613073Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=1
2025-11-03T16:57:03.613098Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-03T16:57:03.613158Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188562 (NKikimr::TEvPQ::TEvTxBatchComplete), Tablet [2:7568544108397207262:2383], Partition 0, Sender [2:7568544108397207303:2383], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:57:03.613200Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188562, Sender [2:7568544108397207303:2383], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvTxBatchComplete
2025-11-03T16:57:03.613253Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271188493, Sender [2:7568544108397207303:2383], Recipient [2:7568544108397207262:2383]: NKikimr::TEvPQ::TEvProxyResponse
2025-11-03T16:57:03.613277Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5335: HandleHook, processing event TEvPQ::TEvProxyResponse
2025-11-03T16:57:03.613301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc2--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-03T16:57:03.613762Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271187968, Sender [1:7568544225216463058:2709], Recipient [2:7568544224361325473:3023]
2025-11-03T16:57:03.613789Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5316: HandleHook, processing event TEvPersQueue::TEvRequest
2025-11-03T16:57:03.613822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc2--test-topic' requestId: <none>
2025-11-03T16:57:03.613838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc2--test-topic' partition 0
2025-11-03T16:57:03.613895Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188486 (NKikimr::TEvPQ::TEvGetMaxSeqNoRequest), Tablet [2:7568544108397207262:2383], Partition 0, Sender [2:7568544108397207262:2383], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:57:03.613934Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188486, Sender [2:7568544108397207262:2383], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvGetMaxSeqNoRequest
2025-11-03T16:57:03.613956Z node 2 :PERSQUEUE TRACE: partition.h:634: StateIdle, processing event TEvPQ::TEvGetMaxSeqNoRequest
2025-11-03T16:57:03.614011Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271188493, Sender [2:7568544108397207303:2383], Recipient [2:7568544108397207262:2383]: NKikimr::TEvPQ::TEvProxyResponse
2025-11-03T16:57:03.614034Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5335: HandleHook, processing event TEvPQ::TEvProxyResponse
2025-11-03T16:57:03.614069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc2--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-03T16:57:03.614773Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 6 partition: 0 MaxSeqNo: 1 sessionId: test-message-group-id2|fa5b977c-bfa74910-1b9ac645-40134b58_0
2025-11-03T16:57:03.615810Z :INFO: [/Root] MessageGroupId [test-message-group-id2] SessionId [test-message-group-id2|6160131f-a6fd3c42-69db7e8f-68435845_0] Write session established. Init response: last_sequence_number: 1 session_id: "test-message-group-id2|fa5b977c-bfa74910-1b9ac645-40134b58_0" topic: "test-topic" cluster: "dc2" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-11-03T16:57:03.616011Z :DEBUG: [/Root] MessageGroupId [test-message-group-id2] SessionId [test-message-group-id2|fa5b977c-bfa74910-1b9ac645-40134b58_0] Write session: try to update token
2025-11-03T16:57:03.616062Z :DEBUG: [/Root] MessageGroupId [test-message-group-id2] SessionId [test-message-group-id2|fa5b977c-bfa74910-1b9ac645-40134b58_0] Send 4 message(s) (0 left), first sequence number is 6
2025-11-03T16:57:03.616902Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 6 sessionId: test-message-group-id2|fa5b977c-bfa74910-1b9ac645-40134b58_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:57:03.617144Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:57:03.617528Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271187968, Sender [1:7568544225216463058:2709], Recipient [2:7568544224361325473:3023]
2025-11-03T16:57:03.617559Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5316: HandleHook, processing event TEvPersQueue::TEvRequest
2025-11-03T16:57:03.617598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc2--test-topic' requestId: <none>
2025-11-03T16:57:03.617619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc2--test-topic' partition 0
2025-11-03T16:57:03.617680Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188507 (NKikimr::TEvPQ::TEvReserveBytes), Tablet [2:7568544108397207262:2383], Partition 0, Sender [2:7568544108397207262:2383], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:57:03.617716Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188507, Sender [2:7568544108397207262:2383], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvReserveBytes
2025-11-03T16:57:03.617740Z node 2 :PERSQUEUE TRACE: partition.h:650: StateIdle, processing event TEvPQ::TEvReserveBytes
2025-11-03T16:57:03.617756Z node 2 :PERSQUEUE TRACE: partition_write.cpp:220: [72075186224037892][Partition][0][StateIdle] TPartition::HandleOnWrite TEvReserveBytes.
2025-11-03T16:57:03.617774Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:57:03.617834Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271188493, Sender [2:7568544108397207303:2383], Recipient [2:7568544108397207262:2383]: NKikimr::TEvPQ::TEvProxyResponse
2025-11-03T16:57:03.617850Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5335: HandleHook, processing event TEvPQ::TEvProxyResponse
2025-11-03T16:57:03.617864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc2--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-11-03T16:57:03.618193Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:57:03.618551Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271187968, Sender [1:7568544225216463058:2709], Recipient [2:7568544224361325473:3023]
2025-11-03T16:57:03.618571Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5316: HandleHook, processing event TEvPersQueue::TEvRequest
2025-11-03T16:57:03.618627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc2--test-topic' requestId: <none>
2025-11-03T16:57:03.618638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc2--test-topic' partition 0
2025-11-03T16:57:03.618678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc2--test-topic partition: 0 SourceId: '\0test-message-group-id2' SeqNo: 6 partNo : 0 messageNo: 1 size 98 offset: -1
2025-11-03T16:57:03.618693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc2--test-topic partition: 0 SourceId: '\0test-message-group-id2' SeqNo: 7 partNo : 0 messageNo: 1 size 98 offset: -1
2025-11-03T16:57:03.618707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc2--test-topic partition: 0 SourceId: '\0test-message-group-id2' SeqNo: 8 partNo : 0 messageNo: 1 size 98 offset: -1
2025-11-03T16:57:03.618720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc2--test-topic partition: 0 SourceId: '\0test-message-group-id2' SeqNo: 9 partNo : 0 messageNo: 1 size 98 offset: -1
2025-11-03T16:57:03.618788Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188480 (NKikimr::TEvPQ::TEvWrite), Tablet [2:7568544108397207262:2383], Partition 0, Sender [2:7568544108397207262:2383], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:57:03.618814Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188480, Sender [2:7568544108397207262:2383], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvWrite
2025-11-03T16:57:03.618826Z node 2 :PERSQUEUE TRACE: partition.h:628: StateIdle, processing event TEvPQ::TEvWrite
2025-11-03T16:57:03.618836Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:57:03.618879Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:57:03.618906Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:57:03.618924Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (4)
2025-11-03T16:57:03.618963Z node 2 :PERSQUEUE TRACE: partition_write.cpp:1168: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc2--test-topic' partition 0 process write for '\0test-message-group-id2' DisableDeduplication=0 SeqNo=6 LocalSeqNo=1 InitialSeqNo=0 EnableKafkaDeduplication=0 ProducerEpoch=(empty maybe)
2025-11-03T16:57:03.619006Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc2--test-topic' partition 0 part blob processing sourceId '\0test-message-group-id2' seqNo 6 partNo 0
2025-11-03T16:57:03.619936Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc2--test-topic' partition 0 part blob complete sourceId '\0test-message-group-id2' seqNo 6 partNo 0 FormedBlobsCount 0 NewHead: Offset 2 PartNo 0 PackedSize 188 count 1 nextOffset 3 batches 1
2025-11-03T16:57:03.619993Z node 2 :PERSQUEUE TRACE: partition_write.cpp:1168: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc2--test-topic' partition 0 process write for '\0test-message-group-id2' DisableDeduplication=0 SeqNo=7 LocalSeqNo=6 InitialSeqNo=0 EnableKafkaDeduplication=0 ProducerEpoch=(empty maybe)
2025-11-03T16:57:03.620006Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc2--test-topic' partition 0 part blob processing sourceId '\0test-message-group-id2' seqNo 7 partNo 0
2025-11-03T16:57:03.620030Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc2--test-topic' partition 0 part blob complete sourceId '\0test-message-group-id2' seqNo 7 partNo 0 FormedBlobsCount 0 NewHead: Offset 2 PartNo 0 PackedSize 344 count 2 nextOffset 4 batches 1
2025-11-03T16:57:03.620046Z node 2 :PERSQUEUE TRACE: partition_write.cpp:1168: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc2--test-topic' partition 0 process write for '\0test-message-group-id2' DisableDeduplication=0 SeqNo=8 LocalSeqNo=7 InitialSeqNo=0 EnableKafkaDeduplication=0 ProducerEpoch=(empty maybe)
2025-11-03T16:57:03.620056Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc2--test-topic' partition 0 part blob processing sourceId '\0test-message-group-id2' seqNo 8 partNo 0
2025-11-03T16:57:03.620070Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc2--test-topic' partition 0 part blob complete sourceId '\0test-message-group-id2' seqNo 8 partNo 0 FormedBlobsCount 0 NewHead: Offset 2 PartNo 0 PackedSize 500 count 3 nextOffset 5 batches 1
2025-11-03T16:57:03.620088Z node 2 :PERSQUEUE TRACE: partition_write.cpp:1168: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc2--test-topic' partition 0 process write for '\0test-message-group-id2' DisableDeduplication=0 SeqNo=9 LocalSeqNo=8 InitialSeqNo=0 EnableKafkaDeduplication=0 ProducerEpoch=(empty maybe)
2025-11-03T16:57:03.620098Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc2--test-topic' partition 0 part blob processing sourceId '\0test-message-group-id2' seqNo 9 partNo 0
2025-11-03T16:57:03.620114Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc2--test-topic' partition 0 part blob complete sourceId '\0test-message-group-id2' seqNo 9 partNo 0 FormedBlobsCount 0 NewHead: Offset 2 PartNo 0 PackedSize 656 count 4 nextOffset 6 batches 1
2025-11-03T16:57:03.620126Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:57:03.620137Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 1 items to delete old stuff
2025-11-03T16:57:03.620207Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 1 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest CmdDeleteRange { Range { From: "x0000000000" IncludeFrom: true To: "x0000000001" IncludeTo: false } }
2025-11-03T16:57:03.620217Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:57:03.620513Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc2--test-topic' partition 0 compactOffset 2,4 HeadOffset 2 endOffset 2 curOffset 6 d0000000000_00000000000000000002_00000_0000000004_00000? size 536 WTime 1762189023620
2025-11-03T16:57:03.620521Z node 2 :PERSQUEUE TRACE: partition_write.cpp:1459: [72075186224037892][Partition][0][StateIdle] TPartition::AddNewFastWriteBlob
2025-11-03T16:57:03.620567Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:57:03.620624Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188562 (NKikimr::TEvPQ::TEvTxBatchComplete), Tablet [2:7568544108397207262:2383], Partition 0, Sender [2:7568544108397207303:2383], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:57:03.620656Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188562, Sender [2:7568544108397207303:2383], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvTxBatchComplete
2025-11-03T16:57:03.620676Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-03T16:57:03.620758Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 2 partNo 0 count 4 size 536
2025-11-03T16:57:03.620940Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 270794752, Sender [2:7568544108397207286:2383], Recipient [2:7568544108397207262:2383]: NKikimrClient.TKeyValueRequest Cookie: 3 CmdDeleteRange { Range { From: "x0000000000" IncludeFrom: true To: "x0000000001" IncludeTo: false } } CmdWrite { Key: "m0000000000p\000test-message-group-id2" Value: "\010\t\020\005\030\212\316\236\326\271\326\220\003 \225\216\354\322\271\326\220\003(\000H\001" StorageChannel: INLINE } CmdWrite { Key: "d0000000000_00000000000000000002_00000_0000000004_00000?" Value: "\022\000\010\002\020\000\030\004 \000(\360\0040\204\0048\001@\000\010\000\000\000\036\000\000\001\002\003\001\004\035\000\000\000\024\000\000test-message-group-id2\027\000\000\000\006\000\000\000\037\000\006\001\001\001\232\001\000\000\024\000\010\006\030\210\243\232\325\2443B\020ipv6:[::1]:55020P\001\342\007$\n\020ipv6:[::1]:55020\032\007unknown\"\007unknown\372\007\033\037\213\010\000\000\000\000\000\000\003\313M-.NLO\005\000\1770\275\266\007\000\000\000\010\007\030\210\243\232\325\2443B\020ipv6:[::1]:55020P\001\342\007$\n\020ipv6:[::1]:55020\032\007unknown\"\007unknown\372\007\03
2025-11-03T16:57:03.621059Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 270794753, Sender [2:7568544224361325474:2383], Recipient [2:7568544108397207262:2383]: NKikimr::TEvKeyValue::TEvIntermediate
2025-11-03T16:57:03.623903Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 2 count 4 size 536 actorID [2:7568544108397207286:2383]
2025-11-03T16:57:03.624018Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 270795264 (NKikimr::TEvKeyValue::TEvResponse), Tablet [2:7568544108397207262:2383], Partition 0, Sender [2:7568544108397207286:2383], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:57:03.624144Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 270795264, Sender [2:7568544108397207286:2383], Recipient [2:7568544108397207303:2383]: NKikimrClient.TResponse Status: 1 DeleteRangeResult { Status: 0 } WriteResult { Status: 0 StatusFlags: 1 } WriteResult { Status: 0 StatusFlags: 1 } WriteResult { Status: 0 StatusFlags: 1 }
2025-11-03T16:57:03.624171Z node 2 :PERSQUEUE TRACE: partition.h:625: StateIdle, processing event TEvKeyValue::TEvResponse
2025-11-03T16:57:03.624189Z node 2 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-03T16:57:03.624213Z node 2 :PERSQUEUE TRACE: partition_write.cpp:518: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse.
2025-11-03T16:57:03.624251Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 484 WriteNewSizeFromSupportivePartitions# 0
2025-11-03T16:57:03.624266Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=4
2025-11-03T16:57:03.624297Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:57:03.624335Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0test-message-group-id2', Topic: 'rt3.dc2--test-topic', Partition: 0, SeqNo: 6, partNo: 0, Offset: 2 is stored on disk
2025-11-03T16:57:03.624354Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:57:03.624381Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0test-message-group-id2', Topic: 'rt3.dc2--test-topic', Partition: 0, SeqNo: 7, partNo: 0, Offset: 3 is stored on disk
2025-11-03T16:57:03.624394Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:57:03.624416Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0test-message-group-id2', Topic: 'rt3.dc2--test-topic', Partition: 0, SeqNo: 8, partNo: 0, Offset: 4 is stored on disk
2025-11-03T16:57:03.624429Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:57:03.624451Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0test-message-group-id2', Topic: 'rt3.dc2--test-topic', Partition: 0, SeqNo: 9, partNo: 0, Offset: 5 is stored on disk
2025-11-03T16:57:03.624464Z node 2 :PERSQUEUE TRACE: partition_write.cpp:424: [72075186224037892][Partition][0][StateIdle] TPartition::SyncMemoryStateWithKVState.
2025-11-03T16:57:03.624601Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:57:03.624613Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:57:03.624626Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:57:03.624640Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:57:03.624676Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:57:03.624688Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:57:03.624703Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:57:03.624719Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:57:03.624784Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271188502, Sender [2:7568544108397207286:2383], Recipient [2:7568544108397207262:2383]: NKikimr::TEvPQ::TEvTabletCacheCounters
2025-11-03T16:57:03.624801Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5328: HandleHook, processing event TEvPQ::TEvTabletCacheCounters
2025-11-03T16:57:03.624838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1186: [PQ: 72075186224037892] Topic 'rt3.dc2--test-topic' counters. CacheSize 888 CachedBlobs 3
2025-11-03T16:57:03.624872Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271188493, Sender [2:7568544108397207303:2383], Recipient [2:7568544108397207262:2383]: NKikimr::TEvPQ::TEvProxyResponse
2025-11-03T16:57:03.624886Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5335: HandleHook, processing event TEvPQ::TEvProxyResponse
2025-11-03T16:57:03.624933Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271188493, Sender [2:7568544108397207303:2383], Recipient [2:7568544108397207262:2383]: NKikimr::TEvPQ::TEvProxyResponse
2025-11-03T16:57:03.624943Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5335: HandleHook, processing event TEvPQ::TEvProxyResponse
2025-11-03T16:57:03.624976Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271188493, Sender [2:7568544108397207303:2383], Recipient [2:7568544108397207262:2383]: NKikimr::TEvPQ::TEvProxyResponse
2025-11-03T16:57:03.624987Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5335: HandleHook, processing event TEvPQ::TEvProxyResponse
2025-11-03T16:57:03.625019Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271188493, Sender [2:7568544108397207303:2383], Recipient [2:7568544108397207262:2383]: NKikimr::TEvPQ::TEvProxyResponse
2025-11-03T16:57:03.625031Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5335: HandleHook, processing event TEvPQ::TEvProxyResponse
2025-11-03T16:57:03.625047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc2--test-topic' partition: 0 messageNo: 1  requestId: <none> cookie: 1
2025-11-03T16:57:03.625253Z node 2 :PERSQUEUE TRACE: pq_l2_cache.h:116: StateFunc, received event# 271450112, Sender [2:7568544108397207286:2383], Recipient [2:7568544048267664305:2071]: NKikimr::NPQ::TEvPqCache::TEvCacheL2Request
2025-11-03T16:57:03.625275Z node 2 :PERSQUEUE TRACE: pq_l2_cache.h:119: StateFunc, processing event TEvPqCache::TEvCacheL2Request
2025-11-03T16:57:03.625325Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 2 partno 0 count 4 parts 0 suffix '63' size 536
2025-11-03T16:57:03.625647Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-03T16:57:03.626566Z :DEBUG: [/Root] MessageGroupId [test-message-group-id2] SessionId [test-message-group-id2|fa5b977c-bfa74910-1b9ac645-40134b58_0] Write session got write response: sequence_numbers: 6 sequence_numbers: 7 sequence_numbers: 8 sequence_numbers: 9 offsets: 2 offsets: 3 offsets: 4 offsets: 5 already_written: false already_written: false already_written: false already_written: false write_statistics { persist_duration_ms: 4 }
2025-11-03T16:57:03.626614Z :DEBUG: [/Root] MessageGroupId [test-message-group-id2] SessionId [test-message-group-id2|fa5b977c-bfa74910-1b9ac645-40134b58_0] Write session: acknoledged message 6
2025-11-03T16:57:03.626647Z :DEBUG: [/Root] MessageGroupId [test-message-group-id2] SessionId [test-message-group-id2|fa5b977c-bfa74910-1b9ac645-40134b58_0] Write session: acknoledged message 7
2025-11-03T16:57:03.626673Z :DEBUG: [/Root] MessageGroupId [test-message-group-id2] SessionId [test-message-group-id2|fa5b977c-bfa74910-1b9ac645-40134b58_0] Write session: acknoledged message 8
2025-11-03T16:57:03.626696Z :DEBUG: [/Root] MessageGroupId [test-message-group-id2] SessionId [test-message-group-id2|fa5b977c-bfa74910-1b9ac645-40134b58_0] Write session: acknoledged message 9
===Messages were written
====ExpectBreakDown
2025-11-03T16:57:03.626929Z :TWriteSession_SeqNoShift DEBUG: Close writer (stop)
2025-11-03T16:57:03.626932Z :TWriteSession_SeqNoShift INFO: Wait for client write event loop to stop
2025-11-03T16:57:03.627014Z :INFO: [/Root] MessageGroupId [test-message-group-id2] SessionId [test-message-group-id2|fa5b977c-bfa74910-1b9ac645-40134b58_0] Write session: close. Timeout = 0 ms
2025-11-03T16:57:03.627044Z :INFO: [/Root] MessageGroupId [test-message-group-id2] SessionId [test-message-group-id2|fa5b977c-bfa74910-1b9ac645-40134b58_0] Write session will now close
2025-11-03T16:57:03.627076Z :DEBUG: [/Root] MessageGroupId [test-message-group-id2] SessionId [test-message-group-id2|fa5b977c-bfa74910-1b9ac645-40134b58_0] Write session: aborting
2025-11-03T16:57:03.627500Z :INFO: [/Root] MessageGroupId [test-message-group-id2] SessionId [test-message-group-id2|fa5b977c-bfa74910-1b9ac645-40134b58_0] Write session: gracefully shut down, all writes complete
2025-11-03T16:57:03.627580Z :DEBUG: [/Root] MessageGroupId [test-message-group-id2] SessionId [test-message-group-id2|fa5b977c-bfa74910-1b9ac645-40134b58_0] Write session: destroy
2025-11-03T16:57:03.627661Z :TWriteSession_SeqNoShift DEBUG: Writer closed
2025-11-03T16:57:03.628204Z :TWriteSession_SeqNoShift INFO: Client write event loop stopped
===Enable dc1
===Update clusters: UPDATE `/Root/PQ/Config/V2/Cluster` SET enabled = true where name = "dc1";
2025-11-03T16:57:03.634454Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 6 sessionId: test-message-group-id2|fa5b977c-bfa74910-1b9ac645-40134b58_0 grpc read done: success: 0 data: 
2025-11-03T16:57:03.634480Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 6 sessionId: test-message-group-id2|fa5b977c-bfa74910-1b9ac645-40134b58_0 grpc read failed
2025-11-03T16:57:03.635089Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:824: session v1 closed cookie: 6 sessionId: test-message-group-id2|fa5b977c-bfa74910-1b9ac645-40134b58_0
2025-11-03T16:57:03.635113Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 6 sessionId: test-message-group-id2|fa5b977c-bfa74910-1b9ac645-40134b58_0 is DEAD
2025-11-03T16:57:03.635367Z node 1 :PQ_PARTITION_CHOOSER TRACE: partition_chooser_impl__abstract_chooser_actor.h:278: StateIdle, received event# 65543, Sender [1:7568544225216463023:2709], Recipient [1:7568544225216463025:2709]: NActors::TEvents::TEvPoison
2025-11-03T16:57:03.635455Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-11-03T16:57:03.636232Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 269877764, Sender [2:7568544224361325473:3023], Recipient [2:7568544108397207262:2383]: NKikimr::TEvTabletPipe::TEvServerDisconnected
2025-11-03T16:57:03.636266Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5331: HandleHook, processing event TEvTabletPipe::TEvServerDisconnected
2025-11-03T16:57:03.636283Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:2729: [PQ: 72075186224037892] Handle TEvTabletPipe::TEvServerDisconnected
2025-11-03T16:57:03.636312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [1:7568544225216463059:2709] destroyed
2025-11-03T16:57:03.636373Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188506 (NKikimr::TEvPQ::TEvPipeDisconnected), Tablet [2:7568544108397207262:2383], Partition 0, Sender [2:7568544108397207262:2383], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:57:03.636411Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188506, Sender [2:7568544108397207262:2383], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvPipeDisconnected
2025-11-03T16:57:03.636431Z node 2 :PERSQUEUE TRACE: partition.h:651: StateIdle, processing event TEvPQ::TEvPipeDisconnected
2025-11-03T16:57:03.636453Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-11-03T16:57:03.636475Z node 2 :PERSQUEUE TRACE: partition_write.cpp:873: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessChangeOwnerRequests.
2025-11-03T16:57:03.636494Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:57:03.636510Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:57:03.636524Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:57:03.636542Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:57:03.636600Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:57:03.636613Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:57:03.636637Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:57:03.664078Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [4:7568544170866189024:2388], Partition 0, Sender [0:0:0], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:57:03.664146Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:03.664169Z node 4 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:03.664198Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:57:03.664214Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:57:03.664227Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:57:03.664254Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:57:03.664318Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:57:03.664332Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:57:03.664353Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:57:03.712122Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:57:03.712199Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:03.712246Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:03.712276Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:57:03.712309Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:57:03.712323Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:57:03.712345Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:57:03.712421Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:57:03.712435Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:57:03.712462Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:57:03.764543Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [4:7568544170866189024:2388], Partition 0, Sender [0:0:0], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:57:03.764616Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:03.764641Z node 4 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:03.764675Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:57:03.764694Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:57:03.764708Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:57:03.764732Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:57:03.764794Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:57:03.764811Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:57:03.764831Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:57:03.816374Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:57:03.816424Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:03.816447Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:03.816470Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:57:03.816482Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:57:03.816501Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:57:03.816517Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:57:03.816560Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:57:03.816570Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:57:03.816586Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:57:03.868226Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [4:7568544170866189024:2388], Partition 0, Sender [0:0:0], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:57:03.868297Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:03.868322Z node 4 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:03.868354Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:57:03.868369Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:57:03.868383Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:57:03.868408Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:57:03.868470Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:57:03.868486Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:57:03.868509Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:57:03.890545Z node 3 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976720699. Ctx: { TraceId: 01k95ad6dv0s18j7gxht5a1698, Database: , SessionId: ydb://session/3?node_id=3&id=YTA1NzFmOWItYzljNWM1MTgtNTZlM2Q2YWEtYzQzYjFjNTc=, PoolId: default, DatabaseId: /Root}. Database not set, use /Root
2025-11-03T16:57:03.915971Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:57:03.916108Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:03.916131Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:03.916160Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:57:03.916176Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:57:03.916190Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:57:03.916210Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:57:03.916270Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:57:03.916281Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:57:03.916302Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
===Check SeqNo writer1, dc2
2025-11-03T16:57:03.924458Z :DEBUG: [/Root] MessageGroupId [test-message-group-id1] SessionId [] Write session: try to update token
2025-11-03T16:57:03.924536Z :INFO: [/Root] MessageGroupId [test-message-group-id1] SessionId [] Write session: Do CDS request
2025-11-03T16:57:03.924585Z :INFO: [/Root] MessageGroupId [test-message-group-id1] SessionId [] Do schedule cds request after 0 ms
2025-11-03T16:57:03.926684Z :INFO: [/Root] MessageGroupId [test-message-group-id1] Running cds request ms
2025-11-03T16:57:03.935244Z :INFO: [/Root] MessageGroupId [test-message-group-id1] SessionId [] Got CDS response: 
write_sessions_clusters { clusters { endpoint: "localhost:14811" name: "dc2" available: true } clusters { endpoint: "localhost:13111" name: "dc1" } primary_cluster_selection_reason: CLIENT_PREFERENCE } version: 1
2025-11-03T16:57:03.935308Z :INFO: [/Root] MessageGroupId [test-message-group-id1] SessionId [] Start write session. Will connect to endpoint: localhost:14811
2025-11-03T16:57:03.943907Z :DEBUG: [/Root] MessageGroupId [test-message-group-id1] SessionId [] Write session: send init request: init_request { topic: "test-topic" message_group_id: "test-message-group-id1" preferred_cluster: "dc2" }
2025-11-03T16:57:03.943789Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-11-03T16:57:03.943821Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 7
2025-11-03T16:57:03.945159Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 7 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "test-message-group-id1" preferred_cluster: "dc2" }
2025-11-03T16:57:03.945519Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 7 topic: "test-topic" message_group_id: "test-message-group-id1" preferred_cluster: "dc2" from ipv6:[::1]:58396
2025-11-03T16:57:03.945541Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=7 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:58396 proto=v1  topic=test-topic durationSec=0
2025-11-03T16:57:03.945553Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-11-03T16:57:03.949153Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 7 sessionId:  describe result for acl check
2025-11-03T16:57:03.949289Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-11-03T16:57:03.949299Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-11-03T16:57:03.949309Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-11-03T16:57:03.949327Z node 1 :PQ_PARTITION_CHOOSER TRACE: partition_chooser_impl__abstract_chooser_actor.h:88: TPartitionChooser [1:7568544225216463076:2714] (SourceId=test-message-group-id1, PreferedPartition=(NULL)) InitTable: SourceId=test-message-group-id1 TopicsAreFirstClassCitizen=0 UseSrcIdMetaMappingInFirstClass=1
2025-11-03T16:57:03.949340Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7568544225216463076:2714] (SourceId=test-message-group-id1, PreferedPartition=(NULL)) StartKqpSession
2025-11-03T16:57:03.953570Z node 1 :PQ_PARTITION_CHOOSER TRACE: partition_chooser_impl__abstract_chooser_actor.h:132: StateCreateKqpSession, received event# 271646728, Sender [1:7568544053417768053:2268], Recipient [1:7568544225216463076:2714]: NKikimrKqp.TEvCreateSessionResponse Error: "" Response { SessionId: "ydb://session/3?node_id=1&id=NDBhMDM3M2QtOTg3M2UwMzAtOGY0NDExZmMtYjcxZjQ1ZDk=" NodeId: 1 } YdbStatus: SUCCESS ResourceExhausted: false
2025-11-03T16:57:03.953611Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7568544225216463076:2714] (SourceId=test-message-group-id1, PreferedPartition=(NULL)) Select from the table
2025-11-03T16:57:03.961933Z node 1 :PQ_PARTITION_CHOOSER TRACE: partition_chooser_impl__abstract_chooser_actor.h:163: StateSelect, received event# 271646721, Sender [1:7568544053417768053:2268], Recipient [1:7568544225216463076:2714]: NKikimrKqp.TEvQueryResponse Response { SessionId: "ydb://session/3?node_id=1&id=NDBhMDM3M2QtOTg3M2UwMzAtOGY0NDExZmMtYjcxZjQ1ZDk=" PreparedQuery: "bf547082-be61c135-9226a4-6fe85003" QueryParameters { Name: "$Hash" Type { Kind: Data Data { Scheme: 2 } } } QueryParameters { Name: "$Topic" Type { Kind: Data Data { Scheme: 4608 } } } QueryParameters { Name: "$SourceId" Type { Kind: Data Data { Scheme: 4608 } } } TxMeta { id: "01k95ad6pj8mg6026g415j22ac" } YdbResults { columns { name: "Partition" type { optional_type { item { type_id: UINT32 } } } } columns { name: "CreateTime" type { optional_type { item { type_id: UINT64 } } } } columns { name: "AccessTime" type { optional_type { item { type_id: UINT64 } } } } columns { name: "SeqNo" type { optional_type { item { type_id: UINT64 } } } } rows { items { uint32_value: 0 } items { uint64_value: 1762189014910 } items { uint64_value: 1762189017431 } items { uint64_value: 0 } } format: FORMAT_VALUE } QueryDiagnostics: "" } YdbStatus: SUCCESS Cons
2025-11-03T16:57:03.962112Z node 1 :PQ_PARTITION_CHOOSER TRACE: partition_chooser_impl__abstract_chooser_actor.h:151: TPartitionChooser [1:7568544225216463076:2714] (SourceId=test-message-group-id1, PreferedPartition=(NULL)) Selected from table PartitionId=0 SeqNo=0
2025-11-03T16:57:03.962130Z node 1 :PQ_PARTITION_CHOOSER TRACE: partition_chooser_impl__old_chooser_actor.h:113: TPartitionChooser [1:7568544225216463076:2714] (SourceId=test-message-group-id1, PreferedPartition=(NULL)) OnPartitionChosen
2025-11-03T16:57:03.962146Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7568544225216463076:2714] (SourceId=test-message-group-id1, PreferedPartition=(NULL)) Update the table
2025-11-03T16:57:03.971727Z node 1 :PQ_PARTITION_CHOOSER TRACE: partition_chooser_impl__abstract_chooser_actor.h:212: StateUpdate, received event# 271646721, Sender [1:7568544053417768053:2268], Recipient [1:7568544225216463076:2714]: NKikimrKqp.TEvQueryResponse Response { SessionId: "ydb://session/3?node_id=1&id=NDBhMDM3M2QtOTg3M2UwMzAtOGY0NDExZmMtYjcxZjQ1ZDk=" PreparedQuery: "34f6fc20-f975aeb1-f34c103e-7f2bd9da" QueryParameters { Name: "$AccessTime" Type { Kind: Data Data { Scheme: 4 } } } QueryParameters { Name: "$CreateTime" Type { Kind: Data Data { Scheme: 4 } } } QueryParameters { Name: "$Hash" Type { Kind: Data Data { Scheme: 2 } } } QueryParameters { Name: "$Partition" Type { Kind: Data Data { Scheme: 2 } } } QueryParameters { Name: "$SeqNo" Type { Kind: Data Data { Scheme: 4 } } } QueryParameters { Name: "$SourceId" Type { Kind: Data Data { Scheme: 4608 } } } QueryParameters { Name: "$Topic" Type { Kind: Data Data { Scheme: 4608 } } } TxMeta { } QueryDiagnostics: "" } YdbStatus: SUCCESS ConsumedRu: 1
2025-11-03T16:57:03.971768Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7568544225216463076:2714] (SourceId=test-message-group-id1, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-11-03T16:57:03.971794Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7568544225216463076:2714] (SourceId=test-message-group-id1, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-11-03T16:57:03.971810Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7568544225216463076:2714] (SourceId=test-message-group-id1, PreferedPartition=(NULL)) Start idle
2025-11-03T16:57:03.971840Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 7 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-11-03T16:57:03.974370Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1
2025-11-03T16:57:03.975875Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [4:7568544170866189024:2388], Partition 0, Sender [0:0:0], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:57:03.975950Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:03.975988Z node 4 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:03.976020Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:57:03.976036Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:57:03.976050Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:57:03.976077Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:57:03.976135Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:57:03.976150Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:57:03.976174Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:57:03.974054Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 269877761, Sender [2:7568544224361325489:3032], Recipient [2:7568544108397207262:2383]: NKikimr::TEvTabletPipe::TEvServerConnected
2025-11-03T16:57:03.974098Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5330: HandleHook, processing event TEvTabletPipe::TEvServerConnected
2025-11-03T16:57:03.974115Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:2716: [PQ: 72075186224037892] Handle TEvTabletPipe::TEvServerConnected
2025-11-03T16:57:03.974143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [1:7568544225216463109:2714], now have 1 active actors on pipe
2025-11-03T16:57:03.974663Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271187968, Sender [1:7568544225216463108:2714], Recipient [2:7568544224361325489:3032]
2025-11-03T16:57:03.974677Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5316: HandleHook, processing event TEvPersQueue::TEvRequest
2025-11-03T16:57:03.974741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc2--test-topic' requestId: <none>
2025-11-03T16:57:03.974764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc2--test-topic' partition 0
2025-11-03T16:57:03.974836Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188498 (NKikimr::TEvPQ::TEvChangeOwner), Tablet [2:7568544108397207262:2383], Partition 0, Sender [2:7568544108397207262:2383], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:57:03.974875Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188498, Sender [2:7568544108397207262:2383], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvChangeOwner
2025-11-03T16:57:03.974893Z node 2 :PERSQUEUE TRACE: partition.h:642: StateIdle, processing event TEvPQ::TEvChangeOwner
2025-11-03T16:57:03.974909Z node 2 :PERSQUEUE TRACE: partition_write.cpp:154: [72075186224037892][Partition][0][StateIdle] TPartition::HandleOnWrite TEvChangeOwner.
2025-11-03T16:57:03.974943Z node 2 :PERSQUEUE TRACE: partition_write.cpp:873: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessChangeOwnerRequests.
2025-11-03T16:57:03.974959Z node 2 :PERSQUEUE TRACE: partition_write.cpp:107: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessChangeOwnerRequest.
2025-11-03T16:57:03.975005Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie test-message-group-id1|29f0cf22-4f758779-24e3be99-1d7b1e01_0 generated for partition 0 topic 'rt3.dc2--test-topic' owner test-message-group-id1
2025-11-03T16:57:03.975023Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:57:03.975047Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:57:03.975075Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:57:03.975093Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-03T16:57:03.975138Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:57:03.975153Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:57:03.975209Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:57:03.975221Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:57:03.975239Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:57:03.975259Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=1
2025-11-03T16:57:03.975283Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-03T16:57:03.975350Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188562 (NKikimr::TEvPQ::TEvTxBatchComplete), Tablet [2:7568544108397207262:2383], Partition 0, Sender [2:7568544108397207303:2383], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:57:03.975384Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188562, Sender [2:7568544108397207303:2383], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvTxBatchComplete
2025-11-03T16:57:03.975426Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271188493, Sender [2:7568544108397207303:2383], Recipient [2:7568544108397207262:2383]: NKikimr::TEvPQ::TEvProxyResponse
2025-11-03T16:57:03.975442Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5335: HandleHook, processing event TEvPQ::TEvProxyResponse
2025-11-03T16:57:03.975465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc2--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-03T16:57:03.976081Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271187968, Sender [1:7568544225216463108:2714], Recipient [2:7568544224361325489:3032]
2025-11-03T16:57:03.976099Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5316: HandleHook, processing event TEvPersQueue::TEvRequest
2025-11-03T16:57:03.976138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc2--test-topic' requestId: <none>
2025-11-03T16:57:03.976160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc2--test-topic' partition 0
2025-11-03T16:57:03.976221Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188486 (NKikimr::TEvPQ::TEvGetMaxSeqNoRequest), Tablet [2:7568544108397207262:2383], Partition 0, Sender [2:7568544108397207262:2383], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:57:03.976255Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188486, Sender [2:7568544108397207262:2383], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvGetMaxSeqNoRequest
2025-11-03T16:57:03.976272Z node 2 :PERSQUEUE TRACE: partition.h:634: StateIdle, processing event TEvPQ::TEvGetMaxSeqNoRequest
2025-11-03T16:57:03.976328Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271188493, Sender [2:7568544108397207303:2383], Recipient [2:7568544108397207262:2383]: NKikimr::TEvPQ::TEvProxyResponse
2025-11-03T16:57:03.976343Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5335: HandleHook, processing event TEvPQ::TEvProxyResponse
2025-11-03T16:57:03.976364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc2--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-03T16:57:03.976683Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 7 partition: 0 MaxSeqNo: 1 sessionId: test-message-group-id1|29f0cf22-4f758779-24e3be99-1d7b1e01_0
2025-11-03T16:57:03.978375Z :INFO: [/Root] MessageGroupId [test-message-group-id1] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1762189023978 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-11-03T16:57:03.978507Z :INFO: [/Root] MessageGroupId [test-message-group-id1] SessionId [] Write session established. Init response: last_sequence_number: 1 session_id: "test-message-group-id1|29f0cf22-4f758779-24e3be99-1d7b1e01_0" topic: "test-topic" cluster: "dc2" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-11-03T16:57:03.978700Z :INFO: [/Root] MessageGroupId [test-message-group-id1] SessionId [test-message-group-id1|29f0cf22-4f758779-24e3be99-1d7b1e01_0] Write session: close. Timeout = 0 ms
2025-11-03T16:57:03.978739Z :INFO: [/Root] MessageGroupId [test-message-group-id1] SessionId [test-message-group-id1|29f0cf22-4f758779-24e3be99-1d7b1e01_0] Write session will now close
2025-11-03T16:57:03.978778Z :DEBUG: [/Root] MessageGroupId [test-message-group-id1] SessionId [test-message-group-id1|29f0cf22-4f758779-24e3be99-1d7b1e01_0] Write session: aborting
2025-11-03T16:57:03.979202Z :INFO: [/Root] MessageGroupId [test-message-group-id1] SessionId [test-message-group-id1|29f0cf22-4f758779-24e3be99-1d7b1e01_0] Write session: gracefully shut down, all writes complete
2025-11-03T16:57:03.979258Z :DEBUG: [/Root] MessageGroupId [test-message-group-id1] SessionId [test-message-group-id1|29f0cf22-4f758779-24e3be99-1d7b1e01_0] Write session: destroy
===Check SeqNo writer1, dc1
2025-11-03T16:57:03.979639Z :DEBUG: [/Root] MessageGroupId [test-message-group-id1] SessionId [] Write session: try to update token
2025-11-03T16:57:03.979696Z :INFO: [/Root] MessageGroupId [test-message-group-id1] SessionId [] Write session: Do CDS request
2025-11-03T16:57:03.979743Z :INFO: [/Root] MessageGroupId [test-message-group-id1] SessionId [] Do schedule cds request after 0 ms
2025-11-03T16:57:03.979844Z :INFO: [/Root] MessageGroupId [test-message-group-id1] Running cds request ms
2025-11-03T16:57:03.983764Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 7 sessionId: test-message-group-id1|29f0cf22-4f758779-24e3be99-1d7b1e01_0 grpc read done: success: 0 data: 
2025-11-03T16:57:03.983803Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 7 sessionId: test-message-group-id1|29f0cf22-4f758779-24e3be99-1d7b1e01_0 grpc read failed
2025-11-03T16:57:03.983839Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 7 sessionId: test-message-group-id1|29f0cf22-4f758779-24e3be99-1d7b1e01_0 grpc closed
2025-11-03T16:57:03.983857Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 7 sessionId: test-message-group-id1|29f0cf22-4f758779-24e3be99-1d7b1e01_0 is DEAD
2025-11-03T16:57:03.984607Z node 1 :PQ_PARTITION_CHOOSER TRACE: partition_chooser_impl__abstract_chooser_actor.h:278: StateIdle, received event# 65543, Sender [1:7568544225216463074:2714], Recipient [1:7568544225216463076:2714]: NActors::TEvents::TEvPoison
2025-11-03T16:57:03.984658Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-11-03T16:57:03.985118Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 269877764, Sender [2:7568544224361325489:3032], Recipient [2:7568544108397207262:2383]: NKikimr::TEvTabletPipe::TEvServerDisconnected
2025-11-03T16:57:03.985157Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5331: HandleHook, processing event TEvTabletPipe::TEvServerDisconnected
2025-11-03T16:57:03.985175Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:2729: [PQ: 72075186224037892] Handle TEvTabletPipe::TEvServerDisconnected
2025-11-03T16:57:03.985201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [1:7568544225216463109:2714] destroyed
2025-11-03T16:57:03.985263Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188506 (NKikimr::TEvPQ::TEvPipeDisconnected), Tablet [2:7568544108397207262:2383], Partition 0, Sender [2:7568544108397207262:2383], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:57:03.985301Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188506, Sender [2:7568544108397207262:2383], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvPipeDisconnected
2025-11-03T16:57:03.985321Z node 2 :PERSQUEUE TRACE: partition.h:651: StateIdle, processing event TEvPQ::TEvPipeDisconnected
2025-11-03T16:57:03.985344Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-11-03T16:57:03.985365Z node 2 :PERSQUEUE TRACE: partition_write.cpp:873: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessChangeOwnerRequests.
2025-11-03T16:57:03.985385Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:57:03.985399Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:57:03.985412Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:57:03.985431Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:57:03.985488Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:57:03.985500Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:57:03.985523Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:57:03.996214Z :INFO: [/Root] MessageGroupId [test-message-group-id1] SessionId [] Got CDS response: 
write_sessions_clusters { clusters { endpoint: "localhost:13111" name: "dc1" } clusters { endpoint: "localhost:14811" name: "dc2" available: true } primary_cluster_selection_reason: CLIENT_PREFERENCE } version: 1
2025-11-03T16:57:03.996380Z :INFO: [/Root] MessageGroupId [test-message-group-id1] SessionId [] Got error. Status: GENERIC_ERROR, Description: <main>: Error: Selected destination cluster: dc1 is currently disabled <main>: Error: Could not get valid endpoint from cluster discovery 
2025-11-03T16:57:03.996423Z :INFO: [/Root] MessageGroupId [test-message-group-id1] SessionId [] Write session will restart in 0.009805s
2025-11-03T16:57:03.996509Z :INFO: [/Root] MessageGroupId [test-message-group-id1] SessionId [] Write session: Do CDS request
2025-11-03T16:57:03.996580Z :INFO: [/Root] MessageGroupId [test-message-group-id1] SessionId [] Do schedule cds request after 9 ms
2025-11-03T16:57:04.009987Z :INFO: [/Root] MessageGroupId [test-message-group-id1] Running cds request ms
2025-11-03T16:57:04.020479Z :INFO: [/Root] MessageGroupId [test-message-group-id1] SessionId [] Got CDS response: 
write_sessions_clusters { clusters { endpoint: "localhost:13111" name: "dc1" } clusters { endpoint: "localhost:14811" name: "dc2" available: true } primary_cluster_selection_reason: CLIENT_PREFERENCE } version: 1
2025-11-03T16:57:04.020603Z :INFO: [/Root] MessageGroupId [test-message-group-id1] SessionId [] Got error. Status: GENERIC_ERROR, Description: <main>: Error: Selected destination cluster: dc1 is currently disabled <main>: Error: Could not get valid endpoint from cluster discovery 
2025-11-03T16:57:04.020630Z :INFO: [/Root] MessageGroupId [test-message-group-id1] SessionId [] Write session will restart in 0.015463s
2025-11-03T16:57:04.020948Z :INFO: [/Root] MessageGroupId [test-message-group-id1] SessionId [] Write session: Do CDS request
2025-11-03T16:57:04.020984Z :INFO: [/Root] MessageGroupId [test-message-group-id1] SessionId [] Do schedule cds request after 15 ms
2025-11-03T16:57:04.020141Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:57:04.020238Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:04.020265Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:04.020296Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:57:04.020320Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:57:04.020336Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:57:04.020359Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:57:04.020418Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:57:04.020434Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:57:04.020455Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:57:04.038717Z :INFO: [/Root] MessageGroupId [test-message-group-id1] Running cds request ms
2025-11-03T16:57:04.053989Z :INFO: [/Root] MessageGroupId [test-message-group-id1] SessionId [] Got CDS response: 
write_sessions_clusters { clusters { endpoint: "localhost:13111" name: "dc1" } clusters { endpoint: "localhost:14811" name: "dc2" available: true } primary_cluster_selection_reason: CLIENT_PREFERENCE } version: 1
2025-11-03T16:57:04.054105Z :INFO: [/Root] MessageGroupId [test-message-group-id1] SessionId [] Got error. Status: GENERIC_ERROR, Description: <main>: Error: Selected destination cluster: dc1 is currently disabled <main>: Error: Could not get valid endpoint from cluster discovery 
2025-11-03T16:57:04.054146Z :INFO: [/Root] MessageGroupId [test-message-group-id1] SessionId [] Write session will restart in 0.035484s
2025-11-03T16:57:04.054217Z :INFO: [/Root] MessageGroupId [test-message-group-id1] SessionId [] Write session: Do CDS request
2025-11-03T16:57:04.054257Z :INFO: [/Root] MessageGroupId [test-message-group-id1] SessionId [] Do schedule cds request after 35 ms
2025-11-03T16:57:04.077527Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [4:7568544170866189024:2388], Partition 0, Sender [0:0:0], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:57:04.077605Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:04.077636Z node 4 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:04.077681Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:57:04.077698Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:57:04.077714Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:57:04.077739Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:57:04.077799Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:57:04.077815Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:57:04.077838Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:57:04.094067Z :INFO: [/Root] MessageGroupId [test-message-group-id1] Running cds request ms
2025-11-03T16:57:04.108197Z :INFO: [/Root] MessageGroupId [test-message-group-id1] SessionId [] Got CDS response: 
write_sessions_clusters { clusters { endpoint: "localhost:13111" name: "dc1" } clusters { endpoint: "localhost:14811" name: "dc2" available: true } primary_cluster_selection_reason: CLIENT_PREFERENCE } version: 1
2025-11-03T16:57:04.108312Z :INFO: [/Root] MessageGroupId [test-message-group-id1] SessionId [] Got error. Status: GENERIC_ERROR, Description: <main>: Error: Selected destination cluster: dc1 is currently disabled <main>: Error: Could not get valid endpoint from cluster discovery 
2025-11-03T16:57:04.108340Z :INFO: [/Root] MessageGroupId [test-message-group-id1] SessionId [] Write session will restart in 0.050428s
2025-11-03T16:57:04.108392Z :INFO: [/Root] MessageGroupId [test-message-group-id1] SessionId [] Write session: Do CDS request
2025-11-03T16:57:04.108430Z :INFO: [/Root] MessageGroupId [test-message-group-id1] SessionId [] Do schedule cds request after 50 ms
2025-11-03T16:57:04.121461Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:57:04.121541Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:04.121564Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:04.121595Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:57:04.121611Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:57:04.121624Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:57:04.121647Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:57:04.121717Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:57:04.121730Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:57:04.121754Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:57:04.160420Z :INFO: [/Root] MessageGroupId [test-message-group-id1] Running cds request ms
2025-11-03T16:57:04.167962Z :INFO: [/Root] MessageGroupId [test-message-group-id1] SessionId [] Got CDS response: 
write_sessions_clusters { clusters { endpoint: "localhost:13111" name: "dc1" } clusters { endpoint: "localhost:14811" name: "dc2" available: true } primary_cluster_selection_reason: CLIENT_PREFERENCE } version: 1
2025-11-03T16:57:04.168101Z :INFO: [/Root] MessageGroupId [test-message-group-id1] SessionId [] Got error. Status: GENERIC_ERROR, Description: <main>: Error: Selected destination cluster: dc1 is currently disabled <main>: Error: Could not get valid endpoint from cluster discovery 
2025-11-03T16:57:04.168125Z :INFO: [/Root] MessageGroupId [test-message-group-id1] SessionId [] Write session will restart in 0.083219s
2025-11-03T16:57:04.168235Z :INFO: [/Root] MessageGroupId [test-message-group-id1] SessionId [] Write session: Do CDS request
2025-11-03T16:57:04.168267Z :INFO: [/Root] MessageGroupId [test-message-group-id1] SessionId [] Do schedule cds request after 83 ms
2025-11-03T16:57:04.177627Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [4:7568544170866189024:2388], Partition 0, Sender [0:0:0], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:57:04.177693Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:04.177716Z node 4 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:04.177747Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:57:04.177764Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:57:04.177777Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:57:04.177801Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:57:04.177862Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:57:04.177875Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:57:04.177898Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:57:04.222179Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:57:04.222284Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:04.222322Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:04.222353Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:57:04.222369Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:57:04.222393Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:57:04.222413Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:57:04.222478Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:57:04.222494Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:57:04.222516Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:57:04.255255Z :INFO: [/Root] MessageGroupId [test-message-group-id1] Running cds request ms
2025-11-03T16:57:04.277463Z :INFO: [/Root] MessageGroupId [test-message-group-id1] SessionId [] Got CDS response: 
write_sessions_clusters { clusters { endpoint: "localhost:13111" name: "dc1" } clusters { endpoint: "localhost:14811" name: "dc2" available: true } primary_cluster_selection_reason: CLIENT_PREFERENCE } version: 1
2025-11-03T16:57:04.277586Z :INFO: [/Root] MessageGroupId [test-message-group-id1] SessionId [] Got error. Status: GENERIC_ERROR, Description: <main>: Error: Selected destination cluster: dc1 is currently disabled <main>: Error: Could not get valid endpoint from cluster discovery 
2025-11-03T16:57:04.277617Z :INFO: [/Root] MessageGroupId [test-message-group-id1] SessionId [] Write session will restart in 0.305189s
2025-11-03T16:57:04.277667Z :INFO: [/Root] MessageGroupId [test-message-group-id1] SessionId [] Write session: Do CDS request
2025-11-03T16:57:04.277699Z :INFO: [/Root] MessageGroupId [test-message-group-id1] SessionId [] Do schedule cds request after 305 ms
2025-11-03T16:57:04.279372Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [4:7568544170866189024:2388], Partition 0, Sender [0:0:0], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:57:04.279448Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:04.279477Z node 4 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:04.279509Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:57:04.279525Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:57:04.279541Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:57:04.279565Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:57:04.279629Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:57:04.279643Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:57:04.279665Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:57:04.322512Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:57:04.322593Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:04.322620Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:04.322663Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:57:04.322685Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:57:04.322698Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:57:04.322720Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:57:04.322791Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:57:04.322806Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:57:04.322828Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:57:04.327785Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188544 (NKikimr::NPQ::NReadQuoterEvents::TEvQuotaCountersUpdated), Tablet [4:7568544170866189024:2388], Partition 0, Sender [4:7568544170866189068:2388], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:57:04.327854Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188544, Sender [4:7568544170866189068:2388], Recipient [4:7568544170866189065:2388]: NKikimr::NPQ::NReadQuoterEvents::TEvQuotaCountersUpdated
2025-11-03T16:57:04.327876Z node 4 :PERSQUEUE TRACE: partition.h:671: StateIdle, processing event NReadQuoterEvents::TEvQuotaCountersUpdated
2025-11-03T16:57:04.340201Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188544 (NKikimr::NPQ::NReadQuoterEvents::TEvQuotaCountersUpdated), Tablet [2:7568544108397207262:2383], Partition 0, Sender [2:7568544108397207306:2383], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:57:04.340259Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188544, Sender [2:7568544108397207306:2383], Recipient [2:7568544108397207303:2383]: NKikimr::NPQ::NReadQuoterEvents::TEvQuotaCountersUpdated
2025-11-03T16:57:04.340279Z node 2 :PERSQUEUE TRACE: partition.h:671: StateIdle, processing event NReadQuoterEvents::TEvQuotaCountersUpdated
2025-11-03T16:57:04.380250Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [4:7568544170866189024:2388], Partition 0, Sender [0:0:0], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:57:04.380317Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:04.380340Z node 4 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:04.380369Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:57:04.380383Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:57:04.380391Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:57:04.380404Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:57:04.380447Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:57:04.380455Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:57:04.380470Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:57:04.424114Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:57:04.424177Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:04.424203Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:04.424230Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:57:04.424245Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:57:04.424258Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:57:04.424280Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:57:04.424335Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:57:04.424349Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:57:04.424372Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:57:04.480161Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [4:7568544170866189024:2388], Partition 0, Sender [0:0:0], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:57:04.480221Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:04.480243Z node 4 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:04.480269Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:57:04.480284Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:57:04.480300Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:57:04.480319Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:57:04.480374Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:57:04.480387Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:57:04.480407Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:57:04.524646Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:57:04.524713Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:04.524734Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:04.524773Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:57:04.524787Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:57:04.524799Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:57:04.524818Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:57:04.524873Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:57:04.524886Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:57:04.524905Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:57:04.580482Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [4:7568544170866189024:2388], Partition 0, Sender [0:0:0], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:57:04.580545Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:04.580567Z node 4 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:04.580594Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:57:04.580608Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:57:04.580621Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:57:04.580653Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:57:04.580725Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:57:04.580739Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:57:04.580761Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:57:04.588050Z :INFO: [/Root] MessageGroupId [test-message-group-id1] Running cds request ms
2025-11-03T16:57:04.595264Z :INFO: [/Root] MessageGroupId [test-message-group-id1] SessionId [] Got CDS response: 
write_sessions_clusters { clusters { endpoint: "localhost:13111" name: "dc1" } clusters { endpoint: "localhost:14811" name: "dc2" available: true } primary_cluster_selection_reason: CLIENT_PREFERENCE } version: 1
2025-11-03T16:57:04.595383Z :INFO: [/Root] MessageGroupId [test-message-group-id1] SessionId [] Got error. Status: GENERIC_ERROR, Description: <main>: Error: Selected destination cluster: dc1 is currently disabled <main>: Error: Could not get valid endpoint from cluster discovery 
2025-11-03T16:57:04.595409Z :INFO: [/Root] MessageGroupId [test-message-group-id1] SessionId [] Write session will restart in 0.354915s
2025-11-03T16:57:04.595468Z :INFO: [/Root] MessageGroupId [test-message-group-id1] SessionId [] Write session: Do CDS request
2025-11-03T16:57:04.595502Z :INFO: [/Root] MessageGroupId [test-message-group-id1] SessionId [] Do schedule cds request after 354 ms
2025-11-03T16:57:04.625271Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:57:04.625338Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:04.625361Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:04.625389Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:57:04.625404Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:57:04.625418Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:57:04.625438Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:57:04.625495Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:57:04.625508Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:57:04.625529Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:57:04.680908Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [4:7568544170866189024:2388], Partition 0, Sender [0:0:0], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:57:04.680977Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:04.681015Z node 4 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:04.681043Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:57:04.681058Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:57:04.681071Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:57:04.681092Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:57:04.681158Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:57:04.681182Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:57:04.681204Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:57:04.725902Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:57:04.725962Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:04.725982Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:04.726008Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:57:04.726021Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:57:04.726042Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:57:04.726061Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:57:04.726115Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:57:04.726126Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:57:04.726146Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:57:04.784272Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [4:7568544170866189024:2388], Partition 0, Sender [0:0:0], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:57:04.784341Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:04.784363Z node 4 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:04.784400Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:57:04.784416Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:57:04.784428Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:57:04.784448Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:57:04.784503Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:57:04.784519Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:57:04.784547Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:57:04.828086Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:57:04.828178Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:04.828203Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:04.828238Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:57:04.828254Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:57:04.828267Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:57:04.828289Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:57:04.828349Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:57:04.828362Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:57:04.828384Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:57:04.885710Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [4:7568544170866189024:2388], Partition 0, Sender [0:0:0], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:57:04.885782Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:04.885808Z node 4 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:04.885840Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:57:04.885858Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:57:04.885872Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:57:04.885894Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:57:04.885954Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:57:04.885968Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:57:04.885989Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:57:04.930134Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:57:04.930202Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:04.930228Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:04.930262Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:57:04.930277Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:57:04.930290Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:57:04.930312Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:57:04.930382Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:57:04.930397Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:57:04.930418Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:57:04.954369Z :INFO: [/Root] MessageGroupId [test-message-group-id1] Running cds request ms
2025-11-03T16:57:04.962105Z :INFO: [/Root] MessageGroupId [test-message-group-id1] SessionId [] Got CDS response: 
write_sessions_clusters { clusters { endpoint: "localhost:13111" name: "dc1" available: true } clusters { endpoint: "localhost:14811" name: "dc2" available: true } primary_cluster_selection_reason: CLIENT_PREFERENCE } version: 1
2025-11-03T16:57:04.962159Z :INFO: [/Root] MessageGroupId [test-message-group-id1] SessionId [] Start write session. Will connect to endpoint: localhost:13111
2025-11-03T16:57:04.969774Z node 3 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-11-03T16:57:04.969800Z node 3 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 6
2025-11-03T16:57:04.970229Z :DEBUG: [/Root] MessageGroupId [test-message-group-id1] SessionId [] Write session: send init request: init_request { topic: "test-topic" message_group_id: "test-message-group-id1" preferred_cluster: "dc1" }
2025-11-03T16:57:04.972160Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 6 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "test-message-group-id1" preferred_cluster: "dc1" }
2025-11-03T16:57:04.972326Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 6 topic: "test-topic" message_group_id: "test-message-group-id1" preferred_cluster: "dc1" from ipv6:[::1]:60192
2025-11-03T16:57:04.972342Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=6 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:60192 proto=v1  topic=test-topic durationSec=0
2025-11-03T16:57:04.972352Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-11-03T16:57:04.974481Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 6 sessionId:  describe result for acl check
2025-11-03T16:57:04.974597Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-11-03T16:57:04.974608Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-11-03T16:57:04.974616Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-11-03T16:57:04.974635Z node 3 :PQ_PARTITION_CHOOSER TRACE: partition_chooser_impl__abstract_chooser_actor.h:88: TPartitionChooser [3:7568544231003279396:2684] (SourceId=test-message-group-id1, PreferedPartition=(NULL)) InitTable: SourceId=test-message-group-id1 TopicsAreFirstClassCitizen=0 UseSrcIdMetaMappingInFirstClass=1
2025-11-03T16:57:04.974647Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [3:7568544231003279396:2684] (SourceId=test-message-group-id1, PreferedPartition=(NULL)) StartKqpSession
2025-11-03T16:57:04.977333Z node 3 :PQ_PARTITION_CHOOSER TRACE: partition_chooser_impl__abstract_chooser_actor.h:132: StateCreateKqpSession, received event# 271646728, Sender [3:7568544115039159497:2257], Recipient [3:7568544231003279396:2684]: NKikimrKqp.TEvCreateSessionResponse Error: "" Response { SessionId: "ydb://session/3?node_id=3&id=ZGY4NmRkMmEtZDVhNGM1YjQtMzVkZTZjMTMtZTg1ODA2ZDU=" NodeId: 3 } YdbStatus: SUCCESS ResourceExhausted: false
2025-11-03T16:57:04.977360Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [3:7568544231003279396:2684] (SourceId=test-message-group-id1, PreferedPartition=(NULL)) Select from the table
2025-11-03T16:57:04.989277Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [4:7568544170866189024:2388], Partition 0, Sender [0:0:0], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:57:04.989345Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:04.989367Z node 4 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:04.989397Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:57:04.989412Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:57:04.989426Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:57:04.989448Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:57:04.989499Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:57:04.989513Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:57:04.989534Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:57:05.031576Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:57:05.031644Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:05.031669Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:05.031701Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:57:05.031726Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:57:05.031740Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:57:05.031764Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:57:05.031825Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:57:05.031838Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:57:05.031861Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:57:05.064753Z node 3 :PQ_PARTITION_CHOOSER TRACE: partition_chooser_impl__abstract_chooser_actor.h:163: StateSelect, received event# 271646721, Sender [3:7568544115039159497:2257], Recipient [3:7568544231003279396:2684]: NKikimrKqp.TEvQueryResponse Response { SessionId: "ydb://session/3?node_id=3&id=ZGY4NmRkMmEtZDVhNGM1YjQtMzVkZTZjMTMtZTg1ODA2ZDU=" PreparedQuery: "442ea808-d7231069-9c6e0723-bcf815" QueryParameters { Name: "$Hash" Type { Kind: Data Data { Scheme: 2 } } } QueryParameters { Name: "$Topic" Type { Kind: Data Data { Scheme: 4608 } } } QueryParameters { Name: "$SourceId" Type { Kind: Data Data { Scheme: 4608 } } } TxMeta { id: "01k95ad7pj2mkzwxpgey826n65" } YdbResults { columns { name: "Partition" type { optional_type { item { type_id: UINT32 } } } } columns { name: "CreateTime" type { optional_type { item { type_id: UINT64 } } } } columns { name: "AccessTime" type { optional_type { item { type_id: UINT64 } } } } columns { name: "SeqNo" type { optional_type { item { type_id: UINT64 } } } } rows { items { uint32_value: 0 } items { uint64_value: 1762189010909 } items { uint64_value: 1762189019836 } items { uint64_value: 0 } } format: FORMAT_VALUE } QueryDiagnostics: "" } YdbStatus: SUCCESS Cons
2025-11-03T16:57:05.064924Z node 3 :PQ_PARTITION_CHOOSER TRACE: partition_chooser_impl__abstract_chooser_actor.h:151: TPartitionChooser [3:7568544231003279396:2684] (SourceId=test-message-group-id1, PreferedPartition=(NULL)) Selected from table PartitionId=0 SeqNo=0
2025-11-03T16:57:05.064941Z node 3 :PQ_PARTITION_CHOOSER TRACE: partition_chooser_impl__old_chooser_actor.h:113: TPartitionChooser [3:7568544231003279396:2684] (SourceId=test-message-group-id1, PreferedPartition=(NULL)) OnPartitionChosen
2025-11-03T16:57:05.064953Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [3:7568544231003279396:2684] (SourceId=test-message-group-id1, PreferedPartition=(NULL)) Update the table
2025-11-03T16:57:05.083758Z node 3 :PQ_PARTITION_CHOOSER TRACE: partition_chooser_impl__abstract_chooser_actor.h:212: StateUpdate, received event# 271646721, Sender [3:7568544115039159497:2257], Recipient [3:7568544231003279396:2684]: NKikimrKqp.TEvQueryResponse Response { SessionId: "ydb://session/3?node_id=3&id=ZGY4NmRkMmEtZDVhNGM1YjQtMzVkZTZjMTMtZTg1ODA2ZDU=" PreparedQuery: "72f7e762-c46fa14f-e3d2f842-88a42755" QueryParameters { Name: "$AccessTime" Type { Kind: Data Data { Scheme: 4 } } } QueryParameters { Name: "$CreateTime" Type { Kind: Data Data { Scheme: 4 } } } QueryParameters { Name: "$Hash" Type { Kind: Data Data { Scheme: 2 } } } QueryParameters { Name: "$Partition" Type { Kind: Data Data { Scheme: 2 } } } QueryParameters { Name: "$SeqNo" Type { Kind: Data Data { Scheme: 4 } } } QueryParameters { Name: "$SourceId" Type { Kind: Data Data { Scheme: 4608 } } } QueryParameters { Name: "$Topic" Type { Kind: Data Data { Scheme: 4608 } } } TxMeta { } QueryDiagnostics: "" } YdbStatus: SUCCESS ConsumedRu: 1
2025-11-03T16:57:05.083802Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [3:7568544231003279396:2684] (SourceId=test-message-group-id1, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-11-03T16:57:05.083831Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [3:7568544231003279396:2684] (SourceId=test-message-group-id1, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-11-03T16:57:05.083849Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [3:7568544231003279396:2684] (SourceId=test-message-group-id1, PreferedPartition=(NULL)) Start idle
2025-11-03T16:57:05.083880Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 6 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-11-03T16:57:05.085127Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 269877761, Sender [4:7568544235290699253:2812], Recipient [4:7568544170866189024:2388]: NKikimr::TEvTabletPipe::TEvServerConnected
2025-11-03T16:57:05.085158Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5330: HandleHook, processing event TEvTabletPipe::TEvServerConnected
2025-11-03T16:57:05.085177Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:2716: [PQ: 72075186224037892] Handle TEvTabletPipe::TEvServerConnected
2025-11-03T16:57:05.085205Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [3:7568544235298246724:2684], now have 1 active actors on pipe
2025-11-03T16:57:05.085515Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 4, Generation: 1
2025-11-03T16:57:05.085789Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271187968, Sender [3:7568544235298246723:2684], Recipient [4:7568544235290699253:2812]
2025-11-03T16:57:05.085811Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5316: HandleHook, processing event TEvPersQueue::TEvRequest
2025-11-03T16:57:05.085852Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:57:05.085875Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:57:05.085943Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188498 (NKikimr::TEvPQ::TEvChangeOwner), Tablet [4:7568544170866189024:2388], Partition 0, Sender [4:7568544170866189024:2388], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:57:05.085978Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188498, Sender [4:7568544170866189024:2388], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvChangeOwner
2025-11-03T16:57:05.085994Z node 4 :PERSQUEUE TRACE: partition.h:642: StateIdle, processing event TEvPQ::TEvChangeOwner
2025-11-03T16:57:05.086010Z node 4 :PERSQUEUE TRACE: partition_write.cpp:154: [72075186224037892][Partition][0][StateIdle] TPartition::HandleOnWrite TEvChangeOwner.
2025-11-03T16:57:05.086027Z node 4 :PERSQUEUE TRACE: partition_write.cpp:873: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessChangeOwnerRequests.
2025-11-03T16:57:05.086039Z node 4 :PERSQUEUE TRACE: partition_write.cpp:107: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessChangeOwnerRequest.
2025-11-03T16:57:05.086081Z node 4 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie test-message-group-id1|ff9780dd-c6707fd7-2021363a-e1250a84_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner test-message-group-id1
2025-11-03T16:57:05.086098Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:57:05.086120Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:57:05.086137Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:57:05.086148Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-03T16:57:05.086192Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:57:05.086207Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:57:05.086254Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:57:05.086265Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:57:05.086282Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:57:05.086302Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=1
2025-11-03T16:57:05.086324Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-03T16:57:05.086381Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188562 (NKikimr::TEvPQ::TEvTxBatchComplete), Tablet [4:7568544170866189024:2388], Partition 0, Sender [4:7568544170866189065:2388], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:57:05.086444Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188562, Sender [4:7568544170866189065:2388], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvTxBatchComplete
2025-11-03T16:57:05.086489Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271188493, Sender [4:7568544170866189065:2388], Recipient [4:7568544170866189024:2388]: NKikimr::TEvPQ::TEvProxyResponse
2025-11-03T16:57:05.086506Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5335: HandleHook, processing event TEvPQ::TEvProxyResponse
2025-11-03T16:57:05.086528Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-03T16:57:05.087583Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271187968, Sender [3:7568544235298246723:2684], Recipient [4:7568544235290699253:2812]
2025-11-03T16:57:05.087602Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5316: HandleHook, processing event TEvPersQueue::TEvRequest
2025-11-03T16:57:05.087638Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:57:05.087655Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:57:05.087715Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188486 (NKikimr::TEvPQ::TEvGetMaxSeqNoRequest), Tablet [4:7568544170866189024:2388], Partition 0, Sender [4:7568544170866189024:2388], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:57:05.087746Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188486, Sender [4:7568544170866189024:2388], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvGetMaxSeqNoRequest
2025-11-03T16:57:05.087763Z node 4 :PERSQUEUE TRACE: partition.h:634: StateIdle, processing event TEvPQ::TEvGetMaxSeqNoRequest
2025-11-03T16:57:05.087852Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271188493, Sender [4:7568544170866189065:2388], Recipient [4:7568544170866189024:2388]: NKikimr::TEvPQ::TEvProxyResponse
2025-11-03T16:57:05.087869Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5335: HandleHook, processing event TEvPQ::TEvProxyResponse
2025-11-03T16:57:05.087890Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-03T16:57:05.088494Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 6 partition: 0 MaxSeqNo: 14 sessionId: test-message-group-id1|ff9780dd-c6707fd7-2021363a-e1250a84_0
2025-11-03T16:57:05.089638Z :INFO: [/Root] MessageGroupId [test-message-group-id1] SessionId [] Counters: { Errors: 7 CurrentSessionLifetimeMs: 1762189025089 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-11-03T16:57:05.089813Z :INFO: [/Root] MessageGroupId [test-message-group-id1] SessionId [] Write session established. Init response: last_sequence_number: 14 session_id: "test-message-group-id1|ff9780dd-c6707fd7-2021363a-e1250a84_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-11-03T16:57:05.090001Z :INFO: [/Root] MessageGroupId [test-message-group-id1] SessionId [test-message-group-id1|ff9780dd-c6707fd7-2021363a-e1250a84_0] Write session: close. Timeout = 0 ms
2025-11-03T16:57:05.090027Z :INFO: [/Root] MessageGroupId [test-message-group-id1] SessionId [test-message-group-id1|ff9780dd-c6707fd7-2021363a-e1250a84_0] Write session will now close
2025-11-03T16:57:05.090058Z :DEBUG: [/Root] MessageGroupId [test-message-group-id1] SessionId [test-message-group-id1|ff9780dd-c6707fd7-2021363a-e1250a84_0] Write session: aborting
2025-11-03T16:57:05.090804Z :INFO: [/Root] MessageGroupId [test-message-group-id1] SessionId [test-message-group-id1|ff9780dd-c6707fd7-2021363a-e1250a84_0] Write session: gracefully shut down, all writes complete
2025-11-03T16:57:05.090875Z :DEBUG: [/Root] MessageGroupId [test-message-group-id1] SessionId [test-message-group-id1|ff9780dd-c6707fd7-2021363a-e1250a84_0] Write session is aborting and will not restart
2025-11-03T16:57:05.090884Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 6 sessionId: test-message-group-id1|ff9780dd-c6707fd7-2021363a-e1250a84_0 grpc read done: success: 0 data: 
2025-11-03T16:57:05.090907Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 6 sessionId: test-message-group-id1|ff9780dd-c6707fd7-2021363a-e1250a84_0 grpc read failed
2025-11-03T16:57:05.090953Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 6 sessionId: test-message-group-id1|ff9780dd-c6707fd7-2021363a-e1250a84_0 grpc closed
2025-11-03T16:57:05.090971Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 6 sessionId: test-message-group-id1|ff9780dd-c6707fd7-2021363a-e1250a84_0 is DEAD
2025-11-03T16:57:05.091119Z :DEBUG: [/Root] MessageGroupId [test-message-group-id1] SessionId [test-message-group-id1|ff9780dd-c6707fd7-2021363a-e1250a84_0] Write session: destroy
2025-11-03T16:57:05.091619Z node 3 :PQ_PARTITION_CHOOSER TRACE: partition_chooser_impl__abstract_chooser_actor.h:278: StateIdle, received event# 65543, Sender [3:7568544231003279394:2684], Recipient [3:7568544231003279396:2684]: NActors::TEvents::TEvPoison
2025-11-03T16:57:05.091668Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
===Check SeqNo writer2 dc1
2025-11-03T16:57:05.092975Z :DEBUG: [/Root] MessageGroupId [test-message-group-id2] SessionId [] Write session: try to update token
2025-11-03T16:57:05.092374Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [4:7568544170866189024:2388], Partition 0, Sender [0:0:0], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:57:05.092427Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:05.092447Z node 4 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:05.093040Z :INFO: [/Root] MessageGroupId [test-message-group-id2] SessionId [] Write session: Do CDS request
2025-11-03T16:57:05.092475Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:57:05.092489Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:57:05.093083Z :INFO: [/Root] MessageGroupId [test-message-group-id2] SessionId [] Do schedule cds request after 0 ms
2025-11-03T16:57:05.092502Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:57:05.092521Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:57:05.092571Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:57:05.092584Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:57:05.092604Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:57:05.092653Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 269877764, Sender [4:7568544235290699253:2812], Recipient [4:7568544170866189024:2388]: NKikimr::TEvTabletPipe::TEvServerDisconnected
2025-11-03T16:57:05.092670Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5331: HandleHook, processing event TEvTabletPipe::TEvServerDisconnected
2025-11-03T16:57:05.092685Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:2729: [PQ: 72075186224037892] Handle TEvTabletPipe::TEvServerDisconnected
2025-11-03T16:57:05.092708Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [3:7568544235298246724:2684] destroyed
2025-11-03T16:57:05.092755Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188506 (NKikimr::TEvPQ::TEvPipeDisconnected), Tablet [4:7568544170866189024:2388], Partition 0, Sender [4:7568544170866189024:2388], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:57:05.092784Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188506, Sender [4:7568544170866189024:2388], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvPipeDisconnected
2025-11-03T16:57:05.092798Z node 4 :PERSQUEUE TRACE: partition.h:651: StateIdle, processing event TEvPQ::TEvPipeDisconnected
2025-11-03T16:57:05.092815Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-11-03T16:57:05.092835Z node 4 :PERSQUEUE TRACE: partition_write.cpp:873: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessChangeOwnerRequests.
2025-11-03T16:57:05.092847Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:57:05.092862Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:57:05.092873Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:57:05.092887Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:57:05.092917Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:57:05.092928Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:57:05.092941Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:57:05.096046Z :INFO: [/Root] MessageGroupId [test-message-group-id2] Running cds request ms
2025-11-03T16:57:05.112036Z :INFO: [/Root] MessageGroupId [test-message-group-id2] SessionId [] Got CDS response: 
write_sessions_clusters { clusters { endpoint: "localhost:13111" name: "dc1" available: true } clusters { endpoint: "localhost:14811" name: "dc2" available: true } primary_cluster_selection_reason: CLIENT_PREFERENCE } version: 1
2025-11-03T16:57:05.112104Z :INFO: [/Root] MessageGroupId [test-message-group-id2] SessionId [] Start write session. Will connect to endpoint: localhost:13111
2025-11-03T16:57:05.116277Z :DEBUG: [/Root] MessageGroupId [test-message-group-id2] SessionId [] Write session: send init request: init_request { topic: "test-topic" message_group_id: "test-message-group-id2" preferred_cluster: "dc1" }
2025-11-03T16:57:05.116762Z node 3 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-11-03T16:57:05.116794Z node 3 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 7
2025-11-03T16:57:05.117456Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 7 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "test-message-group-id2" preferred_cluster: "dc1" }
2025-11-03T16:57:05.117595Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 7 topic: "test-topic" message_group_id: "test-message-group-id2" preferred_cluster: "dc1" from ipv6:[::1]:60206
2025-11-03T16:57:05.117613Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=7 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:60206 proto=v1  topic=test-topic durationSec=0
2025-11-03T16:57:05.117623Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-11-03T16:57:05.120338Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 7 sessionId:  describe result for acl check
2025-11-03T16:57:05.120476Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-11-03T16:57:05.120501Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-11-03T16:57:05.120524Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-11-03T16:57:05.120542Z node 3 :PQ_PARTITION_CHOOSER TRACE: partition_chooser_impl__abstract_chooser_actor.h:88: TPartitionChooser [3:7568544235298246729:2689] (SourceId=test-message-group-id2, PreferedPartition=(NULL)) InitTable: SourceId=test-message-group-id2 TopicsAreFirstClassCitizen=0 UseSrcIdMetaMappingInFirstClass=1
2025-11-03T16:57:05.120554Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [3:7568544235298246729:2689] (SourceId=test-message-group-id2, PreferedPartition=(NULL)) StartKqpSession
2025-11-03T16:57:05.123767Z node 3 :PQ_PARTITION_CHOOSER TRACE: partition_chooser_impl__abstract_chooser_actor.h:132: StateCreateKqpSession, received event# 271646728, Sender [3:7568544115039159497:2257], Recipient [3:7568544235298246729:2689]: NKikimrKqp.TEvCreateSessionResponse Error: "" Response { SessionId: "ydb://session/3?node_id=3&id=NWE5ZWE4YmUtNmJjNjY0MzMtMTU2ZTAyNmItMjIzZGI2MDA=" NodeId: 3 } YdbStatus: SUCCESS ResourceExhausted: false
2025-11-03T16:57:05.123802Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [3:7568544235298246729:2689] (SourceId=test-message-group-id2, PreferedPartition=(NULL)) Select from the table
2025-11-03T16:57:05.135212Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:57:05.135278Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:05.135302Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:05.135333Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:57:05.135349Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:57:05.135361Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:57:05.135385Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:57:05.135441Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:57:05.135454Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:57:05.135474Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:57:05.140756Z node 3 :PQ_PARTITION_CHOOSER TRACE: partition_chooser_impl__abstract_chooser_actor.h:163: StateSelect, received event# 271646721, Sender [3:7568544115039159497:2257], Recipient [3:7568544235298246729:2689]: NKikimrKqp.TEvQueryResponse Response { SessionId: "ydb://session/3?node_id=3&id=NWE5ZWE4YmUtNmJjNjY0MzMtMTU2ZTAyNmItMjIzZGI2MDA=" PreparedQuery: "442ea808-d7231069-9c6e0723-bcf815" QueryParameters { Name: "$Hash" Type { Kind: Data Data { Scheme: 2 } } } QueryParameters { Name: "$Topic" Type { Kind: Data Data { Scheme: 4608 } } } QueryParameters { Name: "$SourceId" Type { Kind: Data Data { Scheme: 4608 } } } TxMeta { id: "01k95ad7v8b1fcq1ej841v9hz7" } YdbResults { columns { name: "Partition" type { optional_type { item { type_id: UINT32 } } } } columns { name: "CreateTime" type { optional_type { item { type_id: UINT64 } } } } columns { name: "AccessTime" type { optional_type { item { type_id: UINT64 } } } } columns { name: "SeqNo" type { optional_type { item { type_id: UINT64 } } } } rows { items { uint32_value: 0 } items { uint64_value: 1762189010911 } items { uint64_value: 1762189020857 } items { uint64_value: 0 } } format: FORMAT_VALUE } QueryDiagnostics: "" } YdbStatus: SUCCESS Cons
2025-11-03T16:57:05.140917Z node 3 :PQ_PARTITION_CHOOSER TRACE: partition_chooser_impl__abstract_chooser_actor.h:151: TPartitionChooser [3:7568544235298246729:2689] (SourceId=test-message-group-id2, PreferedPartition=(NULL)) Selected from table PartitionId=0 SeqNo=0
2025-11-03T16:57:05.140932Z node 3 :PQ_PARTITION_CHOOSER TRACE: partition_chooser_impl__old_chooser_actor.h:113: TPartitionChooser [3:7568544235298246729:2689] (SourceId=test-message-group-id2, PreferedPartition=(NULL)) OnPartitionChosen
2025-11-03T16:57:05.140945Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [3:7568544235298246729:2689] (SourceId=test-message-group-id2, PreferedPartition=(NULL)) Update the table
2025-11-03T16:57:05.166437Z node 3 :PQ_PARTITION_CHOOSER TRACE: partition_chooser_impl__abstract_chooser_actor.h:212: StateUpdate, received event# 271646721, Sender [3:7568544115039159497:2257], Recipient [3:7568544235298246729:2689]: NKikimrKqp.TEvQueryResponse Response { SessionId: "ydb://session/3?node_id=3&id=NWE5ZWE4YmUtNmJjNjY0MzMtMTU2ZTAyNmItMjIzZGI2MDA=" PreparedQuery: "72f7e762-c46fa14f-e3d2f842-88a42755" QueryParameters { Name: "$AccessTime" Type { Kind: Data Data { Scheme: 4 } } } QueryParameters { Name: "$CreateTime" Type { Kind: Data Data { Scheme: 4 } } } QueryParameters { Name: "$Hash" Type { Kind: Data Data { Scheme: 2 } } } QueryParameters { Name: "$Partition" Type { Kind: Data Data { Scheme: 2 } } } QueryParameters { Name: "$SeqNo" Type { Kind: Data Data { Scheme: 4 } } } QueryParameters { Name: "$SourceId" Type { Kind: Data Data { Scheme: 4608 } } } QueryParameters { Name: "$Topic" Type { Kind: Data Data { Scheme: 4608 } } } TxMeta { } QueryDiagnostics: "" } YdbStatus: SUCCESS ConsumedRu: 1
2025-11-03T16:57:05.166495Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [3:7568544235298246729:2689] (SourceId=test-message-group-id2, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-11-03T16:57:05.166530Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [3:7568544235298246729:2689] (SourceId=test-message-group-id2, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-11-03T16:57:05.166552Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [3:7568544235298246729:2689] (SourceId=test-message-group-id2, PreferedPartition=(NULL)) Start idle
2025-11-03T16:57:05.166595Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 7 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-11-03T16:57:05.172112Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 4, Generation: 1
2025-11-03T16:57:05.172050Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 269877761, Sender [4:7568544235290699256:2815], Recipient [4:7568544170866189024:2388]: NKikimr::TEvTabletPipe::TEvServerConnected
2025-11-03T16:57:05.172097Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5330: HandleHook, processing event TEvTabletPipe::TEvServerConnected
2025-11-03T16:57:05.172118Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:2716: [PQ: 72075186224037892] Handle TEvTabletPipe::TEvServerConnected
2025-11-03T16:57:05.172156Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [3:7568544235298246767:2689], now have 1 active actors on pipe
2025-11-03T16:57:05.172452Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271187968, Sender [3:7568544235298246766:2689], Recipient [4:7568544235290699256:2815]
2025-11-03T16:57:05.172476Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5316: HandleHook, processing event TEvPersQueue::TEvRequest
2025-11-03T16:57:05.172556Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:57:05.172585Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:57:05.172678Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188498 (NKikimr::TEvPQ::TEvChangeOwner), Tablet [4:7568544170866189024:2388], Partition 0, Sender [4:7568544170866189024:2388], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:57:05.172719Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188498, Sender [4:7568544170866189024:2388], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvChangeOwner
2025-11-03T16:57:05.172739Z node 4 :PERSQUEUE TRACE: partition.h:642: StateIdle, processing event TEvPQ::TEvChangeOwner
2025-11-03T16:57:05.172755Z node 4 :PERSQUEUE TRACE: partition_write.cpp:154: [72075186224037892][Partition][0][StateIdle] TPartition::HandleOnWrite TEvChangeOwner.
2025-11-03T16:57:05.172776Z node 4 :PERSQUEUE TRACE: partition_write.cpp:873: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessChangeOwnerRequests.
2025-11-03T16:57:05.172791Z node 4 :PERSQUEUE TRACE: partition_write.cpp:107: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessChangeOwnerRequest.
2025-11-03T16:57:05.172841Z node 4 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie test-message-group-id2|496769d2-a98895b3-4a85c4ae-66b3cb17_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner test-message-group-id2
2025-11-03T16:57:05.172859Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:57:05.172883Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:57:05.172902Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:57:05.172916Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-03T16:57:05.172955Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:57:05.172975Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:57:05.173039Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:57:05.173051Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:57:05.173070Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:57:05.173092Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=1
2025-11-03T16:57:05.173119Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-03T16:57:05.173217Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188562 (NKikimr::TEvPQ::TEvTxBatchComplete), Tablet [4:7568544170866189024:2388], Partition 0, Sender [4:7568544170866189065:2388], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:57:05.173255Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188562, Sender [4:7568544170866189065:2388], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvTxBatchComplete
2025-11-03T16:57:05.173302Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271188493, Sender [4:7568544170866189065:2388], Recipient [4:7568544170866189024:2388]: NKikimr::TEvPQ::TEvProxyResponse
2025-11-03T16:57:05.173322Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5335: HandleHook, processing event TEvPQ::TEvProxyResponse
2025-11-03T16:57:05.173346Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-03T16:57:05.173896Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271187968, Sender [3:7568544235298246766:2689], Recipient [4:7568544235290699256:2815]
2025-11-03T16:57:05.173915Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5316: HandleHook, processing event TEvPersQueue::TEvRequest
2025-11-03T16:57:05.173961Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:57:05.173985Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:57:05.174070Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188486 (NKikimr::TEvPQ::TEvGetMaxSeqNoRequest), Tablet [4:7568544170866189024:2388], Partition 0, Sender [4:7568544170866189024:2388], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:57:05.174113Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188486, Sender [4:7568544170866189024:2388], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvGetMaxSeqNoRequest
2025-11-03T16:57:05.174132Z node 4 :PERSQUEUE TRACE: partition.h:634: StateIdle, processing event TEvPQ::TEvGetMaxSeqNoRequest
2025-11-03T16:57:05.174197Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271188493, Sender [4:7568544170866189065:2388], Recipient [4:7568544170866189024:2388]: NKikimr::TEvPQ::TEvProxyResponse
2025-11-03T16:57:05.174214Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5335: HandleHook, processing event TEvPQ::TEvProxyResponse
2025-11-03T16:57:05.174236Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-03T16:57:05.174544Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 7 partition: 0 MaxSeqNo: 14 sessionId: test-message-group-id2|496769d2-a98895b3-4a85c4ae-66b3cb17_0
2025-11-03T16:57:05.175373Z :INFO: [/Root] MessageGroupId [test-message-group-id2] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1762189025175 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-11-03T16:57:05.175471Z :INFO: [/Root] MessageGroupId [test-message-group-id2] SessionId [] Write session established. Init response: last_sequence_number: 14 session_id: "test-message-group-id2|496769d2-a98895b3-4a85c4ae-66b3cb17_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-11-03T16:57:05.175624Z :INFO: [/Root] MessageGroupId [test-message-group-id2] SessionId [test-message-group-id2|496769d2-a98895b3-4a85c4ae-66b3cb17_0] Write session: close. Timeout = 0 ms
2025-11-03T16:57:05.175669Z :INFO: [/Root] MessageGroupId [test-message-group-id2] SessionId [test-message-group-id2|496769d2-a98895b3-4a85c4ae-66b3cb17_0] Write session will now close
2025-11-03T16:57:05.175707Z :DEBUG: [/Root] MessageGroupId [test-message-group-id2] SessionId [test-message-group-id2|496769d2-a98895b3-4a85c4ae-66b3cb17_0] Write session: aborting
2025-11-03T16:57:05.176056Z :INFO: [/Root] MessageGroupId [test-message-group-id2] SessionId [test-message-group-id2|496769d2-a98895b3-4a85c4ae-66b3cb17_0] Write session: gracefully shut down, all writes complete
2025-11-03T16:57:05.176106Z :DEBUG: [/Root] MessageGroupId [test-message-group-id2] SessionId [test-message-group-id2|496769d2-a98895b3-4a85c4ae-66b3cb17_0] Write session: destroy
===Check SeqNo writer2 dc2
2025-11-03T16:57:05.176490Z :DEBUG: [/Root] MessageGroupId [test-message-group-id2] SessionId [] Write session: try to update token
2025-11-03T16:57:05.176556Z :INFO: [/Root] MessageGroupId [test-message-group-id2] SessionId [] Write session: Do CDS request
2025-11-03T16:57:05.176597Z :INFO: [/Root] MessageGroupId [test-message-group-id2] SessionId [] Do schedule cds request after 0 ms
2025-11-03T16:57:05.176771Z :INFO: [/Root] MessageGroupId [test-message-group-id2] Running cds request ms
2025-11-03T16:57:05.178156Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 7 sessionId: test-message-group-id2|496769d2-a98895b3-4a85c4ae-66b3cb17_0 grpc read done: success: 0 data: 
2025-11-03T16:57:05.178182Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 7 sessionId: test-message-group-id2|496769d2-a98895b3-4a85c4ae-66b3cb17_0 grpc read failed
2025-11-03T16:57:05.178213Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 7 sessionId: test-message-group-id2|496769d2-a98895b3-4a85c4ae-66b3cb17_0 grpc closed
2025-11-03T16:57:05.178232Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 7 sessionId: test-message-group-id2|496769d2-a98895b3-4a85c4ae-66b3cb17_0 is DEAD
2025-11-03T16:57:05.179094Z node 3 :PQ_PARTITION_CHOOSER TRACE: partition_chooser_impl__abstract_chooser_actor.h:278: StateIdle, received event# 65543, Sender [3:7568544235298246726:2689], Recipient [3:7568544235298246729:2689]: NActors::TEvents::TEvPoison
2025-11-03T16:57:05.179140Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-11-03T16:57:05.179854Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 269877764, Sender [4:7568544235290699256:2815], Recipient [4:7568544170866189024:2388]: NKikimr::TEvTabletPipe::TEvServerDisconnected
2025-11-03T16:57:05.179889Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5331: HandleHook, processing event TEvTabletPipe::TEvServerDisconnected
2025-11-03T16:57:05.179906Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:2729: [PQ: 72075186224037892] Handle TEvTabletPipe::TEvServerDisconnected
2025-11-03T16:57:05.179933Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [3:7568544235298246767:2689] destroyed
2025-11-03T16:57:05.180010Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188506 (NKikimr::TEvPQ::TEvPipeDisconnected), Tablet [4:7568544170866189024:2388], Partition 0, Sender [4:7568544170866189024:2388], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:57:05.180045Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188506, Sender [4:7568544170866189024:2388], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvPipeDisconnected
2025-11-03T16:57:05.180065Z node 4 :PERSQUEUE TRACE: partition.h:651: StateIdle, processing event TEvPQ::TEvPipeDisconnected
2025-11-03T16:57:05.180089Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-11-03T16:57:05.180108Z node 4 :PERSQUEUE TRACE: partition_write.cpp:873: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessChangeOwnerRequests.
2025-11-03T16:57:05.180129Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:57:05.180141Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:57:05.180155Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:57:05.180174Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:57:05.180229Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:57:05.180240Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:57:05.180260Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:57:05.181422Z :INFO: [/Root] MessageGroupId [test-message-group-id2] SessionId [] Got CDS response: 
write_sessions_clusters { clusters { endpoint: "localhost:14811" name: "dc2" available: true } clusters { endpoint: "localhost:13111" name: "dc1" available: true } primary_cluster_selection_reason: CLIENT_PREFERENCE } version: 1
2025-11-03T16:57:05.181478Z :INFO: [/Root] MessageGroupId [test-message-group-id2] SessionId [] Start write session. Will connect to endpoint: localhost:14811
2025-11-03T16:57:05.188139Z :DEBUG: [/Root] MessageGroupId [test-message-group-id2] SessionId [] Write session: send init request: init_request { topic: "test-topic" message_group_id: "test-message-group-id2" preferred_cluster: "dc2" }
2025-11-03T16:57:05.188484Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-11-03T16:57:05.188512Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 8
2025-11-03T16:57:05.188809Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 8 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "test-message-group-id2" preferred_cluster: "dc2" }
2025-11-03T16:57:05.188903Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 8 topic: "test-topic" message_group_id: "test-message-group-id2" preferred_cluster: "dc2" from ipv6:[::1]:58400
2025-11-03T16:57:05.188921Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=8 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:58400 proto=v1  topic=test-topic durationSec=0
2025-11-03T16:57:05.188929Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-11-03T16:57:05.190296Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 8 sessionId:  describe result for acl check
2025-11-03T16:57:05.190442Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-11-03T16:57:05.190452Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-11-03T16:57:05.190461Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-11-03T16:57:05.190478Z node 1 :PQ_PARTITION_CHOOSER TRACE: partition_chooser_impl__abstract_chooser_actor.h:88: TPartitionChooser [1:7568544233806397760:2727] (SourceId=test-message-group-id2, PreferedPartition=(NULL)) InitTable: SourceId=test-message-group-id2 TopicsAreFirstClassCitizen=0 UseSrcIdMetaMappingInFirstClass=1
2025-11-03T16:57:05.190490Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7568544233806397760:2727] (SourceId=test-message-group-id2, PreferedPartition=(NULL)) StartKqpSession
2025-11-03T16:57:05.193324Z node 1 :PQ_PARTITION_CHOOSER TRACE: partition_chooser_impl__abstract_chooser_actor.h:132: StateCreateKqpSession, received event# 271646728, Sender [1:7568544053417768053:2268], Recipient [1:7568544233806397760:2727]: NKikimrKqp.TEvCreateSessionResponse Error: "" Response { SessionId: "ydb://session/3?node_id=1&id=ZTg3ODgyODMtMzc4ZjExM2MtM2I1M2FiNmUtZjVkZWQxOTg=" NodeId: 1 } YdbStatus: SUCCESS ResourceExhausted: false
2025-11-03T16:57:05.193455Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7568544233806397760:2727] (SourceId=test-message-group-id2, PreferedPartition=(NULL)) Select from the table
2025-11-03T16:57:05.194832Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [4:7568544170866189024:2388], Partition 0, Sender [0:0:0], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:57:05.194907Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:05.194946Z node 4 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:05.194979Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:57:05.194994Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:57:05.195008Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:57:05.195031Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:57:05.195093Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:57:05.195107Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:57:05.195128Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:57:05.200696Z node 1 :PQ_PARTITION_CHOOSER TRACE: partition_chooser_impl__abstract_chooser_actor.h:163: StateSelect, received event# 271646721, Sender [1:7568544053417768053:2268], Recipient [1:7568544233806397760:2727]: NKikimrKqp.TEvQueryResponse Response { SessionId: "ydb://session/3?node_id=1&id=ZTg3ODgyODMtMzc4ZjExM2MtM2I1M2FiNmUtZjVkZWQxOTg=" PreparedQuery: "bf547082-be61c135-9226a4-6fe85003" QueryParameters { Name: "$Hash" Type { Kind: Data Data { Scheme: 2 } } } QueryParameters { Name: "$Topic" Type { Kind: Data Data { Scheme: 4608 } } } QueryParameters { Name: "$SourceId" Type { Kind: Data Data { Scheme: 4608 } } } TxMeta { id: "01k95ad7xab9t7h0zdkppg8k5y" } YdbResults { columns { name: "Partition" type { optional_type { item { type_id: UINT32 } } } } columns { name: "CreateTime" type { optional_type { item { type_id: UINT64 } } } } columns { name: "AccessTime" type { optional_type { item { type_id: UINT64 } } } } columns { name: "SeqNo" type { optional_type { item { type_id: UINT64 } } } } rows { items { uint32_value: 0 } items { uint64_value: 1762189014912 } items { uint64_value: 1762189023601 } items { uint64_value: 0 } } format: FORMAT_VALUE } QueryDiagnostics: "" } YdbStatus: SUCCESS Cons
2025-11-03T16:57:05.200869Z node 1 :PQ_PARTITION_CHOOSER TRACE: partition_chooser_impl__abstract_chooser_actor.h:151: TPartitionChooser [1:7568544233806397760:2727] (SourceId=test-message-group-id2, PreferedPartition=(NULL)) Selected from table PartitionId=0 SeqNo=0
2025-11-03T16:57:05.200884Z node 1 :PQ_PARTITION_CHOOSER TRACE: partition_chooser_impl__old_chooser_actor.h:113: TPartitionChooser [1:7568544233806397760:2727] (SourceId=test-message-group-id2, PreferedPartition=(NULL)) OnPartitionChosen
2025-11-03T16:57:05.200897Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7568544233806397760:2727] (SourceId=test-message-group-id2, PreferedPartition=(NULL)) Update the table
2025-11-03T16:57:05.212059Z node 1 :PQ_PARTITION_CHOOSER TRACE: partition_chooser_impl__abstract_chooser_actor.h:212: StateUpdate, received event# 271646721, Sender [1:7568544053417768053:2268], Recipient [1:7568544233806397760:2727]: NKikimrKqp.TEvQueryResponse Response { SessionId: "ydb://session/3?node_id=1&id=ZTg3ODgyODMtMzc4ZjExM2MtM2I1M2FiNmUtZjVkZWQxOTg=" PreparedQuery: "34f6fc20-f975aeb1-f34c103e-7f2bd9da" QueryParameters { Name: "$AccessTime" Type { Kind: Data Data { Scheme: 4 } } } QueryParameters { Name: "$CreateTime" Type { Kind: Data Data { Scheme: 4 } } } QueryParameters { Name: "$Hash" Type { Kind: Data Data { Scheme: 2 } } } QueryParameters { Name: "$Partition" Type { Kind: Data Data { Scheme: 2 } } } QueryParameters { Name: "$SeqNo" Type { Kind: Data Data { Scheme: 4 } } } QueryParameters { Name: "$SourceId" Type { Kind: Data Data { Scheme: 4608 } } } QueryParameters { Name: "$Topic" Type { Kind: Data Data { Scheme: 4608 } } } TxMeta { } QueryDiagnostics: "" } YdbStatus: SUCCESS ConsumedRu: 1
2025-11-03T16:57:05.212102Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7568544233806397760:2727] (SourceId=test-message-group-id2, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-11-03T16:57:05.212127Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7568544233806397760:2727] (SourceId=test-message-group-id2, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-11-03T16:57:05.212145Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7568544233806397760:2727] (SourceId=test-message-group-id2, PreferedPartition=(NULL)) Start idle
2025-11-03T16:57:05.212178Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 8 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-11-03T16:57:05.213115Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 269877761, Sender [2:7568544232951260142:3064], Recipient [2:7568544108397207262:2383]: NKikimr::TEvTabletPipe::TEvServerConnected
2025-11-03T16:57:05.213151Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5330: HandleHook, processing event TEvTabletPipe::TEvServerConnected
2025-11-03T16:57:05.213167Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:2716: [PQ: 72075186224037892] Handle TEvTabletPipe::TEvServerConnected
2025-11-03T16:57:05.213196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [1:7568544233806397790:2727], now have 1 active actors on pipe
2025-11-03T16:57:05.213529Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1
2025-11-03T16:57:05.215076Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271187968, Sender [1:7568544233806397789:2727], Recipient [2:7568544232951260142:3064]
2025-11-03T16:57:05.215097Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5316: HandleHook, processing event TEvPersQueue::TEvRequest
2025-11-03T16:57:05.215130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc2--test-topic' requestId: <none>
2025-11-03T16:57:05.215146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc2--test-topic' partition 0
2025-11-03T16:57:05.215205Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188498 (NKikimr::TEvPQ::TEvChangeOwner), Tablet [2:7568544108397207262:2383], Partition 0, Sender [2:7568544108397207262:2383], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:57:05.215229Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188498, Sender [2:7568544108397207262:2383], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvChangeOwner
2025-11-03T16:57:05.215244Z node 2 :PERSQUEUE TRACE: partition.h:642: StateIdle, processing event TEvPQ::TEvChangeOwner
2025-11-03T16:57:05.215254Z node 2 :PERSQUEUE TRACE: partition_write.cpp:154: [72075186224037892][Partition][0][StateIdle] TPartition::HandleOnWrite TEvChangeOwner.
2025-11-03T16:57:05.215266Z node 2 :PERSQUEUE TRACE: partition_write.cpp:873: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessChangeOwnerRequests.
2025-11-03T16:57:05.215275Z node 2 :PERSQUEUE TRACE: partition_write.cpp:107: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessChangeOwnerRequest.
2025-11-03T16:57:05.215306Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie test-message-group-id2|d244c11d-f1101354-5046041b-9d2d5679_0 generated for partition 0 topic 'rt3.dc2--test-topic' owner test-message-group-id2
2025-11-03T16:57:05.215318Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:57:05.215334Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:57:05.215347Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:57:05.215353Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-03T16:57:05.215381Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:57:05.215392Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:57:05.215431Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:57:05.215440Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:57:05.215454Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:57:05.215468Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=1
2025-11-03T16:57:05.215486Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-03T16:57:05.215525Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188562 (NKikimr::TEvPQ::TEvTxBatchComplete), Tablet [2:7568544108397207262:2383], Partition 0, Sender [2:7568544108397207303:2383], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:57:05.215546Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188562, Sender [2:7568544108397207303:2383], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvTxBatchComplete
2025-11-03T16:57:05.215573Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271188493, Sender [2:7568544108397207303:2383], Recipient [2:7568544108397207262:2383]: NKikimr::TEvPQ::TEvProxyResponse
2025-11-03T16:57:05.215585Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5335: HandleHook, processing event TEvPQ::TEvProxyResponse
2025-11-03T16:57:05.215606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc2--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-03T16:57:05.217253Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271187968, Sender [1:7568544233806397789:2727], Recipient [2:7568544232951260142:3064]
2025-11-03T16:57:05.217278Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5316: HandleHook, processing event TEvPersQueue::TEvRequest
2025-11-03T16:57:05.217320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc2--test-topic' requestId: <none>
2025-11-03T16:57:05.217353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc2--test-topic' partition 0
2025-11-03T16:57:05.217426Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188486 (NKikimr::TEvPQ::TEvGetMaxSeqNoRequest), Tablet [2:7568544108397207262:2383], Partition 0, Sender [2:7568544108397207262:2383], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:57:05.217464Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188486, Sender [2:7568544108397207262:2383], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvGetMaxSeqNoRequest
2025-11-03T16:57:05.217481Z node 2 :PERSQUEUE TRACE: partition.h:634: StateIdle, processing event TEvPQ::TEvGetMaxSeqNoRequest
2025-11-03T16:57:05.217540Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271188493, Sender [2:7568544108397207303:2383], Recipient [2:7568544108397207262:2383]: NKikimr::TEvPQ::TEvProxyResponse
2025-11-03T16:57:05.217555Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5335: HandleHook, processing event TEvPQ::TEvProxyResponse
2025-11-03T16:57:05.217581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc2--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-03T16:57:05.221049Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 8 partition: 0 MaxSeqNo: 9 sessionId: test-message-group-id2|d244c11d-f1101354-5046041b-9d2d5679_0
2025-11-03T16:57:05.221948Z :INFO: [/Root] MessageGroupId [test-message-group-id2] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1762189025221 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-11-03T16:57:05.222080Z :INFO: [/Root] MessageGroupId [test-message-group-id2] SessionId [] Write session established. Init response: last_sequence_number: 9 session_id: "test-message-group-id2|d244c11d-f1101354-5046041b-9d2d5679_0" topic: "test-topic" cluster: "dc2" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-11-03T16:57:05.222267Z :INFO: [/Root] MessageGroupId [test-message-group-id2] SessionId [test-message-group-id2|d244c11d-f1101354-5046041b-9d2d5679_0] Write session: close. Timeout = 0 ms
2025-11-03T16:57:05.222307Z :INFO: [/Root] MessageGroupId [test-message-group-id2] SessionId [test-message-group-id2|d244c11d-f1101354-5046041b-9d2d5679_0] Write session will now close
2025-11-03T16:57:05.222350Z :DEBUG: [/Root] MessageGroupId [test-message-group-id2] SessionId [test-message-group-id2|d244c11d-f1101354-5046041b-9d2d5679_0] Write session: aborting
2025-11-03T16:57:05.222732Z :INFO: [/Root] MessageGroupId [test-message-group-id2] SessionId [test-message-group-id2|d244c11d-f1101354-5046041b-9d2d5679_0] Write session: gracefully shut down, all writes complete
2025-11-03T16:57:05.222773Z :DEBUG: [/Root] MessageGroupId [test-message-group-id2] SessionId [test-message-group-id2|d244c11d-f1101354-5046041b-9d2d5679_0] Write session: destroy
2025-11-03T16:57:05.224734Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 8 sessionId: test-message-group-id2|d244c11d-f1101354-5046041b-9d2d5679_0 grpc read done: success: 0 data: 
2025-11-03T16:57:05.224759Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 8 sessionId: test-message-group-id2|d244c11d-f1101354-5046041b-9d2d5679_0 grpc read failed
2025-11-03T16:57:05.224781Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 8 sessionId: test-message-group-id2|d244c11d-f1101354-5046041b-9d2d5679_0 grpc closed
2025-11-03T16:57:05.224798Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 8 sessionId: test-message-group-id2|d244c11d-f1101354-5046041b-9d2d5679_0 is DEAD
2025-11-03T16:57:05.225375Z node 1 :PQ_PARTITION_CHOOSER TRACE: partition_chooser_impl__abstract_chooser_actor.h:278: StateIdle, received event# 65543, Sender [1:7568544233806397758:2727], Recipient [1:7568544233806397760:2727]: NActors::TEvents::TEvPoison
2025-11-03T16:57:05.225426Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-11-03T16:57:05.227710Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 269877764, Sender [2:7568544232951260142:3064], Recipient [2:7568544108397207262:2383]: NKikimr::TEvTabletPipe::TEvServerDisconnected
2025-11-03T16:57:05.227749Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5331: HandleHook, processing event TEvTabletPipe::TEvServerDisconnected
2025-11-03T16:57:05.227765Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:2729: [PQ: 72075186224037892] Handle TEvTabletPipe::TEvServerDisconnected
2025-11-03T16:57:05.227791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [1:7568544233806397790:2727] destroyed
2025-11-03T16:57:05.227847Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188506 (NKikimr::TEvPQ::TEvPipeDisconnected), Tablet [2:7568544108397207262:2383], Partition 0, Sender [2:7568544108397207262:2383], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:57:05.227883Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188506, Sender [2:7568544108397207262:2383], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvPipeDisconnected
2025-11-03T16:57:05.227902Z node 2 :PERSQUEUE TRACE: partition.h:651: StateIdle, processing event TEvPQ::TEvPipeDisconnected
2025-11-03T16:57:05.227924Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-11-03T16:57:05.227942Z node 2 :PERSQUEUE TRACE: partition_write.cpp:873: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessChangeOwnerRequests.
2025-11-03T16:57:05.227963Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:57:05.227992Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:57:05.228004Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:57:05.228021Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:57:05.228081Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:57:05.228092Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:57:05.228113Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:57:05.237394Z :INFO: [/Root] [/Root] [83b2cb92-37c5ba22-4640e384-36106743] Starting read session
2025-11-03T16:57:05.237454Z :DEBUG: [/Root] [/Root] [83b2cb92-37c5ba22-4640e384-36106743] Starting cluster discovery
2025-11-03T16:57:05.237432Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 270794757, Sender [0:0:0], Recipient [4:7568544170866189024:2388]: NKikimr::TEvKeyValue::TEvPeriodicRefresh
===Get event on client
2025-11-03T16:57:05.240117Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:57:05.240179Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:05.240201Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:05.240232Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:57:05.240249Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:57:05.240261Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:57:05.240283Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:57:05.240343Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:57:05.240356Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:57:05.240377Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:57:05.246283Z :DEBUG: [/Root] [/Root] [83b2cb92-37c5ba22-4640e384-36106743] Cluster discovery request succeeded
2025-11-03T16:57:05.246366Z :DEBUG: [/Root] [/Root] [83b2cb92-37c5ba22-4640e384-36106743] Starting session to cluster dc2 (localhost:14811)
2025-11-03T16:57:05.246461Z :DEBUG: [/Root] [/Root] [83b2cb92-37c5ba22-4640e384-36106743] Starting session to cluster dc1 (localhost:13111)
2025-11-03T16:57:05.246611Z :DEBUG: [/Root] [/Root] [83b2cb92-37c5ba22-4640e384-36106743] [dc2] In Reconnect, ReadSizeBudget = 26214400, ReadSizeServerDelta = 0
2025-11-03T16:57:05.246668Z :DEBUG: [/Root] [/Root] [83b2cb92-37c5ba22-4640e384-36106743] [dc2] New values: ReadSizeBudget = 26214400, ReadSizeServerDelta = 0
2025-11-03T16:57:05.246711Z :DEBUG: [/Root] [/Root] [83b2cb92-37c5ba22-4640e384-36106743] [dc2] Reconnecting session to cluster dc2 in 0.000000s
2025-11-03T16:57:05.249604Z :DEBUG: [/Root] [/Root] [83b2cb92-37c5ba22-4640e384-36106743] [dc1] In Reconnect, ReadSizeBudget = 26214400, ReadSizeServerDelta = 0
2025-11-03T16:57:05.249642Z :DEBUG: [/Root] [/Root] [83b2cb92-37c5ba22-4640e384-36106743] [dc1] New values: ReadSizeBudget = 26214400, ReadSizeServerDelta = 0
2025-11-03T16:57:05.249669Z :DEBUG: [/Root] [/Root] [83b2cb92-37c5ba22-4640e384-36106743] [dc1] Reconnecting session to cluster dc1 in 0.000000s
2025-11-03T16:57:05.251331Z :DEBUG: [/Root] [/Root] [83b2cb92-37c5ba22-4640e384-36106743] [dc2] Successfully connected. Initializing session
2025-11-03T16:57:05.256072Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 65538, Sender [0:0:0], Recipient [4:7568544170866189024:2388]: NActors::TEvents::TEvWakeup
2025-11-03T16:57:05.262340Z :DEBUG: [/Root] [/Root] [83b2cb92-37c5ba22-4640e384-36106743] [dc1] Successfully connected. Initializing session
2025-11-03T16:57:05.271574Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:109: new grpc connection
2025-11-03T16:57:05.271608Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:131: new session created cookie 1
2025-11-03T16:57:05.271897Z node 3 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:109: new grpc connection
2025-11-03T16:57:05.271919Z node 3 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:131: new session created cookie 1
2025-11-03T16:57:05.284896Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { topic: "test-topic" } read_only_original: true consumer: "shared/user" read_params { max_read_size: 52428800 } } }
2025-11-03T16:57:05.285466Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { topic: "test-topic" } read_only_original: true consumer: "shared/user" read_params { max_read_size: 52428800 } } }
2025-11-03T16:57:05.293742Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 1 consumer shared/user session shared/user_1_1_503573812852966014_v1 read init: from# ipv6:[::1]:58412, request# { init_request { topics_read_settings { topic: "test-topic" } read_only_original: true consumer: "shared/user" read_params { max_read_size: 52428800 } } }
2025-11-03T16:57:05.294439Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 1 consumer shared/user session shared/user_1_1_503573812852966014_v1 auth for : user
2025-11-03T16:57:05.294848Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 1 consumer shared/user session shared/user_3_1_5127326268369064539_v1 read init: from# ipv6:[::1]:60228, request# { init_request { topics_read_settings { topic: "test-topic" } read_only_original: true consumer: "shared/user" read_params { max_read_size: 52428800 } } }
2025-11-03T16:57:05.295304Z node 3 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 1 consumer shared/user session shared/user_3_1_5127326268369064539_v1 auth for : user
2025-11-03T16:57:05.295517Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 1 consumer shared/user session shared/user_1_1_503573812852966014_v1 Handle describe topics response
2025-11-03T16:57:05.295710Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 1 consumer shared/user session shared/user_1_1_503573812852966014_v1 auth is DEAD
2025-11-03T16:57:05.295794Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 1 consumer shared/user session shared/user_1_1_503573812852966014_v1 auth ok: topics# 1, initDone# 0
2025-11-03T16:57:05.294796Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [4:7568544170866189024:2388], Partition 0, Sender [0:0:0], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:57:05.294887Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:05.294913Z node 4 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:05.294965Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:57:05.294983Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:57:05.294998Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:57:05.295021Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:57:05.295090Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:57:05.295115Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:57:05.295136Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:57:05.297241Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 1 consumer shared/user session shared/user_1_1_503573812852966014_v1 register session: topic# rt3.dc2--test-topic
2025-11-03T16:57:05.297718Z :INFO: [/Root] [/Root] [83b2cb92-37c5ba22-4640e384-36106743] [dc2] Server session id: shared/user_1_1_503573812852966014_v1
2025-11-03T16:57:05.295915Z node 3 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 1 consumer shared/user session shared/user_3_1_5127326268369064539_v1 Handle describe topics response
2025-11-03T16:57:05.296017Z node 3 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 1 consumer shared/user session shared/user_3_1_5127326268369064539_v1 auth is DEAD
2025-11-03T16:57:05.296073Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 1 consumer shared/user session shared/user_3_1_5127326268369064539_v1 auth ok: topics# 1, initDone# 0
2025-11-03T16:57:05.297300Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 1 consumer shared/user session shared/user_3_1_5127326268369064539_v1 register session: topic# rt3.dc1--test-topic
2025-11-03T16:57:05.298490Z node 3 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1655: [72075186224037893][rt3.dc1--test-topic] pipe [3:7568544235298246777:2696] connected; active server actors: 1
2025-11-03T16:57:05.298809Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1655: [72075186224037893][rt3.dc2--test-topic] pipe [1:7568544233806397797:2732] connected; active server actors: 1
2025-11-03T16:57:05.299500Z :INFO: [/Root] [/Root] [83b2cb92-37c5ba22-4640e384-36106743] [dc1] Server session id: shared/user_3_1_5127326268369064539_v1
2025-11-03T16:57:05.298681Z node 3 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1706: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [3:7568544235298246777:2696] session shared/user_3_1_5127326268369064539_v1
2025-11-03T16:57:05.298960Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1706: [72075186224037893][rt3.dc2--test-topic] consumer "user" register session for pipe [1:7568544233806397797:2732] session shared/user_1_1_503573812852966014_v1
2025-11-03T16:57:05.300201Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_1_1_503573812852966014_v1 grpc read done: success# 1, data# { read { } }
2025-11-03T16:57:05.300300Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_1_1_503573812852966014_v1 got read request: guid# 7c761041-7de8972f-4db21f4a-c19b09da
2025-11-03T16:57:05.300864Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_3_1_5127326268369064539_v1 grpc read done: success# 1, data# { read { } }
2025-11-03T16:57:05.300952Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_3_1_5127326268369064539_v1 got read request: guid# fe5204be-6a6d7b0-eac00269-832e6763
2025-11-03T16:57:05.307551Z :DEBUG: [/Root] [/Root] [83b2cb92-37c5ba22-4640e384-36106743] [dc2] After sending read request: ReadSizeBudget = 26214400, ReadSizeServerDelta = 0
2025-11-03T16:57:05.307551Z :DEBUG: [/Root] [/Root] [83b2cb92-37c5ba22-4640e384-36106743] [dc1] After sending read request: ReadSizeBudget = 26214400, ReadSizeServerDelta = 0
2025-11-03T16:57:05.310239Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:639: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-11-03T16:57:05.310349Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:669: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-11-03T16:57:05.310405Z node 3 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:871: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_3_1_5127326268369064539_v1" (Sender=[3:7568544235298246774:2696], Pipe=[3:7568544235298246777:2696], Partitions=[], ActiveFamilyCount=0)
2025-11-03T16:57:05.310445Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1186: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-11-03T16:57:05.308098Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 65538 (NActors::TEvents::TEvWakeup), Tablet [4:7568544170866189024:2388], Partition 0, Sender [0:0:0], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:57:05.308180Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 65538, Sender [0:0:0], Recipient [4:7568544170866189065:2388]: NActors::TEvents::TEvWakeup
2025-11-03T16:57:05.308436Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:57:05.308504Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271188501, Sender [4:7568544170866189065:2388], Recipient [4:7568544170866189024:2388]: NKikimr::TEvPQ::TEvPartitionCounters
2025-11-03T16:57:05.308531Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5324: HandleHook, processing event TEvPQ::TEvPartitionCounters
2025-11-03T16:57:05.308547Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:1078: [PQ: 72075186224037892] Handle TEvPQ::TEvPartitionCounters PartitionId 0
2025-11-03T16:57:05.308784Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271188503, Sender [4:7568544170866189065:2388], Recipient [4:7568544170866189024:2388]: NKikimr::TEvPQ::TEvPartitionLabeledCounters
2025-11-03T16:57:05.308802Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5326: HandleHook, processing event TEvPQ::TEvPartitionLabeledCounters
2025-11-03T16:57:05.308850Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271188503, Sender [4:7568544170866189065:2388], Recipient [4:7568544170866189024:2388]: NKikimr::TEvPQ::TEvPartitionLabeledCounters
2025-11-03T16:57:05.308863Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5326: HandleHook, processing event TEvPQ::TEvPartitionLabeledCounters
2025-11-03T16:57:05.311608Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:639: [72075186224037893][rt3.dc2--test-topic] consumer user register readable partition 0
2025-11-03T16:57:05.311672Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:669: [72075186224037893][rt3.dc2--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-11-03T16:57:05.311704Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:871: [72075186224037893][rt3.dc2--test-topic] consumer user register reading session ReadingSession "shared/user_1_1_503573812852966014_v1" (Sender=[1:7568544233806397794:2732], Pipe=[1:7568544233806397797:2732], Partitions=[], ActiveFamilyCount=0)
2025-11-03T16:57:05.311723Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1186: [72075186224037893][rt3.dc2--test-topic] consumer user rebalancing was scheduled
2025-11-03T16:57:05.324199Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1258: [72075186224037893][rt3.dc2--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-11-03T16:57:05.324323Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1305: [72075186224037893][rt3.dc2--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_1_503573812852966014_v1" (Sender=[1:7568544233806397794:2732], Pipe=[1:7568544233806397797:2732], Partitions=[], ActiveFamilyCount=0)
2025-11-03T16:57:05.324375Z node 1 :PERSQUEUE_READ_BALANCER TRACE: read_balancer__balancing.cpp:308: [72075186224037893][rt3.dc2--test-topic] consumer user family 1 status Free partitions [0] start reading
2025-11-03T16:57:05.324460Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:549: [72075186224037893][rt3.dc2--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_1_1_503573812852966014_v1" sender [1:7568544233806397794:2732] lock partition 0 for ReadingSession "shared/user_1_1_503573812852966014_v1" (Sender=[1:7568544233806397794:2732], Pipe=[1:7568544233806397797:2732], Partitions=[], ActiveFamilyCount=1) generation 1 step 1
2025-11-03T16:57:05.324547Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1325: [72075186224037893][rt3.dc2--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-11-03T16:57:05.324582Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1402: [72075186224037893][rt3.dc2--test-topic] consumer user balancing duration: 0.000334s
2025-11-03T16:57:05.328163Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188544 (NKikimr::NPQ::NReadQuoterEvents::TEvQuotaCountersUpdated), Tablet [4:7568544170866189024:2388], Partition 0, Sender [4:7568544170866189068:2388], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:57:05.328233Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188544, Sender [4:7568544170866189068:2388], Recipient [4:7568544170866189065:2388]: NKikimr::NPQ::NReadQuoterEvents::TEvQuotaCountersUpdated
2025-11-03T16:57:05.328254Z node 4 :PERSQUEUE TRACE: partition.h:671: StateIdle, processing event NReadQuoterEvents::TEvQuotaCountersUpdated
2025-11-03T16:57:05.326022Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1258: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-11-03T16:57:05.326087Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1305: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_3_1_5127326268369064539_v1" (Sender=[3:7568544235298246774:2696], Pipe=[3:7568544235298246777:2696], Partitions=[], ActiveFamilyCount=0)
2025-11-03T16:57:05.326112Z node 3 :PERSQUEUE_READ_BALANCER TRACE: read_balancer__balancing.cpp:308: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Free partitions [0] start reading
2025-11-03T16:57:05.326176Z node 3 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:549: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_3_1_5127326268369064539_v1" sender [3:7568544235298246774:2696] lock partition 0 for ReadingSession "shared/user_3_1_5127326268369064539_v1" (Sender=[3:7568544235298246774:2696], Pipe=[3:7568544235298246777:2696], Partitions=[], ActiveFamilyCount=1) generation 1 step 1
2025-11-03T16:57:05.326215Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1325: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-11-03T16:57:05.326234Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1402: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000178s
2025-11-03T16:57:05.342593Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 1 consumer shared/user session shared/user_1_1_503573812852966014_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc2--test-topic" Generation: 1 Step: 1 Session: "shared/user_1_1_503573812852966014_v1" ClientId: "user" PipeClient { RawX1: 7568544233806397797 RawX2: 4503603922340524 } Path: "/Root/PQ/rt3.dc2--test-topic" }
2025-11-03T16:57:05.342666Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 1 consumer shared/user session shared/user_1_1_503573812852966014_v1 INITING TopicId: Topic rt3.dc2--test-topic in dc dc2 in database: Root, partition 0(assignId:1)
2025-11-03T16:57:05.340461Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:57:05.340548Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:05.340572Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:05.340610Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:57:05.340625Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:57:05.340638Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:57:05.340662Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:57:05.340721Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:57:05.340735Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:57:05.340756Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:57:05.340804Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188544 (NKikimr::NPQ::NReadQuoterEvents::TEvQuotaCountersUpdated), Tablet [2:7568544108397207262:2383], Partition 0, Sender [2:7568544108397207306:2383], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:57:05.340845Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188544, Sender [2:7568544108397207306:2383], Recipient [2:7568544108397207303:2383]: NKikimr::NPQ::NReadQuoterEvents::TEvQuotaCountersUpdated
2025-11-03T16:57:05.340861Z node 2 :PERSQUEUE TRACE: partition.h:671: StateIdle, processing event NReadQuoterEvents::TEvQuotaCountersUpdated
2025-11-03T16:57:05.343639Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 269877761, Sender [2:7568544232951260145:3067], Recipient [2:7568544108397207262:2383]: NKikimr::TEvTabletPipe::TEvServerConnected
2025-11-03T16:57:05.343662Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5330: HandleHook, processing event TEvTabletPipe::TEvServerConnected
2025-11-03T16:57:05.343687Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:2716: [PQ: 72075186224037892] Handle TEvTabletPipe::TEvServerConnected
2025-11-03T16:57:05.343716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [1:7568544233806397800:2735], now have 1 active actors on pipe
2025-11-03T16:57:05.342340Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 1 consumer shared/user session shared/user_3_1_5127326268369064539_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 1 Session: "shared/user_3_1_5127326268369064539_v1" ClientId: "user" PipeClient { RawX1: 7568544235298246777 RawX2: 4503612512275080 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-11-03T16:57:05.343848Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_503573812852966014_v1 TopicId: Topic rt3.dc2--test-topic in dc dc2 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 1, pipe: [1:7568544233806397800:2735]
2025-11-03T16:57:05.342466Z node 3 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 1 consumer shared/user session shared/user_3_1_5127326268369064539_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-11-03T16:57:05.344184Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271187968, Sender [1:7568544233806397799:2735], Recipient [2:7568544232951260145:3067]
2025-11-03T16:57:05.344212Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5316: HandleHook, processing event TEvPersQueue::TEvRequest
2025-11-03T16:57:05.344269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc2--test-topic' requestId: <none>
2025-11-03T16:57:05.344292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc2--test-topic' partition 0
2025-11-03T16:57:05.344341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1748: [PQ: 72075186224037892] Created session shared/user_1_1_503573812852966014_v1 on pipe: [1:7568544233806397800:2735]
2025-11-03T16:57:05.344440Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188488 (NKikimr::TEvPQ::TEvSetClientInfo), Tablet [2:7568544108397207262:2383], Partition 0, Sender [2:7568544108397207262:2383], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:57:05.344478Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188488, Sender [2:7568544108397207262:2383], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvSetClientInfo
2025-11-03T16:57:05.344500Z node 2 :PERSQUEUE TRACE: partition.h:638: StateIdle, processing event TEvPQ::TEvSetClientInfo
2025-11-03T16:57:05.344544Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:57:05.344556Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_1_503573812852966014_v1:1 with generation 1
2025-11-03T16:57:05.344571Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:57:05.344586Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-03T16:57:05.348719Z node 3 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_3_1_5127326268369064539_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 1, pipe: [3:7568544235298246782:2699]
2025-11-03T16:57:05.348610Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 269877761, Sender [4:7568544235290699259:2818], Recipient [4:7568544170866189024:2388]: NKikimr::TEvTabletPipe::TEvServerConnected
2025-11-03T16:57:05.348655Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5330: HandleHook, processing event TEvTabletPipe::TEvServerConnected
2025-11-03T16:57:05.348684Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:2716: [PQ: 72075186224037892] Handle TEvTabletPipe::TEvServerConnected
2025-11-03T16:57:05.348717Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [3:7568544235298246782:2699], now have 1 active actors on pipe
2025-11-03T16:57:05.348974Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271187968, Sender [3:7568544235298246781:2699], Recipient [4:7568544235290699259:2818]
2025-11-03T16:57:05.348997Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5316: HandleHook, processing event TEvPersQueue::TEvRequest
2025-11-03T16:57:05.349079Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:57:05.349106Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:57:05.349139Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:1748: [PQ: 72075186224037892] Created session shared/user_3_1_5127326268369064539_v1 on pipe: [3:7568544235298246782:2699]
2025-11-03T16:57:05.349242Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188488 (NKikimr::TEvPQ::TEvSetClientInfo), Tablet [4:7568544170866189024:2388], Partition 0, Sender [4:7568544170866189024:2388], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:57:05.349285Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188488, Sender [4:7568544170866189024:2388], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvSetClientInfo
2025-11-03T16:57:05.349305Z node 4 :PERSQUEUE TRACE: partition.h:638: StateIdle, processing event TEvPQ::TEvSetClientInfo
2025-11-03T16:57:05.349338Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:57:05.349361Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:57:05.349372Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-03T16:57:05.349445Z node 4 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_3_1_5127326268369064539_v1:1 with generation 1
2025-11-03T16:57:05.369149Z node 2 :PERSQUEUE DEBUG: partition.cpp:3666: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc2--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_1_1_503573812852966014_v1
2025-11-03T16:57:05.369198Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:57:05.369221Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:57:05.369307Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:57:05.369325Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:57:05.369599Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188562 (NKikimr::TEvPQ::TEvTxBatchComplete), Tablet [2:7568544108397207262:2383], Partition 0, Sender [2:7568544108397207303:2383], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:57:05.369657Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188562, Sender [2:7568544108397207303:2383], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvTxBatchComplete
2025-11-03T16:57:05.369685Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-03T16:57:05.369883Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 270794752, Sender [2:7568544108397207286:2383], Recipient [2:7568544108397207262:2383]: NKikimrClient.TKeyValueRequest Cookie: 4 CmdWrite { Key: "i0000000000" Value: "\030\000(\203\263\232\325\2443" StorageChannel: INLINE } CmdWrite { Key: "m0000000000cuser" Value: "\010\000\020\001\030\001\"%shared/user_1_1_503573812852966014_v1(\0000\000@\000" StorageChannel: INLINE } CmdWrite { Key: "m0000000000uuser" Value: "\000\000\000\000\000\000\000\000\001\000\000\000\001\000\000\000shared/user_1_1_503573812852966014_v1" StorageChannel: INLINE }
2025-11-03T16:57:05.370051Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 270794753, Sender [2:7568544232951260146:2383], Recipient [2:7568544108397207262:2383]: NKikimr::TEvKeyValue::TEvIntermediate
2025-11-03T16:57:05.372170Z node 4 :PERSQUEUE DEBUG: partition.cpp:3666: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_3_1_5127326268369064539_v1
2025-11-03T16:57:05.372226Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:57:05.372242Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:57:05.372307Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:57:05.372326Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:57:05.372567Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188562 (NKikimr::TEvPQ::TEvTxBatchComplete), Tablet [4:7568544170866189024:2388], Partition 0, Sender [4:7568544170866189065:2388], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:57:05.372618Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188562, Sender [4:7568544170866189065:2388], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvTxBatchComplete
2025-11-03T16:57:05.372666Z node 4 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-03T16:57:05.372859Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 270794752, Sender [4:7568544170866189047:2388], Recipient [4:7568544170866189024:2388]: NKikimrClient.TKeyValueRequest Cookie: 23 CmdWrite { Key: "i0000000000" Value: "\030\000(\336\225\232\325\2443" StorageChannel: INLINE } CmdWrite { Key: "m0000000000cuser" Value: "\010\000\020\001\030\001\"&shared/user_3_1_5127326268369064539_v1(\0000\000@\000" StorageChannel: INLINE } CmdWrite { Key: "m0000000000uuser" Value: "\000\000\000\000\000\000\000\000\001\000\000\000\001\000\000\000shared/user_3_1_5127326268369064539_v1" StorageChannel: INLINE }
2025-11-03T16:57:05.373046Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 270794753, Sender [4:7568544235290699260:2388], Recipient [4:7568544170866189024:2388]: NKikimr::TEvKeyValue::TEvIntermediate
2025-11-03T16:57:05.376613Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 270795264 (NKikimr::TEvKeyValue::TEvResponse), Tablet [4:7568544170866189024:2388], Partition 0, Sender [4:7568544170866189047:2388], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:57:05.376777Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 270795264, Sender [4:7568544170866189047:2388], Recipient [4:7568544170866189065:2388]: NKikimrClient.TResponse Status: 1 WriteResult { Status: 0 StatusFlags: 1 } WriteResult { Status: 0 StatusFlags: 1 } WriteResult { Status: 0 StatusFlags: 1 }
2025-11-03T16:57:05.376803Z node 4 :PERSQUEUE TRACE: partition.h:625: StateIdle, processing event TEvKeyValue::TEvResponse
2025-11-03T16:57:05.376820Z node 4 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-03T16:57:05.376864Z node 4 :PERSQUEUE TRACE: partition_write.cpp:518: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse.
2025-11-03T16:57:05.376902Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-11-03T16:57:05.376920Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:57:05.376932Z node 4 :PERSQUEUE TRACE: partition_write.cpp:424: [72075186224037892][Partition][0][StateIdle] TPartition::SyncMemoryStateWithKVState.
2025-11-03T16:57:05.376954Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:57:05.376970Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:57:05.376985Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:57:05.377004Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:57:05.377046Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:57:05.377061Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:57:05.377077Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:57:05.377095Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:57:05.377164Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271188502, Sender [4:7568544170866189047:2388], Recipient [4:7568544170866189024:2388]: NKikimr::TEvPQ::TEvTabletCacheCounters
2025-11-03T16:57:05.377186Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5328: HandleHook, processing event TEvPQ::TEvTabletCacheCounters
2025-11-03T16:57:05.377209Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:1186: [PQ: 72075186224037892] Topic 'rt3.dc1--test-topic' counters. CacheSize 4592 CachedBlobs 22
2025-11-03T16:57:05.377259Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271188493, Sender [4:7568544170866189065:2388], Recipient [4:7568544170866189024:2388]: NKikimr::TEvPQ::TEvProxyResponse
2025-11-03T16:57:05.377278Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5335: HandleHook, processing event TEvPQ::TEvProxyResponse
2025-11-03T16:57:05.377309Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-11-03T16:57:05.377608Z node 4 :PERSQUEUE TRACE: pq_l2_cache.h:116: StateFunc, received event# 271450112, Sender [4:7568544170866189047:2388], Recipient [4:7568544115031613334:2071]: NKikimr::NPQ::TEvPqCache::TEvCacheL2Request
2025-11-03T16:57:05.377632Z node 4 :PERSQUEUE TRACE: pq_l2_cache.h:119: StateFunc, processing event TEvPqCache::TEvCacheL2Request
2025-11-03T16:57:05.378090Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_3_1_5127326268369064539_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 28 WriteTimestampMS: 1762189010947 CreateTimestampMS: 1762189010839 SizeLag: 4232 WriteTimestampEstimateMS: 1762189025307 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-11-03T16:57:05.378163Z node 3 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 1 consumer shared/user session shared/user_3_1_5127326268369064539_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 28 readOffset 0 committedOffset 0
2025-11-03T16:57:05.378249Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 1 consumer shared/user session shared/user_3_1_5127326268369064539_v1 sending to client partition status
2025-11-03T16:57:05.383374Z :INFO: [/Root] [/Root] [83b2cb92-37c5ba22-4640e384-36106743] [dc1] Confirm partition stream create. Partition stream id: 2. Cluster: "dc1". Topic: "test-topic". Partition: 0. Read offset: (NULL)
===Get event on client
2025-11-03T16:57:05.385729Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 270795264 (NKikimr::TEvKeyValue::TEvResponse), Tablet [2:7568544108397207262:2383], Partition 0, Sender [2:7568544108397207286:2383], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:57:05.385891Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 270795264, Sender [2:7568544108397207286:2383], Recipient [2:7568544108397207303:2383]: NKikimrClient.TResponse Status: 1 WriteResult { Status: 0 StatusFlags: 1 } WriteResult { Status: 0 StatusFlags: 1 } WriteResult { Status: 0 StatusFlags: 1 }
2025-11-03T16:57:05.385915Z node 2 :PERSQUEUE TRACE: partition.h:625: StateIdle, processing event TEvKeyValue::TEvResponse
2025-11-03T16:57:05.385934Z node 2 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-03T16:57:05.385975Z node 2 :PERSQUEUE TRACE: partition_write.cpp:518: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse.
2025-11-03T16:57:05.386016Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-11-03T16:57:05.386034Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:57:05.386045Z node 2 :PERSQUEUE TRACE: partition_write.cpp:424: [72075186224037892][Partition][0][StateIdle] TPartition::SyncMemoryStateWithKVState.
2025-11-03T16:57:05.386068Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:57:05.386081Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:57:05.386095Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:57:05.386111Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:57:05.386148Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:57:05.386160Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:57:05.386175Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:57:05.386191Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:57:05.386252Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271188493, Sender [2:7568544108397207303:2383], Recipient [2:7568544108397207262:2383]: NKikimr::TEvPQ::TEvProxyResponse
2025-11-03T16:57:05.386270Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5335: HandleHook, processing event TEvPQ::TEvProxyResponse
2025-11-03T16:57:05.386298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc2--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-11-03T16:57:05.387250Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_1_1_503573812852966014_v1 TopicId: Topic rt3.dc2--test-topic in dc dc2 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 6 WriteTimestampMS: 1762189016436 CreateTimestampMS: 1762189016376 SizeLag: 528 WriteTimestampEstimateMS: 1762189025340 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-11-03T16:57:05.387294Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 1 consumer shared/user session shared/user_1_1_503573812852966014_v1 INIT DONE TopicId: Topic rt3.dc2--test-topic in dc dc2 in database: Root, partition 0(assignId:1) EndOffset 6 readOffset 0 committedOffset 0
2025-11-03T16:57:05.387350Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 1 consumer shared/user session shared/user_1_1_503573812852966014_v1 sending to client partition status
2025-11-03T16:57:05.386874Z node 2 :PERSQUEUE TRACE: pq_l2_cache.h:116: StateFunc, received event# 271450112, Sender [2:7568544108397207286:2383], Recipient [2:7568544048267664305:2071]: NKikimr::NPQ::TEvPqCache::TEvCacheL2Request
2025-11-03T16:57:05.386903Z node 2 :PERSQUEUE TRACE: pq_l2_cache.h:119: StateFunc, processing event TEvPqCache::TEvCacheL2Request
2025-11-03T16:57:05.388694Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_3_1_5127326268369064539_v1 grpc read done: success# 1, data# { start_read { topic { path: "test-topic" } cluster: "dc1" assign_id: 1 } }
2025-11-03T16:57:05.388886Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:539: session cookie 1 consumer shared/user session shared/user_3_1_5127326268369064539_v1 got StartRead from client: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 0, commitOffset# 0
2025-11-03T16:57:05.388986Z node 3 :PQ_READ_PROXY INFO: partition_actor.cpp:1023: session cookie 1 consumer shared/user session shared/user_3_1_5127326268369064539_v1 Start reading TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 28 readOffset 0 committedOffset 0 clientCommitOffset 0 clientReadOffset 0
2025-11-03T16:57:05.389036Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_3_1_5127326268369064539_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 0 endOffset 28
2025-11-03T16:57:05.389186Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_3_1_5127326268369064539_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 0, endOffset# 28, WTime# 1762189010947, sizeLag# 4232
2025-11-03T16:57:05.389229Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_3_1_5127326268369064539_v1TEvPartitionReady. Aval parts: 1
2025-11-03T16:57:05.389300Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_3_1_5127326268369064539_v1 performing read request: guid# fe5204be-6a6d7b0-eac00269-832e6763, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 33, size# 5078, partitionsAsked# 1, maxTimeLag# 0ms
2025-11-03T16:57:05.391222Z :INFO: [/Root] [/Root] [83b2cb92-37c5ba22-4640e384-36106743] [dc2] Confirm partition stream create. Partition stream id: 1. Cluster: "dc2". Topic: "test-topic". Partition: 0. Read offset: (NULL)
===Get event on client
2025-11-03T16:57:05.391804Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_1_1_503573812852966014_v1 grpc read done: success# 1, data# { start_read { topic { path: "test-topic" } cluster: "dc2" assign_id: 1 } }
2025-11-03T16:57:05.391948Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:539: session cookie 1 consumer shared/user session shared/user_1_1_503573812852966014_v1 got StartRead from client: partition# TopicId: Topic rt3.dc2--test-topic in dc dc2 in database: Root, partition 0(assignId:1), readOffset# 0, commitOffset# 0
2025-11-03T16:57:05.392021Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1023: session cookie 1 consumer shared/user session shared/user_1_1_503573812852966014_v1 Start reading TopicId: Topic rt3.dc2--test-topic in dc dc2 in database: Root, partition 0(assignId:1) EndOffset 6 readOffset 0 committedOffset 0 clientCommitOffset 0 clientReadOffset 0
2025-11-03T16:57:05.392044Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_1_1_503573812852966014_v1 TopicId: Topic rt3.dc2--test-topic in dc dc2 in database: Root, partition 0(assignId:1) ready for read with readOffset 0 endOffset 6
2025-11-03T16:57:05.392137Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_1_1_503573812852966014_v1 partition ready for read: partition# TopicId: Topic rt3.dc2--test-topic in dc dc2 in database: Root, partition 0(assignId:1), readOffset# 0, endOffset# 6, WTime# 1762189016436, sizeLag# 528
2025-11-03T16:57:05.392153Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_1_1_503573812852966014_v1TEvPartitionReady. Aval parts: 1
2025-11-03T16:57:05.392187Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_1_1_503573812852966014_v1 performing read request: guid# 7c761041-7de8972f-4db21f4a-c19b09da, from# TopicId: Topic rt3.dc2--test-topic in dc dc2 in database: Root, partition 0(assignId:1), count# 7, size# 633, partitionsAsked# 1, maxTimeLag# 0ms
2025-11-03T16:57:05.392271Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_1_1_503573812852966014_v1 READ FROM TopicId: Topic rt3.dc2--test-topic in dc dc2 in database: Root, partition 0(assignId:1)maxCount 7 maxSize 633 maxTimeLagMs 0 readTimestampMs 0 readOffset 0 EndOffset 6 ClientCommitOffset 0 committedOffset 0 Guid 7c761041-7de8972f-4db21f4a-c19b09da
2025-11-03T16:57:05.389419Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_3_1_5127326268369064539_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 33 maxSize 5078 maxTimeLagMs 0 readTimestampMs 0 readOffset 0 EndOffset 28 ClientCommitOffset 0 committedOffset 0 Guid fe5204be-6a6d7b0-eac00269-832e6763
2025-11-03T16:57:05.392952Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271187968, Sender [1:7568544233806397799:2735], Recipient [2:7568544232951260145:3067]
2025-11-03T16:57:05.392981Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5316: HandleHook, processing event TEvPersQueue::TEvRequest
2025-11-03T16:57:05.393095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc2--test-topic' requestId: <none>
2025-11-03T16:57:05.393118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc2--test-topic' partition 0
2025-11-03T16:57:05.393223Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188481 (NKikimr::TEvPQ::TEvRead), Tablet [2:7568544108397207262:2383], Partition 0, Sender [2:7568544108397207262:2383], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:57:05.393264Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188481, Sender [2:7568544108397207262:2383], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvRead
2025-11-03T16:57:05.393281Z node 2 :PERSQUEUE TRACE: partition.h:629: StateIdle, processing event TEvPQ::TEvRead
2025-11-03T16:57:05.393358Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188539 (NKikimr::TEvPQ::TEvApproveReadQuota), Tablet [2:7568544108397207262:2383], Partition 0, Sender [2:7568544108397207306:2383], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:57:05.393391Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188539, Sender [2:7568544108397207306:2383], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvApproveReadQuota
2025-11-03T16:57:05.393406Z node 2 :PERSQUEUE TRACE: partition.h:630: StateIdle, processing event TEvPQ::TEvApproveReadQuota
2025-11-03T16:57:05.393433Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:880: [72075186224037892][Partition][0][StateIdle] read cookie 4 Topic 'rt3.dc2--test-topic' partition 0 user user offset 0 partno 0 count 7 size 633 endOffset 6 max time lag 0ms effective offset 0
2025-11-03T16:57:05.394125Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1105: [72075186224037892][Partition][0][StateIdle] read cookie 4 added 3 blobs, size 888 count 6 last offset 2, current partition end offset: 6
2025-11-03T16:57:05.394144Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1121: [72075186224037892][Partition][0][StateIdle] Reading cookie 4. Send blob request.
2025-11-03T16:57:05.394194Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 0 partno 0 count 1 parts_count 0 source 1 size 176 accessed 1 times before, last time 2025-11-03T16:56:56.000000Z
2025-11-03T16:57:05.394211Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 1 partno 0 count 1 parts_count 0 source 1 size 176 accessed 0 times before, last time 2025-11-03T16:56:56.000000Z
2025-11-03T16:57:05.394231Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 2 partno 0 count 4 parts_count 0 source 1 size 536 accessed 0 times before, last time 2025-11-03T16:57:03.000000Z
2025-11-03T16:57:05.394270Z node 2 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 4. All 3 blobs are from cache.
2025-11-03T16:57:05.394338Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188496 (NKikimr::TEvPQ::TEvBlobResponse), Tablet [2:7568544108397207262:2383], Partition 0, Sender [2:7568544108397207286:2383], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:57:05.394369Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188496, Sender [2:7568544108397207286:2383], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvBlobResponse
2025-11-03T16:57:05.394396Z node 2 :PERSQUEUE TRACE: partition.h:627: StateIdle, processing event TEvPQ::TEvBlobResponse
2025-11-03T16:57:05.394422Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:572: FormAnswer for 3 blobs
2025-11-03T16:57:05.394596Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 0 totakecount 1 count 1 size 156 from pos 0 cbcount 1
2025-11-03T16:57:05.394681Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 1 totakecount 1 count 1 size 156 from pos 0 cbcount 1
2025-11-03T16:57:05.395138Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 2 totakecount 4 count 4 size 516 from pos 0 cbcount 4
2025-11-03T16:57:05.395265Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271188493, Sender [2:7568544108397207303:2383], Recipient [2:7568544108397207262:2383]: NKikimr::TEvPQ::TEvProxyResponse
2025-11-03T16:57:05.395284Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5335: HandleHook, processing event TEvPQ::TEvProxyResponse
2025-11-03T16:57:05.395334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc2--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-03T16:57:05.397113Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_1_1_503573812852966014_v1 TopicId: Topic rt3.dc2--test-topic in dc dc2 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 6 Result { Offset: 0 Data: "... 98 bytes ..." SourceId: "\000test-message-group-id1" SeqNo: 1 WriteTimestampMS: 1762189016436 CreateTimestampMS: 1762189016376 UncompressedSize: 7 PartitionKey: "" ExplicitHash: "" } Result { Offset: 1 Data: "... 98 bytes ..." SourceId: "\000test-message-group-id2" SeqNo: 1 WriteTimestampMS: 1762189016499 CreateTimestampMS: 1762189016496 UncompressedSize: 7 PartitionKey: "" ExplicitHash: "" } Result { Offset: 2 Data: "... 98 bytes ..." SourceId: "\000test-message-group-id2" SeqNo: 6 WriteTimestampMS: 1762189023618 CreateTimestampMS: 1762189021576 UncompressedSize: 7 PartitionKey: "" ExplicitHash: "" } Result { Offset: 3 Data: "... 98 bytes ..." SourceId: "\000test-message-group-id2" SeqNo: 7 WriteTimestampMS: 1762189023619 CreateTimestampMS: 1762189021576 UncompressedSize: 7 PartitionKey: "" ExplicitHash: "" } Result { Offset: 4 Data: "... 98 bytes ..." SourceId: "\000test-message-group-id2" SeqNo: 8 WriteTimestampMS: 1762189023619 CreateTimestampMS: 1762189021576 UncompressedSize: 7 PartitionKey: "" ExplicitHash: "" } Result { Offset: 5 Data: "... 98 bytes ..." SourceId: "\000test-message-group-id2" SeqNo: 9 WriteTimestampMS: 1762189023619 CreateTimestampMS: 1762189021576 UncompressedSize: 7 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 3 SizeLag: 18446744073709551208 RealReadOffset: 5 WaitQuotaTimeMs: 0 EndOffset: 6 StartOffset: 0 } Cookie: 0 }
2025-11-03T16:57:05.397472Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_1_1_503573812852966014_v1 TopicId: Topic rt3.dc2--test-topic in dc dc2 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 1 from offset 6
2025-11-03T16:57:05.397520Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_1_1_503573812852966014_v1 after read state TopicId: Topic rt3.dc2--test-topic in dc dc2 in database: Root, partition 0(assignId:1) EndOffset 6 ReadOffset 6 ReadGuid 7c761041-7de8972f-4db21f4a-c19b09da has messages 1
2025-11-03T16:57:05.397674Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_1_1_503573812852966014_v1 read done: guid# 7c761041-7de8972f-4db21f4a-c19b09da, partition# TopicId: Topic rt3.dc2--test-topic in dc dc2 in database: Root, partition 0(assignId:1), size# 802
2025-11-03T16:57:05.397715Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_1_1_503573812852966014_v1 response to read: guid# 7c761041-7de8972f-4db21f4a-c19b09da
2025-11-03T16:57:05.398974Z :DEBUG: [/Root] [/Root] [83b2cb92-37c5ba22-4640e384-36106743] [dc2] After sending read request: ReadSizeBudget = 26214400, ReadSizeServerDelta = 0
2025-11-03T16:57:05.398046Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_1_1_503573812852966014_v1 Process answer. Aval parts: 0
2025-11-03T16:57:05.396228Z node 2 :PERSQUEUE TRACE: pq_l2_cache.h:116: StateFunc, received event# 271450112, Sender [2:7568544108397207286:2383], Recipient [2:7568544048267664305:2071]: NKikimr::NPQ::TEvPqCache::TEvCacheL2Request
2025-11-03T16:57:05.396255Z node 2 :PERSQUEUE TRACE: pq_l2_cache.h:119: StateFunc, processing event TEvPqCache::TEvCacheL2Request
2025-11-03T16:57:05.396303Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 0 suffix '63'
2025-11-03T16:57:05.396327Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 1 partno 0 count 1 parts 0 suffix '63'
2025-11-03T16:57:05.396352Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 2 partno 0 count 4 parts 0 suffix '63'
2025-11-03T16:57:05.399485Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271187977, Sender [1:7568544233806397799:2735], Recipient [2:7568544232951260145:3067]
2025-11-03T16:57:05.399520Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5319: HandleHook, processing event TEvPersQueue::TEvHasDataInfo
2025-11-03T16:57:05.399616Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271187977 (NKikimr::TEvPersQueue::TEvHasDataInfo), Tablet [2:7568544108397207262:2383], Partition 0, Sender [2:7568544108397207262:2383], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:57:05.399770Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271187977, Sender [2:7568544108397207262:2383], Recipient [2:7568544108397207303:2383]: NKikimrPQ.THasDataInfo Partition: 0 Offset: 6 Deadline: 1762189034897 Sender { RawX1: 7568544233806397799 RawX2: 4503603922340527 } Cookie: 1 ClientId: "user"
2025-11-03T16:57:05.399801Z node 2 :PERSQUEUE TRACE: partition.h:643: StateIdle, processing event TEvPersQueue::TEvHasDataInfo
2025-11-03T16:57:05.396113Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271187968, Sender [3:7568544235298246781:2699], Recipient [4:7568544235290699259:2818]
2025-11-03T16:57:05.396156Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5316: HandleHook, processing event TEvPersQueue::TEvRequest
2025-11-03T16:57:05.396270Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:57:05.396300Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:57:05.396420Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [4:7568544170866189024:2388], Partition 0, Sender [0:0:0], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:57:05.396475Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:05.396501Z node 4 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:05.396532Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:57:05.396546Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:57:05.396559Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:57:05.396578Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:57:05.396632Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:57:05.396644Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:57:05.396665Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:57:05.396726Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188481 (NKikimr::TEvPQ::TEvRead), Tablet [4:7568544170866189024:2388], Partition 0, Sender [4:7568544170866189024:2388], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:57:05.396763Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188481, Sender [4:7568544170866189024:2388], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvRead
2025-11-03T16:57:05.396782Z node 4 :PERSQUEUE TRACE: partition.h:629: StateIdle, processing event TEvPQ::TEvRead
2025-11-03T16:57:05.396875Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188539 (NKikimr::TEvPQ::TEvApproveReadQuota), Tablet [4:7568544170866189024:2388], Partition 0, Sender [4:7568544170866189068:2388], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:57:05.396908Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188539, Sender [4:7568544170866189068:2388], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvApproveReadQuota
2025-11-03T16:57:05.396924Z node 4 :PERSQUEUE TRACE: partition.h:630: StateIdle, processing event TEvPQ::TEvApproveReadQuota
2025-11-03T16:57:05.396950Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:880: [72075186224037892][Partition][0][StateIdle] read cookie 4 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 partno 0 count 33 size 5078 endOffset 28 max time lag 0ms effective offset 0
2025-11-03T16:57:05.400613Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_1_1_503573812852966014_v1 grpc read done: success# 1, data# { read { } }
2025-11-03T16:57:05.400766Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_1_1_503573812852966014_v1 got read request: guid# 3395b434-8783cc6d-dd6ec050-3e8c8fd
2025-11-03T16:57:05.403765Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:1105: [72075186224037892][Partition][0][StateIdle] read cookie 4 added 22 blobs, size 4592 count 28 last offset 24, current partition end offset: 28
2025-11-03T16:57:05.403815Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:1121: [72075186224037892][Partition][0][StateIdle] Reading cookie 4. Send blob request.
2025-11-03T16:57:05.403887Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 0 partno 0 count 1 parts_count 0 source 1 size 176 accessed 1 times before, last time 2025-11-03T16:56:51.000000Z
2025-11-03T16:57:05.403907Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 1 partno 0 count 1 parts_count 0 source 1 size 176 accessed 0 times before, last time 2025-11-03T16:56:51.000000Z
2025-11-03T16:57:05.403930Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 2 partno 0 count 1 parts_count 0 source 1 size 176 accessed 0 times before, last time 2025-11-03T16:56:51.000000Z
2025-11-03T16:57:05.403954Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 3 partno 0 count 1 parts_count 0 source 1 size 176 accessed 0 times before, last time 2025-11-03T16:56:51.000000Z
2025-11-03T16:57:05.408830Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 0 (0-5)
2025-11-03T16:57:05.409080Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (0-0)
2025-11-03T16:57:05.409151Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 0} (1-1)
2025-11-03T16:57:05.409188Z :DEBUG: [/Root] Take Data. Partition 0. Read: {2, 0} (2-2)
2025-11-03T16:57:05.409220Z :DEBUG: [/Root] Take Data. Partition 0. Read: {3, 0} (3-3)
2025-11-03T16:57:05.409253Z :DEBUG: [/Root] Take Data. Partition 0. Read: {3, 1} (4-4)
2025-11-03T16:57:05.409277Z :DEBUG: [/Root] Take Data. Partition 0. Read: {3, 2} (5-5)
2025-11-03T16:57:05.409336Z :DEBUG: [/Root] [/Root] [83b2cb92-37c5ba22-4640e384-36106743] [dc2] The application data is transferred to the client. Number of messages 6, size 42 bytes
===Data event
2025-11-03T16:57:05.409703Z :DEBUG: [/Root] [/Root] [83b2cb92-37c5ba22-4640e384-36106743] [dc2] Commit offsets [0, 1). Partition stream id: 1
2025-11-03T16:57:05.409784Z :DEBUG: [/Root] [/Root] [83b2cb92-37c5ba22-4640e384-36106743] [dc2] Commit offsets [1, 2). Partition stream id: 1
2025-11-03T16:57:05.409820Z :DEBUG: [/Root] [/Root] [83b2cb92-37c5ba22-4640e384-36106743] [dc2] Commit offsets [2, 3). Partition stream id: 1
2025-11-03T16:57:05.408080Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 4 partno 0 count 1 parts_count 0 source 1 size 176 accessed 0 times before, last time 2025-11-03T16:56:51.000000Z
2025-11-03T16:57:05.409855Z :DEBUG: [/Root] [/Root] [83b2cb92-37c5ba22-4640e384-36106743] [dc2] Commit offsets [3, 4). Partition stream id: 1
2025-11-03T16:57:05.409885Z :DEBUG: [/Root] [/Root] [83b2cb92-37c5ba22-4640e384-36106743] [dc2] Commit offsets [4, 5). Partition stream id: 1
2025-11-03T16:57:05.408162Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 5 partno 0 count 1 parts_count 0 source 1 size 176 accessed 0 times before, last time 2025-11-03T16:56:51.000000Z
2025-11-03T16:57:05.408187Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 6 partno 0 count 1 parts_count 0 source 1 size 176 accessed 0 times before, last time 2025-11-03T16:56:51.000000Z
2025-11-03T16:57:05.409914Z :DEBUG: [/Root] [/Root] [83b2cb92-37c5ba22-4640e384-36106743] [dc2] Commit offsets [5, 6). Partition stream id: 1
2025-11-03T16:57:05.408213Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 7 partno 0 count 1 parts_count 0 source 1 size 176 accessed 0 times before, last time 2025-11-03T16:56:51.000000Z
2025-11-03T16:57:05.408243Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 8 partno 0 count 1 parts_count 0 source 1 size 176 accessed 0 times before, last time 2025-11-03T16:56:51.000000Z
2025-11-03T16:57:05.408268Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 9 partno 0 count 1 parts_count 0 source 1 size 176 accessed 0 times before, last time 2025-11-03T16:56:51.000000Z
2025-11-03T16:57:05.408293Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 10 partno 0 count 1 parts_count 0 source 1 size 176 accessed 0 times before, last time 2025-11-03T16:56:51.000000Z
2025-11-03T16:57:05.408312Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 11 partno 0 count 1 parts_count 0 source 1 size 176 accessed 0 times before, last time 2025-11-03T16:56:51.000000Z
2025-11-03T16:57:05.408335Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 12 partno 0 count 1 parts_count 0 source 1 size 176 accessed 0 times before, last time 2025-11-03T16:56:51.000000Z
2025-11-03T16:57:05.408353Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 13 partno 0 count 1 parts_count 0 source 1 size 176 accessed 0 times before, last time 2025-11-03T16:56:51.000000Z
2025-11-03T16:57:05.408372Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 14 partno 0 count 1 parts_count 0 source 1 size 176 accessed 0 times before, last time 2025-11-03T16:56:51.000000Z
2025-11-03T16:57:05.408390Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 15 partno 0 count 1 parts_count 0 source 1 size 176 accessed 0 times before, last time 2025-11-03T16:56:51.000000Z
2025-11-03T16:57:05.408411Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 16 partno 0 count 1 parts_count 0 source 1 size 176 accessed 0 times before, last time 2025-11-03T16:56:51.000000Z
2025-11-03T16:57:05.408429Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 17 partno 0 count 1 parts_count 0 source 1 size 176 accessed 0 times before, last time 2025-11-03T16:56:51.000000Z
2025-11-03T16:57:05.408448Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 18 partno 0 count 1 parts_count 0 source 1 size 176 accessed 0 times before, last time 2025-11-03T16:56:51.000000Z
2025-11-03T16:57:05.408466Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 19 partno 0 count 1 parts_count 0 source 1 size 176 accessed 0 times before, last time 2025-11-03T16:56:51.000000Z
2025-11-03T16:57:05.408484Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 20 partno 0 count 4 parts_count 0 source 1 size 536 accessed 0 times before, last time 2025-11-03T16:56:59.000000Z
2025-11-03T16:57:05.408505Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 24 partno 0 count 4 parts_count 0 source 1 size 536 accessed 0 times before, last time 2025-11-03T16:56:59.000000Z
2025-11-03T16:57:05.408592Z node 4 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 4. All 22 blobs are from cache.
===Get event on client
2025-11-03T16:57:05.408705Z node 4 :PERSQUEUE TRACE: pq_l2_cache.h:116: StateFunc, received event# 271450112, Sender [4:7568544170866189047:2388], Recipient [4:7568544115031613334:2071]: NKikimr::NPQ::TEvPqCache::TEvCacheL2Request
2025-11-03T16:57:05.408732Z node 4 :PERSQUEUE TRACE: pq_l2_cache.h:119: StateFunc, processing event TEvPqCache::TEvCacheL2Request
2025-11-03T16:57:05.408792Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 0 suffix '63'
2025-11-03T16:57:05.408817Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188496 (NKikimr::TEvPQ::TEvBlobResponse), Tablet [4:7568544170866189024:2388], Partition 0, Sender [4:7568544170866189047:2388], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:57:05.408829Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 1 partno 0 count 1 parts 0 suffix '63'
2025-11-03T16:57:05.408883Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 2 partno 0 count 1 parts 0 suffix '63'
2025-11-03T16:57:05.408886Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188496, Sender [4:7568544170866189047:2388], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvBlobResponse
2025-11-03T16:57:05.408910Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 3 partno 0 count 1 parts 0 suffix '63'
2025-11-03T16:57:05.408929Z node 4 :PERSQUEUE TRACE: partition.h:627: StateIdle, processing event TEvPQ::TEvBlobResponse
2025-11-03T16:57:05.408934Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 4 partno 0 count 1 parts 0 suffix '63'
2025-11-03T16:57:05.408965Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 5 partno 0 count 1 parts 0 suffix '63'
2025-11-03T16:57:05.408974Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:572: FormAnswer for 22 blobs
2025-11-03T16:57:05.408993Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 6 partno 0 count 1 parts 0 suffix '63'
2025-11-03T16:57:05.409019Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 7 partno 0 count 1 parts 0 suffix '63'
2025-11-03T16:57:05.409042Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 8 partno 0 count 1 parts 0 suffix '63'
2025-11-03T16:57:05.409082Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 9 partno 0 count 1 parts 0 suffix '63'
2025-11-03T16:57:05.409115Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 10 partno 0 count 1 parts 0 suffix '63'
2025-11-03T16:57:05.409138Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 11 partno 0 count 1 parts 0 suffix '63'
2025-11-03T16:57:05.409159Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 12 partno 0 count 1 parts 0 suffix '63'
2025-11-03T16:57:05.409181Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 13 partno 0 count 1 parts 0 suffix '63'
2025-11-03T16:57:05.409199Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 1 parts 0 suffix '63'
2025-11-03T16:57:05.409220Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 15 partno 0 count 1 parts 0 suffix '63'
2025-11-03T16:57:05.409239Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 16 partno 0 count 1 parts 0 suffix '63'
2025-11-03T16:57:05.409260Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 17 partno 0 count 1 parts 0 suffix '63'
2025-11-03T16:57:05.409278Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 18 partno 0 count 1 parts 0 suffix '63'
2025-11-03T16:57:05.409294Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 19 partno 0 count 1 parts 0 suffix '63'
2025-11-03T16:57:05.409320Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 20 partno 0 count 4 parts 0 suffix '63'
2025-11-03T16:57:05.409339Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 24 partno 0 count 4 parts 0 suffix '63'
2025-11-03T16:57:05.409718Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 0 totakecount 1 count 1 size 156 from pos 0 cbcount 1
2025-11-03T16:57:05.409853Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 1 totakecount 1 count 1 size 156 from pos 0 cbcount 1
2025-11-03T16:57:05.409913Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 2 totakecount 1 count 1 size 156 from pos 0 cbcount 1
2025-11-03T16:57:05.409966Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 3 totakecount 1 count 1 size 156 from pos 0 cbcount 1
2025-11-03T16:57:05.410049Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 4 totakecount 1 count 1 size 156 from pos 0 cbcount 1
2025-11-03T16:57:05.410109Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 5 totakecount 1 count 1 size 156 from pos 0 cbcount 1
2025-11-03T16:57:05.410166Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 6 totakecount 1 count 1 size 156 from pos 0 cbcount 1
2025-11-03T16:57:05.410222Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 7 totakecount 1 count 1 size 156 from pos 0 cbcount 1
2025-11-03T16:57:05.410272Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 8 totakecount 1 count 1 size 156 from pos 0 cbcount 1
2025-11-03T16:57:05.410321Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 9 totakecount 1 count 1 size 156 from pos 0 cbcount 1
2025-11-03T16:57:05.410376Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 10 totakecount 1 count 1 size 156 from pos 0 cbcount 1
2025-11-03T16:57:05.410466Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 11 totakecount 1 count 1 size 156 from pos 0 cbcount 1
2025-11-03T16:57:05.410539Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 12 totakecount 1 count 1 size 156 from pos 0 cbcount 1
2025-11-03T16:57:05.410603Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 13 totakecount 1 count 1 size 156 from pos 0 cbcount 1
2025-11-03T16:57:05.410665Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 14 totakecount 1 count 1 size 156 from pos 0 cbcount 1
2025-11-03T16:57:05.410720Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 15 totakecount 1 count 1 size 156 from pos 0 cbcount 1
2025-11-03T16:57:05.410781Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 16 totakecount 1 count 1 size 156 from pos 0 cbcount 1
2025-11-03T16:57:05.410835Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 17 totakecount 1 count 1 size 156 from pos 0 cbcount 1
2025-11-03T16:57:05.410888Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 18 totakecount 1 count 1 size 156 from pos 0 cbcount 1
2025-11-03T16:57:05.410964Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 19 totakecount 1 count 1 size 156 from pos 0 cbcount 1
2025-11-03T16:57:05.410724Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_1_1_503573812852966014_v1 grpc read done: success# 1, data# { commit { cookies { assign_id: 1 partition_cookie: 1 } } }
2025-11-03T16:57:05.411129Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 20 totakecount 4 count 4 size 516 from pos 0 cbcount 4
2025-11-03T16:57:05.410963Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1449: session cookie 1 consumer shared/user session shared/user_1_1_503573812852966014_v1 commit request from client for 1 in TopicId: Topic rt3.dc2--test-topic in dc dc2 in database: Root, partition 0(assignId:1)
2025-11-03T16:57:05.410998Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:129: session cookie 1 consumer shared/user session shared/user_1_1_503573812852966014_v1 commit request from 1 to 1 in TopicId: Topic rt3.dc2--test-topic in dc dc2 in database: Root, partition 0(assignId:1)
2025-11-03T16:57:05.411063Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:203: session cookie 1 consumer shared/user session shared/user_1_1_503573812852966014_v1 TopicId: Topic rt3.dc2--test-topic in dc dc2 in database: Root, partition 0(assignId:1) committing to position 6 prev 0 end 6 by cookie 1
2025-11-03T16:57:05.411281Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 24 totakecount 4 count 4 size 516 from pos 0 cbcount 4
2025-11-03T16:57:05.411501Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271188493, Sender [4:7568544170866189065:2388], Recipient [4:7568544170866189024:2388]: NKikimr::TEvPQ::TEvProxyResponse
2025-11-03T16:57:05.411525Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5335: HandleHook, processing event TEvPQ::TEvProxyResponse
2025-11-03T16:57:05.411711Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-03T16:57:05.411647Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271187968, Sender [1:7568544233806397799:2735], Recipient [2:7568544232951260145:3067]
2025-11-03T16:57:05.411678Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5316: HandleHook, processing event TEvPersQueue::TEvRequest
2025-11-03T16:57:05.411732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc2--test-topic' requestId: <none>
2025-11-03T16:57:05.411754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc2--test-topic' partition 0
2025-11-03T16:57:05.411854Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188488 (NKikimr::TEvPQ::TEvSetClientInfo), Tablet [2:7568544108397207262:2383], Partition 0, Sender [2:7568544108397207262:2383], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:57:05.411891Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188488, Sender [2:7568544108397207262:2383], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvSetClientInfo
2025-11-03T16:57:05.411911Z node 2 :PERSQUEUE TRACE: partition.h:638: StateIdle, processing event TEvPQ::TEvSetClientInfo
2025-11-03T16:57:05.411938Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:57:05.411971Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:57:05.411998Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-03T16:57:05.412056Z node 2 :PERSQUEUE DEBUG: partition.cpp:3666: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc2--test-topic' partition 0 user user offset is set to 6 (startOffset 0) session shared/user_1_1_503573812852966014_v1
2025-11-03T16:57:05.412072Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:57:05.412085Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:57:05.412130Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:57:05.412143Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:57:05.412270Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188562 (NKikimr::TEvPQ::TEvTxBatchComplete), Tablet [2:7568544108397207262:2383], Partition 0, Sender [2:7568544108397207303:2383], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:57:05.412310Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188562, Sender [2:7568544108397207303:2383], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvTxBatchComplete
2025-11-03T16:57:05.412335Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-03T16:57:05.412495Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 270794752, Sender [2:7568544108397207286:2383], Recipient [2:7568544108397207262:2383]: NKikimrClient.TKeyValueRequest Cookie: 5 CmdWrite { Key: "i0000000000" Value: "\030\000(\203\263\232\325\2443" StorageChannel: INLINE } CmdWrite { Key: "m0000000000cuser" Value: "\010\006\020\001\030\001\"%shared/user_1_1_503573812852966014_v1(\0000\000@\001" StorageChannel: INLINE } CmdWrite { Key: "m0000000000uuser" Value: "\006\000\000\000\000\000\000\000\001\000\000\000\001\000\000\000shared/user_1_1_503573812852966014_v1" StorageChannel: INLINE }
2025-11-03T16:57:05.412686Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 270794753, Sender [2:7568544232951260151:2383], Recipient [2:7568544108397207262:2383]: NKikimr::TEvKeyValue::TEvIntermediate
2025-11-03T16:57:05.416489Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271187977, Sender [3:7568544235298246781:2699], Recipient [4:7568544235290699259:2818]
2025-11-03T16:57:05.416517Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5319: HandleHook, processing event TEvPersQueue::TEvHasDataInfo
2025-11-03T16:57:05.416606Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271187977 (NKikimr::TEvPersQueue::TEvHasDataInfo), Tablet [4:7568544170866189024:2388], Partition 0, Sender [4:7568544170866189024:2388], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:57:05.416723Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271187977, Sender [4:7568544170866189024:2388], Recipient [4:7568544170866189065:2388]: NKikimrPQ.THasDataInfo Partition: 0 Offset: 28 Deadline: 1762189034915 Sender { RawX1: 7568544235298246781 RawX2: 4503612512275083 } Cookie: 1 ClientId: "user"
2025-11-03T16:57:05.416739Z node 4 :PERSQUEUE TRACE: partition.h:643: StateIdle, processing event TEvPersQueue::TEvHasDataInfo
2025-11-03T16:57:05.418788Z node 2 :PERSQUEUE TRACE: pq_l2_cache.h:116: StateFunc, received event# 271450112, Sender [2:7568544108397207286:2383], Recipient [2:7568544048267664305:2071]: NKikimr::NPQ::TEvPqCache::TEvCacheL2Request
2025-11-03T16:57:05.418799Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 270795264 (NKikimr::TEvKeyValue::TEvResponse), Tablet [2:7568544108397207262:2383], Partition 0, Sender [2:7568544108397207286:2383], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:57:05.418817Z node 2 :PERSQUEUE TRACE: pq_l2_cache.h:119: StateFunc, processing event TEvPqCache::TEvCacheL2Request
2025-11-03T16:57:05.418977Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 270795264, Sender [2:7568544108397207286:2383], Recipient [2:7568544108397207303:2383]: NKikimrClient.TResponse Status: 1 WriteResult { Status: 0 StatusFlags: 1 } WriteResult { Status: 0 StatusFlags: 1 } WriteResult { Status: 0 StatusFlags: 1 }
2025-11-03T16:57:05.419001Z node 2 :PERSQUEUE TRACE: partition.h:625: StateIdle, processing event TEvKeyValue::TEvResponse
2025-11-03T16:57:05.419019Z node 2 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-03T16:57:05.419069Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:923: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc2--test-topic' partition 0 user user readTimeStamp for offset 6 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-11-03T16:57:05.419100Z node 2 :PERSQUEUE TRACE: partition_write.cpp:518: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse.
2025-11-03T16:57:05.419130Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-11-03T16:57:05.419148Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:57:05.419162Z node 2 :PERSQUEUE TRACE: partition_write.cpp:424: [72075186224037892][Partition][0][StateIdle] TPartition::SyncMemoryStateWithKVState.
2025-11-03T16:57:05.419189Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:57:05.419203Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:57:05.419215Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:57:05.419234Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:57:05.419277Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:57:05.419289Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:57:05.414765Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_3_1_5127326268369064539_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 28 Result { Offset: 0 Data: "... 98 bytes ..." SourceId: "\000test-message-group-id1" SeqNo: 1 WriteTimestampMS: 1762189010947 CreateTimestampMS: 1762189010839 UncompressedSize: 7 PartitionKey: "" ExplicitHash: "" } Result { Offset: 1 Data: "... 98 bytes ..." SourceId: "\000test-message-group-id2" SeqNo: 1 WriteTimestampMS: 1762189011038 CreateTimestampMS: 1762189011032 UncompressedSize: 7 PartitionKey: "" ExplicitHash: "" } Result { Offset: 2 Data: "... 98 bytes ..." SourceId: "\000test-message-group-id1" SeqNo: 2 WriteTimestampMS: 1762189011065 CreateTimestampMS: 1762189011052 UncompressedSize: 7 PartitionKey: "" ExplicitHash: "" } Result { Offset: 3 Data: "... 98 bytes ..." SourceId: "\000test-message-group-id2" SeqNo: 2 WriteTimestampMS: 1762189011091 CreateTimestampMS: 1762189011084 UncompressedSize: 7 PartitionKey: "" ExplicitHash: "" } Result { Offset: 4 Data: "... 98 bytes ..." SourceId: "\000test-message-group-id1" SeqNo: 3 WriteTimestampMS: 1762189011163 CreateTimestampMS: 1762189011148 UncompressedSize: 7 PartitionKey: "" ExplicitHash: "" } Result { Offset: 5 Data: "... 98 bytes ..." SourceId: "\000test-message-group-id2" SeqNo: 3 WriteTimestampMS: 1762189011192 CreateTimestampMS: 1762189011185 UncompressedSize: 7 PartitionKey: "" ExplicitHash: "" } Result { Offset: 6 Data: "... 98 bytes ..." SourceId: "\000test-message-group-id1" SeqNo: 4 WriteTimestampMS: 1762189011265 CreateTimestampMS: 1762189011260 UncompressedSize: 7 PartitionKey: "" ExplicitHash: "" } Result { Offset: 7 Data: "... 98 bytes ..." SourceId: "\000test-message-group-id2" SeqNo: 4 WriteTimestampMS: 1762189011289 CreateTimestampMS: 1762189011276 UncompressedSize: 7 PartitionKey: "" ExplicitHash: "" } Result { Offset: 8 Data: "... 98 bytes ..." SourceId: "\000test-message-group-id1" SeqNo: 5 WriteTimestampMS: 1762189011314 CreateTimestampMS: 1762189011309 UncompressedSize: 7 PartitionKey: "" ExplicitHash: "" } Result { Offset: 9 Data: "... 98 bytes ..." SourceId: "\000test-message-group-id2" SeqNo: 5 WriteTimestampMS: 1762189011396 CreateTimestampMS: 1762189011390 UncompressedSize: 7 PartitionKey: "" ExplicitHash: "" } Result { Offset: 10 Data: "... 98 bytes ..." SourceId: "\000test-message-group-id1" SeqNo: 6 WriteTimestampMS: 1762189011412 CreateTimestampMS: 1762189011408 UncompressedSize: 7 PartitionKey: "" ExplicitHash: "" } Result { Offset: 11 Data: "... 98 bytes ..." SourceId: "\000test-message-group-id2" SeqNo: 6 WriteTimestampMS: 1762189011443 CreateTimestampMS: 1762189011431 UncompressedSize: 7 PartitionKey: "" ExplicitHash: "" } Result { Offset: 12 Data: "... 98 bytes ..." SourceId: "\000test-message-group-id1" SeqNo: 7 WriteTimestampMS: 1762189011480 CreateTimestampMS: 1762189011472 UncompressedSize: 7 PartitionKey: "" ExplicitHash: "" } Result { Offset: 13 Data: "... 98 bytes ..." SourceId: "\000test-message-group-id2" SeqNo: 7 WriteTimestampMS: 1762189011500 CreateTimestampMS: 1762189011496 UncompressedSize: 7 PartitionKey: "" ExplicitHash: "" } Result { Offset: 14 Data: "... 98 bytes ..." SourceId: "\000test-message-group-id1" SeqNo: 8 WriteTimestampMS: 1762189011567 CreateTimestampMS: 1762189011548 UncompressedSize: 7 PartitionKey: "" ExplicitHash: "" } Result { Offset: 15 Data: "... 98 bytes ..." SourceId: "\000test-message-group-id2" SeqNo: 8 WriteTimestampMS: 1762189011586 CreateTimestampMS: 1762189011576 UncompressedSize: 7 PartitionKey: "" ExplicitHash: "" } Result { Offset: 16 Data: "... 98 bytes ..." SourceId: "\000test-message-group-id1" SeqNo: 9 WriteTimestampMS: 1762189011606 CreateTimestampMS: 1762189011599 UncompressedSize: 7 PartitionKey: "" ExplicitHash: "" } Result { Offset: 17 Data: "... 98 bytes ..." SourceId: "\000test-message-group-id2" SeqNo: 9 WriteTimestampMS: 1762189011706 CreateTimestampMS: 1762189011708 UncompressedSize: 7 PartitionKey: "" ExplicitHash: "" } Result { Offset: 18 Data: "... 98 bytes ..." SourceId: "\000test-message-group-id1" SeqNo: 10 WriteTimestampMS: 1762189011729 CreateTimestampMS: 1762189011724 UncompressedSize: 7 PartitionKey: "" ExplicitHash: "" } Result { Offset: 19 Data: "... 98 bytes ..." SourceId: "\000test-message-group-id2" SeqNo: 10 WriteTimestampMS: 1762189011762 CreateTimestampMS: 1762189011752 UncompressedSize: 7 PartitionKey: "" ExplicitHash: "" } Result { Offset: 20 Data: "... 98 bytes ..." SourceId: "\000test-message-group-id2" SeqNo: 11 WriteTimestampMS: 1762189019862 CreateTimestampMS: 1762189017776 UncompressedSize: 7 PartitionKey: "" ExplicitHash: "" } Result { Offset: 21 Data: "... 98 bytes ..." SourceId: "\000test-message-group-id2" SeqNo: 12 WriteTimestampMS: 1762189019863 CreateTimestampMS: 1762189017777 UncompressedSize: 7 PartitionKey: "" ExplicitHash: "" } Result { Offset: 22 Data: "... 98 bytes ..." SourceId: "\000test-message-group-id2" SeqNo: 13 WriteTimestampMS: 1762189019863 CreateTimestampMS: 1762189017777 UncompressedSize: 7 PartitionKey: "" ExplicitHash: "" } Result { Offset: 23 Data: "... 98 bytes ..." SourceId: "\000test-message-group-id2" SeqNo: 14 WriteTimestampMS: 1762189019863 CreateTimestampMS: 1762189017777 UncompressedSize: 7 PartitionKey: "" ExplicitHash: "" } Result { Offset: 24 Data: "... 98 bytes ..." SourceId: "\000test-message-group-id1" SeqNo: 11 WriteTimestampMS: 1762189019869 CreateTimestampMS: 1762189017776 UncompressedSize: 7 PartitionKey: "" ExplicitHash: "" } Result { Offset: 25 Data: "... 98 bytes ..." SourceId: "\000test-message-group-id1" SeqNo: 12 WriteTimestampMS: 1762189019870 CreateTimestampMS: 1762189017776 UncompressedSize: 7 PartitionKey: "" ExplicitHash: "" } Result { Offset: 26 Data: "... 98 bytes ..." SourceId: "\000test-message-group-id1" SeqNo: 13 WriteTimestampMS: 1762189019870 CreateTimestampMS: 1762189017777 UncompressedSize: 7 PartitionKey: "" ExplicitHash: "" } Result { Offset: 27 Data: "... 98 bytes ..." SourceId: "\000test-message-group-id1" SeqNo: 14 WriteTimestampMS: 1762189019870 CreateTimestampMS: 1762189017777 UncompressedSize: 7 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 22 SizeLag: 18446744073709551480 RealReadOffset: 27 WaitQuotaTimeMs: 0 EndOffset: 28 StartOffset: 0 } Cookie: 0 }
2025-11-03T16:57:05.419304Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:57:05.419322Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:57:05.415801Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_3_1_5127326268369064539_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 1 from offset 28
2025-11-03T16:57:05.415845Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_3_1_5127326268369064539_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 28 ReadOffset 28 ReadGuid fe5204be-6a6d7b0-eac00269-832e6763 has messages 1
2025-11-03T16:57:05.416103Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_3_1_5127326268369064539_v1 read done: guid# fe5204be-6a6d7b0-eac00269-832e6763, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 4174
2025-11-03T16:57:05.416166Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_3_1_5127326268369064539_v1 response to read: guid# fe5204be-6a6d7b0-eac00269-832e6763
2025-11-03T16:57:05.419411Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 271188493, Sender [2:7568544108397207303:2383], Recipient [2:7568544108397207262:2383]: NKikimr::TEvPQ::TEvProxyResponse
2025-11-03T16:57:05.416532Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_3_1_5127326268369064539_v1 Process answer. Aval parts: 0
2025-11-03T16:57:05.419437Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5335: HandleHook, processing event TEvPQ::TEvProxyResponse
2025-11-03T16:57:05.419456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc2--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-11-03T16:57:05.419762Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_1_1_503573812852966014_v1 TopicId: Topic rt3.dc2--test-topic in dc dc2 in database: Root, partition 0(assignId:1) initDone 1 event { Cookie: 1 }
2025-11-03T16:57:05.419833Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:961: session cookie 1 consumer shared/user session shared/user_1_1_503573812852966014_v1 TopicId: Topic rt3.dc2--test-topic in dc dc2 in database: Root, partition 0(assignId:1) commit done to position 6 endOffset 6 with cookie 1
2025-11-03T16:57:05.419894Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:707: session cookie 1 consumer shared/user session shared/user_1_1_503573812852966014_v1 replying for commits: assignId# 1, from# 1, to# 1, offset# 6
2025-11-03T16:57:05.420910Z :DEBUG: [/Root] [/Root] [83b2cb92-37c5ba22-4640e384-36106743] [dc1] After sending read request: ReadSizeBudget = 26214400, ReadSizeServerDelta = 0
2025-11-03T16:57:05.421623Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 0 (0-27)
2025-11-03T16:57:05.421843Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (0-0)
2025-11-03T16:57:05.421893Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 0} (1-1)
2025-11-03T16:57:05.421933Z :DEBUG: [/Root] Take Data. Partition 0. Read: {2, 0} (2-2)
2025-11-03T16:57:05.421959Z :DEBUG: [/Root] Take Data. Partition 0. Read: {3, 0} (3-3)
2025-11-03T16:57:05.421991Z :DEBUG: [/Root] Take Data. Partition 0. Read: {4, 0} (4-4)
2025-11-03T16:57:05.422035Z :DEBUG: [/Root] Take Data. Partition 0. Read: {5, 0} (5-5)
2025-11-03T16:57:05.422060Z :DEBUG: [/Root] Take Data. Partition 0. Read: {6, 0} (6-6)
2025-11-03T16:57:05.422085Z :DEBUG: [/Root] Take Data. Partition 0. Read: {7, 0} (7-7)
2025-11-03T16:57:05.422126Z :DEBUG: [/Root] Take Data. Partition 0. Read: {8, 0} (8-8)
2025-11-03T16:57:05.422152Z :DEBUG: [/Root] Take Data. Partition 0. Read: {9, 0} (9-9)
2025-11-03T16:57:05.422178Z :DEBUG: [/Root] Take Data. Partition 0. Read: {10, 0} (10-10)
2025-11-03T16:57:05.422205Z :DEBUG: [/Root] Take Data. Partition 0. Read: {11, 0} (11-11)
2025-11-03T16:57:05.422243Z :DEBUG: [/Root] Take Data. Partition 0. Read: {12, 0} (12-12)
2025-11-03T16:57:05.422269Z :DEBUG: [/Root] Take Data. Partition 0. Read: {13, 0} (13-13)
2025-11-03T16:57:05.422293Z :DEBUG: [/Root] Take Data. Partition 0. Read: {14, 0} (14-14)
2025-11-03T16:57:05.422317Z :DEBUG: [/Root] Take Data. Partition 0. Read: {15, 0} (15-15)
2025-11-03T16:57:05.422348Z :DEBUG: [/Root] Take Data. Partition 0. Read: {16, 0} (16-16)
2025-11-03T16:57:05.422376Z :DEBUG: [/Root] Take Data. Partition 0. Read: {17, 0} (17-17)
2025-11-03T16:57:05.422403Z :DEBUG: [/Root] Take Data. Partition 0. Read: {18, 0} (18-18)
2025-11-03T16:57:05.422426Z :DEBUG: [/Root] Take Data. Partition 0. Read: {19, 0} (19-19)
2025-11-03T16:57:05.422451Z :DEBUG: [/Root] Take Data. Partition 0. Read: {20, 0} (20-20)
2025-11-03T16:57:05.422475Z :DEBUG: [/Root] Take Data. Partition 0. Read: {21, 0} (21-21)
2025-11-03T16:57:05.422500Z :DEBUG: [/Root] Take Data. Partition 0. Read: {21, 1} (22-22)
2025-11-03T16:57:05.422529Z :DEBUG: [/Root] Take Data. Partition 0. Read: {21, 2} (23-23)
2025-11-03T16:57:05.422556Z :DEBUG: [/Root] Take Data. Partition 0. Read: {22, 0} (24-24)
2025-11-03T16:57:05.422582Z :DEBUG: [/Root] Take Data. Partition 0. Read: {23, 0} (25-25)
2025-11-03T16:57:05.422607Z :DEBUG: [/Root] Take Data. Partition 0. Read: {23, 1} (26-26)
2025-11-03T16:57:05.422635Z :DEBUG: [/Root] Take Data. Partition 0. Read: {23, 2} (27-27)
2025-11-03T16:57:05.422685Z :DEBUG: [/Root] [/Root] [83b2cb92-37c5ba22-4640e384-36106743] [dc1] The application data is transferred to the client. Number of messages 28, size 196 bytes
===Data event
2025-11-03T16:57:05.423116Z :DEBUG: [/Root] [/Root] [83b2cb92-37c5ba22-4640e384-36106743] [dc1] Commit offsets [0, 1). Partition stream id: 2
2025-11-03T16:57:05.423182Z :DEBUG: [/Root] [/Root] [83b2cb92-37c5ba22-4640e384-36106743] [dc1] Commit offsets [1, 2). Partition stream id: 2
2025-11-03T16:57:05.423183Z :DEBUG: [/Root] [/Root] [83b2cb92-37c5ba22-4640e384-36106743] [dc2] Committed response: cookies { assign_id: 1 partition_cookie: 1 }
2025-11-03T16:57:05.423226Z :DEBUG: [/Root] [/Root] [83b2cb92-37c5ba22-4640e384-36106743] [dc1] Commit offsets [2, 3). Partition stream id: 2
2025-11-03T16:57:05.423255Z :DEBUG: [/Root] [/Root] [83b2cb92-37c5ba22-4640e384-36106743] [dc1] Commit offsets [3, 4). Partition stream id: 2
2025-11-03T16:57:05.423284Z :DEBUG: [/Root] [/Root] [83b2cb92-37c5ba22-4640e384-36106743] [dc1] Commit offsets [4, 5). Partition stream id: 2
2025-11-03T16:57:05.423310Z :DEBUG: [/Root] [/Root] [83b2cb92-37c5ba22-4640e384-36106743] [dc1] Commit offsets [5, 6). Partition stream id: 2
2025-11-03T16:57:05.423335Z :DEBUG: [/Root] [/Root] [83b2cb92-37c5ba22-4640e384-36106743] [dc1] Commit offsets [6, 7). Partition stream id: 2
2025-11-03T16:57:05.423360Z :DEBUG: [/Root] [/Root] [83b2cb92-37c5ba22-4640e384-36106743] [dc1] Commit offsets [7, 8). Partition stream id: 2
2025-11-03T16:57:05.423400Z :DEBUG: [/Root] [/Root] [83b2cb92-37c5ba22-4640e384-36106743] [dc1] Commit offsets [8, 9). Partition stream id: 2
2025-11-03T16:57:05.423434Z :DEBUG: [/Root] [/Root] [83b2cb92-37c5ba22-4640e384-36106743] [dc1] Commit offsets [9, 10). Partition stream id: 2
2025-11-03T16:57:05.423464Z :DEBUG: [/Root] [/Root] [83b2cb92-37c5ba22-4640e384-36106743] [dc1] Commit offsets [10, 11). Partition stream id: 2
2025-11-03T16:57:05.423494Z :DEBUG: [/Root] [/Root] [83b2cb92-37c5ba22-4640e384-36106743] [dc1] Commit offsets [11, 12). Partition stream id: 2
2025-11-03T16:57:05.423521Z :DEBUG: [/Root] [/Root] [83b2cb92-37c5ba22-4640e384-36106743] [dc1] Commit offsets [12, 13). Partition stream id: 2
2025-11-03T16:57:05.423558Z :DEBUG: [/Root] [/Root] [83b2cb92-37c5ba22-4640e384-36106743] [dc1] Commit offsets [13, 14). Partition stream id: 2
2025-11-03T16:57:05.423591Z :DEBUG: [/Root] [/Root] [83b2cb92-37c5ba22-4640e384-36106743] [dc1] Commit offsets [14, 15). Partition stream id: 2
2025-11-03T16:57:05.423619Z :DEBUG: [/Root] [/Root] [83b2cb92-37c5ba22-4640e384-36106743] [dc1] Commit offsets [15, 16). Partition stream id: 2
2025-11-03T16:57:05.423644Z :DEBUG: [/Root] [/Root] [83b2cb92-37c5ba22-4640e384-36106743] [dc1] Commit offsets [16, 17). Partition stream id: 2
2025-11-03T16:57:05.423671Z :DEBUG: [/Root] [/Root] [83b2cb92-37c5ba22-4640e384-36106743] [dc1] Commit offsets [17, 18). Partition stream id: 2
2025-11-03T16:57:05.423698Z :DEBUG: [/Root] [/Root] [83b2cb92-37c5ba22-4640e384-36106743] [dc1] Commit offsets [18, 19). Partition stream id: 2
2025-11-03T16:57:05.423727Z :DEBUG: [/Root] [/Root] [83b2cb92-37c5ba22-4640e384-36106743] [dc1] Commit offsets [19, 20). Partition stream id: 2
2025-11-03T16:57:05.423754Z :DEBUG: [/Root] [/Root] [83b2cb92-37c5ba22-4640e384-36106743] [dc1] Commit offsets [20, 21). Partition stream id: 2
2025-11-03T16:57:05.423785Z :DEBUG: [/Root] [/Root] [83b2cb92-37c5ba22-4640e384-36106743] [dc1] Commit offsets [21, 22). Partition stream id: 2
2025-11-03T16:57:05.423815Z :DEBUG: [/Root] [/Root] [83b2cb92-37c5ba22-4640e384-36106743] [dc1] Commit offsets [22, 23). Partition stream id: 2
2025-11-03T16:57:05.423842Z :DEBUG: [/Root] [/Root] [83b2cb92-37c5ba22-4640e384-36106743] [dc1] Commit offsets [23, 24). Partition stream id: 2
2025-11-03T16:57:05.423868Z :DEBUG: [/Root] [/Root] [83b2cb92-37c5ba22-4640e384-36106743] [dc1] Commit offsets [24, 25). Partition stream id: 2
2025-11-03T16:57:05.423902Z :DEBUG: [/Root] [/Root] [83b2cb92-37c5ba22-4640e384-36106743] [dc1] Commit offsets [25, 26). Partition stream id: 2
2025-11-03T16:57:05.423931Z :DEBUG: [/Root] [/Root] [83b2cb92-37c5ba22-4640e384-36106743] [dc1] Commit offsets [26, 27). Partition stream id: 2
2025-11-03T16:57:05.423958Z :DEBUG: [/Root] [/Root] [83b2cb92-37c5ba22-4640e384-36106743] [dc1] Commit offsets [27, 28). Partition stream id: 2
2025-11-03T16:57:05.424280Z :INFO: [/Root] [/Root] [83b2cb92-37c5ba22-4640e384-36106743] Closing read session. Close timeout: 0.000000s
2025-11-03T16:57:05.424341Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): dc2:test-topic:0:1:5:6 dc1:test-topic:0:2:27:0
2025-11-03T16:57:05.424383Z :INFO: [/Root] [/Root] [83b2cb92-37c5ba22-4640e384-36106743] Counters: { Errors: 0 CurrentSessionLifetimeMs: 201 BytesRead: 238 MessagesRead: 34 BytesReadCompressed: 918 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-11-03T16:57:05.424481Z :NOTICE: [/Root] [/Root] [83b2cb92-37c5ba22-4640e384-36106743] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Close with zero timeout " }
2025-11-03T16:57:05.424564Z :DEBUG: [/Root] [/Root] [83b2cb92-37c5ba22-4640e384-36106743] [dc2] Abort session to cluster
2025-11-03T16:57:05.424925Z :DEBUG: [/Root] [/Root] [83b2cb92-37c5ba22-4640e384-36106743] [dc1] Abort session to cluster
2025-11-03T16:57:05.425212Z :NOTICE: [/Root] [/Root] [83b2cb92-37c5ba22-4640e384-36106743] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
2025-11-03T16:57:05.424201Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_3_1_5127326268369064539_v1 grpc read done: success# 1, data# { read { } }
2025-11-03T16:57:05.424367Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_3_1_5127326268369064539_v1 got read request: guid# 5e1a4458-15c3af9c-b16a54ed-7aa07a02
2025-11-03T16:57:05.428154Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_3_1_5127326268369064539_v1 grpc read done: success# 1, data# { commit { cookies { assign_id: 1 partition_cookie: 1 } } }
2025-11-03T16:57:05.428288Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_1_1_503573812852966014_v1 grpc read done: success# 0, data# {  }
2025-11-03T16:57:05.428323Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:125: session cookie 1 consumer shared/user session shared/user_1_1_503573812852966014_v1 grpc read failed
2025-11-03T16:57:05.428277Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:92: session cookie 1 consumer shared/user session shared/user_3_1_5127326268369064539_v1 grpc closed
2025-11-03T16:57:05.436079Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 1 consumer shared/user session shared/user_3_1_5127326268369064539_v1 is DEAD
2025-11-03T16:57:05.432792Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:92: session cookie 1 consumer shared/user session shared/user_1_1_503573812852966014_v1 grpc closed
2025-11-03T16:57:05.436075Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 1 consumer shared/user session shared/user_1_1_503573812852966014_v1 is DEAD
2025-11-03T16:57:05.439313Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 269877764, Sender [4:7568544235290699259:2818], Recipient [4:7568544170866189024:2388]: NKikimr::TEvTabletPipe::TEvServerDisconnected
2025-11-03T16:57:05.439349Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:5331: HandleHook, processing event TEvTabletPipe::TEvServerDisconnected
2025-11-03T16:57:05.439369Z node 4 :PERSQUEUE TRACE: pq_impl.cpp:2729: [PQ: 72075186224037892] Handle TEvTabletPipe::TEvServerDisconnected
2025-11-03T16:57:05.440674Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:57:05.440757Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:05.440780Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:05.440813Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:57:05.440840Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:57:05.440853Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:57:05.440877Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:57:05.452106Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2258: [PQ: 72075186224037892] Destroy direct read session shared/user_3_1_5127326268369064539_v1
2025-11-03T16:57:05.452189Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [3:7568544235298246782:2699] destroyed
2025-11-03T16:57:05.452291Z node 4 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_3_1_5127326268369064539_v1
2025-11-03T16:57:05.445260Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:57:05.445323Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:57:05.445350Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:57:05.452427Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5312: HandleHook, received event# 269877764, Sender [2:7568544232951260145:3067], Recipient [2:7568544108397207262:2383]: NKikimr::TEvTabletPipe::TEvServerDisconnected
2025-11-03T16:57:05.452462Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:5331: HandleHook, processing event TEvTabletPipe::TEvServerDisconnected
2025-11-03T16:57:05.452481Z node 2 :PERSQUEUE TRACE: pq_impl.cpp:2729: [PQ: 72075186224037892] Handle TEvTabletPipe::TEvServerDisconnected
2025-11-03T16:57:05.452499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2258: [PQ: 72075186224037892] Destroy direct read session shared/user_1_1_503573812852966014_v1
2025-11-03T16:57:05.452551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [1:7568544233806397800:2735] destroyed
2025-11-03T16:57:05.452605Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_1_503573812852966014_v1
2025-11-03T16:57:05.458965Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1659: [72075186224037893][rt3.dc2--test-topic] pipe [1:7568544233806397797:2732] disconnected.
2025-11-03T16:57:05.459005Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1670: [72075186224037893][rt3.dc2--test-topic] pipe [1:7568544233806397797:2732] disconnected; active server actors: 1
2025-11-03T16:57:05.459029Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1679: [72075186224037893][rt3.dc2--test-topic] pipe [1:7568544233806397797:2732] client user disconnected session shared/user_1_1_503573812852966014_v1
2025-11-03T16:57:05.459102Z node 1 :PERSQUEUE_READ_BALANCER TRACE: read_balancer__balancing.cpp:241: [72075186224037893][rt3.dc2--test-topic] consumer user family 1 status Active partitions [0]  is free.
2025-11-03T16:57:05.463318Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1659: [72075186224037893][rt3.dc1--test-topic] pipe [3:7568544235298246777:2696] disconnected.
2025-11-03T16:57:05.463393Z node 3 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1670: [72075186224037893][rt3.dc1--test-topic] pipe [3:7568544235298246777:2696] disconnected; active server actors: 1
2025-11-03T16:57:05.463417Z node 3 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1679: [72075186224037893][rt3.dc1--test-topic] pipe [3:7568544235298246777:2696] client user disconnected session shared/user_3_1_5127326268369064539_v1
2025-11-03T16:57:05.463490Z node 3 :PERSQUEUE_READ_BALANCER TRACE: read_balancer__balancing.cpp:241: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0]  is free.
2025-11-03T16:57:05.497009Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [4:7568544170866189024:2388], Partition 0, Sender [0:0:0], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:57:05.497074Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:05.497109Z node 4 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:05.497140Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:57:05.497170Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:57:05.497183Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:57:05.497204Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:57:05.497276Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:57:05.497291Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:57:05.497312Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:57:05.541046Z node 2 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [2:7568544108397207262:2383], Partition 0, Sender [0:0:0], Recipient [2:7568544108397207303:2383], Cookie: 0
2025-11-03T16:57:05.541116Z node 2 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [2:7568544108397207303:2383]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:05.541139Z node 2 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:05.541169Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:57:05.541193Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:57:05.541206Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:57:05.541229Z node 2 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:57:05.541303Z node 2 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:57:05.541322Z node 2 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:57:05.541342Z node 2 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:57:05.597812Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [4:7568544170866189024:2388], Partition 0, Sender [0:0:0], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:57:05.597882Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:05.597910Z node 4 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:05.597941Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:57:05.597958Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:57:05.597974Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:57:05.597999Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:57:05.598062Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:57:05.598077Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:57:05.598100Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:57:05.698244Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [4:7568544170866189024:2388], Partition 0, Sender [0:0:0], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:57:05.698323Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:05.698362Z node 4 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:05.698393Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:57:05.698410Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:57:05.698425Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:57:05.698446Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:57:05.698520Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:57:05.698536Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:57:05.698568Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:57:05.799762Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [4:7568544170866189024:2388], Partition 0, Sender [0:0:0], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:57:05.799821Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:05.799842Z node 4 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:05.799872Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:57:05.799885Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:57:05.799898Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:57:05.799921Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:57:05.799995Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:57:05.800012Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:57:05.800032Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:57:05.902525Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [4:7568544170866189024:2388], Partition 0, Sender [0:0:0], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:57:05.902595Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:05.902618Z node 4 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:05.902649Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:57:05.902666Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:57:05.902680Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:57:05.902703Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:57:05.902761Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:57:05.902775Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:57:05.902796Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:57:06.004264Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [4:7568544170866189024:2388], Partition 0, Sender [0:0:0], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:57:06.004381Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:06.004429Z node 4 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:06.004480Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:57:06.004511Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:57:06.004537Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:57:06.004577Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:57:06.004686Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:57:06.004714Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:57:06.004753Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:57:06.106198Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [4:7568544170866189024:2388], Partition 0, Sender [0:0:0], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:57:06.106272Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:06.106298Z node 4 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:06.106334Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:57:06.106353Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:57:06.106369Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:57:06.106396Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:57:06.106460Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:57:06.106474Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:57:06.106496Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:57:06.207245Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [4:7568544170866189024:2388], Partition 0, Sender [0:0:0], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:57:06.207315Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:06.207341Z node 4 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:06.207371Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:57:06.207388Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:57:06.207404Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:57:06.207430Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:57:06.207518Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:57:06.207537Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:57:06.207568Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:57:06.308853Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [4:7568544170866189024:2388], Partition 0, Sender [0:0:0], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:57:06.308942Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:06.308977Z node 4 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:06.309020Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:57:06.309038Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:57:06.309054Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:57:06.309080Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:57:06.309144Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:57:06.309177Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:57:06.309203Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:57:06.328241Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188544 (NKikimr::NPQ::NReadQuoterEvents::TEvQuotaCountersUpdated), Tablet [4:7568544170866189024:2388], Partition 0, Sender [4:7568544170866189068:2388], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:57:06.328322Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188544, Sender [4:7568544170866189068:2388], Recipient [4:7568544170866189065:2388]: NKikimr::NPQ::NReadQuoterEvents::TEvQuotaCountersUpdated
2025-11-03T16:57:06.328348Z node 4 :PERSQUEUE TRACE: partition.h:671: StateIdle, processing event NReadQuoterEvents::TEvQuotaCountersUpdated
2025-11-03T16:57:06.409400Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [4:7568544170866189024:2388], Partition 0, Sender [0:0:0], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:57:06.409478Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:06.409506Z node 4 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:06.409563Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:57:06.409581Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:57:06.409600Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:57:06.409624Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:57:06.409701Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:57:06.409719Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:57:06.409744Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:57:06.512419Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [4:7568544170866189024:2388], Partition 0, Sender [0:0:0], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:57:06.512496Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:06.512537Z node 4 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:06.512568Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:57:06.512584Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:57:06.512600Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:57:06.512622Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:57:06.512681Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:57:06.512697Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:57:06.512720Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:57:06.612864Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [4:7568544170866189024:2388], Partition 0, Sender [0:0:0], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:57:06.612947Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:06.612976Z node 4 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:06.613021Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:57:06.613036Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:57:06.613050Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:57:06.613086Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:57:06.613147Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:57:06.613162Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:57:06.613181Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:57:06.716157Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [4:7568544170866189024:2388], Partition 0, Sender [0:0:0], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:57:06.716235Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:06.716263Z node 4 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:06.716298Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:57:06.716314Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:57:06.716329Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:57:06.716353Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:57:06.716418Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:57:06.716433Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:57:06.716455Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:57:06.816712Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [4:7568544170866189024:2388], Partition 0, Sender [0:0:0], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:57:06.816790Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:06.816814Z node 4 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:06.816845Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:57:06.816861Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:57:06.816875Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:57:06.816899Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:57:06.816959Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:57:06.816974Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:57:06.816995Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:57:06.918504Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [4:7568544170866189024:2388], Partition 0, Sender [0:0:0], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:57:06.918583Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:06.918609Z node 4 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:06.918645Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:57:06.918661Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:57:06.918678Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:57:06.918704Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:57:06.918775Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:57:06.918792Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:57:06.918819Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:57:07.023071Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [4:7568544170866189024:2388], Partition 0, Sender [0:0:0], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:57:07.023138Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:07.023159Z node 4 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:07.023191Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:57:07.023206Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:57:07.023220Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:57:07.023241Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:57:07.023299Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:57:07.023313Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:57:07.023336Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:57:07.124324Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [4:7568544170866189024:2388], Partition 0, Sender [0:0:0], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:57:07.124394Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:07.124421Z node 4 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:07.124452Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:57:07.124468Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:57:07.124498Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:57:07.124520Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:57:07.124582Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:57:07.124599Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:57:07.124622Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:57:07.226253Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [4:7568544170866189024:2388], Partition 0, Sender [0:0:0], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:57:07.226322Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:07.226348Z node 4 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:07.226379Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:57:07.226394Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:57:07.226409Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:57:07.226431Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:57:07.226493Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:57:07.226508Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:57:07.226531Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:57:07.328958Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [4:7568544170866189024:2388], Partition 0, Sender [0:0:0], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:57:07.329022Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:07.329042Z node 4 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:07.329072Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:57:07.329093Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:57:07.329105Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:57:07.329124Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:57:07.329183Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:57:07.329194Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:57:07.329214Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:57:07.329280Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188544 (NKikimr::NPQ::NReadQuoterEvents::TEvQuotaCountersUpdated), Tablet [4:7568544170866189024:2388], Partition 0, Sender [4:7568544170866189068:2388], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:57:07.329311Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188544, Sender [4:7568544170866189068:2388], Recipient [4:7568544170866189065:2388]: NKikimr::NPQ::NReadQuoterEvents::TEvQuotaCountersUpdated
2025-11-03T16:57:07.329326Z node 4 :PERSQUEUE TRACE: partition.h:671: StateIdle, processing event NReadQuoterEvents::TEvQuotaCountersUpdated
2025-11-03T16:57:07.431669Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [4:7568544170866189024:2388], Partition 0, Sender [0:0:0], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:57:07.431733Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:07.431755Z node 4 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:07.431787Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:57:07.431801Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:57:07.431812Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:57:07.431836Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:57:07.431895Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:57:07.431909Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:57:07.431930Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:57:07.532155Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [4:7568544170866189024:2388], Partition 0, Sender [0:0:0], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:57:07.532214Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:07.532235Z node 4 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:07.532263Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:57:07.532278Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:57:07.532290Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:57:07.532311Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:57:07.532366Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:57:07.532380Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:57:07.532400Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:57:07.632961Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [4:7568544170866189024:2388], Partition 0, Sender [0:0:0], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:57:07.633019Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:07.633040Z node 4 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:07.633066Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:57:07.633079Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:57:07.633092Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:57:07.633112Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:57:07.633179Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:57:07.633193Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:57:07.633213Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:57:07.735129Z node 4 :PERSQUEUE TRACE: partition.h:620: StateIdle event# 271188505 (NKikimr::TEvPQ::TEvUpdateAvailableSize), Tablet [4:7568544170866189024:2388], Partition 0, Sender [0:0:0], Recipient [4:7568544170866189065:2388], Cookie: 0
2025-11-03T16:57:07.735182Z node 4 :PERSQUEUE TRACE: partition.h:622: StateIdle, received event# 271188505, Sender [0:0:0], Recipient [4:7568544170866189065:2388]: NKikimr::TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:07.735202Z node 4 :PERSQUEUE TRACE: partition.h:649: StateIdle, processing event TEvPQ::TEvUpdateAvailableSize
2025-11-03T16:57:07.735227Z node 4 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:57:07.735241Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:57:07.735252Z node 4 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:57:07.735272Z node 4 :PERSQUEUE TRACE: partition.cpp:543: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete old stuff
2025-11-03T16:57:07.735367Z node 4 :PERSQUEUE TRACE: partition.cpp:552: [72075186224037892][Partition][0][StateIdle] Have 0 items to delete all stuff. Delete command NKikimrClient.TKeyValueRequest 
2025-11-03T16:57:07.735384Z node 4 :PERSQUEUE TRACE: partition_write.cpp:163: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessReserveRequests.
2025-11-03T16:57:07.735401Z node 4 :PERSQUEUE TRACE: partition_write.cpp:282: [72075186224037892][Partition][0][StateIdle] TPartition::AnswerCurrentWrites. Responses.size()=0
2025-11-03T16:57:09.628078Z :RetryWithBatching INFO: Random seed for debugging is 1762189029628053
2025-11-03T16:57:10.277078Z node 5 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[5:7568544254006038191:2081];send_to=[0:7307199536658146131:7762515];
2025-11-03T16:57:10.277247Z node 5 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
2025-11-03T16:57:10.370912Z node 5 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
test_client.cpp: SetPath # /home/runner/.ya/build/build_root/7jz3/00196f/r3tmp/tmpwAOmoI/pdisk_1.dat
2025-11-03T16:57:10.448020Z node 5 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-11-03T16:57:10.457841Z node 6 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-11-03T16:57:10.489704Z node 6 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-11-03T16:57:10.489826Z node 6 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=incorrect path status: LookupError;
2025-11-03T16:57:10.644102Z node 5 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-11-03T16:57:10.677634Z node 5 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
2025-11-03T16:57:10.699140Z node 5 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(5, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-11-03T16:57:10.699234Z node 5 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(5, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-11-03T16:57:10.706568Z node 5 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(6, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-11-03T16:57:10.706662Z node 5 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(6, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-11-03T16:57:10.713506Z node 5 :HIVE WARN: hive_impl.cpp:811: HIVE#72057594037968897 Handle TEvInterconnect::TEvNodeConnected, NodeId 6 Cookie 6
2025-11-03T16:57:10.713656Z node 5 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(5, (0,0,0,0)) VolatileState: Connecting -> Connected
2025-11-03T16:57:10.717500Z node 5 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(6, (0,0,0,0)) VolatileState: Connecting -> Connected
TServer::EnableGrpc on GrpcPort 6701, node 5
2025-11-03T16:57:10.764333Z node 6 :BS_NODE WARN: {NWDC01@distconf.cpp:397} StateFunc too long Type# 268639238 Duration# 0.024134s
2025-11-03T16:57:10.792086Z node 6 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-11-03T16:57:10.924850Z node 5 :NET_CLASSIFIER WARN: net_classifier.cpp:190: distributable config is empty, broken or outdated, will use file: /home/runner/.ya/build/build_root/7jz3/00196f/r3tmp/yandexm5cIwc.tmp
2025-11-03T16:57:10.924879Z node 5 :NET_CLASSIFIER WARN: net_classifier.cpp:196: will try to initialize from file: /home/runner/.ya/build/build_root/7jz3/00196f/r3tmp/yandexm5cIwc.tmp
2025-11-03T16:57:10.925044Z node 5 :NET_CLASSIFIER WARN: net_classifier.cpp:202: successfully initialized from file: /home/runner/.ya/build/build_root/7jz3/00196f/r3tmp/yandexm5cIwc.tmp
2025-11-03T16:57:10.925230Z node 5 :NET_CLASSIFIER ERROR: net_classifier.cpp:228: got bad distributable configuration
2025-11-03T16:57:10.972100Z node 5 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-11-03T16:57:10.997585Z INFO: TTestServer started on Port 20672 GrpcPort 6701
TClient is connected to server localhost:20672
PQClient connected to localhost:6701
WaitRootIsUp 'Root'...
TClient::Ls request: Root
2025-11-03T16:57:11.316638Z node 5 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "Root"
    PathId: 1
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 1
    CreateStep: 0
    ParentPathId: 1
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 1
      SubDomainVersion: 0
      SecurityStateVersion: 0
    }
    ChildrenExist: false
  }
  Children {
    Name: ".sys"
    PathId: 18446744073709551615
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 0
    CreateStep: 0
    ParentPathId: 18446744073709551615
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 0
      Pl...
(TRUNCATED)
WaitRootIsUp 'Root' success.
2025-11-03T16:57:11.335448Z node 5 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpAlterSubDomain, opId: 281474976710657:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_alter_subdomain.cpp:311)
waiting...
2025-11-03T16:57:11.380124Z node 6 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
waiting...
waiting...
waiting...
2025-11-03T16:57:15.284476Z node 5 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[5:7568544254006038191:2081];send_to=[0:7307199536658146131:7762515];
2025-11-03T16:57:15.284627Z node 5 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
2025-11-03T16:57:15.949807Z node 5 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [5:7568544275480875665:2329], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-03T16:57:15.949988Z node 5 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-03T16:57:15.950407Z node 5 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [5:7568544275480875678:2332], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-03T16:57:15.950464Z node 5 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [5:7568544275480875679:2333], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-03T16:57:15.950604Z node 5 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-03T16:57:15.964263Z node 5 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateResourcePool, opId: 281474976710661:3, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_resource_pool.cpp:179)
2025-11-03T16:57:16.011103Z node 5 :KQP_WORKLOAD_SERVICE WARN: helpers.h:73: [WorkloadService] [TPoolCreatorActor] ActorId: [5:7568544275480875682:2334], DatabaseId: /Root, PoolId: default, Scheduled retry for error: { <main>: Error: Transaction 281474976710661 completed, doublechecking }
2025-11-03T16:57:16.042483Z node 5 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710662:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:690)
2025-11-03T16:57:16.127216Z node 5 :TX_PROXY ERROR: schemereq.cpp:593: Actor# [5:7568544279775843129:2732] txid# 281474976710663, issues: { message: "Check failed: path: \'/Root/.metadata/workload_manager/pools/default\', error: path exist, request accepts it (id: [OwnerId: 72057594046644480, LocalPathId: 8], type: EPathTypeResourcePool, state: EPathStateNoChanges)" severity: 1 }
2025-11-03T16:57:16.176465Z node 5 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:570: Compilation failed, self: [5:7568544279775843148:2346], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-11-03T16:57:16.179188Z node 5 :KQP_SESSION WARN: kqp_session_actor.cpp:2506: SessionId: ydb://session/3?node_id=5&id=NGJjZjljZGMtZWU2M2M3NmYtYTg3NDdjNjktNGI2YWI2M2I=, ActorId: [5:7568544275480875663:2328], ActorState: ExecuteState, TraceId: 01k95adjdbfj51qsbrnt3frt4r, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-11-03T16:57:16.179643Z node 5 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-11-03T16:57:16.383395Z node 5 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710664:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:690)
2025-11-03T16:57:16.565061Z node 6 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:570: Compilation failed, self: [6:7568544282608517353:2311], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:5:17: Error: At function: KiReadTable!
        <main>:5:17: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Versions]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-11-03T16:57:16.568306Z node 6 :KQP_SESSION WARN: kqp_session_actor.cpp:2506: SessionId: ydb://session/3?node_id=6&id=NjUzNWVjYy1iYWEzMjU2Mi0xNzhhNTAwMS01ODcyMjY2ZA==, ActorId: [6:7568544282608517314:2304], ActorState: ExecuteState, TraceId: 01k95adjywd8g8ga73k4rb5c5j, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-11-03T16:57:16.568824Z node 6 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 5 column: 17 } message: "At function: KiReadTable!" end_position { row: 5 column: 17 } severity: 1 issues { position { row: 5 column: 17 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Versions]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 5 column: 17 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-11-03T16:57:16.669448Z node 5 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710665:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:690)
=== Init DC: UPSERT INTO `/Root/PQ/Config/V2/Cluster` (name, balancer, local, enabled, weight) VALUES ("dc1", "localhost:6701", true, true, 1000);
2025-11-03T16:57:17.145572Z node 5 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976710666. Ctx: { TraceId: 01k95adkcjeetgnjjtg01yer7d, Database: , SessionId: ydb://session/3?node_id=5&id=NmIyMmE4OTItODhmYmE3YWEtODEwYzc0OTMtZmQ4MTk2M2Y=, PoolId: default, DatabaseId: /Root}. Database not set, use /Root
=== CheckClustersList. Subcribe to ClusterTracker from [5:7568544284070810791:2997] 
=== CheckClustersList. Ok
2025-11-03T16:57:24.603386Z node 5 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710671:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:690)
waiting...
PQ Client: create topic: rt3.dc1--test-topic with 1 partitions
CallPersQueueGRPC request to localhost:6701
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
CallPersQueueGRPC response:
2025-11-03T16:57:24.707202Z node 5 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
CallPersQueueGRPC request to localhost:6701
MetaRequest {
  CmdCreateTopic {
    Topic: "rt3.dc1--test-topic"
    NumPartitions: 1
    Config {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
  }
}
CallPersQueueGRPC response:
Status: 129
ProxyErrorCode: 53
SchemeStatus: 1
FlatTxId {
  TxId: 281474976710672
  SchemeShardTabletId: 72057594046644480
  PathId: 13
}
ErrorCode: OK
AddTopic: rt3.dc1--test-topic
===Run query:``DECLARE $version as Int64; DECLARE $path AS Utf8; DECLARE $cluster as Utf8; UPSERT INTO `/Root/PQ/Config/V2/Topics` (path, dc) VALUES ($path, $cluster); UPSERT INTO `/Root/PQ/Config/V2/Versions` (name, version) VALUES ("Topics", $version);`` with topic = test-topic, dc = dc1
2025-11-03T16:57:24.776334Z node 5 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1655: [72075186224037893][] pipe [5:7568544314135582298:3278] connected; active server actors: 1
2025-11-03T16:57:24.776534Z node 5 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1519: [72075186224037893][rt3.dc1--test-topic] updating configuration. Deleted partitions []. Added partitions [0]
2025-11-03T16:57:24.779645Z node 5 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:971: [72075186224037893][rt3.dc1--test-topic] Discovered subdomain [OwnerId: 72057594046644480, LocalPathId: 1] state, outOfSpace = 0 at RB 72075186224037893
2025-11-03T16:57:24.786400Z node 5 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:140: [72075186224037893][rt3.dc1--test-topic] BALANCER INIT DONE for rt3.dc1--test-topic: (0, 72075186224037892) 
2025-11-03T16:57:24.804202Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2960: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-11-03T16:57:24.816666Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2992: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-11-03T16:57:24.816947Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:787: [PQ: 72075186224037892] no config, start with empty partitions and default config
2025-11-03T16:57:24.816982Z node 6 :PERSQUEUE NOTICE: pq_impl.cpp:913: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-11-03T16:57:24.817029Z node 6 :PERSQUEUE INFO: pq_impl.cpp:612: [PQ: 72075186224037892] doesn't have tx writes info
2025-11-03T16:57:24.820195Z node 5 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:404: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 6, Generation 1
2025-11-03T16:57:24.818545Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [5:7568544314135582321:2446], now have 1 active actors on pipe
2025-11-03T16:57:24.818581Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [5:7568544314135582297:3277], now have 1 active actors on pipe
2025-11-03T16:57:24.818968Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-03T16:57:24.832904Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-03T16:57:24.855302Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [5:7568544314135582361:3324], now have 1 active actors on pipe
2025-11-03T16:57:24.856598Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-03T16:57:24.860585Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-03T16:57:24.861627Z node 6 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-11-03T16:57:24.861673Z node 6 :PERSQUEUE DEBUG: partition.cpp:1312: [72075186224037892][Partition][0][StateInit] HandleOnInit TEvPQ::TEvProposePartitionConfig
2025-11-03T16:57:24.861966Z node 6 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-11-03T16:57:24.862186Z node 6 :PERSQUEUE INFO: partition_init.cpp:1101: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [6:7568544316968256105:2380]
2025-11-03T16:57:24.868705Z node 6 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-11-03T16:57:24.868736Z node 6 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-11-03T16:57:24.868765Z node 6 :PERSQUEUE INFO: partition.cpp:707: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1 [6:7568544316968256105:2380]
2025-11-03T16:57:24.868796Z node 6 :PERSQUEUE DEBUG: partition.cpp:727: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 0 Head Offset 0 PartNo 0 PackedSize 0 count 0 nextOffset 0 batches 0
2025-11-03T16:57:24.868828Z node 6 :PERSQUEUE DEBUG: partition_mlp.cpp:83: [72075186224037892][Partition][0][StateIdle] Initializing MLP Consumers: 0
2025-11-03T16:57:24.870130Z node 6 :PERSQUEUE DEBUG: partition.cpp:4273: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 1
2025-11-03T16:57:24.870167Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:57:24.870258Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:57:24.870270Z node 6 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-03T16:57:24.870287Z node 6 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-11-03T16:57:24.870300Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-11-03T16:57:24.870313Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:57:24.870324Z node 6 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-11-03T16:57:24.870352Z node 6 :PERSQUEUE DEBUG: partition_read.cpp:923: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-11-03T16:57:24.870386Z node 6 :PERSQUEUE DEBUG: partition_mlp.cpp:60: [72075186224037892][Partition][0][StateIdle] Process MLP pending events. Count 0
2025-11-03T16:57:24.870960Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-03T16:57:24.871118Z node 6 :PERSQUEUE DEBUG: partition_compaction.cpp:183: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:57:24.877911Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-03T16:57:24.878056Z node 6 :PERSQUEUE DEBUG: partition.cpp:1416: [72075186224037892][Partition][0][StateIdle] Handle TEvPQ::TEvTxCommit Step 1762189044889, TxId 281474976710672
2025-11-03T16:57:24.878079Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-11-03T16:57:24.878104Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:57:24.878237Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:57:24.878452Z node 6 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-03T16:57:24.882367Z node 6 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-03T16:57:24.882558Z node 6 :PERSQUEUE DEBUG: partition_mlp.cpp:83: [72075186224037892][Partition][0][StateIdle] Initializing MLP Consumers: 0
2025-11-03T16:57:24.882679Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-11-03T16:57:24.882703Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:57:24.882717Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:57:24.882731Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:57:24.882763Z node 6 :PERSQUEUE DEBUG: partition_compaction.cpp:183: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:57:24.883167Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:398: [PQ: 72075186224037892] Apply new config PartitionConfig { LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 } PartitionIds: 0 TopicName: "rt3.dc1--test-topic" Version: 0 LocalDC: true Codecs { Ids: 0 Ids: 1 Ids: 2 Codecs: "raw" Codecs: "gzip" Codecs: "lzop" } TopicPath: "/Root/PQ/rt3.dc1--test-topic" YcCloudId: "" YcFolderId: "" YdbDatabaseId: "" YdbDatabasePath: "/Root" Partitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } AllPartitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } Consumers { Name: "user" ReadFromTimestampsMs: 0 FormatVersion: 0 Version: 0 Generation: 0 } MonitoringProjectId: ""
2025-11-03T16:57:24.883265Z node 6 :PERSQUEUE NOTICE: pq_impl.cpp:913: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-11-03T16:57:24.883554Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-03T16:57:24.894738Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-03T16:57:24.894849Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-03T16:57:24.898878Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-03T16:57:24.964618Z node 5 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976710673. Ctx: { TraceId: 01k95adv1p8twckydppvd26pts, Database: , SessionId: ydb://session/3?node_id=5&id=OTRkZjkzNmMtNmY3ZjZhMWMtZTRkYjBlNjctNDE1NmUzODg=, PoolId: default, DatabaseId: /Root}. Database not set, use /Root
2025-11-03T16:57:24.970998Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:57:24.971049Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:57:24.971067Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
===Query complete
TClient::Ls request: /Root/PQ/rt3.dc1--test-topic
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976710672
    CreateStep: 1762189044889
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts...
(TRUNCATED)
GetTopicVersionFromPath:  record Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976710672
    CreateStep: 1762189044889
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      YdbDatabasePath: "/Root"
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
    Partitions {
      PartitionId: 0
      TabletId: 72075186224037892
      Status: Active
    }
    AlterVersion: 1
    BalancerTabletID: 72075186224037893
    NextPartitionId: 1
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 1
      PlanResolution: 7
      Coordinators: 72057594046316545
      TimeCastBucketsPerMediator: 2
      Mediators: 72057594046382081
    }
    DomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    PathsInside: 12
    PathsLimit: 10000
    ShardsInside: 6
    ShardsLimit: 200000
    ResourcesDomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    DiskSpaceUsage {
      Tables {
        TotalSize: 0
        DataSize: 0
        IndexSize: 0
      }
      Topics {
        ReserveSize: 0
        AccountSize: 0
        DataSize: 0
        UsedReserveSize: 0
      }
    }
    PQPartitionsInside: 1
    PQPartitionsLimit: 1000000
    SchemeLimits {
      MaxDepth: 32
      MaxPaths: 10000
      MaxChildrenInDir: 100000
      MaxAclBytesSize: 10240
      MaxTableColumns: 200
      MaxTableColumnNameLength: 255
      MaxTableKeyColumns: 30
      MaxTableIndices: 20
      MaxShards: 200000
      MaxShardsInPath: 35000
      MaxConsistentCopyTargets: 10000
      MaxPathElementLength: 255
      ExtraPathSymbolsAllowed: "!\"#$%&\'()*+,-.:;<=>?@[\\]^_`{|}~"
      MaxPQPartitions: 1000000
      MaxTableCdcStreams: 5
      MaxExports: 10
      MaxImports: 10
      MaxColumnTableColumns: 10000
    }
  }
}
Path: "/Root/PQ/rt3.dc1--test-topic"
 name rt3.dc1--test-topic version1
CallPersQueueGRPC request to localhost:6701
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-11-03T16:57:25.029175Z node 5 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
MetaResponse {
  CmdGetTopicMetadataResult {
    TopicInfo {
      Topic: "rt3.dc1--test-topic"
      NumPartitions: 1
      Config {
        PartitionConfig {
          LifetimeSeconds: 86400
          LowWatermark: 8388608
          SourceIdLifetimeSeconds: 86400
          WriteSpeedInBytesPerSecond: 20000000
          BurstSize: 20000000
          SourceIdMaxCounts: 6000000
        }
        Version: 1
        LocalDC: true
        Codecs {
          Ids: 0
          Ids: 1
          Ids: 2
          Codecs: "raw"
          Codecs: "gzip"
          Codecs: "lzop"
        }
        TopicPath: "/Root/PQ/rt3.dc1--test-topic"
        YdbDatabasePath: "/Root"
        Consumers {
          Name: "user"
          ReadFromTimestampsMs: 0
          FormatVersion: 0
          Version: 0
        }
      }
      ErrorCode: OK
    }
  }
}
=== Topic created, have version: 1
2025-11-03T16:57:25.060510Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: try to update token
2025-11-03T16:57:25.060962Z :INFO: [] MessageGroupId [src] SessionId [] Write session: Do CDS request
2025-11-03T16:57:25.061005Z :INFO: [] MessageGroupId [src] SessionId [] Start write session. Will connect to endpoint: localhost:6701
2025-11-03T16:57:25.072128Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:57:25.072173Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:57:25.072191Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:57:25.092680Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src" }
2025-11-03T16:57:25.100562Z node 5 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-11-03T16:57:25.100598Z node 5 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1
2025-11-03T16:57:25.101140Z node 5 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src" }
2025-11-03T16:57:25.101262Z node 5 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1 topic: "test-topic" message_group_id: "src" from ipv6:[::1]:42126
2025-11-03T16:57:25.101283Z node 5 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:42126 proto=v1  topic=test-topic durationSec=0
2025-11-03T16:57:25.101293Z node 5 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-11-03T16:57:25.105591Z node 5 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1 sessionId:  describe result for acl check
2025-11-03T16:57:25.105752Z node 5 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-11-03T16:57:25.105787Z node 5 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-11-03T16:57:25.105799Z node 5 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-11-03T16:57:25.105819Z node 5 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [5:7568544318430549733:2464] (SourceId=src, PreferedPartition=(NULL)) StartKqpSession
2025-11-03T16:57:25.109374Z node 5 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [5:7568544318430549733:2464] (SourceId=src, PreferedPartition=(NULL)) Select from the table
2025-11-03T16:57:25.176120Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:57:25.176159Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:57:25.176178Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:57:25.284097Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:57:25.284143Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:57:25.284160Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:57:25.388113Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:57:25.388151Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:57:25.388168Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:57:25.463813Z node 5 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [5:7568544318430549733:2464] (SourceId=src, PreferedPartition=(NULL)) RequestPQRB
2025-11-03T16:57:25.464626Z node 5 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1655: [72075186224037893][rt3.dc1--test-topic] pipe [5:7568544318430549779:2464] connected; active server actors: 1
2025-11-03T16:57:25.464724Z node 5 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [5:7568544318430549733:2464] (SourceId=src, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=src
2025-11-03T16:57:25.464743Z node 5 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [5:7568544318430549733:2464] (SourceId=src, PreferedPartition=(NULL)) Update the table
2025-11-03T16:57:25.468194Z node 5 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1659: [72075186224037893][rt3.dc1--test-topic] pipe [5:7568544318430549779:2464] disconnected.
2025-11-03T16:57:25.468237Z node 5 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1670: [72075186224037893][rt3.dc1--test-topic] pipe [5:7568544318430549779:2464] disconnected; active server actors: 1
2025-11-03T16:57:25.468258Z node 5 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1695: [72075186224037893][rt3.dc1--test-topic] pipe [5:7568544318430549779:2464] disconnected no session
2025-11-03T16:57:25.484507Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:57:25.484542Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:57:25.484560Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:57:25.588093Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:57:25.588131Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:57:25.588158Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:57:25.639640Z node 5 :FLAT_TX_SCHEMESHARD WARN: schemeshard_impl.cpp:7727: Cannot get console configs
2025-11-03T16:57:25.639666Z node 5 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
2025-11-03T16:57:25.643464Z node 5 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [5:7568544318430549733:2464] (SourceId=src, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-11-03T16:57:25.643501Z node 5 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [5:7568544318430549733:2464] (SourceId=src, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-11-03T16:57:25.643519Z node 5 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [5:7568544318430549733:2464] (SourceId=src, PreferedPartition=(NULL)) Start idle
2025-11-03T16:57:25.643554Z node 5 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-11-03T16:57:25.648672Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [5:7568544318430549808:2464], now have 1 active actors on pipe
2025-11-03T16:57:25.649052Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 6, Generation: 1
2025-11-03T16:57:25.656226Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:57:25.656273Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:57:25.656366Z node 6 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src|7f7f4ff0-efca7fbc-5aaa442f-f2108aa5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src
2025-11-03T16:57:25.656405Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:57:25.656428Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:57:25.656441Z node 6 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-03T16:57:25.656479Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:57:25.656516Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-03T16:57:25.656604Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-03T16:57:25.664132Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:57:25.664180Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:57:25.664278Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-03T16:57:25.668465Z node 5 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1 partition: 0 MaxSeqNo: 0 sessionId: src|7f7f4ff0-efca7fbc-5aaa442f-f2108aa5_0
2025-11-03T16:57:25.669388Z :INFO: [] MessageGroupId [src] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1762189045669 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-11-03T16:57:25.669505Z :INFO: [] MessageGroupId [src] SessionId [] Write session established. Init response: session_id: "src|7f7f4ff0-efca7fbc-5aaa442f-f2108aa5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-11-03T16:57:25.670484Z :INFO: [] MessageGroupId [src] SessionId [src|7f7f4ff0-efca7fbc-5aaa442f-f2108aa5_0] Write session: close. Timeout = 0 ms
2025-11-03T16:57:25.670533Z :INFO: [] MessageGroupId [src] SessionId [src|7f7f4ff0-efca7fbc-5aaa442f-f2108aa5_0] Write session will now close
2025-11-03T16:57:25.670593Z :DEBUG: [] MessageGroupId [src] SessionId [src|7f7f4ff0-efca7fbc-5aaa442f-f2108aa5_0] Write session: aborting
2025-11-03T16:57:25.671087Z :INFO: [] MessageGroupId [src] SessionId [src|7f7f4ff0-efca7fbc-5aaa442f-f2108aa5_0] Write session: gracefully shut down, all writes complete
2025-11-03T16:57:25.671137Z :DEBUG: [] MessageGroupId [src] SessionId [src|7f7f4ff0-efca7fbc-5aaa442f-f2108aa5_0] Write session: destroy
2025-11-03T16:57:25.676155Z node 5 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId: src|7f7f4ff0-efca7fbc-5aaa442f-f2108aa5_0 grpc read done: success: 0 data: 
2025-11-03T16:57:25.676176Z node 5 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 1 sessionId: src|7f7f4ff0-efca7fbc-5aaa442f-f2108aa5_0 grpc read failed
2025-11-03T16:57:25.676206Z node 5 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 1 sessionId: src|7f7f4ff0-efca7fbc-5aaa442f-f2108aa5_0 grpc closed
2025-11-03T16:57:25.676227Z node 5 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1 sessionId: src|7f7f4ff0-efca7fbc-5aaa442f-f2108aa5_0 is DEAD
2025-11-03T16:57:25.676798Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-11-03T16:57:25.677279Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [5:7568544318430549808:2464] destroyed
2025-11-03T16:57:25.677333Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-11-03T16:57:25.677362Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:57:25.677377Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:57:25.677390Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
====TYdbPqTestRetryPolicy()
2025-11-03T16:57:25.688635Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:57:25.688672Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:57:25.688691Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:57:25.757026Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [] Write session: try to update token
2025-11-03T16:57:25.757389Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [] Write session: Do CDS request
2025-11-03T16:57:25.757442Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [] Do schedule cds request after 0 ms
2025-11-03T16:57:25.757545Z :INFO: [/Root] MessageGroupId [test-message-group-id] Running cds request ms
2025-11-03T16:57:25.775990Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [] Got CDS response: 
write_sessions_clusters { clusters { endpoint: "localhost:6701" name: "dc1" available: true } primary_cluster_selection_reason: CLIENT_LOCATION } version: 1
2025-11-03T16:57:25.776049Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [] Start write session. Will connect to endpoint: localhost:6701
2025-11-03T16:57:25.796106Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:57:25.796144Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:57:25.796161Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:57:25.811331Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [] Write session: send init request: init_request { topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" }
2025-11-03T16:57:25.820537Z node 5 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-11-03T16:57:25.820568Z node 5 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2
2025-11-03T16:57:25.821055Z node 5 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" }
2025-11-03T16:57:25.821190Z node 5 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2 topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" from ipv6:[::1]:42160
2025-11-03T16:57:25.821209Z node 5 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:42160 proto=v1  topic=test-topic durationSec=0
2025-11-03T16:57:25.821221Z node 5 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-11-03T16:57:25.826029Z node 5 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2 sessionId:  describe result for acl check
2025-11-03T16:57:25.826159Z node 5 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-11-03T16:57:25.826197Z node 5 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-11-03T16:57:25.826211Z node 5 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-11-03T16:57:25.826229Z node 5 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [5:7568544318430549835:2488] (SourceId=test-message-group-id, PreferedPartition=(NULL)) StartKqpSession
2025-11-03T16:57:25.829454Z node 5 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [5:7568544318430549835:2488] (SourceId=test-message-group-id, PreferedPartition=(NULL)) Select from the table
2025-11-03T16:57:25.842737Z node 5 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [5:7568544318430549835:2488] (SourceId=test-message-group-id, PreferedPartition=(NULL)) RequestPQRB
2025-11-03T16:57:25.843607Z node 5 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1655: [72075186224037893][rt3.dc1--test-topic] pipe [5:7568544318430549857:2488] connected; active server actors: 1
2025-11-03T16:57:25.843838Z node 5 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [5:7568544318430549835:2488] (SourceId=test-message-group-id, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=test-message-group-id
2025-11-03T16:57:25.843858Z node 5 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [5:7568544318430549835:2488] (SourceId=test-message-group-id, PreferedPartition=(NULL)) Update the table
2025-11-03T16:57:25.845923Z node 5 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1659: [72075186224037893][rt3.dc1--test-topic] pipe [5:7568544318430549857:2488] disconnected.
2025-11-03T16:57:25.845951Z node 5 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1670: [72075186224037893][rt3.dc1--test-topic] pipe [5:7568544318430549857:2488] disconnected; active server actors: 1
2025-11-03T16:57:25.845971Z node 5 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1695: [72075186224037893][rt3.dc1--test-topic] pipe [5:7568544318430549857:2488] disconnected no session
2025-11-03T16:57:25.873762Z node 5 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [5:7568544318430549835:2488] (SourceId=test-message-group-id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-11-03T16:57:25.873800Z node 5 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [5:7568544318430549835:2488] (SourceId=test-message-group-id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-11-03T16:57:25.873819Z node 5 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [5:7568544318430549835:2488] (SourceId=test-message-group-id, PreferedPartition=(NULL)) Start idle
2025-11-03T16:57:25.873853Z node 5 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-11-03T16:57:25.876000Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [5:7568544318430549874:2488], now have 1 active actors on pipe
2025-11-03T16:57:25.876340Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 6, Generation: 1
2025-11-03T16:57:25.876717Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:57:25.876746Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:57:25.876829Z node 6 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie test-message-group-id|22b3c6bc-352dccef-9be782a8-e4e0068_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner test-message-group-id
2025-11-03T16:57:25.876864Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:57:25.876883Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:57:25.876895Z node 6 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-03T16:57:25.876934Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:57:25.876972Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-03T16:57:25.877072Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-03T16:57:25.878210Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:57:25.878235Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:57:25.878308Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-03T16:57:25.878718Z node 5 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2 partition: 0 MaxSeqNo: 0 sessionId: test-message-group-id|22b3c6bc-352dccef-9be782a8-e4e0068_0
2025-11-03T16:57:25.880660Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1762189045880 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-11-03T16:57:25.880782Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [] Write session established. Init response: session_id: "test-message-group-id|22b3c6bc-352dccef-9be782a8-e4e0068_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
ReadyToAcceptEvent
{"NodeId":5,"Down":true}
2025-11-03T16:57:25.892537Z node 6 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:57:25.892567Z node 6 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:57:25.892583Z node 6 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
{"NodeId":6,"Down":true}
{"TabletsKicked":3}
{"TabletsKicked":3}
TClient::Ls request: /Root/PQ/rt3.dc1--test-topic
2025-11-03T16:57:25.914154Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [5:7568544314135582321:2446] destroyed
2025-11-03T16:57:25.925786Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-11-03T16:57:25.925810Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-11-03T16:57:25.925882Z node 5 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2 reason: pipe to partition's 0 tablet is dead #2 sessionId: test-message-group-id|22b3c6bc-352dccef-9be782a8-e4e0068_0
2025-11-03T16:57:25.926243Z node 5 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2 sessionId: test-message-group-id|22b3c6bc-352dccef-9be782a8-e4e0068_0 is DEAD
====CreateRetryState
Test retry state: get retry delay
2025-11-03T16:57:25.929576Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|22b3c6bc-352dccef-9be782a8-e4e0068_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: pipe to partition's 0 tablet is dead #2, code: 500027 
2025-11-03T16:57:25.929627Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|22b3c6bc-352dccef-9be782a8-e4e0068_0] Write session will restart in 2.000000s
2025-11-03T16:57:25.929690Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|22b3c6bc-352dccef-9be782a8-e4e0068_0] Write session: Do CDS request
2025-11-03T16:57:25.929731Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|22b3c6bc-352dccef-9be782a8-e4e0068_0] Do schedule cds request after 2000 ms
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976710672
    CreateStep: 1762189044889
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts...
(TRUNCATED)
2025-11-03T16:57:27.004340Z node 5 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976710678. Failed to resolve tablet: 72075186224037890 after several retries.
2025-11-03T16:57:27.004501Z node 5 :KQP_EXECUTER WARN: kqp_executer_impl.h:245: ActorId: [5:7568544322725517199:2476] TxId: 281474976710678. Ctx: { TraceId: 01k95advv3ens1mbmkymm57nng, Database: /Root, SessionId: ydb://session/3?node_id=5&id=NjY2MmZkOS02ZGU5MTZjYi1mY2I0OGVlZC02NDNlMmQ5Mw==, PoolId: default}. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037890 after several retries.
2025-11-03T16:57:27.004814Z node 5 :KQP_SESSION WARN: kqp_session_actor.cpp:2987: SessionId: ydb://session/3?node_id=5&id=NjY2MmZkOS02ZGU5MTZjYi1mY2I0OGVlZC02NDNlMmQ5Mw==, ActorId: [5:7568544318430549791:2476], ActorState: ExecuteState, TraceId: 01k95advv3ens1mbmkymm57nng, Create QueryResponse for error on request, msg: 
2025-11-03T16:57:27.006779Z node 5 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Failed to resolve tablet: 72075186224037890 after several retries." severity: 1 } TxMeta { id: "01k95adwec8s7x46apq273w0ze" } } YdbStatus: UNAVAILABLE ConsumedRu: 405 }
2025-11-03T16:57:27.037724Z node 6 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976715661. Failed to resolve tablet: 72075186224037890 after several retries.
2025-11-03T16:57:27.037882Z node 6 :KQP_EXECUTER WARN: kqp_executer_impl.h:245: ActorId: [6:7568544325558190767:2388] TxId: 281474976715661. Ctx: { TraceId: 01k95advtx9zazqwebmxp2esdh, Database: /Root, SessionId: ydb://session/3?node_id=6&id=NDFmNmViNjItMTMwNWE5M2MtYTYxNTU5ZjYtZjlmMGVhMzQ=, PoolId: default}. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037890 after several retries.
2025-11-03T16:57:27.038196Z node 6 :KQP_SESSION WARN: kqp_session_actor.cpp:2987: SessionId: ydb://session/3?node_id=6&id=NDFmNmViNjItMTMwNWE5M2MtYTYxNTU5ZjYtZjlmMGVhMzQ=, ActorId: [6:7568544321263223454:2388], ActorState: ExecuteState, TraceId: 01k95advtx9zazqwebmxp2esdh, Create QueryResponse for error on request, msg: 
2025-11-03T16:57:27.039642Z node 6 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Failed to resolve tablet: 72075186224037890 after several retries." severity: 1 } TxMeta { id: "01k95adweg7f00qhwgtmtkkksw" } } YdbStatus: UNAVAILABLE ConsumedRu: 408 }
2025-11-03T16:57:27.932548Z :INFO: [/Root] MessageGroupId [test-message-group-id] Running cds request ms
2025-11-03T16:57:27.952365Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|22b3c6bc-352dccef-9be782a8-e4e0068_0] Got CDS response: 
write_sessions_clusters { clusters { endpoint: "localhost:6701" name: "dc1" available: true } primary_cluster_selection_reason: CLIENT_LOCATION } version: 1
2025-11-03T16:57:27.952445Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|22b3c6bc-352dccef-9be782a8-e4e0068_0] Start write session. Will connect to endpoint: localhost:6701
2025-11-03T16:57:27.959827Z node 5 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-11-03T16:57:27.959859Z node 5 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3
2025-11-03T16:57:27.965010Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|22b3c6bc-352dccef-9be782a8-e4e0068_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" }
2025-11-03T16:57:27.972403Z node 5 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" }
2025-11-03T16:57:27.972643Z node 5 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3 topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" from ipv6:[::1]:42160
2025-11-03T16:57:27.972668Z node 5 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:42160 proto=v1  topic=test-topic durationSec=0
2025-11-03T16:57:27.972684Z node 5 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-11-03T16:57:27.974799Z node 5 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3 sessionId:  describe result for acl check
2025-11-03T16:57:27.974956Z node 5 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-11-03T16:57:27.974968Z node 5 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-11-03T16:57:27.974981Z node 5 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-11-03T16:57:27.975002Z node 5 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [5:7568544327020484595:2499] (SourceId=test-message-group-id, PreferedPartition=(NULL)) StartKqpSession
2025-11-03T16:57:27.978717Z node 5 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [5:7568544327020484595:2499] (SourceId=test-message-group-id, PreferedPartition=(NULL)) Select from the table
2025-11-03T16:57:28.776894Z node 5 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976710680. Failed to resolve tablet: 72075186224037891 after several retries.
2025-11-03T16:57:28.777032Z node 5 :KQP_EXECUTER WARN: kqp_executer_impl.h:245: ActorId: [5:7568544327020484603:2501] TxId: 281474976710680. Ctx: { TraceId: 01k95ady5benpj9wsf7jn9q3k2, Database: /Root, SessionId: ydb://session/3?node_id=5&id=OTI4YTUzM2EtYWRjMTY4YmYtNTEzMWYzYzgtYzg3NWZhODA=, PoolId: default}. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037891 after several retries.
2025-11-03T16:57:28.777266Z node 5 :KQP_SESSION WARN: kqp_session_actor.cpp:2987: SessionId: ydb://session/3?node_id=5&id=OTI4YTUzM2EtYWRjMTY4YmYtNTEzMWYzYzgtYzg3NWZhODA=, ActorId: [5:7568544327020484596:2501], ActorState: ExecuteState, TraceId: 01k95ady5benpj9wsf7jn9q3k2, Create QueryResponse for error on request, msg: 
2025-11-03T16:57:28.778933Z node 5 :PQ_PARTITION_CHOOSER INFO: partition_chooser_impl__abstract_chooser_actor.h:312: TPartitionChooser [5:7568544327020484595:2499] (SourceId=test-message-group-id, PreferedPartition=(NULL)) ReplyError: kqp error Marker# PQ50 : Response {
  SessionId: "ydb://session/3?node_id=5&id=OTI4YTUzM2EtYWRjMTY4YmYtNTEzMWYzYzgtYzg3NWZhODA="
  QueryIssues {
    message: "Failed to resolve tablet: 72075186224037891 after several retries."
    severity: 1
  }
  TxMeta {
    id: "01k95ady5g051s0xgr1xxvet6c"
  }
}
YdbStatus: UNAVAILABLE
ConsumedRu: 4
2025-11-03T16:57:28.779077Z node 5 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3 reason: kqp error Marker# PQ50 : Response {
  SessionId: "ydb://session/3?node_id=5&id=OTI4YTUzM2EtYWRjMTY4YmYtNTEzMWYzYzgtYzg3NWZhODA="
  QueryIssues {
    message: "Failed to resolve tablet: 72075186224037891 after several retries."
    severity: 1
  }
  TxMeta {
    id: "01k95ady5g051s0xgr1xxvet6c"
  }
}
YdbStatus: UNAVAILABLE
ConsumedRu: 4
 sessionId: 
2025-11-03T16:57:28.779477Z node 5 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3 sessionId:  is DEAD
Test retry state: get retry delay
2025-11-03T16:57:28.781511Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|22b3c6bc-352dccef-9be782a8-e4e0068_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: kqp error Marker# PQ50 : Response {   SessionId: "ydb://session/3?node_id=5&id=OTI4YTUzM2EtYWRjMTY4YmYtNTEzMWYzYzgtYzg3NWZhODA="   QueryIssues {     message: "Failed to resolve tablet: 72075186224037891 after several retries."     severity: 1   }   TxMeta {     id: "01k95ady5g051s0xgr1xxvet6c"   } } YdbStatus: UNAVAILABLE ConsumedRu: 4 , code: 500001 
2025-11-03T16:57:28.781567Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|22b3c6bc-352dccef-9be782a8-e4e0068_0] Write session will restart in 2.000000s
2025-11-03T16:57:28.781643Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|22b3c6bc-352dccef-9be782a8-e4e0068_0] Write session: Do CDS request
2025-11-03T16:57:28.781688Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|22b3c6bc-352dccef-9be782a8-e4e0068_0] Do schedule cds request after 2000 ms
2025-11-03T16:57:29.649570Z node 6 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976715663. Failed to resolve tablet: 72075186224037890 after several retries.
2025-11-03T16:57:29.649687Z node 6 :KQP_EXECUTER WARN: kqp_executer_impl.h:245: ActorId: [6:7568544334148125443:2398] TxId: 281474976715663. Ctx: { TraceId: 01k95ady7m3rtrxh7hnaysmnsc, Database: /Root, SessionId: ydb://session/3?node_id=6&id=ZDAyZmJmZS1lZGJkZWMzMS0xOTgzMjg5OS1iMDdjMzUzMQ==, PoolId: default}. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037890 after several retries.
2025-11-03T16:57:29.649933Z node 6 :KQP_SESSION WARN: kqp_session_actor.cpp:2987: SessionId: ydb://session/3?node_id=6&id=ZDAyZmJmZS1lZGJkZWMzMS0xOTgzMjg5OS1iMDdjMzUzMQ==, ActorId: [6:7568544334148125426:2398], ActorState: ExecuteState, TraceId: 01k95ady7m3rtrxh7hnaysmnsc, Create QueryResponse for error on request, msg: 
2025-11-03T16:57:29.651300Z node 6 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Failed to resolve tablet: 72075186224037890 after several retries." severity: 1 } TxMeta { id: "01k95adys8d12enx8e894xm88q" } } YdbStatus: UNAVAILABLE ConsumedRu: 360 }
2025-11-03T16:57:29.653266Z node 5 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976710681. Failed to resolve tablet: 72075186224037890 after several retries.
2025-11-03T16:57:29.653411Z node 5 :KQP_EXECUTER WARN: kqp_executer_impl.h:245: ActorId: [5:7568544331315451952:2504] TxId: 281474976710681. Ctx: { TraceId: 01k95ady6h5paz103d84vfwewh, Database: /Root, SessionId: ydb://session/3?node_id=5&id=Y2I5NTZjZGUtYWQ1YTgxNGQtMzdiODUwMjEtZTczN2Y3Y2U=, PoolId: default}. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037890 after several retries.
2025-11-03T16:57:29.653706Z node 5 :KQP_SESSION WARN: kqp_session_actor.cpp:2987: SessionId: ydb://session/3?node_id=5&id=Y2I5NTZjZGUtYWQ1YTgxNGQtMzdiODUwMjEtZTczN2Y3Y2U=, ActorId: [5:7568544331315451908:2504], ActorState: ExecuteState, TraceId: 01k95ady6h5paz103d84vfwewh, Create QueryResponse for error on request, msg: 
2025-11-03T16:57:29.655389Z node 5 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Failed to resolve tablet: 72075186224037890 after several retries." severity: 1 } TxMeta { id: "01k95adytgf5zrr6t7w5786854" } } YdbStatus: UNAVAILABLE ConsumedRu: 420 }
2025-11-03T16:57:29.684417Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|22b3c6bc-352dccef-9be782a8-e4e0068_0] Write 1 messages with Id from 1 to 1
====ExpectBreakDown
2025-11-03T16:57:30.784155Z :INFO: [/Root] MessageGroupId [test-message-group-id] Running cds request ms
2025-11-03T16:57:30.794669Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|22b3c6bc-352dccef-9be782a8-e4e0068_0] Got CDS response: 
write_sessions_clusters { clusters { endpoint: "localhost:6701" name: "dc1" available: true } primary_cluster_selection_reason: CLIENT_LOCATION } version: 1
2025-11-03T16:57:30.794739Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|22b3c6bc-352dccef-9be782a8-e4e0068_0] Start write session. Will connect to endpoint: localhost:6701
2025-11-03T16:57:30.799339Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|22b3c6bc-352dccef-9be782a8-e4e0068_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" }
2025-11-03T16:57:30.800991Z node 5 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-11-03T16:57:30.801027Z node 5 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 4
2025-11-03T16:57:30.809071Z node 5 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 4 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" }
2025-11-03T16:57:30.809301Z node 5 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 4 topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" from ipv6:[::1]:42160
2025-11-03T16:57:30.809321Z node 5 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=4 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:42160 proto=v1  topic=test-topic durationSec=0
2025-11-03T16:57:30.809333Z node 5 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-11-03T16:57:30.816328Z node 5 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 4 sessionId:  describe result for acl check
2025-11-03T16:57:30.816515Z node 5 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-11-03T16:57:30.816527Z node 5 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-11-03T16:57:30.816536Z node 5 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-11-03T16:57:30.816553Z node 5 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [5:7568544339905386662:2525] (SourceId=test-message-group-id, PreferedPartition=(NULL)) StartKqpSession
2025-11-03T16:57:30.821060Z node 5 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [5:7568544339905386662:2525] (SourceId=test-message-group-id, PreferedPartition=(NULL)) Select from the table
2025-11-03T16:57:31.849538Z node 5 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976710684. Failed to resolve tablet: 72075186224037891 after several retries.
2025-11-03T16:57:31.849661Z node 5 :KQP_EXECUTER WARN: kqp_executer_impl.h:245: ActorId: [5:7568544339905386674:2527] TxId: 281474976710684. Ctx: { TraceId: 01k95ae0y5dpqg1dzqj0r7dngg, Database: /Root, SessionId: ydb://session/3?node_id=5&id=MTRhMmJhMjQtYTFiMjllMDAtZDU1MWY3NmQtNWM0ZjEzMzY=, PoolId: default}. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037891 after several retries.
2025-11-03T16:57:31.849907Z node 5 :KQP_SESSION WARN: kqp_session_actor.cpp:2987: SessionId: ydb://session/3?node_id=5&id=MTRhMmJhMjQtYTFiMjllMDAtZDU1MWY3NmQtNWM0ZjEzMzY=, ActorId: [5:7568544339905386663:2527], ActorState: ExecuteState, TraceId: 01k95ae0y5dpqg1dzqj0r7dngg, Create QueryResponse for error on request, msg: 
2025-11-03T16:57:31.851560Z node 5 :PQ_PARTITION_CHOOSER INFO: partition_chooser_impl__abstract_chooser_actor.h:312: TPartitionChooser [5:7568544339905386662:2525] (SourceId=test-message-group-id, PreferedPartition=(NULL)) ReplyError: kqp error Marker# PQ50 : Response {
  SessionId: "ydb://session/3?node_id=5&id=MTRhMmJhMjQtYTFiMjllMDAtZDU1MWY3NmQtNWM0ZjEzMzY="
  QueryIssues {
    message: "Failed to resolve tablet: 72075186224037891 after several retries."
    severity: 1
  }
  TxMeta {
    id: "01k95ae0yc2wfs86965xbraq5a"
  }
}
YdbStatus: UNAVAILABLE
ConsumedRu: 1
2025-11-03T16:57:31.851654Z node 5 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 4 reason: kqp error Marker# PQ50 : Response {
  SessionId: "ydb://session/3?node_id=5&id=MTRhMmJhMjQtYTFiMjllMDAtZDU1MWY3NmQtNWM0ZjEzMzY="
  QueryIssues {
    message: "Failed to resolve tablet: 72075186224037891 after several retries."
    severity: 1
  }
  TxMeta {
    id: "01k95ae0yc2wfs86965xbraq5a"
  }
}
YdbStatus: UNAVAILABLE
ConsumedRu: 1
 sessionId: 
2025-11-03T16:57:31.852065Z node 5 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 4 sessionId:  is DEAD
Test retry state: get retry delay
2025-11-03T16:57:31.856341Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|22b3c6bc-352dccef-9be782a8-e4e0068_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: kqp error Marker# PQ50 : Response {   SessionId: "ydb://session/3?node_id=5&id=MTRhMmJhMjQtYTFiMjllMDAtZDU1MWY3NmQtNWM0ZjEzMzY="   QueryIssues {     message: "Failed to resolve tablet: 72075186224037891 after several retries."     severity: 1   }   TxMeta {     id: "01k95ae0yc2wfs86965xbraq5a"   } } YdbStatus: UNAVAILABLE ConsumedRu: 1 , code: 500001 
2025-11-03T16:57:31.856408Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|22b3c6bc-352dccef-9be782a8-e4e0068_0] Write session will restart in 2.000000s
2025-11-03T16:57:31.856528Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|22b3c6bc-352dccef-9be782a8-e4e0068_0] Write session: Do CDS request
2025-11-03T16:57:31.856581Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|22b3c6bc-352dccef-9be782a8-e4e0068_0] Do schedule cds request after 2000 ms
2025-11-03T16:57:32.215192Z node 6 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976715665. Failed to resolve tablet: 72075186224037888 after several retries.
2025-11-03T16:57:32.215311Z node 6 :KQP_EXECUTER WARN: kqp_executer_impl.h:245: ActorId: [6:7568544347033027412:2410] TxId: 281474976715665. Ctx: { TraceId: 01k95ae0s14g6m6z88q9gkh6tq, Database: /Root, SessionId: ydb://session/3?node_id=6&id=M2UwNzI4Zi0yYzUxMzNkYi05MmI2Y2E2My01Y2Q4NTI5NQ==, PoolId: default}. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037888 after several retries.
2025-11-03T16:57:32.215556Z node 6 :KQP_SESSION WARN: kqp_session_actor.cpp:2987: SessionId: ydb://session/3?node_id=6&id=M2UwNzI4Zi0yYzUxMzNkYi05MmI2Y2E2My01Y2Q4NTI5NQ==, ActorId: [6:7568544342738060102:2410], ActorState: ExecuteState, TraceId: 01k95ae0s14g6m6z88q9gkh6tq, Create QueryResponse for error on request, msg: 
2025-11-03T16:57:32.217171Z node 6 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Failed to resolve tablet: 72075186224037888 after several retries." severity: 1 } TxMeta { id: "01k95ae18wd5xjqgrr861f71dh" } } YdbStatus: UNAVAILABLE ConsumedRu: 328 }
2025-11-03T16:57:32.424961Z node 5 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976710685. Failed to resolve tablet: 72075186224037888 after several retries.
2025-11-03T16:57:32.425097Z node 5 :KQP_EXECUTER WARN: kqp_executer_impl.h:245: ActorId: [5:7568544344200354005:2518] TxId: 281474976710685. Ctx: { TraceId: 01k95ae0s34fhv4t8mnxxnsz71, Database: /Root, SessionId: ydb://session/3?node_id=5&id=OWU2MWY1MTgtMWQzNGQzNDMtYWJhOTJhYjctZTgzYTE1YmQ=, PoolId: default}. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037888 after several retries.
2025-11-03T16:57:32.425375Z node 5 :KQP_SESSION WARN: kqp_session_actor.cpp:2987: SessionId: ydb://session/3?node_id=5&id=OWU2MWY1MTgtMWQzNGQzNDMtYWJhOTJhYjctZTgzYTE1YmQ=, ActorId: [5:7568544339905386646:2518], ActorState: ExecuteState, TraceId: 01k95ae0s34fhv4t8mnxxnsz71, Create QueryResponse for error on request, msg: 
2025-11-03T16:57:32.428428Z node 5 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Failed to resolve tablet: 72075186224037888 after several retries." severity: 1 } TxMeta { id: "01k95ae1gr9q14kddn8g5rs0at" } } YdbStatus: UNAVAILABLE ConsumedRu: 484 }
2025-11-03T16:57:33.858036Z :INFO: [/Root] MessageGroupId [test-message-group-id] Running cds request ms
2025-11-03T16:57:33.869153Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|22b3c6bc-352dccef-9be782a8-e4e0068_0] Got CDS response: 
write_sessions_clusters { clusters { endpoint: "localhost:6701" name: "dc1" available: true } primary_cluster_selection_reason: CLIENT_LOCATION } version: 1
2025-11-03T16:57:33.869221Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|22b3c6bc-352dccef-9be782a8-e4e0068_0] Start write session. Will connect to endpoint: localhost:6701
2025-11-03T16:57:33.881339Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|22b3c6bc-352dccef-9be782a8-e4e0068_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" }
2025-11-03T16:57:33.884264Z node 5 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-11-03T16:57:33.884301Z node 5 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 5
2025-11-03T16:57:33.884920Z node 5 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 5 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" }
2025-11-03T16:57:33.885084Z node 5 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 5 topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" from ipv6:[::1]:42160
2025-11-03T16:57:33.885103Z node 5 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=5 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:42160 proto=v1  topic=test-topic durationSec=0
2025-11-03T16:57:33.885117Z node 5 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-11-03T16:57:33.886934Z node 5 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 5 sessionId:  describe result for acl check
2025-11-03T16:57:33.887103Z node 5 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-11-03T16:57:33.887116Z node 5 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-11-03T16:57:33.887127Z node 5 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-11-03T16:57:33.887147Z node 5 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [5:7568544352790288726:2545] (SourceId=test-message-group-id, PreferedPartition=(NULL)) StartKqpSession
2025-11-03T16:57:33.896047Z node 5 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [5:7568544352790288726:2545] (SourceId=test-message-group-id, PreferedPartition=(NULL)) Select from the table
2025-11-03T16:57:34.717300Z node 6 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976715667. Failed to resolve tablet: 72075186224037890 after several retries.
2025-11-03T16:57:34.717423Z node 6 :KQP_EXECUTER WARN: kqp_executer_impl.h:245: ActorId: [6:7568544355622962087:2420] TxId: 281474976715667. Ctx: { TraceId: 01k95ae3918t5ra8gfvk6ra87j, Database: /Root, SessionId: ydb://session/3?node_id=6&id=NmRiZmEwNDctOTkwOTFjZGEtYmZiYzNiNC02ZTQxNjQ1ZQ==, PoolId: default}. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037890 after several retries.
2025-11-03T16:57:34.717713Z node 6 :KQP_SESSION WARN: kqp_session_actor.cpp:2987: SessionId: ydb://session/3?node_id=6&id=NmRiZmEwNDctOTkwOTFjZGEtYmZiYzNiNC02ZTQxNjQ1ZQ==, ActorId: [6:7568544355622962070:2420], ActorState: ExecuteState, TraceId: 01k95ae3918t5ra8gfvk6ra87j, Create QueryResponse for error on request, msg: 
2025-11-03T16:57:34.719000Z node 6 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Failed to resolve tablet: 72075186224037890 after several retries." severity: 1 } TxMeta { id: "01k95ae3pw5w85zqze85pp8sy1" } } YdbStatus: UNAVAILABLE ConsumedRu: 288 }
2025-11-03T16:57:34.904748Z node 5 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976710688. Failed to resolve tablet: 72075186224037891 after several retries.
2025-11-03T16:57:34.904866Z node 5 :KQP_EXECUTER WARN: kqp_executer_impl.h:245: ActorId: [5:7568544352790288738:2547] TxId: 281474976710688. Ctx: { TraceId: 01k95ae3y88cve7a2yt05v579g, Database: /Root, SessionId: ydb://session/3?node_id=5&id=N2E1NTBjYTktOGE3MmVjNjItY2JmN2M0NmQtMTc4MzU3NDc=, PoolId: default}. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037891 after several retries.
Test retry state: get retry delay
2025-11-03T16:57:34.912288Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|22b3c6bc-352dccef-9be782a8-e4e0068_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: kqp error Marker# PQ50 : Response {   SessionId: "ydb://session/3?node_id=5&id=N2E1NTBjYTktOGE3MmVjNjItY2JmN2M0NmQtMTc4MzU3NDc="   QueryIssues {     message: "Failed to resolve tablet: 72075186224037891 after several retries."     severity: 1   }   TxMeta {     id: "01k95ae3yb3egwtb7g3btwyq23"   } } YdbStatus: UNAVAILABLE ConsumedRu: 1 , code: 500001 
2025-11-03T16:57:34.905107Z node 5 :KQP_SESSION WARN: kqp_session_actor.cpp:2987: SessionId: ydb://session/3?node_id=5&id=N2E1NTBjYTktOGE3MmVjNjItY2JmN2M0NmQtMTc4MzU3NDc=, ActorId: [5:7568544352790288727:2547], ActorState: ExecuteState, TraceId: 01k95ae3y88cve7a2yt05v579g, Create QueryResponse for error on request, msg: 
2025-11-03T16:57:34.912346Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|22b3c6bc-352dccef-9be782a8-e4e0068_0] Write session will restart in 2.000000s
2025-11-03T16:57:34.906477Z node 5 :PQ_PARTITION_CHOOSER INFO: partition_chooser_impl__abstract_chooser_actor.h:312: TPartitionChooser [5:7568544352790288726:2545] (SourceId=test-message-group-id, PreferedPartition=(NULL)) ReplyError: kqp error Marker# PQ50 : Response {
  SessionId: "ydb://session/3?node_id=5&id=N2E1NTBjYTktOGE3MmVjNjItY2JmN2M0NmQtMTc4MzU3NDc="
  QueryIssues {
    message: "Failed to resolve tablet: 72075186224037891 after several retries."
    severity: 1
  }
  TxMeta {
    id: "01k95ae3yb3egwtb7g3btwyq23"
  }
}
YdbStatus: UNAVAILABLE
ConsumedRu: 1
2025-11-03T16:57:34.906560Z node 5 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 5 reason: kqp error Marker# PQ50 : Response {
  SessionId: "ydb://session/3?node_id=5&id=N2E1NTBjYTktOGE3MmVjNjItY2JmN2M0NmQtMTc4MzU3NDc="
  QueryIssues {
    message: "Failed to resolve tablet: 72075186224037891 after several retries."
    severity: 1
  }
  TxMeta {
    id: "01k95ae3yb3egwtb7g3btwyq23"
  }
}
YdbStatus: UNAVAILABLE
ConsumedRu: 1
 sessionId: 
2025-11-03T16:57:34.912442Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|22b3c6bc-352dccef-9be782a8-e4e0068_0] Write session: Do CDS request
2025-11-03T16:57:34.906913Z node 5 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 5 sessionId:  is DEAD
2025-11-03T16:57:34.912489Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|22b3c6bc-352dccef-9be782a8-e4e0068_0] Do schedule cds request after 2000 ms
2025-11-03T16:57:34.919939Z node 5 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976710689. Failed to resolve tablet: 72075186224037890 after several retries.
2025-11-03T16:57:34.920071Z node 5 :KQP_EXECUTER WARN: kqp_executer_impl.h:245: ActorId: [5:7568544352790288744:2538] TxId: 281474976710689. Ctx: { TraceId: 01k95ae3fq505w1bt41dk1yjz2, Database: /Root, SessionId: ydb://session/3?node_id=5&id=ZjY4OTFkZDItN2Q1MzZmNDUtM2U2ZDFjOGQtNjdhYzM3YjY=, PoolId: default}. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037890 after several retries.
2025-11-03T16:57:34.920325Z node 5 :KQP_SESSION WARN: kqp_session_actor.cpp:2987: SessionId: ydb://session/3?node_id=5&id=ZjY4OTFkZDItN2Q1MzZmNDUtM2U2ZDFjOGQtNjdhYzM3YjY=, ActorId: [5:7568544352790288707:2538], ActorState: ExecuteState, TraceId: 01k95ae3fq505w1bt41dk1yjz2, Create QueryResponse for error on request, msg: 
2025-11-03T16:57:34.921579Z node 5 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Failed to resolve tablet: 72075186224037890 after several retries." severity: 1 } TxMeta { id: "01k95ae3z8dn3q74vtfamg13nf" } } YdbStatus: UNAVAILABLE ConsumedRu: 325 }
2025-11-03T16:57:36.915067Z :INFO: [/Root] MessageGroupId [test-message-group-id] Running cds request ms
2025-11-03T16:57:36.928111Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|22b3c6bc-352dccef-9be782a8-e4e0068_0] Got CDS response: 
write_sessions_clusters { clusters { endpoint: "localhost:6701" name: "dc1" available: true } primary_cluster_selection_reason: CLIENT_LOCATION } version: 1
2025-11-03T16:57:36.928182Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|22b3c6bc-352dccef-9be782a8-e4e0068_0] Start write session. Will connect to endpoint: localhost:6701
2025-11-03T16:57:36.936847Z node 5 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-11-03T16:57:36.936886Z node 5 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 6
2025-11-03T16:57:36.943624Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|22b3c6bc-352dccef-9be782a8-e4e0068_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" }
2025-11-03T16:57:36.944512Z node 5 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 6 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" }
2025-11-03T16:57:36.944714Z node 5 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 6 topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" from ipv6:[::1]:42160
2025-11-03T16:57:36.944738Z node 5 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=6 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:42160 proto=v1  topic=test-topic durationSec=0
2025-11-03T16:57:36.944751Z node 5 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-11-03T16:57:36.953549Z node 5 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 6 sessionId:  describe result for acl check
2025-11-03T16:57:36.953708Z node 5 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-11-03T16:57:36.953721Z node 5 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-11-03T16:57:36.953731Z node 5 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-11-03T16:57:36.953752Z node 5 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [5:7568544365675190816:2565] (SourceId=test-message-group-id, PreferedPartition=(NULL)) StartKqpSession
2025-11-03T16:57:36.958076Z node 5 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [5:7568544365675190816:2565] (SourceId=test-message-group-id, PreferedPartition=(NULL)) Select from the table
2025-11-03T16:57:37.320055Z node 6 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976715669. Failed to resolve tablet: 72075186224037888 after several retries.
2025-11-03T16:57:37.320187Z node 6 :KQP_EXECUTER WARN: kqp_executer_impl.h:245: ActorId: [6:7568544368507864055:2432] TxId: 281474976715669. Ctx: { TraceId: 01k95ae5q85g6ymye089c1b5eq, Database: /Root, SessionId: ydb://session/3?node_id=6&id=ZDZmOWNjMDgtODcwMzU4YWUtN2Q3M2I0NzAtZDI1ZDk2MjA=, PoolId: default}. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037888 after several retries.
2025-11-03T16:57:37.320481Z node 6 :KQP_SESSION WARN: kqp_session_actor.cpp:2987: SessionId: ydb://session/3?node_id=6&id=ZDZmOWNjMDgtODcwMzU4YWUtN2Q3M2I0NzAtZDI1ZDk2MjA=, ActorId: [6:7568544364212896745:2432], ActorState: ExecuteState, TraceId: 01k95ae5q85g6ymye089c1b5eq, Create QueryResponse for error on request, msg: 
2025-11-03T16:57:37.322026Z node 6 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Failed to resolve tablet: 72075186224037888 after several retries." severity: 1 } TxMeta { id: "01k95ae67tb5j8ew1emkfq194e" } } YdbStatus: UNAVAILABLE ConsumedRu: 301 }
2025-11-03T16:57:37.393529Z node 5 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976710692. Failed to resolve tablet: 72075186224037890 after several retries.
2025-11-03T16:57:37.393664Z node 5 :KQP_EXECUTER WARN: kqp_executer_impl.h:245: ActorId: [5:7568544365675190775:2555] TxId: 281474976710692. Ctx: { TraceId: 01k95ae5xq27171qx3scqywdca, Database: /Root, SessionId: ydb://session/3?node_id=5&id=ZmQwMTAyY2EtNDU5ZDMxOTctNzQ4ZDE3YzAtOGY5MTVlZDY=, PoolId: default}. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037890 after several retries.
2025-11-03T16:57:37.393925Z node 5 :KQP_SESSION WARN: kqp_session_actor.cpp:2987: SessionId: ydb://session/3?node_id=5&id=ZmQwMTAyY2EtNDU5ZDMxOTctNzQ4ZDE3YzAtOGY5MTVlZDY=, ActorId: [5:7568544361380223454:2555], ActorState: ExecuteState, TraceId: 01k95ae5xq27171qx3scqywdca, Create QueryResponse for error on request, msg: 
2025-11-03T16:57:37.395414Z node 5 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Failed to resolve tablet: 72075186224037890 after several retries." severity: 1 } TxMeta { id: "01k95ae6cgfhzhebkgn8zc5st6" } } YdbStatus: UNAVAILABLE ConsumedRu: 301 }
2025-11-03T16:57:37.976140Z node 5 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976710693. Failed to resolve tablet: 72075186224037891 after several retries.
2025-11-03T16:57:37.976259Z node 5 :KQP_EXECUTER WARN: kqp_executer_impl.h:245: ActorId: [5:7568544365675190827:2567] TxId: 281474976710693. Ctx: { TraceId: 01k95ae6xy9wdxq0nfyxdazgff, Database: /Root, SessionId: ydb://session/3?node_id=5&id=ZDJjMzZhMjctYWM2YjlmZTUtNzRmMTA1YTQtYmY1NjNjYTY=, PoolId: default}. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037891 after several retries.
2025-11-03T16:57:37.976479Z node 5 :KQP_SESSION WARN: kqp_session_actor.cpp:2987: SessionId: ydb://session/3?node_id=5&id=ZDJjMzZhMjctYWM2YjlmZTUtNzRmMTA1YTQtYmY1NjNjYTY=, ActorId: [5:7568544365675190817:2567], ActorState: ExecuteState, TraceId: 01k95ae6xy9wdxq0nfyxdazgff, Create QueryResponse for error on request, msg: 
Test retry state: get retry delay
2025-11-03T16:57:37.978048Z node 5 :PQ_PARTITION_CHOOSER INFO: partition_chooser_impl__abstract_chooser_actor.h:312: TPartitionChooser [5:7568544365675190816:2565] (SourceId=test-message-group-id, PreferedPartition=(NULL)) ReplyError: kqp error Marker# PQ50 : Response {
  SessionId: "ydb://session/3?node_id=5&id=ZDJjMzZhMjctYWM2YjlmZTUtNzRmMTA1YTQtYmY1NjNjYTY="
  QueryIssues {
    message: "Failed to resolve tablet: 72075186224037891 after several retries."
    severity: 1
  }
  TxMeta {
    id: "01k95ae6y0entv359rgcrbgfkp"
  }
}
YdbStatus: UNAVAILABLE
ConsumedRu: 1
2025-11-03T16:57:37.978135Z node 5 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 6 reason: kqp error Marker# PQ50 : Response {
  SessionId: "ydb://session/3?node_id=5&id=ZDJjMzZhMjctYWM2YjlmZTUtNzRmMTA1YTQtYmY1NjNjYTY="
  QueryIssues {
    message: "Failed to resolve tablet: 72075186224037891 after several retries."
    severity: 1
  }
  TxMeta {
    id: "01k95ae6y0entv359rgcrbgfkp"
  }
}
YdbStatus: UNAVAILABLE
ConsumedRu: 1
 sessionId: 
2025-11-03T16:57:37.978500Z node 5 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 6 sessionId:  is DEAD
2025-11-03T16:57:37.980294Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|22b3c6bc-352dccef-9be782a8-e4e0068_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: kqp error Marker# PQ50 : Response {   SessionId: "ydb://session/3?node_id=5&id=ZDJjMzZhMjctYWM2YjlmZTUtNzRmMTA1YTQtYmY1NjNjYTY="   QueryIssues {     message: "Failed to resolve tablet: 72075186224037891 after several retries."     severity: 1   }   TxMeta {     id: "01k95ae6y0entv359rgcrbgfkp"   } } YdbStatus: UNAVAILABLE ConsumedRu: 1 , code: 500001 
2025-11-03T16:57:37.980345Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|22b3c6bc-352dccef-9be782a8-e4e0068_0] Write session will restart in 2.000000s
2025-11-03T16:57:37.980440Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|22b3c6bc-352dccef-9be782a8-e4e0068_0] Write session: Do CDS request
2025-11-03T16:57:37.980494Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|22b3c6bc-352dccef-9be782a8-e4e0068_0] Do schedule cds request after 2000 ms
ReadyToAcceptEvent
2025-11-03T16:57:37.980686Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|22b3c6bc-352dccef-9be782a8-e4e0068_0] Write 1 messages with Id from 2 to 2
ReadyToAcceptEvent
2025-11-03T16:57:37.980764Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|22b3c6bc-352dccef-9be782a8-e4e0068_0] Write 1 messages with Id from 3 to 3
ReadyToAcceptEvent
2025-11-03T16:57:37.981344Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|22b3c6bc-352dccef-9be782a8-e4e0068_0] Write 1 messages with Id from 4 to 4
ReadyToAcceptEvent
2025-11-03T16:57:37.981392Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|22b3c6bc-352dccef-9be782a8-e4e0068_0] Write 1 messages with Id from 5 to 5
ReadyToAcceptEvent
2025-11-03T16:57:37.981428Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|22b3c6bc-352dccef-9be782a8-e4e0068_0] Write 1 messages with Id from 6 to 6
ReadyToAcceptEvent
2025-11-03T16:57:37.981461Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|22b3c6bc-352dccef-9be782a8-e4e0068_0] Write 1 messages with Id from 7 to 7
ReadyToAcceptEvent
2025-11-03T16:57:37.981489Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|22b3c6bc-352dccef-9be782a8-e4e0068_0] Write 1 messages with Id from 8 to 8
ReadyToAcceptEvent
2025-11-03T16:57:37.981516Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|22b3c6bc-352dccef-9be782a8-e4e0068_0] Write 1 messages with Id from 9 to 9
ReadyToAcceptEvent
2025-11-03T16:57:37.981550Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|22b3c6bc-352dccef-9be782a8-e4e0068_0] Write 1 messages with Id from 10 to 10
{"NodeId":5,"Down":false}
{"NodeId":6,"Down":false}
2025-11-03T16:57:38.079828Z node 5 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:140: [72075186224037893][rt3.dc1--test-topic] BALANCER INIT DONE for rt3.dc1--test-topic: (0, 72075186224037892) 
2025-11-03T16:57:38.083355Z node 5 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:971: [72075186224037893][rt3.dc1--test-topic] Discovered subdomain [OwnerId: 72057594046644480, LocalPathId: 1] state, outOfSpace = 0 at RB 72075186224037893
2025-11-03T16:57:38.103372Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2960: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-11-03T16:57:38.129093Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2992: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-11-03T16:57:38.130130Z node 5 :PERSQUEUE NOTICE: pq_impl.cpp:913: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-11-03T16:57:38.130153Z node 5 :PERSQUEUE INFO: pq_impl.cpp:599: [PQ: 72075186224037892] has a tx writes info
2025-11-03T16:57:38.130214Z node 5 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-11-03T16:57:38.130545Z node 5 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-11-03T16:57:38.130771Z node 5 :PERSQUEUE INFO: partition_init.cpp:1101: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [5:7568544374265125784:2575]
2025-11-03T16:57:38.134159Z node 5 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-11-03T16:57:38.137047Z node 5 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-11-03T16:57:38.137375Z node 5 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-11-03T16:57:38.139330Z node 5 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-11-03T16:57:38.139675Z node 5 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-11-03T16:57:38.139704Z node 5 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-11-03T16:57:38.139748Z node 5 :PERSQUEUE INFO: partition_init.cpp:968: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-11-03T16:57:38.139773Z node 5 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-11-03T16:57:38.139799Z node 5 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-11-03T16:57:38.139837Z node 5 :PERSQUEUE INFO: partition.cpp:707: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2 [5:7568544374265125784:2575]
2025-11-03T16:57:38.139879Z node 5 :PERSQUEUE DEBUG: partition.cpp:727: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 0 Head Offset 0 PartNo 0 PackedSize 0 count 0 nextOffset 0 batches 0
2025-11-03T16:57:38.139921Z node 5 :PERSQUEUE DEBUG: partition_mlp.cpp:83: [72075186224037892][Partition][0][StateIdle] Initializing MLP Consumers: 0
2025-11-03T16:57:38.139966Z node 5 :PERSQUEUE DEBUG: partition.cpp:4273: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-11-03T16:57:38.140418Z node 5 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:57:38.140455Z node 5 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:57:38.140477Z node 5 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:57:38.140547Z node 5 :PERSQUEUE DEBUG: partition_read.cpp:923: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-11-03T16:57:38.140599Z node 5 :PERSQUEUE DEBUG: partition_mlp.cpp:60: [72075186224037892][Partition][0][StateIdle] Process MLP pending events. Count 0
2025-11-03T16:57:38.140803Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:183: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:57:38.142143Z node 5 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:404: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 5, Generation 2
2025-11-03T16:57:38.142197Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [5:7568544374265125716:2572], now have 1 active actors on pipe
2025-11-03T16:57:38.240956Z node 5 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:57:38.240991Z node 5 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:57:38.241009Z node 5 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:57:38.344401Z node 5 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:57:38.344441Z node 5 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:57:38.344460Z node 5 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:57:38.450156Z node 5 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:57:38.450201Z node 5 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:57:38.450220Z node 5 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:57:38.551546Z node 5 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:57:38.551586Z node 5 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:57:38.551600Z node 5 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:57:38.650556Z node 5 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:57:38.650596Z node 5 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:57:38.650614Z node 5 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:57:38.755636Z node 5 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:57:38.755678Z node 5 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:57:38.755696Z node 5 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:57:38.856756Z node 5 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:57:38.856793Z node 5 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:57:38.856808Z node 5 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:57:38.957258Z node 5 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:57:38.957299Z node 5 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:57:38.957319Z node 5 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:57:39.058262Z node 5 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:57:39.058302Z node 5 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:57:39.058318Z node 5 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:57:39.160301Z node 5 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:57:39.160344Z node 5 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:57:39.160360Z node 5 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:57:39.263823Z node 5 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:57:39.263865Z node 5 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:57:39.263884Z node 5 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:57:39.363808Z node 5 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:57:39.363846Z node 5 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:57:39.363861Z node 5 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:57:39.465030Z node 5 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:57:39.465069Z node 5 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:57:39.465087Z node 5 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:57:39.569041Z node 5 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:57:39.569083Z node 5 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:57:39.569100Z node 5 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:57:39.669470Z node 5 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:57:39.669508Z node 5 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:57:39.669537Z node 5 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:57:39.769947Z node 5 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:57:39.769992Z node 5 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:57:39.770010Z node 5 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:57:39.872461Z node 5 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:57:39.872496Z node 5 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:57:39.872511Z node 5 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:57:39.973566Z node 5 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:57:39.973600Z node 5 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:57:39.973617Z node 5 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:57:39.985625Z :INFO: [/Root] MessageGroupId [test-message-group-id] Running cds request ms
2025-11-03T16:57:39.994408Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|22b3c6bc-352dccef-9be782a8-e4e0068_0] Got CDS response: 
write_sessions_clusters { clusters { endpoint: "localhost:6701" name: "dc1" available: true } primary_cluster_selection_reason: CLIENT_LOCATION } version: 1
2025-11-03T16:57:39.994474Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|22b3c6bc-352dccef-9be782a8-e4e0068_0] Start write session. Will connect to endpoint: localhost:6701
2025-11-03T16:57:39.998158Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|22b3c6bc-352dccef-9be782a8-e4e0068_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" }
2025-11-03T16:57:39.999106Z node 5 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-11-03T16:57:39.999139Z node 5 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 7
2025-11-03T16:57:39.999651Z node 5 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 7 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" }
2025-11-03T16:57:39.999793Z node 5 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 7 topic: "test-topic" message_group_id: "test-message-group-id" preferred_cluster: "dc1" from ipv6:[::1]:42160
2025-11-03T16:57:39.999812Z node 5 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=7 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:42160 proto=v1  topic=test-topic durationSec=0
2025-11-03T16:57:39.999823Z node 5 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-11-03T16:57:40.001453Z node 5 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 7 sessionId:  describe result for acl check
2025-11-03T16:57:40.001591Z node 5 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-11-03T16:57:40.001603Z node 5 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-11-03T16:57:40.001613Z node 5 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-11-03T16:57:40.001631Z node 5 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [5:7568544382855060520:2602] (SourceId=test-message-group-id, PreferedPartition=(NULL)) StartKqpSession
2025-11-03T16:57:40.004921Z node 5 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [5:7568544382855060520:2602] (SourceId=test-message-group-id, PreferedPartition=(NULL)) Select from the table
2025-11-03T16:57:40.015289Z node 5 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [5:7568544382855060520:2602] (SourceId=test-message-group-id, PreferedPartition=(NULL)) Update the table
2025-11-03T16:57:40.029206Z node 5 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [5:7568544382855060520:2602] (SourceId=test-message-group-id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-11-03T16:57:40.029249Z node 5 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [5:7568544382855060520:2602] (SourceId=test-message-group-id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-11-03T16:57:40.029269Z node 5 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [5:7568544382855060520:2602] (SourceId=test-message-group-id, PreferedPartition=(NULL)) Start idle
2025-11-03T16:57:40.029303Z node 5 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 7 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-11-03T16:57:40.030990Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 5, Generation: 2
2025-11-03T16:57:40.031044Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [5:7568544382855060554:2602], now have 1 active actors on pipe
2025-11-03T16:57:40.031233Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:57:40.031261Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:57:40.031346Z node 5 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie test-message-group-id|56f0d554-c9180a7c-e9555bfd-b6c66860_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner test-message-group-id
2025-11-03T16:57:40.031389Z node 5 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:57:40.031410Z node 5 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:57:40.031422Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-03T16:57:40.031463Z node 5 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:57:40.031505Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-03T16:57:40.031559Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-03T16:57:40.031974Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:57:40.032015Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:57:40.032085Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-03T16:57:40.032209Z node 5 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 7 partition: 0 MaxSeqNo: 0 sessionId: test-message-group-id|56f0d554-c9180a7c-e9555bfd-b6c66860_0
2025-11-03T16:57:40.033235Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|22b3c6bc-352dccef-9be782a8-e4e0068_0] Write session established. Init response: session_id: "test-message-group-id|56f0d554-c9180a7c-e9555bfd-b6c66860_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-11-03T16:57:40.033458Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|56f0d554-c9180a7c-e9555bfd-b6c66860_0] Write session: try to update token
2025-11-03T16:57:40.033496Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|56f0d554-c9180a7c-e9555bfd-b6c66860_0] Send 10 message(s) (0 left), first sequence number is 1
2025-11-03T16:57:40.034224Z node 5 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 7 sessionId: test-message-group-id|56f0d554-c9180a7c-e9555bfd-b6c66860_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-03T16:57:40.034650Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-03T16:57:40.038534Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:57:40.038577Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:57:40.038676Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-11-03T16:57:40.038789Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-11-03T16:57:40.039401Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-11-03T16:57:40.039423Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-11-03T16:57:40.039771Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0test-message-group-id' SeqNo: 1 partNo : 0 messageNo: 1 size 101 offset: -1
2025-11-03T16:57:40.039800Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0test-message-group-id' SeqNo: 2 partNo : 0 messageNo: 1 size 101 offset: -1
2025-11-03T16:57:40.039824Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0test-message-group-id' SeqNo: 3 partNo : 0 messageNo: 1 size 101 offset: -1
2025-11-03T16:57:40.039845Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0test-message-group-id' SeqNo: 4 partNo : 0 messageNo: 1 size 101 offset: -1
2025-11-03T16:57:40.039867Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0test-message-group-id' SeqNo: 5 partNo : 0 messageNo: 1 size 101 offset: -1
2025-11-03T16:57:40.039886Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0test-message-group-id' SeqNo: 6 partNo : 0 messageNo: 1 size 101 offset: -1
2025-11-03T16:57:40.039905Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0test-message-group-id' SeqNo: 7 partNo : 0 messageNo: 1 size 101 offset: -1
2025-11-03T16:57:40.039926Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0test-message-group-id' SeqNo: 8 partNo : 0 messageNo: 1 size 101 offset: -1
2025-11-03T16:57:40.039946Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0test-message-group-id' SeqNo: 9 partNo : 0 messageNo: 1 size 101 offset: -1
2025-11-03T16:57:40.039968Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0test-message-group-id' SeqNo: 10 partNo : 0 messageNo: 1 size 101 offset: -1
2025-11-03T16:57:40.040044Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-03T16:57:40.040141Z node 5 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:57:40.040195Z node 5 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:57:40.040207Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (10)
2025-11-03T16:57:40.040326Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0test-message-group-id' seqNo 1 partNo 0
2025-11-03T16:57:40.041279Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0test-message-group-id' seqNo 1 partNo 0 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 190 count 1 nextOffset 1 batches 1
2025-11-03T16:57:40.041348Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0test-message-group-id' seqNo 2 partNo 0
2025-11-03T16:57:40.041387Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0test-message-group-id' seqNo 2 partNo 0 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 348 count 2 nextOffset 2 batches 1
2025-11-03T16:57:40.041408Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0test-message-group-id' seqNo 3 partNo 0
2025-11-03T16:57:40.041434Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0test-message-group-id' seqNo 3 partNo 0 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 506 count 3 nextOffset 3 batches 1
2025-11-03T16:57:40.041456Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0test-message-group-id' seqNo 4 partNo 0
2025-11-03T16:57:40.041482Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0test-message-group-id' seqNo 4 partNo 0 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 664 count 4 nextOffset 4 batches 1
2025-11-03T16:57:40.041506Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0test-message-group-id' seqNo 5 partNo 0
2025-11-03T16:57:40.041531Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0test-message-group-id' seqNo 5 partNo 0 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 822 count 5 nextOffset 5 batches 1
2025-11-03T16:57:40.041554Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0test-message-group-id' seqNo 6 partNo 0
2025-11-03T16:57:40.041575Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0test-message-group-id' seqNo 6 partNo 0 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 980 count 6 nextOffset 6 batches 1
2025-11-03T16:57:40.041596Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0test-message-group-id' seqNo 7 partNo 0
2025-11-03T16:57:40.041617Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0test-message-group-id' seqNo 7 partNo 0 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 1138 count 7 nextOffset 7 batches 1
2025-11-03T16:57:40.041641Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0test-message-group-id' seqNo 8 partNo 0
2025-11-03T16:57:40.041664Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0test-message-group-id' seqNo 8 partNo 0 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 1296 count 8 nextOffset 8 batches 1
2025-11-03T16:57:40.041687Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0test-message-group-id' seqNo 9 partNo 0
2025-11-03T16:57:40.041712Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0test-message-group-id' seqNo 9 partNo 0 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 1454 count 9 nextOffset 9 batches 1
2025-11-03T16:57:40.041734Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0test-message-group-id' seqNo 10 partNo 0
2025-11-03T16:57:40.041758Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0test-message-group-id' seqNo 10 partNo 0 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 1612 count 10 nextOffset 10 batches 1
2025-11-03T16:57:40.041774Z node 5 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:57:40.042283Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 0,10 HeadOffset 0 endOffset 0 curOffset 10 d0000000000_00000000000000000000_00000_0000000010_00000? size 1208 WTime 1762189060038
2025-11-03T16:57:40.043645Z node 5 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-03T16:57:40.043857Z node 5 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 0 partNo 0 count 10 size 1208
2025-11-03T16:57:40.053363Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 0 count 10 size 1208 actorID [5:7568544374265125743:2575]
2025-11-03T16:57:40.053448Z node 5 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-03T16:57:40.053515Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1230 WriteNewSizeFromSupportivePartitions# 0
2025-11-03T16:57:40.053554Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:57:40.053600Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0test-message-group-id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 1, partNo: 0, Offset: 0 is stored on disk
2025-11-03T16:57:40.053626Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:57:40.053650Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0test-message-group-id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 2, partNo: 0, Offset: 1 is stored on disk
2025-11-03T16:57:40.053662Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:57:40.053685Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0test-message-group-id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 3, partNo: 0, Offset: 2 is stored on disk
2025-11-03T16:57:40.053699Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:57:40.053724Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0test-message-group-id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 4, partNo: 0, Offset: 3 is stored on disk
2025-11-03T16:57:40.053737Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:57:40.053758Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0test-message-group-id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 5, partNo: 0, Offset: 4 is stored on disk
2025-11-03T16:57:40.053771Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:57:40.053794Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0test-message-group-id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 6, partNo: 0, Offset: 5 is stored on disk
2025-11-03T16:57:40.053806Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:57:40.053828Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0test-message-group-id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 7, partNo: 0, Offset: 6 is stored on disk
2025-11-03T16:57:40.053841Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:57:40.053866Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0test-message-group-id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 8, partNo: 0, Offset: 7 is stored on disk
2025-11-03T16:57:40.053880Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:57:40.053902Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0test-message-group-id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 9, partNo: 0, Offset: 8 is stored on disk
2025-11-03T16:57:40.053914Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-03T16:57:40.053934Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0test-message-group-id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 10, partNo: 0, Offset: 9 is stored on disk
2025-11-03T16:57:40.054174Z node 5 :PERSQUEUE DEBUG: partition_read.cpp:923: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-11-03T16:57:40.054198Z node 5 :PERSQUEUE DEBUG: partition_read.cpp:965: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-11-03T16:57:40.054222Z node 5 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:57:40.054236Z node 5 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:57:40.054250Z node 5 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:57:40.054288Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-03T16:57:40.054437Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1  requestId: <none> cookie: 1
2025-11-03T16:57:40.054560Z node 5 :PERSQUEUE DEBUG: partition_read.cpp:880: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 partno 0 count 1 size 1024000 endOffset 10 max time lag 0ms effective offset 0
2025-11-03T16:57:40.054775Z node 5 :PERSQUEUE DEBUG: partition_read.cpp:1105: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 1208 count 10 last offset 0, current partition end offset: 10
2025-11-03T16:57:40.054794Z node 5 :PERSQUEUE DEBUG: partition_read.cpp:1121: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-11-03T16:57:40.054848Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 0 partno 0 count 10 parts_count 0 source 1 size 1208 accessed 0 times before, last time 2025-11-03T16:57:40.000000Z
2025-11-03T16:57:40.054874Z node 5 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 3. All 1 blobs are from cache.
2025-11-03T16:57:40.054875Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 10 parts 0 suffix '63' size 1208
2025-11-03T16:57:40.054924Z node 5 :PERSQUEUE DEBUG: partition_read.cpp:572: FormAnswer for 1 blobs
2025-11-03T16:57:40.054947Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 10 parts 0 suffix '63'
2025-11-03T16:57:40.055208Z node 5 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 0 totakecount 10 count 10 size 1188 from pos 0 cbcount 10
2025-11-03T16:57:40.055294Z node 5 :PERSQUEUE DEBUG: partition_read.cpp:1015: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1762189060038 queuesize 0 startOffset 0
2025-11-03T16:57:40.055402Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-11-03T16:57:40.056382Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|56f0d554-c9180a7c-e9555bfd-b6c66860_0] Write session got write response: sequence_numbers: 1 sequence_numbers: 2 sequence_numbers: 3 sequence_numbers: 4 sequence_numbers: 5 sequence_numbers: 6 sequence_numbers: 7 sequence_numbers: 8 sequence_numbers: 9 sequence_numbers: 10 offsets: 0 offsets: 1 offsets: 2 offsets: 3 offsets: 4 offsets: 5 offsets: 6 offsets: 7 offsets: 8 offsets: 9 already_written: false already_written: false already_written: false already_written: false already_written: false already_written: false already_written: false already_written: false already_written: false already_written: false write_statistics { persist_duration_ms: 15 }
2025-11-03T16:57:40.056433Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|56f0d554-c9180a7c-e9555bfd-b6c66860_0] Write session: acknoledged message 1
2025-11-03T16:57:40.056466Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|56f0d554-c9180a7c-e9555bfd-b6c66860_0] Write session: acknoledged message 2
2025-11-03T16:57:40.056498Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|56f0d554-c9180a7c-e9555bfd-b6c66860_0] Write session: acknoledged message 3
2025-11-03T16:57:40.056526Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|56f0d554-c9180a7c-e9555bfd-b6c66860_0] Write session: acknoledged message 4
2025-11-03T16:57:40.056551Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|56f0d554-c9180a7c-e9555bfd-b6c66860_0] Write session: acknoledged message 5
2025-11-03T16:57:40.056580Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|56f0d554-c9180a7c-e9555bfd-b6c66860_0] Write session: acknoledged message 6
2025-11-03T16:57:40.056602Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|56f0d554-c9180a7c-e9555bfd-b6c66860_0] Write session: acknoledged message 7
2025-11-03T16:57:40.056632Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|56f0d554-c9180a7c-e9555bfd-b6c66860_0] Write session: acknoledged message 8
2025-11-03T16:57:40.056661Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|56f0d554-c9180a7c-e9555bfd-b6c66860_0] Write session: acknoledged message 9
2025-11-03T16:57:40.056689Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|56f0d554-c9180a7c-e9555bfd-b6c66860_0] Write session: acknoledged message 10
2025-11-03T16:57:40.056965Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|56f0d554-c9180a7c-e9555bfd-b6c66860_0] Write session: close. Timeout = 0 ms
2025-11-03T16:57:40.057005Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|56f0d554-c9180a7c-e9555bfd-b6c66860_0] Write session will now close
2025-11-03T16:57:40.057074Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|56f0d554-c9180a7c-e9555bfd-b6c66860_0] Write session: aborting
2025-11-03T16:57:40.057467Z :INFO: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|56f0d554-c9180a7c-e9555bfd-b6c66860_0] Write session: gracefully shut down, all writes complete
2025-11-03T16:57:40.057509Z :DEBUG: [/Root] MessageGroupId [test-message-group-id] SessionId [test-message-group-id|56f0d554-c9180a7c-e9555bfd-b6c66860_0] Write session: destroy
2025-11-03T16:57:40.059482Z node 5 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 7 sessionId: test-message-group-id|56f0d554-c9180a7c-e9555bfd-b6c66860_0 grpc read done: success: 0 data: 
2025-11-03T16:57:40.059511Z node 5 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 7 sessionId: test-message-group-id|56f0d554-c9180a7c-e9555bfd-b6c66860_0 grpc read failed
2025-11-03T16:57:40.059548Z node 5 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 7 sessionId: test-message-group-id|56f0d554-c9180a7c-e9555bfd-b6c66860_0 grpc closed
2025-11-03T16:57:40.059566Z node 5 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 7 sessionId: test-message-group-id|56f0d554-c9180a7c-e9555bfd-b6c66860_0 is DEAD
2025-11-03T16:57:40.064219Z node 5 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-11-03T16:57:40.064428Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [5:7568544382855060554:2602] destroyed
2025-11-03T16:57:40.064465Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-11-03T16:57:40.064498Z node 5 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:57:40.064513Z node 5 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:57:40.064527Z node 5 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:57:40.076238Z node 5 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:57:40.076266Z node 5 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:57:40.076281Z node 5 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:57:40.177017Z node 5 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:57:40.177063Z node 5 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:57:40.177078Z node 5 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:57:40.278059Z node 5 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:57:40.278100Z node 5 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:57:40.278116Z node 5 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:57:40.378337Z node 5 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:57:40.378375Z node 5 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:57:40.378405Z node 5 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:57:40.478779Z node 5 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:57:40.478818Z node 5 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:57:40.478850Z node 5 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:57:40.579876Z node 5 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:57:40.579918Z node 5 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:57:40.579937Z node 5 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:57:40.685267Z node 5 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:57:40.685309Z node 5 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:57:40.685326Z node 5 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:57:40.785519Z node 5 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:57:40.785562Z node 5 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:57:40.785585Z node 5 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:57:40.888801Z node 5 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:57:40.888841Z node 5 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:57:40.888860Z node 5 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:57:40.992139Z node 5 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:57:40.992183Z node 5 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:57:40.992202Z node 5 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:57:41.095993Z node 5 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:57:41.096032Z node 5 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:57:41.096050Z node 5 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:57:41.196213Z node 5 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:57:41.196250Z node 5 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:57:41.196266Z node 5 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:57:41.300757Z node 5 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:57:41.300794Z node 5 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:57:41.300811Z node 5 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:57:41.404482Z node 5 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:57:41.404522Z node 5 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:57:41.404538Z node 5 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:57:41.508528Z node 5 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:57:41.508569Z node 5 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:57:41.508585Z node 5 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:57:41.608519Z node 5 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:57:41.608560Z node 5 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:57:41.608580Z node 5 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:57:41.712260Z node 5 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:57:41.712296Z node 5 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:57:41.712315Z node 5 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-03T16:57:41.816355Z node 5 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-03T16:57:41.816395Z node 5 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-03T16:57:41.816414Z node 5 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
