2025-11-26T18:41:46.303385Z node 12 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[12:7577106171478497376:2085];send_to=[0:7307199536658146131:7762515];
2025-11-26T18:41:46.303445Z node 12 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
2025-11-26T18:41:46.352354Z node 13 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[13:7577106168456596478:2085];send_to=[0:7307199536658146131:7762515];
2025-11-26T18:41:46.352507Z node 13 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
2025-11-26T18:41:46.354024Z node 12 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
test_client.cpp: SetPath # /home/runner/.ya/build/build_root/1ucl/00498c/r3tmp/tmpOFG037/pdisk_1.dat
2025-11-26T18:41:46.369669Z node 13 :BS_NODE WARN: {NWDC01@distconf.cpp:397} StateFunc too long Type# 268639238 Duration# 0.009920s
2025-11-26T18:41:46.383029Z node 12 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-11-26T18:41:46.398269Z node 13 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-11-26T18:41:46.401865Z node 13 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-11-26T18:41:46.589680Z node 12 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-11-26T18:41:46.612965Z node 12 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
2025-11-26T18:41:46.661113Z node 12 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(12, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-11-26T18:41:46.661241Z node 12 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(12, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-11-26T18:41:46.663172Z node 12 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(13, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-11-26T18:41:46.663295Z node 12 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(13, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-11-26T18:41:46.672875Z node 12 :HIVE WARN: hive_impl.cpp:811: HIVE#72057594037968897 Handle TEvInterconnect::TEvNodeConnected, NodeId 13 Cookie 13
2025-11-26T18:41:46.673186Z node 12 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(12, (0,0,0,0)) VolatileState: Connecting -> Connected
2025-11-26T18:41:46.677265Z node 12 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(13, (0,0,0,0)) VolatileState: Connecting -> Connected
TServer::EnableGrpc on GrpcPort 21251, node 12
2025-11-26T18:41:46.743810Z node 13 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-11-26T18:41:46.831588Z node 12 :NET_CLASSIFIER WARN: net_classifier.cpp:190: distributable config is empty, broken or outdated, will use file: /home/runner/.ya/build/build_root/1ucl/00498c/r3tmp/yandexhhUgpU.tmp
2025-11-26T18:41:46.831627Z node 12 :NET_CLASSIFIER WARN: net_classifier.cpp:196: will try to initialize from file: /home/runner/.ya/build/build_root/1ucl/00498c/r3tmp/yandexhhUgpU.tmp
2025-11-26T18:41:46.831817Z node 12 :NET_CLASSIFIER WARN: net_classifier.cpp:202: successfully initialized from file: /home/runner/.ya/build/build_root/1ucl/00498c/r3tmp/yandexhhUgpU.tmp
2025-11-26T18:41:46.832025Z node 12 :NET_CLASSIFIER ERROR: net_classifier.cpp:228: got bad distributable configuration
2025-11-26T18:41:46.888478Z INFO: TTestServer started on Port 4372 GrpcPort 21251
2025-11-26T18:41:47.008846Z node 12 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
TClient is connected to server localhost:4372
PQClient connected to localhost:21251
WaitRootIsUp 'Root'...
TClient::Ls request: Root
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "Root"
    PathId: 1
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 1
    CreateStep: 0
    ParentPathId: 1
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 1
      SubDomainVersion: 0
      SecurityStateVersion: 0
    }
    ChildrenExist: false
  }
  Children {
    Name: ".sys"
    PathId: 18446744073709551615
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 0
    CreateStep: 0
    ParentPathId: 18446744073709551615
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 0
      Pl...
(TRUNCATED)
WaitRootIsUp 'Root' success.
2025-11-26T18:41:47.219448Z node 12 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpAlterSubDomain, opId: 281474976715657:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_alter_subdomain.cpp:311)
waiting...
2025-11-26T18:41:47.333233Z node 12 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
waiting...
2025-11-26T18:41:47.381192Z node 12 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976715659:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:690)
2025-11-26T18:41:47.386216Z node 13 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
waiting...
waiting...
waiting...
2025-11-26T18:41:51.305637Z node 12 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[12:7577106171478497376:2085];send_to=[0:7307199536658146131:7762515];
2025-11-26T18:41:51.305747Z node 12 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
2025-11-26T18:41:51.353393Z node 13 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[13:7577106168456596478:2085];send_to=[0:7307199536658146131:7762515];
2025-11-26T18:41:51.353492Z node 13 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
2025-11-26T18:41:51.917088Z node 13 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:566: Compilation failed, self: [13:7577106189931433306:2298], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-11-26T18:41:51.933312Z node 13 :KQP_SESSION WARN: kqp_session_actor.cpp:2444: SessionId: ydb://session/3?node_id=13&id=YmFlMzYwYWEtMzI2ZjdmOGMtMWVlODExYTItOWNlMDFmODg=, ActorId: [13:7577106189931433304:2297], ActorState: ExecuteState, TraceId: 01kb0qhm7hb28dex4td76xy1zg, ReplyQueryCompileError, status: SCHEME_ERROR, issues: { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } }, remove tx with tx_id: 
2025-11-26T18:41:51.933962Z node 13 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-11-26T18:41:52.992172Z node 12 :KQP_PROXY ERROR: kqp_proxy_service.cpp:1327: TraceId: "01kb0qhg4t1j8gwqnwqwmbkzdb", Request deadline has expired for 0.318889s seconds
2025-11-26T18:41:53.038665Z node 13 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:566: Compilation failed, self: [13:7577106194226400630:2304], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-11-26T18:41:53.041805Z node 13 :KQP_SESSION WARN: kqp_session_actor.cpp:2444: SessionId: ydb://session/3?node_id=13&id=NTFhYjY0MzctNzc5MWUyMWQtZGIxYzUyNDQtYzAwOGE3MmM=, ActorId: [13:7577106194226400628:2303], ActorState: ExecuteState, TraceId: 01kb0qhn9d1an1cr0ve28vs03d, ReplyQueryCompileError, status: SCHEME_ERROR, issues: { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } }, remove tx with tx_id: 
2025-11-26T18:41:53.042271Z node 13 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-11-26T18:41:53.074191Z node 12 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:566: Compilation failed, self: [12:7577106197248302249:2329], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-11-26T18:41:53.078328Z node 12 :KQP_SESSION WARN: kqp_session_actor.cpp:2444: SessionId: ydb://session/3?node_id=12&id=NjUwM2RlOTUtNjJiNWVhYTYtYTQ1OWVhNzMtOGNiYmQyZDY=, ActorId: [12:7577106197248302246:2327], ActorState: ExecuteState, TraceId: 01kb0qhnb56fgzypbhdeyj60c0, ReplyQueryCompileError, status: SCHEME_ERROR, issues: { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } }, remove tx with tx_id: 
2025-11-26T18:41:53.078755Z node 12 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-11-26T18:41:53.087333Z node 12 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976715662:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:690)
2025-11-26T18:41:53.206194Z node 12 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976715663:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:690)
2025-11-26T18:41:53.413429Z node 12 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976715664:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:690)
=== Init DC: UPSERT INTO `/Root/PQ/Config/V2/Cluster` (name, balancer, local, enabled, weight) VALUES ("dc1", "localhost", true, true, 1000), ("dc2", "dc2.logbroker.yandex.net", false, true, 1000);
2025-11-26T18:41:53.921630Z node 12 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976715665. Ctx: { TraceId: 01kb0qhnxkaq1rp3x19casf00x, Database: , SessionId: ydb://session/3?node_id=12&id=Yjg5MmZlNGYtYTVmNDEwMTgtYzM1NDIyMDgtZDYzZGJhN2M=, PoolId: , DatabaseId: /Root}. Database not set, use /Root
=== CheckClustersList. Subcribe to ClusterTracker from [12:7577106201543269983:3040] 
2025-11-26T18:42:01.564033Z node 12 :FLAT_TX_SCHEMESHARD WARN: schemeshard_impl.cpp:7717: Cannot get console configs
2025-11-26T18:42:01.564078Z node 12 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
=== CheckClustersList. Ok
PQ Client: create topic: rt3.dc1--topic1 with 2 partitions
CallPersQueueGRPC request to localhost:21251
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--topic1"
  }
}
2025-11-26T18:42:02.167264Z node 12 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--topic1, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
CallPersQueueGRPC request to localhost:21251
MetaRequest {
  CmdCreateTopic {
    Topic: "rt3.dc1--topic1"
    NumPartitions: 2
    Config {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
  }
}
CallPersQueueGRPC response:
Status: 129
ProxyErrorCode: 53
SchemeStatus: 1
FlatTxId {
  TxId: 281474976715678
  SchemeShardTabletId: 72057594046644480
  PathId: 9
}
ErrorCode: OK
AddTopic: rt3.dc1--topic1
===Run query:``DECLARE $version as Int64; DECLARE $path AS Utf8; DECLARE $cluster as Utf8; UPSERT INTO `/Root/PQ/Config/V2/Topics` (path, dc) VALUES ($path, $cluster); UPSERT INTO `/Root/PQ/Config/V2/Versions` (name, version) VALUES ("Topics", $version);`` with topic = topic1, dc = dc1
2025-11-26T18:42:02.221533Z node 12 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][] pipe [12:7577106240197976177:3323] connected; active server actors: 1
2025-11-26T18:42:02.221837Z node 12 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1517: [72075186224037893][rt3.dc1--topic1] updating configuration. Deleted partitions []. Added partitions [1, 0]
2025-11-26T18:42:02.222510Z node 12 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:969: [72075186224037893][rt3.dc1--topic1] Discovered subdomain [OwnerId: 72057594046644480, LocalPathId: 1] state, outOfSpace = 0 at RB 72075186224037893
2025-11-26T18:42:02.222091Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2959: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-11-26T18:42:02.225742Z node 12 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:138: [72075186224037893][rt3.dc1--topic1] BALANCER INIT DONE for rt3.dc1--topic1: (0, 72075186224037892) (1, 72075186224037892) 
2025-11-26T18:42:02.229213Z node 12 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--topic1] TEvClientConnected TabletId 72075186224037892, NodeId 13, Generation 1
2025-11-26T18:42:02.227742Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2991: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-11-26T18:42:02.228144Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:785: [PQ: 72075186224037892] no config, start with empty partitions and default config
2025-11-26T18:42:02.228216Z node 13 :PERSQUEUE NOTICE: pq_impl.cpp:911: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-11-26T18:42:02.228276Z node 13 :PERSQUEUE INFO: pq_impl.cpp:612: [PQ: 72075186224037892] doesn't have tx writes info
2025-11-26T18:42:02.228972Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2720: [PQ: 72075186224037892] server connected, pipe [12:7577106240197976205:2453], now have 1 active actors on pipe
2025-11-26T18:42:02.229003Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2720: [PQ: 72075186224037892] server connected, pipe [12:7577106240197976176:3322], now have 1 active actors on pipe
2025-11-26T18:42:02.230426Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:3569: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-26T18:42:02.236223Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:1043: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-26T18:42:02.245584Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2720: [PQ: 72075186224037892] server connected, pipe [12:7577106240197976233:3368], now have 1 active actors on pipe
2025-11-26T18:42:02.249713Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:3569: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-26T18:42:02.261900Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:1043: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-26T18:42:02.263728Z node 13 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--topic1:1:Initializer] Start initializing step TInitConfigStep
2025-11-26T18:42:02.263783Z node 13 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--topic1:0:Initializer] Start initializing step TInitConfigStep
2025-11-26T18:42:02.263831Z node 13 :PERSQUEUE DEBUG: partition.cpp:1298: [72075186224037892][Partition][0][StateInit] HandleOnInit TEvPQ::TEvProposePartitionConfig
2025-11-26T18:42:02.263857Z node 13 :PERSQUEUE DEBUG: partition.cpp:1298: [72075186224037892][Partition][1][StateInit] HandleOnInit TEvPQ::TEvProposePartitionConfig
2025-11-26T18:42:02.264340Z node 13 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--topic1:1:Initializer] Start initializing step TInitInternalFieldsStep
2025-11-26T18:42:02.264637Z node 13 :PERSQUEUE INFO: partition_init.cpp:1106: [72075186224037892][Partition][1][StateInit] bootstrapping 1 [13:7577106237176073990:2391]
2025-11-26T18:42:02.270688Z node 13 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--topic1:1:Initializer] Start initializing step TInitFieldsStep
2025-11-26T18:42:02.271880Z node 13 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--topic1:1:Initializer] Initializing completed.
2025-11-26T18:42:02.271923Z node 13 :PERSQUEUE INFO: partition.cpp:695: [72075186224037892][Partition][1][StateInit] init complete for topic 'rt3.dc1--topic1' partition 1 generation 1 [13:7577106237176073990:2391]
2025-11-26T18:42:02.271963Z node 13 :PERSQUEUE DEBUG: partition.cpp:715: [72075186224037892][Partition][1][StateInit] SYNC INIT topic rt3.dc1--topic1 partitition 1 so 0 endOffset 0 Head Offset 0 PartNo 0 PackedSize 0 count 0 nextOffset 0 batches 0
2025-11-26T18:42:02.273845Z node 13 :PERSQUEUE DEBUG: partition.cpp:4392: [72075186224037892][Partition][1][StateIdle] Process pending events. Count 1
2025-11-26T18:42:02.273889Z node 13 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][1][StateIdle] Process user action and tx events
2025-11-26T18:42:02.273917Z node 13 :PERSQUEUE DEBUG: partition.cpp:2375: [72075186224037892][Partition][1][StateIdle] TPartition::ProcessUserActionAndTxEvent(TTransaction[ProposeConfig])
2025-11-26T18:42:02.273976Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][1][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-26T18:42:02.273993Z node 13 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][1][StateIdle] Process user action and tx pending commits
2025-11-26T18:42:02.274014Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][1][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-26T18:42:02.274029Z node 13 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][1][StateIdle] Try persist
2025-11-26T18:42:02.274063Z node 13 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][1][StateIdle] Process user action and tx events
2025-11-26T18:42:02.274080Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][1][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-26T18:42:02.274096Z node 13 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][1][StateIdle] Process user action and tx pending commits
2025-11-26T18:42:02.274115Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][1][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-26T18:42:02.274131Z node 13 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][1][StateIdle] Try persist
2025-11-26T18:42:02.274179Z node 13 :PERSQUEUE DEBUG: partition_read.cpp:915: [72075186224037892][Partition][1][StateIdle] Topic 'rt3.dc1--topic1' partition 1 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-11-26T18:42:02.274469Z node 13 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--topic1:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-11-26T18:42:02.274752Z node 13 :PERSQUEUE INFO: partition_init.cpp:1106: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [13:7577106237176073991:2391]
2025-11-26T18:42:02.287712Z node 13 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--topic1:0:Initializer] Start initializing step TInitFieldsStep
2025-11-26T18:42:02.287766Z node 13 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--topic1:0:Initializer] Initializing completed.
2025-11-26T18:42:02.287798Z node 13 :PERSQUEUE INFO: partition.cpp:695: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--topic1' partition 0 generation 1 [13:7577106237176073991:2391]
2025-11-26T18:42:02.287834Z node 13 :PERSQUEUE DEBUG: partition.cpp:715: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--topic1 partitition 0 so 0 endOffset 0 Head Offset 0 PartNo 0 PackedSize 0 count 0 nextOffset 0 batches 0
2025-11-26T18:42:02.292732Z node 13 :PERSQUEUE DEBUG: partition.cpp:4392: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 1
2025-11-26T18:42:02.292799Z node 13 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:42:02.292830Z node 13 :PERSQUEUE DEBUG: partition.cpp:2375: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TTransaction[ProposeConfig])
2025-11-26T18:42:02.292885Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-26T18:42:02.292901Z node 13 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:42:02.292932Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-26T18:42:02.292961Z node 13 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:42:02.293021Z node 13 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:42:02.293058Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-26T18:42:02.293087Z node 13 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:42:02.293122Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-26T18:42:02.293150Z node 13 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:42:02.293210Z node 13 :PERSQUEUE DEBUG: partition_read.cpp:915: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-11-26T18:42:02.293962Z node 13 :PERSQUEUE DEBUG: partition_compaction.cpp:183: [72075186224037892][Partition][1][StateIdle] No data for blobs compaction
2025-11-26T18:42:02.294405Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:3569: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-26T18:42:02.294580Z node 13 :PERSQUEUE DEBUG: partition_compaction.cpp:183: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-26T18:42:02.304112Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:1043: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-26T18:42:02.304309Z node 13 :PERSQUEUE DEBUG: partition.cpp:1403: [72075186224037892][Partition][0][StateIdle] Handle TEvPQ::TEvTxCommit Step 1764182522291, TxId 281474976715678
2025-11-26T18:42:02.304338Z node 13 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:42:02.304356Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-26T18:42:02.304372Z node 13 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:42:02.304440Z node 13 :PERSQUEUE DEBUG: partition.cpp:2439: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TTransaction[ProposeConfig])
2025-11-26T18:42:02.304598Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-26T18:42:02.304619Z node 13 :PERSQUEUE DEBUG: partition.cpp:2301: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-26T18:42:02.304644Z node 13 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:42:02.304916Z node 13 :PERSQUEUE DEBUG: partition.cpp:1403: [72075186224037892][Partition][1][StateIdle] Handle TEvPQ::TEvTxCommit Step 1764182522291, TxId 281474976715678
2025-11-26T18:42:02.304933Z node 13 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][1][StateIdle] Process user action and tx events
2025-11-26T18:42:02.304945Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][1][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-26T18:42:02.304956Z node 13 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][1][StateIdle] Process user action and tx pending commits
2025-11-26T18:42:02.304979Z node 13 :PERSQUEUE DEBUG: partition.cpp:2439: [72075186224037892][Partition][1][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TTransaction[ProposeConfig])
2025-11-26T18:42:02.305054Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][1][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-26T18:42:02.305065Z node 13 :PERSQUEUE DEBUG: partition.cpp:2301: [72075186224037892][Partition][1][StateIdle] Batch completed (1)
2025-11-26T18:42:02.305078Z node 13 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][1][StateIdle] Try persist
2025-11-26T18:42:02.305212Z node 13 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-26T18:42:02.305280Z node 13 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-26T18:42:02.311597Z node 13 :PERSQUEUE DEBUG: partition.cpp:2112: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-26T18:42:02.312097Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-11-26T18:42:02.312142Z node 13 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:42:02.312158Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:42:02.312174Z node 13 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:42:02.312192Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:42:02.312207Z node 13 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:42:02.312242Z node 13 :PERSQUEUE DEBUG: partition_compaction.cpp:183: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-26T18:42:02.312273Z node 13 :PERSQUEUE DEBUG: partition.cpp:2112: [72075186224037892][Partition][1][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-26T18:42:02.312593Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037892][Partition][1][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-11-26T18:42:02.312620Z node 13 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][1][StateIdle] Process user action and tx events
2025-11-26T18:42:02.312631Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][1][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:42:02.312640Z node 13 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][1][StateIdle] Process user action and tx pending commits
2025-11-26T18:42:02.312653Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][1][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:42:02.312662Z node 13 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][1][StateIdle] Try persist
2025-11-26T18:42:02.312676Z node 13 :PERSQUEUE DEBUG: partition_compaction.cpp:183: [72075186224037892][Partition][1][StateIdle] No data for blobs compaction
2025-11-26T18:42:02.313217Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:398: [PQ: 72075186224037892] Apply new config PartitionConfig { LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 2 SourceIdMaxCounts: 6000000 } PartitionIds: 1 PartitionIds: 0 TopicName: "rt3.dc1--topic1" Version: 0 LocalDC: true Codecs { Ids: 0 Ids: 1 Ids: 2 Codecs: "raw" Codecs: "gzip" Codecs: "lzop" } TopicPath: "/Root/PQ/rt3.dc1--topic1" YcCloudId: "" YcFolderId: "" YdbDatabaseId: "" YdbDatabasePath: "/Root" Partitions { PartitionId: 1 Status: Active CreateVersion: 1 TabletId: 0 } Partitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } AllPartitions { PartitionId: 1 Status: Active CreateVersion: 1 TabletId: 0 } AllPartitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } Consumers { Name: "user" ReadFromTimestampsMs: 0 FormatVersion: 0 Version: 0 Generation: 0 } MonitoringProjectId: ""
2025-11-26T18:42:02.313389Z node 13 :PERSQUEUE NOTICE: pq_impl.cpp:911: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-11-26T18:42:02.313812Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:3569: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-26T18:42:02.323414Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:1043: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-26T18:42:02.323575Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:3569: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-26T18:42:02.328040Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:1043: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-26T18:42:02.377440Z node 13 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][1][StateIdle] Process user action and tx events
2025-11-26T18:42:02.377474Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][1][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:42:02.377493Z node 13 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][1][StateIdle] Process user action and tx pending commits
2025-11-26T18:42:02.377526Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][1][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:42:02.377539Z node 13 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][1][StateIdle] Try persist
2025-11-26T18:42:02.395591Z node 13 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:42:02.395633Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:42:02.395648Z node 13 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:42:02.395671Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:42:02.395685Z node 13 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:42:02.420553Z node 12 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976715679. Ctx: { TraceId: 01kb0qhybkdw65wj4qv6mwcabv, Database: , SessionId: ydb://session/3?node_id=12&id=ZmQ3ZDRhMWUtNzMzYTBhNWQtNWMxNzBiNDgtOTZmOTAyZmQ=, PoolId: , DatabaseId: /Root}. Database not set, use /Root
===Query complete
TClient::Ls request: /Root/PQ/rt3.dc1--topic1
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--topic1"
    PathId: 9
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976715678
    CreateStep: 1764182522291
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--topic1"
    PathId: 9
    TotalGroupCount: 2
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
...
(TRUNCATED)
GetTopicVersionFromPath:  record Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--topic1"
    PathId: 9
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976715678
    CreateStep: 1764182522291
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--topic1"
    PathId: 9
    TotalGroupCount: 2
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      YdbDatabasePath: "/Root"
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
    Partitions {
      PartitionId: 0
      TabletId: 72075186224037892
      Status: Active
    }
    Partitions {
      PartitionId: 1
      TabletId: 72075186224037892
      Status: Active
    }
    AlterVersion: 1
    BalancerTabletID: 72075186224037893
    NextPartitionId: 2
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 1
      PlanResolution: 7
      Coordinators: 72057594046316545
      TimeCastBucketsPerMediator: 2
      Mediators: 72057594046382081
    }
    DomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    PathsInside: 8
    PathsLimit: 10000
    ShardsInside: 6
    ShardsLimit: 200000
    ResourcesDomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    DiskSpaceUsage {
      Tables {
        TotalSize: 0
        DataSize: 0
        IndexSize: 0
      }
      Topics {
        ReserveSize: 0
        AccountSize: 0
        DataSize: 0
        UsedReserveSize: 0
      }
    }
    PQPartitionsInside: 2
    PQPartitionsLimit: 1000000
    SchemeLimits {
      MaxDepth: 32
      MaxPaths: 10000
      MaxChildrenInDir: 100000
      MaxAclBytesSize: 10240
      MaxTableColumns: 200
      MaxTableColumnNameLength: 255
      MaxTableKeyColumns: 30
      MaxTableIndices: 20
      MaxShards: 200000
      MaxShardsInPath: 35000
      MaxConsistentCopyTargets: 10000
      MaxPathElementLength: 255
      ExtraPathSymbolsAllowed: "!\"#$%&\'()*+,-.:;<=>?@[\\]^_`{|}~"
      MaxPQPartitions: 1000000
      MaxTableCdcStreams: 5
      MaxExports: 10
      MaxImports: 10
      MaxColumnTableColumns: 10000
    }
  }
}
Path: "/Root/PQ/rt3.dc1--topic1"
 name rt3.dc1--topic1 version1
CallPersQueueGRPC request to localhost:21251
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--topic1"
  }
}
2025-11-26T18:42:02.465530Z node 12 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--topic1, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
2025-11-26T18:42:02.476988Z node 13 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][1][StateIdle] Process user action and tx events
2025-11-26T18:42:02.477028Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][1][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:42:02.477046Z node 13 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][1][StateIdle] Process user action and tx pending commits
2025-11-26T18:42:02.477074Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][1][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:42:02.477089Z node 13 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][1][StateIdle] Try persist
2025-11-26T18:42:02.495906Z node 13 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:42:02.495951Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:42:02.495967Z node 13 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:42:02.495996Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:42:02.496024Z node 13 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:42:02.581550Z node 13 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][1][StateIdle] Process user action and tx events
2025-11-26T18:42:02.581591Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][1][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:42:02.581611Z node 13 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][1][StateIdle] Process user action and tx pending commits
2025-11-26T18:42:02.581637Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][1][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:42:02.581652Z node 13 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][1][StateIdle] Try persist
2025-11-26T18:42:02.596704Z node 13 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:42:02.596741Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:42:02.596758Z node 13 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:42:02.596785Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:42:02.596807Z node 13 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:42:02.680688Z node 13 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][1][StateIdle] Process user action and tx events
2025-11-26T18:42:02.680726Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][1][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:42:02.680741Z node 13 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][1][StateIdle] Process user action and tx pending commits
2025-11-26T18:42:02.680768Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][1][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:42:02.680782Z node 13 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][1][StateIdle] Try persist
2025-11-26T18:42:02.699904Z node 13 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:42:02.699941Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:42:02.699958Z node 13 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:42:02.699984Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:42:02.700010Z node 13 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:42:02.781618Z node 13 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][1][StateIdle] Process user action and tx events
2025-11-26T18:42:02.781658Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][1][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:42:02.781675Z node 13 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][1][StateIdle] Process user action and tx pending commits
2025-11-26T18:42:02.781702Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][1][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:42:02.781718Z node 13 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][1][StateIdle] Try persist
2025-11-26T18:42:02.801357Z node 13 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:42:02.801400Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:42:02.801416Z node 13 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:42:02.801443Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:42:02.801457Z node 13 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:42:02.881859Z node 13 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][1][StateIdle] Process user action and tx events
2025-11-26T18:42:02.881904Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][1][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:42:02.881921Z node 13 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][1][StateIdle] Process user action and tx pending commits
2025-11-26T18:42:02.881950Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][1][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:42:02.881964Z node 13 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][1][StateIdle] Try persist
2025-11-26T18:42:02.901637Z node 13 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:42:02.901680Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:42:02.901696Z node 13 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:42:02.901722Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:42:02.901737Z node 13 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
CallPersQueueGRPC request to localhost:21251
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--topic1"
  }
}
2025-11-26T18:42:02.969821Z node 12 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--topic1, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
2025-11-26T18:42:02.982987Z node 13 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][1][StateIdle] Process user action and tx events
2025-11-26T18:42:02.983021Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][1][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:42:02.983037Z node 13 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][1][StateIdle] Process user action and tx pending commits
2025-11-26T18:42:02.983064Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][1][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:42:02.983079Z node 13 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][1][StateIdle] Try persist
2025-11-26T18:42:03.005719Z node 13 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:42:03.005764Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:42:03.005780Z node 13 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:42:03.005806Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:42:03.005821Z node 13 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:42:03.084123Z node 13 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][1][StateIdle] Process user action and tx events
2025-11-26T18:42:03.084160Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][1][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:42:03.084174Z node 13 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][1][StateIdle] Process user action and tx pending commits
2025-11-26T18:42:03.084196Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][1][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:42:03.084207Z node 13 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][1][StateIdle] Try persist
2025-11-26T18:42:03.112252Z node 13 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:42:03.112294Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:42:03.112307Z node 13 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:42:03.112329Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:42:03.112343Z node 13 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:42:03.185240Z node 13 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][1][StateIdle] Process user action and tx events
2025-11-26T18:42:03.185296Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][1][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:42:03.185311Z node 13 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][1][StateIdle] Process user action and tx pending commits
2025-11-26T18:42:03.185336Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][1][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:42:03.185351Z node 13 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][1][StateIdle] Try persist
2025-11-26T18:42:03.213362Z node 13 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:42:03.213400Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:42:03.213416Z node 13 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:42:03.213439Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:42:03.213451Z node 13 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:42:03.285874Z node 13 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][1][StateIdle] Process user action and tx events
2025-11-26T18:42:03.285913Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][1][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:42:03.285929Z node 13 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][1][StateIdle] Process user action and tx pending commits
2025-11-26T18:42:03.285951Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][1][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:42:03.285965Z node 13 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][1][StateIdle] Try persist
2025-11-26T18:42:03.314975Z node 13 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:42:03.315014Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:42:03.315038Z node 13 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:42:03.315061Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:42:03.315075Z node 13 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:42:03.386574Z node 13 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][1][StateIdle] Process user action and tx events
2025-11-26T18:42:03.386611Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][1][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:42:03.386625Z node 13 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][1][StateIdle] Process user action and tx pending commits
2025-11-26T18:42:03.386649Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][1][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:42:03.386662Z node 13 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][1][StateIdle] Try persist
2025-11-26T18:42:03.421412Z node 13 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:42:03.421461Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:42:03.421476Z node 13 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:42:03.421499Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:42:03.421511Z node 13 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
CallPersQueueGRPC request to localhost:21251
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--topic1"
  }
}
2025-11-26T18:42:03.486563Z node 13 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][1][StateIdle] Process user action and tx events
2025-11-26T18:42:03.486597Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][1][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:42:03.486611Z node 13 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][1][StateIdle] Process user action and tx pending commits
2025-11-26T18:42:03.486632Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][1][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:42:03.486644Z node 13 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][1][StateIdle] Try persist
2025-11-26T18:42:03.488397Z node 12 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
MetaResponse {
  CmdGetTopicMetadataResult {
    TopicInfo {
      Topic: "rt3.dc1--topic1"
      NumPartitions: 2
      Config {
        PartitionConfig {
          LifetimeSeconds: 86400
          LowWatermark: 8388608
          SourceIdLifetimeSeconds: 86400
          WriteSpeedInBytesPerSecond: 20000000
          BurstSize: 20000000
          SourceIdMaxCounts: 6000000
        }
        Version: 1
        LocalDC: true
        Codecs {
          Ids: 0
          Ids: 1
          Ids: 2
          Codecs: "raw"
          Codecs: "gzip"
          Codecs: "lzop"
        }
        TopicPath: "/Root/PQ/rt3.dc1--topic1"
        YdbDatabasePath: "/Root"
        Consumers {
          Name: "user"
          ReadFromTimestampsMs: 0
          FormatVersion: 0
          Version: 0
        }
      }
      ErrorCode: OK
    }
  }
}
=== Topic created, have version: 1
2025-11-26T18:42:03.498882Z :INFO: [] [] [3430877a-9305be47-dcd0f077-4a6fb492] Starting read session
2025-11-26T18:42:03.498949Z :DEBUG: [] [] [3430877a-9305be47-dcd0f077-4a6fb492] Starting session to cluster null (localhost:21251)
2025-11-26T18:42:03.503972Z :DEBUG: [] [] [3430877a-9305be47-dcd0f077-4a6fb492] [null] In Reconnect, ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-26T18:42:03.504039Z :DEBUG: [] [] [3430877a-9305be47-dcd0f077-4a6fb492] [null] New values: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-26T18:42:03.504116Z :DEBUG: [] [] [3430877a-9305be47-dcd0f077-4a6fb492] [null] Reconnecting session to cluster null in 0.000000s
===== CreateReader =====
MessagesInflight: 0
BytesInflightUncompressed: 0
BytesInflightCompressed: 0
BytesInflightTotal: 0
============
2025-11-26T18:42:03.507996Z :DEBUG: [] [] [3430877a-9305be47-dcd0f077-4a6fb492] [null] Successfully connected. Initializing session
2025-11-26T18:42:03.508561Z node 12 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:109: new grpc connection
2025-11-26T18:42:03.508582Z node 12 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:131: new session created cookie 1
2025-11-26T18:42:03.509003Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { topic: "topic1" } read_only_original: true consumer: "shared/user" read_params { max_read_size: 104857600 } } }
2025-11-26T18:42:03.509242Z node 12 :PQ_READ_PROXY INFO: read_session_actor.cpp:941: session cookie 1 consumer shared/user session shared/user_12_1_1519369155454581669_v1 read init: from# ipv6:[::1]:40008, request# { init_request { topics_read_settings { topic: "topic1" } read_only_original: true consumer: "shared/user" read_params { max_read_size: 104857600 } } }
2025-11-26T18:42:03.509739Z node 12 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 1 consumer shared/user session shared/user_12_1_1519369155454581669_v1 auth for : user
2025-11-26T18:42:03.510356Z node 12 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 1 consumer shared/user session shared/user_12_1_1519369155454581669_v1 Handle describe topics response
2025-11-26T18:42:03.510484Z node 12 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 1 consumer shared/user session shared/user_12_1_1519369155454581669_v1 auth is DEAD
2025-11-26T18:42:03.510554Z node 12 :PQ_READ_PROXY INFO: read_session_actor.cpp:1058: session cookie 1 consumer shared/user session shared/user_12_1_1519369155454581669_v1 auth ok: topics# 1, initDone# 0
2025-11-26T18:42:03.511364Z node 12 :PQ_READ_PROXY INFO: read_session_actor.cpp:1229: session cookie 1 consumer shared/user session shared/user_12_1_1519369155454581669_v1 register session: topic# rt3.dc1--topic1
2025-11-26T18:42:03.511666Z :INFO: [] [] [3430877a-9305be47-dcd0f077-4a6fb492] [null] Server session id: shared/user_12_1_1519369155454581669_v1
2025-11-26T18:42:03.511684Z node 12 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--topic1] pipe [12:7577106244492943693:2483] connected; active server actors: 1
2025-11-26T18:42:03.511732Z node 12 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--topic1] consumer "user" register session for pipe [12:7577106244492943693:2483] session shared/user_12_1_1519369155454581669_v1
2025-11-26T18:42:03.511778Z node 12 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--topic1] consumer user register readable partition 0
2025-11-26T18:42:03.511841Z node 12 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--topic1] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-11-26T18:42:03.511856Z node 12 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--topic1] consumer user register readable partition 1
2025-11-26T18:42:03.511875Z node 12 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--topic1] consumer user family created family=2 (Status=Free, Partitions=[1])
2025-11-26T18:42:03.511918Z node 12 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--topic1] consumer user register reading session ReadingSession "shared/user_12_1_1519369155454581669_v1" (Sender=[12:7577106244492943690:2483], Pipe=[12:7577106244492943693:2483], Partitions=[], ActiveFamilyCount=0)
2025-11-26T18:42:03.511946Z :DEBUG: [] [] [3430877a-9305be47-dcd0f077-4a6fb492] [null] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-26T18:42:03.511954Z node 12 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--topic1] consumer user rebalancing was scheduled
2025-11-26T18:42:03.512042Z node 12 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--topic1] consumer user balancing. Sessions=1, Families=2, UnradableFamilies=2 [2 (1), 1 (0), ], RequireBalancing=0 []
2025-11-26T18:42:03.512117Z node 12 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--topic1] consumer user balancing family=2 (Status=Free, Partitions=[1]) for ReadingSession "shared/user_12_1_1519369155454581669_v1" (Sender=[12:7577106244492943690:2483], Pipe=[12:7577106244492943693:2483], Partitions=[], ActiveFamilyCount=0)
2025-11-26T18:42:03.512181Z node 12 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--topic1] consumer user family 2 status Active partitions [1] session "shared/user_12_1_1519369155454581669_v1" sender [12:7577106244492943690:2483] lock partition 1 for ReadingSession "shared/user_12_1_1519369155454581669_v1" (Sender=[12:7577106244492943690:2483], Pipe=[12:7577106244492943693:2483], Partitions=[], ActiveFamilyCount=1) generation 1 step 1
2025-11-26T18:42:03.512226Z node 12 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--topic1] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_12_1_1519369155454581669_v1" (Sender=[12:7577106244492943690:2483], Pipe=[12:7577106244492943693:2483], Partitions=[], ActiveFamilyCount=1)
2025-11-26T18:42:03.512267Z node 12 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--topic1] consumer user family 1 status Active partitions [0] session "shared/user_12_1_1519369155454581669_v1" sender [12:7577106244492943690:2483] lock partition 0 for ReadingSession "shared/user_12_1_1519369155454581669_v1" (Sender=[12:7577106244492943690:2483], Pipe=[12:7577106244492943693:2483], Partitions=[], ActiveFamilyCount=2) generation 1 step 2
2025-11-26T18:42:03.512315Z node 12 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--topic1] consumer user start rebalancing. familyCount=2, sessionCount=1, desiredFamilyCount=2, allowPlusOne=0
2025-11-26T18:42:03.512371Z node 12 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--topic1] consumer user balancing duration: 0.000288s
2025-11-26T18:42:03.512439Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_12_1_1519369155454581669_v1 grpc read done: success# 1, data# { read { } }
2025-11-26T18:42:03.513220Z node 12 :PQ_READ_PROXY INFO: read_session_actor.cpp:1347: session cookie 1 consumer shared/user session shared/user_12_1_1519369155454581669_v1 assign: record# { Partition: 1 TabletId: 72075186224037892 Topic: "rt3.dc1--topic1" Generation: 1 Step: 1 Session: "shared/user_12_1_1519369155454581669_v1" ClientId: "user" PipeClient { RawX1: 7577106244492943693 RawX2: 4503651166980531 } Path: "/Root/PQ/rt3.dc1--topic1" }
2025-11-26T18:42:03.513359Z node 12 :PQ_READ_PROXY INFO: read_session_actor.cpp:1347: session cookie 1 consumer shared/user session shared/user_12_1_1519369155454581669_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--topic1" Generation: 1 Step: 2 Session: "shared/user_12_1_1519369155454581669_v1" ClientId: "user" PipeClient { RawX1: 7577106244492943693 RawX2: 4503651166980531 } Path: "/Root/PQ/rt3.dc1--topic1" }
2025-11-26T18:42:03.513482Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1850: session cookie 1 consumer shared/user session shared/user_12_1_1519369155454581669_v1 got read request: guid# 47c909db-c5755f01-4f5976fd-b28054de
2025-11-26T18:42:03.513574Z node 12 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 1 consumer shared/user session shared/user_12_1_1519369155454581669_v1 INITING TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 1(assignId:1)
2025-11-26T18:42:03.513666Z node 12 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 1 consumer shared/user session shared/user_12_1_1519369155454581669_v1 INITING TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:2)
2025-11-26T18:42:03.514211Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2720: [PQ: 72075186224037892] server connected, pipe [12:7577106244492943697:2486], now have 1 active actors on pipe
2025-11-26T18:42:03.514253Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2720: [PQ: 72075186224037892] server connected, pipe [12:7577106244492943698:2487], now have 1 active actors on pipe
2025-11-26T18:42:03.514355Z node 12 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_12_1_1519369155454581669_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 1(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 1, pipe: [12:7577106244492943697:2486]
2025-11-26T18:42:03.514445Z node 12 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_12_1_1519369155454581669_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:2) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 1, pipe: [12:7577106244492943698:2487]
2025-11-26T18:42:03.514534Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-26T18:42:03.514582Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 1
2025-11-26T18:42:03.514625Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:1746: [PQ: 72075186224037892] Created session shared/user_12_1_1519369155454581669_v1 on pipe: [12:7577106244492943697:2486]
2025-11-26T18:42:03.514731Z node 13 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][1][StateIdle] Process user action and tx events
2025-11-26T18:42:03.514746Z node 13 :PERSQUEUE DEBUG: partition.cpp:2368: [72075186224037892][Partition][1][StateIdle] TPartition::ProcessUserActionAndTxEvent(TEvPQ::TEvSetClientInfo)
2025-11-26T18:42:03.514771Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][1][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-26T18:42:03.514785Z node 13 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][1][StateIdle] Process user action and tx pending commits
2025-11-26T18:42:03.514809Z node 13 :PERSQUEUE DEBUG: partition.cpp:2432: [72075186224037892][Partition][1][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TEvPQ::TEvSetClientInfo)
2025-11-26T18:42:03.514917Z node 13 :PERSQUEUE DEBUG: partition.cpp:3786: [72075186224037892][Partition][1][StateIdle] Topic 'rt3.dc1--topic1' partition 1 user user session is set to 0 (startOffset 0) session shared/user_12_1_1519369155454581669_v1
2025-11-26T18:42:03.514932Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][1][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-26T18:42:03.514948Z node 13 :PERSQUEUE DEBUG: partition.cpp:2301: [72075186224037892][Partition][1][StateIdle] Batch completed (1)
2025-11-26T18:42:03.514963Z node 13 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][1][StateIdle] Try persist
2025-11-26T18:42:03.515113Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-26T18:42:03.515128Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-26T18:42:03.515149Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:1746: [PQ: 72075186224037892] Created session shared/user_12_1_1519369155454581669_v1 on pipe: [12:7577106244492943698:2487]
2025-11-26T18:42:03.515178Z node 13 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-26T18:42:03.515210Z node 13 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:42:03.515218Z node 13 :PERSQUEUE DEBUG: partition.cpp:2368: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TEvPQ::TEvSetClientInfo)
2025-11-26T18:42:03.515232Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-26T18:42:03.515238Z node 13 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:42:03.515249Z node 13 :PERSQUEUE DEBUG: partition.cpp:2432: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TEvPQ::TEvSetClientInfo)
2025-11-26T18:42:03.515274Z node 13 :PERSQUEUE DEBUG: partition.cpp:3786: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 user user session is set to 0 (startOffset 0) session shared/user_12_1_1519369155454581669_v1
2025-11-26T18:42:03.515282Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-26T18:42:03.515289Z node 13 :PERSQUEUE DEBUG: partition.cpp:2301: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-26T18:42:03.515296Z node 13 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:42:03.515464Z node 13 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-26T18:42:03.515988Z node 13 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_12_1_1519369155454581669_v1:1 with generation 1
2025-11-26T18:42:03.516037Z node 13 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_12_1_1519369155454581669_v1:2 with generation 1
2025-11-26T18:42:03.521378Z node 13 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Writing. Can't process user action and tx events
2025-11-26T18:42:03.527835Z node 13 :PERSQUEUE DEBUG: partition.cpp:2112: [72075186224037892][Partition][1][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-26T18:42:03.527985Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037892][Partition][1][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-11-26T18:42:03.528016Z node 13 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][1][StateIdle] Process user action and tx events
2025-11-26T18:42:03.528034Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][1][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:42:03.528049Z node 13 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][1][StateIdle] Process user action and tx pending commits
2025-11-26T18:42:03.528068Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][1][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:42:03.528084Z node 13 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][1][StateIdle] Try persist
2025-11-26T18:42:03.528112Z node 13 :PERSQUEUE DEBUG: partition_compaction.cpp:183: [72075186224037892][Partition][1][StateIdle] No data for blobs compaction
2025-11-26T18:42:03.528144Z node 13 :PERSQUEUE DEBUG: partition.cpp:2112: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-26T18:42:03.528202Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-11-26T18:42:03.528224Z node 13 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:42:03.528236Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:42:03.528246Z node 13 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:42:03.528260Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:42:03.528270Z node 13 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:42:03.528285Z node 13 :PERSQUEUE DEBUG: partition_compaction.cpp:183: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-26T18:42:03.528345Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 1 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-11-26T18:42:03.528727Z node 12 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_12_1_1519369155454581669_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 1(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 0 SizeLag: 0 WriteTimestampEstimateMS: 1764182523486 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-11-26T18:42:03.528789Z node 12 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 1 consumer shared/user session shared/user_12_1_1519369155454581669_v1 INIT DONE TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 1(assignId:1) EndOffset 0 readOffset 0 committedOffset 0
2025-11-26T18:42:03.528880Z node 12 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_12_1_1519369155454581669_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:2) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 0 SizeLag: 0 WriteTimestampEstimateMS: 1764182523421 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-11-26T18:42:03.528902Z node 12 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 1 consumer shared/user session shared/user_12_1_1519369155454581669_v1 INIT DONE TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:2) EndOffset 0 readOffset 0 committedOffset 0
2025-11-26T18:42:03.528949Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1446: session cookie 1 consumer shared/user session shared/user_12_1_1519369155454581669_v1 sending to client partition status
2025-11-26T18:42:03.529234Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1446: session cookie 1 consumer shared/user session shared/user_12_1_1519369155454581669_v1 sending to client partition status
CreatePartitionStream { PartitionStreamId: 1 TopicPath: topic1 Cluster: dc1 PartitionId: 1 CommittedOffset: 0 EndOffset: 0 }
2025-11-26T18:42:03.533050Z :INFO: [] [] [3430877a-9305be47-dcd0f077-4a6fb492] [null] Confirm partition stream create. Partition stream id: 1. Cluster: "dc1". Topic: "topic1". Partition: 1. Read offset: (NULL)
2025-11-26T18:42:03.528407Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
CreatePartitionStream { PartitionStreamId: 2 TopicPath: topic1 Cluster: dc1 PartitionId: 0 CommittedOffset: 0 EndOffset: 0 }
2025-11-26T18:42:03.533480Z :INFO: [] [] [3430877a-9305be47-dcd0f077-4a6fb492] [null] Confirm partition stream create. Partition stream id: 2. Cluster: "dc1". Topic: "topic1". Partition: 0. Read offset: (NULL)
2025-11-26T18:42:03.534059Z :DEBUG: [] MessageGroupId [source0] SessionId [] Write session: try to update token
2025-11-26T18:42:03.534812Z :INFO: [] MessageGroupId [source0] SessionId [] Write session: Do CDS request
2025-11-26T18:42:03.534882Z :INFO: [] MessageGroupId [source0] SessionId [] Start write session. Will connect to endpoint: localhost:21251
2025-11-26T18:42:03.541476Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_12_1_1519369155454581669_v1 grpc read done: success# 1, data# { start_read { topic { path: "topic1" } cluster: "dc1" partition: 1 assign_id: 1 } }
2025-11-26T18:42:03.541673Z node 12 :PQ_READ_PROXY INFO: read_session_actor.cpp:551: session cookie 1 consumer shared/user session shared/user_12_1_1519369155454581669_v1 got StartRead from client: partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 1(assignId:1), readOffset# 0, commitOffset# 0
2025-11-26T18:42:03.541777Z node 12 :PQ_READ_PROXY INFO: partition_actor.cpp:1023: session cookie 1 consumer shared/user session shared/user_12_1_1519369155454581669_v1 Start reading TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 1(assignId:1) EndOffset 0 readOffset 0 committedOffset 0 clientCommitOffset 0 clientReadOffset 0
2025-11-26T18:42:03.541821Z node 12 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_12_1_1519369155454581669_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 1(assignId:1) wait data in partition inited, cookie 1 from offset 0
2025-11-26T18:42:03.542544Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_12_1_1519369155454581669_v1 grpc read done: success# 1, data# { start_read { topic { path: "topic1" } cluster: "dc1" assign_id: 2 } }
2025-11-26T18:42:03.542708Z node 12 :PQ_READ_PROXY INFO: read_session_actor.cpp:551: session cookie 1 consumer shared/user session shared/user_12_1_1519369155454581669_v1 got StartRead from client: partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:2), readOffset# 0, commitOffset# 0
2025-11-26T18:42:03.542771Z node 12 :PQ_READ_PROXY INFO: partition_actor.cpp:1023: session cookie 1 consumer shared/user session shared/user_12_1_1519369155454581669_v1 Start reading TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:2) EndOffset 0 readOffset 0 committedOffset 0 clientCommitOffset 0 clientReadOffset 0
2025-11-26T18:42:03.542801Z node 12 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_12_1_1519369155454581669_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:2) wait data in partition inited, cookie 1 from offset 0
2025-11-26T18:42:03.544092Z :DEBUG: [] MessageGroupId [source0] SessionId [] Write session: send init request: init_request { topic: "topic1" message_group_id: "source0" }
2025-11-26T18:42:03.544925Z node 12 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-11-26T18:42:03.544960Z node 12 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1
2025-11-26T18:42:03.545301Z node 12 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId:  grpc read done: success: 1 data: init_request { topic: "topic1" message_group_id: "source0" }
2025-11-26T18:42:03.545492Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1 topic: "topic1" message_group_id: "source0" from ipv6:[::1]:40008
2025-11-26T18:42:03.545517Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40008 proto=v1  topic=topic1 durationSec=0
2025-11-26T18:42:03.545528Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-11-26T18:42:03.547755Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1 sessionId:  describe result for acl check
2025-11-26T18:42:03.547933Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-11-26T18:42:03.547954Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-11-26T18:42:03.547968Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-11-26T18:42:03.547991Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [12:7577106244492943704:2488] (SourceId=source0, PreferedPartition=(NULL)) StartKqpSession
2025-11-26T18:42:03.551867Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [12:7577106244492943704:2488] (SourceId=source0, PreferedPartition=(NULL)) Select from the table
2025-11-26T18:42:03.589434Z node 13 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][1][StateIdle] Process user action and tx events
2025-11-26T18:42:03.589472Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][1][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:42:03.589486Z node 13 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][1][StateIdle] Process user action and tx pending commits
2025-11-26T18:42:03.589508Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][1][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:42:03.589521Z node 13 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][1][StateIdle] Try persist
2025-11-26T18:42:03.625404Z node 13 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:42:03.625439Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:42:03.625454Z node 13 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:42:03.625477Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:42:03.625491Z node 13 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:42:03.690342Z node 13 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][1][StateIdle] Process user action and tx events
2025-11-26T18:42:03.690380Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][1][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:42:03.690397Z node 13 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][1][StateIdle] Process user action and tx pending commits
2025-11-26T18:42:03.690429Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][1][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:42:03.690443Z node 13 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][1][StateIdle] Try persist
2025-11-26T18:42:03.725689Z node 13 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:42:03.725728Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:42:03.725745Z node 13 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:42:03.725770Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:42:03.725797Z node 13 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:42:03.792716Z node 13 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][1][StateIdle] Process user action and tx events
2025-11-26T18:42:03.792753Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][1][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:42:03.792767Z node 13 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][1][StateIdle] Process user action and tx pending commits
2025-11-26T18:42:03.792789Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][1][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:42:03.792802Z node 13 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][1][StateIdle] Try persist
2025-11-26T18:42:03.802102Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [12:7577106244492943704:2488] (SourceId=source0, PreferedPartition=(NULL)) RequestPQRB
2025-11-26T18:42:03.802942Z node 12 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--topic1] pipe [12:7577106244492943766:2488] connected; active server actors: 1
2025-11-26T18:42:03.803046Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [12:7577106244492943704:2488] (SourceId=source0, PreferedPartition=(NULL)) Received partition 1 from PQRB for SourceId=source0
2025-11-26T18:42:03.803073Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [12:7577106244492943704:2488] (SourceId=source0, PreferedPartition=(NULL)) Update the table
2025-11-26T18:42:03.808862Z node 12 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--topic1] pipe [12:7577106244492943766:2488] disconnected; active server actors: 1
2025-11-26T18:42:03.808902Z node 12 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1689: [72075186224037893][rt3.dc1--topic1] pipe [12:7577106244492943766:2488] disconnected no session
2025-11-26T18:42:03.826591Z node 13 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:42:03.826634Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:42:03.826649Z node 13 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:42:03.826671Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:42:03.826684Z node 13 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:42:03.893112Z node 13 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][1][StateIdle] Process user action and tx events
2025-11-26T18:42:03.893152Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][1][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:42:03.893168Z node 13 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][1][StateIdle] Process user action and tx pending commits
2025-11-26T18:42:03.893204Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][1][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:42:03.893220Z node 13 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][1][StateIdle] Try persist
2025-11-26T18:42:03.927411Z node 13 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:42:03.927449Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:42:03.927463Z node 13 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:42:03.927500Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:42:03.927515Z node 13 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:42:03.993474Z node 13 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][1][StateIdle] Process user action and tx events
2025-11-26T18:42:03.993512Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][1][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:42:03.993526Z node 13 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][1][StateIdle] Process user action and tx pending commits
2025-11-26T18:42:03.993549Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][1][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:42:03.993562Z node 13 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][1][StateIdle] Try persist
2025-11-26T18:42:04.007135Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [12:7577106244492943704:2488] (SourceId=source0, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-11-26T18:42:04.007189Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [12:7577106244492943704:2488] (SourceId=source0, PreferedPartition=(NULL)) ReplyResult: Partition=1, SeqNo=(NULL)
2025-11-26T18:42:04.007219Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [12:7577106244492943704:2488] (SourceId=source0, PreferedPartition=(NULL)) Start idle
2025-11-26T18:42:04.007263Z node 12 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1 sessionId:  partition: 1 expectedGeneration: (NULL)
2025-11-26T18:42:04.008210Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2720: [PQ: 72075186224037892] server connected, pipe [12:7577106248787911087:2488], now have 1 active actors on pipe
2025-11-26T18:42:04.008290Z node 12 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=1) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 13, Generation: 1
2025-11-26T18:42:04.008574Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-26T18:42:04.008629Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 1
2025-11-26T18:42:04.008737Z node 13 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie source0|7e762adb-ff8a68d0-a7730004-3813abb3_0 generated for partition 1 topic 'rt3.dc1--topic1' owner source0
2025-11-26T18:42:04.008794Z node 13 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][1][StateIdle] Process user action and tx events
2025-11-26T18:42:04.008819Z node 13 :PERSQUEUE DEBUG: partition.cpp:2382: [72075186224037892][Partition][1][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-26T18:42:04.008844Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][1][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-26T18:42:04.008859Z node 13 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][1][StateIdle] Process user action and tx pending commits
2025-11-26T18:42:04.008882Z node 13 :PERSQUEUE DEBUG: partition.cpp:2446: [72075186224037892][Partition][1][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-26T18:42:04.008924Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][1][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-26T18:42:04.008941Z node 13 :PERSQUEUE DEBUG: partition.cpp:2301: [72075186224037892][Partition][1][StateIdle] Batch completed (1)
2025-11-26T18:42:04.008965Z node 13 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][1][StateIdle] Try persist
2025-11-26T18:42:04.009023Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][1][StateIdle] TPartition::ReplyOwnerOk. Partition: 1
2025-11-26T18:42:04.009088Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 1 messageNo: 0  requestId: <none> cookie: 0
2025-11-26T18:42:04.009965Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-26T18:42:04.010009Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 1
2025-11-26T18:42:04.010118Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 1 messageNo: 0  requestId: <none> cookie: 0
2025-11-26T18:42:04.013638Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1 partition: 1 MaxSeqNo: 0 sessionId: source0|7e762adb-ff8a68d0-a7730004-3813abb3_0
2025-11-26T18:42:04.014405Z :INFO: [] MessageGroupId [source0] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1764182524014 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-11-26T18:42:04.014577Z :INFO: [] MessageGroupId [source0] SessionId [] Write session established. Init response: session_id: "source0|7e762adb-ff8a68d0-a7730004-3813abb3_0" topic: "topic1" cluster: "dc1" partition_id: 1 supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-11-26T18:42:04.014812Z :DEBUG: [] MessageGroupId [source0] SessionId [source0|7e762adb-ff8a68d0-a7730004-3813abb3_0] Write 1 messages with Id from 1 to 1
2025-11-26T18:42:04.014911Z :INFO: [] MessageGroupId [source0] SessionId [source0|7e762adb-ff8a68d0-a7730004-3813abb3_0] Write session: close. Timeout = 10000 ms
2025-11-26T18:42:04.015331Z :DEBUG: [] MessageGroupId [source0] SessionId [source0|7e762adb-ff8a68d0-a7730004-3813abb3_0] Write session: try to update token
2025-11-26T18:42:04.015394Z :DEBUG: [] MessageGroupId [source0] SessionId [source0|7e762adb-ff8a68d0-a7730004-3813abb3_0] Send 1 message(s) (0 left), first sequence number is 1
2025-11-26T18:42:04.015909Z node 12 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId: source0|7e762adb-ff8a68d0-a7730004-3813abb3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-26T18:42:04.016211Z node 12 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=1) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-26T18:42:04.016634Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-26T18:42:04.016693Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 1
2025-11-26T18:42:04.016791Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 1 messageNo: 0  requestId: <none> cookie: 1
2025-11-26T18:42:04.016992Z node 12 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=1) Received event: NActors::IEventHandle
2025-11-26T18:42:04.017411Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-26T18:42:04.017444Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 1
2025-11-26T18:42:04.017933Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2009: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 1 SourceId: '\0source0' SeqNo: 1 partNo : 0 messageNo: 1 size 98 offset: -1
2025-11-26T18:42:04.018004Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:633: [72075186224037892][Partition][1][StateIdle] Received TPartition::TEvWrite
2025-11-26T18:42:04.018104Z node 13 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][1][StateIdle] Process user action and tx events
2025-11-26T18:42:04.018129Z node 13 :PERSQUEUE DEBUG: partition.cpp:2382: [72075186224037892][Partition][1][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-26T18:42:04.018168Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][1][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-26T18:42:04.018182Z node 13 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][1][StateIdle] Process user action and tx pending commits
2025-11-26T18:42:04.018203Z node 13 :PERSQUEUE DEBUG: partition.cpp:2446: [72075186224037892][Partition][1][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-26T18:42:04.018313Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][1][StateIdle] Topic 'rt3.dc1--topic1' partition 1 part blob processing sourceId '\0source0' seqNo 1 partNo 0
2025-11-26T18:42:04.018935Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:1428: [72075186224037892][Partition][1][StateIdle] Topic 'rt3.dc1--topic1' partition 1 part blob complete sourceId '\0source0' seqNo 1 partNo 0 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 173 count 1 nextOffset 1 batches 1
2025-11-26T18:42:04.018970Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][1][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-26T18:42:04.018983Z node 13 :PERSQUEUE DEBUG: partition.cpp:2301: [72075186224037892][Partition][1][StateIdle] Batch completed (1)
2025-11-26T18:42:04.019000Z node 13 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][1][StateIdle] Try persist
2025-11-26T18:42:04.019672Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:1680: [72075186224037892][Partition][1][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 1 compactOffset 0,1 HeadOffset 0 endOffset 0 curOffset 1 d0000000001_00000000000000000000_00000_0000000001_00000? size 161 WTime 1764182524019
2025-11-26T18:42:04.019864Z node 13 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-26T18:42:04.020021Z node 13 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 1 offset 0 partNo 0 count 1 size 161
2025-11-26T18:42:04.025045Z node 13 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 1 offset 0 count 1 size 161 actorID [13:7577106237176073971:2391]
2025-11-26T18:42:04.025780Z node 12 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 1 consumer shared/user session shared/user_12_1_1519369155454581669_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 1(assignId:1) wait for data done:  readOffset 0 EndOffset 0 newEndOffset 1 commitOffset 0 clientCommitOffset 0 cookie 1 readingFinished 0 firstRead 1
2025-11-26T18:42:04.025121Z node 13 :PERSQUEUE DEBUG: partition.cpp:2112: [72075186224037892][Partition][1][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-26T18:42:04.025201Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037892][Partition][1][StateIdle] TPartition::HandleWriteResponse writeNewSize# 106 WriteNewSizeFromSupportivePartitions# 0
2025-11-26T18:42:04.025809Z node 12 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_12_1_1519369155454581669_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 1(assignId:1) ready for read with readOffset 0 endOffset 1
2025-11-26T18:42:04.025209Z node 13 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 1 offset 0 partno 0 count 1 parts 0 suffix '63' size 161
2025-11-26T18:42:04.025868Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_12_1_1519369155454581669_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 1(assignId:1), readOffset# 0, endOffset# 1, WTime# 0, sizeLag# 161
2025-11-26T18:42:04.025266Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][1][StateIdle] TPartition::ReplyWrite. Partition: 1
2025-11-26T18:42:04.025898Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2354: session cookie 1 consumer shared/user session shared/user_12_1_1519369155454581669_v1TEvPartitionReady. Aval parts: 1
2025-11-26T18:42:04.025321Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][1][StateIdle] Answering for message sourceid: '\0source0', Topic: 'rt3.dc1--topic1', Partition: 1, SeqNo: 1, partNo: 0, Offset: 0 is stored on disk
2025-11-26T18:42:04.025942Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2277: session cookie 1 consumer shared/user session shared/user_12_1_1519369155454581669_v1 performing read request: guid# 47c909db-c5755f01-4f5976fd-b28054de, from# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 1(assignId:1), count# 1, size# 193, partitionsAsked# 1, maxTimeLag# 0ms
2025-11-26T18:42:04.025641Z node 13 :PERSQUEUE DEBUG: partition_read.cpp:915: [72075186224037892][Partition][1][StateIdle] Topic 'rt3.dc1--topic1' partition 1 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-11-26T18:42:04.025672Z node 13 :PERSQUEUE DEBUG: partition_read.cpp:957: [72075186224037892][Partition][1][StateIdle] Topic 'rt3.dc1--topic1' partition 1 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-11-26T18:42:04.025695Z node 13 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][1][StateIdle] Process user action and tx events
2025-11-26T18:42:04.025714Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][1][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:42:04.025729Z node 13 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][1][StateIdle] Process user action and tx pending commits
2025-11-26T18:42:04.025748Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][1][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:42:04.026027Z node 12 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_12_1_1519369155454581669_v1 READ FROM TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 1(assignId:1)maxCount 1 maxSize 193 maxTimeLagMs 0 readTimestampMs 0 readOffset 0 EndOffset 1 ClientCommitOffset 0 committedOffset 0 Guid 47c909db-c5755f01-4f5976fd-b28054de
2025-11-26T18:42:04.025765Z node 13 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][1][StateIdle] Try persist
2025-11-26T18:42:04.025801Z node 13 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][1][StateIdle] No data for blobs compaction
2025-11-26T18:42:04.025862Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 1 messageNo: 1  requestId: <none> cookie: 1
2025-11-26T18:42:04.026010Z node 13 :PERSQUEUE DEBUG: partition_read.cpp:872: [72075186224037892][Partition][1][StateIdle] read cookie 3 Topic 'rt3.dc1--topic1' partition 1 user user offset 0 partno 0 count 1 size 1024000 endOffset 1 max time lag 0ms effective offset 0
2025-11-26T18:42:04.026213Z node 12 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=1) Received event: NActors::IEventHandle
2025-11-26T18:42:04.026324Z node 13 :PERSQUEUE DEBUG: partition_read.cpp:1097: [72075186224037892][Partition][1][StateIdle] read cookie 3 added 1 blobs, size 161 count 1 last offset 0, current partition end offset: 1
2025-11-26T18:42:04.026358Z node 13 :PERSQUEUE DEBUG: partition_read.cpp:1113: [72075186224037892][Partition][1][StateIdle] Reading cookie 3. Send blob request.
2025-11-26T18:42:04.026499Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-26T18:42:04.026537Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 1
2025-11-26T18:42:04.026612Z node 13 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 1 offset 0 partno 0 count 1 parts_count 0 source 1 size 161 accessed 0 times before, last time 2025-11-26T18:42:04.000000Z
2025-11-26T18:42:04.026654Z node 13 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 3. All 1 blobs are from cache.
2025-11-26T18:42:04.026850Z :DEBUG: [] MessageGroupId [source0] SessionId [source0|7e762adb-ff8a68d0-a7730004-3813abb3_0] Write session got write response: sequence_numbers: 1 offsets: 0 already_written: false partition_id: 1 write_statistics { persist_duration_ms: 6 queued_in_partition_duration_ms: 1 }
2025-11-26T18:42:04.026912Z :DEBUG: [] MessageGroupId [source0] SessionId [source0|7e762adb-ff8a68d0-a7730004-3813abb3_0] Write session: acknoledged message 1
2025-11-26T18:42:04.026717Z node 13 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 1 offset 0 partno 0 count 1 parts 0 suffix '63'
2025-11-26T18:42:04.028633Z node 12 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_12_1_1519369155454581669_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 1(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 1 Result { Offset: 0 Data: "... 98 bytes ..." SourceId: "\000source0" SeqNo: 1 WriteTimestampMS: 1764182524017 CreateTimestampMS: 1764182524014 UncompressedSize: 15 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 20 RealReadOffset: 0 WaitQuotaTimeMs: 0 EndOffset: 1 StartOffset: 0 } Cookie: 0 }
2025-11-26T18:42:04.026729Z node 13 :PERSQUEUE DEBUG: partition_read.cpp:569: FormAnswer for 1 blobs
2025-11-26T18:42:04.026922Z node 13 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 1 count 1 size 141 from pos 0 cbcount 1
2025-11-26T18:42:04.027073Z node 13 :PERSQUEUE DEBUG: partition_read.cpp:1007: Topic 'rt3.dc1--topic1' partition 1 user user readTimeStamp done, result 1764182524017 queuesize 0 startOffset 0
2025-11-26T18:42:04.028764Z node 12 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_12_1_1519369155454581669_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 1(assignId:1) wait data in partition inited, cookie 2 from offset 1
2025-11-26T18:42:04.027132Z node 13 :PERSQUEUE DEBUG: partition_read.cpp:872: [72075186224037892][Partition][1][StateIdle] read cookie 4 Topic 'rt3.dc1--topic1' partition 1 user user offset 0 partno 0 count 1 size 193 endOffset 1 max time lag 0ms effective offset 0
2025-11-26T18:42:04.027362Z node 13 :PERSQUEUE DEBUG: partition_read.cpp:1097: [72075186224037892][Partition][1][StateIdle] read cookie 4 added 1 blobs, size 161 count 1 last offset 0, current partition end offset: 1
2025-11-26T18:42:04.028797Z node 12 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_12_1_1519369155454581669_v1 after read state TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 1(assignId:1) EndOffset 1 ReadOffset 1 ReadGuid 47c909db-c5755f01-4f5976fd-b28054de has messages 1
2025-11-26T18:42:04.027379Z node 13 :PERSQUEUE DEBUG: partition_read.cpp:1113: [72075186224037892][Partition][1][StateIdle] Reading cookie 4. Send blob request.
2025-11-26T18:42:04.027419Z node 13 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 1 offset 0 partno 0 count 1 parts_count 0 source 1 size 161 accessed 1 times before, last time 2025-11-26T18:42:04.000000Z
2025-11-26T18:42:04.027451Z node 13 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 4. All 1 blobs are from cache.
2025-11-26T18:42:04.027483Z node 13 :PERSQUEUE DEBUG: partition_read.cpp:569: FormAnswer for 1 blobs
2025-11-26T18:42:04.027517Z node 13 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 1 offset 0 partno 0 count 1 parts 0 suffix '63'
2025-11-26T18:42:04.027595Z node 13 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 1 count 1 size 141 from pos 0 cbcount 1
2025-11-26T18:42:04.027682Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 1 messageNo: 0  requestId: <none> cookie: 0
2025-11-26T18:42:04.027737Z node 13 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:42:04.028902Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1951: session cookie 1 consumer shared/user session shared/user_12_1_1519369155454581669_v1 read done: guid# 47c909db-c5755f01-4f5976fd-b28054de, partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 1(assignId:1), size# 197
2025-11-26T18:42:04.027752Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:42:04.027767Z node 13 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:42:04.028956Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2113: session cookie 1 consumer shared/user session shared/user_12_1_1519369155454581669_v1 response to read: guid# 47c909db-c5755f01-4f5976fd-b28054de
2025-11-26T18:42:04.027786Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:42:04.027799Z node 13 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:42:04.029160Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2156: session cookie 1 consumer shared/user session shared/user_12_1_1519369155454581669_v1 Process answer. Aval parts: 0
2025-11-26T18:42:04.029697Z :DEBUG: [] [] [3430877a-9305be47-dcd0f077-4a6fb492] [null] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-26T18:42:04.029866Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_12_1_1519369155454581669_v1 grpc read done: success# 1, data# { read { } }
2025-11-26T18:42:04.029990Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1850: session cookie 1 consumer shared/user session shared/user_12_1_1519369155454581669_v1 got read request: guid# 9c56ff32-5a4de698-3585cd48-9b7e43bd
2025-11-26T18:42:04.094069Z node 13 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][1][StateIdle] Process user action and tx events
2025-11-26T18:42:04.094113Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][1][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:42:04.094128Z node 13 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][1][StateIdle] Process user action and tx pending commits
2025-11-26T18:42:04.094153Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][1][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:42:04.094167Z node 13 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][1][StateIdle] Try persist
2025-11-26T18:42:04.116044Z :INFO: [] MessageGroupId [source0] SessionId [source0|7e762adb-ff8a68d0-a7730004-3813abb3_0] Write session will now close
2025-11-26T18:42:04.116134Z :DEBUG: [] MessageGroupId [source0] SessionId [source0|7e762adb-ff8a68d0-a7730004-3813abb3_0] Write session: aborting
2025-11-26T18:42:04.116790Z :INFO: [] MessageGroupId [source0] SessionId [source0|7e762adb-ff8a68d0-a7730004-3813abb3_0] Write session: gracefully shut down, all writes complete
2025-11-26T18:42:04.116853Z :DEBUG: [] MessageGroupId [source0] SessionId [source0|7e762adb-ff8a68d0-a7730004-3813abb3_0] Write session: destroy
2025-11-26T18:42:04.119988Z node 12 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId: source0|7e762adb-ff8a68d0-a7730004-3813abb3_0 grpc read done: success: 0 data: 
2025-11-26T18:42:04.120024Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 1 sessionId: source0|7e762adb-ff8a68d0-a7730004-3813abb3_0 grpc read failed
2025-11-26T18:42:04.120067Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 1 sessionId: source0|7e762adb-ff8a68d0-a7730004-3813abb3_0 grpc closed
2025-11-26T18:42:04.120097Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1 sessionId: source0|7e762adb-ff8a68d0-a7730004-3813abb3_0 is DEAD
2025-11-26T18:42:04.121199Z node 12 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=1) Received event: NActors::TEvents::TEvPoison
2025-11-26T18:42:04.121845Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2745: [PQ: 72075186224037892] server disconnected, pipe [12:7577106248787911087:2488] destroyed
2025-11-26T18:42:04.121918Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][1][StateIdle] TPartition::DropOwner.
2025-11-26T18:42:04.121959Z node 13 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][1][StateIdle] Process user action and tx events
2025-11-26T18:42:04.121975Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][1][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:42:04.121992Z node 13 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][1][StateIdle] Process user action and tx pending commits
2025-11-26T18:42:04.122019Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][1][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:42:04.122033Z node 13 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][1][StateIdle] Try persist
2025-11-26T18:42:04.123554Z :DEBUG: [] MessageGroupId [source1] SessionId [] Write session: try to update token
2025-11-26T18:42:04.123849Z :INFO: [] MessageGroupId [source1] SessionId [] Write session: Do CDS request
2025-11-26T18:42:04.123876Z :INFO: [] MessageGroupId [source1] SessionId [] Start write session. Will connect to endpoint: localhost:21251
2025-11-26T18:42:04.128117Z node 13 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:42:04.128158Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:42:04.128176Z node 13 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:42:04.128215Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:42:04.128230Z node 13 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:42:04.138283Z :DEBUG: [] MessageGroupId [source1] SessionId [] Write session: send init request: init_request { topic: "topic1" message_group_id: "source1" }
2025-11-26T18:42:04.138962Z node 12 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-11-26T18:42:04.139001Z node 12 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2
2025-11-26T18:42:04.139609Z node 12 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId:  grpc read done: success: 1 data: init_request { topic: "topic1" message_group_id: "source1" }
2025-11-26T18:42:04.139758Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2 topic: "topic1" message_group_id: "source1" from ipv6:[::1]:40008
2025-11-26T18:42:04.139776Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40008 proto=v1  topic=topic1 durationSec=0
2025-11-26T18:42:04.139786Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-11-26T18:42:04.141620Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2 sessionId:  describe result for acl check
2025-11-26T18:42:04.141784Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-11-26T18:42:04.141799Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-11-26T18:42:04.141814Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-11-26T18:42:04.141835Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [12:7577106248787911097:2506] (SourceId=source1, PreferedPartition=(NULL)) StartKqpSession
2025-11-26T18:42:04.150477Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [12:7577106248787911097:2506] (SourceId=source1, PreferedPartition=(NULL)) Select from the table
2025-11-26T18:42:04.158418Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [12:7577106248787911097:2506] (SourceId=source1, PreferedPartition=(NULL)) RequestPQRB
2025-11-26T18:42:04.158957Z node 12 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--topic1] pipe [12:7577106248787911127:2506] connected; active server actors: 1
2025-11-26T18:42:04.159006Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [12:7577106248787911097:2506] (SourceId=source1, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=source1
2025-11-26T18:42:04.159032Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [12:7577106248787911097:2506] (SourceId=source1, PreferedPartition=(NULL)) Update the table
2025-11-26T18:42:04.159358Z node 12 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--topic1] pipe [12:7577106248787911127:2506] disconnected; active server actors: 1
2025-11-26T18:42:04.159389Z node 12 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1689: [72075186224037893][rt3.dc1--topic1] pipe [12:7577106248787911127:2506] disconnected no session
2025-11-26T18:42:04.190498Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [12:7577106248787911097:2506] (SourceId=source1, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-11-26T18:42:04.190558Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [12:7577106248787911097:2506] (SourceId=source1, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-11-26T18:42:04.190588Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [12:7577106248787911097:2506] (SourceId=source1, PreferedPartition=(NULL)) Start idle
2025-11-26T18:42:04.190633Z node 12 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-11-26T18:42:04.192159Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2720: [PQ: 72075186224037892] server connected, pipe [12:7577106248787911138:2506], now have 1 active actors on pipe
2025-11-26T18:42:04.192277Z node 12 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 13, Generation: 1
2025-11-26T18:42:04.192557Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-26T18:42:04.192601Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-26T18:42:04.192716Z node 13 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie source1|795db7ff-3232e27b-e223b0d2-232ab1ce_0 generated for partition 0 topic 'rt3.dc1--topic1' owner source1
2025-11-26T18:42:04.192759Z node 13 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:42:04.192776Z node 13 :PERSQUEUE DEBUG: partition.cpp:2382: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-26T18:42:04.192812Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-26T18:42:04.192826Z node 13 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:42:04.192850Z node 13 :PERSQUEUE DEBUG: partition.cpp:2446: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-26T18:42:04.192888Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-26T18:42:04.192904Z node 13 :PERSQUEUE DEBUG: partition.cpp:2301: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-26T18:42:04.192938Z node 13 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:42:04.192998Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-26T18:42:04.193061Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-26T18:42:04.193710Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-26T18:42:04.193745Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-26T18:42:04.193833Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-26T18:42:04.194224Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2 partition: 0 MaxSeqNo: 0 sessionId: source1|795db7ff-3232e27b-e223b0d2-232ab1ce_0
2025-11-26T18:42:04.195219Z :INFO: [] MessageGroupId [source1] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1764182524195 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-11-26T18:42:04.195373Z :INFO: [] MessageGroupId [source1] SessionId [] Write session established. Init response: session_id: "source1|795db7ff-3232e27b-e223b0d2-232ab1ce_0" topic: "topic1" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-11-26T18:42:04.195648Z :DEBUG: [] MessageGroupId [source1] SessionId [source1|795db7ff-3232e27b-e223b0d2-232ab1ce_0] Write 1 messages with Id from 1 to 1
2025-11-26T18:42:04.195728Z :INFO: [] MessageGroupId [source1] SessionId [source1|795db7ff-3232e27b-e223b0d2-232ab1ce_0] Write session: close. Timeout = 10000 ms
2025-11-26T18:42:04.195194Z node 13 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][1][StateIdle] Process user action and tx events
2025-11-26T18:42:04.195231Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][1][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:42:04.195246Z node 13 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][1][StateIdle] Process user action and tx pending commits
2025-11-26T18:42:04.195279Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][1][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:42:04.195295Z node 13 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][1][StateIdle] Try persist
2025-11-26T18:42:04.196181Z :DEBUG: [] MessageGroupId [source1] SessionId [source1|795db7ff-3232e27b-e223b0d2-232ab1ce_0] Write session: try to update token
2025-11-26T18:42:04.196249Z :DEBUG: [] MessageGroupId [source1] SessionId [source1|795db7ff-3232e27b-e223b0d2-232ab1ce_0] Send 1 message(s) (0 left), first sequence number is 1
2025-11-26T18:42:04.197848Z node 12 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: source1|795db7ff-3232e27b-e223b0d2-232ab1ce_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-26T18:42:04.198119Z node 12 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-26T18:42:04.199176Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-26T18:42:04.199222Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-26T18:42:04.199316Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-11-26T18:42:04.199720Z node 12 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-26T18:42:04.200099Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-26T18:42:04.200131Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-26T18:42:04.200203Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2009: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: '\0source1' SeqNo: 1 partNo : 0 messageNo: 1 size 98 offset: -1
2025-11-26T18:42:04.200259Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:633: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-26T18:42:04.200329Z node 13 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:42:04.200357Z node 13 :PERSQUEUE DEBUG: partition.cpp:2382: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-26T18:42:04.200394Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-26T18:42:04.200407Z node 13 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:42:04.200429Z node 13 :PERSQUEUE DEBUG: partition.cpp:2446: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-26T18:42:04.200583Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId '\0source1' seqNo 1 partNo 0
2025-11-26T18:42:04.231067Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:1428: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '\0source1' seqNo 1 partNo 0 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 173 count 1 nextOffset 1 batches 1
2025-11-26T18:42:04.231143Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-26T18:42:04.231160Z node 13 :PERSQUEUE DEBUG: partition.cpp:2301: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-26T18:42:04.231186Z node 13 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:42:04.231897Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:1680: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 0,1 HeadOffset 0 endOffset 0 curOffset 1 d0000000000_00000000000000000000_00000_0000000001_00000? size 161 WTime 1764182524231
2025-11-26T18:42:04.232133Z node 13 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Writing. Can't process user action and tx events
2025-11-26T18:42:04.232152Z node 13 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-26T18:42:04.232269Z node 13 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 0 partNo 0 count 1 size 161
2025-11-26T18:42:04.240697Z node 13 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 0 count 1 size 161 actorID [13:7577106237176073971:2391]
2025-11-26T18:42:04.240782Z node 13 :PERSQUEUE DEBUG: partition.cpp:2112: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-26T18:42:04.240869Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 106 WriteNewSizeFromSupportivePartitions# 0
2025-11-26T18:42:04.240914Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-26T18:42:04.240973Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 1, partNo: 0, Offset: 0 is stored on disk
2025-11-26T18:42:04.241336Z node 13 :PERSQUEUE DEBUG: partition_read.cpp:915: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-11-26T18:42:04.241365Z node 13 :PERSQUEUE DEBUG: partition_read.cpp:957: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-11-26T18:42:04.241393Z node 13 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:42:04.241413Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:42:04.241431Z node 13 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:42:04.241450Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:42:04.241467Z node 13 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:42:04.241506Z node 13 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-26T18:42:04.241572Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 1  requestId: <none> cookie: 1
2025-11-26T18:42:04.241713Z node 13 :PERSQUEUE DEBUG: partition_read.cpp:872: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--topic1' partition 0 user user offset 0 partno 0 count 1 size 1024000 endOffset 1 max time lag 0ms effective offset 0
2025-11-26T18:42:04.242115Z node 13 :PERSQUEUE DEBUG: partition_read.cpp:1097: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 161 count 1 last offset 0, current partition end offset: 1
2025-11-26T18:42:04.242140Z node 13 :PERSQUEUE DEBUG: partition_read.cpp:1113: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-11-26T18:42:04.242203Z node 13 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 0 partno 0 count 1 parts_count 0 source 1 size 161 accessed 0 times before, last time 2025-11-26T18:42:04.000000Z
2025-11-26T18:42:04.242236Z node 13 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 3. All 1 blobs are from cache.
2025-11-26T18:42:04.242297Z node 13 :PERSQUEUE DEBUG: partition_read.cpp:569: FormAnswer for 1 blobs
2025-11-26T18:42:04.242503Z node 13 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 1 count 1 size 141 from pos 0 cbcount 1
2025-11-26T18:42:04.242605Z node 13 :PERSQUEUE DEBUG: partition_read.cpp:1007: Topic 'rt3.dc1--topic1' partition 0 user user readTimeStamp done, result 1764182524197 queuesize 0 startOffset 0
2025-11-26T18:42:04.243761Z node 13 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 0 suffix '63' size 161
2025-11-26T18:42:04.243857Z node 13 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 0 suffix '63'
2025-11-26T18:42:04.244271Z node 12 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-26T18:42:04.244298Z node 12 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 1 consumer shared/user session shared/user_12_1_1519369155454581669_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:2) wait for data done:  readOffset 0 EndOffset 0 newEndOffset 1 commitOffset 0 clientCommitOffset 0 cookie 1 readingFinished 0 firstRead 1
2025-11-26T18:42:04.244330Z node 12 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_12_1_1519369155454581669_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:2) ready for read with readOffset 0 endOffset 1
2025-11-26T18:42:04.244418Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_12_1_1519369155454581669_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:2), readOffset# 0, endOffset# 1, WTime# 0, sizeLag# 161
2025-11-26T18:42:04.244439Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2354: session cookie 1 consumer shared/user session shared/user_12_1_1519369155454581669_v1TEvPartitionReady. Aval parts: 1
2025-11-26T18:42:04.244483Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2277: session cookie 1 consumer shared/user session shared/user_12_1_1519369155454581669_v1 performing read request: guid# 9c56ff32-5a4de698-3585cd48-9b7e43bd, from# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:2), count# 1, size# 193, partitionsAsked# 1, maxTimeLag# 0ms
2025-11-26T18:42:04.244580Z node 12 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_12_1_1519369155454581669_v1 READ FROM TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:2)maxCount 1 maxSize 193 maxTimeLagMs 0 readTimestampMs 0 readOffset 0 EndOffset 1 ClientCommitOffset 0 committedOffset 0 Guid 9c56ff32-5a4de698-3585cd48-9b7e43bd
2025-11-26T18:42:04.245133Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-26T18:42:04.245180Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-26T18:42:04.245333Z node 13 :PERSQUEUE DEBUG: partition_read.cpp:872: [72075186224037892][Partition][0][StateIdle] read cookie 4 Topic 'rt3.dc1--topic1' partition 0 user user offset 0 partno 0 count 1 size 193 endOffset 1 max time lag 0ms effective offset 0
2025-11-26T18:42:04.245662Z node 13 :PERSQUEUE DEBUG: partition_read.cpp:1097: [72075186224037892][Partition][0][StateIdle] read cookie 4 added 1 blobs, size 161 count 1 last offset 0, current partition end offset: 1
2025-11-26T18:42:04.245687Z node 13 :PERSQUEUE DEBUG: partition_read.cpp:1113: [72075186224037892][Partition][0][StateIdle] Reading cookie 4. Send blob request.
2025-11-26T18:42:04.245743Z node 13 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 0 partno 0 count 1 parts_count 0 source 1 size 161 accessed 1 times before, last time 2025-11-26T18:42:04.000000Z
2025-11-26T18:42:04.245786Z node 13 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 4. All 1 blobs are from cache.
2025-11-26T18:42:04.245840Z node 13 :PERSQUEUE DEBUG: partition_read.cpp:569: FormAnswer for 1 blobs
2025-11-26T18:42:04.246039Z node 13 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 1 count 1 size 141 from pos 0 cbcount 1
2025-11-26T18:42:04.246169Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-26T18:42:04.246951Z node 13 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 0 suffix '63'
2025-11-26T18:42:04.247466Z :DEBUG: [] MessageGroupId [source1] SessionId [source1|795db7ff-3232e27b-e223b0d2-232ab1ce_0] Write session got write response: sequence_numbers: 1 offsets: 0 already_written: false write_statistics { persist_duration_ms: 8 queued_in_partition_duration_ms: 33 }
2025-11-26T18:42:04.247545Z :DEBUG: [] MessageGroupId [source1] SessionId [source1|795db7ff-3232e27b-e223b0d2-232ab1ce_0] Write session: acknoledged message 1
2025-11-26T18:42:04.247982Z node 12 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_12_1_1519369155454581669_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:2) initDone 1 event { CmdReadResult { MaxOffset: 1 Result { Offset: 0 Data: "... 98 bytes ..." SourceId: "\000source1" SeqNo: 1 WriteTimestampMS: 1764182524197 CreateTimestampMS: 1764182524195 UncompressedSize: 15 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 20 RealReadOffset: 0 WaitQuotaTimeMs: 0 EndOffset: 1 StartOffset: 0 } Cookie: 0 }
2025-11-26T18:42:04.248133Z node 12 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_12_1_1519369155454581669_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:2) wait data in partition inited, cookie 2 from offset 1
2025-11-26T18:42:04.248179Z node 12 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_12_1_1519369155454581669_v1 after read state TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:2) EndOffset 1 ReadOffset 1 ReadGuid 9c56ff32-5a4de698-3585cd48-9b7e43bd has messages 1
2025-11-26T18:42:04.248332Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1951: session cookie 1 consumer shared/user session shared/user_12_1_1519369155454581669_v1 read done: guid# 9c56ff32-5a4de698-3585cd48-9b7e43bd, partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:2), size# 195
2025-11-26T18:42:04.248372Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2113: session cookie 1 consumer shared/user session shared/user_12_1_1519369155454581669_v1 response to read: guid# 9c56ff32-5a4de698-3585cd48-9b7e43bd
2025-11-26T18:42:04.248646Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2156: session cookie 1 consumer shared/user session shared/user_12_1_1519369155454581669_v1 Process answer. Aval parts: 0
2025-11-26T18:42:04.249682Z :DEBUG: [] [] [3430877a-9305be47-dcd0f077-4a6fb492] [null] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-26T18:42:04.250128Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_12_1_1519369155454581669_v1 grpc read done: success# 1, data# { read { } }
2025-11-26T18:42:04.250250Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1850: session cookie 1 consumer shared/user session shared/user_12_1_1519369155454581669_v1 got read request: guid# 62d40a41-bf21c1a-bf8dbdca-9d46512
2025-11-26T18:42:04.296109Z node 13 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][1][StateIdle] Process user action and tx events
2025-11-26T18:42:04.296146Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][1][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:42:04.296161Z node 13 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][1][StateIdle] Process user action and tx pending commits
2025-11-26T18:42:04.296186Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][1][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:42:04.296219Z node 13 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][1][StateIdle] Try persist
2025-11-26T18:42:04.299688Z :INFO: [] MessageGroupId [source1] SessionId [source1|795db7ff-3232e27b-e223b0d2-232ab1ce_0] Write session will now close
2025-11-26T18:42:04.299741Z :DEBUG: [] MessageGroupId [source1] SessionId [source1|795db7ff-3232e27b-e223b0d2-232ab1ce_0] Write session: aborting
2025-11-26T18:42:04.301346Z node 12 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: source1|795db7ff-3232e27b-e223b0d2-232ab1ce_0 grpc read done: success: 0 data: 
2025-11-26T18:42:04.301380Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 2 sessionId: source1|795db7ff-3232e27b-e223b0d2-232ab1ce_0 grpc read failed
2025-11-26T18:42:04.301424Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 2 sessionId: source1|795db7ff-3232e27b-e223b0d2-232ab1ce_0 grpc closed
2025-11-26T18:42:04.301451Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2 sessionId: source1|795db7ff-3232e27b-e223b0d2-232ab1ce_0 is DEAD
2025-11-26T18:42:04.302701Z node 12 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-11-26T18:42:04.305608Z :INFO: [] MessageGroupId [source1] SessionId [source1|795db7ff-3232e27b-e223b0d2-232ab1ce_0] Write session: gracefully shut down, all writes complete
2025-11-26T18:42:04.306648Z :DEBUG: [] MessageGroupId [source1] SessionId [source1|795db7ff-3232e27b-e223b0d2-232ab1ce_0] Write session is aborting and will not restart
2025-11-26T18:42:04.307053Z :DEBUG: [] MessageGroupId [source1] SessionId [source1|795db7ff-3232e27b-e223b0d2-232ab1ce_0] Write session: destroy
2025-11-26T18:42:04.309114Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2745: [PQ: 72075186224037892] server disconnected, pipe [12:7577106248787911138:2506] destroyed
2025-11-26T18:42:04.309170Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-11-26T18:42:04.309213Z node 13 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:42:04.309225Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:42:04.309500Z :DEBUG: [] MessageGroupId [source2] SessionId [] Write session: try to update token
2025-11-26T18:42:04.309238Z node 13 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:42:04.309276Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:42:04.309288Z node 13 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:42:04.309814Z :INFO: [] MessageGroupId [source2] SessionId [] Write session: Do CDS request
2025-11-26T18:42:04.309842Z :INFO: [] MessageGroupId [source2] SessionId [] Start write session. Will connect to endpoint: localhost:21251
2025-11-26T18:42:04.316036Z :DEBUG: [] MessageGroupId [source2] SessionId [] Write session: send init request: init_request { topic: "topic1" message_group_id: "source2" }
2025-11-26T18:42:04.318398Z node 12 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-11-26T18:42:04.318437Z node 12 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3
2025-11-26T18:42:04.319011Z node 12 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3 sessionId:  grpc read done: success: 1 data: init_request { topic: "topic1" message_group_id: "source2" }
2025-11-26T18:42:04.319183Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3 topic: "topic1" message_group_id: "source2" from ipv6:[::1]:40008
2025-11-26T18:42:04.319207Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40008 proto=v1  topic=topic1 durationSec=0
2025-11-26T18:42:04.319219Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-11-26T18:42:04.321498Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3 sessionId:  describe result for acl check
2025-11-26T18:42:04.321674Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-11-26T18:42:04.321690Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-11-26T18:42:04.321705Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-11-26T18:42:04.321731Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [12:7577106248787911144:2511] (SourceId=source2, PreferedPartition=(NULL)) StartKqpSession
2025-11-26T18:42:04.332850Z node 13 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:42:04.332890Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:42:04.332908Z node 13 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:42:04.332934Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:42:04.332948Z node 13 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:42:04.335998Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [12:7577106248787911144:2511] (SourceId=source2, PreferedPartition=(NULL)) Select from the table
2025-11-26T18:42:04.351008Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [12:7577106248787911144:2511] (SourceId=source2, PreferedPartition=(NULL)) RequestPQRB
2025-11-26T18:42:04.352044Z node 12 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--topic1] pipe [12:7577106248787911164:2511] connected; active server actors: 1
2025-11-26T18:42:04.352083Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [12:7577106248787911144:2511] (SourceId=source2, PreferedPartition=(NULL)) Received partition 1 from PQRB for SourceId=source2
2025-11-26T18:42:04.352102Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [12:7577106248787911144:2511] (SourceId=source2, PreferedPartition=(NULL)) Update the table
2025-11-26T18:42:04.352444Z node 12 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--topic1] pipe [12:7577106248787911164:2511] disconnected; active server actors: 1
2025-11-26T18:42:04.352464Z node 12 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1689: [72075186224037893][rt3.dc1--topic1] pipe [12:7577106248787911164:2511] disconnected no session
2025-11-26T18:42:04.392107Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [12:7577106248787911144:2511] (SourceId=source2, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-11-26T18:42:04.392159Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [12:7577106248787911144:2511] (SourceId=source2, PreferedPartition=(NULL)) ReplyResult: Partition=1, SeqNo=(NULL)
2025-11-26T18:42:04.392188Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [12:7577106248787911144:2511] (SourceId=source2, PreferedPartition=(NULL)) Start idle
2025-11-26T18:42:04.392229Z node 12 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3 sessionId:  partition: 1 expectedGeneration: (NULL)
2025-11-26T18:42:04.394279Z node 12 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=1) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 13, Generation: 1
2025-11-26T18:42:04.396154Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3 partition: 1 MaxSeqNo: 0 sessionId: source2|38b717a7-b94c3d12-20a34c8-cbe0d2a0_0
2025-11-26T18:42:04.397050Z :INFO: [] MessageGroupId [source2] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1764182524396 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-11-26T18:42:04.397186Z :INFO: [] MessageGroupId [source2] SessionId [] Write session established. Init response: session_id: "source2|38b717a7-b94c3d12-20a34c8-cbe0d2a0_0" topic: "topic1" cluster: "dc1" partition_id: 1 supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-11-26T18:42:04.394062Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2720: [PQ: 72075186224037892] server connected, pipe [12:7577106248787911175:2511], now have 1 active actors on pipe
2025-11-26T18:42:04.394645Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-26T18:42:04.394683Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 1
2025-11-26T18:42:04.394778Z node 13 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie source2|38b717a7-b94c3d12-20a34c8-cbe0d2a0_0 generated for partition 1 topic 'rt3.dc1--topic1' owner source2
2025-11-26T18:42:04.394813Z node 13 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][1][StateIdle] Process user action and tx events
2025-11-26T18:42:04.394832Z node 13 :PERSQUEUE DEBUG: partition.cpp:2382: [72075186224037892][Partition][1][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-26T18:42:04.394854Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][1][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-26T18:42:04.394871Z node 13 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][1][StateIdle] Process user action and tx pending commits
2025-11-26T18:42:04.394893Z node 13 :PERSQUEUE DEBUG: partition.cpp:2446: [72075186224037892][Partition][1][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-26T18:42:04.394933Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][1][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-26T18:42:04.394951Z node 13 :PERSQUEUE DEBUG: partition.cpp:2301: [72075186224037892][Partition][1][StateIdle] Batch completed (1)
2025-11-26T18:42:04.394976Z node 13 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][1][StateIdle] Try persist
2025-11-26T18:42:04.395025Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][1][StateIdle] TPartition::ReplyOwnerOk. Partition: 1
2025-11-26T18:42:04.395085Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 1 messageNo: 0  requestId: <none> cookie: 0
2025-11-26T18:42:04.395720Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-26T18:42:04.395747Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 1
2025-11-26T18:42:04.395871Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 1 messageNo: 0  requestId: <none> cookie: 0
2025-11-26T18:42:04.397564Z node 13 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][1][StateIdle] Process user action and tx events
2025-11-26T18:42:04.397584Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][1][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:42:04.397596Z node 13 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][1][StateIdle] Process user action and tx pending commits
2025-11-26T18:42:04.397611Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][1][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:42:04.397621Z node 13 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][1][StateIdle] Try persist
2025-11-26T18:42:04.401351Z :DEBUG: [] MessageGroupId [source2] SessionId [source2|38b717a7-b94c3d12-20a34c8-cbe0d2a0_0] Write 1 messages with Id from 1 to 1
2025-11-26T18:42:04.401450Z :INFO: [] MessageGroupId [source2] SessionId [source2|38b717a7-b94c3d12-20a34c8-cbe0d2a0_0] Write session: close. Timeout = 10000 ms
2025-11-26T18:42:04.401706Z :DEBUG: [] MessageGroupId [source2] SessionId [source2|38b717a7-b94c3d12-20a34c8-cbe0d2a0_0] Write session: try to update token
2025-11-26T18:42:04.401776Z :DEBUG: [] MessageGroupId [source2] SessionId [source2|38b717a7-b94c3d12-20a34c8-cbe0d2a0_0] Send 1 message(s) (0 left), first sequence number is 1
2025-11-26T18:42:04.402667Z node 12 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3 sessionId: source2|38b717a7-b94c3d12-20a34c8-cbe0d2a0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-26T18:42:04.403011Z node 12 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=1) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-26T18:42:04.404225Z node 12 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=1) Received event: NActors::IEventHandle
2025-11-26T18:42:04.403610Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-26T18:42:04.403669Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 1
2025-11-26T18:42:04.403758Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 1 messageNo: 0  requestId: <none> cookie: 1
2025-11-26T18:42:04.404758Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-26T18:42:04.404789Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 1
2025-11-26T18:42:04.404875Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2009: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 1 SourceId: '\0source2' SeqNo: 1 partNo : 0 messageNo: 1 size 98 offset: -1
2025-11-26T18:42:04.404948Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:633: [72075186224037892][Partition][1][StateIdle] Received TPartition::TEvWrite
2025-11-26T18:42:04.405006Z node 13 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][1][StateIdle] Process user action and tx events
2025-11-26T18:42:04.405025Z node 13 :PERSQUEUE DEBUG: partition.cpp:2382: [72075186224037892][Partition][1][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-26T18:42:04.405061Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][1][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-26T18:42:04.405076Z node 13 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][1][StateIdle] Process user action and tx pending commits
2025-11-26T18:42:04.405098Z node 13 :PERSQUEUE DEBUG: partition.cpp:2446: [72075186224037892][Partition][1][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-26T18:42:04.405228Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][1][StateIdle] Topic 'rt3.dc1--topic1' partition 1 part blob processing sourceId '\0source2' seqNo 1 partNo 0
2025-11-26T18:42:04.406236Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:1428: [72075186224037892][Partition][1][StateIdle] Topic 'rt3.dc1--topic1' partition 1 part blob complete sourceId '\0source2' seqNo 1 partNo 0 FormedBlobsCount 0 NewHead: Offset 1 PartNo 0 PackedSize 173 count 1 nextOffset 2 batches 1
2025-11-26T18:42:04.406282Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][1][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-26T18:42:04.406301Z node 13 :PERSQUEUE DEBUG: partition.cpp:2301: [72075186224037892][Partition][1][StateIdle] Batch completed (1)
2025-11-26T18:42:04.406327Z node 13 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][1][StateIdle] Try persist
2025-11-26T18:42:04.407159Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:1680: [72075186224037892][Partition][1][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 1 compactOffset 1,1 HeadOffset 1 endOffset 1 curOffset 2 d0000000001_00000000000000000001_00000_0000000001_00000? size 161 WTime 1764182524406
2025-11-26T18:42:04.407374Z node 13 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-26T18:42:04.407591Z node 13 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 1 offset 1 partNo 0 count 1 size 161
2025-11-26T18:42:04.421015Z node 13 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 1 offset 1 count 1 size 161 actorID [13:7577106237176073971:2391]
2025-11-26T18:42:04.421094Z node 13 :PERSQUEUE DEBUG: partition.cpp:2112: [72075186224037892][Partition][1][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-26T18:42:04.421172Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037892][Partition][1][StateIdle] TPartition::HandleWriteResponse writeNewSize# 106 WriteNewSizeFromSupportivePartitions# 0
2025-11-26T18:42:04.421210Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][1][StateIdle] TPartition::ReplyWrite. Partition: 1
2025-11-26T18:42:04.421285Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][1][StateIdle] Answering for message sourceid: '\0source2', Topic: 'rt3.dc1--topic1', Partition: 1, SeqNo: 1, partNo: 0, Offset: 1 is stored on disk
2025-11-26T18:42:04.421607Z node 13 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][1][StateIdle] Process user action and tx events
2025-11-26T18:42:04.421635Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][1][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:42:04.421652Z node 13 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][1][StateIdle] Process user action and tx pending commits
2025-11-26T18:42:04.421670Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][1][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:42:04.421689Z node 13 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][1][StateIdle] Try persist
2025-11-26T18:42:04.421726Z node 13 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][1][StateIdle] No data for blobs compaction
2025-11-26T18:42:04.421794Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 1 messageNo: 1  requestId: <none> cookie: 1
2025-11-26T18:42:04.421979Z node 13 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 1 offset 1 partno 0 count 1 parts 0 suffix '63' size 161
2025-11-26T18:42:04.422313Z node 12 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 1 consumer shared/user session shared/user_12_1_1519369155454581669_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 1(assignId:1) wait for data done:  readOffset 1 EndOffset 1 newEndOffset 2 commitOffset 0 clientCommitOffset 0 cookie 2 readingFinished 0 firstRead 0
2025-11-26T18:42:04.422357Z node 12 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_12_1_1519369155454581669_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 1(assignId:1) ready for read with readOffset 1 endOffset 2
2025-11-26T18:42:04.422430Z node 12 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=1) Received event: NActors::IEventHandle
2025-11-26T18:42:04.422877Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_12_1_1519369155454581669_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 1(assignId:1), readOffset# 1, endOffset# 2, WTime# 1764182524017, sizeLag# 161
2025-11-26T18:42:04.422896Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2354: session cookie 1 consumer shared/user session shared/user_12_1_1519369155454581669_v1TEvPartitionReady. Aval parts: 1
2025-11-26T18:42:04.422944Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2277: session cookie 1 consumer shared/user session shared/user_12_1_1519369155454581669_v1 performing read request: guid# 62d40a41-bf21c1a-bf8dbdca-9d46512, from# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 1(assignId:1), count# 1, size# 193, partitionsAsked# 1, maxTimeLag# 0ms
2025-11-26T18:42:04.423010Z node 12 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_12_1_1519369155454581669_v1 READ FROM TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 1(assignId:1)maxCount 1 maxSize 193 maxTimeLagMs 0 readTimestampMs 0 readOffset 1 EndOffset 2 ClientCommitOffset 0 committedOffset 0 Guid 62d40a41-bf21c1a-bf8dbdca-9d46512
2025-11-26T18:42:04.426552Z :DEBUG: [] MessageGroupId [source2] SessionId [source2|38b717a7-b94c3d12-20a34c8-cbe0d2a0_0] Write session got write response: sequence_numbers: 1 offsets: 1 already_written: false partition_id: 1 write_statistics { persist_duration_ms: 16 }
2025-11-26T18:42:04.426628Z :DEBUG: [] MessageGroupId [source2] SessionId [source2|38b717a7-b94c3d12-20a34c8-cbe0d2a0_0] Write session: acknoledged message 1
2025-11-26T18:42:04.425420Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-26T18:42:04.425471Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 1
2025-11-26T18:42:04.425596Z node 13 :PERSQUEUE DEBUG: partition_read.cpp:872: [72075186224037892][Partition][1][StateIdle] read cookie 5 Topic 'rt3.dc1--topic1' partition 1 user user offset 1 partno 0 count 1 size 193 endOffset 2 max time lag 0ms effective offset 1
2025-11-26T18:42:04.425932Z node 13 :PERSQUEUE DEBUG: partition_read.cpp:1097: [72075186224037892][Partition][1][StateIdle] read cookie 5 added 1 blobs, size 161 count 1 last offset 1, current partition end offset: 2
2025-11-26T18:42:04.425955Z node 13 :PERSQUEUE DEBUG: partition_read.cpp:1113: [72075186224037892][Partition][1][StateIdle] Reading cookie 5. Send blob request.
2025-11-26T18:42:04.426012Z node 13 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 1 offset 1 partno 0 count 1 parts_count 0 source 1 size 161 accessed 0 times before, last time 2025-11-26T18:42:04.000000Z
2025-11-26T18:42:04.426047Z node 13 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 5. All 1 blobs are from cache.
2025-11-26T18:42:04.426100Z node 13 :PERSQUEUE DEBUG: partition_read.cpp:569: FormAnswer for 1 blobs
2025-11-26T18:42:04.426293Z node 13 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 1 totakecount 1 count 1 size 141 from pos 0 cbcount 1
2025-11-26T18:42:04.426411Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 1 messageNo: 0  requestId: <none> cookie: 1
2025-11-26T18:42:04.426707Z node 13 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 1 offset 1 partno 0 count 1 parts 0 suffix '63'
2025-11-26T18:42:04.427128Z node 12 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_12_1_1519369155454581669_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 1(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 2 Result { Offset: 1 Data: "... 98 bytes ..." SourceId: "\000source2" SeqNo: 1 WriteTimestampMS: 1764182524404 CreateTimestampMS: 1764182524401 UncompressedSize: 15 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 20 RealReadOffset: 1 WaitQuotaTimeMs: 0 EndOffset: 2 StartOffset: 0 } Cookie: 1 }
2025-11-26T18:42:04.427252Z node 12 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_12_1_1519369155454581669_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 1(assignId:1) wait data in partition inited, cookie 3 from offset 2
2025-11-26T18:42:04.427299Z node 12 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_12_1_1519369155454581669_v1 after read state TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 1(assignId:1) EndOffset 2 ReadOffset 2 ReadGuid 62d40a41-bf21c1a-bf8dbdca-9d46512 has messages 1
2025-11-26T18:42:04.428199Z :DEBUG: [] [] [3430877a-9305be47-dcd0f077-4a6fb492] [null] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-26T18:42:04.427416Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1951: session cookie 1 consumer shared/user session shared/user_12_1_1519369155454581669_v1 read done: guid# 62d40a41-bf21c1a-bf8dbdca-9d46512, partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 1(assignId:1), size# 199
2025-11-26T18:42:04.427448Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2113: session cookie 1 consumer shared/user session shared/user_12_1_1519369155454581669_v1 response to read: guid# 62d40a41-bf21c1a-bf8dbdca-9d46512
2025-11-26T18:42:04.427659Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2156: session cookie 1 consumer shared/user session shared/user_12_1_1519369155454581669_v1 Process answer. Aval parts: 0
2025-11-26T18:42:04.429971Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_12_1_1519369155454581669_v1 grpc read done: success# 1, data# { read { } }
2025-11-26T18:42:04.430110Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1850: session cookie 1 consumer shared/user session shared/user_12_1_1519369155454581669_v1 got read request: guid# 7bf0f58a-8adbf8c0-f7441e0b-f83e8d23
2025-11-26T18:42:04.433273Z node 13 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:42:04.433311Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:42:04.433328Z node 13 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:42:04.433354Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:42:04.433368Z node 13 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:42:04.501579Z node 13 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][1][StateIdle] Process user action and tx events
2025-11-26T18:42:04.501625Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][1][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:42:04.501644Z node 13 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][1][StateIdle] Process user action and tx pending commits
2025-11-26T18:42:04.501669Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][1][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:42:04.501686Z node 13 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][1][StateIdle] Try persist
2025-11-26T18:42:04.503124Z :INFO: [] MessageGroupId [source2] SessionId [source2|38b717a7-b94c3d12-20a34c8-cbe0d2a0_0] Write session will now close
2025-11-26T18:42:04.503176Z :DEBUG: [] MessageGroupId [source2] SessionId [source2|38b717a7-b94c3d12-20a34c8-cbe0d2a0_0] Write session: aborting
2025-11-26T18:42:04.503618Z :INFO: [] MessageGroupId [source2] SessionId [source2|38b717a7-b94c3d12-20a34c8-cbe0d2a0_0] Write session: gracefully shut down, all writes complete
2025-11-26T18:42:04.503656Z :DEBUG: [] MessageGroupId [source2] SessionId [source2|38b717a7-b94c3d12-20a34c8-cbe0d2a0_0] Write session: destroy
2025-11-26T18:42:04.505188Z :INFO: [] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:topic1:0:2:0:0 null:topic1:1:1:1:0
2025-11-26T18:42:04.505267Z :INFO: [] [] [3430877a-9305be47-dcd0f077-4a6fb492] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1006 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 81 BytesInflightTotal: 81 MessagesInflight: 3 }
2025-11-26T18:42:04.506387Z node 12 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3 sessionId: source2|38b717a7-b94c3d12-20a34c8-cbe0d2a0_0 grpc read done: success: 0 data: 
2025-11-26T18:42:04.506422Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 3 sessionId: source2|38b717a7-b94c3d12-20a34c8-cbe0d2a0_0 grpc read failed
2025-11-26T18:42:04.506464Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 3 sessionId: source2|38b717a7-b94c3d12-20a34c8-cbe0d2a0_0 grpc closed
2025-11-26T18:42:04.506489Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3 sessionId: source2|38b717a7-b94c3d12-20a34c8-cbe0d2a0_0 is DEAD
2025-11-26T18:42:04.507472Z node 12 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=1) Received event: NActors::TEvents::TEvPoison
2025-11-26T18:42:04.508838Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2745: [PQ: 72075186224037892] server disconnected, pipe [12:7577106248787911175:2511] destroyed
2025-11-26T18:42:04.508898Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][1][StateIdle] TPartition::DropOwner.
2025-11-26T18:42:04.508941Z node 13 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][1][StateIdle] Process user action and tx events
2025-11-26T18:42:04.508958Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][1][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:42:04.508976Z node 13 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][1][StateIdle] Process user action and tx pending commits
2025-11-26T18:42:04.509002Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][1][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:42:04.509018Z node 13 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][1][StateIdle] Try persist
2025-11-26T18:42:04.513745Z :DEBUG: [] MessageGroupId [source3] SessionId [] Write session: try to update token
2025-11-26T18:42:04.514157Z :INFO: [] MessageGroupId [source3] SessionId [] Write session: Do CDS request
2025-11-26T18:42:04.514203Z :INFO: [] MessageGroupId [source3] SessionId [] Start write session. Will connect to endpoint: localhost:21251
2025-11-26T18:42:04.528756Z :DEBUG: [] MessageGroupId [source3] SessionId [] Write session: send init request: init_request { topic: "topic1" message_group_id: "source3" }
2025-11-26T18:42:04.529403Z node 12 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-11-26T18:42:04.529444Z node 12 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 4
2025-11-26T18:42:04.530137Z node 12 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 4 sessionId:  grpc read done: success: 1 data: init_request { topic: "topic1" message_group_id: "source3" }
2025-11-26T18:42:04.530316Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 4 topic: "topic1" message_group_id: "source3" from ipv6:[::1]:40008
2025-11-26T18:42:04.530343Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=4 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40008 proto=v1  topic=topic1 durationSec=0
2025-11-26T18:42:04.530358Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-11-26T18:42:04.534894Z node 13 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:42:04.534928Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:42:04.534943Z node 13 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:42:04.534967Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:42:04.534980Z node 13 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:42:04.532578Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 4 sessionId:  describe result for acl check
2025-11-26T18:42:04.532755Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-11-26T18:42:04.532773Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-11-26T18:42:04.532790Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-11-26T18:42:04.532816Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [12:7577106248787911184:2515] (SourceId=source3, PreferedPartition=(NULL)) StartKqpSession
2025-11-26T18:42:04.537425Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [12:7577106248787911184:2515] (SourceId=source3, PreferedPartition=(NULL)) Select from the table
2025-11-26T18:42:04.555012Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [12:7577106248787911184:2515] (SourceId=source3, PreferedPartition=(NULL)) RequestPQRB
2025-11-26T18:42:04.555926Z node 12 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--topic1] pipe [12:7577106248787911204:2515] connected; active server actors: 1
2025-11-26T18:42:04.556090Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [12:7577106248787911184:2515] (SourceId=source3, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=source3
2025-11-26T18:42:04.556119Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [12:7577106248787911184:2515] (SourceId=source3, PreferedPartition=(NULL)) Update the table
2025-11-26T18:42:04.557371Z node 12 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--topic1] pipe [12:7577106248787911204:2515] disconnected; active server actors: 1
2025-11-26T18:42:04.557405Z node 12 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1689: [72075186224037893][rt3.dc1--topic1] pipe [12:7577106248787911204:2515] disconnected no session
2025-11-26T18:42:04.576777Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [12:7577106248787911184:2515] (SourceId=source3, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-11-26T18:42:04.576828Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [12:7577106248787911184:2515] (SourceId=source3, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-11-26T18:42:04.576858Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [12:7577106248787911184:2515] (SourceId=source3, PreferedPartition=(NULL)) Start idle
2025-11-26T18:42:04.576903Z node 12 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 4 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-11-26T18:42:04.578646Z node 12 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 13, Generation: 1
2025-11-26T18:42:04.580602Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 4 partition: 0 MaxSeqNo: 0 sessionId: source3|64cac67c-f54a8d9c-d90935b3-345b0c86_0
2025-11-26T18:42:04.578478Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2720: [PQ: 72075186224037892] server connected, pipe [12:7577106248787911214:2515], now have 1 active actors on pipe
2025-11-26T18:42:04.579005Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-26T18:42:04.579044Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-26T18:42:04.579132Z node 13 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie source3|64cac67c-f54a8d9c-d90935b3-345b0c86_0 generated for partition 0 topic 'rt3.dc1--topic1' owner source3
2025-11-26T18:42:04.579166Z node 13 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:42:04.579183Z node 13 :PERSQUEUE DEBUG: partition.cpp:2382: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-26T18:42:04.579207Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-26T18:42:04.579224Z node 13 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:42:04.579248Z node 13 :PERSQUEUE DEBUG: partition.cpp:2446: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-26T18:42:04.579286Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-26T18:42:04.581516Z :INFO: [] MessageGroupId [source3] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1764182524581 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-11-26T18:42:04.579305Z node 13 :PERSQUEUE DEBUG: partition.cpp:2301: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-26T18:42:04.579328Z node 13 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:42:04.579374Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-26T18:42:04.579431Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-26T18:42:04.580106Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-26T18:42:04.580130Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-26T18:42:04.580219Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-26T18:42:04.581668Z :INFO: [] MessageGroupId [source3] SessionId [] Write session established. Init response: session_id: "source3|64cac67c-f54a8d9c-d90935b3-345b0c86_0" topic: "topic1" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-11-26T18:42:04.581987Z :DEBUG: [] MessageGroupId [source3] SessionId [source3|64cac67c-f54a8d9c-d90935b3-345b0c86_0] Write 1 messages with Id from 1 to 1
2025-11-26T18:42:04.582094Z :INFO: [] MessageGroupId [source3] SessionId [source3|64cac67c-f54a8d9c-d90935b3-345b0c86_0] Write session: close. Timeout = 10000 ms
2025-11-26T18:42:04.582473Z :DEBUG: [] MessageGroupId [source3] SessionId [source3|64cac67c-f54a8d9c-d90935b3-345b0c86_0] Write session: try to update token
2025-11-26T18:42:04.582516Z :DEBUG: [] MessageGroupId [source3] SessionId [source3|64cac67c-f54a8d9c-d90935b3-345b0c86_0] Send 1 message(s) (0 left), first sequence number is 1
2025-11-26T18:42:04.585353Z node 12 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 4 sessionId: source3|64cac67c-f54a8d9c-d90935b3-345b0c86_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-26T18:42:04.585694Z node 12 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-26T18:42:04.586175Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-26T18:42:04.586222Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-26T18:42:04.586306Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-11-26T18:42:04.586622Z node 12 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-26T18:42:04.587126Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-26T18:42:04.587156Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-26T18:42:04.587232Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2009: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: '\0source3' SeqNo: 1 partNo : 0 messageNo: 1 size 98 offset: -1
2025-11-26T18:42:04.587282Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:633: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-26T18:42:04.587330Z node 13 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:42:04.587348Z node 13 :PERSQUEUE DEBUG: partition.cpp:2382: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-26T18:42:04.587382Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-26T18:42:04.587396Z node 13 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:42:04.587419Z node 13 :PERSQUEUE DEBUG: partition.cpp:2446: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-26T18:42:04.587541Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId '\0source3' seqNo 1 partNo 0
2025-11-26T18:42:04.604865Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:1428: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '\0source3' seqNo 1 partNo 0 FormedBlobsCount 0 NewHead: Offset 1 PartNo 0 PackedSize 173 count 1 nextOffset 2 batches 1
2025-11-26T18:42:04.605074Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-26T18:42:04.605097Z node 13 :PERSQUEUE DEBUG: partition.cpp:2301: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-26T18:42:04.605121Z node 13 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:42:04.605892Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:1680: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 1,1 HeadOffset 1 endOffset 1 curOffset 2 d0000000000_00000000000000000001_00000_0000000001_00000? size 161 WTime 1764182524604
2025-11-26T18:42:04.606131Z node 13 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][1][StateIdle] Process user action and tx events
2025-11-26T18:42:04.606147Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][1][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:42:04.606160Z node 13 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][1][StateIdle] Process user action and tx pending commits
2025-11-26T18:42:04.606179Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][1][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:42:04.606192Z node 13 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][1][StateIdle] Try persist
2025-11-26T18:42:04.606229Z node 13 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-26T18:42:04.606404Z node 13 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 1 partNo 0 count 1 size 161
2025-11-26T18:42:04.613648Z node 13 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 1 count 1 size 161 actorID [13:7577106237176073971:2391]
2025-11-26T18:42:04.613740Z node 13 :PERSQUEUE DEBUG: partition.cpp:2112: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-26T18:42:04.613818Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 106 WriteNewSizeFromSupportivePartitions# 0
2025-11-26T18:42:04.613859Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-26T18:42:04.613917Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0source3', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 1, partNo: 0, Offset: 1 is stored on disk
2025-11-26T18:42:04.614244Z node 13 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:42:04.614263Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:42:04.614281Z node 13 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:42:04.614301Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:42:04.614317Z node 13 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:42:04.614366Z node 13 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-26T18:42:04.614429Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 1  requestId: <none> cookie: 1
2025-11-26T18:42:04.614695Z node 13 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 1 partno 0 count 1 parts 0 suffix '63' size 161
2025-11-26T18:42:04.615041Z node 12 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 1 consumer shared/user session shared/user_12_1_1519369155454581669_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:2) wait for data done:  readOffset 1 EndOffset 1 newEndOffset 2 commitOffset 0 clientCommitOffset 0 cookie 2 readingFinished 0 firstRead 0
2025-11-26T18:42:04.615074Z node 12 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-26T18:42:04.615085Z node 12 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_12_1_1519369155454581669_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:2) ready for read with readOffset 1 endOffset 2
2025-11-26T18:42:04.615149Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_12_1_1519369155454581669_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:2), readOffset# 1, endOffset# 2, WTime# 1764182524197, sizeLag# 161
2025-11-26T18:42:04.615167Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2354: session cookie 1 consumer shared/user session shared/user_12_1_1519369155454581669_v1TEvPartitionReady. Aval parts: 1
2025-11-26T18:42:04.615215Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2277: session cookie 1 consumer shared/user session shared/user_12_1_1519369155454581669_v1 performing read request: guid# 7bf0f58a-8adbf8c0-f7441e0b-f83e8d23, from# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:2), count# 1, size# 193, partitionsAsked# 1, maxTimeLag# 0ms
2025-11-26T18:42:04.615268Z node 12 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_12_1_1519369155454581669_v1 READ FROM TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:2)maxCount 1 maxSize 193 maxTimeLagMs 0 readTimestampMs 0 readOffset 1 EndOffset 2 ClientCommitOffset 0 committedOffset 0 Guid 7bf0f58a-8adbf8c0-f7441e0b-f83e8d23
2025-11-26T18:42:04.616314Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-26T18:42:04.616365Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-26T18:42:04.616484Z node 13 :PERSQUEUE DEBUG: partition_read.cpp:872: [72075186224037892][Partition][0][StateIdle] read cookie 5 Topic 'rt3.dc1--topic1' partition 0 user user offset 1 partno 0 count 1 size 193 endOffset 2 max time lag 0ms effective offset 1
2025-11-26T18:42:04.616832Z node 13 :PERSQUEUE DEBUG: partition_read.cpp:1097: [72075186224037892][Partition][0][StateIdle] read cookie 5 added 1 blobs, size 161 count 1 last offset 1, current partition end offset: 2
2025-11-26T18:42:04.616855Z node 13 :PERSQUEUE DEBUG: partition_read.cpp:1113: [72075186224037892][Partition][0][StateIdle] Reading cookie 5. Send blob request.
2025-11-26T18:42:04.616910Z node 13 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 1 partno 0 count 1 parts_count 0 source 1 size 161 accessed 0 times before, last time 2025-11-26T18:42:04.000000Z
2025-11-26T18:42:04.616950Z node 13 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 5. All 1 blobs are from cache.
2025-11-26T18:42:04.617005Z node 13 :PERSQUEUE DEBUG: partition_read.cpp:569: FormAnswer for 1 blobs
2025-11-26T18:42:04.617193Z node 13 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 1 totakecount 1 count 1 size 141 from pos 0 cbcount 1
2025-11-26T18:42:04.617331Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-11-26T18:42:04.617829Z :DEBUG: [] MessageGroupId [source3] SessionId [source3|64cac67c-f54a8d9c-d90935b3-345b0c86_0] Write session got write response: sequence_numbers: 1 offsets: 1 already_written: false write_statistics { persist_duration_ms: 9 queued_in_partition_duration_ms: 18 }
2025-11-26T18:42:04.617916Z :DEBUG: [] MessageGroupId [source3] SessionId [source3|64cac67c-f54a8d9c-d90935b3-345b0c86_0] Write session: acknoledged message 1
2025-11-26T18:42:04.617813Z node 13 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 1 partno 0 count 1 parts 0 suffix '63'
2025-11-26T18:42:04.618298Z node 12 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_12_1_1519369155454581669_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:2) initDone 1 event { CmdReadResult { MaxOffset: 2 Result { Offset: 1 Data: "... 98 bytes ..." SourceId: "\000source3" SeqNo: 1 WriteTimestampMS: 1764182524585 CreateTimestampMS: 1764182524581 UncompressedSize: 15 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 20 RealReadOffset: 1 WaitQuotaTimeMs: 0 EndOffset: 2 StartOffset: 0 } Cookie: 1 }
2025-11-26T18:42:04.618422Z node 12 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_12_1_1519369155454581669_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:2) wait data in partition inited, cookie 3 from offset 2
2025-11-26T18:42:04.618465Z node 12 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_12_1_1519369155454581669_v1 after read state TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:2) EndOffset 2 ReadOffset 2 ReadGuid 7bf0f58a-8adbf8c0-f7441e0b-f83e8d23 has messages 1
2025-11-26T18:42:04.618579Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1951: session cookie 1 consumer shared/user session shared/user_12_1_1519369155454581669_v1 read done: guid# 7bf0f58a-8adbf8c0-f7441e0b-f83e8d23, partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:2), size# 197
2025-11-26T18:42:04.618607Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2113: session cookie 1 consumer shared/user session shared/user_12_1_1519369155454581669_v1 response to read: guid# 7bf0f58a-8adbf8c0-f7441e0b-f83e8d23
2025-11-26T18:42:04.618803Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2156: session cookie 1 consumer shared/user session shared/user_12_1_1519369155454581669_v1 Process answer. Aval parts: 0
2025-11-26T18:42:04.621400Z :DEBUG: [] [] [3430877a-9305be47-dcd0f077-4a6fb492] [null] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-26T18:42:04.622050Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_12_1_1519369155454581669_v1 grpc read done: success# 1, data# { read { } }
2025-11-26T18:42:04.622225Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1850: session cookie 1 consumer shared/user session shared/user_12_1_1519369155454581669_v1 got read request: guid# dbf2c5c5-22bbe06c-1dff7c21-26e1e60e
2025-11-26T18:42:04.635500Z node 13 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:42:04.635540Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:42:04.635553Z node 13 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:42:04.635573Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:42:04.635584Z node 13 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:42:04.682258Z :INFO: [] MessageGroupId [source3] SessionId [source3|64cac67c-f54a8d9c-d90935b3-345b0c86_0] Write session will now close
2025-11-26T18:42:04.682337Z :DEBUG: [] MessageGroupId [source3] SessionId [source3|64cac67c-f54a8d9c-d90935b3-345b0c86_0] Write session: aborting
2025-11-26T18:42:04.683281Z :INFO: [] MessageGroupId [source3] SessionId [source3|64cac67c-f54a8d9c-d90935b3-345b0c86_0] Write session: gracefully shut down, all writes complete
2025-11-26T18:42:04.683314Z :DEBUG: [] MessageGroupId [source3] SessionId [source3|64cac67c-f54a8d9c-d90935b3-345b0c86_0] Write session is aborting and will not restart
2025-11-26T18:42:04.683377Z :DEBUG: [] MessageGroupId [source3] SessionId [source3|64cac67c-f54a8d9c-d90935b3-345b0c86_0] Write session: destroy
2025-11-26T18:42:04.684620Z :DEBUG: [] MessageGroupId [source4] SessionId [] Write session: try to update token
2025-11-26T18:42:04.684998Z :INFO: [] MessageGroupId [source4] SessionId [] Write session: Do CDS request
2025-11-26T18:42:04.685037Z :INFO: [] MessageGroupId [source4] SessionId [] Start write session. Will connect to endpoint: localhost:21251
2025-11-26T18:42:04.687367Z node 12 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 4 sessionId: source3|64cac67c-f54a8d9c-d90935b3-345b0c86_0 grpc read done: success: 0 data: 
2025-11-26T18:42:04.687401Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 4 sessionId: source3|64cac67c-f54a8d9c-d90935b3-345b0c86_0 grpc read failed
2025-11-26T18:42:04.687441Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 4 sessionId: source3|64cac67c-f54a8d9c-d90935b3-345b0c86_0 grpc closed
2025-11-26T18:42:04.687470Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 4 sessionId: source3|64cac67c-f54a8d9c-d90935b3-345b0c86_0 is DEAD
2025-11-26T18:42:04.688727Z node 12 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-11-26T18:42:04.691102Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2745: [PQ: 72075186224037892] server disconnected, pipe [12:7577106248787911214:2515] destroyed
2025-11-26T18:42:04.691158Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-11-26T18:42:04.691198Z node 13 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:42:04.691216Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:42:04.691232Z node 13 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:42:04.691255Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:42:04.691270Z node 13 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:42:04.696824Z :DEBUG: [] MessageGroupId [source4] SessionId [] Write session: send init request: init_request { topic: "topic1" message_group_id: "source4" }
2025-11-26T18:42:04.697381Z node 12 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-11-26T18:42:04.697421Z node 12 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 5
2025-11-26T18:42:04.701257Z node 12 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 5 sessionId:  grpc read done: success: 1 data: init_request { topic: "topic1" message_group_id: "source4" }
2025-11-26T18:42:04.701470Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 5 topic: "topic1" message_group_id: "source4" from ipv6:[::1]:40008
2025-11-26T18:42:04.701494Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=5 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40008 proto=v1  topic=topic1 durationSec=0
2025-11-26T18:42:04.701509Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-11-26T18:42:04.704139Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 5 sessionId:  describe result for acl check
2025-11-26T18:42:04.704344Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-11-26T18:42:04.704363Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-11-26T18:42:04.704379Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-11-26T18:42:04.704406Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [12:7577106248787911223:2521] (SourceId=source4, PreferedPartition=(NULL)) StartKqpSession
2025-11-26T18:42:04.704814Z node 13 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][1][StateIdle] Process user action and tx events
2025-11-26T18:42:04.704844Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][1][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:42:04.704858Z node 13 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][1][StateIdle] Process user action and tx pending commits
2025-11-26T18:42:04.704896Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][1][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:42:04.704912Z node 13 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][1][StateIdle] Try persist
2025-11-26T18:42:04.716797Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [12:7577106248787911223:2521] (SourceId=source4, PreferedPartition=(NULL)) Select from the table
2025-11-26T18:42:04.730941Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [12:7577106248787911223:2521] (SourceId=source4, PreferedPartition=(NULL)) RequestPQRB
2025-11-26T18:42:04.731386Z node 12 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--topic1] pipe [12:7577106248787911244:2521] connected; active server actors: 1
2025-11-26T18:42:04.731420Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [12:7577106248787911223:2521] (SourceId=source4, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=source4
2025-11-26T18:42:04.731438Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [12:7577106248787911223:2521] (SourceId=source4, PreferedPartition=(NULL)) Update the table
2025-11-26T18:42:04.731991Z node 12 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--topic1] pipe [12:7577106248787911244:2521] disconnected; active server actors: 1
2025-11-26T18:42:04.732011Z node 12 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1689: [72075186224037893][rt3.dc1--topic1] pipe [12:7577106248787911244:2521] disconnected no session
2025-11-26T18:42:04.736322Z node 13 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:42:04.736356Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:42:04.736369Z node 13 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:42:04.736391Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:42:04.736406Z node 13 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:42:04.741686Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [12:7577106248787911223:2521] (SourceId=source4, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-11-26T18:42:04.741741Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [12:7577106248787911223:2521] (SourceId=source4, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-11-26T18:42:04.741771Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [12:7577106248787911223:2521] (SourceId=source4, PreferedPartition=(NULL)) Start idle
2025-11-26T18:42:04.741816Z node 12 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 5 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-11-26T18:42:04.744268Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2720: [PQ: 72075186224037892] server connected, pipe [12:7577106248787911253:2521], now have 1 active actors on pipe
2025-11-26T18:42:04.744602Z node 12 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 13, Generation: 1
2025-11-26T18:42:04.744882Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-26T18:42:04.744924Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-26T18:42:04.745011Z node 13 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie source4|b8dc4f28-dd7a008d-2e81e07a-6a20b923_0 generated for partition 0 topic 'rt3.dc1--topic1' owner source4
2025-11-26T18:42:04.745047Z node 13 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:42:04.745063Z node 13 :PERSQUEUE DEBUG: partition.cpp:2382: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-26T18:42:04.745087Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-26T18:42:04.745103Z node 13 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:42:04.745128Z node 13 :PERSQUEUE DEBUG: partition.cpp:2446: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-26T18:42:04.745167Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-26T18:42:04.745184Z node 13 :PERSQUEUE DEBUG: partition.cpp:2301: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-26T18:42:04.745206Z node 13 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:42:04.745282Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-26T18:42:04.745353Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-26T18:42:04.746365Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-26T18:42:04.746403Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-26T18:42:04.746486Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-26T18:42:04.746910Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 5 partition: 0 MaxSeqNo: 0 sessionId: source4|b8dc4f28-dd7a008d-2e81e07a-6a20b923_0
2025-11-26T18:42:04.747729Z :INFO: [] MessageGroupId [source4] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1764182524747 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-11-26T18:42:04.747870Z :INFO: [] MessageGroupId [source4] SessionId [] Write session established. Init response: session_id: "source4|b8dc4f28-dd7a008d-2e81e07a-6a20b923_0" topic: "topic1" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-11-26T18:42:04.748108Z :DEBUG: [] MessageGroupId [source4] SessionId [source4|b8dc4f28-dd7a008d-2e81e07a-6a20b923_0] Write 1 messages with Id from 1 to 1
2025-11-26T18:42:04.748178Z :INFO: [] MessageGroupId [source4] SessionId [source4|b8dc4f28-dd7a008d-2e81e07a-6a20b923_0] Write session: close. Timeout = 10000 ms
2025-11-26T18:42:04.748655Z :DEBUG: [] MessageGroupId [source4] SessionId [source4|b8dc4f28-dd7a008d-2e81e07a-6a20b923_0] Write session: try to update token
2025-11-26T18:42:04.748723Z :DEBUG: [] MessageGroupId [source4] SessionId [source4|b8dc4f28-dd7a008d-2e81e07a-6a20b923_0] Send 1 message(s) (0 left), first sequence number is 1
2025-11-26T18:42:04.749449Z node 12 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 5 sessionId: source4|b8dc4f28-dd7a008d-2e81e07a-6a20b923_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-26T18:42:04.749795Z node 12 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-26T18:42:04.750216Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-26T18:42:04.750255Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-26T18:42:04.750330Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-11-26T18:42:04.750613Z node 12 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-26T18:42:04.750980Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-26T18:42:04.751007Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-26T18:42:04.751074Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2009: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: '\0source4' SeqNo: 1 partNo : 0 messageNo: 1 size 98 offset: -1
2025-11-26T18:42:04.751118Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:633: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-26T18:42:04.751162Z node 13 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:42:04.751180Z node 13 :PERSQUEUE DEBUG: partition.cpp:2382: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-26T18:42:04.751213Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-26T18:42:04.751227Z node 13 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:42:04.751250Z node 13 :PERSQUEUE DEBUG: partition.cpp:2446: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-26T18:42:04.751366Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId '\0source4' seqNo 1 partNo 0
2025-11-26T18:42:04.752260Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:1428: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '\0source4' seqNo 1 partNo 0 FormedBlobsCount 0 NewHead: Offset 2 PartNo 0 PackedSize 173 count 1 nextOffset 3 batches 1
2025-11-26T18:42:04.752307Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-26T18:42:04.752323Z node 13 :PERSQUEUE DEBUG: partition.cpp:2301: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-26T18:42:04.752346Z node 13 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:42:04.753074Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:1680: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 2,1 HeadOffset 2 endOffset 2 curOffset 3 d0000000000_00000000000000000002_00000_0000000001_00000? size 161 WTime 1764182524752
2025-11-26T18:42:04.753284Z node 13 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-26T18:42:04.753446Z node 13 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 2 partNo 0 count 1 size 161
2025-11-26T18:42:04.759655Z node 13 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 2 count 1 size 161 actorID [13:7577106237176073971:2391]
2025-11-26T18:42:04.759741Z node 13 :PERSQUEUE DEBUG: partition.cpp:2112: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-26T18:42:04.759817Z node 13 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 2 partno 0 count 1 parts 0 suffix '63' size 161
2025-11-26T18:42:04.759822Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 106 WriteNewSizeFromSupportivePartitions# 0
2025-11-26T18:42:04.759861Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-26T18:42:04.759917Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0source4', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 1, partNo: 0, Offset: 2 is stored on disk
2025-11-26T18:42:04.760223Z node 13 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:42:04.760242Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:42:04.760265Z node 13 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:42:04.760284Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:42:04.760299Z node 13 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:42:04.760333Z node 13 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-26T18:42:04.760390Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 1  requestId: <none> cookie: 1
2025-11-26T18:42:04.760839Z node 12 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 1 consumer shared/user session shared/user_12_1_1519369155454581669_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:2) wait for data done:  readOffset 2 EndOffset 2 newEndOffset 3 commitOffset 0 clientCommitOffset 0 cookie 3 readingFinished 0 firstRead 0
2025-11-26T18:42:04.760883Z node 12 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_12_1_1519369155454581669_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:2) ready for read with readOffset 2 endOffset 3
2025-11-26T18:42:04.760957Z node 12 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-26T18:42:04.761515Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_12_1_1519369155454581669_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:2), readOffset# 2, endOffset# 3, WTime# 1764182524585, sizeLag# 161
2025-11-26T18:42:04.761534Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2354: session cookie 1 consumer shared/user session shared/user_12_1_1519369155454581669_v1TEvPartitionReady. Aval parts: 1
2025-11-26T18:42:04.761588Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2277: session cookie 1 consumer shared/user session shared/user_12_1_1519369155454581669_v1 performing read request: guid# dbf2c5c5-22bbe06c-1dff7c21-26e1e60e, from# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:2), count# 1, size# 193, partitionsAsked# 1, maxTimeLag# 0ms
2025-11-26T18:42:04.761647Z node 12 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_12_1_1519369155454581669_v1 READ FROM TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:2)maxCount 1 maxSize 193 maxTimeLagMs 0 readTimestampMs 0 readOffset 2 EndOffset 3 ClientCommitOffset 0 committedOffset 0 Guid dbf2c5c5-22bbe06c-1dff7c21-26e1e60e
2025-11-26T18:42:04.762232Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-26T18:42:04.762290Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-26T18:42:04.762367Z :DEBUG: [] MessageGroupId [source4] SessionId [source4|b8dc4f28-dd7a008d-2e81e07a-6a20b923_0] Write session got write response: sequence_numbers: 1 offsets: 2 already_written: false write_statistics { persist_duration_ms: 7 queued_in_partition_duration_ms: 1 }
2025-11-26T18:42:04.762430Z :DEBUG: [] MessageGroupId [source4] SessionId [source4|b8dc4f28-dd7a008d-2e81e07a-6a20b923_0] Write session: acknoledged message 1
2025-11-26T18:42:04.762422Z node 13 :PERSQUEUE DEBUG: partition_read.cpp:872: [72075186224037892][Partition][0][StateIdle] read cookie 6 Topic 'rt3.dc1--topic1' partition 0 user user offset 2 partno 0 count 1 size 193 endOffset 3 max time lag 0ms effective offset 2
2025-11-26T18:42:04.762789Z node 13 :PERSQUEUE DEBUG: partition_read.cpp:1097: [72075186224037892][Partition][0][StateIdle] read cookie 6 added 1 blobs, size 161 count 1 last offset 2, current partition end offset: 3
2025-11-26T18:42:04.762820Z node 13 :PERSQUEUE DEBUG: partition_read.cpp:1113: [72075186224037892][Partition][0][StateIdle] Reading cookie 6. Send blob request.
2025-11-26T18:42:04.762882Z node 13 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 2 partno 0 count 1 parts_count 0 source 1 size 161 accessed 0 times before, last time 2025-11-26T18:42:04.000000Z
2025-11-26T18:42:04.762929Z node 13 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 6. All 1 blobs are from cache.
2025-11-26T18:42:04.763005Z node 13 :PERSQUEUE DEBUG: partition_read.cpp:569: FormAnswer for 1 blobs
2025-11-26T18:42:04.763192Z node 13 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 2 totakecount 1 count 1 size 141 from pos 0 cbcount 1
2025-11-26T18:42:04.763326Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 2
2025-11-26T18:42:04.763480Z node 13 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 2 partno 0 count 1 parts 0 suffix '63'
2025-11-26T18:42:04.763856Z node 12 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_12_1_1519369155454581669_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:2) initDone 1 event { CmdReadResult { MaxOffset: 3 Result { Offset: 2 Data: "... 98 bytes ..." SourceId: "\000source4" SeqNo: 1 WriteTimestampMS: 1764182524751 CreateTimestampMS: 1764182524748 UncompressedSize: 15 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 20 RealReadOffset: 2 WaitQuotaTimeMs: 0 EndOffset: 3 StartOffset: 0 } Cookie: 2 }
2025-11-26T18:42:04.763950Z node 12 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_12_1_1519369155454581669_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:2) wait data in partition inited, cookie 4 from offset 3
2025-11-26T18:42:04.763986Z node 12 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_12_1_1519369155454581669_v1 after read state TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:2) EndOffset 3 ReadOffset 3 ReadGuid dbf2c5c5-22bbe06c-1dff7c21-26e1e60e has messages 1
2025-11-26T18:42:04.764106Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1951: session cookie 1 consumer shared/user session shared/user_12_1_1519369155454581669_v1 read done: guid# dbf2c5c5-22bbe06c-1dff7c21-26e1e60e, partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:2), size# 197
2025-11-26T18:42:04.764144Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2113: session cookie 1 consumer shared/user session shared/user_12_1_1519369155454581669_v1 response to read: guid# dbf2c5c5-22bbe06c-1dff7c21-26e1e60e
2025-11-26T18:42:04.764389Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2156: session cookie 1 consumer shared/user session shared/user_12_1_1519369155454581669_v1 Process answer. Aval parts: 0
2025-11-26T18:42:04.765820Z :DEBUG: [] [] [3430877a-9305be47-dcd0f077-4a6fb492] [null] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-26T18:42:04.766011Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_12_1_1519369155454581669_v1 grpc read done: success# 1, data# { read { } }
2025-11-26T18:42:04.766151Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1850: session cookie 1 consumer shared/user session shared/user_12_1_1519369155454581669_v1 got read request: guid# 45687fb4-cf0af337-7765959-a28804c5
2025-11-26T18:42:04.804993Z node 13 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][1][StateIdle] Process user action and tx events
2025-11-26T18:42:04.805028Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][1][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:42:04.805044Z node 13 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][1][StateIdle] Process user action and tx pending commits
2025-11-26T18:42:04.805066Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][1][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:42:04.805080Z node 13 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][1][StateIdle] Try persist
2025-11-26T18:42:04.836743Z node 13 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:42:04.836782Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:42:04.836795Z node 13 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:42:04.836819Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:42:04.836831Z node 13 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:42:04.848297Z :INFO: [] MessageGroupId [source4] SessionId [source4|b8dc4f28-dd7a008d-2e81e07a-6a20b923_0] Write session will now close
2025-11-26T18:42:04.848355Z :DEBUG: [] MessageGroupId [source4] SessionId [source4|b8dc4f28-dd7a008d-2e81e07a-6a20b923_0] Write session: aborting
2025-11-26T18:42:04.848783Z :INFO: [] MessageGroupId [source4] SessionId [source4|b8dc4f28-dd7a008d-2e81e07a-6a20b923_0] Write session: gracefully shut down, all writes complete
2025-11-26T18:42:04.848817Z :DEBUG: [] MessageGroupId [source4] SessionId [source4|b8dc4f28-dd7a008d-2e81e07a-6a20b923_0] Write session: destroy
2025-11-26T18:42:04.850199Z :DEBUG: [] MessageGroupId [source5] SessionId [] Write session: try to update token
2025-11-26T18:42:04.852142Z :INFO: [] MessageGroupId [source5] SessionId [] Write session: Do CDS request
2025-11-26T18:42:04.852183Z :INFO: [] MessageGroupId [source5] SessionId [] Start write session. Will connect to endpoint: localhost:21251
2025-11-26T18:42:04.849735Z node 12 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 5 sessionId: source4|b8dc4f28-dd7a008d-2e81e07a-6a20b923_0 grpc read done: success: 0 data: 
2025-11-26T18:42:04.849770Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 5 sessionId: source4|b8dc4f28-dd7a008d-2e81e07a-6a20b923_0 grpc read failed
2025-11-26T18:42:04.849831Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:824: session v1 closed cookie: 5 sessionId: source4|b8dc4f28-dd7a008d-2e81e07a-6a20b923_0
2025-11-26T18:42:04.849856Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 5 sessionId: source4|b8dc4f28-dd7a008d-2e81e07a-6a20b923_0 is DEAD
2025-11-26T18:42:04.850276Z node 12 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-11-26T18:42:04.857327Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2745: [PQ: 72075186224037892] server disconnected, pipe [12:7577106248787911253:2521] destroyed
2025-11-26T18:42:04.857386Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-11-26T18:42:04.857423Z node 13 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:42:04.857439Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:42:04.857455Z node 13 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:42:04.857479Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:42:04.857492Z node 13 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:42:04.862347Z :DEBUG: [] MessageGroupId [source5] SessionId [] Write session: send init request: init_request { topic: "topic1" message_group_id: "source5" }
2025-11-26T18:42:04.864457Z node 12 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-11-26T18:42:04.864508Z node 12 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 6
2025-11-26T18:42:04.864875Z node 12 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 6 sessionId:  grpc read done: success: 1 data: init_request { topic: "topic1" message_group_id: "source5" }
2025-11-26T18:42:04.865046Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 6 topic: "topic1" message_group_id: "source5" from ipv6:[::1]:40008
2025-11-26T18:42:04.865076Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=6 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40008 proto=v1  topic=topic1 durationSec=0
2025-11-26T18:42:04.865089Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-11-26T18:42:04.867120Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 6 sessionId:  describe result for acl check
2025-11-26T18:42:04.867276Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-11-26T18:42:04.867297Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-11-26T18:42:04.867313Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-11-26T18:42:04.867340Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [12:7577106248787911270:2529] (SourceId=source5, PreferedPartition=(NULL)) StartKqpSession
2025-11-26T18:42:04.871525Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [12:7577106248787911270:2529] (SourceId=source5, PreferedPartition=(NULL)) Select from the table
2025-11-26T18:42:04.879716Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [12:7577106248787911270:2529] (SourceId=source5, PreferedPartition=(NULL)) RequestPQRB
2025-11-26T18:42:04.880210Z node 12 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--topic1] pipe [12:7577106248787911289:2529] connected; active server actors: 1
2025-11-26T18:42:04.880259Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [12:7577106248787911270:2529] (SourceId=source5, PreferedPartition=(NULL)) Received partition 1 from PQRB for SourceId=source5
2025-11-26T18:42:04.880284Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [12:7577106248787911270:2529] (SourceId=source5, PreferedPartition=(NULL)) Update the table
2025-11-26T18:42:04.880614Z node 12 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--topic1] pipe [12:7577106248787911289:2529] disconnected; active server actors: 1
2025-11-26T18:42:04.880643Z node 12 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1689: [72075186224037893][rt3.dc1--topic1] pipe [12:7577106248787911289:2529] disconnected no session
2025-11-26T18:42:04.892056Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [12:7577106248787911270:2529] (SourceId=source5, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-11-26T18:42:04.892107Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [12:7577106248787911270:2529] (SourceId=source5, PreferedPartition=(NULL)) ReplyResult: Partition=1, SeqNo=(NULL)
2025-11-26T18:42:04.892137Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [12:7577106248787911270:2529] (SourceId=source5, PreferedPartition=(NULL)) Start idle
2025-11-26T18:42:04.892180Z node 12 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 6 sessionId:  partition: 1 expectedGeneration: (NULL)
2025-11-26T18:42:04.894301Z node 12 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=1) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 13, Generation: 1
2025-11-26T18:42:04.894307Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2720: [PQ: 72075186224037892] server connected, pipe [12:7577106248787911299:2529], now have 1 active actors on pipe
2025-11-26T18:42:04.894633Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-26T18:42:04.894678Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 1
2025-11-26T18:42:04.894777Z node 13 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie source5|1a2750ca-f3003e6d-1013c9e9-d3919b45_0 generated for partition 1 topic 'rt3.dc1--topic1' owner source5
2025-11-26T18:42:04.894816Z node 13 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][1][StateIdle] Process user action and tx events
2025-11-26T18:42:04.894837Z node 13 :PERSQUEUE DEBUG: partition.cpp:2382: [72075186224037892][Partition][1][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-26T18:42:04.894858Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][1][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-26T18:42:04.894873Z node 13 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][1][StateIdle] Process user action and tx pending commits
2025-11-26T18:42:04.894896Z node 13 :PERSQUEUE DEBUG: partition.cpp:2446: [72075186224037892][Partition][1][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-26T18:42:04.894931Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][1][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-26T18:42:04.894953Z node 13 :PERSQUEUE DEBUG: partition.cpp:2301: [72075186224037892][Partition][1][StateIdle] Batch completed (1)
2025-11-26T18:42:04.894973Z node 13 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][1][StateIdle] Try persist
2025-11-26T18:42:04.895019Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][1][StateIdle] TPartition::ReplyOwnerOk. Partition: 1
2025-11-26T18:42:04.895076Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 1 messageNo: 0  requestId: <none> cookie: 0
2025-11-26T18:42:04.895829Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-26T18:42:04.895855Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 1
2025-11-26T18:42:04.895934Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 1 messageNo: 0  requestId: <none> cookie: 0
2025-11-26T18:42:04.896219Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 6 partition: 1 MaxSeqNo: 0 sessionId: source5|1a2750ca-f3003e6d-1013c9e9-d3919b45_0
2025-11-26T18:42:04.901433Z :INFO: [] MessageGroupId [source5] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1764182524901 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-11-26T18:42:04.901585Z :INFO: [] MessageGroupId [source5] SessionId [] Write session established. Init response: session_id: "source5|1a2750ca-f3003e6d-1013c9e9-d3919b45_0" topic: "topic1" cluster: "dc1" partition_id: 1 supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-11-26T18:42:04.901901Z :DEBUG: [] MessageGroupId [source5] SessionId [source5|1a2750ca-f3003e6d-1013c9e9-d3919b45_0] Write 1 messages with Id from 1 to 1
2025-11-26T18:42:04.901981Z :INFO: [] MessageGroupId [source5] SessionId [source5|1a2750ca-f3003e6d-1013c9e9-d3919b45_0] Write session: close. Timeout = 10000 ms
2025-11-26T18:42:04.905688Z :DEBUG: [] MessageGroupId [source5] SessionId [source5|1a2750ca-f3003e6d-1013c9e9-d3919b45_0] Write session: try to update token
2025-11-26T18:42:04.905759Z :DEBUG: [] MessageGroupId [source5] SessionId [source5|1a2750ca-f3003e6d-1013c9e9-d3919b45_0] Send 1 message(s) (0 left), first sequence number is 1
2025-11-26T18:42:04.908137Z node 13 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][1][StateIdle] Process user action and tx events
2025-11-26T18:42:04.908173Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][1][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:42:04.908188Z node 13 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][1][StateIdle] Process user action and tx pending commits
2025-11-26T18:42:04.908211Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][1][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:42:04.908225Z node 13 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][1][StateIdle] Try persist
2025-11-26T18:42:04.908186Z node 12 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 6 sessionId: source5|1a2750ca-f3003e6d-1013c9e9-d3919b45_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-26T18:42:04.908580Z node 12 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=1) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-26T18:42:04.909501Z node 12 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=1) Received event: NActors::IEventHandle
2025-11-26T18:42:04.909176Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-26T18:42:04.909224Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 1
2025-11-26T18:42:04.909324Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 1 messageNo: 0  requestId: <none> cookie: 1
2025-11-26T18:42:04.910057Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-26T18:42:04.910093Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 1
2025-11-26T18:42:04.910164Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2009: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 1 SourceId: '\0source5' SeqNo: 1 partNo : 0 messageNo: 1 size 98 offset: -1
2025-11-26T18:42:04.910219Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:633: [72075186224037892][Partition][1][StateIdle] Received TPartition::TEvWrite
2025-11-26T18:42:04.910266Z node 13 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][1][StateIdle] Process user action and tx events
2025-11-26T18:42:04.910284Z node 13 :PERSQUEUE DEBUG: partition.cpp:2382: [72075186224037892][Partition][1][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-26T18:42:04.910316Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][1][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-26T18:42:04.910330Z node 13 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][1][StateIdle] Process user action and tx pending commits
2025-11-26T18:42:04.910352Z node 13 :PERSQUEUE DEBUG: partition.cpp:2446: [72075186224037892][Partition][1][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-26T18:42:04.910473Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][1][StateIdle] Topic 'rt3.dc1--topic1' partition 1 part blob processing sourceId '\0source5' seqNo 1 partNo 0
2025-11-26T18:42:04.911373Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:1428: [72075186224037892][Partition][1][StateIdle] Topic 'rt3.dc1--topic1' partition 1 part blob complete sourceId '\0source5' seqNo 1 partNo 0 FormedBlobsCount 0 NewHead: Offset 2 PartNo 0 PackedSize 173 count 1 nextOffset 3 batches 1
2025-11-26T18:42:04.911412Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][1][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-26T18:42:04.911429Z node 13 :PERSQUEUE DEBUG: partition.cpp:2301: [72075186224037892][Partition][1][StateIdle] Batch completed (1)
2025-11-26T18:42:04.911452Z node 13 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][1][StateIdle] Try persist
2025-11-26T18:42:04.912150Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:1680: [72075186224037892][Partition][1][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 1 compactOffset 2,1 HeadOffset 2 endOffset 2 curOffset 3 d0000000001_00000000000000000002_00000_0000000001_00000? size 161 WTime 1764182524911
2025-11-26T18:42:04.912340Z node 13 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-26T18:42:04.912547Z node 13 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 1 offset 2 partNo 0 count 1 size 161
2025-11-26T18:42:04.918626Z node 13 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 1 offset 2 count 1 size 161 actorID [13:7577106237176073971:2391]
2025-11-26T18:42:04.918694Z node 13 :PERSQUEUE DEBUG: partition.cpp:2112: [72075186224037892][Partition][1][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-26T18:42:04.918753Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037892][Partition][1][StateIdle] TPartition::HandleWriteResponse writeNewSize# 106 WriteNewSizeFromSupportivePartitions# 0
2025-11-26T18:42:04.918781Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][1][StateIdle] TPartition::ReplyWrite. Partition: 1
2025-11-26T18:42:04.918827Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][1][StateIdle] Answering for message sourceid: '\0source5', Topic: 'rt3.dc1--topic1', Partition: 1, SeqNo: 1, partNo: 0, Offset: 2 is stored on disk
2025-11-26T18:42:04.919063Z node 13 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][1][StateIdle] Process user action and tx events
2025-11-26T18:42:04.919076Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][1][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:42:04.919088Z node 13 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][1][StateIdle] Process user action and tx pending commits
2025-11-26T18:42:04.919100Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][1][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:42:04.919111Z node 13 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][1][StateIdle] Try persist
2025-11-26T18:42:04.919134Z node 13 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][1][StateIdle] No data for blobs compaction
2025-11-26T18:42:04.919154Z node 13 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 1 offset 2 partno 0 count 1 parts 0 suffix '63' size 161
2025-11-26T18:42:04.919174Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 1 messageNo: 1  requestId: <none> cookie: 1
2025-11-26T18:42:04.919407Z node 12 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 1 consumer shared/user session shared/user_12_1_1519369155454581669_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 1(assignId:1) wait for data done:  readOffset 2 EndOffset 2 newEndOffset 3 commitOffset 0 clientCommitOffset 0 cookie 3 readingFinished 0 firstRead 0
2025-11-26T18:42:04.919454Z node 12 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_12_1_1519369155454581669_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 1(assignId:1) ready for read with readOffset 2 endOffset 3
2025-11-26T18:42:04.919526Z node 12 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=1) Received event: NActors::IEventHandle
2025-11-26T18:42:04.919987Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_12_1_1519369155454581669_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 1(assignId:1), readOffset# 2, endOffset# 3, WTime# 1764182524404, sizeLag# 161
2025-11-26T18:42:04.920020Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2354: session cookie 1 consumer shared/user session shared/user_12_1_1519369155454581669_v1TEvPartitionReady. Aval parts: 1
2025-11-26T18:42:04.920071Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2277: session cookie 1 consumer shared/user session shared/user_12_1_1519369155454581669_v1 performing read request: guid# 45687fb4-cf0af337-7765959-a28804c5, from# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 1(assignId:1), count# 1, size# 193, partitionsAsked# 1, maxTimeLag# 0ms
2025-11-26T18:42:04.920129Z node 12 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_12_1_1519369155454581669_v1 READ FROM TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 1(assignId:1)maxCount 1 maxSize 193 maxTimeLagMs 0 readTimestampMs 0 readOffset 2 EndOffset 3 ClientCommitOffset 0 committedOffset 0 Guid 45687fb4-cf0af337-7765959-a28804c5
2025-11-26T18:42:04.920487Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-26T18:42:04.920534Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 1
2025-11-26T18:42:04.920639Z node 13 :PERSQUEUE DEBUG: partition_read.cpp:872: [72075186224037892][Partition][1][StateIdle] read cookie 6 Topic 'rt3.dc1--topic1' partition 1 user user offset 2 partno 0 count 1 size 193 endOffset 3 max time lag 0ms effective offset 2
2025-11-26T18:42:04.920899Z node 13 :PERSQUEUE DEBUG: partition_read.cpp:1097: [72075186224037892][Partition][1][StateIdle] read cookie 6 added 1 blobs, size 161 count 1 last offset 2, current partition end offset: 3
2025-11-26T18:42:04.920916Z node 13 :PERSQUEUE DEBUG: partition_read.cpp:1113: [72075186224037892][Partition][1][StateIdle] Reading cookie 6. Send blob request.
2025-11-26T18:42:04.920958Z node 13 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 1 offset 2 partno 0 count 1 parts_count 0 source 1 size 161 accessed 0 times before, last time 2025-11-26T18:42:04.000000Z
2025-11-26T18:42:04.920983Z node 13 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 6. All 1 blobs are from cache.
2025-11-26T18:42:04.921021Z node 13 :PERSQUEUE DEBUG: partition_read.cpp:569: FormAnswer for 1 blobs
2025-11-26T18:42:04.921185Z node 13 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 2 totakecount 1 count 1 size 141 from pos 0 cbcount 1
2025-11-26T18:42:04.921323Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 1 messageNo: 0  requestId: <none> cookie: 2
2025-11-26T18:42:04.921376Z node 13 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 1 offset 2 partno 0 count 1 parts 0 suffix '63'
2025-11-26T18:42:04.921746Z :DEBUG: [] MessageGroupId [source5] SessionId [source5|1a2750ca-f3003e6d-1013c9e9-d3919b45_0] Write session got write response: sequence_numbers: 1 offsets: 2 already_written: false partition_id: 1 write_statistics { persist_duration_ms: 7 queued_in_partition_duration_ms: 1 }
2025-11-26T18:42:04.921821Z :DEBUG: [] MessageGroupId [source5] SessionId [source5|1a2750ca-f3003e6d-1013c9e9-d3919b45_0] Write session: acknoledged message 1
2025-11-26T18:42:04.924239Z node 12 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_12_1_1519369155454581669_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 1(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 3 Result { Offset: 2 Data: "... 98 bytes ..." SourceId: "\000source5" SeqNo: 1 WriteTimestampMS: 1764182524910 CreateTimestampMS: 1764182524901 UncompressedSize: 15 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 20 RealReadOffset: 2 WaitQuotaTimeMs: 0 EndOffset: 3 StartOffset: 0 } Cookie: 2 }
2025-11-26T18:42:04.924379Z node 12 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_12_1_1519369155454581669_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 1(assignId:1) wait data in partition inited, cookie 4 from offset 3
2025-11-26T18:42:04.924422Z node 12 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_12_1_1519369155454581669_v1 after read state TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 1(assignId:1) EndOffset 3 ReadOffset 3 ReadGuid 45687fb4-cf0af337-7765959-a28804c5 has messages 1
2025-11-26T18:42:04.924583Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1951: session cookie 1 consumer shared/user session shared/user_12_1_1519369155454581669_v1 read done: guid# 45687fb4-cf0af337-7765959-a28804c5, partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 1(assignId:1), size# 199
2025-11-26T18:42:04.924622Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2113: session cookie 1 consumer shared/user session shared/user_12_1_1519369155454581669_v1 response to read: guid# 45687fb4-cf0af337-7765959-a28804c5
2025-11-26T18:42:04.924855Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2156: session cookie 1 consumer shared/user session shared/user_12_1_1519369155454581669_v1 Process answer. Aval parts: 0
2025-11-26T18:42:04.925750Z :DEBUG: [] [] [3430877a-9305be47-dcd0f077-4a6fb492] [null] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-26T18:42:04.926474Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_12_1_1519369155454581669_v1 grpc read done: success# 1, data# { read { } }
2025-11-26T18:42:04.926598Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1850: session cookie 1 consumer shared/user session shared/user_12_1_1519369155454581669_v1 got read request: guid# b235869-cebc24da-f3649b73-ba0cb1d2
2025-11-26T18:42:04.937046Z node 13 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:42:04.937075Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:42:04.937085Z node 13 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:42:04.937102Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:42:04.937111Z node 13 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:42:05.002167Z :INFO: [] MessageGroupId [source5] SessionId [source5|1a2750ca-f3003e6d-1013c9e9-d3919b45_0] Write session will now close
2025-11-26T18:42:05.002208Z :DEBUG: [] MessageGroupId [source5] SessionId [source5|1a2750ca-f3003e6d-1013c9e9-d3919b45_0] Write session: aborting
2025-11-26T18:42:05.002924Z :INFO: [] MessageGroupId [source5] SessionId [source5|1a2750ca-f3003e6d-1013c9e9-d3919b45_0] Write session: gracefully shut down, all writes complete
2025-11-26T18:42:05.002950Z :DEBUG: [] MessageGroupId [source5] SessionId [source5|1a2750ca-f3003e6d-1013c9e9-d3919b45_0] Write session is aborting and will not restart
2025-11-26T18:42:05.002998Z :DEBUG: [] MessageGroupId [source5] SessionId [source5|1a2750ca-f3003e6d-1013c9e9-d3919b45_0] Write session: destroy
2025-11-26T18:42:05.004055Z :DEBUG: [] MessageGroupId [source6] SessionId [] Write session: try to update token
2025-11-26T18:42:05.003316Z node 12 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 6 sessionId: source5|1a2750ca-f3003e6d-1013c9e9-d3919b45_0 grpc read done: success: 0 data: 
2025-11-26T18:42:05.003352Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 6 sessionId: source5|1a2750ca-f3003e6d-1013c9e9-d3919b45_0 grpc read failed
2025-11-26T18:42:05.003392Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 6 sessionId: source5|1a2750ca-f3003e6d-1013c9e9-d3919b45_0 grpc closed
2025-11-26T18:42:05.003418Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 6 sessionId: source5|1a2750ca-f3003e6d-1013c9e9-d3919b45_0 is DEAD
2025-11-26T18:42:05.004694Z node 12 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=1) Received event: NActors::TEvents::TEvPoison
2025-11-26T18:42:05.004820Z :INFO: [] MessageGroupId [source6] SessionId [] Write session: Do CDS request
2025-11-26T18:42:05.004861Z :INFO: [] MessageGroupId [source6] SessionId [] Start write session. Will connect to endpoint: localhost:21251
2025-11-26T18:42:05.005189Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2745: [PQ: 72075186224037892] server disconnected, pipe [12:7577106248787911299:2529] destroyed
2025-11-26T18:42:05.005263Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][1][StateIdle] TPartition::DropOwner.
2025-11-26T18:42:05.005303Z node 13 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][1][StateIdle] Process user action and tx events
2025-11-26T18:42:05.005320Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][1][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:42:05.005336Z node 13 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][1][StateIdle] Process user action and tx pending commits
2025-11-26T18:42:05.005359Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][1][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:42:05.005373Z node 13 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][1][StateIdle] Try persist
2025-11-26T18:42:05.008736Z node 13 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][1][StateIdle] Process user action and tx events
2025-11-26T18:42:05.008784Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][1][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:42:05.008799Z node 13 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][1][StateIdle] Process user action and tx pending commits
2025-11-26T18:42:05.008822Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][1][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:42:05.008836Z node 13 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][1][StateIdle] Try persist
2025-11-26T18:42:05.014701Z :DEBUG: [] MessageGroupId [source6] SessionId [] Write session: send init request: init_request { topic: "topic1" message_group_id: "source6" }
2025-11-26T18:42:05.015106Z node 12 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-11-26T18:42:05.015148Z node 12 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 7
2025-11-26T18:42:05.015501Z node 12 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 7 sessionId:  grpc read done: success: 1 data: init_request { topic: "topic1" message_group_id: "source6" }
2025-11-26T18:42:05.015685Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 7 topic: "topic1" message_group_id: "source6" from ipv6:[::1]:40008
2025-11-26T18:42:05.015714Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=7 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40008 proto=v1  topic=topic1 durationSec=0
2025-11-26T18:42:05.015725Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-11-26T18:42:05.017205Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 7 sessionId:  describe result for acl check
2025-11-26T18:42:05.017366Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-11-26T18:42:05.017389Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-11-26T18:42:05.017405Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-11-26T18:42:05.017429Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [12:7577106253082878600:2533] (SourceId=source6, PreferedPartition=(NULL)) StartKqpSession
2025-11-26T18:42:05.020978Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [12:7577106253082878600:2533] (SourceId=source6, PreferedPartition=(NULL)) Select from the table
2025-11-26T18:42:05.030280Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [12:7577106253082878600:2533] (SourceId=source6, PreferedPartition=(NULL)) RequestPQRB
2025-11-26T18:42:05.031440Z node 12 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--topic1] pipe [12:7577106253082878619:2533] connected; active server actors: 1
2025-11-26T18:42:05.031507Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [12:7577106253082878600:2533] (SourceId=source6, PreferedPartition=(NULL)) Received partition 1 from PQRB for SourceId=source6
2025-11-26T18:42:05.031533Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [12:7577106253082878600:2533] (SourceId=source6, PreferedPartition=(NULL)) Update the table
2025-11-26T18:42:05.032341Z node 12 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--topic1] pipe [12:7577106253082878619:2533] disconnected; active server actors: 1
2025-11-26T18:42:05.032380Z node 12 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1689: [72075186224037893][rt3.dc1--topic1] pipe [12:7577106253082878619:2533] disconnected no session
2025-11-26T18:42:05.037529Z node 13 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:42:05.037572Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:42:05.037587Z node 13 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:42:05.037608Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:42:05.037621Z node 13 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:42:05.042086Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [12:7577106253082878600:2533] (SourceId=source6, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-11-26T18:42:05.042137Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [12:7577106253082878600:2533] (SourceId=source6, PreferedPartition=(NULL)) ReplyResult: Partition=1, SeqNo=(NULL)
2025-11-26T18:42:05.042163Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [12:7577106253082878600:2533] (SourceId=source6, PreferedPartition=(NULL)) Start idle
2025-11-26T18:42:05.042201Z node 12 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 7 sessionId:  partition: 1 expectedGeneration: (NULL)
2025-11-26T18:42:05.043943Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2720: [PQ: 72075186224037892] server connected, pipe [12:7577106253082878628:2533], now have 1 active actors on pipe
2025-11-26T18:42:05.044141Z node 12 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=1) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 13, Generation: 1
2025-11-26T18:42:05.044469Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-26T18:42:05.044525Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 1
2025-11-26T18:42:05.044616Z node 13 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie source6|308bc7b1-43555b35-d5df2c1-387436fb_0 generated for partition 1 topic 'rt3.dc1--topic1' owner source6
2025-11-26T18:42:05.044651Z node 13 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][1][StateIdle] Process user action and tx events
2025-11-26T18:42:05.044668Z node 13 :PERSQUEUE DEBUG: partition.cpp:2382: [72075186224037892][Partition][1][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-26T18:42:05.044692Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][1][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-26T18:42:05.044708Z node 13 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][1][StateIdle] Process user action and tx pending commits
2025-11-26T18:42:05.044733Z node 13 :PERSQUEUE DEBUG: partition.cpp:2446: [72075186224037892][Partition][1][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-26T18:42:05.044770Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][1][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-26T18:42:05.044785Z node 13 :PERSQUEUE DEBUG: partition.cpp:2301: [72075186224037892][Partition][1][StateIdle] Batch completed (1)
2025-11-26T18:42:05.044807Z node 13 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][1][StateIdle] Try persist
2025-11-26T18:42:05.044856Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][1][StateIdle] TPartition::ReplyOwnerOk. Partition: 1
2025-11-26T18:42:05.044913Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 1 messageNo: 0  requestId: <none> cookie: 0
2025-11-26T18:42:05.047801Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-26T18:42:05.047850Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 1
2025-11-26T18:42:05.047942Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 1 messageNo: 0  requestId: <none> cookie: 0
2025-11-26T18:42:05.048281Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 7 partition: 1 MaxSeqNo: 0 sessionId: source6|308bc7b1-43555b35-d5df2c1-387436fb_0
2025-11-26T18:42:05.049133Z :INFO: [] MessageGroupId [source6] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1764182525049 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-11-26T18:42:05.049312Z :INFO: [] MessageGroupId [source6] SessionId [] Write session established. Init response: session_id: "source6|308bc7b1-43555b35-d5df2c1-387436fb_0" topic: "topic1" cluster: "dc1" partition_id: 1 supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-11-26T18:42:05.049739Z :DEBUG: [] MessageGroupId [source6] SessionId [source6|308bc7b1-43555b35-d5df2c1-387436fb_0] Write 1 messages with Id from 1 to 1
2025-11-26T18:42:05.049821Z :INFO: [] MessageGroupId [source6] SessionId [source6|308bc7b1-43555b35-d5df2c1-387436fb_0] Write session: close. Timeout = 10000 ms
2025-11-26T18:42:05.050088Z :DEBUG: [] MessageGroupId [source6] SessionId [source6|308bc7b1-43555b35-d5df2c1-387436fb_0] Write session: try to update token
2025-11-26T18:42:05.050128Z :DEBUG: [] MessageGroupId [source6] SessionId [source6|308bc7b1-43555b35-d5df2c1-387436fb_0] Send 1 message(s) (0 left), first sequence number is 1
2025-11-26T18:42:05.053345Z node 12 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 7 sessionId: source6|308bc7b1-43555b35-d5df2c1-387436fb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-26T18:42:05.055847Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-26T18:42:05.055904Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 1
2025-11-26T18:42:05.055994Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 1 messageNo: 0  requestId: <none> cookie: 1
2025-11-26T18:42:05.053699Z node 12 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=1) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-26T18:42:05.061358Z node 12 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=1) Received event: NActors::IEventHandle
2025-11-26T18:42:05.062381Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-26T18:42:05.062432Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 1
2025-11-26T18:42:05.062503Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2009: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 1 SourceId: '\0source6' SeqNo: 1 partNo : 0 messageNo: 1 size 98 offset: -1
2025-11-26T18:42:05.062558Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:633: [72075186224037892][Partition][1][StateIdle] Received TPartition::TEvWrite
2025-11-26T18:42:05.062609Z node 13 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][1][StateIdle] Process user action and tx events
2025-11-26T18:42:05.062628Z node 13 :PERSQUEUE DEBUG: partition.cpp:2382: [72075186224037892][Partition][1][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-26T18:42:05.062659Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][1][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-26T18:42:05.062673Z node 13 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][1][StateIdle] Process user action and tx pending commits
2025-11-26T18:42:05.062693Z node 13 :PERSQUEUE DEBUG: partition.cpp:2446: [72075186224037892][Partition][1][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-26T18:42:05.062804Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][1][StateIdle] Topic 'rt3.dc1--topic1' partition 1 part blob processing sourceId '\0source6' seqNo 1 partNo 0
2025-11-26T18:42:05.063723Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:1428: [72075186224037892][Partition][1][StateIdle] Topic 'rt3.dc1--topic1' partition 1 part blob complete sourceId '\0source6' seqNo 1 partNo 0 FormedBlobsCount 0 NewHead: Offset 3 PartNo 0 PackedSize 173 count 1 nextOffset 4 batches 1
2025-11-26T18:42:05.063763Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][1][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-26T18:42:05.063778Z node 13 :PERSQUEUE DEBUG: partition.cpp:2301: [72075186224037892][Partition][1][StateIdle] Batch completed (1)
2025-11-26T18:42:05.063802Z node 13 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][1][StateIdle] Try persist
2025-11-26T18:42:05.064530Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:1680: [72075186224037892][Partition][1][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 1 compactOffset 3,1 HeadOffset 3 endOffset 3 curOffset 4 d0000000001_00000000000000000003_00000_0000000001_00000? size 161 WTime 1764182525064
2025-11-26T18:42:05.064719Z node 13 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-26T18:42:05.064884Z node 13 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 1 offset 3 partNo 0 count 1 size 161
2025-11-26T18:42:05.067934Z node 13 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 1 offset 3 count 1 size 161 actorID [13:7577106237176073971:2391]
2025-11-26T18:42:05.068011Z node 13 :PERSQUEUE DEBUG: partition.cpp:2112: [72075186224037892][Partition][1][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-26T18:42:05.068075Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037892][Partition][1][StateIdle] TPartition::HandleWriteResponse writeNewSize# 106 WriteNewSizeFromSupportivePartitions# 0
2025-11-26T18:42:05.068084Z node 13 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 1 offset 3 partno 0 count 1 parts 0 suffix '63' size 161
2025-11-26T18:42:05.068112Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][1][StateIdle] TPartition::ReplyWrite. Partition: 1
2025-11-26T18:42:05.068157Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][1][StateIdle] Answering for message sourceid: '\0source6', Topic: 'rt3.dc1--topic1', Partition: 1, SeqNo: 1, partNo: 0, Offset: 3 is stored on disk
2025-11-26T18:42:05.068456Z node 13 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][1][StateIdle] Process user action and tx events
2025-11-26T18:42:05.068474Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][1][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:42:05.068489Z node 13 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][1][StateIdle] Process user action and tx pending commits
2025-11-26T18:42:05.068520Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][1][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:42:05.068537Z node 13 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][1][StateIdle] Try persist
2025-11-26T18:42:05.068571Z node 13 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][1][StateIdle] No data for blobs compaction
2025-11-26T18:42:05.068629Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 1 messageNo: 1  requestId: <none> cookie: 1
2025-11-26T18:42:05.069358Z node 12 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 1 consumer shared/user session shared/user_12_1_1519369155454581669_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 1(assignId:1) wait for data done:  readOffset 3 EndOffset 3 newEndOffset 4 commitOffset 0 clientCommitOffset 0 cookie 4 readingFinished 0 firstRead 0
2025-11-26T18:42:05.069402Z node 12 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_12_1_1519369155454581669_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 1(assignId:1) ready for read with readOffset 3 endOffset 4
2025-11-26T18:42:05.069462Z node 12 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=1) Received event: NActors::IEventHandle
2025-11-26T18:42:05.069875Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_12_1_1519369155454581669_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 1(assignId:1), readOffset# 3, endOffset# 4, WTime# 1764182524910, sizeLag# 161
2025-11-26T18:42:05.069895Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2354: session cookie 1 consumer shared/user session shared/user_12_1_1519369155454581669_v1TEvPartitionReady. Aval parts: 1
2025-11-26T18:42:05.069943Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2277: session cookie 1 consumer shared/user session shared/user_12_1_1519369155454581669_v1 performing read request: guid# b235869-cebc24da-f3649b73-ba0cb1d2, from# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 1(assignId:1), count# 1, size# 193, partitionsAsked# 1, maxTimeLag# 0ms
2025-11-26T18:42:05.070000Z node 12 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_12_1_1519369155454581669_v1 READ FROM TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 1(assignId:1)maxCount 1 maxSize 193 maxTimeLagMs 0 readTimestampMs 0 readOffset 3 EndOffset 4 ClientCommitOffset 0 committedOffset 0 Guid b235869-cebc24da-f3649b73-ba0cb1d2
2025-11-26T18:42:05.071171Z :DEBUG: [] MessageGroupId [source6] SessionId [source6|308bc7b1-43555b35-d5df2c1-387436fb_0] Write session got write response: sequence_numbers: 1 offsets: 3 already_written: false partition_id: 1 write_statistics { persist_duration_ms: 4 queued_in_partition_duration_ms: 1 }
2025-11-26T18:42:05.071250Z :DEBUG: [] MessageGroupId [source6] SessionId [source6|308bc7b1-43555b35-d5df2c1-387436fb_0] Write session: acknoledged message 1
2025-11-26T18:42:05.071864Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-26T18:42:05.071923Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 1
2025-11-26T18:42:05.072062Z node 13 :PERSQUEUE DEBUG: partition_read.cpp:872: [72075186224037892][Partition][1][StateIdle] read cookie 7 Topic 'rt3.dc1--topic1' partition 1 user user offset 3 partno 0 count 1 size 193 endOffset 4 max time lag 0ms effective offset 3
2025-11-26T18:42:05.072375Z node 13 :PERSQUEUE DEBUG: partition_read.cpp:1097: [72075186224037892][Partition][1][StateIdle] read cookie 7 added 1 blobs, size 161 count 1 last offset 3, current partition end offset: 4
2025-11-26T18:42:05.072397Z node 13 :PERSQUEUE DEBUG: partition_read.cpp:1113: [72075186224037892][Partition][1][StateIdle] Reading cookie 7. Send blob request.
2025-11-26T18:42:05.072456Z node 13 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 1 offset 3 partno 0 count 1 parts_count 0 source 1 size 161 accessed 0 times before, last time 2025-11-26T18:42:05.000000Z
2025-11-26T18:42:05.072511Z node 13 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 7. All 1 blobs are from cache.
2025-11-26T18:42:05.072568Z node 13 :PERSQUEUE DEBUG: partition_read.cpp:569: FormAnswer for 1 blobs
2025-11-26T18:42:05.072749Z node 13 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 3 totakecount 1 count 1 size 141 from pos 0 cbcount 1
2025-11-26T18:42:05.072865Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 1 messageNo: 0  requestId: <none> cookie: 3
2025-11-26T18:42:05.073057Z node 13 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 1 offset 3 partno 0 count 1 parts 0 suffix '63'
2025-11-26T18:42:05.073535Z node 12 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_12_1_1519369155454581669_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 1(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 4 Result { Offset: 3 Data: "... 98 bytes ..." SourceId: "\000source6" SeqNo: 1 WriteTimestampMS: 1764182525062 CreateTimestampMS: 1764182525049 UncompressedSize: 15 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 20 RealReadOffset: 3 WaitQuotaTimeMs: 0 EndOffset: 4 StartOffset: 0 } Cookie: 3 }
2025-11-26T18:42:05.073680Z node 12 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_12_1_1519369155454581669_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 1(assignId:1) wait data in partition inited, cookie 5 from offset 4
2025-11-26T18:42:05.073726Z node 12 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_12_1_1519369155454581669_v1 after read state TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 1(assignId:1) EndOffset 4 ReadOffset 4 ReadGuid b235869-cebc24da-f3649b73-ba0cb1d2 has messages 1
2025-11-26T18:42:05.073857Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1951: session cookie 1 consumer shared/user session shared/user_12_1_1519369155454581669_v1 read done: guid# b235869-cebc24da-f3649b73-ba0cb1d2, partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 1(assignId:1), size# 199
2025-11-26T18:42:05.073887Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2113: session cookie 1 consumer shared/user session shared/user_12_1_1519369155454581669_v1 response to read: guid# b235869-cebc24da-f3649b73-ba0cb1d2
2025-11-26T18:42:05.074138Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2156: session cookie 1 consumer shared/user session shared/user_12_1_1519369155454581669_v1 Process answer. Aval parts: 0
2025-11-26T18:42:05.075184Z :DEBUG: [] [] [3430877a-9305be47-dcd0f077-4a6fb492] [null] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-26T18:42:05.076639Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_12_1_1519369155454581669_v1 grpc read done: success# 1, data# { read { } }
2025-11-26T18:42:05.076778Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1850: session cookie 1 consumer shared/user session shared/user_12_1_1519369155454581669_v1 got read request: guid# bcd4f48b-206e66c2-f94d12c1-37849ab9
2025-11-26T18:42:05.109372Z node 13 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][1][StateIdle] Process user action and tx events
2025-11-26T18:42:05.109415Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][1][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:42:05.109431Z node 13 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][1][StateIdle] Process user action and tx pending commits
2025-11-26T18:42:05.109455Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][1][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:42:05.109470Z node 13 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][1][StateIdle] Try persist
2025-11-26T18:42:05.139707Z node 13 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:42:05.139746Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:42:05.139760Z node 13 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:42:05.139782Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:42:05.139796Z node 13 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:42:05.149947Z :INFO: [] MessageGroupId [source6] SessionId [source6|308bc7b1-43555b35-d5df2c1-387436fb_0] Write session will now close
2025-11-26T18:42:05.150002Z :DEBUG: [] MessageGroupId [source6] SessionId [source6|308bc7b1-43555b35-d5df2c1-387436fb_0] Write session: aborting
2025-11-26T18:42:05.150803Z :INFO: [] MessageGroupId [source6] SessionId [source6|308bc7b1-43555b35-d5df2c1-387436fb_0] Write session: gracefully shut down, all writes complete
2025-11-26T18:42:05.150829Z :DEBUG: [] MessageGroupId [source6] SessionId [source6|308bc7b1-43555b35-d5df2c1-387436fb_0] Write session is aborting and will not restart
2025-11-26T18:42:05.150893Z :DEBUG: [] MessageGroupId [source6] SessionId [source6|308bc7b1-43555b35-d5df2c1-387436fb_0] Write session: destroy
2025-11-26T18:42:05.152204Z node 12 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 7 sessionId: source6|308bc7b1-43555b35-d5df2c1-387436fb_0 grpc read done: success: 0 data: 
2025-11-26T18:42:05.152227Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 7 sessionId: source6|308bc7b1-43555b35-d5df2c1-387436fb_0 grpc read failed
2025-11-26T18:42:05.152256Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 7 sessionId: source6|308bc7b1-43555b35-d5df2c1-387436fb_0 grpc closed
2025-11-26T18:42:05.152275Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 7 sessionId: source6|308bc7b1-43555b35-d5df2c1-387436fb_0 is DEAD
2025-11-26T18:42:05.153105Z :DEBUG: [] MessageGroupId [source7] SessionId [] Write session: try to update token
2025-11-26T18:42:05.153410Z :INFO: [] MessageGroupId [source7] SessionId [] Write session: Do CDS request
2025-11-26T18:42:05.153444Z :INFO: [] MessageGroupId [source7] SessionId [] Start write session. Will connect to endpoint: localhost:21251
2025-11-26T18:42:05.153436Z node 12 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=1) Received event: NActors::TEvents::TEvPoison
2025-11-26T18:42:05.155661Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2745: [PQ: 72075186224037892] server disconnected, pipe [12:7577106253082878628:2533] destroyed
2025-11-26T18:42:05.155714Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][1][StateIdle] TPartition::DropOwner.
2025-11-26T18:42:05.155751Z node 13 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][1][StateIdle] Process user action and tx events
2025-11-26T18:42:05.155766Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][1][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:42:05.155782Z node 13 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][1][StateIdle] Process user action and tx pending commits
2025-11-26T18:42:05.155805Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][1][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:42:05.155819Z node 13 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][1][StateIdle] Try persist
2025-11-26T18:42:05.160241Z :DEBUG: [] MessageGroupId [source7] SessionId [] Write session: send init request: init_request { topic: "topic1" message_group_id: "source7" }
2025-11-26T18:42:05.162735Z node 12 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-11-26T18:42:05.162768Z node 12 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 8
2025-11-26T18:42:05.163379Z node 12 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 8 sessionId:  grpc read done: success: 1 data: init_request { topic: "topic1" message_group_id: "source7" }
2025-11-26T18:42:05.163523Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 8 topic: "topic1" message_group_id: "source7" from ipv6:[::1]:40008
2025-11-26T18:42:05.163543Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=8 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40008 proto=v1  topic=topic1 durationSec=0
2025-11-26T18:42:05.163554Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-11-26T18:42:05.166608Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 8 sessionId:  describe result for acl check
2025-11-26T18:42:05.166739Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-11-26T18:42:05.166749Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-11-26T18:42:05.166760Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-11-26T18:42:05.166777Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [12:7577106253082878646:2539] (SourceId=source7, PreferedPartition=(NULL)) StartKqpSession
2025-11-26T18:42:05.170272Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [12:7577106253082878646:2539] (SourceId=source7, PreferedPartition=(NULL)) Select from the table
2025-11-26T18:42:05.180580Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [12:7577106253082878646:2539] (SourceId=source7, PreferedPartition=(NULL)) RequestPQRB
2025-11-26T18:42:05.181361Z node 12 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--topic1] pipe [12:7577106253082878667:2539] connected; active server actors: 1
2025-11-26T18:42:05.181412Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [12:7577106253082878646:2539] (SourceId=source7, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=source7
2025-11-26T18:42:05.181436Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [12:7577106253082878646:2539] (SourceId=source7, PreferedPartition=(NULL)) Update the table
2025-11-26T18:42:05.181769Z node 12 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--topic1] pipe [12:7577106253082878667:2539] disconnected; active server actors: 1
2025-11-26T18:42:05.181799Z node 12 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1689: [72075186224037893][rt3.dc1--topic1] pipe [12:7577106253082878667:2539] disconnected no session
2025-11-26T18:42:05.190990Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [12:7577106253082878646:2539] (SourceId=source7, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-11-26T18:42:05.191041Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [12:7577106253082878646:2539] (SourceId=source7, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-11-26T18:42:05.191068Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [12:7577106253082878646:2539] (SourceId=source7, PreferedPartition=(NULL)) Start idle
2025-11-26T18:42:05.191111Z node 12 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 8 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-11-26T18:42:05.192677Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2720: [PQ: 72075186224037892] server connected, pipe [12:7577106253082878676:2539], now have 1 active actors on pipe
2025-11-26T18:42:05.192812Z node 12 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 13, Generation: 1
2025-11-26T18:42:05.192956Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-26T18:42:05.193001Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-26T18:42:05.193094Z node 13 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie source7|f1424691-13dd63dd-333396ec-f9aef30e_0 generated for partition 0 topic 'rt3.dc1--topic1' owner source7
2025-11-26T18:42:05.193131Z node 13 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:42:05.193147Z node 13 :PERSQUEUE DEBUG: partition.cpp:2382: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-26T18:42:05.193171Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-26T18:42:05.193190Z node 13 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:42:05.193214Z node 13 :PERSQUEUE DEBUG: partition.cpp:2446: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-26T18:42:05.193273Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-26T18:42:05.193294Z node 13 :PERSQUEUE DEBUG: partition.cpp:2301: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-26T18:42:05.193331Z node 13 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:42:05.193386Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-26T18:42:05.193448Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-26T18:42:05.193937Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-26T18:42:05.193968Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-26T18:42:05.194047Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-26T18:42:05.194409Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 8 partition: 0 MaxSeqNo: 0 sessionId: source7|f1424691-13dd63dd-333396ec-f9aef30e_0
2025-11-26T18:42:05.195106Z :INFO: [] MessageGroupId [source7] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1764182525195 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-11-26T18:42:05.195249Z :INFO: [] MessageGroupId [source7] SessionId [] Write session established. Init response: session_id: "source7|f1424691-13dd63dd-333396ec-f9aef30e_0" topic: "topic1" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-11-26T18:42:05.195526Z :DEBUG: [] MessageGroupId [source7] SessionId [source7|f1424691-13dd63dd-333396ec-f9aef30e_0] Write 1 messages with Id from 1 to 1
2025-11-26T18:42:05.195597Z :INFO: [] MessageGroupId [source7] SessionId [source7|f1424691-13dd63dd-333396ec-f9aef30e_0] Write session: close. Timeout = 10000 ms
2025-11-26T18:42:05.195880Z :DEBUG: [] MessageGroupId [source7] SessionId [source7|f1424691-13dd63dd-333396ec-f9aef30e_0] Write session: try to update token
2025-11-26T18:42:05.195930Z :DEBUG: [] MessageGroupId [source7] SessionId [source7|f1424691-13dd63dd-333396ec-f9aef30e_0] Send 1 message(s) (0 left), first sequence number is 1
2025-11-26T18:42:05.196509Z node 12 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 8 sessionId: source7|f1424691-13dd63dd-333396ec-f9aef30e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-26T18:42:05.196839Z node 12 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-26T18:42:05.197177Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-26T18:42:05.197215Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-26T18:42:05.197313Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-11-26T18:42:05.197479Z node 12 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-26T18:42:05.197792Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-26T18:42:05.197820Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-26T18:42:05.197885Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2009: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: '\0source7' SeqNo: 1 partNo : 0 messageNo: 1 size 98 offset: -1
2025-11-26T18:42:05.197931Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:633: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-26T18:42:05.197971Z node 13 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:42:05.197989Z node 13 :PERSQUEUE DEBUG: partition.cpp:2382: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-26T18:42:05.198014Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-26T18:42:05.198024Z node 13 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:42:05.198039Z node 13 :PERSQUEUE DEBUG: partition.cpp:2446: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-26T18:42:05.198128Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId '\0source7' seqNo 1 partNo 0
2025-11-26T18:42:05.229531Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:1428: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '\0source7' seqNo 1 partNo 0 FormedBlobsCount 0 NewHead: Offset 3 PartNo 0 PackedSize 173 count 1 nextOffset 4 batches 1
2025-11-26T18:42:05.229600Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-26T18:42:05.229619Z node 13 :PERSQUEUE DEBUG: partition.cpp:2301: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-26T18:42:05.229644Z node 13 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:42:05.230382Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:1680: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 3,1 HeadOffset 3 endOffset 3 curOffset 4 d0000000000_00000000000000000003_00000_0000000001_00000? size 161 WTime 1764182525230
2025-11-26T18:42:05.230650Z node 13 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][1][StateIdle] Process user action and tx events
2025-11-26T18:42:05.230676Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][1][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:42:05.230689Z node 13 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][1][StateIdle] Process user action and tx pending commits
2025-11-26T18:42:05.230708Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][1][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:42:05.230726Z node 13 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][1][StateIdle] Try persist
2025-11-26T18:42:05.230767Z node 13 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-26T18:42:05.230938Z node 13 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 3 partNo 0 count 1 size 161
2025-11-26T18:42:05.233886Z node 13 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 3 count 1 size 161 actorID [13:7577106237176073971:2391]
2025-11-26T18:42:05.233958Z node 13 :PERSQUEUE DEBUG: partition.cpp:2112: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-26T18:42:05.234020Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 106 WriteNewSizeFromSupportivePartitions# 0
2025-11-26T18:42:05.234071Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-26T18:42:05.234089Z node 13 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 3 partno 0 count 1 parts 0 suffix '63' size 161
2025-11-26T18:42:05.234134Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0source7', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 1, partNo: 0, Offset: 3 is stored on disk
2025-11-26T18:42:05.234445Z node 13 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:42:05.234465Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:42:05.234482Z node 13 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:42:05.234501Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:42:05.234516Z node 13 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:42:05.234548Z node 13 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-26T18:42:05.234611Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 1  requestId: <none> cookie: 1
2025-11-26T18:42:05.234660Z node 12 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 1 consumer shared/user session shared/user_12_1_1519369155454581669_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:2) wait for data done:  readOffset 3 EndOffset 3 newEndOffset 4 commitOffset 0 clientCommitOffset 0 cookie 4 readingFinished 0 firstRead 0
2025-11-26T18:42:05.234705Z node 12 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_12_1_1519369155454581669_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:2) ready for read with readOffset 3 endOffset 4
2025-11-26T18:42:05.234760Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_12_1_1519369155454581669_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:2), readOffset# 3, endOffset# 4, WTime# 1764182524751, sizeLag# 161
2025-11-26T18:42:05.234779Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2354: session cookie 1 consumer shared/user session shared/user_12_1_1519369155454581669_v1TEvPartitionReady. Aval parts: 1
2025-11-26T18:42:05.234837Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2277: session cookie 1 consumer shared/user session shared/user_12_1_1519369155454581669_v1 performing read request: guid# bcd4f48b-206e66c2-f94d12c1-37849ab9, from# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:2), count# 1, size# 193, partitionsAsked# 1, maxTimeLag# 0ms
2025-11-26T18:42:05.234910Z node 12 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-26T18:42:05.235398Z node 12 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_12_1_1519369155454581669_v1 READ FROM TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:2)maxCount 1 maxSize 193 maxTimeLagMs 0 readTimestampMs 0 readOffset 3 EndOffset 4 ClientCommitOffset 0 committedOffset 0 Guid bcd4f48b-206e66c2-f94d12c1-37849ab9
2025-11-26T18:42:05.236176Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-26T18:42:05.236224Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-26T18:42:05.236281Z :DEBUG: [] MessageGroupId [source7] SessionId [source7|f1424691-13dd63dd-333396ec-f9aef30e_0] Write session got write response: sequence_numbers: 1 offsets: 3 already_written: false write_statistics { persist_duration_ms: 5 queued_in_partition_duration_ms: 31 }
2025-11-26T18:42:05.236343Z :DEBUG: [] MessageGroupId [source7] SessionId [source7|f1424691-13dd63dd-333396ec-f9aef30e_0] Write session: acknoledged message 1
2025-11-26T18:42:05.236343Z node 13 :PERSQUEUE DEBUG: partition_read.cpp:872: [72075186224037892][Partition][0][StateIdle] read cookie 7 Topic 'rt3.dc1--topic1' partition 0 user user offset 3 partno 0 count 1 size 193 endOffset 4 max time lag 0ms effective offset 3
2025-11-26T18:42:05.236684Z node 13 :PERSQUEUE DEBUG: partition_read.cpp:1097: [72075186224037892][Partition][0][StateIdle] read cookie 7 added 1 blobs, size 161 count 1 last offset 3, current partition end offset: 4
2025-11-26T18:42:05.236719Z node 13 :PERSQUEUE DEBUG: partition_read.cpp:1113: [72075186224037892][Partition][0][StateIdle] Reading cookie 7. Send blob request.
2025-11-26T18:42:05.236782Z node 13 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 3 partno 0 count 1 parts_count 0 source 1 size 161 accessed 0 times before, last time 2025-11-26T18:42:05.000000Z
2025-11-26T18:42:05.236828Z node 13 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 7. All 1 blobs are from cache.
2025-11-26T18:42:05.236893Z node 13 :PERSQUEUE DEBUG: partition_read.cpp:569: FormAnswer for 1 blobs
2025-11-26T18:42:05.236922Z node 13 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 3 partno 0 count 1 parts 0 suffix '63'
2025-11-26T18:42:05.237085Z node 13 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 3 totakecount 1 count 1 size 141 from pos 0 cbcount 1
2025-11-26T18:42:05.237215Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 3
2025-11-26T18:42:05.237747Z node 12 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_12_1_1519369155454581669_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:2) initDone 1 event { CmdReadResult { MaxOffset: 4 Result { Offset: 3 Data: "... 98 bytes ..." SourceId: "\000source7" SeqNo: 1 WriteTimestampMS: 1764182525198 CreateTimestampMS: 1764182525195 UncompressedSize: 15 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 20 RealReadOffset: 3 WaitQuotaTimeMs: 0 EndOffset: 4 StartOffset: 0 } Cookie: 3 }
2025-11-26T18:42:05.237876Z node 12 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_12_1_1519369155454581669_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:2) wait data in partition inited, cookie 5 from offset 4
2025-11-26T18:42:05.237915Z node 12 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_12_1_1519369155454581669_v1 after read state TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:2) EndOffset 4 ReadOffset 4 ReadGuid bcd4f48b-206e66c2-f94d12c1-37849ab9 has messages 1
2025-11-26T18:42:05.238041Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1951: session cookie 1 consumer shared/user session shared/user_12_1_1519369155454581669_v1 read done: guid# bcd4f48b-206e66c2-f94d12c1-37849ab9, partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:2), size# 197
2025-11-26T18:42:05.238071Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2113: session cookie 1 consumer shared/user session shared/user_12_1_1519369155454581669_v1 response to read: guid# bcd4f48b-206e66c2-f94d12c1-37849ab9
2025-11-26T18:42:05.238273Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2156: session cookie 1 consumer shared/user session shared/user_12_1_1519369155454581669_v1 Process answer. Aval parts: 0
2025-11-26T18:42:05.238888Z :DEBUG: [] [] [3430877a-9305be47-dcd0f077-4a6fb492] [null] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-26T18:42:05.239101Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_12_1_1519369155454581669_v1 grpc read done: success# 1, data# { read { } }
2025-11-26T18:42:05.239222Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1850: session cookie 1 consumer shared/user session shared/user_12_1_1519369155454581669_v1 got read request: guid# 50fa3c8b-75e95c59-eeabbf31-2dd86c2
2025-11-26T18:42:05.239620Z node 13 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:42:05.239648Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:42:05.239662Z node 13 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:42:05.239683Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:42:05.239696Z node 13 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:42:05.295738Z :INFO: [] MessageGroupId [source7] SessionId [source7|f1424691-13dd63dd-333396ec-f9aef30e_0] Write session will now close
2025-11-26T18:42:05.295793Z :DEBUG: [] MessageGroupId [source7] SessionId [source7|f1424691-13dd63dd-333396ec-f9aef30e_0] Write session: aborting
2025-11-26T18:42:05.296196Z :INFO: [] MessageGroupId [source7] SessionId [source7|f1424691-13dd63dd-333396ec-f9aef30e_0] Write session: gracefully shut down, all writes complete
2025-11-26T18:42:05.296234Z :DEBUG: [] MessageGroupId [source7] SessionId [source7|f1424691-13dd63dd-333396ec-f9aef30e_0] Write session: destroy
2025-11-26T18:42:05.296797Z node 12 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 8 sessionId: source7|f1424691-13dd63dd-333396ec-f9aef30e_0 grpc read done: success: 0 data: 
2025-11-26T18:42:05.296854Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 8 sessionId: source7|f1424691-13dd63dd-333396ec-f9aef30e_0 grpc read failed
2025-11-26T18:42:05.296912Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 8 sessionId: source7|f1424691-13dd63dd-333396ec-f9aef30e_0 grpc closed
2025-11-26T18:42:05.296937Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 8 sessionId: source7|f1424691-13dd63dd-333396ec-f9aef30e_0 is DEAD
2025-11-26T18:42:05.298310Z node 12 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-11-26T18:42:05.298833Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2745: [PQ: 72075186224037892] server disconnected, pipe [12:7577106253082878676:2539] destroyed
2025-11-26T18:42:05.298899Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-11-26T18:42:05.298938Z node 13 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:42:05.298954Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:42:05.298971Z node 13 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:42:05.298995Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:42:05.299009Z node 13 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:42:05.301714Z :DEBUG: [] MessageGroupId [source8] SessionId [] Write session: try to update token
2025-11-26T18:42:05.312638Z :INFO: [] MessageGroupId [source8] SessionId [] Write session: Do CDS request
2025-11-26T18:42:05.312684Z :INFO: [] MessageGroupId [source8] SessionId [] Start write session. Will connect to endpoint: localhost:21251
2025-11-26T18:42:05.323404Z :DEBUG: [] MessageGroupId [source8] SessionId [] Write session: send init request: init_request { topic: "topic1" message_group_id: "source8" }
2025-11-26T18:42:05.323506Z node 12 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-11-26T18:42:05.323545Z node 12 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 9
2025-11-26T18:42:05.324264Z node 12 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 9 sessionId:  grpc read done: success: 1 data: init_request { topic: "topic1" message_group_id: "source8" }
2025-11-26T18:42:05.324442Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 9 topic: "topic1" message_group_id: "source8" from ipv6:[::1]:40008
2025-11-26T18:42:05.324472Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=9 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40008 proto=v1  topic=topic1 durationSec=0
2025-11-26T18:42:05.324485Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-11-26T18:42:05.326605Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 9 sessionId:  describe result for acl check
2025-11-26T18:42:05.326779Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-11-26T18:42:05.326803Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-11-26T18:42:05.326819Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-11-26T18:42:05.326843Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [12:7577106253082878701:2548] (SourceId=source8, PreferedPartition=(NULL)) StartKqpSession
2025-11-26T18:42:05.330785Z node 13 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][1][StateIdle] Process user action and tx events
2025-11-26T18:42:05.330820Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][1][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:42:05.330834Z node 13 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][1][StateIdle] Process user action and tx pending commits
2025-11-26T18:42:05.330855Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][1][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:42:05.330868Z node 13 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][1][StateIdle] Try persist
2025-11-26T18:42:05.331233Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [12:7577106253082878701:2548] (SourceId=source8, PreferedPartition=(NULL)) Select from the table
2025-11-26T18:42:05.339972Z node 13 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:42:05.340011Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:42:05.340025Z node 13 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:42:05.340045Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:42:05.340057Z node 13 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:42:05.340391Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [12:7577106253082878701:2548] (SourceId=source8, PreferedPartition=(NULL)) RequestPQRB
2025-11-26T18:42:05.340683Z node 12 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--topic1] pipe [12:7577106253082878720:2548] connected; active server actors: 1
2025-11-26T18:42:05.340732Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [12:7577106253082878701:2548] (SourceId=source8, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=source8
2025-11-26T18:42:05.340752Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [12:7577106253082878701:2548] (SourceId=source8, PreferedPartition=(NULL)) Update the table
2025-11-26T18:42:05.340995Z node 12 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--topic1] pipe [12:7577106253082878720:2548] disconnected; active server actors: 1
2025-11-26T18:42:05.341026Z node 12 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1689: [72075186224037893][rt3.dc1--topic1] pipe [12:7577106253082878720:2548] disconnected no session
2025-11-26T18:42:05.351711Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [12:7577106253082878701:2548] (SourceId=source8, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-11-26T18:42:05.351769Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [12:7577106253082878701:2548] (SourceId=source8, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-11-26T18:42:05.351800Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [12:7577106253082878701:2548] (SourceId=source8, PreferedPartition=(NULL)) Start idle
2025-11-26T18:42:05.351843Z node 12 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 9 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-11-26T18:42:05.352846Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2720: [PQ: 72075186224037892] server connected, pipe [12:7577106253082878737:2548], now have 1 active actors on pipe
2025-11-26T18:42:05.352961Z node 12 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 13, Generation: 1
2025-11-26T18:42:05.353214Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-26T18:42:05.353279Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-26T18:42:05.353382Z node 13 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie source8|5ab2fad7-d67cf8f1-acd8cb95-bb2d7e58_0 generated for partition 0 topic 'rt3.dc1--topic1' owner source8
2025-11-26T18:42:05.353438Z node 13 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:42:05.353455Z node 13 :PERSQUEUE DEBUG: partition.cpp:2382: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-26T18:42:05.353483Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-26T18:42:05.353500Z node 13 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:42:05.353525Z node 13 :PERSQUEUE DEBUG: partition.cpp:2446: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-26T18:42:05.353567Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-26T18:42:05.353584Z node 13 :PERSQUEUE DEBUG: partition.cpp:2301: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-26T18:42:05.353609Z node 13 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:42:05.353666Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-26T18:42:05.353729Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-26T18:42:05.354975Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-26T18:42:05.355036Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-26T18:42:05.355147Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-26T18:42:05.355614Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 9 partition: 0 MaxSeqNo: 0 sessionId: source8|5ab2fad7-d67cf8f1-acd8cb95-bb2d7e58_0
2025-11-26T18:42:05.356449Z :INFO: [] MessageGroupId [source8] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1764182525356 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-11-26T18:42:05.364955Z :INFO: [] MessageGroupId [source8] SessionId [] Write session established. Init response: session_id: "source8|5ab2fad7-d67cf8f1-acd8cb95-bb2d7e58_0" topic: "topic1" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-11-26T18:42:05.365297Z :DEBUG: [] MessageGroupId [source8] SessionId [source8|5ab2fad7-d67cf8f1-acd8cb95-bb2d7e58_0] Write 1 messages with Id from 1 to 1
2025-11-26T18:42:05.365392Z :INFO: [] MessageGroupId [source8] SessionId [source8|5ab2fad7-d67cf8f1-acd8cb95-bb2d7e58_0] Write session: close. Timeout = 10000 ms
2025-11-26T18:42:05.365880Z :DEBUG: [] MessageGroupId [source8] SessionId [source8|5ab2fad7-d67cf8f1-acd8cb95-bb2d7e58_0] Write session: try to update token
2025-11-26T18:42:05.365961Z :DEBUG: [] MessageGroupId [source8] SessionId [source8|5ab2fad7-d67cf8f1-acd8cb95-bb2d7e58_0] Send 1 message(s) (0 left), first sequence number is 1
2025-11-26T18:42:05.366615Z node 12 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 9 sessionId: source8|5ab2fad7-d67cf8f1-acd8cb95-bb2d7e58_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-26T18:42:05.367020Z node 12 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-26T18:42:05.367510Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-26T18:42:05.367563Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-26T18:42:05.367649Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-11-26T18:42:05.367876Z node 12 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-26T18:42:05.368280Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-26T18:42:05.368313Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-26T18:42:05.368380Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2009: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: '\0source8' SeqNo: 1 partNo : 0 messageNo: 1 size 98 offset: -1
2025-11-26T18:42:05.368440Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:633: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-26T18:42:05.368511Z node 13 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:42:05.368539Z node 13 :PERSQUEUE DEBUG: partition.cpp:2382: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-26T18:42:05.368585Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-26T18:42:05.368606Z node 13 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:42:05.368628Z node 13 :PERSQUEUE DEBUG: partition.cpp:2446: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-26T18:42:05.368742Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId '\0source8' seqNo 1 partNo 0
2025-11-26T18:42:05.369762Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:1428: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '\0source8' seqNo 1 partNo 0 FormedBlobsCount 0 NewHead: Offset 4 PartNo 0 PackedSize 173 count 1 nextOffset 5 batches 1
2025-11-26T18:42:05.369839Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-26T18:42:05.369869Z node 13 :PERSQUEUE DEBUG: partition.cpp:2301: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-26T18:42:05.369900Z node 13 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:42:05.370938Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:1680: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 4,1 HeadOffset 4 endOffset 4 curOffset 5 d0000000000_00000000000000000004_00000_0000000001_00000? size 161 WTime 1764182525370
2025-11-26T18:42:05.371279Z node 13 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-26T18:42:05.371489Z node 13 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 4 partNo 0 count 1 size 161
2025-11-26T18:42:05.376453Z node 13 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 4 count 1 size 161 actorID [13:7577106237176073971:2391]
2025-11-26T18:42:05.376547Z node 13 :PERSQUEUE DEBUG: partition.cpp:2112: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-26T18:42:05.376612Z node 13 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 4 partno 0 count 1 parts 0 suffix '63' size 161
2025-11-26T18:42:05.376623Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 106 WriteNewSizeFromSupportivePartitions# 0
2025-11-26T18:42:05.376665Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-26T18:42:05.376726Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0source8', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 1, partNo: 0, Offset: 4 is stored on disk
2025-11-26T18:42:05.376981Z node 13 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:42:05.377011Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:42:05.377027Z node 13 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:42:05.377045Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:42:05.377061Z node 13 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:42:05.377094Z node 13 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-26T18:42:05.377138Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 1  requestId: <none> cookie: 1
2025-11-26T18:42:05.377201Z node 12 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 1 consumer shared/user session shared/user_12_1_1519369155454581669_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:2) wait for data done:  readOffset 4 EndOffset 4 newEndOffset 5 commitOffset 0 clientCommitOffset 0 cookie 5 readingFinished 0 firstRead 0
2025-11-26T18:42:05.377260Z node 12 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_12_1_1519369155454581669_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:2) ready for read with readOffset 4 endOffset 5
2025-11-26T18:42:05.377316Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_12_1_1519369155454581669_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:2), readOffset# 4, endOffset# 5, WTime# 1764182525198, sizeLag# 161
2025-11-26T18:42:05.377335Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2354: session cookie 1 consumer shared/user session shared/user_12_1_1519369155454581669_v1TEvPartitionReady. Aval parts: 1
2025-11-26T18:42:05.377370Z node 12 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-26T18:42:05.377381Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2277: session cookie 1 consumer shared/user session shared/user_12_1_1519369155454581669_v1 performing read request: guid# 50fa3c8b-75e95c59-eeabbf31-2dd86c2, from# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:2), count# 1, size# 193, partitionsAsked# 1, maxTimeLag# 0ms
2025-11-26T18:42:05.377437Z node 12 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_12_1_1519369155454581669_v1 READ FROM TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:2)maxCount 1 maxSize 193 maxTimeLagMs 0 readTimestampMs 0 readOffset 4 EndOffset 5 ClientCommitOffset 0 committedOffset 0 Guid 50fa3c8b-75e95c59-eeabbf31-2dd86c2
2025-11-26T18:42:05.377883Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-26T18:42:05.377932Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-26T18:42:05.378072Z node 13 :PERSQUEUE DEBUG: partition_read.cpp:872: [72075186224037892][Partition][0][StateIdle] read cookie 8 Topic 'rt3.dc1--topic1' partition 0 user user offset 4 partno 0 count 1 size 193 endOffset 5 max time lag 0ms effective offset 4
2025-11-26T18:42:05.378147Z :DEBUG: [] MessageGroupId [source8] SessionId [source8|5ab2fad7-d67cf8f1-acd8cb95-bb2d7e58_0] Write session got write response: sequence_numbers: 1 offsets: 4 already_written: false write_statistics { persist_duration_ms: 6 queued_in_partition_duration_ms: 1 }
2025-11-26T18:42:05.378203Z :DEBUG: [] MessageGroupId [source8] SessionId [source8|5ab2fad7-d67cf8f1-acd8cb95-bb2d7e58_0] Write session: acknoledged message 1
2025-11-26T18:42:05.378408Z node 13 :PERSQUEUE DEBUG: partition_read.cpp:1097: [72075186224037892][Partition][0][StateIdle] read cookie 8 added 1 blobs, size 161 count 1 last offset 4, current partition end offset: 5
2025-11-26T18:42:05.378436Z node 13 :PERSQUEUE DEBUG: partition_read.cpp:1113: [72075186224037892][Partition][0][StateIdle] Reading cookie 8. Send blob request.
2025-11-26T18:42:05.378491Z node 13 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 4 partno 0 count 1 parts_count 0 source 1 size 161 accessed 0 times before, last time 2025-11-26T18:42:05.000000Z
2025-11-26T18:42:05.378543Z node 13 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 8. All 1 blobs are from cache.
2025-11-26T18:42:05.378609Z node 13 :PERSQUEUE DEBUG: partition_read.cpp:569: FormAnswer for 1 blobs
2025-11-26T18:42:05.378617Z node 13 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 4 partno 0 count 1 parts 0 suffix '63'
2025-11-26T18:42:05.378787Z node 13 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 4 totakecount 1 count 1 size 141 from pos 0 cbcount 1
2025-11-26T18:42:05.378905Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 4
2025-11-26T18:42:05.379443Z node 12 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_12_1_1519369155454581669_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:2) initDone 1 event { CmdReadResult { MaxOffset: 5 Result { Offset: 4 Data: "... 98 bytes ..." SourceId: "\000source8" SeqNo: 1 WriteTimestampMS: 1764182525368 CreateTimestampMS: 1764182525365 UncompressedSize: 15 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 20 RealReadOffset: 4 WaitQuotaTimeMs: 0 EndOffset: 5 StartOffset: 0 } Cookie: 4 }
2025-11-26T18:42:05.379612Z node 12 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_12_1_1519369155454581669_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:2) wait data in partition inited, cookie 6 from offset 5
2025-11-26T18:42:05.379664Z node 12 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_12_1_1519369155454581669_v1 after read state TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:2) EndOffset 5 ReadOffset 5 ReadGuid 50fa3c8b-75e95c59-eeabbf31-2dd86c2 has messages 1
2025-11-26T18:42:05.379784Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1951: session cookie 1 consumer shared/user session shared/user_12_1_1519369155454581669_v1 read done: guid# 50fa3c8b-75e95c59-eeabbf31-2dd86c2, partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:2), size# 197
2025-11-26T18:42:05.379845Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2113: session cookie 1 consumer shared/user session shared/user_12_1_1519369155454581669_v1 response to read: guid# 50fa3c8b-75e95c59-eeabbf31-2dd86c2
2025-11-26T18:42:05.380077Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2156: session cookie 1 consumer shared/user session shared/user_12_1_1519369155454581669_v1 Process answer. Aval parts: 0
2025-11-26T18:42:05.380630Z :DEBUG: [] [] [3430877a-9305be47-dcd0f077-4a6fb492] [null] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-26T18:42:05.380961Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_12_1_1519369155454581669_v1 grpc read done: success# 1, data# { read { } }
2025-11-26T18:42:05.381090Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1850: session cookie 1 consumer shared/user session shared/user_12_1_1519369155454581669_v1 got read request: guid# b772ce9d-506c5597-58b84efc-10dc75a5
2025-11-26T18:42:05.431102Z node 13 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][1][StateIdle] Process user action and tx events
2025-11-26T18:42:05.431141Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][1][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:42:05.431156Z node 13 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][1][StateIdle] Process user action and tx pending commits
2025-11-26T18:42:05.431198Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][1][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:42:05.431213Z node 13 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][1][StateIdle] Try persist
2025-11-26T18:42:05.440348Z node 13 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:42:05.440383Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:42:05.440398Z node 13 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:42:05.440422Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:42:05.440435Z node 13 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:42:05.465522Z :INFO: [] MessageGroupId [source8] SessionId [source8|5ab2fad7-d67cf8f1-acd8cb95-bb2d7e58_0] Write session will now close
2025-11-26T18:42:05.465586Z :DEBUG: [] MessageGroupId [source8] SessionId [source8|5ab2fad7-d67cf8f1-acd8cb95-bb2d7e58_0] Write session: aborting
2025-11-26T18:42:05.466451Z :INFO: [] MessageGroupId [source8] SessionId [source8|5ab2fad7-d67cf8f1-acd8cb95-bb2d7e58_0] Write session: gracefully shut down, all writes complete
2025-11-26T18:42:05.466534Z :DEBUG: [] MessageGroupId [source8] SessionId [source8|5ab2fad7-d67cf8f1-acd8cb95-bb2d7e58_0] Write session is aborting and will not restart
2025-11-26T18:42:05.466592Z :DEBUG: [] MessageGroupId [source8] SessionId [source8|5ab2fad7-d67cf8f1-acd8cb95-bb2d7e58_0] Write session: destroy
2025-11-26T18:42:05.466987Z node 12 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 9 sessionId: source8|5ab2fad7-d67cf8f1-acd8cb95-bb2d7e58_0 grpc read done: success: 0 data: 
2025-11-26T18:42:05.467022Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 9 sessionId: source8|5ab2fad7-d67cf8f1-acd8cb95-bb2d7e58_0 grpc read failed
2025-11-26T18:42:05.467066Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 9 sessionId: source8|5ab2fad7-d67cf8f1-acd8cb95-bb2d7e58_0 grpc closed
2025-11-26T18:42:05.467096Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 9 sessionId: source8|5ab2fad7-d67cf8f1-acd8cb95-bb2d7e58_0 is DEAD
2025-11-26T18:42:05.467881Z :DEBUG: [] MessageGroupId [source9] SessionId [] Write session: try to update token
2025-11-26T18:42:05.468176Z node 12 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-11-26T18:42:05.468296Z :INFO: [] MessageGroupId [source9] SessionId [] Write session: Do CDS request
2025-11-26T18:42:05.468329Z :INFO: [] MessageGroupId [source9] SessionId [] Start write session. Will connect to endpoint: localhost:21251
2025-11-26T18:42:05.468686Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2745: [PQ: 72075186224037892] server disconnected, pipe [12:7577106253082878737:2548] destroyed
2025-11-26T18:42:05.468757Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-11-26T18:42:05.468799Z node 13 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:42:05.468817Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:42:05.468834Z node 13 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:42:05.468858Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:42:05.468873Z node 13 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:42:05.474196Z :DEBUG: [] MessageGroupId [source9] SessionId [] Write session: send init request: init_request { topic: "topic1" message_group_id: "source9" }
2025-11-26T18:42:05.474545Z node 12 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-11-26T18:42:05.474591Z node 12 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 10
2025-11-26T18:42:05.474997Z node 12 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 10 sessionId:  grpc read done: success: 1 data: init_request { topic: "topic1" message_group_id: "source9" }
2025-11-26T18:42:05.475177Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 10 topic: "topic1" message_group_id: "source9" from ipv6:[::1]:40008
2025-11-26T18:42:05.475209Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=10 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40008 proto=v1  topic=topic1 durationSec=0
2025-11-26T18:42:05.475221Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-11-26T18:42:05.477039Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 10 sessionId:  describe result for acl check
2025-11-26T18:42:05.477219Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-11-26T18:42:05.477241Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-11-26T18:42:05.477271Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-11-26T18:42:05.477294Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [12:7577106253082878746:2554] (SourceId=source9, PreferedPartition=(NULL)) StartKqpSession
2025-11-26T18:42:05.481294Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [12:7577106253082878746:2554] (SourceId=source9, PreferedPartition=(NULL)) Select from the table
2025-11-26T18:42:05.488149Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [12:7577106253082878746:2554] (SourceId=source9, PreferedPartition=(NULL)) RequestPQRB
2025-11-26T18:42:05.488414Z node 12 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--topic1] pipe [12:7577106253082878765:2554] connected; active server actors: 1
2025-11-26T18:42:05.488479Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [12:7577106253082878746:2554] (SourceId=source9, PreferedPartition=(NULL)) Received partition 1 from PQRB for SourceId=source9
2025-11-26T18:42:05.488512Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [12:7577106253082878746:2554] (SourceId=source9, PreferedPartition=(NULL)) Update the table
2025-11-26T18:42:05.488820Z node 12 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--topic1] pipe [12:7577106253082878765:2554] disconnected; active server actors: 1
2025-11-26T18:42:05.488854Z node 12 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1689: [72075186224037893][rt3.dc1--topic1] pipe [12:7577106253082878765:2554] disconnected no session
2025-11-26T18:42:05.498078Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [12:7577106253082878746:2554] (SourceId=source9, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-11-26T18:42:05.498128Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [12:7577106253082878746:2554] (SourceId=source9, PreferedPartition=(NULL)) ReplyResult: Partition=1, SeqNo=(NULL)
2025-11-26T18:42:05.498156Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [12:7577106253082878746:2554] (SourceId=source9, PreferedPartition=(NULL)) Start idle
2025-11-26T18:42:05.498198Z node 12 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 10 sessionId:  partition: 1 expectedGeneration: (NULL)
2025-11-26T18:42:05.499008Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2720: [PQ: 72075186224037892] server connected, pipe [12:7577106253082878775:2554], now have 1 active actors on pipe
2025-11-26T18:42:05.499109Z node 12 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=1) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 13, Generation: 1
2025-11-26T18:42:05.499284Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-26T18:42:05.499328Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 1
2025-11-26T18:42:05.499399Z node 13 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie source9|f56e9d90-558d8fa2-3cad81ed-93be0135_0 generated for partition 1 topic 'rt3.dc1--topic1' owner source9
2025-11-26T18:42:05.499430Z node 13 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][1][StateIdle] Process user action and tx events
2025-11-26T18:42:05.499442Z node 13 :PERSQUEUE DEBUG: partition.cpp:2382: [72075186224037892][Partition][1][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-26T18:42:05.499459Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][1][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-26T18:42:05.499469Z node 13 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][1][StateIdle] Process user action and tx pending commits
2025-11-26T18:42:05.499487Z node 13 :PERSQUEUE DEBUG: partition.cpp:2446: [72075186224037892][Partition][1][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-26T18:42:05.499518Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][1][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-26T18:42:05.499533Z node 13 :PERSQUEUE DEBUG: partition.cpp:2301: [72075186224037892][Partition][1][StateIdle] Batch completed (1)
2025-11-26T18:42:05.499557Z node 13 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][1][StateIdle] Try persist
2025-11-26T18:42:05.499609Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][1][StateIdle] TPartition::ReplyOwnerOk. Partition: 1
2025-11-26T18:42:05.499670Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 1 messageNo: 0  requestId: <none> cookie: 0
2025-11-26T18:42:05.500071Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-26T18:42:05.500103Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 1
2025-11-26T18:42:05.500178Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 1 messageNo: 0  requestId: <none> cookie: 0
2025-11-26T18:42:05.500408Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 10 partition: 1 MaxSeqNo: 0 sessionId: source9|f56e9d90-558d8fa2-3cad81ed-93be0135_0
2025-11-26T18:42:05.501170Z :INFO: [] MessageGroupId [source9] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1764182525501 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-11-26T18:42:05.501330Z :INFO: [] MessageGroupId [source9] SessionId [] Write session established. Init response: session_id: "source9|f56e9d90-558d8fa2-3cad81ed-93be0135_0" topic: "topic1" cluster: "dc1" partition_id: 1 supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-11-26T18:42:05.501602Z :DEBUG: [] MessageGroupId [source9] SessionId [source9|f56e9d90-558d8fa2-3cad81ed-93be0135_0] Write 1 messages with Id from 1 to 1
2025-11-26T18:42:05.501708Z :INFO: [] MessageGroupId [source9] SessionId [source9|f56e9d90-558d8fa2-3cad81ed-93be0135_0] Write session: close. Timeout = 10000 ms
2025-11-26T18:42:05.502142Z :DEBUG: [] MessageGroupId [source9] SessionId [source9|f56e9d90-558d8fa2-3cad81ed-93be0135_0] Write session: try to update token
2025-11-26T18:42:05.502201Z :DEBUG: [] MessageGroupId [source9] SessionId [source9|f56e9d90-558d8fa2-3cad81ed-93be0135_0] Send 1 message(s) (0 left), first sequence number is 1
2025-11-26T18:42:05.502778Z node 12 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 10 sessionId: source9|f56e9d90-558d8fa2-3cad81ed-93be0135_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-26T18:42:05.503088Z node 12 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=1) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-26T18:42:05.503801Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-26T18:42:05.503843Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 1
2025-11-26T18:42:05.503927Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 1 messageNo: 0  requestId: <none> cookie: 1
2025-11-26T18:42:05.504109Z node 12 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=1) Received event: NActors::IEventHandle
2025-11-26T18:42:05.504419Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-26T18:42:05.504446Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 1
2025-11-26T18:42:05.504541Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2009: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 1 SourceId: '\0source9' SeqNo: 1 partNo : 0 messageNo: 1 size 98 offset: -1
2025-11-26T18:42:05.504594Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:633: [72075186224037892][Partition][1][StateIdle] Received TPartition::TEvWrite
2025-11-26T18:42:05.504647Z node 13 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][1][StateIdle] Process user action and tx events
2025-11-26T18:42:05.504670Z node 13 :PERSQUEUE DEBUG: partition.cpp:2382: [72075186224037892][Partition][1][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-26T18:42:05.504703Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][1][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-26T18:42:05.504724Z node 13 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][1][StateIdle] Process user action and tx pending commits
2025-11-26T18:42:05.504745Z node 13 :PERSQUEUE DEBUG: partition.cpp:2446: [72075186224037892][Partition][1][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-26T18:42:05.504877Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][1][StateIdle] Topic 'rt3.dc1--topic1' partition 1 part blob processing sourceId '\0source9' seqNo 1 partNo 0
2025-11-26T18:42:05.505736Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:1428: [72075186224037892][Partition][1][StateIdle] Topic 'rt3.dc1--topic1' partition 1 part blob complete sourceId '\0source9' seqNo 1 partNo 0 FormedBlobsCount 0 NewHead: Offset 4 PartNo 0 PackedSize 173 count 1 nextOffset 5 batches 1
2025-11-26T18:42:05.505792Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][1][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-26T18:42:05.505811Z node 13 :PERSQUEUE DEBUG: partition.cpp:2301: [72075186224037892][Partition][1][StateIdle] Batch completed (1)
2025-11-26T18:42:05.505838Z node 13 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][1][StateIdle] Try persist
2025-11-26T18:42:05.506602Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:1680: [72075186224037892][Partition][1][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 1 compactOffset 4,1 HeadOffset 4 endOffset 4 curOffset 5 d0000000001_00000000000000000004_00000_0000000001_00000? size 161 WTime 1764182525506
2025-11-26T18:42:05.506803Z node 13 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-26T18:42:05.507029Z node 13 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 1 offset 4 partNo 0 count 1 size 161
2025-11-26T18:42:05.510241Z node 13 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 1 offset 4 count 1 size 161 actorID [13:7577106237176073971:2391]
2025-11-26T18:42:05.510312Z node 13 :PERSQUEUE DEBUG: partition.cpp:2112: [72075186224037892][Partition][1][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-26T18:42:05.510368Z node 13 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 1 offset 4 partno 0 count 1 parts 0 suffix '63' size 161
2025-11-26T18:42:05.510386Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037892][Partition][1][StateIdle] TPartition::HandleWriteResponse writeNewSize# 106 WriteNewSizeFromSupportivePartitions# 0
2025-11-26T18:42:05.510427Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][1][StateIdle] TPartition::ReplyWrite. Partition: 1
2025-11-26T18:42:05.510481Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][1][StateIdle] Answering for message sourceid: '\0source9', Topic: 'rt3.dc1--topic1', Partition: 1, SeqNo: 1, partNo: 0, Offset: 4 is stored on disk
2025-11-26T18:42:05.510784Z node 13 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][1][StateIdle] Process user action and tx events
2025-11-26T18:42:05.510805Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][1][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:42:05.510829Z node 13 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][1][StateIdle] Process user action and tx pending commits
2025-11-26T18:42:05.510850Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][1][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:42:05.510868Z node 13 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][1][StateIdle] Try persist
2025-11-26T18:42:05.510900Z node 13 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][1][StateIdle] No data for blobs compaction
2025-11-26T18:42:05.510959Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 1 messageNo: 1  requestId: <none> cookie: 1
2025-11-26T18:42:05.511236Z node 12 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 1 consumer shared/user session shared/user_12_1_1519369155454581669_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 1(assignId:1) wait for data done:  readOffset 4 EndOffset 4 newEndOffset 5 commitOffset 0 clientCommitOffset 0 cookie 5 readingFinished 0 firstRead 0
2025-11-26T18:42:05.511287Z node 12 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_12_1_1519369155454581669_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 1(assignId:1) ready for read with readOffset 4 endOffset 5
2025-11-26T18:42:05.511353Z node 12 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=1) Received event: NActors::IEventHandle
2025-11-26T18:42:05.511360Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_12_1_1519369155454581669_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 1(assignId:1), readOffset# 4, endOffset# 5, WTime# 1764182525062, sizeLag# 161
2025-11-26T18:42:05.511379Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2354: session cookie 1 consumer shared/user session shared/user_12_1_1519369155454581669_v1TEvPartitionReady. Aval parts: 1
2025-11-26T18:42:05.511424Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2277: session cookie 1 consumer shared/user session shared/user_12_1_1519369155454581669_v1 performing read request: guid# b772ce9d-506c5597-58b84efc-10dc75a5, from# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 1(assignId:1), count# 1, size# 193, partitionsAsked# 1, maxTimeLag# 0ms
2025-11-26T18:42:05.511482Z node 12 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_12_1_1519369155454581669_v1 READ FROM TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 1(assignId:1)maxCount 1 maxSize 193 maxTimeLagMs 0 readTimestampMs 0 readOffset 4 EndOffset 5 ClientCommitOffset 0 committedOffset 0 Guid b772ce9d-506c5597-58b84efc-10dc75a5
2025-11-26T18:42:05.511988Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-26T18:42:05.512036Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 1
2025-11-26T18:42:05.512153Z node 13 :PERSQUEUE DEBUG: partition_read.cpp:872: [72075186224037892][Partition][1][StateIdle] read cookie 8 Topic 'rt3.dc1--topic1' partition 1 user user offset 4 partno 0 count 1 size 193 endOffset 5 max time lag 0ms effective offset 4
2025-11-26T18:42:05.512527Z node 13 :PERSQUEUE DEBUG: partition_read.cpp:1097: [72075186224037892][Partition][1][StateIdle] read cookie 8 added 1 blobs, size 161 count 1 last offset 4, current partition end offset: 5
2025-11-26T18:42:05.512560Z node 13 :PERSQUEUE DEBUG: partition_read.cpp:1113: [72075186224037892][Partition][1][StateIdle] Reading cookie 8. Send blob request.
2025-11-26T18:42:05.512623Z node 13 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 1 offset 4 partno 0 count 1 parts_count 0 source 1 size 161 accessed 0 times before, last time 2025-11-26T18:42:05.000000Z
2025-11-26T18:42:05.512667Z node 13 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 8. All 1 blobs are from cache.
2025-11-26T18:42:05.512725Z node 13 :PERSQUEUE DEBUG: partition_read.cpp:569: FormAnswer for 1 blobs
2025-11-26T18:42:05.512919Z node 13 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 4 totakecount 1 count 1 size 141 from pos 0 cbcount 1
2025-11-26T18:42:05.513031Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 1 messageNo: 0  requestId: <none> cookie: 4
2025-11-26T18:42:05.513286Z node 13 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 1 offset 4 partno 0 count 1 parts 0 suffix '63'
2025-11-26T18:42:05.513595Z :DEBUG: [] MessageGroupId [source9] SessionId [source9|f56e9d90-558d8fa2-3cad81ed-93be0135_0] Write session got write response: sequence_numbers: 1 offsets: 4 already_written: false partition_id: 1 write_statistics { persist_duration_ms: 5 queued_in_partition_duration_ms: 1 }
2025-11-26T18:42:05.513676Z :DEBUG: [] MessageGroupId [source9] SessionId [source9|f56e9d90-558d8fa2-3cad81ed-93be0135_0] Write session: acknoledged message 1
2025-11-26T18:42:05.513659Z node 12 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_12_1_1519369155454581669_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 1(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 5 Result { Offset: 4 Data: "... 98 bytes ..." SourceId: "\000source9" SeqNo: 1 WriteTimestampMS: 1764182525504 CreateTimestampMS: 1764182525501 UncompressedSize: 15 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 20 RealReadOffset: 4 WaitQuotaTimeMs: 0 EndOffset: 5 StartOffset: 0 } Cookie: 4 }
2025-11-26T18:42:05.513791Z node 12 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_12_1_1519369155454581669_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 1(assignId:1) wait data in partition inited, cookie 6 from offset 5
2025-11-26T18:42:05.513840Z node 12 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_12_1_1519369155454581669_v1 after read state TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 1(assignId:1) EndOffset 5 ReadOffset 5 ReadGuid b772ce9d-506c5597-58b84efc-10dc75a5 has messages 1
2025-11-26T18:42:05.513925Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1951: session cookie 1 consumer shared/user session shared/user_12_1_1519369155454581669_v1 read done: guid# b772ce9d-506c5597-58b84efc-10dc75a5, partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 1(assignId:1), size# 199
2025-11-26T18:42:05.513959Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2113: session cookie 1 consumer shared/user session shared/user_12_1_1519369155454581669_v1 response to read: guid# b772ce9d-506c5597-58b84efc-10dc75a5
2025-11-26T18:42:05.514191Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2156: session cookie 1 consumer shared/user session shared/user_12_1_1519369155454581669_v1 Process answer. Aval parts: 0
2025-11-26T18:42:05.514663Z :DEBUG: [] [] [3430877a-9305be47-dcd0f077-4a6fb492] [null] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-26T18:42:05.514950Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_12_1_1519369155454581669_v1 grpc read done: success# 1, data# { read { } }
2025-11-26T18:42:05.515082Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1850: session cookie 1 consumer shared/user session shared/user_12_1_1519369155454581669_v1 got read request: guid# 9e1f678f-a69c9ba2-11e31c17-422a20a4
2025-11-26T18:42:05.531521Z node 13 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][1][StateIdle] Process user action and tx events
2025-11-26T18:42:05.531561Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][1][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:42:05.531578Z node 13 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][1][StateIdle] Process user action and tx pending commits
2025-11-26T18:42:05.531603Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][1][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:42:05.531618Z node 13 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][1][StateIdle] Try persist
2025-11-26T18:42:05.540729Z node 13 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:42:05.540767Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:42:05.540783Z node 13 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:42:05.540808Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:42:05.540825Z node 13 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:42:05.601846Z :INFO: [] MessageGroupId [source9] SessionId [source9|f56e9d90-558d8fa2-3cad81ed-93be0135_0] Write session will now close
2025-11-26T18:42:05.601910Z :DEBUG: [] MessageGroupId [source9] SessionId [source9|f56e9d90-558d8fa2-3cad81ed-93be0135_0] Write session: aborting
2025-11-26T18:42:05.602435Z :INFO: [] MessageGroupId [source9] SessionId [source9|f56e9d90-558d8fa2-3cad81ed-93be0135_0] Write session: gracefully shut down, all writes complete
2025-11-26T18:42:05.602470Z :DEBUG: [] MessageGroupId [source9] SessionId [source9|f56e9d90-558d8fa2-3cad81ed-93be0135_0] Write session: destroy
===== Write =====
MessagesInflight: 10
BytesInflightUncompressed: 0
BytesInflightCompressed: 270
BytesInflightTotal: 270
============
===== StartFuncs-1 =====
MessagesInflight: 10
BytesInflightUncompressed: 0
BytesInflightCompressed: 270
BytesInflightTotal: 270
============
2025-11-26T18:42:05.603285Z :DEBUG: [] Decompression task done. Partition/PartitionSessionId: 0 (0-0)
2025-11-26T18:42:05.603307Z :DEBUG: [] Decompression task done. Partition/PartitionSessionId: 1 (0-0)
2025-11-26T18:42:05.603410Z :DEBUG: [] Decompression task done. Partition/PartitionSessionId: 1 (1-1)
2025-11-26T18:42:05.603473Z :DEBUG: [] Take Data. Partition 0. Read: {0, 0} (0-0)
2025-11-26T18:42:05.603571Z :DEBUG: [] [] [3430877a-9305be47-dcd0f077-4a6fb492] [null] The application data is transferred to the client. Number of messages 1, size 15 bytes
2025-11-26T18:42:05.603657Z :DEBUG: [] Decompression task done. Partition/PartitionSessionId: 0 (1-1)
2025-11-26T18:42:05.603702Z :DEBUG: [] Decompression task done. Partition/PartitionSessionId: 0 (2-2)
Got message: DataReceived { PartitionStreamId: 2 PartitionId: 0 Message { Data: ..15 bytes.. Partition stream id: 2 Cluster: "dc1". Topic: "topic1" Partition: 0 PartitionKey: "" Information: { Offset: 0 SeqNo: 1 MessageGroupId: "source1" CreateTime: 2025-11-26T18:42:04.195000Z WriteTime: 2025-11-26T18:42:04.197000Z Ip: "ipv6:[::1]:40008" UncompressedSize: 15 Meta: { "logtype": "unknown", "ident": "unknown", "server": "ipv6:[::1]:40008" } } } }
2025-11-26T18:42:05.603890Z :DEBUG: [] Take Data. Partition 1. Read: {0, 0} (0-0)
2025-11-26T18:42:05.603964Z :DEBUG: [] [] [3430877a-9305be47-dcd0f077-4a6fb492] [null] The application data is transferred to the client. Number of messages 1, size 15 bytes
Got message: DataReceived { PartitionStreamId: 1 PartitionId: 1 Message { Data: ..15 bytes.. Partition stream id: 1 Cluster: "dc1". Topic: "topic1" Partition: 1 PartitionKey: "" Information: { Offset: 0 SeqNo: 1 MessageGroupId: "source0" CreateTime: 2025-11-26T18:42:04.014000Z WriteTime: 2025-11-26T18:42:04.017000Z Ip: "ipv6:[::1]:40008" UncompressedSize: 15 Meta: { "logtype": "unknown", "ident": "unknown", "server": "ipv6:[::1]:40008" } } } }
2025-11-26T18:42:05.604226Z :DEBUG: [] Take Data. Partition 1. Read: {0, 0} (1-1)
2025-11-26T18:42:05.604284Z :DEBUG: [] [] [3430877a-9305be47-dcd0f077-4a6fb492] [null] The application data is transferred to the client. Number of messages 1, size 15 bytes
Got message: DataReceived { PartitionStreamId: 1 PartitionId: 1 Message { Data: ..15 bytes.. Partition stream id: 1 Cluster: "dc1". Topic: "topic1" Partition: 1 PartitionKey: "" Information: { Offset: 1 SeqNo: 1 MessageGroupId: "source2" CreateTime: 2025-11-26T18:42:04.401000Z WriteTime: 2025-11-26T18:42:04.404000Z Ip: "ipv6:[::1]:40008" UncompressedSize: 15 Meta: { "logtype": "unknown", "ident": "unknown", "server": "ipv6:[::1]:40008" } } } }
2025-11-26T18:42:05.604541Z :DEBUG: [] Take Data. Partition 0. Read: {0, 0} (1-1)
2025-11-26T18:42:05.604606Z :DEBUG: [] [] [3430877a-9305be47-dcd0f077-4a6fb492] [null] The application data is transferred to the client. Number of messages 1, size 15 bytes
Got message: DataReceived { PartitionStreamId: 2 PartitionId: 0 Message { Data: ..15 bytes.. Partition stream id: 2 Cluster: "dc1". Topic: "topic1" Partition: 0 PartitionKey: "" Information: { Offset: 1 SeqNo: 1 MessageGroupId: "source3" CreateTime: 2025-11-26T18:42:04.581000Z WriteTime: 2025-11-26T18:42:04.585000Z Ip: "ipv6:[::1]:40008" UncompressedSize: 15 Meta: { "logtype": "unknown", "ident": "unknown", "server": "ipv6:[::1]:40008" } } } }
2025-11-26T18:42:05.604826Z :DEBUG: [] Take Data. Partition 0. Read: {0, 0} (2-2)
2025-11-26T18:42:05.604897Z :DEBUG: [] [] [3430877a-9305be47-dcd0f077-4a6fb492] [null] The application data is transferred to the client. Number of messages 1, size 15 bytes
Got message: DataReceived { PartitionStreamId: 2 PartitionId: 0 Message { Data: ..15 bytes.. Partition stream id: 2 Cluster: "dc1". Topic: "topic1" Partition: 0 PartitionKey: "" Information: { Offset: 2 SeqNo: 1 MessageGroupId: "source4" CreateTime: 2025-11-26T18:42:04.748000Z WriteTime: 2025-11-26T18:42:04.751000Z Ip: "ipv6:[::1]:40008" UncompressedSize: 15 Meta: { "logtype": "unknown", "ident": "unknown", "server": "ipv6:[::1]:40008" } } } }
===== doRead(5) =====
MessagesInflight: 5
BytesInflightUncompressed: 0
BytesInflightCompressed: 135
BytesInflightTotal: 135
============
>>>> Delete topic
CallPersQueueGRPC request to localhost:21251
MetaRequest {
  CmdDeleteTopic {
    Topic: "rt3.dc1--topic1"
  }
}
2025-11-26T18:42:05.606066Z node 12 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 10 sessionId: source9|f56e9d90-558d8fa2-3cad81ed-93be0135_0 grpc read done: success: 0 data: 
2025-11-26T18:42:05.606098Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 10 sessionId: source9|f56e9d90-558d8fa2-3cad81ed-93be0135_0 grpc read failed
2025-11-26T18:42:05.606140Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 10 sessionId: source9|f56e9d90-558d8fa2-3cad81ed-93be0135_0 grpc closed
2025-11-26T18:42:05.606166Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 10 sessionId: source9|f56e9d90-558d8fa2-3cad81ed-93be0135_0 is DEAD
2025-11-26T18:42:05.607340Z node 12 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=1) Received event: NActors::TEvents::TEvPoison
2025-11-26T18:42:05.608102Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2745: [PQ: 72075186224037892] server disconnected, pipe [12:7577106253082878775:2554] destroyed
2025-11-26T18:42:05.608166Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][1][StateIdle] TPartition::DropOwner.
2025-11-26T18:42:05.608204Z node 13 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][1][StateIdle] Process user action and tx events
2025-11-26T18:42:05.608224Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][1][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:42:05.608241Z node 13 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][1][StateIdle] Process user action and tx pending commits
2025-11-26T18:42:05.608266Z node 13 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][1][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:42:05.608280Z node 13 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][1][StateIdle] Try persist
2025-11-26T18:42:05.611912Z node 12 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpDropPersQueueGroup, opId: 281474976715707:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_drop_pq.cpp:422)
CallPersQueueGRPC response:
Status: 129
ProxyErrorCode: 53
SchemeStatus: 1
FlatTxId {
  TxId: 281474976715707
  SchemeShardTabletId: 72057594046644480
}
ErrorCode: OK
2025-11-26T18:42:05.618395Z node 12 :TX_PROXY ERROR: schemereq.cpp:590: Actor# [12:7577106253082878790:3680] txid# 281474976715708, issues: { message: "Path does not exist" issue_code: 200200 severity: 1 }
RemoveTopic: rt3.dc1--topic1
===Run query:``DECLARE $version as Int64; DECLARE $path AS Utf8; DECLARE $cluster as Utf8; DELETE FROM `/Root/PQ/Config/V2/Topics` WHERE path = $path AND dc = $cluster; UPSERT INTO `/Root/PQ/Config/V2/Versions` (name, version) VALUES ("Topics", $version);`` with topic = topic1, dc = dc1
2025-11-26T18:42:05.621141Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:1521: [PQ: 72075186224037892] Handle TEvPersQueue::TEvDropTablet
2025-11-26T18:42:05.630865Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2745: [PQ: 72075186224037892] server disconnected, pipe [12:7577106240197976233:3368] destroyed
2025-11-26T18:42:05.630909Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2745: [PQ: 72075186224037892] server disconnected, pipe [12:7577106240197976205:2453] destroyed
2025-11-26T18:42:05.631228Z node 12 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--topic1] TEvClientDestroyed 72075186224037892
2025-11-26T18:42:05.631488Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2256: [PQ: 72075186224037892] Destroy direct read session shared/user_12_1_1519369155454581669_v1
2025-11-26T18:42:05.631535Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2256: [PQ: 72075186224037892] Destroy direct read session shared/user_12_1_1519369155454581669_v1
2025-11-26T18:42:05.631600Z node 13 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_12_1_1519369155454581669_v1
2025-11-26T18:42:05.631631Z node 13 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_12_1_1519369155454581669_v1
2025-11-26T18:42:05.631435Z node 12 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_12_1_1519369155454581669_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 1(assignId:1) schedule pipe restart attempt 0 reason: pipe to tablet is dead 72075186224037892, current pipe: [12:7577106244492943697:2486]
2025-11-26T18:42:05.631476Z node 12 :HIVE WARN: hive_impl.cpp:516: HIVE#72057594037968897 Handle TEvLocal::TEvTabletStatus from node 12, TabletId: 72075186224037893 not found
2025-11-26T18:42:05.631536Z node 12 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_12_1_1519369155454581669_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:2) schedule pipe restart attempt 0 reason: pipe to tablet is dead 72075186224037892, current pipe: [12:7577106244492943698:2487]
2025-11-26T18:42:05.631868Z node 12 :HIVE WARN: hive_impl.cpp:516: HIVE#72057594037968897 Handle TEvLocal::TEvTabletStatus from node 13, TabletId: 72075186224037892 not found
2025-11-26T18:42:05.632423Z node 12 :PQ_READ_PROXY INFO: read_session_actor.cpp:1777: session cookie 1 consumer shared/user session shared/user_12_1_1519369155454581669_v1 balancer dead, restarting all from topic: topic# Topic rt3.dc1--topic1 in dc dc1 in database: Root
2025-11-26T18:42:05.632670Z node 12 :PQ_READ_PROXY INFO: read_session_actor.cpp:1727: session cookie 1 consumer shared/user session shared/user_12_1_1519369155454581669_v1 got all from client, actual releasing: partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:2)
2025-11-26T18:42:05.632695Z node 12 :PQ_READ_PROXY INFO: read_session_actor.cpp:1651: session cookie 1 consumer shared/user session shared/user_12_1_1519369155454581669_v1 released: partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:2)
2025-11-26T18:42:05.632817Z node 12 :PQ_READ_PROXY INFO: read_session_actor.cpp:1727: session cookie 1 consumer shared/user session shared/user_12_1_1519369155454581669_v1 got all from client, actual releasing: partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 1(assignId:1)
2025-11-26T18:42:05.632840Z node 12 :PQ_READ_PROXY INFO: read_session_actor.cpp:1651: session cookie 1 consumer shared/user session shared/user_12_1_1519369155454581669_v1 released: partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 1(assignId:1)
2025-11-26T18:42:05.632915Z node 12 :PQ_READ_PROXY INFO: read_session_actor.cpp:1229: session cookie 1 consumer shared/user session shared/user_12_1_1519369155454581669_v1 register session: topic# rt3.dc1--topic1
2025-11-26T18:42:05.640815Z node 12 :HIVE WARN: tx__delete_tablet.cpp:91: HIVE#72057594037968897 THive::TTxDeleteTablet tablet (72057594046644480,5) wasn't found
2025-11-26T18:42:05.640920Z node 12 :HIVE WARN: tx__delete_tablet.cpp:91: HIVE#72057594037968897 THive::TTxDeleteTablet tablet (72057594046644480,6) wasn't found
2025-11-26T18:42:05.867240Z node 12 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976715709. Ctx: { TraceId: 01kb0qj1p4emz28n9d1cz16bmd, Database: , SessionId: ydb://session/3?node_id=12&id=YTc2MDNhZjAtNWE3NTM2MTMtODA4NjY5NWEtYTU1YTczNWU=, PoolId: , DatabaseId: /Root}. Database not set, use /Root
===Query complete
CallPersQueueGRPC request to localhost:21251
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--topic1"
  }
}
2025-11-26T18:42:05.974475Z node 12 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
MetaResponse {
  CmdGetTopicMetadataResult {
    TopicInfo {
      Topic: "rt3.dc1--topic1"
      NumPartitions: 2
      Config {
        PartitionConfig {
          LifetimeSeconds: 86400
          LowWatermark: 8388608
          SourceIdLifetimeSeconds: 86400
          WriteSpeedInBytesPerSecond: 20000000
          BurstSize: 20000000
          SourceIdMaxCounts: 6000000
        }
        Version: 1
        LocalDC: true
        Codecs {
          Ids: 0
          Ids: 1
          Ids: 2
          Codecs: "raw"
          Codecs: "gzip"
          Codecs: "lzop"
        }
        TopicPath: "/Root/PQ/rt3.dc1--topic1"
        YdbDatabasePath: "/Root"
        Consumers {
          Name: "user"
          ReadFromTimestampsMs: 0
          FormatVersion: 0
          Version: 0
        }
      }
      ErrorCode: OK
    }
  }
}
CallPersQueueGRPC request to localhost:21251
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--topic1"
  }
}
2025-11-26T18:42:06.028063Z node 12 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
MetaResponse {
  CmdGetTopicMetadataResult {
    TopicInfo {
      Topic: "rt3.dc1--topic1"
      NumPartitions: 2
      Config {
        PartitionConfig {
          LifetimeSeconds: 86400
          LowWatermark: 8388608
          SourceIdLifetimeSeconds: 86400
          WriteSpeedInBytesPerSecond: 20000000
          BurstSize: 20000000
          SourceIdMaxCounts: 6000000
        }
        Version: 1
        LocalDC: true
        Codecs {
          Ids: 0
          Ids: 1
          Ids: 2
          Codecs: "raw"
          Codecs: "gzip"
          Codecs: "lzop"
        }
        TopicPath: "/Root/PQ/rt3.dc1--topic1"
        YdbDatabasePath: "/Root"
        Consumers {
          Name: "user"
          ReadFromTimestampsMs: 0
          FormatVersion: 0
          Version: 0
        }
      }
      ErrorCode: OK
    }
  }
}
CallPersQueueGRPC request to localhost:21251
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--topic1"
  }
}
2025-11-26T18:42:06.080956Z node 12 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
MetaResponse {
  CmdGetTopicMetadataResult {
    TopicInfo {
      Topic: "rt3.dc1--topic1"
      NumPartitions: 2
      Config {
        PartitionConfig {
          LifetimeSeconds: 86400
          LowWatermark: 8388608
          SourceIdLifetimeSeconds: 86400
          WriteSpeedInBytesPerSecond: 20000000
          BurstSize: 20000000
          SourceIdMaxCounts: 6000000
        }
        Version: 1
        LocalDC: true
        Codecs {
          Ids: 0
          Ids: 1
          Ids: 2
          Codecs: "raw"
          Codecs: "gzip"
          Codecs: "lzop"
        }
        TopicPath: "/Root/PQ/rt3.dc1--topic1"
        YdbDatabasePath: "/Root"
        Consumers {
          Name: "user"
          ReadFromTimestampsMs: 0
          FormatVersion: 0
          Version: 0
        }
      }
      ErrorCode: OK
    }
  }
}
CallPersQueueGRPC request to localhost:21251
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--topic1"
  }
}
2025-11-26T18:42:06.137288Z node 12 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
MetaResponse {
  CmdGetTopicMetadataResult {
    TopicInfo {
      Topic: "rt3.dc1--topic1"
      NumPartitions: 2
      Config {
        PartitionConfig {
          LifetimeSeconds: 86400
          LowWatermark: 8388608
          SourceIdLifetimeSeconds: 86400
          WriteSpeedInBytesPerSecond: 20000000
          BurstSize: 20000000
          SourceIdMaxCounts: 6000000
        }
        Version: 1
        LocalDC: true
        Codecs {
          Ids: 0
          Ids: 1
          Ids: 2
          Codecs: "raw"
          Codecs: "gzip"
          Codecs: "lzop"
        }
        TopicPath: "/Root/PQ/rt3.dc1--topic1"
        YdbDatabasePath: "/Root"
        Consumers {
          Name: "user"
          ReadFromTimestampsMs: 0
          FormatVersion: 0
          Version: 0
        }
      }
      ErrorCode: OK
    }
  }
}
CallPersQueueGRPC request to localhost:21251
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--topic1"
  }
}
2025-11-26T18:42:06.191029Z node 12 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
MetaResponse {
  CmdGetTopicMetadataResult {
    TopicInfo {
      Topic: "rt3.dc1--topic1"
      NumPartitions: 2
      Config {
        PartitionConfig {
          LifetimeSeconds: 86400
          LowWatermark: 8388608
          SourceIdLifetimeSeconds: 86400
          WriteSpeedInBytesPerSecond: 20000000
          BurstSize: 20000000
          SourceIdMaxCounts: 6000000
        }
        Version: 1
        LocalDC: true
        Codecs {
          Ids: 0
          Ids: 1
          Ids: 2
          Codecs: "raw"
          Codecs: "gzip"
          Codecs: "lzop"
        }
        TopicPath: "/Root/PQ/rt3.dc1--topic1"
        YdbDatabasePath: "/Root"
        Consumers {
          Name: "user"
          ReadFromTimestampsMs: 0
          FormatVersion: 0
          Version: 0
        }
      }
      ErrorCode: OK
    }
  }
}
CallPersQueueGRPC request to localhost:21251
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--topic1"
  }
}
2025-11-26T18:42:06.244667Z node 12 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--topic1, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
>>>> Topic deleted
Got message: PartitionStreamClosed { PartitionStreamId: 2 PartitionId: 0 Reason: Lost }
Got message: PartitionStreamClosed { PartitionStreamId: 1 PartitionId: 1 Reason: Lost }
===== StartFuncs-2 =====
MessagesInflight: 5
BytesInflightUncompressed: 0
BytesInflightCompressed: 135
BytesInflightTotal: 135
============
2025-11-26T18:42:11.249732Z :DEBUG: [] Decompression task done. Partition/PartitionSessionId: 1 (2-2)
2025-11-26T18:42:11.249785Z :DEBUG: [] Decompression task done. Partition/PartitionSessionId: 1 (3-3)
2025-11-26T18:42:11.249958Z :DEBUG: [] Decompression task done. Partition/PartitionSessionId: 0 (3-3)
2025-11-26T18:42:11.250005Z :DEBUG: [] Decompression task done. Partition/PartitionSessionId: 0 (4-4)
2025-11-26T18:42:11.250128Z :DEBUG: [] Decompression task done. Partition/PartitionSessionId: 1 (4-4)
===== End =====
MessagesInflight: 0
BytesInflightUncompressed: 0
BytesInflightCompressed: 0
BytesInflightTotal: 0
============
2025-11-26T18:42:12.253641Z :INFO: [] [] [3430877a-9305be47-dcd0f077-4a6fb492] Closing read session. Close timeout: 0.000000s
2025-11-26T18:42:12.253719Z :INFO: [] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset):
2025-11-26T18:42:12.253796Z :INFO: [] [] [3430877a-9305be47-dcd0f077-4a6fb492] Counters: { Errors: 0 CurrentSessionLifetimeMs: 8754 BytesRead: 150 MessagesRead: 10 BytesReadCompressed: 270 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-11-26T18:42:12.253945Z :NOTICE: [] [] [3430877a-9305be47-dcd0f077-4a6fb492] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Close with zero timeout " }
2025-11-26T18:42:12.254009Z :DEBUG: [] [] [3430877a-9305be47-dcd0f077-4a6fb492] [null] Abort session to cluster
2025-11-26T18:42:12.255145Z :NOTICE: [] [] [3430877a-9305be47-dcd0f077-4a6fb492] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
2025-11-26T18:42:12.258607Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_12_1_1519369155454581669_v1 grpc read done: success# 0, data# {  }
2025-11-26T18:42:12.258644Z node 12 :PQ_READ_PROXY INFO: read_session_actor.cpp:125: session cookie 1 consumer shared/user session shared/user_12_1_1519369155454581669_v1 grpc read failed
2025-11-26T18:42:12.258671Z node 12 :PQ_READ_PROXY INFO: read_session_actor.cpp:92: session cookie 1 consumer shared/user session shared/user_12_1_1519369155454581669_v1 grpc closed
2025-11-26T18:42:12.258693Z node 12 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 1 consumer shared/user session shared/user_12_1_1519369155454581669_v1 is DEAD
