2025-11-21T14:10:47.817100Z node 8 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
test_client.cpp: SetPath # /home/runner/.ya/build/build_root/w20x/005377/r3tmp/tmpMBKeYe/pdisk_1.dat
2025-11-21T14:10:47.816767Z node 7 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-11-21T14:10:47.818003Z node 7 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-11-21T14:10:47.818040Z node 7 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=incorrect path status: LookupError;
2025-11-21T14:10:47.826591Z node 8 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-11-21T14:10:47.826646Z node 8 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=incorrect path status: LookupError;
2025-11-21T14:10:47.862251Z node 7 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
2025-11-21T14:10:47.882677Z node 7 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(8, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-11-21T14:10:47.882709Z node 7 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(8, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-11-21T14:10:47.889088Z node 7 :HIVE WARN: hive_impl.cpp:811: HIVE#72057594037968897 Handle TEvInterconnect::TEvNodeConnected, NodeId 8 Cookie 8
2025-11-21T14:10:47.890853Z node 7 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(8, (0,0,0,0)) VolatileState: Connecting -> Connected
TServer::EnableGrpc on GrpcPort 32602, node 7
2025-11-21T14:10:47.911252Z node 7 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(7, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-11-21T14:10:47.911281Z node 7 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(7, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-11-21T14:10:47.912943Z node 7 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(7, (0,0,0,0)) VolatileState: Connecting -> Connected
2025-11-21T14:10:47.920744Z INFO: TTestServer started on Port 16727 GrpcPort 32602
2025-11-21T14:10:47.918799Z node 7 :NET_CLASSIFIER WARN: net_classifier.cpp:190: distributable config is empty, broken or outdated, will use file: /home/runner/.ya/build/build_root/w20x/005377/r3tmp/yandex5UmO2Z.tmp
2025-11-21T14:10:47.918814Z node 7 :NET_CLASSIFIER WARN: net_classifier.cpp:196: will try to initialize from file: /home/runner/.ya/build/build_root/w20x/005377/r3tmp/yandex5UmO2Z.tmp
TClient is connected to server localhost:16727
PQClient connected to localhost:32602
WaitRootIsUp 'Root'...
TClient::Ls request: Root
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "Root"
    PathId: 1
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 1
    CreateStep: 0
    ParentPathId: 1
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 1
      SubDomainVersion: 0
      SecurityStateVersion: 0
    }
    ChildrenExist: false
  }
  Children {
    Name: ".sys"
    PathId: 18446744073709551615
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 0
    CreateStep: 0
    ParentPathId: 18446744073709551615
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 0
      Pl...
(TRUNCATED)
WaitRootIsUp 'Root' success.
2025-11-21T14:10:47.948272Z node 7 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpAlterSubDomain, opId: 281474976715657:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at ydb/core/tx/schemeshard/schemeshard__operation_alter_subdomain.cpp:311)
waiting...
2025-11-21T14:10:47.977187Z node 7 :NET_CLASSIFIER WARN: net_classifier.cpp:202: successfully initialized from file: /home/runner/.ya/build/build_root/w20x/005377/r3tmp/yandex5UmO2Z.tmp
2025-11-21T14:10:47.977490Z node 7 :NET_CLASSIFIER ERROR: net_classifier.cpp:228: got bad distributable configuration
2025-11-21T14:10:47.977863Z node 7 :FLAT_TX_SCHEMESHARD WARN: schemeshard__notify.cpp:122: NotifyTxCompletion, unknown transaction, txId: 281474976715657, at schemeshard: 72057594046644480
waiting...
2025-11-21T14:10:48.072579Z node 7 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976715659:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:690)
waiting...
2025-11-21T14:10:48.099441Z node 7 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-11-21T14:10:48.106467Z node 8 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
waiting...
waiting...
2025-11-21T14:10:48.648288Z node 8 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [8:7575180914486579587:2296], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-21T14:10:48.648332Z node 8 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-21T14:10:48.648747Z node 8 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [8:7575180914486579608:2299], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-21T14:10:48.648760Z node 8 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [8:7575180914486579609:2300], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-21T14:10:48.648793Z node 8 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-21T14:10:48.660403Z node 7 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateResourcePool, opId: 281474976720657:3, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at ydb/core/tx/schemeshard/schemeshard__operation_create_resource_pool.cpp:179)
2025-11-21T14:10:48.675341Z node 8 :KQP_WORKLOAD_SERVICE WARN: helpers.h:73: [WorkloadService] [TPoolCreatorActor] ActorId: [8:7575180914486579612:2301], DatabaseId: /Root, PoolId: default, Scheduled retry for error: { <main>: Error: Transaction 281474976720657 completed, doublechecking }
2025-11-21T14:10:48.702134Z node 7 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:615: Compilation failed, self: [7:7575180916751177293:2335], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-11-21T14:10:48.703094Z node 7 :KQP_SESSION WARN: kqp_session_actor.cpp:2517: SessionId: ydb://session/3?node_id=7&id=NGQ3YzQ3OTMtZDFjNDNhOTAtN2UxMTRiNDgtY2Y4ZTdhN2I=, ActorId: [7:7575180916751177252:2327], ActorState: ExecuteState, TraceId: 01kakc1q7mc4pabsp862fvkfh8, ReplyQueryCompileError, status: SCHEME_ERROR, issues: { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } }, remove tx with tx_id: 
2025-11-21T14:10:48.703250Z node 7 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-11-21T14:10:48.704366Z node 7 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976715662:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:690)
2025-11-21T14:10:48.745667Z node 7 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976715663:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:690)
2025-11-21T14:10:48.750249Z node 8 :TX_PROXY ERROR: schemereq.cpp:593: Actor# [8:7575180914486579704:2177] txid# 281474976720658, issues: { message: "Check failed: path: \'/Root/.metadata/workload_manager/pools/default\', error: path exist, request accepts it (id: [OwnerId: 72057594046644480, LocalPathId: 9], type: EPathTypeResourcePool, state: EPathStateNoChanges), source_location: ydb/core/tx/schemeshard/schemeshard__operation_create_resource_pool.cpp:92" severity: 1 }
2025-11-21T14:10:48.756708Z node 8 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:615: Compilation failed, self: [8:7575180914486579718:2309], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:5:17: Error: At function: KiReadTable!
        <main>:5:17: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Versions]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-11-21T14:10:48.756861Z node 8 :KQP_SESSION WARN: kqp_session_actor.cpp:2517: SessionId: ydb://session/3?node_id=8&id=YmM0NTFjOTQtNjBjY2JhMTItYzkwOGQwZWUtOThhYmYxMjI=, ActorId: [8:7575180914486579569:2293], ActorState: ExecuteState, TraceId: 01kakc1q629ksdwx1a3rdhtpzk, ReplyQueryCompileError, status: SCHEME_ERROR, issues: { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 5 column: 17 } message: "At function: KiReadTable!" end_position { row: 5 column: 17 } severity: 1 issues { position { row: 5 column: 17 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Versions]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 5 column: 17 } issue_code: 2003 severity: 1 } } }, remove tx with tx_id: 
2025-11-21T14:10:48.756997Z node 8 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 5 column: 17 } message: "At function: KiReadTable!" end_position { row: 5 column: 17 } severity: 1 issues { position { row: 5 column: 17 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Versions]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 5 column: 17 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-11-21T14:10:48.769806Z node 7 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976715664:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:690)
=== Init DC: UPSERT INTO `/Root/PQ/Config/V2/Cluster` (name, balancer, local, enabled, weight) VALUES ("dc1", "localhost", true, true, 1000), ("dc2", "dc2.logbroker.yandex.net", false, true, 1000);
2025-11-21T14:10:48.812769Z node 7 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-11-21T14:10:48.813197Z node 7 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976715665. Ctx: { TraceId: 01kakc1qaq12dh9581qr1dvmg4, Database: , SessionId: ydb://session/3?node_id=7&id=Mzg5YzRlMC00NjBkMTM2MS05M2YyZjZmZi1hMjI4ZGJhMQ==, PoolId: default, DatabaseId: /Root}. Database not set, use /Root
2025-11-21T14:10:48.816822Z node 8 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
=== CheckClustersList. Subcribe to ClusterTracker from [7:7575180916751177667:3022] 
=== CheckClustersList. Ok
PQ Client: create topic: rt3.dc1--topic1 with 1 partitions
CallPersQueueGRPC request to localhost:32602
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--topic1"
  }
}
2025-11-21T14:10:54.143031Z node 7 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--topic1, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
CallPersQueueGRPC request to localhost:32602
MetaRequest {
  CmdCreateTopic {
    Topic: "rt3.dc1--topic1"
    NumPartitions: 1
    Config {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
  }
}
CallPersQueueGRPC response:
Status: 129
ProxyErrorCode: 53
SchemeStatus: 1
FlatTxId {
  TxId: 281474976715671
  SchemeShardTabletId: 72057594046644480
  PathId: 13
}
ErrorCode: OK
AddTopic: rt3.dc1--topic1
===Run query:``DECLARE $version as Int64; DECLARE $path AS Utf8; DECLARE $cluster as Utf8; UPSERT INTO `/Root/PQ/Config/V2/Topics` (path, dc) VALUES ($path, $cluster); UPSERT INTO `/Root/PQ/Config/V2/Versions` (name, version) VALUES ("Topics", $version);`` with topic = topic1, dc = dc1
2025-11-21T14:10:54.165633Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:2960: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-11-21T14:10:54.168572Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:2992: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-11-21T14:10:54.168666Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:787: [PQ: 72075186224037892] no config, start with empty partitions and default config
2025-11-21T14:10:54.168676Z node 7 :PERSQUEUE NOTICE: pq_impl.cpp:913: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-11-21T14:10:54.168693Z node 7 :PERSQUEUE INFO: pq_impl.cpp:612: [PQ: 72075186224037892] doesn't have tx writes info
2025-11-21T14:10:54.169183Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [7:7575180942520981742:3189], now have 1 active actors on pipe
2025-11-21T14:10:54.169299Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-21T14:10:54.175864Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-21T14:10:54.179501Z node 8 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1656: [72075186224037893][] pipe [7:7575180942520981743:3190] connected; active server actors: 1
2025-11-21T14:10:54.179962Z node 8 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1520: [72075186224037893][rt3.dc1--topic1] updating configuration. Deleted partitions []. Added partitions [0]
2025-11-21T14:10:54.180338Z node 8 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:971: [72075186224037893][rt3.dc1--topic1] Discovered subdomain [OwnerId: 72057594046644480, LocalPathId: 1] state, outOfSpace = 0 at RB 72075186224037893
2025-11-21T14:10:54.181572Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [8:7575180940256383895:2390], now have 1 active actors on pipe
2025-11-21T14:10:54.181640Z node 8 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:140: [72075186224037893][rt3.dc1--topic1] BALANCER INIT DONE for rt3.dc1--topic1: (0, 72075186224037892) 
2025-11-21T14:10:54.181658Z node 8 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:404: [72075186224037893][rt3.dc1--topic1] TEvClientConnected TabletId 72075186224037892, NodeId 7, Generation 1
2025-11-21T14:10:54.194192Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [7:7575180942520981807:3238], now have 1 active actors on pipe
2025-11-21T14:10:54.194281Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-21T14:10:54.195150Z node 7 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976715672. Ctx: { TraceId: 01kakc1wjcd6va7e2bjgwe26q5, Database: , SessionId: ydb://session/3?node_id=7&id=ZDkyN2ViNjQtZWQxY2ZmN2YtZWJiOGYyYzYtM2Q0YjQ3MzY=, PoolId: default, DatabaseId: /Root}. Database not set, use /Root
2025-11-21T14:10:54.195372Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-21T14:10:54.195560Z node 7 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--topic1:0:Initializer] Start initializing step TInitConfigStep
2025-11-21T14:10:54.195572Z node 7 :PERSQUEUE DEBUG: partition.cpp:1316: [72075186224037892][Partition][0][StateInit] HandleOnInit TEvPQ::TEvProposePartitionConfig
2025-11-21T14:10:54.195633Z node 7 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--topic1:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-11-21T14:10:54.195683Z node 7 :PERSQUEUE INFO: partition_init.cpp:1107: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [7:7575180942520981820:2427]
2025-11-21T14:10:54.196553Z node 7 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--topic1:0:Initializer] Start initializing step TInitFieldsStep
2025-11-21T14:10:54.196556Z node 7 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--topic1:0:Initializer] Initializing completed.
2025-11-21T14:10:54.196561Z node 7 :PERSQUEUE INFO: partition.cpp:708: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--topic1' partition 0 generation 1 [7:7575180942520981820:2427]
2025-11-21T14:10:54.196571Z node 7 :PERSQUEUE DEBUG: partition.cpp:728: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--topic1 partitition 0 so 0 endOffset 0 Head Offset 0 PartNo 0 PackedSize 0 count 0 nextOffset 0 batches 0
2025-11-21T14:10:54.196578Z node 7 :PERSQUEUE DEBUG: partition_mlp.cpp:107: [72075186224037892][Partition][0][StateIdle] Initializing MLP Consumers: 0
2025-11-21T14:10:54.196899Z node 7 :PERSQUEUE DEBUG: partition.cpp:4406: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 1
2025-11-21T14:10:54.196906Z node 7 :PERSQUEUE DEBUG: partition.cpp:2313: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-21T14:10:54.196912Z node 7 :PERSQUEUE DEBUG: partition.cpp:2400: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TTransaction[ProposeConfig])
2025-11-21T14:10:54.196922Z node 7 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-21T14:10:54.196924Z node 7 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-21T14:10:54.196926Z node 7 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-21T14:10:54.196929Z node 7 :PERSQUEUE DEBUG: partition.cpp:2331: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-21T14:10:54.196938Z node 7 :PERSQUEUE DEBUG: partition.cpp:2313: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-21T14:10:54.196940Z node 7 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-21T14:10:54.196941Z node 7 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-21T14:10:54.196944Z node 7 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-21T14:10:54.196946Z node 7 :PERSQUEUE DEBUG: partition.cpp:2331: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-21T14:10:54.196955Z node 7 :PERSQUEUE DEBUG: partition_read.cpp:930: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-11-21T14:10:54.196963Z node 7 :PERSQUEUE DEBUG: partition_mlp.cpp:70: [72075186224037892][Partition][0][StateIdle] Process MLP pending events. Count 0
2025-11-21T14:10:54.197038Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-21T14:10:54.197086Z node 7 :PERSQUEUE DEBUG: partition_compaction.cpp:183: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-21T14:10:54.199749Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-21T14:10:54.199817Z node 7 :PERSQUEUE DEBUG: partition.cpp:1428: [72075186224037892][Partition][0][StateIdle] Handle TEvPQ::TEvTxCommit Step 1763734254233, TxId 281474976715671
2025-11-21T14:10:54.199833Z node 7 :PERSQUEUE DEBUG: partition.cpp:2313: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-21T14:10:54.199838Z node 7 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-21T14:10:54.199840Z node 7 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-21T14:10:54.199849Z node 7 :PERSQUEUE DEBUG: partition.cpp:2464: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TTransaction[ProposeConfig])
2025-11-21T14:10:54.199860Z node 7 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-21T14:10:54.199863Z node 7 :PERSQUEUE DEBUG: partition.cpp:2326: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-21T14:10:54.199868Z node 7 :PERSQUEUE DEBUG: partition.cpp:2331: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-21T14:10:54.199911Z node 7 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-21T14:10:54.200885Z node 7 :PERSQUEUE DEBUG: partition.cpp:2137: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-21T14:10:54.200925Z node 7 :PERSQUEUE DEBUG: partition_mlp.cpp:107: [72075186224037892][Partition][0][StateIdle] Initializing MLP Consumers: 0
2025-11-21T14:10:54.200961Z node 7 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-11-21T14:10:54.200969Z node 7 :PERSQUEUE DEBUG: partition.cpp:2313: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-21T14:10:54.200971Z node 7 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-21T14:10:54.200973Z node 7 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-21T14:10:54.200976Z node 7 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-21T14:10:54.200978Z node 7 :PERSQUEUE DEBUG: partition.cpp:2331: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-21T14:10:54.200984Z node 7 :PERSQUEUE DEBUG: partition_compaction.cpp:183: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-21T14:10:54.201117Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:398: [PQ: 72075186224037892] Apply new config PartitionConfig { LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 } PartitionIds: 0 TopicName: "rt3.dc1--topic1" Version: 0 LocalDC: true Codecs { Ids: 0 Ids: 1 Ids: 2 Codecs: "raw" Codecs: "gzip" Codecs: "lzop" } TopicPath: "/Root/PQ/rt3.dc1--topic1" YcCloudId: "" YcFolderId: "" YdbDatabaseId: "" YdbDatabasePath: "/Root" Partitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } AllPartitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } Consumers { Name: "user" ReadFromTimestampsMs: 0 FormatVersion: 0 Version: 0 Generation: 0 } MonitoringProjectId: ""
2025-11-21T14:10:54.201138Z node 7 :PERSQUEUE NOTICE: pq_impl.cpp:913: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-11-21T14:10:54.201183Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-21T14:10:54.205702Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-21T14:10:54.205733Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-21T14:10:54.206614Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
===Query complete
TClient::Ls request: /Root/PQ/rt3.dc1--topic1
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--topic1"
    PathId: 13
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976715671
    CreateStep: 1763734254233
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--topic1"
    PathId: 13
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 600000...
(TRUNCATED)
GetTopicVersionFromPath:  record Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--topic1"
    PathId: 13
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976715671
    CreateStep: 1763734254233
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--topic1"
    PathId: 13
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      YdbDatabasePath: "/Root"
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
    Partitions {
      PartitionId: 0
      TabletId: 72075186224037892
      Status: Active
    }
    AlterVersion: 1
    BalancerTabletID: 72075186224037893
    NextPartitionId: 1
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 1
      PlanResolution: 7
      Coordinators: 72057594046316545
      TimeCastBucketsPerMediator: 2
      Mediators: 72057594046382081
    }
    DomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    PathsInside: 12
    PathsLimit: 10000
    ShardsInside: 6
    ShardsLimit: 200000
    ResourcesDomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    DiskSpaceUsage {
      Tables {
        TotalSize: 0
        DataSize: 0
        IndexSize: 0
      }
      Topics {
        ReserveSize: 0
        AccountSize: 0
        DataSize: 0
        UsedReserveSize: 0
      }
    }
    PQPartitionsInside: 1
    PQPartitionsLimit: 1000000
    SchemeLimits {
      MaxDepth: 32
      MaxPaths: 10000
      MaxChildrenInDir: 100000
      MaxAclBytesSize: 10240
      MaxTableColumns: 200
      MaxTableColumnNameLength: 255
      MaxTableKeyColumns: 30
      MaxTableIndices: 20
      MaxShards: 200000
      MaxShardsInPath: 35000
      MaxConsistentCopyTargets: 10000
      MaxPathElementLength: 255
      ExtraPathSymbolsAllowed: "!\"#$%&\'()*+,-.:;<=>?@[\\]^_`{|}~"
      MaxPQPartitions: 1000000
      MaxTableCdcStreams: 5
      MaxExports: 10
      MaxImports: 10
      MaxColumnTableColumns: 10000
    }
  }
}
Path: "/Root/PQ/rt3.dc1--topic1"
 name rt3.dc1--topic1 version1
CallPersQueueGRPC request to localhost:32602
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--topic1"
  }
}
2025-11-21T14:10:54.213141Z node 7 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
MetaResponse {
  CmdGetTopicMetadataResult {
    TopicInfo {
      Topic: "rt3.dc1--topic1"
      NumPartitions: 1
      Config {
        PartitionConfig {
          LifetimeSeconds: 86400
          LowWatermark: 8388608
          SourceIdLifetimeSeconds: 86400
          WriteSpeedInBytesPerSecond: 20000000
          BurstSize: 20000000
          SourceIdMaxCounts: 6000000
        }
        Version: 1
        LocalDC: true
        Codecs {
          Ids: 0
          Ids: 1
          Ids: 2
          Codecs: "raw"
          Codecs: "gzip"
          Codecs: "lzop"
        }
        TopicPath: "/Root/PQ/rt3.dc1--topic1"
        YdbDatabasePath: "/Root"
        Consumers {
          Name: "user"
          ReadFromTimestampsMs: 0
          FormatVersion: 0
          Version: 0
        }
      }
      ErrorCode: OK
    }
  }
}
=== Topic created, have version: 1
2025-11-21T14:10:54.218575Z :INFO: [] [] [13e92436-20538e01-57bcc6dd-bc92c1ad] Starting read session
2025-11-21T14:10:54.218609Z :DEBUG: [] [] [13e92436-20538e01-57bcc6dd-bc92c1ad] Starting session to cluster null (localhost:32602)
2025-11-21T14:10:54.219211Z :DEBUG: [] [] [13e92436-20538e01-57bcc6dd-bc92c1ad] [null] In Reconnect, ReadSizeBudget = 2621440, ReadSizeServerDelta = 0
2025-11-21T14:10:54.219218Z :DEBUG: [] [] [13e92436-20538e01-57bcc6dd-bc92c1ad] [null] New values: ReadSizeBudget = 2621440, ReadSizeServerDelta = 0
2025-11-21T14:10:54.219226Z :DEBUG: [] [] [13e92436-20538e01-57bcc6dd-bc92c1ad] [null] Reconnecting session to cluster null in 0.000000s
2025-11-21T14:10:54.219681Z :DEBUG: [] [] [13e92436-20538e01-57bcc6dd-bc92c1ad] [null] Successfully connected. Initializing session
2025-11-21T14:10:54.220018Z node 7 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:109: new grpc connection
2025-11-21T14:10:54.220030Z node 7 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:131: new session created cookie 1
2025-11-21T14:10:54.220605Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { topic: "topic1" } read_only_original: true consumer: "shared/user" read_params { max_read_size: 5242880 } } }
2025-11-21T14:10:54.220664Z node 7 :PQ_READ_PROXY INFO: read_session_actor.cpp:941: session cookie 1 consumer shared/user session shared/user_7_1_3034911298628433174_v1 read init: from# ipv6:[::1]:51498, request# { init_request { topics_read_settings { topic: "topic1" } read_only_original: true consumer: "shared/user" read_params { max_read_size: 5242880 } } }
2025-11-21T14:10:54.220773Z node 7 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 1 consumer shared/user session shared/user_7_1_3034911298628433174_v1 auth for : user
2025-11-21T14:10:54.221499Z :INFO: [] [] [13e92436-20538e01-57bcc6dd-bc92c1ad] [null] Server session id: shared/user_7_1_3034911298628433174_v1
2025-11-21T14:10:54.221547Z :DEBUG: [] [] [13e92436-20538e01-57bcc6dd-bc92c1ad] [null] After sending read request: ReadSizeBudget = 2621440, ReadSizeServerDelta = 0
2025-11-21T14:10:54.221062Z node 7 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 1 consumer shared/user session shared/user_7_1_3034911298628433174_v1 Handle describe topics response
2025-11-21T14:10:54.221085Z node 7 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 1 consumer shared/user session shared/user_7_1_3034911298628433174_v1 auth is DEAD
2025-11-21T14:10:54.221101Z node 7 :PQ_READ_PROXY INFO: read_session_actor.cpp:1058: session cookie 1 consumer shared/user session shared/user_7_1_3034911298628433174_v1 auth ok: topics# 1, initDone# 0
2025-11-21T14:10:54.221360Z node 7 :PQ_READ_PROXY INFO: read_session_actor.cpp:1229: session cookie 1 consumer shared/user session shared/user_7_1_3034911298628433174_v1 register session: topic# rt3.dc1--topic1
2025-11-21T14:10:54.221732Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_7_1_3034911298628433174_v1 grpc read done: success# 1, data# { read { } }
2025-11-21T14:10:54.221761Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1850: session cookie 1 consumer shared/user session shared/user_7_1_3034911298628433174_v1 got read request: guid# ea9348cb-62ba3ccd-48b8bdce-81b6b745
2025-11-21T14:10:54.223625Z node 8 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1656: [72075186224037893][rt3.dc1--topic1] pipe [7:7575180942520981889:2443] connected; active server actors: 1
2025-11-21T14:10:54.223660Z node 8 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1707: [72075186224037893][rt3.dc1--topic1] consumer "user" register session for pipe [7:7575180942520981889:2443] session shared/user_7_1_3034911298628433174_v1
2025-11-21T14:10:54.223676Z node 8 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:639: [72075186224037893][rt3.dc1--topic1] consumer user register readable partition 0
2025-11-21T14:10:54.223689Z node 8 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:669: [72075186224037893][rt3.dc1--topic1] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-11-21T14:10:54.223698Z node 8 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:871: [72075186224037893][rt3.dc1--topic1] consumer user register reading session ReadingSession "shared/user_7_1_3034911298628433174_v1" (Sender=[7:7575180942520981884:2443], Pipe=[7:7575180942520981889:2443], Partitions=[], ActiveFamilyCount=0)
2025-11-21T14:10:54.223702Z node 8 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1186: [72075186224037893][rt3.dc1--topic1] consumer user rebalancing was scheduled
2025-11-21T14:10:54.223714Z node 8 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1258: [72075186224037893][rt3.dc1--topic1] consumer user balancing. Sessions=1, Families=1, UnreadableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-11-21T14:10:54.223724Z node 8 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1305: [72075186224037893][rt3.dc1--topic1] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_7_1_3034911298628433174_v1" (Sender=[7:7575180942520981884:2443], Pipe=[7:7575180942520981889:2443], Partitions=[], ActiveFamilyCount=0)
2025-11-21T14:10:54.223737Z node 8 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:549: [72075186224037893][rt3.dc1--topic1] consumer user family 1 status Active partitions [0] session "shared/user_7_1_3034911298628433174_v1" sender [7:7575180942520981884:2443] lock partition 0 for ReadingSession "shared/user_7_1_3034911298628433174_v1" (Sender=[7:7575180942520981884:2443], Pipe=[7:7575180942520981889:2443], Partitions=[], ActiveFamilyCount=1) generation 1 step 1
2025-11-21T14:10:54.223759Z node 8 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1325: [72075186224037893][rt3.dc1--topic1] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-11-21T14:10:54.223765Z node 8 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1403: [72075186224037893][rt3.dc1--topic1] consumer user balancing duration: 0.000047s
2025-11-21T14:10:54.224112Z node 7 :PQ_READ_PROXY INFO: read_session_actor.cpp:1347: session cookie 1 consumer shared/user session shared/user_7_1_3034911298628433174_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--topic1" Generation: 1 Step: 1 Session: "shared/user_7_1_3034911298628433174_v1" ClientId: "user" PipeClient { RawX1: 7575180942520981889 RawX2: 4503629692144011 } Path: "/Root/PQ/rt3.dc1--topic1" }
2025-11-21T14:10:54.224134Z node 7 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 1 consumer shared/user session shared/user_7_1_3034911298628433174_v1 INITING TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1)
2025-11-21T14:10:54.224364Z node 7 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_7_1_3034911298628433174_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 1, pipe: [7:7575180942520981891:2447]
2025-11-21T14:10:54.224383Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [7:7575180942520981891:2447], now have 1 active actors on pipe
2025-11-21T14:10:54.224456Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-21T14:10:54.224465Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-21T14:10:54.224479Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:1748: [PQ: 72075186224037892] Created session shared/user_7_1_3034911298628433174_v1 on pipe: [7:7575180942520981891:2447]
2025-11-21T14:10:54.224500Z node 7 :PERSQUEUE DEBUG: partition.cpp:2313: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-21T14:10:54.224504Z node 7 :PERSQUEUE DEBUG: partition.cpp:2393: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TEvPQ::TEvSetClientInfo)
2025-11-21T14:10:54.224513Z node 7 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-21T14:10:54.224516Z node 7 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-21T14:10:54.224523Z node 7 :PERSQUEUE DEBUG: partition.cpp:2457: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TEvPQ::TEvSetClientInfo)
2025-11-21T14:10:54.224544Z node 7 :PERSQUEUE DEBUG: partition.cpp:3799: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 user user session is set to 0 (startOffset 0) session shared/user_7_1_3034911298628433174_v1
2025-11-21T14:10:54.224548Z node 7 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-21T14:10:54.224550Z node 7 :PERSQUEUE DEBUG: partition.cpp:2326: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-21T14:10:54.224553Z node 7 :PERSQUEUE DEBUG: partition.cpp:2331: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-21T14:10:54.224592Z node 7 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-21T14:10:54.224786Z node 7 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_7_1_3034911298628433174_v1:1 with generation 1
2025-11-21T14:10:54.226316Z node 7 :PERSQUEUE DEBUG: partition.cpp:2137: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-21T14:10:54.226364Z node 7 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-11-21T14:10:54.226374Z node 7 :PERSQUEUE DEBUG: partition.cpp:2313: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-21T14:10:54.226377Z node 7 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-21T14:10:54.226379Z node 7 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-21T14:10:54.226381Z node 7 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-21T14:10:54.226383Z node 7 :PERSQUEUE DEBUG: partition.cpp:2331: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-21T14:10:54.226390Z node 7 :PERSQUEUE DEBUG: partition_compaction.cpp:183: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-21T14:10:54.226401Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-11-21T14:10:54.226447Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_7_1_3034911298628433174_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 0 SizeLag: 0 WriteTimestampEstimateMS: 1763734254200 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-11-21T14:10:54.226456Z node 7 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 1 consumer shared/user session shared/user_7_1_3034911298628433174_v1 INIT DONE TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 0 readOffset 0 committedOffset 0
2025-11-21T14:10:54.226470Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1446: session cookie 1 consumer shared/user session shared/user_7_1_3034911298628433174_v1 sending to client partition status
>>>> message: CreatePartitionStream { PartitionStreamId: 1 TopicPath: topic1 Cluster: dc1 PartitionId: 0 CommittedOffset: 0 EndOffset: 0 }
2025-11-21T14:10:54.226965Z :INFO: [] [] [13e92436-20538e01-57bcc6dd-bc92c1ad] [null] Confirm partition stream create. Partition stream id: 1. Cluster: "dc1". Topic: "topic1". Partition: 0. Read offset: (NULL)
2025-11-21T14:10:54.227124Z :DEBUG: [] MessageGroupId [source0] SessionId [] Write session: try to update token
2025-11-21T14:10:54.227347Z :INFO: [] MessageGroupId [source0] SessionId [] Write session: Do CDS request
2025-11-21T14:10:54.227353Z :INFO: [] MessageGroupId [source0] SessionId [] Start write session. Will connect to endpoint: localhost:32602
2025-11-21T14:10:54.228034Z :DEBUG: [] MessageGroupId [source0] SessionId [] Write session: send init request: init_request { topic: "topic1" message_group_id: "source0" }
2025-11-21T14:10:54.228434Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_7_1_3034911298628433174_v1 grpc read done: success# 1, data# { start_read { topic { path: "topic1" } cluster: "dc1" assign_id: 1 } }
2025-11-21T14:10:54.228478Z node 7 :PQ_READ_PROXY INFO: read_session_actor.cpp:551: session cookie 1 consumer shared/user session shared/user_7_1_3034911298628433174_v1 got StartRead from client: partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 0, commitOffset# 0
2025-11-21T14:10:54.228508Z node 7 :PQ_READ_PROXY INFO: partition_actor.cpp:1023: session cookie 1 consumer shared/user session shared/user_7_1_3034911298628433174_v1 Start reading TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 0 readOffset 0 committedOffset 0 clientCommitOffset 0 clientReadOffset 0
2025-11-21T14:10:54.228514Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_7_1_3034911298628433174_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 1 from offset 0
2025-11-21T14:10:54.228531Z node 7 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-11-21T14:10:54.228536Z node 7 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1
2025-11-21T14:10:54.228746Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId:  grpc read done: success: 1 data: init_request { topic: "topic1" message_group_id: "source0" }
2025-11-21T14:10:54.228785Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1 topic: "topic1" message_group_id: "source0" from ipv6:[::1]:51498
2025-11-21T14:10:54.228790Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51498 proto=v1  topic=topic1 durationSec=0
2025-11-21T14:10:54.228793Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-11-21T14:10:54.229347Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1 sessionId:  describe result for acl check
2025-11-21T14:10:54.229378Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-11-21T14:10:54.229391Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-11-21T14:10:54.229393Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-11-21T14:10:54.229399Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [7:7575180942520981899:2448] (SourceId=source0, PreferedPartition=(NULL)) StartKqpSession
2025-11-21T14:10:54.230092Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [7:7575180942520981899:2448] (SourceId=source0, PreferedPartition=(NULL)) Select from the table
2025-11-21T14:10:54.259352Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [7:7575180942520981899:2448] (SourceId=source0, PreferedPartition=(NULL)) RequestPQRB
2025-11-21T14:10:54.266410Z node 8 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1656: [72075186224037893][rt3.dc1--topic1] pipe [7:7575180942520981931:2448] connected; active server actors: 1
2025-11-21T14:10:54.270501Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [7:7575180942520981899:2448] (SourceId=source0, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=source0
2025-11-21T14:10:54.270520Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [7:7575180942520981899:2448] (SourceId=source0, PreferedPartition=(NULL)) Update the table
2025-11-21T14:10:54.272092Z node 8 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1660: [72075186224037893][rt3.dc1--topic1] pipe [7:7575180942520981931:2448] disconnected.
2025-11-21T14:10:54.272107Z node 8 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1671: [72075186224037893][rt3.dc1--topic1] pipe [7:7575180942520981931:2448] disconnected; active server actors: 1
2025-11-21T14:10:54.272111Z node 8 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1696: [72075186224037893][rt3.dc1--topic1] pipe [7:7575180942520981931:2448] disconnected no session
2025-11-21T14:10:54.303652Z node 7 :PERSQUEUE DEBUG: partition.cpp:2313: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-21T14:10:54.303671Z node 7 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-21T14:10:54.303673Z node 7 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-21T14:10:54.303677Z node 7 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-21T14:10:54.303680Z node 7 :PERSQUEUE DEBUG: partition.cpp:2331: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-21T14:10:54.307715Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [7:7575180942520981899:2448] (SourceId=source0, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-11-21T14:10:54.307730Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [7:7575180942520981899:2448] (SourceId=source0, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-11-21T14:10:54.307734Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [7:7575180942520981899:2448] (SourceId=source0, PreferedPartition=(NULL)) Start idle
2025-11-21T14:10:54.307744Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-11-21T14:10:54.308516Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 7, Generation: 1
2025-11-21T14:10:54.308534Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [7:7575180942520981952:2448], now have 1 active actors on pipe
2025-11-21T14:10:54.308602Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-21T14:10:54.308611Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-21T14:10:54.308641Z node 7 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie source0|b0c147d1-bd22d488-1c1c3475-ba083cff_0 generated for partition 0 topic 'rt3.dc1--topic1' owner source0
2025-11-21T14:10:54.308651Z node 7 :PERSQUEUE DEBUG: partition.cpp:2313: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-21T14:10:54.308654Z node 7 :PERSQUEUE DEBUG: partition.cpp:2407: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-21T14:10:54.308660Z node 7 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-21T14:10:54.308662Z node 7 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-21T14:10:54.308667Z node 7 :PERSQUEUE DEBUG: partition.cpp:2471: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-21T14:10:54.308676Z node 7 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-21T14:10:54.308679Z node 7 :PERSQUEUE DEBUG: partition.cpp:2326: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-21T14:10:54.308682Z node 7 :PERSQUEUE DEBUG: partition.cpp:2331: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-21T14:10:54.308697Z node 7 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-21T14:10:54.308714Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-21T14:10:54.309273Z :INFO: [] MessageGroupId [source0] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1763734254309 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-11-21T14:10:54.309308Z :INFO: [] MessageGroupId [source0] SessionId [] Write session established. Init response: session_id: "source0|b0c147d1-bd22d488-1c1c3475-ba083cff_0" topic: "topic1" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-11-21T14:10:54.309583Z :DEBUG: [] MessageGroupId [source0] SessionId [source0|b0c147d1-bd22d488-1c1c3475-ba083cff_0] Write 1 messages with Id from 1 to 1
2025-11-21T14:10:54.309616Z :INFO: [] MessageGroupId [source0] SessionId [source0|b0c147d1-bd22d488-1c1c3475-ba083cff_0] Write session: close. Timeout = 10000 ms
2025-11-21T14:10:54.308839Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-21T14:10:54.308843Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-21T14:10:54.308855Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-21T14:10:54.308883Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1 partition: 0 MaxSeqNo: 0 sessionId: source0|b0c147d1-bd22d488-1c1c3475-ba083cff_0
2025-11-21T14:10:54.316245Z :DEBUG: [] MessageGroupId [source0] SessionId [source0|b0c147d1-bd22d488-1c1c3475-ba083cff_0] Write session: try to update token
2025-11-21T14:10:54.316259Z :DEBUG: [] MessageGroupId [source0] SessionId [source0|b0c147d1-bd22d488-1c1c3475-ba083cff_0] Send 1 message(s) (0 left), first sequence number is 1
2025-11-21T14:10:54.318053Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId: source0|b0c147d1-bd22d488-1c1c3475-ba083cff_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-21T14:10:54.318168Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-21T14:10:54.318343Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-21T14:10:54.318371Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-21T14:10:54.318413Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-11-21T14:10:54.318433Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-11-21T14:10:54.318553Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-21T14:10:54.318558Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-21T14:10:54.318701Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: '\0source0' SeqNo: 1 partNo : 0 messageNo: 1 size 1122 offset: -1
2025-11-21T14:10:54.318710Z node 7 :PERSQUEUE DEBUG: partition_write.cpp:634: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-21T14:10:54.318726Z node 7 :PERSQUEUE DEBUG: partition.cpp:2313: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-21T14:10:54.318730Z node 7 :PERSQUEUE DEBUG: partition.cpp:2407: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-21T14:10:54.318744Z node 7 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-21T14:10:54.318747Z node 7 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-21T14:10:54.318752Z node 7 :PERSQUEUE DEBUG: partition.cpp:2471: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-21T14:10:54.318781Z node 7 :PERSQUEUE DEBUG: partition_write.cpp:1326: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId '\0source0' seqNo 1 partNo 0
2025-11-21T14:10:54.318845Z node 7 :PERSQUEUE DEBUG: partition_write.cpp:1430: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '\0source0' seqNo 1 partNo 0 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 1197 count 1 nextOffset 1 batches 1
2025-11-21T14:10:54.318852Z node 7 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-21T14:10:54.318856Z node 7 :PERSQUEUE DEBUG: partition.cpp:2326: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-21T14:10:54.318859Z node 7 :PERSQUEUE DEBUG: partition.cpp:2331: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-21T14:10:54.318914Z node 7 :PERSQUEUE DEBUG: partition_write.cpp:1682: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 0,1 HeadOffset 0 endOffset 0 curOffset 1 d0000000000_00000000000000000000_00000_0000000001_00000? size 1185 WTime 1763734254318
2025-11-21T14:10:54.318939Z node 7 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-21T14:10:54.318950Z node 7 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 0 partNo 0 count 1 size 1185
2025-11-21T14:10:54.321096Z :DEBUG: [] MessageGroupId [source0] SessionId [source0|b0c147d1-bd22d488-1c1c3475-ba083cff_0] Write session got write response: sequence_numbers: 1 offsets: 0 already_written: false write_statistics { persist_duration_ms: 1 }
2025-11-21T14:10:54.321111Z :DEBUG: [] MessageGroupId [source0] SessionId [source0|b0c147d1-bd22d488-1c1c3475-ba083cff_0] Write session: acknoledged message 1
2025-11-21T14:10:54.320363Z node 7 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 0 count 1 size 1185 actorID [7:7575180942520981761:2427]
2025-11-21T14:10:54.320389Z node 7 :PERSQUEUE DEBUG: partition.cpp:2137: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-21T14:10:54.320410Z node 7 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1130 WriteNewSizeFromSupportivePartitions# 0
2025-11-21T14:10:54.320419Z node 7 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-21T14:10:54.320429Z node 7 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0source0', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 1, partNo: 0, Offset: 0 is stored on disk
2025-11-21T14:10:54.320478Z node 7 :PERSQUEUE DEBUG: partition_read.cpp:930: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-11-21T14:10:54.320483Z node 7 :PERSQUEUE DEBUG: partition_read.cpp:972: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-11-21T14:10:54.320487Z node 7 :PERSQUEUE DEBUG: partition.cpp:2313: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-21T14:10:54.320491Z node 7 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-21T14:10:54.320493Z node 7 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-21T14:10:54.320496Z node 7 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-21T14:10:54.320498Z node 7 :PERSQUEUE DEBUG: partition.cpp:2331: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-21T14:10:54.320504Z node 7 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-21T14:10:54.320513Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 1  requestId: <none> cookie: 1
2025-11-21T14:10:54.320543Z node 7 :PERSQUEUE DEBUG: partition_read.cpp:887: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--topic1' partition 0 user user offset 0 partno 0 count 1 size 1024000 endOffset 1 max time lag 0ms effective offset 0
2025-11-21T14:10:54.320558Z node 7 :PERSQUEUE DEBUG: partition_read.cpp:1112: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 1185 count 1 last offset 0, current partition end offset: 1
2025-11-21T14:10:54.320561Z node 7 :PERSQUEUE DEBUG: partition_read.cpp:1128: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-11-21T14:10:54.320570Z node 7 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 0 partno 0 count 1 parts_count 0 source 1 size 1185 accessed 0 times before, last time 2025-11-21T14:10:54.000000Z
2025-11-21T14:10:54.320574Z node 7 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 3. All 1 blobs are from cache.
2025-11-21T14:10:54.320584Z node 7 :PERSQUEUE DEBUG: partition_read.cpp:576: FormAnswer for 1 blobs
2025-11-21T14:10:54.320597Z node 7 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 0 totakecount 1 count 1 size 1165 from pos 0 cbcount 1
2025-11-21T14:10:54.320611Z node 7 :PERSQUEUE DEBUG: partition_read.cpp:1022: Topic 'rt3.dc1--topic1' partition 0 user user readTimeStamp done, result 1763734254318 queuesize 0 startOffset 0
2025-11-21T14:10:54.320635Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 1 consumer shared/user session shared/user_7_1_3034911298628433174_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 0 EndOffset 0 newEndOffset 1 commitOffset 0 clientCommitOffset 0 cookie 1 readingFinished 0 firstRead 1
2025-11-21T14:10:54.320639Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_7_1_3034911298628433174_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 0 endOffset 1
2025-11-21T14:10:54.320652Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-11-21T14:10:54.320820Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_7_1_3034911298628433174_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 0, endOffset# 1, WTime# 0, sizeLag# 1185
2025-11-21T14:10:54.320821Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2354: session cookie 1 consumer shared/user session shared/user_7_1_3034911298628433174_v1TEvPartitionReady. Aval parts: 1
2025-11-21T14:10:54.320839Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2277: session cookie 1 consumer shared/user session shared/user_7_1_3034911298628433174_v1 performing read request: guid# ea9348cb-62ba3ccd-48b8bdce-81b6b745, from# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), count# 1, size# 1422, partitionsAsked# 1, maxTimeLag# 0ms
2025-11-21T14:10:54.320873Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_7_1_3034911298628433174_v1 READ FROM TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1)maxCount 1 maxSize 1422 maxTimeLagMs 0 readTimestampMs 0 readOffset 0 EndOffset 1 ClientCommitOffset 0 committedOffset 0 Guid ea9348cb-62ba3ccd-48b8bdce-81b6b745
2025-11-21T14:10:54.322126Z :DEBUG: [] [] [13e92436-20538e01-57bcc6dd-bc92c1ad] [null] After sending read request: ReadSizeBudget = 2621440, ReadSizeServerDelta = 0
2025-11-21T14:10:54.321373Z node 7 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 0 suffix '63' size 1185
2025-11-21T14:10:54.321385Z node 7 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 0 suffix '63'
2025-11-21T14:10:54.321587Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-21T14:10:54.321593Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-21T14:10:54.321620Z node 7 :PERSQUEUE DEBUG: partition_read.cpp:887: [72075186224037892][Partition][0][StateIdle] read cookie 4 Topic 'rt3.dc1--topic1' partition 0 user user offset 0 partno 0 count 1 size 1422 endOffset 1 max time lag 0ms effective offset 0
2025-11-21T14:10:54.321638Z node 7 :PERSQUEUE DEBUG: partition_read.cpp:1112: [72075186224037892][Partition][0][StateIdle] read cookie 4 added 1 blobs, size 1185 count 1 last offset 0, current partition end offset: 1
2025-11-21T14:10:54.321641Z node 7 :PERSQUEUE DEBUG: partition_read.cpp:1128: [72075186224037892][Partition][0][StateIdle] Reading cookie 4. Send blob request.
2025-11-21T14:10:54.321647Z node 7 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 0 partno 0 count 1 parts_count 0 source 1 size 1185 accessed 1 times before, last time 2025-11-21T14:10:54.000000Z
2025-11-21T14:10:54.321654Z node 7 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 4. All 1 blobs are from cache.
2025-11-21T14:10:54.321662Z node 7 :PERSQUEUE DEBUG: partition_read.cpp:576: FormAnswer for 1 blobs
2025-11-21T14:10:54.321675Z node 7 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 0 totakecount 1 count 1 size 1165 from pos 0 cbcount 1
2025-11-21T14:10:54.321695Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-21T14:10:54.321756Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_7_1_3034911298628433174_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 1 Result { Offset: 0 Data: "... 1122 bytes ..." SourceId: "\000source0" SeqNo: 1 WriteTimestampMS: 1763734254318 CreateTimestampMS: 1763734254309 UncompressedSize: 1047552 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 20 RealReadOffset: 0 WaitQuotaTimeMs: 0 EndOffset: 1 StartOffset: 0 } Cookie: 0 }
2025-11-21T14:10:54.321783Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_7_1_3034911298628433174_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 2 from offset 1
2025-11-21T14:10:54.321791Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_7_1_3034911298628433174_v1 after read state TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 1 ReadOffset 1 ReadGuid ea9348cb-62ba3ccd-48b8bdce-81b6b745 has messages 1
2025-11-21T14:10:54.321805Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1951: session cookie 1 consumer shared/user session shared/user_7_1_3034911298628433174_v1 read done: guid# ea9348cb-62ba3ccd-48b8bdce-81b6b745, partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), size# 1222
2025-11-21T14:10:54.321812Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2113: session cookie 1 consumer shared/user session shared/user_7_1_3034911298628433174_v1 response to read: guid# ea9348cb-62ba3ccd-48b8bdce-81b6b745
2025-11-21T14:10:54.321888Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2156: session cookie 1 consumer shared/user session shared/user_7_1_3034911298628433174_v1 Process answer. Aval parts: 0
2025-11-21T14:10:54.322280Z node 7 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 0 suffix '63'
2025-11-21T14:10:54.322338Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_7_1_3034911298628433174_v1 grpc read done: success# 1, data# { read { } }
2025-11-21T14:10:54.322381Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1850: session cookie 1 consumer shared/user session shared/user_7_1_3034911298628433174_v1 got read request: guid# 1d6ae369-85a158e1-cdbac30f-3546db9f
2025-11-21T14:10:54.402904Z node 7 :PERSQUEUE DEBUG: partition.cpp:2313: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-21T14:10:54.402924Z node 7 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-21T14:10:54.402927Z node 7 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-21T14:10:54.402930Z node 7 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-21T14:10:54.402932Z node 7 :PERSQUEUE DEBUG: partition.cpp:2331: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-21T14:10:54.411113Z :INFO: [] MessageGroupId [source0] SessionId [source0|b0c147d1-bd22d488-1c1c3475-ba083cff_0] Write session will now close
2025-11-21T14:10:54.411140Z :DEBUG: [] MessageGroupId [source0] SessionId [source0|b0c147d1-bd22d488-1c1c3475-ba083cff_0] Write session: aborting
2025-11-21T14:10:54.411349Z :INFO: [] MessageGroupId [source0] SessionId [source0|b0c147d1-bd22d488-1c1c3475-ba083cff_0] Write session: gracefully shut down, all writes complete
2025-11-21T14:10:54.411371Z :DEBUG: [] MessageGroupId [source0] SessionId [source0|b0c147d1-bd22d488-1c1c3475-ba083cff_0] Write session: destroy
2025-11-21T14:10:54.411608Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId: source0|b0c147d1-bd22d488-1c1c3475-ba083cff_0 grpc read done: success: 0 data: 
2025-11-21T14:10:54.411623Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 1 sessionId: source0|b0c147d1-bd22d488-1c1c3475-ba083cff_0 grpc read failed
2025-11-21T14:10:54.411632Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 1 sessionId: source0|b0c147d1-bd22d488-1c1c3475-ba083cff_0 grpc closed
2025-11-21T14:10:54.411642Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1 sessionId: source0|b0c147d1-bd22d488-1c1c3475-ba083cff_0 is DEAD
2025-11-21T14:10:54.411884Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-11-21T14:10:54.412684Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [7:7575180942520981952:2448] destroyed
2025-11-21T14:10:54.412706Z node 7 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-11-21T14:10:54.412715Z node 7 :PERSQUEUE DEBUG: partition.cpp:2313: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-21T14:10:54.412719Z node 7 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-21T14:10:54.412721Z node 7 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-21T14:10:54.412725Z node 7 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-21T14:10:54.412727Z node 7 :PERSQUEUE DEBUG: partition.cpp:2331: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-21T14:10:54.414568Z :DEBUG: [] MessageGroupId [source1] SessionId [] Write session: try to update token
2025-11-21T14:10:54.414801Z :INFO: [] MessageGroupId [source1] SessionId [] Write session: Do CDS request
2025-11-21T14:10:54.414810Z :INFO: [] MessageGroupId [source1] SessionId [] Start write session. Will connect to endpoint: localhost:32602
2025-11-21T14:10:54.415447Z :DEBUG: [] MessageGroupId [source1] SessionId [] Write session: send init request: init_request { topic: "topic1" message_group_id: "source1" }
2025-11-21T14:10:54.416159Z node 7 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-11-21T14:10:54.416176Z node 7 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2
2025-11-21T14:10:54.416380Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId:  grpc read done: success: 1 data: init_request { topic: "topic1" message_group_id: "source1" }
2025-11-21T14:10:54.416410Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2 topic: "topic1" message_group_id: "source1" from ipv6:[::1]:51498
2025-11-21T14:10:54.416416Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51498 proto=v1  topic=topic1 durationSec=0
2025-11-21T14:10:54.416420Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-11-21T14:10:54.416956Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2 sessionId:  describe result for acl check
2025-11-21T14:10:54.417001Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-11-21T14:10:54.417003Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-11-21T14:10:54.417005Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-11-21T14:10:54.417012Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [7:7575180942520981965:2458] (SourceId=source1, PreferedPartition=(NULL)) StartKqpSession
2025-11-21T14:10:54.417778Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [7:7575180942520981965:2458] (SourceId=source1, PreferedPartition=(NULL)) Select from the table
2025-11-21T14:10:54.420023Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [7:7575180942520981965:2458] (SourceId=source1, PreferedPartition=(NULL)) RequestPQRB
2025-11-21T14:10:54.422407Z node 8 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1656: [72075186224037893][rt3.dc1--topic1] pipe [7:7575180942520981984:2458] connected; active server actors: 1
2025-11-21T14:10:54.422572Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [7:7575180942520981965:2458] (SourceId=source1, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=source1
2025-11-21T14:10:54.422588Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [7:7575180942520981965:2458] (SourceId=source1, PreferedPartition=(NULL)) Update the table
2025-11-21T14:10:54.423088Z node 8 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1660: [72075186224037893][rt3.dc1--topic1] pipe [7:7575180942520981984:2458] disconnected.
2025-11-21T14:10:54.423099Z node 8 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1671: [72075186224037893][rt3.dc1--topic1] pipe [7:7575180942520981984:2458] disconnected; active server actors: 1
2025-11-21T14:10:54.423102Z node 8 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1696: [72075186224037893][rt3.dc1--topic1] pipe [7:7575180942520981984:2458] disconnected no session
2025-11-21T14:10:54.427397Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [7:7575180942520981965:2458] (SourceId=source1, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-11-21T14:10:54.427413Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [7:7575180942520981965:2458] (SourceId=source1, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-11-21T14:10:54.427418Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [7:7575180942520981965:2458] (SourceId=source1, PreferedPartition=(NULL)) Start idle
2025-11-21T14:10:54.427428Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-11-21T14:10:54.427735Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 7, Generation: 1
2025-11-21T14:10:54.427754Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [7:7575180942520982001:2458], now have 1 active actors on pipe
2025-11-21T14:10:54.427852Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-21T14:10:54.427862Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-21T14:10:54.427898Z node 7 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie source1|ef07ecc1-fe5c93f4-58f49a20-a279a595_0 generated for partition 0 topic 'rt3.dc1--topic1' owner source1
2025-11-21T14:10:54.427909Z node 7 :PERSQUEUE DEBUG: partition.cpp:2313: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-21T14:10:54.427912Z node 7 :PERSQUEUE DEBUG: partition.cpp:2407: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-21T14:10:54.427917Z node 7 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-21T14:10:54.427918Z node 7 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-21T14:10:54.427921Z node 7 :PERSQUEUE DEBUG: partition.cpp:2471: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-21T14:10:54.427931Z node 7 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-21T14:10:54.427933Z node 7 :PERSQUEUE DEBUG: partition.cpp:2326: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-21T14:10:54.427935Z node 7 :PERSQUEUE DEBUG: partition.cpp:2331: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-21T14:10:54.427949Z node 7 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-21T14:10:54.427961Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-21T14:10:54.428067Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-21T14:10:54.428070Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-21T14:10:54.428080Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-21T14:10:54.428105Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2 partition: 0 MaxSeqNo: 0 sessionId: source1|ef07ecc1-fe5c93f4-58f49a20-a279a595_0
2025-11-21T14:10:54.428562Z :INFO: [] MessageGroupId [source1] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1763734254428 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-11-21T14:10:54.428609Z :INFO: [] MessageGroupId [source1] SessionId [] Write session established. Init response: session_id: "source1|ef07ecc1-fe5c93f4-58f49a20-a279a595_0" topic: "topic1" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-11-21T14:10:54.428962Z :DEBUG: [] MessageGroupId [source1] SessionId [source1|ef07ecc1-fe5c93f4-58f49a20-a279a595_0] Write 1 messages with Id from 1 to 1
2025-11-21T14:10:54.429003Z :INFO: [] MessageGroupId [source1] SessionId [source1|ef07ecc1-fe5c93f4-58f49a20-a279a595_0] Write session: close. Timeout = 10000 ms
2025-11-21T14:10:54.434320Z :DEBUG: [] MessageGroupId [source1] SessionId [source1|ef07ecc1-fe5c93f4-58f49a20-a279a595_0] Write session: try to update token
2025-11-21T14:10:54.434340Z :DEBUG: [] MessageGroupId [source1] SessionId [source1|ef07ecc1-fe5c93f4-58f49a20-a279a595_0] Send 1 message(s) (0 left), first sequence number is 1
2025-11-21T14:10:54.434643Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: source1|ef07ecc1-fe5c93f4-58f49a20-a279a595_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-21T14:10:54.434747Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-21T14:10:54.434861Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-21T14:10:54.434875Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-21T14:10:54.434913Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-11-21T14:10:54.434936Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-11-21T14:10:54.434962Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-21T14:10:54.434968Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-21T14:10:54.434989Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: '\0source1' SeqNo: 1 partNo : 0 messageNo: 1 size 1122 offset: -1
2025-11-21T14:10:54.434997Z node 7 :PERSQUEUE DEBUG: partition_write.cpp:634: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-21T14:10:54.435020Z node 7 :PERSQUEUE DEBUG: partition.cpp:2313: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-21T14:10:54.435024Z node 7 :PERSQUEUE DEBUG: partition.cpp:2407: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-21T14:10:54.435053Z node 7 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-21T14:10:54.435055Z node 7 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-21T14:10:54.435062Z node 7 :PERSQUEUE DEBUG: partition.cpp:2471: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-21T14:10:54.435095Z node 7 :PERSQUEUE DEBUG: partition_write.cpp:1326: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId '\0source1' seqNo 1 partNo 0
2025-11-21T14:10:54.435143Z node 7 :PERSQUEUE DEBUG: partition_write.cpp:1430: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '\0source1' seqNo 1 partNo 0 FormedBlobsCount 0 NewHead: Offset 1 PartNo 0 PackedSize 1197 count 1 nextOffset 2 batches 1
2025-11-21T14:10:54.435150Z node 7 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-21T14:10:54.435152Z node 7 :PERSQUEUE DEBUG: partition.cpp:2326: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-21T14:10:54.435155Z node 7 :PERSQUEUE DEBUG: partition.cpp:2331: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-21T14:10:54.435209Z node 7 :PERSQUEUE DEBUG: partition_write.cpp:1682: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 1,1 HeadOffset 1 endOffset 1 curOffset 2 d0000000000_00000000000000000001_00000_0000000001_00000? size 1185 WTime 1763734254435
2025-11-21T14:10:54.435237Z node 7 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-21T14:10:54.435248Z node 7 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 1 partNo 0 count 1 size 1185
2025-11-21T14:10:54.436750Z node 7 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 1 count 1 size 1185 actorID [7:7575180942520981761:2427]
2025-11-21T14:10:54.436773Z node 7 :PERSQUEUE DEBUG: partition.cpp:2137: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-21T14:10:54.436798Z node 7 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1130 WriteNewSizeFromSupportivePartitions# 0
2025-11-21T14:10:54.436809Z node 7 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-21T14:10:54.436818Z node 7 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 1, partNo: 0, Offset: 1 is stored on disk
2025-11-21T14:10:54.436863Z node 7 :PERSQUEUE DEBUG: partition.cpp:2313: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-21T14:10:54.436870Z node 7 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-21T14:10:54.436872Z node 7 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-21T14:10:54.436886Z node 7 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-21T14:10:54.436888Z node 7 :PERSQUEUE DEBUG: partition.cpp:2331: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-21T14:10:54.436898Z node 7 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-21T14:10:54.436910Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 1  requestId: <none> cookie: 1
2025-11-21T14:10:54.436937Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-11-21T14:10:54.436946Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 1 consumer shared/user session shared/user_7_1_3034911298628433174_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 1 EndOffset 1 newEndOffset 2 commitOffset 0 clientCommitOffset 0 cookie 2 readingFinished 0 firstRead 0
2025-11-21T14:10:54.436950Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_7_1_3034911298628433174_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 1 endOffset 2
2025-11-21T14:10:54.436966Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_7_1_3034911298628433174_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 1, endOffset# 2, WTime# 1763734254318, sizeLag# 1185
2025-11-21T14:10:54.436968Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2354: session cookie 1 consumer shared/user session shared/user_7_1_3034911298628433174_v1TEvPartitionReady. Aval parts: 1
2025-11-21T14:10:54.436983Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2277: session cookie 1 consumer shared/user session shared/user_7_1_3034911298628433174_v1 performing read request: guid# 1d6ae369-85a158e1-cdbac30f-3546db9f, from# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), count# 1, size# 1422, partitionsAsked# 1, maxTimeLag# 0ms
2025-11-21T14:10:54.437000Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_7_1_3034911298628433174_v1 READ FROM TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1)maxCount 1 maxSize 1422 maxTimeLagMs 0 readTimestampMs 0 readOffset 1 EndOffset 2 ClientCommitOffset 0 committedOffset 0 Guid 1d6ae369-85a158e1-cdbac30f-3546db9f
2025-11-21T14:10:54.437098Z node 7 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 1 partno 0 count 1 parts 0 suffix '63' size 1185
2025-11-21T14:10:54.437165Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-21T14:10:54.437172Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-21T14:10:54.437212Z node 7 :PERSQUEUE DEBUG: partition_read.cpp:887: [72075186224037892][Partition][0][StateIdle] read cookie 5 Topic 'rt3.dc1--topic1' partition 0 user user offset 1 partno 0 count 1 size 1422 endOffset 2 max time lag 0ms effective offset 1
2025-11-21T14:10:54.437498Z :DEBUG: [] MessageGroupId [source1] SessionId [source1|ef07ecc1-fe5c93f4-58f49a20-a279a595_0] Write session got write response: sequence_numbers: 1 offsets: 1 already_written: false write_statistics { persist_duration_ms: 1 }
2025-11-21T14:10:54.437516Z :DEBUG: [] MessageGroupId [source1] SessionId [source1|ef07ecc1-fe5c93f4-58f49a20-a279a595_0] Write session: acknoledged message 1
2025-11-21T14:10:54.437232Z node 7 :PERSQUEUE DEBUG: partition_read.cpp:1112: [72075186224037892][Partition][0][StateIdle] read cookie 5 added 1 blobs, size 1185 count 1 last offset 1, current partition end offset: 2
2025-11-21T14:10:54.437242Z node 7 :PERSQUEUE DEBUG: partition_read.cpp:1128: [72075186224037892][Partition][0][StateIdle] Reading cookie 5. Send blob request.
2025-11-21T14:10:54.437255Z node 7 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 1 partno 0 count 1 parts_count 0 source 1 size 1185 accessed 0 times before, last time 2025-11-21T14:10:54.000000Z
2025-11-21T14:10:54.437264Z node 7 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 5. All 1 blobs are from cache.
2025-11-21T14:10:54.437276Z node 7 :PERSQUEUE DEBUG: partition_read.cpp:576: FormAnswer for 1 blobs
2025-11-21T14:10:54.437294Z node 7 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 1 totakecount 1 count 1 size 1165 from pos 0 cbcount 1
2025-11-21T14:10:54.437318Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-11-21T14:10:54.437425Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_7_1_3034911298628433174_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 2 Result { Offset: 1 Data: "... 1122 bytes ..." SourceId: "\000source1" SeqNo: 1 WriteTimestampMS: 1763734254435 CreateTimestampMS: 1763734254428 UncompressedSize: 1047552 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 20 RealReadOffset: 1 WaitQuotaTimeMs: 0 EndOffset: 2 StartOffset: 0 } Cookie: 1 }
2025-11-21T14:10:54.437452Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_7_1_3034911298628433174_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 3 from offset 2
2025-11-21T14:10:54.437462Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_7_1_3034911298628433174_v1 after read state TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 2 ReadOffset 2 ReadGuid 1d6ae369-85a158e1-cdbac30f-3546db9f has messages 1
2025-11-21T14:10:54.437488Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1951: session cookie 1 consumer shared/user session shared/user_7_1_3034911298628433174_v1 read done: guid# 1d6ae369-85a158e1-cdbac30f-3546db9f, partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), size# 1224
2025-11-21T14:10:54.437497Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2113: session cookie 1 consumer shared/user session shared/user_7_1_3034911298628433174_v1 response to read: guid# 1d6ae369-85a158e1-cdbac30f-3546db9f
2025-11-21T14:10:54.437577Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2156: session cookie 1 consumer shared/user session shared/user_7_1_3034911298628433174_v1 Process answer. Aval parts: 0
2025-11-21T14:10:54.437600Z node 7 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 1 partno 0 count 1 parts 0 suffix '63'
2025-11-21T14:10:54.437833Z :DEBUG: [] [] [13e92436-20538e01-57bcc6dd-bc92c1ad] [null] After sending read request: ReadSizeBudget = 2621440, ReadSizeServerDelta = 0
2025-11-21T14:10:54.438030Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_7_1_3034911298628433174_v1 grpc read done: success# 1, data# { read { } }
2025-11-21T14:10:54.438110Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1850: session cookie 1 consumer shared/user session shared/user_7_1_3034911298628433174_v1 got read request: guid# 9aa869f8-998df627-f906c9e9-a84bbd45
2025-11-21T14:10:54.503252Z node 7 :PERSQUEUE DEBUG: partition.cpp:2313: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-21T14:10:54.503265Z node 7 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-21T14:10:54.503268Z node 7 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-21T14:10:54.503271Z node 7 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-21T14:10:54.503273Z node 7 :PERSQUEUE DEBUG: partition.cpp:2331: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-21T14:10:54.529728Z :INFO: [] MessageGroupId [source1] SessionId [source1|ef07ecc1-fe5c93f4-58f49a20-a279a595_0] Write session will now close
2025-11-21T14:10:54.529751Z :DEBUG: [] MessageGroupId [source1] SessionId [source1|ef07ecc1-fe5c93f4-58f49a20-a279a595_0] Write session: aborting
2025-11-21T14:10:54.530024Z :INFO: [] MessageGroupId [source1] SessionId [source1|ef07ecc1-fe5c93f4-58f49a20-a279a595_0] Write session: gracefully shut down, all writes complete
2025-11-21T14:10:54.530044Z :DEBUG: [] MessageGroupId [source1] SessionId [source1|ef07ecc1-fe5c93f4-58f49a20-a279a595_0] Write session: destroy
2025-11-21T14:10:54.530287Z :DEBUG: [] MessageGroupId [source2] SessionId [] Write session: try to update token
2025-11-21T14:10:54.530487Z :INFO: [] MessageGroupId [source2] SessionId [] Write session: Do CDS request
2025-11-21T14:10:54.530494Z :INFO: [] MessageGroupId [source2] SessionId [] Start write session. Will connect to endpoint: localhost:32602
2025-11-21T14:10:54.530483Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: source1|ef07ecc1-fe5c93f4-58f49a20-a279a595_0 grpc read done: success: 0 data: 
2025-11-21T14:10:54.530500Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 2 sessionId: source1|ef07ecc1-fe5c93f4-58f49a20-a279a595_0 grpc read failed
2025-11-21T14:10:54.530511Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 2 sessionId: source1|ef07ecc1-fe5c93f4-58f49a20-a279a595_0 grpc closed
2025-11-21T14:10:54.530520Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2 sessionId: source1|ef07ecc1-fe5c93f4-58f49a20-a279a595_0 is DEAD
2025-11-21T14:10:54.530854Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-11-21T14:10:54.531198Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [7:7575180942520982001:2458] destroyed
2025-11-21T14:10:54.531231Z node 7 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-11-21T14:10:54.531245Z node 7 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-11-21T14:10:54.531252Z node 7 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3
2025-11-21T14:10:54.531255Z node 7 :PERSQUEUE DEBUG: partition.cpp:2313: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-21T14:10:54.531259Z node 7 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-21T14:10:54.531267Z node 7 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-21T14:10:54.531272Z node 7 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-21T14:10:54.531274Z node 7 :PERSQUEUE DEBUG: partition.cpp:2331: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-21T14:10:54.531417Z :DEBUG: [] MessageGroupId [source2] SessionId [] Write session: send init request: init_request { topic: "topic1" message_group_id: "source2" }
2025-11-21T14:10:54.531605Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3 sessionId:  grpc read done: success: 1 data: init_request { topic: "topic1" message_group_id: "source2" }
2025-11-21T14:10:54.531640Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3 topic: "topic1" message_group_id: "source2" from ipv6:[::1]:51498
2025-11-21T14:10:54.531650Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51498 proto=v1  topic=topic1 durationSec=0
2025-11-21T14:10:54.531656Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-11-21T14:10:54.532214Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3 sessionId:  describe result for acl check
2025-11-21T14:10:54.532253Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-11-21T14:10:54.532260Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-11-21T14:10:54.532262Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-11-21T14:10:54.532268Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [7:7575180942520982011:2462] (SourceId=source2, PreferedPartition=(NULL)) StartKqpSession
2025-11-21T14:10:54.532947Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [7:7575180942520982011:2462] (SourceId=source2, PreferedPartition=(NULL)) Select from the table
2025-11-21T14:10:54.534857Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [7:7575180942520982011:2462] (SourceId=source2, PreferedPartition=(NULL)) RequestPQRB
2025-11-21T14:10:54.535050Z node 8 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1656: [72075186224037893][rt3.dc1--topic1] pipe [7:7575180942520982027:2462] connected; active server actors: 1
2025-11-21T14:10:54.537139Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [7:7575180942520982011:2462] (SourceId=source2, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=source2
2025-11-21T14:10:54.537152Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [7:7575180942520982011:2462] (SourceId=source2, PreferedPartition=(NULL)) Update the table
2025-11-21T14:10:54.538806Z node 8 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1660: [72075186224037893][rt3.dc1--topic1] pipe [7:7575180942520982027:2462] disconnected.
2025-11-21T14:10:54.538825Z node 8 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1671: [72075186224037893][rt3.dc1--topic1] pipe [7:7575180942520982027:2462] disconnected; active server actors: 1
2025-11-21T14:10:54.538830Z node 8 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1696: [72075186224037893][rt3.dc1--topic1] pipe [7:7575180942520982027:2462] disconnected no session
2025-11-21T14:10:54.541736Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [7:7575180942520982011:2462] (SourceId=source2, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-11-21T14:10:54.541755Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [7:7575180942520982011:2462] (SourceId=source2, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-11-21T14:10:54.541759Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [7:7575180942520982011:2462] (SourceId=source2, PreferedPartition=(NULL)) Start idle
2025-11-21T14:10:54.541769Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-11-21T14:10:54.541923Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 7, Generation: 1
2025-11-21T14:10:54.541939Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [7:7575180942520982044:2462], now have 1 active actors on pipe
2025-11-21T14:10:54.541946Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-21T14:10:54.541953Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-21T14:10:54.542000Z node 7 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie source2|e34ced48-9333dd64-e76a911e-30279bbc_0 generated for partition 0 topic 'rt3.dc1--topic1' owner source2
2025-11-21T14:10:54.542011Z node 7 :PERSQUEUE DEBUG: partition.cpp:2313: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-21T14:10:54.542017Z node 7 :PERSQUEUE DEBUG: partition.cpp:2407: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-21T14:10:54.542023Z node 7 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-21T14:10:54.542026Z node 7 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-21T14:10:54.542029Z node 7 :PERSQUEUE DEBUG: partition.cpp:2471: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-21T14:10:54.542040Z node 7 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-21T14:10:54.542042Z node 7 :PERSQUEUE DEBUG: partition.cpp:2326: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-21T14:10:54.542045Z node 7 :PERSQUEUE DEBUG: partition.cpp:2331: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-21T14:10:54.542064Z node 7 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-21T14:10:54.542088Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-21T14:10:54.546496Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-21T14:10:54.546519Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-21T14:10:54.546558Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-21T14:10:54.546611Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3 partition: 0 MaxSeqNo: 0 sessionId: source2|e34ced48-9333dd64-e76a911e-30279bbc_0
2025-11-21T14:10:54.546976Z :INFO: [] MessageGroupId [source2] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1763734254546 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-11-21T14:10:54.547020Z :INFO: [] MessageGroupId [source2] SessionId [] Write session established. Init response: session_id: "source2|e34ced48-9333dd64-e76a911e-30279bbc_0" topic: "topic1" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-11-21T14:10:54.547300Z :DEBUG: [] MessageGroupId [source2] SessionId [source2|e34ced48-9333dd64-e76a911e-30279bbc_0] Write 1 messages with Id from 1 to 1
2025-11-21T14:10:54.547340Z :INFO: [] MessageGroupId [source2] SessionId [source2|e34ced48-9333dd64-e76a911e-30279bbc_0] Write session: close. Timeout = 10000 ms
2025-11-21T14:10:54.553156Z :DEBUG: [] MessageGroupId [source2] SessionId [source2|e34ced48-9333dd64-e76a911e-30279bbc_0] Write session: try to update token
2025-11-21T14:10:54.553180Z :DEBUG: [] MessageGroupId [source2] SessionId [source2|e34ced48-9333dd64-e76a911e-30279bbc_0] Send 1 message(s) (0 left), first sequence number is 1
2025-11-21T14:10:54.553553Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3 sessionId: source2|e34ced48-9333dd64-e76a911e-30279bbc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-21T14:10:54.553669Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-21T14:10:54.553728Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-21T14:10:54.553739Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-21T14:10:54.553788Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-11-21T14:10:54.553810Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-11-21T14:10:54.554268Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-21T14:10:54.554289Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-21T14:10:54.554313Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: '\0source2' SeqNo: 1 partNo : 0 messageNo: 1 size 1122 offset: -1
2025-11-21T14:10:54.554325Z node 7 :PERSQUEUE DEBUG: partition_write.cpp:634: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-21T14:10:54.554343Z node 7 :PERSQUEUE DEBUG: partition.cpp:2313: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-21T14:10:54.554364Z node 7 :PERSQUEUE DEBUG: partition.cpp:2407: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-21T14:10:54.554377Z node 7 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-21T14:10:54.554379Z node 7 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-21T14:10:54.554386Z node 7 :PERSQUEUE DEBUG: partition.cpp:2471: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-21T14:10:54.554420Z node 7 :PERSQUEUE DEBUG: partition_write.cpp:1326: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId '\0source2' seqNo 1 partNo 0
2025-11-21T14:10:54.554468Z node 7 :PERSQUEUE DEBUG: partition_write.cpp:1430: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '\0source2' seqNo 1 partNo 0 FormedBlobsCount 0 NewHead: Offset 2 PartNo 0 PackedSize 1197 count 1 nextOffset 3 batches 1
2025-11-21T14:10:54.554477Z node 7 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-21T14:10:54.554480Z node 7 :PERSQUEUE DEBUG: partition.cpp:2326: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-21T14:10:54.554483Z node 7 :PERSQUEUE DEBUG: partition.cpp:2331: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-21T14:10:54.554544Z node 7 :PERSQUEUE DEBUG: partition_write.cpp:1682: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 2,1 HeadOffset 2 endOffset 2 curOffset 3 d0000000000_00000000000000000002_00000_0000000001_00000? size 1185 WTime 1763734254553
2025-11-21T14:10:54.554574Z node 7 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-21T14:10:54.554585Z node 7 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 2 partNo 0 count 1 size 1185
2025-11-21T14:10:54.556079Z node 7 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 2 count 1 size 1185 actorID [7:7575180942520981761:2427]
2025-11-21T14:10:54.556100Z node 7 :PERSQUEUE DEBUG: partition.cpp:2137: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-21T14:10:54.556124Z node 7 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1130 WriteNewSizeFromSupportivePartitions# 0
2025-11-21T14:10:54.556135Z node 7 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-21T14:10:54.556144Z node 7 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0source2', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 1, partNo: 0, Offset: 2 is stored on disk
2025-11-21T14:10:54.556189Z node 7 :PERSQUEUE DEBUG: partition.cpp:2313: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-21T14:10:54.556193Z node 7 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-21T14:10:54.556195Z node 7 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-21T14:10:54.556197Z node 7 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-21T14:10:54.556199Z node 7 :PERSQUEUE DEBUG: partition.cpp:2331: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-21T14:10:54.556209Z node 7 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-21T14:10:54.556210Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 1 consumer shared/user session shared/user_7_1_3034911298628433174_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 2 EndOffset 2 newEndOffset 3 commitOffset 0 clientCommitOffset 0 cookie 3 readingFinished 0 firstRead 0
2025-11-21T14:10:54.556215Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_7_1_3034911298628433174_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 2 endOffset 3
2025-11-21T14:10:54.556575Z :DEBUG: [] MessageGroupId [source2] SessionId [source2|e34ced48-9333dd64-e76a911e-30279bbc_0] Write session got write response: sequence_numbers: 1 offsets: 2 already_written: false write_statistics { persist_duration_ms: 2 }
2025-11-21T14:10:54.556602Z :DEBUG: [] MessageGroupId [source2] SessionId [source2|e34ced48-9333dd64-e76a911e-30279bbc_0] Write session: acknoledged message 1
2025-11-21T14:10:54.556219Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 1  requestId: <none> cookie: 1
2025-11-21T14:10:54.556228Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_7_1_3034911298628433174_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 2, endOffset# 3, WTime# 1763734254435, sizeLag# 1185
2025-11-21T14:10:54.556230Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2354: session cookie 1 consumer shared/user session shared/user_7_1_3034911298628433174_v1TEvPartitionReady. Aval parts: 1
2025-11-21T14:10:54.556237Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-11-21T14:10:54.556242Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2277: session cookie 1 consumer shared/user session shared/user_7_1_3034911298628433174_v1 performing read request: guid# 9aa869f8-998df627-f906c9e9-a84bbd45, from# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), count# 1, size# 1422, partitionsAsked# 1, maxTimeLag# 0ms
2025-11-21T14:10:54.556252Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_7_1_3034911298628433174_v1 READ FROM TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1)maxCount 1 maxSize 1422 maxTimeLagMs 0 readTimestampMs 0 readOffset 2 EndOffset 3 ClientCommitOffset 0 committedOffset 0 Guid 9aa869f8-998df627-f906c9e9-a84bbd45
2025-11-21T14:10:54.556482Z node 7 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 2 partno 0 count 1 parts 0 suffix '63' size 1185
2025-11-21T14:10:54.556516Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-21T14:10:54.556523Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-21T14:10:54.556555Z node 7 :PERSQUEUE DEBUG: partition_read.cpp:887: [72075186224037892][Partition][0][StateIdle] read cookie 6 Topic 'rt3.dc1--topic1' partition 0 user user offset 2 partno 0 count 1 size 1422 endOffset 3 max time lag 0ms effective offset 2
2025-11-21T14:10:54.556572Z node 7 :PERSQUEUE DEBUG: partition_read.cpp:1112: [72075186224037892][Partition][0][StateIdle] read cookie 6 added 1 blobs, size 1185 count 1 last offset 2, current partition end offset: 3
2025-11-21T14:10:54.556575Z node 7 :PERSQUEUE DEBUG: partition_read.cpp:1128: [72075186224037892][Partition][0][StateIdle] Reading cookie 6. Send blob request.
2025-11-21T14:10:54.556584Z node 7 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 2 partno 0 count 1 parts_count 0 source 1 size 1185 accessed 0 times before, last time 2025-11-21T14:10:54.000000Z
2025-11-21T14:10:54.556591Z node 7 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 6. All 1 blobs are from cache.
2025-11-21T14:10:54.556601Z node 7 :PERSQUEUE DEBUG: partition_read.cpp:576: FormAnswer for 1 blobs
2025-11-21T14:10:54.556602Z node 7 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 2 partno 0 count 1 parts 0 suffix '63'
2025-11-21T14:10:54.556613Z node 7 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 2 totakecount 1 count 1 size 1165 from pos 0 cbcount 1
2025-11-21T14:10:54.556634Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 2
2025-11-21T14:10:54.556702Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_7_1_3034911298628433174_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 3 Result { Offset: 2 Data: "... 1122 bytes ..." SourceId: "\000source2" SeqNo: 1 WriteTimestampMS: 1763734254553 CreateTimestampMS: 1763734254547 UncompressedSize: 1047552 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 20 RealReadOffset: 2 WaitQuotaTimeMs: 0 EndOffset: 3 StartOffset: 0 } Cookie: 2 }
2025-11-21T14:10:54.556726Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_7_1_3034911298628433174_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 4 from offset 3
2025-11-21T14:10:54.556735Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_7_1_3034911298628433174_v1 after read state TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 3 ReadOffset 3 ReadGuid 9aa869f8-998df627-f906c9e9-a84bbd45 has messages 1
2025-11-21T14:10:54.556756Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1951: session cookie 1 consumer shared/user session shared/user_7_1_3034911298628433174_v1 read done: guid# 9aa869f8-998df627-f906c9e9-a84bbd45, partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), size# 1224
2025-11-21T14:10:54.556763Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2113: session cookie 1 consumer shared/user session shared/user_7_1_3034911298628433174_v1 response to read: guid# 9aa869f8-998df627-f906c9e9-a84bbd45
2025-11-21T14:10:54.556858Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2156: session cookie 1 consumer shared/user session shared/user_7_1_3034911298628433174_v1 Process answer. Aval parts: 0
2025-11-21T14:10:54.557005Z :DEBUG: [] [] [13e92436-20538e01-57bcc6dd-bc92c1ad] [null] After sending read request: ReadSizeBudget = 2621440, ReadSizeServerDelta = 0
2025-11-21T14:10:54.557436Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_7_1_3034911298628433174_v1 grpc read done: success# 1, data# { read { } }
2025-11-21T14:10:54.557488Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1850: session cookie 1 consumer shared/user session shared/user_7_1_3034911298628433174_v1 got read request: guid# b2f74ad2-67f9d243-efb38d40-7b7d15ae
2025-11-21T14:10:54.604200Z node 7 :PERSQUEUE DEBUG: partition.cpp:2313: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-21T14:10:54.604215Z node 7 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-21T14:10:54.604218Z node 7 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-21T14:10:54.604224Z node 7 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-21T14:10:54.604225Z node 7 :PERSQUEUE DEBUG: partition.cpp:2331: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-21T14:10:54.647435Z :INFO: [] MessageGroupId [source2] SessionId [source2|e34ced48-9333dd64-e76a911e-30279bbc_0] Write session will now close
2025-11-21T14:10:54.647459Z :DEBUG: [] MessageGroupId [source2] SessionId [source2|e34ced48-9333dd64-e76a911e-30279bbc_0] Write session: aborting
2025-11-21T14:10:54.647658Z :INFO: [] MessageGroupId [source2] SessionId [source2|e34ced48-9333dd64-e76a911e-30279bbc_0] Write session: gracefully shut down, all writes complete
2025-11-21T14:10:54.647677Z :DEBUG: [] MessageGroupId [source2] SessionId [source2|e34ced48-9333dd64-e76a911e-30279bbc_0] Write session: destroy
2025-11-21T14:10:54.647995Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3 sessionId: source2|e34ced48-9333dd64-e76a911e-30279bbc_0 grpc read done: success: 0 data: 
2025-11-21T14:10:54.648012Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 3 sessionId: source2|e34ced48-9333dd64-e76a911e-30279bbc_0 grpc read failed
2025-11-21T14:10:54.648022Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 3 sessionId: source2|e34ced48-9333dd64-e76a911e-30279bbc_0 grpc closed
2025-11-21T14:10:54.648029Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3 sessionId: source2|e34ced48-9333dd64-e76a911e-30279bbc_0 is DEAD
2025-11-21T14:10:54.648289Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-11-21T14:10:54.649051Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [7:7575180942520982044:2462] destroyed
2025-11-21T14:10:54.649079Z node 7 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-11-21T14:10:54.649087Z node 7 :PERSQUEUE DEBUG: partition.cpp:2313: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-21T14:10:54.649090Z node 7 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-21T14:10:54.649093Z node 7 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-21T14:10:54.649096Z node 7 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-21T14:10:54.649098Z node 7 :PERSQUEUE DEBUG: partition.cpp:2331: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-21T14:10:54.649204Z :DEBUG: [] MessageGroupId [source3] SessionId [] Write session: try to update token
2025-11-21T14:10:54.649391Z :INFO: [] MessageGroupId [source3] SessionId [] Write session: Do CDS request
2025-11-21T14:10:54.649399Z :INFO: [] MessageGroupId [source3] SessionId [] Start write session. Will connect to endpoint: localhost:32602
2025-11-21T14:10:54.649685Z :DEBUG: [] MessageGroupId [source3] SessionId [] Write session: send init request: init_request { topic: "topic1" message_group_id: "source3" }
2025-11-21T14:10:54.651175Z node 7 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-11-21T14:10:54.651188Z node 7 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 4
2025-11-21T14:10:54.651339Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 4 sessionId:  grpc read done: success: 1 data: init_request { topic: "topic1" message_group_id: "source3" }
2025-11-21T14:10:54.651379Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 4 topic: "topic1" message_group_id: "source3" from ipv6:[::1]:51498
2025-11-21T14:10:54.651388Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=4 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51498 proto=v1  topic=topic1 durationSec=0
2025-11-21T14:10:54.651393Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-11-21T14:10:54.651985Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 4 sessionId:  describe result for acl check
2025-11-21T14:10:54.652032Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-11-21T14:10:54.652034Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-11-21T14:10:54.652037Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-11-21T14:10:54.652041Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [7:7575180942520982056:2466] (SourceId=source3, PreferedPartition=(NULL)) StartKqpSession
2025-11-21T14:10:54.652656Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [7:7575180942520982056:2466] (SourceId=source3, PreferedPartition=(NULL)) Select from the table
2025-11-21T14:10:54.655902Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [7:7575180942520982056:2466] (SourceId=source3, PreferedPartition=(NULL)) RequestPQRB
2025-11-21T14:10:54.658754Z node 8 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1656: [72075186224037893][rt3.dc1--topic1] pipe [7:7575180942520982075:2466] connected; active server actors: 1
2025-11-21T14:10:54.659036Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [7:7575180942520982056:2466] (SourceId=source3, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=source3
2025-11-21T14:10:54.659048Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [7:7575180942520982056:2466] (SourceId=source3, PreferedPartition=(NULL)) Update the table
2025-11-21T14:10:54.659434Z node 8 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1660: [72075186224037893][rt3.dc1--topic1] pipe [7:7575180942520982075:2466] disconnected.
2025-11-21T14:10:54.659442Z node 8 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1671: [72075186224037893][rt3.dc1--topic1] pipe [7:7575180942520982075:2466] disconnected; active server actors: 1
2025-11-21T14:10:54.659445Z node 8 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1696: [72075186224037893][rt3.dc1--topic1] pipe [7:7575180942520982075:2466] disconnected no session
2025-11-21T14:10:54.667833Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [7:7575180942520982056:2466] (SourceId=source3, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-11-21T14:10:54.667851Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [7:7575180942520982056:2466] (SourceId=source3, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-11-21T14:10:54.667854Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [7:7575180942520982056:2466] (SourceId=source3, PreferedPartition=(NULL)) Start idle
2025-11-21T14:10:54.667864Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 4 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-11-21T14:10:54.668606Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 7, Generation: 1
2025-11-21T14:10:54.668626Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [7:7575180942520982090:2466], now have 1 active actors on pipe
2025-11-21T14:10:54.668705Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-21T14:10:54.668714Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-21T14:10:54.668746Z node 7 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie source3|d09b621c-c7cf75fa-1a42539d-c008775_0 generated for partition 0 topic 'rt3.dc1--topic1' owner source3
2025-11-21T14:10:54.668759Z node 7 :PERSQUEUE DEBUG: partition.cpp:2313: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-21T14:10:54.668765Z node 7 :PERSQUEUE DEBUG: partition.cpp:2407: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-21T14:10:54.668772Z node 7 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-21T14:10:54.668774Z node 7 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-21T14:10:54.668779Z node 7 :PERSQUEUE DEBUG: partition.cpp:2471: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-21T14:10:54.668791Z node 7 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-21T14:10:54.668794Z node 7 :PERSQUEUE DEBUG: partition.cpp:2326: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-21T14:10:54.668797Z node 7 :PERSQUEUE DEBUG: partition.cpp:2331: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-21T14:10:54.668818Z node 7 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-21T14:10:54.668835Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-21T14:10:54.668983Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-21T14:10:54.668989Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-21T14:10:54.669004Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-21T14:10:54.669032Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 4 partition: 0 MaxSeqNo: 0 sessionId: source3|d09b621c-c7cf75fa-1a42539d-c008775_0
2025-11-21T14:10:54.670438Z :INFO: [] MessageGroupId [source3] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1763734254670 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-11-21T14:10:54.670487Z :INFO: [] MessageGroupId [source3] SessionId [] Write session established. Init response: session_id: "source3|d09b621c-c7cf75fa-1a42539d-c008775_0" topic: "topic1" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-11-21T14:10:54.670801Z :DEBUG: [] MessageGroupId [source3] SessionId [source3|d09b621c-c7cf75fa-1a42539d-c008775_0] Write 1 messages with Id from 1 to 1
2025-11-21T14:10:54.670844Z :INFO: [] MessageGroupId [source3] SessionId [source3|d09b621c-c7cf75fa-1a42539d-c008775_0] Write session: close. Timeout = 10000 ms
2025-11-21T14:10:54.676602Z :DEBUG: [] MessageGroupId [source3] SessionId [source3|d09b621c-c7cf75fa-1a42539d-c008775_0] Write session: try to update token
2025-11-21T14:10:54.676622Z :DEBUG: [] MessageGroupId [source3] SessionId [source3|d09b621c-c7cf75fa-1a42539d-c008775_0] Send 1 message(s) (0 left), first sequence number is 1
2025-11-21T14:10:54.678458Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 4 sessionId: source3|d09b621c-c7cf75fa-1a42539d-c008775_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-21T14:10:54.678619Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-21T14:10:54.678754Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-21T14:10:54.678766Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-21T14:10:54.678807Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-11-21T14:10:54.678825Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-11-21T14:10:54.678942Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-21T14:10:54.678947Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-21T14:10:54.678967Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: '\0source3' SeqNo: 1 partNo : 0 messageNo: 1 size 1122 offset: -1
2025-11-21T14:10:54.678976Z node 7 :PERSQUEUE DEBUG: partition_write.cpp:634: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-21T14:10:54.678995Z node 7 :PERSQUEUE DEBUG: partition.cpp:2313: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-21T14:10:54.679000Z node 7 :PERSQUEUE DEBUG: partition.cpp:2407: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-21T14:10:54.679011Z node 7 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-21T14:10:54.679013Z node 7 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-21T14:10:54.679018Z node 7 :PERSQUEUE DEBUG: partition.cpp:2471: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-21T14:10:54.679050Z node 7 :PERSQUEUE DEBUG: partition_write.cpp:1326: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId '\0source3' seqNo 1 partNo 0
2025-11-21T14:10:54.679096Z node 7 :PERSQUEUE DEBUG: partition_write.cpp:1430: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '\0source3' seqNo 1 partNo 0 FormedBlobsCount 0 NewHead: Offset 3 PartNo 0 PackedSize 1197 count 1 nextOffset 4 batches 1
2025-11-21T14:10:54.679104Z node 7 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-21T14:10:54.679107Z node 7 :PERSQUEUE DEBUG: partition.cpp:2326: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-21T14:10:54.679111Z node 7 :PERSQUEUE DEBUG: partition.cpp:2331: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-21T14:10:54.679166Z node 7 :PERSQUEUE DEBUG: partition_write.cpp:1682: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 3,1 HeadOffset 3 endOffset 3 curOffset 4 d0000000000_00000000000000000003_00000_0000000001_00000? size 1185 WTime 1763734254678
2025-11-21T14:10:54.679194Z node 7 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-21T14:10:54.679206Z node 7 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 3 partNo 0 count 1 size 1185
2025-11-21T14:10:54.681265Z node 7 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 3 count 1 size 1185 actorID [7:7575180942520981761:2427]
2025-11-21T14:10:54.681293Z node 7 :PERSQUEUE DEBUG: partition.cpp:2137: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-21T14:10:54.681317Z node 7 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1130 WriteNewSizeFromSupportivePartitions# 0
2025-11-21T14:10:54.681331Z node 7 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-21T14:10:54.681339Z node 7 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 3 partno 0 count 1 parts 0 suffix '63' size 1185
2025-11-21T14:10:54.681341Z node 7 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0source3', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 1, partNo: 0, Offset: 3 is stored on disk
2025-11-21T14:10:54.681388Z node 7 :PERSQUEUE DEBUG: partition.cpp:2313: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-21T14:10:54.681395Z node 7 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-21T14:10:54.681399Z node 7 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-21T14:10:54.681402Z node 7 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-21T14:10:54.681404Z node 7 :PERSQUEUE DEBUG: partition.cpp:2331: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-21T14:10:54.681411Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 1 consumer shared/user session shared/user_7_1_3034911298628433174_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 3 EndOffset 3 newEndOffset 4 commitOffset 0 clientCommitOffset 0 cookie 4 readingFinished 0 firstRead 0
2025-11-21T14:10:54.681413Z node 7 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-21T14:10:54.681416Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_7_1_3034911298628433174_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 3 endOffset 4
2025-11-21T14:10:54.681425Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 1  requestId: <none> cookie: 1
2025-11-21T14:10:54.681432Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_7_1_3034911298628433174_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 3, endOffset# 4, WTime# 1763734254553, sizeLag# 1185
2025-11-21T14:10:54.681435Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2354: session cookie 1 consumer shared/user session shared/user_7_1_3034911298628433174_v1TEvPartitionReady. Aval parts: 1
2025-11-21T14:10:54.681445Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-11-21T14:10:54.681452Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2277: session cookie 1 consumer shared/user session shared/user_7_1_3034911298628433174_v1 performing read request: guid# b2f74ad2-67f9d243-efb38d40-7b7d15ae, from# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), count# 1, size# 1422, partitionsAsked# 1, maxTimeLag# 0ms
2025-11-21T14:10:54.681468Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_7_1_3034911298628433174_v1 READ FROM TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1)maxCount 1 maxSize 1422 maxTimeLagMs 0 readTimestampMs 0 readOffset 3 EndOffset 4 ClientCommitOffset 0 committedOffset 0 Guid b2f74ad2-67f9d243-efb38d40-7b7d15ae
2025-11-21T14:10:54.681606Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-21T14:10:54.681615Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-21T14:10:54.681655Z node 7 :PERSQUEUE DEBUG: partition_read.cpp:887: [72075186224037892][Partition][0][StateIdle] read cookie 7 Topic 'rt3.dc1--topic1' partition 0 user user offset 3 partno 0 count 1 size 1422 endOffset 4 max time lag 0ms effective offset 3
2025-11-21T14:10:54.681678Z node 7 :PERSQUEUE DEBUG: partition_read.cpp:1112: [72075186224037892][Partition][0][StateIdle] read cookie 7 added 1 blobs, size 1185 count 1 last offset 3, current partition end offset: 4
2025-11-21T14:10:54.681682Z node 7 :PERSQUEUE DEBUG: partition_read.cpp:1128: [72075186224037892][Partition][0][StateIdle] Reading cookie 7. Send blob request.
2025-11-21T14:10:54.681691Z node 7 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 3 partno 0 count 1 parts_count 0 source 1 size 1185 accessed 0 times before, last time 2025-11-21T14:10:54.000000Z
2025-11-21T14:10:54.681700Z node 7 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 7. All 1 blobs are from cache.
2025-11-21T14:10:54.681714Z node 7 :PERSQUEUE DEBUG: partition_read.cpp:576: FormAnswer for 1 blobs
2025-11-21T14:10:54.681732Z node 7 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 3 totakecount 1 count 1 size 1165 from pos 0 cbcount 1
2025-11-21T14:10:54.681757Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 3
2025-11-21T14:10:54.681841Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_7_1_3034911298628433174_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 4 Result { Offset: 3 Data: "... 1122 bytes ..." SourceId: "\000source3" SeqNo: 1 WriteTimestampMS: 1763734254678 CreateTimestampMS: 1763734254670 UncompressedSize: 1047552 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 20 RealReadOffset: 3 WaitQuotaTimeMs: 0 EndOffset: 4 StartOffset: 0 } Cookie: 3 }
2025-11-21T14:10:54.681870Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_7_1_3034911298628433174_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 5 from offset 4
2025-11-21T14:10:54.681879Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_7_1_3034911298628433174_v1 after read state TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 4 ReadOffset 4 ReadGuid b2f74ad2-67f9d243-efb38d40-7b7d15ae has messages 1
2025-11-21T14:10:54.681905Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1951: session cookie 1 consumer shared/user session shared/user_7_1_3034911298628433174_v1 read done: guid# b2f74ad2-67f9d243-efb38d40-7b7d15ae, partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), size# 1224
2025-11-21T14:10:54.681912Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2113: session cookie 1 consumer shared/user session shared/user_7_1_3034911298628433174_v1 response to read: guid# b2f74ad2-67f9d243-efb38d40-7b7d15ae
2025-11-21T14:10:54.682022Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2156: session cookie 1 consumer shared/user session shared/user_7_1_3034911298628433174_v1 Process answer. Aval parts: 0
2025-11-21T14:10:54.682156Z node 7 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 3 partno 0 count 1 parts 0 suffix '63'
2025-11-21T14:10:54.682465Z :DEBUG: [] MessageGroupId [source3] SessionId [source3|d09b621c-c7cf75fa-1a42539d-c008775_0] Write session got write response: sequence_numbers: 1 offsets: 3 already_written: false write_statistics { persist_duration_ms: 2 }
2025-11-21T14:10:54.682479Z :DEBUG: [] MessageGroupId [source3] SessionId [source3|d09b621c-c7cf75fa-1a42539d-c008775_0] Write session: acknoledged message 1
2025-11-21T14:10:54.682546Z :DEBUG: [] [] [13e92436-20538e01-57bcc6dd-bc92c1ad] [null] After sending read request: ReadSizeBudget = 2621440, ReadSizeServerDelta = 0
2025-11-21T14:10:54.682669Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_7_1_3034911298628433174_v1 grpc read done: success# 1, data# { read { } }
2025-11-21T14:10:54.682736Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1850: session cookie 1 consumer shared/user session shared/user_7_1_3034911298628433174_v1 got read request: guid# 6eb0399f-ced61744-53821535-8633620b
2025-11-21T14:10:54.704472Z node 7 :PERSQUEUE DEBUG: partition.cpp:2313: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-21T14:10:54.704491Z node 7 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-21T14:10:54.704494Z node 7 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-21T14:10:54.704498Z node 7 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-21T14:10:54.704502Z node 7 :PERSQUEUE DEBUG: partition.cpp:2331: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-21T14:10:54.770949Z :INFO: [] MessageGroupId [source3] SessionId [source3|d09b621c-c7cf75fa-1a42539d-c008775_0] Write session will now close
2025-11-21T14:10:54.770970Z :DEBUG: [] MessageGroupId [source3] SessionId [source3|d09b621c-c7cf75fa-1a42539d-c008775_0] Write session: aborting
2025-11-21T14:10:54.771143Z :INFO: [] MessageGroupId [source3] SessionId [source3|d09b621c-c7cf75fa-1a42539d-c008775_0] Write session: gracefully shut down, all writes complete
2025-11-21T14:10:54.771163Z :DEBUG: [] MessageGroupId [source3] SessionId [source3|d09b621c-c7cf75fa-1a42539d-c008775_0] Write session: destroy
2025-11-21T14:10:54.771544Z :DEBUG: [] MessageGroupId [source4] SessionId [] Write session: try to update token
2025-11-21T14:10:54.771682Z :INFO: [] MessageGroupId [source4] SessionId [] Write session: Do CDS request
2025-11-21T14:10:54.771690Z :INFO: [] MessageGroupId [source4] SessionId [] Start write session. Will connect to endpoint: localhost:32602
2025-11-21T14:10:54.771949Z :DEBUG: [] MessageGroupId [source4] SessionId [] Write session: send init request: init_request { topic: "topic1" message_group_id: "source4" }
2025-11-21T14:10:54.774087Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 4 sessionId: source3|d09b621c-c7cf75fa-1a42539d-c008775_0 grpc read done: success: 0 data: 
2025-11-21T14:10:54.774118Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 4 sessionId: source3|d09b621c-c7cf75fa-1a42539d-c008775_0 grpc read failed
2025-11-21T14:10:54.774128Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 4 sessionId: source3|d09b621c-c7cf75fa-1a42539d-c008775_0 grpc closed
2025-11-21T14:10:54.774136Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 4 sessionId: source3|d09b621c-c7cf75fa-1a42539d-c008775_0 is DEAD
2025-11-21T14:10:54.774333Z node 7 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-11-21T14:10:54.774347Z node 7 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 5
2025-11-21T14:10:54.774444Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-11-21T14:10:54.774551Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [7:7575180942520982090:2466] destroyed
2025-11-21T14:10:54.774572Z node 7 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-11-21T14:10:54.774581Z node 7 :PERSQUEUE DEBUG: partition.cpp:2313: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-21T14:10:54.774599Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 5 sessionId:  grpc read done: success: 1 data: init_request { topic: "topic1" message_group_id: "source4" }
2025-11-21T14:10:54.774601Z node 7 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-21T14:10:54.774606Z node 7 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-21T14:10:54.774608Z node 7 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-21T14:10:54.774610Z node 7 :PERSQUEUE DEBUG: partition.cpp:2331: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-21T14:10:54.774630Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 5 topic: "topic1" message_group_id: "source4" from ipv6:[::1]:51498
2025-11-21T14:10:54.774635Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=5 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51498 proto=v1  topic=topic1 durationSec=0
2025-11-21T14:10:54.774639Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-11-21T14:10:54.775078Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 5 sessionId:  describe result for acl check
2025-11-21T14:10:54.775118Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-11-21T14:10:54.775125Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-11-21T14:10:54.775127Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-11-21T14:10:54.775132Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [7:7575180942520982108:2471] (SourceId=source4, PreferedPartition=(NULL)) StartKqpSession
2025-11-21T14:10:54.775813Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [7:7575180942520982108:2471] (SourceId=source4, PreferedPartition=(NULL)) Select from the table
2025-11-21T14:10:54.781249Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [7:7575180942520982108:2471] (SourceId=source4, PreferedPartition=(NULL)) RequestPQRB
2025-11-21T14:10:54.781699Z node 8 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1656: [72075186224037893][rt3.dc1--topic1] pipe [7:7575180942520982127:2471] connected; active server actors: 1
2025-11-21T14:10:54.782751Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [7:7575180942520982108:2471] (SourceId=source4, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=source4
2025-11-21T14:10:54.782763Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [7:7575180942520982108:2471] (SourceId=source4, PreferedPartition=(NULL)) Update the table
2025-11-21T14:10:54.783190Z node 8 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1660: [72075186224037893][rt3.dc1--topic1] pipe [7:7575180942520982127:2471] disconnected.
2025-11-21T14:10:54.783206Z node 8 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1671: [72075186224037893][rt3.dc1--topic1] pipe [7:7575180942520982127:2471] disconnected; active server actors: 1
2025-11-21T14:10:54.783210Z node 8 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1696: [72075186224037893][rt3.dc1--topic1] pipe [7:7575180942520982127:2471] disconnected no session
2025-11-21T14:10:54.794840Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [7:7575180942520982108:2471] (SourceId=source4, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-11-21T14:10:54.794858Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [7:7575180942520982108:2471] (SourceId=source4, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-11-21T14:10:54.794860Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [7:7575180942520982108:2471] (SourceId=source4, PreferedPartition=(NULL)) Start idle
2025-11-21T14:10:54.794868Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 5 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-11-21T14:10:54.795307Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 7, Generation: 1
2025-11-21T14:10:54.795321Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [7:7575180942520982142:2471], now have 1 active actors on pipe
2025-11-21T14:10:54.795327Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-21T14:10:54.795332Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-21T14:10:54.795358Z node 7 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie source4|7dcb697d-a7c1bae8-465da1e3-5332c7dc_0 generated for partition 0 topic 'rt3.dc1--topic1' owner source4
2025-11-21T14:10:54.795366Z node 7 :PERSQUEUE DEBUG: partition.cpp:2313: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-21T14:10:54.795368Z node 7 :PERSQUEUE DEBUG: partition.cpp:2407: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-21T14:10:54.795372Z node 7 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-21T14:10:54.795374Z node 7 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-21T14:10:54.795377Z node 7 :PERSQUEUE DEBUG: partition.cpp:2471: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-21T14:10:54.795387Z node 7 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-21T14:10:54.795389Z node 7 :PERSQUEUE DEBUG: partition.cpp:2326: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-21T14:10:54.795391Z node 7 :PERSQUEUE DEBUG: partition.cpp:2331: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-21T14:10:54.795407Z node 7 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-21T14:10:54.795427Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-21T14:10:54.795685Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-21T14:10:54.795693Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-21T14:10:54.795710Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-21T14:10:54.795747Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 5 partition: 0 MaxSeqNo: 0 sessionId: source4|7dcb697d-a7c1bae8-465da1e3-5332c7dc_0
2025-11-21T14:10:54.796132Z :INFO: [] MessageGroupId [source4] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1763734254796 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-11-21T14:10:54.796178Z :INFO: [] MessageGroupId [source4] SessionId [] Write session established. Init response: session_id: "source4|7dcb697d-a7c1bae8-465da1e3-5332c7dc_0" topic: "topic1" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-11-21T14:10:54.796766Z :DEBUG: [] MessageGroupId [source4] SessionId [source4|7dcb697d-a7c1bae8-465da1e3-5332c7dc_0] Write 1 messages with Id from 1 to 1
2025-11-21T14:10:54.796809Z :INFO: [] MessageGroupId [source4] SessionId [source4|7dcb697d-a7c1bae8-465da1e3-5332c7dc_0] Write session: close. Timeout = 10000 ms
2025-11-21T14:10:54.805825Z node 7 :PERSQUEUE DEBUG: partition.cpp:2313: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-21T14:10:54.805841Z node 7 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-21T14:10:54.805843Z node 7 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-21T14:10:54.805847Z node 7 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-21T14:10:54.805850Z node 7 :PERSQUEUE DEBUG: partition.cpp:2331: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-21T14:10:54.806576Z :DEBUG: [] MessageGroupId [source4] SessionId [source4|7dcb697d-a7c1bae8-465da1e3-5332c7dc_0] Write session: try to update token
2025-11-21T14:10:54.806598Z :DEBUG: [] MessageGroupId [source4] SessionId [source4|7dcb697d-a7c1bae8-465da1e3-5332c7dc_0] Send 1 message(s) (0 left), first sequence number is 1
2025-11-21T14:10:54.806961Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 5 sessionId: source4|7dcb697d-a7c1bae8-465da1e3-5332c7dc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-21T14:10:54.807154Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-21T14:10:54.807246Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-21T14:10:54.807262Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-21T14:10:54.807302Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-11-21T14:10:54.807346Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-11-21T14:10:54.807394Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-21T14:10:54.807397Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-21T14:10:54.807428Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: '\0source4' SeqNo: 1 partNo : 0 messageNo: 1 size 1122 offset: -1
2025-11-21T14:10:54.807439Z node 7 :PERSQUEUE DEBUG: partition_write.cpp:634: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-21T14:10:54.807455Z node 7 :PERSQUEUE DEBUG: partition.cpp:2313: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-21T14:10:54.807459Z node 7 :PERSQUEUE DEBUG: partition.cpp:2407: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-21T14:10:54.807472Z node 7 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-21T14:10:54.807475Z node 7 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-21T14:10:54.807480Z node 7 :PERSQUEUE DEBUG: partition.cpp:2471: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-21T14:10:54.807520Z node 7 :PERSQUEUE DEBUG: partition_write.cpp:1326: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId '\0source4' seqNo 1 partNo 0
2025-11-21T14:10:54.807564Z node 7 :PERSQUEUE DEBUG: partition_write.cpp:1430: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '\0source4' seqNo 1 partNo 0 FormedBlobsCount 0 NewHead: Offset 4 PartNo 0 PackedSize 1197 count 1 nextOffset 5 batches 1
2025-11-21T14:10:54.807572Z node 7 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-21T14:10:54.807575Z node 7 :PERSQUEUE DEBUG: partition.cpp:2326: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-21T14:10:54.807578Z node 7 :PERSQUEUE DEBUG: partition.cpp:2331: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-21T14:10:54.807633Z node 7 :PERSQUEUE DEBUG: partition_write.cpp:1682: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 4,1 HeadOffset 4 endOffset 4 curOffset 5 d0000000000_00000000000000000004_00000_0000000001_00000? size 1185 WTime 1763734254807
2025-11-21T14:10:54.807658Z node 7 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-21T14:10:54.807670Z node 7 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 4 partNo 0 count 1 size 1185
2025-11-21T14:10:54.813803Z node 7 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 4 count 1 size 1185 actorID [7:7575180942520981761:2427]
2025-11-21T14:10:54.813838Z node 7 :PERSQUEUE DEBUG: partition.cpp:2137: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-21T14:10:54.813867Z node 7 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1130 WriteNewSizeFromSupportivePartitions# 0
2025-11-21T14:10:54.813882Z node 7 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-21T14:10:54.813894Z node 7 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0source4', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 1, partNo: 0, Offset: 4 is stored on disk
2025-11-21T14:10:54.813939Z node 7 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 4 partno 0 count 1 parts 0 suffix '63' size 1185
2025-11-21T14:10:54.813946Z node 7 :PERSQUEUE DEBUG: partition.cpp:2313: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-21T14:10:54.813952Z node 7 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-21T14:10:54.813954Z node 7 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-21T14:10:54.813957Z node 7 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-21T14:10:54.813959Z node 7 :PERSQUEUE DEBUG: partition.cpp:2331: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-21T14:10:54.813970Z node 7 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-21T14:10:54.814002Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 1  requestId: <none> cookie: 1
2025-11-21T14:10:54.814003Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 1 consumer shared/user session shared/user_7_1_3034911298628433174_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 4 EndOffset 4 newEndOffset 5 commitOffset 0 clientCommitOffset 0 cookie 5 readingFinished 0 firstRead 0
2025-11-21T14:10:54.814009Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_7_1_3034911298628433174_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 4 endOffset 5
2025-11-21T14:10:54.814025Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-11-21T14:10:54.814028Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_7_1_3034911298628433174_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 4, endOffset# 5, WTime# 1763734254678, sizeLag# 1185
2025-11-21T14:10:54.814032Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2354: session cookie 1 consumer shared/user session shared/user_7_1_3034911298628433174_v1TEvPartitionReady. Aval parts: 1
2025-11-21T14:10:54.814055Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2277: session cookie 1 consumer shared/user session shared/user_7_1_3034911298628433174_v1 performing read request: guid# 6eb0399f-ced61744-53821535-8633620b, from# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), count# 1, size# 1422, partitionsAsked# 1, maxTimeLag# 0ms
2025-11-21T14:10:54.814075Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_7_1_3034911298628433174_v1 READ FROM TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1)maxCount 1 maxSize 1422 maxTimeLagMs 0 readTimestampMs 0 readOffset 4 EndOffset 5 ClientCommitOffset 0 committedOffset 0 Guid 6eb0399f-ced61744-53821535-8633620b
2025-11-21T14:10:54.814118Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-21T14:10:54.814134Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-21T14:10:54.814183Z node 7 :PERSQUEUE DEBUG: partition_read.cpp:887: [72075186224037892][Partition][0][StateIdle] read cookie 8 Topic 'rt3.dc1--topic1' partition 0 user user offset 4 partno 0 count 1 size 1422 endOffset 5 max time lag 0ms effective offset 4
2025-11-21T14:10:54.814214Z node 7 :PERSQUEUE DEBUG: partition_read.cpp:1112: [72075186224037892][Partition][0][StateIdle] read cookie 8 added 1 blobs, size 1185 count 1 last offset 4, current partition end offset: 5
2025-11-21T14:10:54.814223Z node 7 :PERSQUEUE DEBUG: partition_read.cpp:1128: [72075186224037892][Partition][0][StateIdle] Reading cookie 8. Send blob request.
2025-11-21T14:10:54.814304Z :DEBUG: [] MessageGroupId [source4] SessionId [source4|7dcb697d-a7c1bae8-465da1e3-5332c7dc_0] Write session got write response: sequence_numbers: 1 offsets: 4 already_written: false write_statistics { persist_duration_ms: 6 }
2025-11-21T14:10:54.814311Z :DEBUG: [] MessageGroupId [source4] SessionId [source4|7dcb697d-a7c1bae8-465da1e3-5332c7dc_0] Write session: acknoledged message 1
2025-11-21T14:10:54.814234Z node 7 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 4 partno 0 count 1 parts_count 0 source 1 size 1185 accessed 0 times before, last time 2025-11-21T14:10:54.000000Z
2025-11-21T14:10:54.814250Z node 7 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 8. All 1 blobs are from cache.
2025-11-21T14:10:54.814264Z node 7 :PERSQUEUE DEBUG: partition_read.cpp:576: FormAnswer for 1 blobs
2025-11-21T14:10:54.814281Z node 7 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 4 totakecount 1 count 1 size 1165 from pos 0 cbcount 1
2025-11-21T14:10:54.814307Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 4
2025-11-21T14:10:54.814405Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_7_1_3034911298628433174_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 5 Result { Offset: 4 Data: "... 1122 bytes ..." SourceId: "\000source4" SeqNo: 1 WriteTimestampMS: 1763734254807 CreateTimestampMS: 1763734254796 UncompressedSize: 1047552 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 20 RealReadOffset: 4 WaitQuotaTimeMs: 0 EndOffset: 5 StartOffset: 0 } Cookie: 4 }
2025-11-21T14:10:54.814427Z node 7 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 4 partno 0 count 1 parts 0 suffix '63'
2025-11-21T14:10:54.814432Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_7_1_3034911298628433174_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 6 from offset 5
2025-11-21T14:10:54.814441Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_7_1_3034911298628433174_v1 after read state TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 5 ReadOffset 5 ReadGuid 6eb0399f-ced61744-53821535-8633620b has messages 1
2025-11-21T14:10:54.814493Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1951: session cookie 1 consumer shared/user session shared/user_7_1_3034911298628433174_v1 read done: guid# 6eb0399f-ced61744-53821535-8633620b, partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), size# 1224
2025-11-21T14:10:54.814510Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2113: session cookie 1 consumer shared/user session shared/user_7_1_3034911298628433174_v1 response to read: guid# 6eb0399f-ced61744-53821535-8633620b
2025-11-21T14:10:54.814602Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2156: session cookie 1 consumer shared/user session shared/user_7_1_3034911298628433174_v1 Process answer. Aval parts: 0
2025-11-21T14:10:54.814807Z :DEBUG: [] [] [13e92436-20538e01-57bcc6dd-bc92c1ad] [null] After sending read request: ReadSizeBudget = 2621440, ReadSizeServerDelta = 0
2025-11-21T14:10:54.814880Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_7_1_3034911298628433174_v1 grpc read done: success# 1, data# { read { } }
2025-11-21T14:10:54.814937Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1850: session cookie 1 consumer shared/user session shared/user_7_1_3034911298628433174_v1 got read request: guid# 69b4cad4-5be77c2e-682018c8-a0150629
2025-11-21T14:10:54.896899Z :INFO: [] MessageGroupId [source4] SessionId [source4|7dcb697d-a7c1bae8-465da1e3-5332c7dc_0] Write session will now close
2025-11-21T14:10:54.896921Z :DEBUG: [] MessageGroupId [source4] SessionId [source4|7dcb697d-a7c1bae8-465da1e3-5332c7dc_0] Write session: aborting
2025-11-21T14:10:54.897142Z :INFO: [] MessageGroupId [source4] SessionId [source4|7dcb697d-a7c1bae8-465da1e3-5332c7dc_0] Write session: gracefully shut down, all writes complete
2025-11-21T14:10:54.897159Z :DEBUG: [] MessageGroupId [source4] SessionId [source4|7dcb697d-a7c1bae8-465da1e3-5332c7dc_0] Write session: destroy
2025-11-21T14:10:54.897526Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 5 sessionId: source4|7dcb697d-a7c1bae8-465da1e3-5332c7dc_0 grpc read done: success: 0 data: 
2025-11-21T14:10:54.897542Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 5 sessionId: source4|7dcb697d-a7c1bae8-465da1e3-5332c7dc_0 grpc read failed
2025-11-21T14:10:54.897552Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 5 sessionId: source4|7dcb697d-a7c1bae8-465da1e3-5332c7dc_0 grpc closed
2025-11-21T14:10:54.897562Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 5 sessionId: source4|7dcb697d-a7c1bae8-465da1e3-5332c7dc_0 is DEAD
2025-11-21T14:10:54.897835Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-11-21T14:10:54.897929Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [7:7575180942520982142:2471] destroyed
2025-11-21T14:10:54.897952Z node 7 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-11-21T14:10:54.897962Z node 7 :PERSQUEUE DEBUG: partition.cpp:2313: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-21T14:10:54.897966Z node 7 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-21T14:10:54.897968Z node 7 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-21T14:10:54.897986Z node 7 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-21T14:10:54.897989Z node 7 :PERSQUEUE DEBUG: partition.cpp:2331: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-21T14:10:54.898084Z :DEBUG: [] MessageGroupId [source5] SessionId [] Write session: try to update token
2025-11-21T14:10:54.898233Z :INFO: [] MessageGroupId [source5] SessionId [] Write session: Do CDS request
2025-11-21T14:10:54.898239Z :INFO: [] MessageGroupId [source5] SessionId [] Start write session. Will connect to endpoint: localhost:32602
2025-11-21T14:10:54.898495Z :DEBUG: [] MessageGroupId [source5] SessionId [] Write session: send init request: init_request { topic: "topic1" message_group_id: "source5" }
2025-11-21T14:10:54.898606Z node 7 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-11-21T14:10:54.898629Z node 7 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 6
2025-11-21T14:10:54.898755Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 6 sessionId:  grpc read done: success: 1 data: init_request { topic: "topic1" message_group_id: "source5" }
2025-11-21T14:10:54.898786Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 6 topic: "topic1" message_group_id: "source5" from ipv6:[::1]:51498
2025-11-21T14:10:54.898792Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=6 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51498 proto=v1  topic=topic1 durationSec=0
2025-11-21T14:10:54.898796Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-11-21T14:10:54.899268Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 6 sessionId:  describe result for acl check
2025-11-21T14:10:54.899294Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-11-21T14:10:54.899301Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-11-21T14:10:54.899304Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-11-21T14:10:54.899309Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [7:7575180942520982156:2476] (SourceId=source5, PreferedPartition=(NULL)) StartKqpSession
2025-11-21T14:10:54.899970Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [7:7575180942520982156:2476] (SourceId=source5, PreferedPartition=(NULL)) Select from the table
2025-11-21T14:10:54.902513Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [7:7575180942520982156:2476] (SourceId=source5, PreferedPartition=(NULL)) RequestPQRB
2025-11-21T14:10:54.902738Z node 8 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1656: [72075186224037893][rt3.dc1--topic1] pipe [7:7575180942520982172:2476] connected; active server actors: 1
2025-11-21T14:10:54.902931Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [7:7575180942520982156:2476] (SourceId=source5, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=source5
2025-11-21T14:10:54.902942Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [7:7575180942520982156:2476] (SourceId=source5, PreferedPartition=(NULL)) Update the table
2025-11-21T14:10:54.903056Z node 8 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1660: [72075186224037893][rt3.dc1--topic1] pipe [7:7575180942520982172:2476] disconnected.
2025-11-21T14:10:54.903065Z node 8 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1671: [72075186224037893][rt3.dc1--topic1] pipe [7:7575180942520982172:2476] disconnected; active server actors: 1
2025-11-21T14:10:54.903068Z node 8 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1696: [72075186224037893][rt3.dc1--topic1] pipe [7:7575180942520982172:2476] disconnected no session
2025-11-21T14:10:54.906112Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [7:7575180942520982156:2476] (SourceId=source5, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-11-21T14:10:54.906144Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [7:7575180942520982156:2476] (SourceId=source5, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-11-21T14:10:54.906148Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [7:7575180942520982156:2476] (SourceId=source5, PreferedPartition=(NULL)) Start idle
2025-11-21T14:10:54.906157Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 6 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-11-21T14:10:54.906173Z node 7 :PERSQUEUE DEBUG: partition.cpp:2313: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-21T14:10:54.906178Z node 7 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-21T14:10:54.906179Z node 7 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-21T14:10:54.906181Z node 7 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-21T14:10:54.906183Z node 7 :PERSQUEUE DEBUG: partition.cpp:2331: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-21T14:10:54.906320Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 7, Generation: 1
2025-11-21T14:10:54.906338Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [7:7575180942520982188:2476], now have 1 active actors on pipe
2025-11-21T14:10:54.906366Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-21T14:10:54.906374Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-21T14:10:54.906403Z node 7 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie source5|54e33309-3b50980c-81477b97-62d5b0e1_0 generated for partition 0 topic 'rt3.dc1--topic1' owner source5
2025-11-21T14:10:54.906414Z node 7 :PERSQUEUE DEBUG: partition.cpp:2313: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-21T14:10:54.906417Z node 7 :PERSQUEUE DEBUG: partition.cpp:2407: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-21T14:10:54.906422Z node 7 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-21T14:10:54.906429Z node 7 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-21T14:10:54.906433Z node 7 :PERSQUEUE DEBUG: partition.cpp:2471: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-21T14:10:54.906443Z node 7 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-21T14:10:54.906448Z node 7 :PERSQUEUE DEBUG: partition.cpp:2326: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-21T14:10:54.906451Z node 7 :PERSQUEUE DEBUG: partition.cpp:2331: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-21T14:10:54.906465Z node 7 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-21T14:10:54.906484Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-21T14:10:54.906527Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-21T14:10:54.906540Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-21T14:10:54.906561Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-21T14:10:54.906613Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 6 partition: 0 MaxSeqNo: 0 sessionId: source5|54e33309-3b50980c-81477b97-62d5b0e1_0
2025-11-21T14:10:54.906955Z :INFO: [] MessageGroupId [source5] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1763734254906 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-11-21T14:10:54.906998Z :INFO: [] MessageGroupId [source5] SessionId [] Write session established. Init response: session_id: "source5|54e33309-3b50980c-81477b97-62d5b0e1_0" topic: "topic1" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-11-21T14:10:54.907282Z :DEBUG: [] MessageGroupId [source5] SessionId [source5|54e33309-3b50980c-81477b97-62d5b0e1_0] Write 1 messages with Id from 1 to 1
2025-11-21T14:10:54.907313Z :INFO: [] MessageGroupId [source5] SessionId [source5|54e33309-3b50980c-81477b97-62d5b0e1_0] Write session: close. Timeout = 10000 ms
2025-11-21T14:10:54.913368Z :DEBUG: [] MessageGroupId [source5] SessionId [source5|54e33309-3b50980c-81477b97-62d5b0e1_0] Write session: try to update token
2025-11-21T14:10:54.913389Z :DEBUG: [] MessageGroupId [source5] SessionId [source5|54e33309-3b50980c-81477b97-62d5b0e1_0] Send 1 message(s) (0 left), first sequence number is 1
2025-11-21T14:10:54.913996Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 6 sessionId: source5|54e33309-3b50980c-81477b97-62d5b0e1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-21T14:10:54.914157Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-21T14:10:54.914216Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-21T14:10:54.914227Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-21T14:10:54.914264Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-11-21T14:10:54.914287Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-11-21T14:10:54.914325Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-21T14:10:54.914328Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-21T14:10:54.914366Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: '\0source5' SeqNo: 1 partNo : 0 messageNo: 1 size 1122 offset: -1
2025-11-21T14:10:54.914374Z node 7 :PERSQUEUE DEBUG: partition_write.cpp:634: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-21T14:10:54.914392Z node 7 :PERSQUEUE DEBUG: partition.cpp:2313: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-21T14:10:54.914396Z node 7 :PERSQUEUE DEBUG: partition.cpp:2407: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-21T14:10:54.914408Z node 7 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-21T14:10:54.914410Z node 7 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-21T14:10:54.914415Z node 7 :PERSQUEUE DEBUG: partition.cpp:2471: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-21T14:10:54.914449Z node 7 :PERSQUEUE DEBUG: partition_write.cpp:1326: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId '\0source5' seqNo 1 partNo 0
2025-11-21T14:10:54.914486Z node 7 :PERSQUEUE DEBUG: partition_write.cpp:1430: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '\0source5' seqNo 1 partNo 0 FormedBlobsCount 0 NewHead: Offset 5 PartNo 0 PackedSize 1197 count 1 nextOffset 6 batches 1
2025-11-21T14:10:54.914494Z node 7 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-21T14:10:54.914496Z node 7 :PERSQUEUE DEBUG: partition.cpp:2326: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-21T14:10:54.914499Z node 7 :PERSQUEUE DEBUG: partition.cpp:2331: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-21T14:10:54.914557Z node 7 :PERSQUEUE DEBUG: partition_write.cpp:1682: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 5,1 HeadOffset 5 endOffset 5 curOffset 6 d0000000000_00000000000000000005_00000_0000000001_00000? size 1185 WTime 1763734254914
2025-11-21T14:10:54.914582Z node 7 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-21T14:10:54.914595Z node 7 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 5 partNo 0 count 1 size 1185
2025-11-21T14:10:54.916450Z node 7 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 5 count 1 size 1185 actorID [7:7575180942520981761:2427]
2025-11-21T14:10:54.916477Z node 7 :PERSQUEUE DEBUG: partition.cpp:2137: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-21T14:10:54.916500Z node 7 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1130 WriteNewSizeFromSupportivePartitions# 0
2025-11-21T14:10:54.916512Z node 7 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-21T14:10:54.916530Z node 7 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0source5', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 1, partNo: 0, Offset: 5 is stored on disk
2025-11-21T14:10:54.916539Z node 7 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 5 partno 0 count 1 parts 0 suffix '63' size 1185
2025-11-21T14:10:54.916574Z node 7 :PERSQUEUE DEBUG: partition.cpp:2313: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-21T14:10:54.916582Z node 7 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-21T14:10:54.916585Z node 7 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-21T14:10:54.916587Z node 7 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-21T14:10:54.916589Z node 7 :PERSQUEUE DEBUG: partition.cpp:2331: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-21T14:10:54.916599Z node 7 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-21T14:10:54.916604Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 1 consumer shared/user session shared/user_7_1_3034911298628433174_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 5 EndOffset 5 newEndOffset 6 commitOffset 0 clientCommitOffset 0 cookie 6 readingFinished 0 firstRead 0
2025-11-21T14:10:54.916610Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 1  requestId: <none> cookie: 1
2025-11-21T14:10:54.916611Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_7_1_3034911298628433174_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 5 endOffset 6
2025-11-21T14:10:54.916629Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-11-21T14:10:54.916629Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_7_1_3034911298628433174_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 5, endOffset# 6, WTime# 1763734254807, sizeLag# 1185
2025-11-21T14:10:54.916633Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2354: session cookie 1 consumer shared/user session shared/user_7_1_3034911298628433174_v1TEvPartitionReady. Aval parts: 1
2025-11-21T14:10:54.916648Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2277: session cookie 1 consumer shared/user session shared/user_7_1_3034911298628433174_v1 performing read request: guid# 69b4cad4-5be77c2e-682018c8-a0150629, from# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), count# 1, size# 1422, partitionsAsked# 1, maxTimeLag# 0ms
2025-11-21T14:10:54.916671Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_7_1_3034911298628433174_v1 READ FROM TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1)maxCount 1 maxSize 1422 maxTimeLagMs 0 readTimestampMs 0 readOffset 5 EndOffset 6 ClientCommitOffset 0 committedOffset 0 Guid 69b4cad4-5be77c2e-682018c8-a0150629
2025-11-21T14:10:54.916726Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-21T14:10:54.916739Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-21T14:10:54.916799Z node 7 :PERSQUEUE DEBUG: partition_read.cpp:887: [72075186224037892][Partition][0][StateIdle] read cookie 9 Topic 'rt3.dc1--topic1' partition 0 user user offset 5 partno 0 count 1 size 1422 endOffset 6 max time lag 0ms effective offset 5
2025-11-21T14:10:54.916832Z node 7 :PERSQUEUE DEBUG: partition_read.cpp:1112: [72075186224037892][Partition][0][StateIdle] read cookie 9 added 1 blobs, size 1185 count 1 last offset 5, current partition end offset: 6
2025-11-21T14:10:54.916841Z node 7 :PERSQUEUE DEBUG: partition_read.cpp:1128: [72075186224037892][Partition][0][StateIdle] Reading cookie 9. Send blob request.
2025-11-21T14:10:54.916855Z node 7 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 5 partno 0 count 1 parts_count 0 source 1 size 1185 accessed 0 times before, last time 2025-11-21T14:10:54.000000Z
2025-11-21T14:10:54.916880Z node 7 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 9. All 1 blobs are from cache.
2025-11-21T14:10:54.916882Z node 7 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 5 partno 0 count 1 parts 0 suffix '63'
2025-11-21T14:10:54.916891Z :DEBUG: [] MessageGroupId [source5] SessionId [source5|54e33309-3b50980c-81477b97-62d5b0e1_0] Write session got write response: sequence_numbers: 1 offsets: 5 already_written: false write_statistics { persist_duration_ms: 2 }
2025-11-21T14:10:54.916902Z :DEBUG: [] MessageGroupId [source5] SessionId [source5|54e33309-3b50980c-81477b97-62d5b0e1_0] Write session: acknoledged message 1
2025-11-21T14:10:54.916900Z node 7 :PERSQUEUE DEBUG: partition_read.cpp:576: FormAnswer for 1 blobs
2025-11-21T14:10:54.916925Z node 7 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 5 totakecount 1 count 1 size 1165 from pos 0 cbcount 1
2025-11-21T14:10:54.916971Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 5
2025-11-21T14:10:54.917069Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_7_1_3034911298628433174_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 6 Result { Offset: 5 Data: "... 1122 bytes ..." SourceId: "\000source5" SeqNo: 1 WriteTimestampMS: 1763734254914 CreateTimestampMS: 1763734254907 UncompressedSize: 1047552 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 20 RealReadOffset: 5 WaitQuotaTimeMs: 0 EndOffset: 6 StartOffset: 0 } Cookie: 5 }
2025-11-21T14:10:54.917104Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_7_1_3034911298628433174_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 7 from offset 6
2025-11-21T14:10:54.917118Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_7_1_3034911298628433174_v1 after read state TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 6 ReadOffset 6 ReadGuid 69b4cad4-5be77c2e-682018c8-a0150629 has messages 1
2025-11-21T14:10:54.917150Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1951: session cookie 1 consumer shared/user session shared/user_7_1_3034911298628433174_v1 read done: guid# 69b4cad4-5be77c2e-682018c8-a0150629, partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), size# 1224
2025-11-21T14:10:54.917165Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2113: session cookie 1 consumer shared/user session shared/user_7_1_3034911298628433174_v1 response to read: guid# 69b4cad4-5be77c2e-682018c8-a0150629
2025-11-21T14:10:54.917285Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2156: session cookie 1 consumer shared/user session shared/user_7_1_3034911298628433174_v1 Process answer. Aval parts: 0
2025-11-21T14:10:54.917531Z :DEBUG: [] [] [13e92436-20538e01-57bcc6dd-bc92c1ad] [null] After sending read request: ReadSizeBudget = 2621440, ReadSizeServerDelta = 0
2025-11-21T14:10:54.917766Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_7_1_3034911298628433174_v1 grpc read done: success# 1, data# { read { } }
2025-11-21T14:10:54.917828Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1850: session cookie 1 consumer shared/user session shared/user_7_1_3034911298628433174_v1 got read request: guid# db8edab9-9b8a3929-bc42376a-c89013ca
2025-11-21T14:10:55.006758Z node 7 :PERSQUEUE DEBUG: partition.cpp:2313: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-21T14:10:55.006787Z node 7 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-21T14:10:55.006790Z node 7 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-21T14:10:55.006795Z node 7 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-21T14:10:55.006798Z node 7 :PERSQUEUE DEBUG: partition.cpp:2331: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-21T14:10:55.008242Z :INFO: [] MessageGroupId [source5] SessionId [source5|54e33309-3b50980c-81477b97-62d5b0e1_0] Write session will now close
2025-11-21T14:10:55.008259Z :DEBUG: [] MessageGroupId [source5] SessionId [source5|54e33309-3b50980c-81477b97-62d5b0e1_0] Write session: aborting
2025-11-21T14:10:55.008878Z :INFO: [] MessageGroupId [source5] SessionId [source5|54e33309-3b50980c-81477b97-62d5b0e1_0] Write session: gracefully shut down, all writes complete
2025-11-21T14:10:55.008906Z :DEBUG: [] MessageGroupId [source5] SessionId [source5|54e33309-3b50980c-81477b97-62d5b0e1_0] Write session: destroy
2025-11-21T14:10:55.009274Z :DEBUG: [] MessageGroupId [source6] SessionId [] Write session: try to update token
2025-11-21T14:10:55.009431Z :INFO: [] MessageGroupId [source6] SessionId [] Write session: Do CDS request
2025-11-21T14:10:55.009437Z :INFO: [] MessageGroupId [source6] SessionId [] Start write session. Will connect to endpoint: localhost:32602
2025-11-21T14:10:55.010498Z :DEBUG: [] MessageGroupId [source6] SessionId [] Write session: send init request: init_request { topic: "topic1" message_group_id: "source6" }
2025-11-21T14:10:55.010385Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 6 sessionId: source5|54e33309-3b50980c-81477b97-62d5b0e1_0 grpc read done: success: 0 data: 
2025-11-21T14:10:55.010402Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 6 sessionId: source5|54e33309-3b50980c-81477b97-62d5b0e1_0 grpc read failed
2025-11-21T14:10:55.010415Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 6 sessionId: source5|54e33309-3b50980c-81477b97-62d5b0e1_0 grpc closed
2025-11-21T14:10:55.010422Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 6 sessionId: source5|54e33309-3b50980c-81477b97-62d5b0e1_0 is DEAD
2025-11-21T14:10:55.010467Z node 7 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-11-21T14:10:55.010473Z node 7 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 7
2025-11-21T14:10:55.010662Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-11-21T14:10:55.010990Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [7:7575180942520982188:2476] destroyed
2025-11-21T14:10:55.011015Z node 7 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-11-21T14:10:55.011025Z node 7 :PERSQUEUE DEBUG: partition.cpp:2313: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-21T14:10:55.011029Z node 7 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-21T14:10:55.011031Z node 7 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-21T14:10:55.011035Z node 7 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-21T14:10:55.011037Z node 7 :PERSQUEUE DEBUG: partition.cpp:2331: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-21T14:10:55.011072Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 7 sessionId:  grpc read done: success: 1 data: init_request { topic: "topic1" message_group_id: "source6" }
2025-11-21T14:10:55.011104Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 7 topic: "topic1" message_group_id: "source6" from ipv6:[::1]:51498
2025-11-21T14:10:55.011109Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=7 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51498 proto=v1  topic=topic1 durationSec=0
2025-11-21T14:10:55.011114Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-11-21T14:10:55.011641Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 7 sessionId:  describe result for acl check
2025-11-21T14:10:55.011675Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-11-21T14:10:55.011677Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-11-21T14:10:55.011678Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-11-21T14:10:55.011683Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [7:7575180946815949502:2480] (SourceId=source6, PreferedPartition=(NULL)) StartKqpSession
2025-11-21T14:10:55.012229Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [7:7575180946815949502:2480] (SourceId=source6, PreferedPartition=(NULL)) Select from the table
2025-11-21T14:10:55.014430Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [7:7575180946815949502:2480] (SourceId=source6, PreferedPartition=(NULL)) RequestPQRB
2025-11-21T14:10:55.014705Z node 8 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1656: [72075186224037893][rt3.dc1--topic1] pipe [7:7575180946815949518:2480] connected; active server actors: 1
2025-11-21T14:10:55.014935Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [7:7575180946815949502:2480] (SourceId=source6, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=source6
2025-11-21T14:10:55.014945Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [7:7575180946815949502:2480] (SourceId=source6, PreferedPartition=(NULL)) Update the table
2025-11-21T14:10:55.015224Z node 8 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1660: [72075186224037893][rt3.dc1--topic1] pipe [7:7575180946815949518:2480] disconnected.
2025-11-21T14:10:55.015237Z node 8 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1671: [72075186224037893][rt3.dc1--topic1] pipe [7:7575180946815949518:2480] disconnected; active server actors: 1
2025-11-21T14:10:55.015240Z node 8 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1696: [72075186224037893][rt3.dc1--topic1] pipe [7:7575180946815949518:2480] disconnected no session
2025-11-21T14:10:55.019062Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [7:7575180946815949502:2480] (SourceId=source6, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-11-21T14:10:55.019079Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [7:7575180946815949502:2480] (SourceId=source6, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-11-21T14:10:55.019083Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [7:7575180946815949502:2480] (SourceId=source6, PreferedPartition=(NULL)) Start idle
2025-11-21T14:10:55.019093Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 7 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-11-21T14:10:55.019279Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 7, Generation: 1
2025-11-21T14:10:55.019295Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [7:7575180946815949533:2480], now have 1 active actors on pipe
2025-11-21T14:10:55.019303Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-21T14:10:55.019310Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-21T14:10:55.019340Z node 7 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie source6|10974a83-e0461bef-750a9c72-b2f9e08f_0 generated for partition 0 topic 'rt3.dc1--topic1' owner source6
2025-11-21T14:10:55.019352Z node 7 :PERSQUEUE DEBUG: partition.cpp:2313: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-21T14:10:55.019356Z node 7 :PERSQUEUE DEBUG: partition.cpp:2407: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-21T14:10:55.019362Z node 7 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-21T14:10:55.019365Z node 7 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-21T14:10:55.019369Z node 7 :PERSQUEUE DEBUG: partition.cpp:2471: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-21T14:10:55.019381Z node 7 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-21T14:10:55.019384Z node 7 :PERSQUEUE DEBUG: partition.cpp:2326: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-21T14:10:55.019387Z node 7 :PERSQUEUE DEBUG: partition.cpp:2331: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-21T14:10:55.019405Z node 7 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-21T14:10:55.019424Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-21T14:10:55.020072Z :INFO: [] MessageGroupId [source6] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1763734255020 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-11-21T14:10:55.020116Z :INFO: [] MessageGroupId [source6] SessionId [] Write session established. Init response: session_id: "source6|10974a83-e0461bef-750a9c72-b2f9e08f_0" topic: "topic1" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-11-21T14:10:55.020541Z :DEBUG: [] MessageGroupId [source6] SessionId [source6|10974a83-e0461bef-750a9c72-b2f9e08f_0] Write 1 messages with Id from 1 to 1
2025-11-21T14:10:55.020582Z :INFO: [] MessageGroupId [source6] SessionId [source6|10974a83-e0461bef-750a9c72-b2f9e08f_0] Write session: close. Timeout = 10000 ms
2025-11-21T14:10:55.019508Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-21T14:10:55.019523Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-21T14:10:55.019549Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-21T14:10:55.019596Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 7 partition: 0 MaxSeqNo: 0 sessionId: source6|10974a83-e0461bef-750a9c72-b2f9e08f_0
2025-11-21T14:10:55.026635Z :DEBUG: [] MessageGroupId [source6] SessionId [source6|10974a83-e0461bef-750a9c72-b2f9e08f_0] Write session: try to update token
2025-11-21T14:10:55.026656Z :DEBUG: [] MessageGroupId [source6] SessionId [source6|10974a83-e0461bef-750a9c72-b2f9e08f_0] Send 1 message(s) (0 left), first sequence number is 1
2025-11-21T14:10:55.027264Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 7 sessionId: source6|10974a83-e0461bef-750a9c72-b2f9e08f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-21T14:10:55.027390Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-21T14:10:55.027528Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-21T14:10:55.027549Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-21T14:10:55.027594Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-11-21T14:10:55.027625Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-11-21T14:10:55.027669Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-21T14:10:55.027676Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-21T14:10:55.027698Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: '\0source6' SeqNo: 1 partNo : 0 messageNo: 1 size 1122 offset: -1
2025-11-21T14:10:55.027711Z node 7 :PERSQUEUE DEBUG: partition_write.cpp:634: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-21T14:10:55.027732Z node 7 :PERSQUEUE DEBUG: partition.cpp:2313: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-21T14:10:55.027744Z node 7 :PERSQUEUE DEBUG: partition.cpp:2407: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-21T14:10:55.027755Z node 7 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-21T14:10:55.027763Z node 7 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-21T14:10:55.027768Z node 7 :PERSQUEUE DEBUG: partition.cpp:2471: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-21T14:10:55.027802Z node 7 :PERSQUEUE DEBUG: partition_write.cpp:1326: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId '\0source6' seqNo 1 partNo 0
2025-11-21T14:10:55.027851Z node 7 :PERSQUEUE DEBUG: partition_write.cpp:1430: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '\0source6' seqNo 1 partNo 0 FormedBlobsCount 0 NewHead: Offset 6 PartNo 0 PackedSize 1197 count 1 nextOffset 7 batches 1
2025-11-21T14:10:55.027864Z node 7 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-21T14:10:55.027867Z node 7 :PERSQUEUE DEBUG: partition.cpp:2326: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-21T14:10:55.027870Z node 7 :PERSQUEUE DEBUG: partition.cpp:2331: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-21T14:10:55.027926Z node 7 :PERSQUEUE DEBUG: partition_write.cpp:1682: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 6,1 HeadOffset 6 endOffset 6 curOffset 7 d0000000000_00000000000000000006_00000_0000000001_00000? size 1185 WTime 1763734255027
2025-11-21T14:10:55.027958Z node 7 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-21T14:10:55.027975Z node 7 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 6 partNo 0 count 1 size 1185
2025-11-21T14:10:55.039244Z node 7 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 6 count 1 size 1185 actorID [7:7575180942520981761:2427]
2025-11-21T14:10:55.039283Z node 7 :PERSQUEUE DEBUG: partition.cpp:2137: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-21T14:10:55.039314Z node 7 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1130 WriteNewSizeFromSupportivePartitions# 0
2025-11-21T14:10:55.039328Z node 7 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 6 partno 0 count 1 parts 0 suffix '63' size 1185
2025-11-21T14:10:55.039334Z node 7 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-21T14:10:55.039345Z node 7 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0source6', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 1, partNo: 0, Offset: 6 is stored on disk
2025-11-21T14:10:55.039399Z node 7 :PERSQUEUE DEBUG: partition.cpp:2313: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-21T14:10:55.039403Z node 7 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-21T14:10:55.039405Z node 7 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-21T14:10:55.039408Z node 7 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-21T14:10:55.039412Z node 7 :PERSQUEUE DEBUG: partition.cpp:2331: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-21T14:10:55.039421Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 1 consumer shared/user session shared/user_7_1_3034911298628433174_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 6 EndOffset 6 newEndOffset 7 commitOffset 0 clientCommitOffset 0 cookie 7 readingFinished 0 firstRead 0
2025-11-21T14:10:55.039424Z node 7 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-21T14:10:55.039427Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_7_1_3034911298628433174_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 6 endOffset 7
2025-11-21T14:10:55.039438Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 1  requestId: <none> cookie: 1
2025-11-21T14:10:55.039447Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_7_1_3034911298628433174_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 6, endOffset# 7, WTime# 1763734254914, sizeLag# 1185
2025-11-21T14:10:55.039784Z :DEBUG: [] MessageGroupId [source6] SessionId [source6|10974a83-e0461bef-750a9c72-b2f9e08f_0] Write session got write response: sequence_numbers: 1 offsets: 6 already_written: false write_statistics { persist_duration_ms: 11 }
2025-11-21T14:10:55.039801Z :DEBUG: [] MessageGroupId [source6] SessionId [source6|10974a83-e0461bef-750a9c72-b2f9e08f_0] Write session: acknoledged message 1
2025-11-21T14:10:55.039450Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2354: session cookie 1 consumer shared/user session shared/user_7_1_3034911298628433174_v1TEvPartitionReady. Aval parts: 1
2025-11-21T14:10:55.039461Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-11-21T14:10:55.039463Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2277: session cookie 1 consumer shared/user session shared/user_7_1_3034911298628433174_v1 performing read request: guid# db8edab9-9b8a3929-bc42376a-c89013ca, from# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), count# 1, size# 1422, partitionsAsked# 1, maxTimeLag# 0ms
2025-11-21T14:10:55.039479Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_7_1_3034911298628433174_v1 READ FROM TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1)maxCount 1 maxSize 1422 maxTimeLagMs 0 readTimestampMs 0 readOffset 6 EndOffset 7 ClientCommitOffset 0 committedOffset 0 Guid db8edab9-9b8a3929-bc42376a-c89013ca
2025-11-21T14:10:55.039573Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-21T14:10:55.039582Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-21T14:10:55.039628Z node 7 :PERSQUEUE DEBUG: partition_read.cpp:887: [72075186224037892][Partition][0][StateIdle] read cookie 10 Topic 'rt3.dc1--topic1' partition 0 user user offset 6 partno 0 count 1 size 1422 endOffset 7 max time lag 0ms effective offset 6
2025-11-21T14:10:55.039657Z node 7 :PERSQUEUE DEBUG: partition_read.cpp:1112: [72075186224037892][Partition][0][StateIdle] read cookie 10 added 1 blobs, size 1185 count 1 last offset 6, current partition end offset: 7
2025-11-21T14:10:55.039661Z node 7 :PERSQUEUE DEBUG: partition_read.cpp:1128: [72075186224037892][Partition][0][StateIdle] Reading cookie 10. Send blob request.
2025-11-21T14:10:55.039675Z node 7 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 6 partno 0 count 1 parts_count 0 source 1 size 1185 accessed 0 times before, last time 2025-11-21T14:10:55.000000Z
2025-11-21T14:10:55.039686Z node 7 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 10. All 1 blobs are from cache.
2025-11-21T14:10:55.039705Z node 7 :PERSQUEUE DEBUG: partition_read.cpp:576: FormAnswer for 1 blobs
2025-11-21T14:10:55.039725Z node 7 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 6 totakecount 1 count 1 size 1165 from pos 0 cbcount 1
2025-11-21T14:10:55.039768Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 6
2025-11-21T14:10:55.039764Z node 7 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 6 partno 0 count 1 parts 0 suffix '63'
2025-11-21T14:10:55.039847Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_7_1_3034911298628433174_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 7 Result { Offset: 6 Data: "... 1122 bytes ..." SourceId: "\000source6" SeqNo: 1 WriteTimestampMS: 1763734255027 CreateTimestampMS: 1763734255020 UncompressedSize: 1047552 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 20 RealReadOffset: 6 WaitQuotaTimeMs: 0 EndOffset: 7 StartOffset: 0 } Cookie: 6 }
2025-11-21T14:10:55.039879Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_7_1_3034911298628433174_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 8 from offset 7
2025-11-21T14:10:55.039900Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_7_1_3034911298628433174_v1 after read state TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 7 ReadOffset 7 ReadGuid db8edab9-9b8a3929-bc42376a-c89013ca has messages 1
2025-11-21T14:10:55.039935Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1951: session cookie 1 consumer shared/user session shared/user_7_1_3034911298628433174_v1 read done: guid# db8edab9-9b8a3929-bc42376a-c89013ca, partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), size# 1224
2025-11-21T14:10:55.039945Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2113: session cookie 1 consumer shared/user session shared/user_7_1_3034911298628433174_v1 response to read: guid# db8edab9-9b8a3929-bc42376a-c89013ca
2025-11-21T14:10:55.040032Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2156: session cookie 1 consumer shared/user session shared/user_7_1_3034911298628433174_v1 Process answer. Aval parts: 0
2025-11-21T14:10:55.040214Z :DEBUG: [] [] [13e92436-20538e01-57bcc6dd-bc92c1ad] [null] After sending read request: ReadSizeBudget = 2621440, ReadSizeServerDelta = 0
2025-11-21T14:10:55.040310Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_7_1_3034911298628433174_v1 grpc read done: success# 1, data# { read { } }
2025-11-21T14:10:55.040359Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1850: session cookie 1 consumer shared/user session shared/user_7_1_3034911298628433174_v1 got read request: guid# 91571aee-a64db9ed-9a2eb102-9aaa725b
2025-11-21T14:10:55.106904Z node 7 :PERSQUEUE DEBUG: partition.cpp:2313: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-21T14:10:55.106940Z node 7 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-21T14:10:55.106944Z node 7 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-21T14:10:55.106948Z node 7 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-21T14:10:55.106951Z node 7 :PERSQUEUE DEBUG: partition.cpp:2331: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-21T14:10:55.120676Z :INFO: [] MessageGroupId [source6] SessionId [source6|10974a83-e0461bef-750a9c72-b2f9e08f_0] Write session will now close
2025-11-21T14:10:55.120699Z :DEBUG: [] MessageGroupId [source6] SessionId [source6|10974a83-e0461bef-750a9c72-b2f9e08f_0] Write session: aborting
2025-11-21T14:10:55.120883Z :INFO: [] MessageGroupId [source6] SessionId [source6|10974a83-e0461bef-750a9c72-b2f9e08f_0] Write session: gracefully shut down, all writes complete
2025-11-21T14:10:55.120904Z :DEBUG: [] MessageGroupId [source6] SessionId [source6|10974a83-e0461bef-750a9c72-b2f9e08f_0] Write session: destroy
2025-11-21T14:10:55.121099Z :DEBUG: [] MessageGroupId [source7] SessionId [] Write session: try to update token
2025-11-21T14:10:55.121085Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 7 sessionId: source6|10974a83-e0461bef-750a9c72-b2f9e08f_0 grpc read done: success: 0 data: 
2025-11-21T14:10:55.121101Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 7 sessionId: source6|10974a83-e0461bef-750a9c72-b2f9e08f_0 grpc read failed
2025-11-21T14:10:55.121112Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 7 sessionId: source6|10974a83-e0461bef-750a9c72-b2f9e08f_0 grpc closed
2025-11-21T14:10:55.121130Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 7 sessionId: source6|10974a83-e0461bef-750a9c72-b2f9e08f_0 is DEAD
2025-11-21T14:10:55.121269Z :INFO: [] MessageGroupId [source7] SessionId [] Write session: Do CDS request
2025-11-21T14:10:55.121275Z :INFO: [] MessageGroupId [source7] SessionId [] Start write session. Will connect to endpoint: localhost:32602
2025-11-21T14:10:55.121452Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-11-21T14:10:55.121549Z :DEBUG: [] MessageGroupId [source7] SessionId [] Write session: send init request: init_request { topic: "topic1" message_group_id: "source7" }
2025-11-21T14:10:55.121611Z node 7 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-11-21T14:10:55.121626Z node 7 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 8
2025-11-21T14:10:55.121762Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 8 sessionId:  grpc read done: success: 1 data: init_request { topic: "topic1" message_group_id: "source7" }
2025-11-21T14:10:55.121792Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 8 topic: "topic1" message_group_id: "source7" from ipv6:[::1]:51498
2025-11-21T14:10:55.121804Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=8 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51498 proto=v1  topic=topic1 durationSec=0
2025-11-21T14:10:55.121809Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-11-21T14:10:55.121901Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [7:7575180946815949533:2480] destroyed
2025-11-21T14:10:55.121919Z node 7 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-11-21T14:10:55.121931Z node 7 :PERSQUEUE DEBUG: partition.cpp:2313: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-21T14:10:55.121939Z node 7 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-21T14:10:55.121942Z node 7 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-21T14:10:55.121944Z node 7 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-21T14:10:55.121947Z node 7 :PERSQUEUE DEBUG: partition.cpp:2331: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-21T14:10:55.122330Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 8 sessionId:  describe result for acl check
2025-11-21T14:10:55.122379Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-11-21T14:10:55.122381Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-11-21T14:10:55.122383Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-11-21T14:10:55.122388Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [7:7575180946815949547:2484] (SourceId=source7, PreferedPartition=(NULL)) StartKqpSession
2025-11-21T14:10:55.123422Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [7:7575180946815949547:2484] (SourceId=source7, PreferedPartition=(NULL)) Select from the table
2025-11-21T14:10:55.127114Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [7:7575180946815949547:2484] (SourceId=source7, PreferedPartition=(NULL)) RequestPQRB
2025-11-21T14:10:55.130629Z node 8 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1656: [72075186224037893][rt3.dc1--topic1] pipe [7:7575180946815949566:2484] connected; active server actors: 1
2025-11-21T14:10:55.131068Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [7:7575180946815949547:2484] (SourceId=source7, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=source7
2025-11-21T14:10:55.131086Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [7:7575180946815949547:2484] (SourceId=source7, PreferedPartition=(NULL)) Update the table
2025-11-21T14:10:55.131370Z node 8 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1660: [72075186224037893][rt3.dc1--topic1] pipe [7:7575180946815949566:2484] disconnected.
2025-11-21T14:10:55.131379Z node 8 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1671: [72075186224037893][rt3.dc1--topic1] pipe [7:7575180946815949566:2484] disconnected; active server actors: 1
2025-11-21T14:10:55.131385Z node 8 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1696: [72075186224037893][rt3.dc1--topic1] pipe [7:7575180946815949566:2484] disconnected no session
2025-11-21T14:10:55.139848Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [7:7575180946815949547:2484] (SourceId=source7, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-11-21T14:10:55.139865Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [7:7575180946815949547:2484] (SourceId=source7, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-11-21T14:10:55.139869Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [7:7575180946815949547:2484] (SourceId=source7, PreferedPartition=(NULL)) Start idle
2025-11-21T14:10:55.139880Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 8 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-11-21T14:10:55.142675Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 7, Generation: 1
2025-11-21T14:10:55.142696Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [7:7575180946815949583:2484], now have 1 active actors on pipe
2025-11-21T14:10:55.142767Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-21T14:10:55.142777Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-21T14:10:55.142808Z node 7 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie source7|fcd9b461-2c690dd2-2016e630-c815df11_0 generated for partition 0 topic 'rt3.dc1--topic1' owner source7
2025-11-21T14:10:55.142819Z node 7 :PERSQUEUE DEBUG: partition.cpp:2313: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-21T14:10:55.142823Z node 7 :PERSQUEUE DEBUG: partition.cpp:2407: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-21T14:10:55.142830Z node 7 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-21T14:10:55.142833Z node 7 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-21T14:10:55.142838Z node 7 :PERSQUEUE DEBUG: partition.cpp:2471: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-21T14:10:55.142849Z node 7 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-21T14:10:55.142852Z node 7 :PERSQUEUE DEBUG: partition.cpp:2326: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-21T14:10:55.142856Z node 7 :PERSQUEUE DEBUG: partition.cpp:2331: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-21T14:10:55.142873Z node 7 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-21T14:10:55.142891Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-21T14:10:55.143513Z :INFO: [] MessageGroupId [source7] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1763734255143 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-11-21T14:10:55.143550Z :INFO: [] MessageGroupId [source7] SessionId [] Write session established. Init response: session_id: "source7|fcd9b461-2c690dd2-2016e630-c815df11_0" topic: "topic1" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-11-21T14:10:55.143792Z :DEBUG: [] MessageGroupId [source7] SessionId [source7|fcd9b461-2c690dd2-2016e630-c815df11_0] Write 1 messages with Id from 1 to 1
2025-11-21T14:10:55.143830Z :INFO: [] MessageGroupId [source7] SessionId [source7|fcd9b461-2c690dd2-2016e630-c815df11_0] Write session: close. Timeout = 10000 ms
2025-11-21T14:10:55.143031Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-21T14:10:55.143037Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-21T14:10:55.143049Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-21T14:10:55.143083Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 8 partition: 0 MaxSeqNo: 0 sessionId: source7|fcd9b461-2c690dd2-2016e630-c815df11_0
2025-11-21T14:10:55.150176Z :DEBUG: [] MessageGroupId [source7] SessionId [source7|fcd9b461-2c690dd2-2016e630-c815df11_0] Write session: try to update token
2025-11-21T14:10:55.150197Z :DEBUG: [] MessageGroupId [source7] SessionId [source7|fcd9b461-2c690dd2-2016e630-c815df11_0] Send 1 message(s) (0 left), first sequence number is 1
2025-11-21T14:10:55.150972Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 8 sessionId: source7|fcd9b461-2c690dd2-2016e630-c815df11_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-21T14:10:55.151152Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-21T14:10:55.151287Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-21T14:10:55.151300Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-21T14:10:55.151335Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-11-21T14:10:55.151348Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-11-21T14:10:55.151449Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-21T14:10:55.151454Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-21T14:10:55.151474Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: '\0source7' SeqNo: 1 partNo : 0 messageNo: 1 size 1122 offset: -1
2025-11-21T14:10:55.151483Z node 7 :PERSQUEUE DEBUG: partition_write.cpp:634: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-21T14:10:55.151499Z node 7 :PERSQUEUE DEBUG: partition.cpp:2313: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-21T14:10:55.151502Z node 7 :PERSQUEUE DEBUG: partition.cpp:2407: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-21T14:10:55.151511Z node 7 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-21T14:10:55.151513Z node 7 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-21T14:10:55.151518Z node 7 :PERSQUEUE DEBUG: partition.cpp:2471: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-21T14:10:55.151546Z node 7 :PERSQUEUE DEBUG: partition_write.cpp:1326: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId '\0source7' seqNo 1 partNo 0
2025-11-21T14:10:55.151584Z node 7 :PERSQUEUE DEBUG: partition_write.cpp:1430: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '\0source7' seqNo 1 partNo 0 FormedBlobsCount 0 NewHead: Offset 7 PartNo 0 PackedSize 1197 count 1 nextOffset 8 batches 1
2025-11-21T14:10:55.151591Z node 7 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-21T14:10:55.151594Z node 7 :PERSQUEUE DEBUG: partition.cpp:2326: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-21T14:10:55.151598Z node 7 :PERSQUEUE DEBUG: partition.cpp:2331: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-21T14:10:55.151655Z node 7 :PERSQUEUE DEBUG: partition_write.cpp:1682: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 7,1 HeadOffset 7 endOffset 7 curOffset 8 d0000000000_00000000000000000007_00000_0000000001_00000? size 1185 WTime 1763734255151
2025-11-21T14:10:55.151680Z node 7 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-21T14:10:55.151693Z node 7 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 7 partNo 0 count 1 size 1185
2025-11-21T14:10:55.168002Z :DEBUG: [] MessageGroupId [source7] SessionId [source7|fcd9b461-2c690dd2-2016e630-c815df11_0] Write session got write response: sequence_numbers: 1 offsets: 7 already_written: false write_statistics { persist_duration_ms: 13 queued_in_partition_duration_ms: 3 }
2025-11-21T14:10:55.168017Z :DEBUG: [] MessageGroupId [source7] SessionId [source7|fcd9b461-2c690dd2-2016e630-c815df11_0] Write session: acknoledged message 1
2025-11-21T14:10:55.167353Z node 7 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 7 count 1 size 1185 actorID [7:7575180942520981761:2427]
2025-11-21T14:10:55.167387Z node 7 :PERSQUEUE DEBUG: partition.cpp:2137: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-21T14:10:55.167412Z node 7 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1130 WriteNewSizeFromSupportivePartitions# 0
2025-11-21T14:10:55.167411Z node 7 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 7 partno 0 count 1 parts 0 suffix '63' size 1185
2025-11-21T14:10:55.167428Z node 7 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-21T14:10:55.167440Z node 7 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0source7', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 1, partNo: 0, Offset: 7 is stored on disk
2025-11-21T14:10:55.167481Z node 7 :PERSQUEUE DEBUG: partition.cpp:2313: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-21T14:10:55.167485Z node 7 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-21T14:10:55.167487Z node 7 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-21T14:10:55.167490Z node 7 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-21T14:10:55.167492Z node 7 :PERSQUEUE DEBUG: partition.cpp:2331: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-21T14:10:55.167502Z node 7 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-21T14:10:55.167517Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 1  requestId: <none> cookie: 1
2025-11-21T14:10:55.167551Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 1 consumer shared/user session shared/user_7_1_3034911298628433174_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 7 EndOffset 7 newEndOffset 8 commitOffset 0 clientCommitOffset 0 cookie 8 readingFinished 0 firstRead 0
2025-11-21T14:10:55.167555Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_7_1_3034911298628433174_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 7 endOffset 8
2025-11-21T14:10:55.167571Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-11-21T14:10:55.167810Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_7_1_3034911298628433174_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 7, endOffset# 8, WTime# 1763734255027, sizeLag# 1185
2025-11-21T14:10:55.167813Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2354: session cookie 1 consumer shared/user session shared/user_7_1_3034911298628433174_v1TEvPartitionReady. Aval parts: 1
2025-11-21T14:10:55.167828Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2277: session cookie 1 consumer shared/user session shared/user_7_1_3034911298628433174_v1 performing read request: guid# 91571aee-a64db9ed-9a2eb102-9aaa725b, from# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), count# 1, size# 1422, partitionsAsked# 1, maxTimeLag# 0ms
2025-11-21T14:10:55.167843Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_7_1_3034911298628433174_v1 READ FROM TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1)maxCount 1 maxSize 1422 maxTimeLagMs 0 readTimestampMs 0 readOffset 7 EndOffset 8 ClientCommitOffset 0 committedOffset 0 Guid 91571aee-a64db9ed-9a2eb102-9aaa725b
2025-11-21T14:10:55.167917Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-21T14:10:55.167926Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-21T14:10:55.167961Z node 7 :PERSQUEUE DEBUG: partition_read.cpp:887: [72075186224037892][Partition][0][StateIdle] read cookie 11 Topic 'rt3.dc1--topic1' partition 0 user user offset 7 partno 0 count 1 size 1422 endOffset 8 max time lag 0ms effective offset 7
2025-11-21T14:10:55.167983Z node 7 :PERSQUEUE DEBUG: partition_read.cpp:1112: [72075186224037892][Partition][0][StateIdle] read cookie 11 added 1 blobs, size 1185 count 1 last offset 7, current partition end offset: 8
2025-11-21T14:10:55.167988Z node 7 :PERSQUEUE DEBUG: partition_read.cpp:1128: [72075186224037892][Partition][0][StateIdle] Reading cookie 11. Send blob request.
2025-11-21T14:10:55.168000Z node 7 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 7 partno 0 count 1 parts_count 0 source 1 size 1185 accessed 0 times before, last time 2025-11-21T14:10:55.000000Z
2025-11-21T14:10:55.168015Z node 7 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 11. All 1 blobs are from cache.
2025-11-21T14:10:55.168029Z node 7 :PERSQUEUE DEBUG: partition_read.cpp:576: FormAnswer for 1 blobs
2025-11-21T14:10:55.168043Z node 7 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 7 partno 0 count 1 parts 0 suffix '63'
2025-11-21T14:10:55.168044Z node 7 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 7 totakecount 1 count 1 size 1165 from pos 0 cbcount 1
2025-11-21T14:10:55.168067Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 7
2025-11-21T14:10:55.168142Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_7_1_3034911298628433174_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 8 Result { Offset: 7 Data: "... 1122 bytes ..." SourceId: "\000source7" SeqNo: 1 WriteTimestampMS: 1763734255147 CreateTimestampMS: 1763734255143 UncompressedSize: 1047552 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 20 RealReadOffset: 7 WaitQuotaTimeMs: 0 EndOffset: 8 StartOffset: 0 } Cookie: 7 }
2025-11-21T14:10:55.168168Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_7_1_3034911298628433174_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 9 from offset 8
2025-11-21T14:10:55.168177Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_7_1_3034911298628433174_v1 after read state TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 8 ReadOffset 8 ReadGuid 91571aee-a64db9ed-9a2eb102-9aaa725b has messages 1
2025-11-21T14:10:55.168201Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1951: session cookie 1 consumer shared/user session shared/user_7_1_3034911298628433174_v1 read done: guid# 91571aee-a64db9ed-9a2eb102-9aaa725b, partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), size# 1224
2025-11-21T14:10:55.168209Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2113: session cookie 1 consumer shared/user session shared/user_7_1_3034911298628433174_v1 response to read: guid# 91571aee-a64db9ed-9a2eb102-9aaa725b
2025-11-21T14:10:55.168315Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2156: session cookie 1 consumer shared/user session shared/user_7_1_3034911298628433174_v1 Process answer. Aval parts: 0
2025-11-21T14:10:55.168756Z :DEBUG: [] [] [13e92436-20538e01-57bcc6dd-bc92c1ad] [null] After sending read request: ReadSizeBudget = 2621440, ReadSizeServerDelta = 0
2025-11-21T14:10:55.168886Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_7_1_3034911298628433174_v1 grpc read done: success# 1, data# { read { } }
2025-11-21T14:10:55.168963Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1850: session cookie 1 consumer shared/user session shared/user_7_1_3034911298628433174_v1 got read request: guid# 245966d8-a3bdf49c-c0bbf8d9-f60d256a
2025-11-21T14:10:55.210556Z node 7 :PERSQUEUE DEBUG: partition.cpp:2313: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-21T14:10:55.210577Z node 7 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-21T14:10:55.210580Z node 7 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-21T14:10:55.210583Z node 7 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-21T14:10:55.210586Z node 7 :PERSQUEUE DEBUG: partition.cpp:2331: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-21T14:10:55.219555Z :INFO: [] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:topic1:0:1:7:0
2025-11-21T14:10:55.219581Z :INFO: [] [] [13e92436-20538e01-57bcc6dd-bc92c1ad] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1001 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 8400 BytesInflightTotal: 8400 MessagesInflight: 8 }
2025-11-21T14:10:55.246398Z :INFO: [] MessageGroupId [source7] SessionId [source7|fcd9b461-2c690dd2-2016e630-c815df11_0] Write session will now close
2025-11-21T14:10:55.246423Z :DEBUG: [] MessageGroupId [source7] SessionId [source7|fcd9b461-2c690dd2-2016e630-c815df11_0] Write session: aborting
2025-11-21T14:10:55.246670Z :INFO: [] MessageGroupId [source7] SessionId [source7|fcd9b461-2c690dd2-2016e630-c815df11_0] Write session: gracefully shut down, all writes complete
2025-11-21T14:10:55.246691Z :DEBUG: [] MessageGroupId [source7] SessionId [source7|fcd9b461-2c690dd2-2016e630-c815df11_0] Write session: destroy
2025-11-21T14:10:55.247611Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 8 sessionId: source7|fcd9b461-2c690dd2-2016e630-c815df11_0 grpc read done: success: 0 data: 
2025-11-21T14:10:55.247628Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 8 sessionId: source7|fcd9b461-2c690dd2-2016e630-c815df11_0 grpc read failed
2025-11-21T14:10:55.247639Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 8 sessionId: source7|fcd9b461-2c690dd2-2016e630-c815df11_0 grpc closed
2025-11-21T14:10:55.247648Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 8 sessionId: source7|fcd9b461-2c690dd2-2016e630-c815df11_0 is DEAD
2025-11-21T14:10:55.248005Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-11-21T14:10:55.248274Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [7:7575180946815949583:2484] destroyed
2025-11-21T14:10:55.248289Z node 7 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-11-21T14:10:55.248301Z node 7 :PERSQUEUE DEBUG: partition.cpp:2313: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-21T14:10:55.248304Z node 7 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-21T14:10:55.248306Z node 7 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-21T14:10:55.248309Z node 7 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-21T14:10:55.248311Z node 7 :PERSQUEUE DEBUG: partition.cpp:2331: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-21T14:10:55.254502Z :DEBUG: [] MessageGroupId [source8] SessionId [] Write session: try to update token
2025-11-21T14:10:55.254689Z :INFO: [] MessageGroupId [source8] SessionId [] Write session: Do CDS request
2025-11-21T14:10:55.254698Z :INFO: [] MessageGroupId [source8] SessionId [] Start write session. Will connect to endpoint: localhost:32602
2025-11-21T14:10:55.255138Z node 7 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-11-21T14:10:55.255152Z node 7 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 9
2025-11-21T14:10:55.255395Z :DEBUG: [] MessageGroupId [source8] SessionId [] Write session: send init request: init_request { topic: "topic1" message_group_id: "source8" }
2025-11-21T14:10:55.255729Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 9 sessionId:  grpc read done: success: 1 data: init_request { topic: "topic1" message_group_id: "source8" }
2025-11-21T14:10:55.255765Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 9 topic: "topic1" message_group_id: "source8" from ipv6:[::1]:51498
2025-11-21T14:10:55.255770Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=9 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51498 proto=v1  topic=topic1 durationSec=0
2025-11-21T14:10:55.255775Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-11-21T14:10:55.256315Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 9 sessionId:  describe result for acl check
2025-11-21T14:10:55.256345Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-11-21T14:10:55.256348Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-11-21T14:10:55.256350Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-11-21T14:10:55.256355Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [7:7575180946815949609:2494] (SourceId=source8, PreferedPartition=(NULL)) StartKqpSession
2025-11-21T14:10:55.257015Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [7:7575180946815949609:2494] (SourceId=source8, PreferedPartition=(NULL)) Select from the table
2025-11-21T14:10:55.259700Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [7:7575180946815949609:2494] (SourceId=source8, PreferedPartition=(NULL)) RequestPQRB
2025-11-21T14:10:55.260531Z node 8 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1656: [72075186224037893][rt3.dc1--topic1] pipe [7:7575180946815949631:2494] connected; active server actors: 1
2025-11-21T14:10:55.260930Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [7:7575180946815949609:2494] (SourceId=source8, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=source8
2025-11-21T14:10:55.260964Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [7:7575180946815949609:2494] (SourceId=source8, PreferedPartition=(NULL)) Update the table
2025-11-21T14:10:55.261484Z node 8 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1660: [72075186224037893][rt3.dc1--topic1] pipe [7:7575180946815949631:2494] disconnected.
2025-11-21T14:10:55.261497Z node 8 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1671: [72075186224037893][rt3.dc1--topic1] pipe [7:7575180946815949631:2494] disconnected; active server actors: 1
2025-11-21T14:10:55.261500Z node 8 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1696: [72075186224037893][rt3.dc1--topic1] pipe [7:7575180946815949631:2494] disconnected no session
2025-11-21T14:10:55.263997Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [7:7575180946815949609:2494] (SourceId=source8, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-11-21T14:10:55.264025Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [7:7575180946815949609:2494] (SourceId=source8, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-11-21T14:10:55.264029Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [7:7575180946815949609:2494] (SourceId=source8, PreferedPartition=(NULL)) Start idle
2025-11-21T14:10:55.264038Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 9 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-11-21T14:10:55.264245Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 7, Generation: 1
2025-11-21T14:10:55.264269Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [7:7575180946815949648:2494], now have 1 active actors on pipe
2025-11-21T14:10:55.264275Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-21T14:10:55.264284Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-21T14:10:55.264310Z node 7 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie source8|3d8fed37-7bd2afcf-64534519-4a68353d_0 generated for partition 0 topic 'rt3.dc1--topic1' owner source8
2025-11-21T14:10:55.264318Z node 7 :PERSQUEUE DEBUG: partition.cpp:2313: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-21T14:10:55.264321Z node 7 :PERSQUEUE DEBUG: partition.cpp:2407: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-21T14:10:55.264326Z node 7 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-21T14:10:55.264327Z node 7 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-21T14:10:55.264331Z node 7 :PERSQUEUE DEBUG: partition.cpp:2471: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-21T14:10:55.264339Z node 7 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-21T14:10:55.264341Z node 7 :PERSQUEUE DEBUG: partition.cpp:2326: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-21T14:10:55.264343Z node 7 :PERSQUEUE DEBUG: partition.cpp:2331: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-21T14:10:55.264357Z node 7 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-21T14:10:55.264373Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-21T14:10:55.264643Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-21T14:10:55.264648Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-21T14:10:55.264659Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-21T14:10:55.264690Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 9 partition: 0 MaxSeqNo: 0 sessionId: source8|3d8fed37-7bd2afcf-64534519-4a68353d_0
2025-11-21T14:10:55.265059Z :INFO: [] MessageGroupId [source8] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1763734255265 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-11-21T14:10:55.265095Z :INFO: [] MessageGroupId [source8] SessionId [] Write session established. Init response: session_id: "source8|3d8fed37-7bd2afcf-64534519-4a68353d_0" topic: "topic1" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-11-21T14:10:55.265429Z :DEBUG: [] MessageGroupId [source8] SessionId [source8|3d8fed37-7bd2afcf-64534519-4a68353d_0] Write 1 messages with Id from 1 to 1
2025-11-21T14:10:55.265476Z :INFO: [] MessageGroupId [source8] SessionId [source8|3d8fed37-7bd2afcf-64534519-4a68353d_0] Write session: close. Timeout = 10000 ms
2025-11-21T14:10:55.272734Z :DEBUG: [] MessageGroupId [source8] SessionId [source8|3d8fed37-7bd2afcf-64534519-4a68353d_0] Write session: try to update token
2025-11-21T14:10:55.272753Z :DEBUG: [] MessageGroupId [source8] SessionId [source8|3d8fed37-7bd2afcf-64534519-4a68353d_0] Send 1 message(s) (0 left), first sequence number is 1
2025-11-21T14:10:55.273112Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 9 sessionId: source8|3d8fed37-7bd2afcf-64534519-4a68353d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-21T14:10:55.273222Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-21T14:10:55.273359Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-21T14:10:55.273376Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-21T14:10:55.273426Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-11-21T14:10:55.273445Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-11-21T14:10:55.273487Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-21T14:10:55.273493Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-21T14:10:55.273513Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: '\0source8' SeqNo: 1 partNo : 0 messageNo: 1 size 1122 offset: -1
2025-11-21T14:10:55.273527Z node 7 :PERSQUEUE DEBUG: partition_write.cpp:634: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-21T14:10:55.273545Z node 7 :PERSQUEUE DEBUG: partition.cpp:2313: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-21T14:10:55.273554Z node 7 :PERSQUEUE DEBUG: partition.cpp:2407: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-21T14:10:55.273566Z node 7 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-21T14:10:55.273575Z node 7 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-21T14:10:55.273580Z node 7 :PERSQUEUE DEBUG: partition.cpp:2471: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-21T14:10:55.273613Z node 7 :PERSQUEUE DEBUG: partition_write.cpp:1326: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId '\0source8' seqNo 1 partNo 0
2025-11-21T14:10:55.273667Z node 7 :PERSQUEUE DEBUG: partition_write.cpp:1430: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '\0source8' seqNo 1 partNo 0 FormedBlobsCount 0 NewHead: Offset 8 PartNo 0 PackedSize 1197 count 1 nextOffset 9 batches 1
2025-11-21T14:10:55.273679Z node 7 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-21T14:10:55.273682Z node 7 :PERSQUEUE DEBUG: partition.cpp:2326: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-21T14:10:55.273685Z node 7 :PERSQUEUE DEBUG: partition.cpp:2331: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-21T14:10:55.273741Z node 7 :PERSQUEUE DEBUG: partition_write.cpp:1682: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 8,1 HeadOffset 8 endOffset 8 curOffset 9 d0000000000_00000000000000000008_00000_0000000001_00000? size 1185 WTime 1763734255270
2025-11-21T14:10:55.273773Z node 7 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-21T14:10:55.273794Z node 7 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 8 partNo 0 count 1 size 1185
2025-11-21T14:10:55.288640Z node 7 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 8 count 1 size 1185 actorID [7:7575180942520981761:2427]
2025-11-21T14:10:55.288679Z node 7 :PERSQUEUE DEBUG: partition.cpp:2137: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-21T14:10:55.288709Z node 7 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1130 WriteNewSizeFromSupportivePartitions# 0
2025-11-21T14:10:55.288722Z node 7 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-21T14:10:55.288739Z node 7 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0source8', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 1, partNo: 0, Offset: 8 is stored on disk
2025-11-21T14:10:55.288788Z node 7 :PERSQUEUE DEBUG: partition.cpp:2313: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-21T14:10:55.288791Z node 7 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-21T14:10:55.288793Z node 7 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-21T14:10:55.288797Z node 7 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-21T14:10:55.288799Z node 7 :PERSQUEUE DEBUG: partition.cpp:2331: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-21T14:10:55.288812Z node 7 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-21T14:10:55.288826Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 1  requestId: <none> cookie: 1
2025-11-21T14:10:55.288836Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 1 consumer shared/user session shared/user_7_1_3034911298628433174_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 8 EndOffset 8 newEndOffset 9 commitOffset 0 clientCommitOffset 0 cookie 9 readingFinished 0 firstRead 0
2025-11-21T14:10:55.288845Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_7_1_3034911298628433174_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 8 endOffset 9
2025-11-21T14:10:55.288848Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-11-21T14:10:55.288869Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_7_1_3034911298628433174_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 8, endOffset# 9, WTime# 1763734255147, sizeLag# 1185
2025-11-21T14:10:55.288873Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2354: session cookie 1 consumer shared/user session shared/user_7_1_3034911298628433174_v1TEvPartitionReady. Aval parts: 1
2025-11-21T14:10:55.288896Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2277: session cookie 1 consumer shared/user session shared/user_7_1_3034911298628433174_v1 performing read request: guid# 245966d8-a3bdf49c-c0bbf8d9-f60d256a, from# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), count# 1, size# 1422, partitionsAsked# 1, maxTimeLag# 0ms
2025-11-21T14:10:55.288911Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_7_1_3034911298628433174_v1 READ FROM TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1)maxCount 1 maxSize 1422 maxTimeLagMs 0 readTimestampMs 0 readOffset 8 EndOffset 9 ClientCommitOffset 0 committedOffset 0 Guid 245966d8-a3bdf49c-c0bbf8d9-f60d256a
2025-11-21T14:10:55.288986Z node 7 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 8 partno 0 count 1 parts 0 suffix '63' size 1185
2025-11-21T14:10:55.289038Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-21T14:10:55.289047Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-21T14:10:55.289100Z node 7 :PERSQUEUE DEBUG: partition_read.cpp:887: [72075186224037892][Partition][0][StateIdle] read cookie 12 Topic 'rt3.dc1--topic1' partition 0 user user offset 8 partno 0 count 1 size 1422 endOffset 9 max time lag 0ms effective offset 8
2025-11-21T14:10:55.289142Z node 7 :PERSQUEUE DEBUG: partition_read.cpp:1112: [72075186224037892][Partition][0][StateIdle] read cookie 12 added 1 blobs, size 1185 count 1 last offset 8, current partition end offset: 9
2025-11-21T14:10:55.289148Z node 7 :PERSQUEUE DEBUG: partition_read.cpp:1128: [72075186224037892][Partition][0][StateIdle] Reading cookie 12. Send blob request.
2025-11-21T14:10:55.289165Z node 7 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 8 partno 0 count 1 parts_count 0 source 1 size 1185 accessed 0 times before, last time 2025-11-21T14:10:55.000000Z
2025-11-21T14:10:55.289175Z node 7 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 12. All 1 blobs are from cache.
2025-11-21T14:10:55.289186Z node 7 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 8 partno 0 count 1 parts 0 suffix '63'
2025-11-21T14:10:55.289192Z node 7 :PERSQUEUE DEBUG: partition_read.cpp:576: FormAnswer for 1 blobs
2025-11-21T14:10:55.289210Z node 7 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 8 totakecount 1 count 1 size 1165 from pos 0 cbcount 1
2025-11-21T14:10:55.289246Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 8
2025-11-21T14:10:55.289338Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_7_1_3034911298628433174_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 9 Result { Offset: 8 Data: "... 1122 bytes ..." SourceId: "\000source8" SeqNo: 1 WriteTimestampMS: 1763734255270 CreateTimestampMS: 1763734255265 UncompressedSize: 1047552 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 20 RealReadOffset: 8 WaitQuotaTimeMs: 0 EndOffset: 9 StartOffset: 0 } Cookie: 8 }
2025-11-21T14:10:55.289375Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_7_1_3034911298628433174_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 10 from offset 9
2025-11-21T14:10:55.289385Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_7_1_3034911298628433174_v1 after read state TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 9 ReadOffset 9 ReadGuid 245966d8-a3bdf49c-c0bbf8d9-f60d256a has messages 1
2025-11-21T14:10:55.289403Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1951: session cookie 1 consumer shared/user session shared/user_7_1_3034911298628433174_v1 read done: guid# 245966d8-a3bdf49c-c0bbf8d9-f60d256a, partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), size# 1224
2025-11-21T14:10:55.289411Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2113: session cookie 1 consumer shared/user session shared/user_7_1_3034911298628433174_v1 response to read: guid# 245966d8-a3bdf49c-c0bbf8d9-f60d256a
2025-11-21T14:10:55.289521Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2156: session cookie 1 consumer shared/user session shared/user_7_1_3034911298628433174_v1 Process answer. Aval parts: 0
2025-11-21T14:10:55.290486Z :DEBUG: [] MessageGroupId [source8] SessionId [source8|3d8fed37-7bd2afcf-64534519-4a68353d_0] Write session got write response: sequence_numbers: 1 offsets: 8 already_written: false write_statistics { persist_duration_ms: 18 }
2025-11-21T14:10:55.290500Z :DEBUG: [] MessageGroupId [source8] SessionId [source8|3d8fed37-7bd2afcf-64534519-4a68353d_0] Write session: acknoledged message 1
2025-11-21T14:10:55.290664Z :DEBUG: [] [] [13e92436-20538e01-57bcc6dd-bc92c1ad] [null] After sending read request: ReadSizeBudget = 2621440, ReadSizeServerDelta = 0
2025-11-21T14:10:55.291646Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_7_1_3034911298628433174_v1 grpc read done: success# 1, data# { read { } }
2025-11-21T14:10:55.291756Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1850: session cookie 1 consumer shared/user session shared/user_7_1_3034911298628433174_v1 got read request: guid# 4561a93-29f5678d-1a3aadc4-b9eb748
2025-11-21T14:10:55.310883Z node 7 :PERSQUEUE DEBUG: partition.cpp:2313: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-21T14:10:55.310899Z node 7 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-21T14:10:55.310902Z node 7 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-21T14:10:55.310907Z node 7 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-21T14:10:55.310910Z node 7 :PERSQUEUE DEBUG: partition.cpp:2331: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-21T14:10:55.365710Z :INFO: [] MessageGroupId [source8] SessionId [source8|3d8fed37-7bd2afcf-64534519-4a68353d_0] Write session will now close
2025-11-21T14:10:55.365734Z :DEBUG: [] MessageGroupId [source8] SessionId [source8|3d8fed37-7bd2afcf-64534519-4a68353d_0] Write session: aborting
2025-11-21T14:10:55.365930Z :INFO: [] MessageGroupId [source8] SessionId [source8|3d8fed37-7bd2afcf-64534519-4a68353d_0] Write session: gracefully shut down, all writes complete
2025-11-21T14:10:55.365954Z :DEBUG: [] MessageGroupId [source8] SessionId [source8|3d8fed37-7bd2afcf-64534519-4a68353d_0] Write session: destroy
2025-11-21T14:10:55.366742Z :DEBUG: [] MessageGroupId [source9] SessionId [] Write session: try to update token
2025-11-21T14:10:55.366930Z :INFO: [] MessageGroupId [source9] SessionId [] Write session: Do CDS request
2025-11-21T14:10:55.366937Z :INFO: [] MessageGroupId [source9] SessionId [] Start write session. Will connect to endpoint: localhost:32602
2025-11-21T14:10:55.366577Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 9 sessionId: source8|3d8fed37-7bd2afcf-64534519-4a68353d_0 grpc read done: success: 0 data: 
2025-11-21T14:10:55.366594Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 9 sessionId: source8|3d8fed37-7bd2afcf-64534519-4a68353d_0 grpc read failed
2025-11-21T14:10:55.366604Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 9 sessionId: source8|3d8fed37-7bd2afcf-64534519-4a68353d_0 grpc closed
2025-11-21T14:10:55.366622Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 9 sessionId: source8|3d8fed37-7bd2afcf-64534519-4a68353d_0 is DEAD
2025-11-21T14:10:55.366870Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-11-21T14:10:55.367537Z node 7 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-11-21T14:10:55.367547Z node 7 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 10
2025-11-21T14:10:55.369082Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [7:7575180946815949648:2494] destroyed
2025-11-21T14:10:55.369111Z node 7 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-11-21T14:10:55.369123Z node 7 :PERSQUEUE DEBUG: partition.cpp:2313: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-21T14:10:55.369131Z node 7 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-21T14:10:55.369134Z node 7 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-21T14:10:55.369137Z node 7 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-21T14:10:55.369140Z node 7 :PERSQUEUE DEBUG: partition.cpp:2331: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-21T14:10:55.370470Z :DEBUG: [] MessageGroupId [source9] SessionId [] Write session: send init request: init_request { topic: "topic1" message_group_id: "source9" }
2025-11-21T14:10:55.370812Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 10 sessionId:  grpc read done: success: 1 data: init_request { topic: "topic1" message_group_id: "source9" }
2025-11-21T14:10:55.370856Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 10 topic: "topic1" message_group_id: "source9" from ipv6:[::1]:51498
2025-11-21T14:10:55.370861Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=10 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51498 proto=v1  topic=topic1 durationSec=0
2025-11-21T14:10:55.370867Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-11-21T14:10:55.371453Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 10 sessionId:  describe result for acl check
2025-11-21T14:10:55.371487Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-11-21T14:10:55.371490Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-11-21T14:10:55.371493Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-11-21T14:10:55.371499Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [7:7575180946815949659:2498] (SourceId=source9, PreferedPartition=(NULL)) StartKqpSession
2025-11-21T14:10:55.372148Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [7:7575180946815949659:2498] (SourceId=source9, PreferedPartition=(NULL)) Select from the table
2025-11-21T14:10:55.375057Z node 8 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1656: [72075186224037893][rt3.dc1--topic1] pipe [7:7575180946815949675:2498] connected; active server actors: 1
2025-11-21T14:10:55.375844Z node 8 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1660: [72075186224037893][rt3.dc1--topic1] pipe [7:7575180946815949675:2498] disconnected.
2025-11-21T14:10:55.375855Z node 8 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1671: [72075186224037893][rt3.dc1--topic1] pipe [7:7575180946815949675:2498] disconnected; active server actors: 1
2025-11-21T14:10:55.375858Z node 8 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1696: [72075186224037893][rt3.dc1--topic1] pipe [7:7575180946815949675:2498] disconnected no session
2025-11-21T14:10:55.374549Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [7:7575180946815949659:2498] (SourceId=source9, PreferedPartition=(NULL)) RequestPQRB
2025-11-21T14:10:55.375412Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [7:7575180946815949659:2498] (SourceId=source9, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=source9
2025-11-21T14:10:55.375416Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [7:7575180946815949659:2498] (SourceId=source9, PreferedPartition=(NULL)) Update the table
2025-11-21T14:10:55.379890Z :INFO: [] MessageGroupId [source9] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1763734255379 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-11-21T14:10:55.379932Z :INFO: [] MessageGroupId [source9] SessionId [] Write session established. Init response: session_id: "source9|35c32606-a4240f6a-a0859a67-e85ea6d3_0" topic: "topic1" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-11-21T14:10:55.380201Z :DEBUG: [] MessageGroupId [source9] SessionId [source9|35c32606-a4240f6a-a0859a67-e85ea6d3_0] Write 1 messages with Id from 1 to 1
2025-11-21T14:10:55.380243Z :INFO: [] MessageGroupId [source9] SessionId [source9|35c32606-a4240f6a-a0859a67-e85ea6d3_0] Write session: close. Timeout = 10000 ms
2025-11-21T14:10:55.379118Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [7:7575180946815949659:2498] (SourceId=source9, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-11-21T14:10:55.379133Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [7:7575180946815949659:2498] (SourceId=source9, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-11-21T14:10:55.379140Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [7:7575180946815949659:2498] (SourceId=source9, PreferedPartition=(NULL)) Start idle
2025-11-21T14:10:55.379149Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 10 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-11-21T14:10:55.379327Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 7, Generation: 1
2025-11-21T14:10:55.379341Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [7:7575180946815949691:2498], now have 1 active actors on pipe
2025-11-21T14:10:55.379349Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-21T14:10:55.379356Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-21T14:10:55.379388Z node 7 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie source9|35c32606-a4240f6a-a0859a67-e85ea6d3_0 generated for partition 0 topic 'rt3.dc1--topic1' owner source9
2025-11-21T14:10:55.379400Z node 7 :PERSQUEUE DEBUG: partition.cpp:2313: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-21T14:10:55.379404Z node 7 :PERSQUEUE DEBUG: partition.cpp:2407: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-21T14:10:55.379410Z node 7 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-21T14:10:55.379412Z node 7 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-21T14:10:55.379416Z node 7 :PERSQUEUE DEBUG: partition.cpp:2471: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-21T14:10:55.379426Z node 7 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-21T14:10:55.379429Z node 7 :PERSQUEUE DEBUG: partition.cpp:2326: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-21T14:10:55.379432Z node 7 :PERSQUEUE DEBUG: partition.cpp:2331: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-21T14:10:55.379451Z node 7 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-21T14:10:55.379465Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-21T14:10:55.379502Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-21T14:10:55.379506Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-21T14:10:55.379517Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-21T14:10:55.379544Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 10 partition: 0 MaxSeqNo: 0 sessionId: source9|35c32606-a4240f6a-a0859a67-e85ea6d3_0
2025-11-21T14:10:55.390924Z :DEBUG: [] MessageGroupId [source9] SessionId [source9|35c32606-a4240f6a-a0859a67-e85ea6d3_0] Write session: try to update token
2025-11-21T14:10:55.390948Z :DEBUG: [] MessageGroupId [source9] SessionId [source9|35c32606-a4240f6a-a0859a67-e85ea6d3_0] Send 1 message(s) (0 left), first sequence number is 1
2025-11-21T14:10:55.391306Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 10 sessionId: source9|35c32606-a4240f6a-a0859a67-e85ea6d3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-21T14:10:55.391459Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-21T14:10:55.391852Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-21T14:10:55.391864Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-21T14:10:55.391907Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-11-21T14:10:55.391931Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-11-21T14:10:55.392041Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-21T14:10:55.392049Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-21T14:10:55.392073Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: '\0source9' SeqNo: 1 partNo : 0 messageNo: 1 size 1122 offset: -1
2025-11-21T14:10:55.392085Z node 7 :PERSQUEUE DEBUG: partition_write.cpp:634: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-21T14:10:55.392102Z node 7 :PERSQUEUE DEBUG: partition.cpp:2313: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-21T14:10:55.392105Z node 7 :PERSQUEUE DEBUG: partition.cpp:2407: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-21T14:10:55.392116Z node 7 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-21T14:10:55.392119Z node 7 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-21T14:10:55.392127Z node 7 :PERSQUEUE DEBUG: partition.cpp:2471: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-21T14:10:55.392162Z node 7 :PERSQUEUE DEBUG: partition_write.cpp:1326: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId '\0source9' seqNo 1 partNo 0
2025-11-21T14:10:55.392219Z node 7 :PERSQUEUE DEBUG: partition_write.cpp:1430: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '\0source9' seqNo 1 partNo 0 FormedBlobsCount 0 NewHead: Offset 9 PartNo 0 PackedSize 1197 count 1 nextOffset 10 batches 1
2025-11-21T14:10:55.392227Z node 7 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-21T14:10:55.392229Z node 7 :PERSQUEUE DEBUG: partition.cpp:2326: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-21T14:10:55.392232Z node 7 :PERSQUEUE DEBUG: partition.cpp:2331: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-21T14:10:55.392287Z node 7 :PERSQUEUE DEBUG: partition_write.cpp:1682: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 9,1 HeadOffset 9 endOffset 9 curOffset 10 d0000000000_00000000000000000009_00000_0000000001_00000? size 1185 WTime 1763734255392
2025-11-21T14:10:55.392313Z node 7 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-21T14:10:55.392325Z node 7 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 9 partNo 0 count 1 size 1185
2025-11-21T14:10:55.396700Z :DEBUG: [] MessageGroupId [source9] SessionId [source9|35c32606-a4240f6a-a0859a67-e85ea6d3_0] Write session got write response: sequence_numbers: 1 offsets: 9 already_written: false write_statistics { persist_duration_ms: 2 queued_in_partition_duration_ms: 1 }
2025-11-21T14:10:55.396720Z :DEBUG: [] MessageGroupId [source9] SessionId [source9|35c32606-a4240f6a-a0859a67-e85ea6d3_0] Write session: acknoledged message 1
2025-11-21T14:10:55.395872Z node 7 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 9 count 1 size 1185 actorID [7:7575180942520981761:2427]
2025-11-21T14:10:55.395906Z node 7 :PERSQUEUE DEBUG: partition.cpp:2137: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-21T14:10:55.395933Z node 7 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1130 WriteNewSizeFromSupportivePartitions# 0
2025-11-21T14:10:55.395944Z node 7 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-21T14:10:55.395957Z node 7 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0source9', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 1, partNo: 0, Offset: 9 is stored on disk
2025-11-21T14:10:55.396004Z node 7 :PERSQUEUE DEBUG: partition.cpp:2313: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-21T14:10:55.396008Z node 7 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-21T14:10:55.396010Z node 7 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-21T14:10:55.396014Z node 7 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-21T14:10:55.396016Z node 7 :PERSQUEUE DEBUG: partition.cpp:2331: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-21T14:10:55.396026Z node 7 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-21T14:10:55.396041Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 1  requestId: <none> cookie: 1
2025-11-21T14:10:55.396070Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 1 consumer shared/user session shared/user_7_1_3034911298628433174_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 9 EndOffset 9 newEndOffset 10 commitOffset 0 clientCommitOffset 0 cookie 10 readingFinished 0 firstRead 0
2025-11-21T14:10:55.396074Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_7_1_3034911298628433174_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 9 endOffset 10
2025-11-21T14:10:55.396092Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-11-21T14:10:55.396120Z node 7 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 9 partno 0 count 1 parts 0 suffix '63' size 1185
2025-11-21T14:10:55.396341Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_7_1_3034911298628433174_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 9, endOffset# 10, WTime# 1763734255270, sizeLag# 1185
2025-11-21T14:10:55.396344Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2354: session cookie 1 consumer shared/user session shared/user_7_1_3034911298628433174_v1TEvPartitionReady. Aval parts: 1
2025-11-21T14:10:55.396360Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2277: session cookie 1 consumer shared/user session shared/user_7_1_3034911298628433174_v1 performing read request: guid# 4561a93-29f5678d-1a3aadc4-b9eb748, from# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), count# 1, size# 1422, partitionsAsked# 1, maxTimeLag# 0ms
2025-11-21T14:10:55.396374Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_7_1_3034911298628433174_v1 READ FROM TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1)maxCount 1 maxSize 1422 maxTimeLagMs 0 readTimestampMs 0 readOffset 9 EndOffset 10 ClientCommitOffset 0 committedOffset 0 Guid 4561a93-29f5678d-1a3aadc4-b9eb748
2025-11-21T14:10:55.396904Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-21T14:10:55.396913Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-21T14:10:55.396953Z node 7 :PERSQUEUE DEBUG: partition_read.cpp:887: [72075186224037892][Partition][0][StateIdle] read cookie 13 Topic 'rt3.dc1--topic1' partition 0 user user offset 9 partno 0 count 1 size 1422 endOffset 10 max time lag 0ms effective offset 9
2025-11-21T14:10:55.396975Z node 7 :PERSQUEUE DEBUG: partition_read.cpp:1112: [72075186224037892][Partition][0][StateIdle] read cookie 13 added 1 blobs, size 1185 count 1 last offset 9, current partition end offset: 10
2025-11-21T14:10:55.396989Z node 7 :PERSQUEUE DEBUG: partition_read.cpp:1128: [72075186224037892][Partition][0][StateIdle] Reading cookie 13. Send blob request.
2025-11-21T14:10:55.397000Z node 7 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 9 partno 0 count 1 parts_count 0 source 1 size 1185 accessed 0 times before, last time 2025-11-21T14:10:55.000000Z
2025-11-21T14:10:55.397008Z node 7 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 13. All 1 blobs are from cache.
2025-11-21T14:10:55.397023Z node 7 :PERSQUEUE DEBUG: partition_read.cpp:576: FormAnswer for 1 blobs
2025-11-21T14:10:55.397040Z node 7 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 9 totakecount 1 count 1 size 1165 from pos 0 cbcount 1
2025-11-21T14:10:55.397064Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 9
2025-11-21T14:10:55.397538Z :DEBUG: [] [] [13e92436-20538e01-57bcc6dd-bc92c1ad] [null] After sending read request: ReadSizeBudget = 2621440, ReadSizeServerDelta = 0
2025-11-21T14:10:55.397142Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_7_1_3034911298628433174_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 10 Result { Offset: 9 Data: "... 1122 bytes ..." SourceId: "\000source9" SeqNo: 1 WriteTimestampMS: 1763734255392 CreateTimestampMS: 1763734255380 UncompressedSize: 1047552 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 20 RealReadOffset: 9 WaitQuotaTimeMs: 0 EndOffset: 10 StartOffset: 0 } Cookie: 9 }
2025-11-21T14:10:55.397175Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_7_1_3034911298628433174_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 11 from offset 10
2025-11-21T14:10:55.397184Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_7_1_3034911298628433174_v1 after read state TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 10 ReadOffset 10 ReadGuid 4561a93-29f5678d-1a3aadc4-b9eb748 has messages 1
2025-11-21T14:10:55.397201Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1951: session cookie 1 consumer shared/user session shared/user_7_1_3034911298628433174_v1 read done: guid# 4561a93-29f5678d-1a3aadc4-b9eb748, partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), size# 1224
2025-11-21T14:10:55.397209Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2113: session cookie 1 consumer shared/user session shared/user_7_1_3034911298628433174_v1 response to read: guid# 4561a93-29f5678d-1a3aadc4-b9eb748
2025-11-21T14:10:55.397292Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2156: session cookie 1 consumer shared/user session shared/user_7_1_3034911298628433174_v1 Process answer. Aval parts: 0
2025-11-21T14:10:55.397628Z node 7 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 9 partno 0 count 1 parts 0 suffix '63'
2025-11-21T14:10:55.397735Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_7_1_3034911298628433174_v1 grpc read done: success# 1, data# { read { } }
2025-11-21T14:10:55.397771Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1850: session cookie 1 consumer shared/user session shared/user_7_1_3034911298628433174_v1 got read request: guid# f4546b74-78b2f5e-33999fbf-85f200b4
2025-11-21T14:10:55.411046Z node 7 :PERSQUEUE DEBUG: partition.cpp:2313: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-21T14:10:55.411065Z node 7 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-21T14:10:55.411068Z node 7 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-21T14:10:55.411073Z node 7 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-21T14:10:55.411076Z node 7 :PERSQUEUE DEBUG: partition.cpp:2331: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-21T14:10:55.480306Z :INFO: [] MessageGroupId [source9] SessionId [source9|35c32606-a4240f6a-a0859a67-e85ea6d3_0] Write session will now close
2025-11-21T14:10:55.480328Z :DEBUG: [] MessageGroupId [source9] SessionId [source9|35c32606-a4240f6a-a0859a67-e85ea6d3_0] Write session: aborting
2025-11-21T14:10:55.480485Z :INFO: [] MessageGroupId [source9] SessionId [source9|35c32606-a4240f6a-a0859a67-e85ea6d3_0] Write session: gracefully shut down, all writes complete
2025-11-21T14:10:55.480506Z :DEBUG: [] MessageGroupId [source9] SessionId [source9|35c32606-a4240f6a-a0859a67-e85ea6d3_0] Write session: destroy
2025-11-21T14:10:55.482694Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 10 sessionId: source9|35c32606-a4240f6a-a0859a67-e85ea6d3_0 grpc read done: success: 0 data: 
2025-11-21T14:10:55.482713Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 10 sessionId: source9|35c32606-a4240f6a-a0859a67-e85ea6d3_0 grpc read failed
2025-11-21T14:10:55.482724Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 10 sessionId: source9|35c32606-a4240f6a-a0859a67-e85ea6d3_0 grpc closed
2025-11-21T14:10:55.482732Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 10 sessionId: source9|35c32606-a4240f6a-a0859a67-e85ea6d3_0 is DEAD
2025-11-21T14:10:55.483000Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-11-21T14:10:55.483518Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [7:7575180946815949691:2498] destroyed
2025-11-21T14:10:55.483539Z node 7 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-11-21T14:10:55.483553Z node 7 :PERSQUEUE DEBUG: partition.cpp:2313: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-21T14:10:55.483557Z node 7 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-21T14:10:55.483559Z node 7 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-21T14:10:55.483562Z node 7 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-21T14:10:55.483564Z node 7 :PERSQUEUE DEBUG: partition.cpp:2331: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-21T14:10:55.487359Z :DEBUG: [] Decompression task done. Partition/PartitionSessionId: 0 (1-1)
2025-11-21T14:10:55.488789Z :DEBUG: [] Decompression task done. Partition/PartitionSessionId: 0 (0-0)
2025-11-21T14:10:55.490717Z :DEBUG: [] Decompression task done. Partition/PartitionSessionId: 0 (2-2)
2025-11-21T14:10:55.511382Z node 7 :PERSQUEUE DEBUG: partition.cpp:2313: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-21T14:10:55.511402Z node 7 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-21T14:10:55.511405Z node 7 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-21T14:10:55.511409Z node 7 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-21T14:10:55.511412Z node 7 :PERSQUEUE DEBUG: partition.cpp:2331: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-21T14:10:55.611766Z node 7 :PERSQUEUE DEBUG: partition.cpp:2313: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-21T14:10:55.611788Z node 7 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-21T14:10:55.611791Z node 7 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-21T14:10:55.611796Z node 7 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-21T14:10:55.611799Z node 7 :PERSQUEUE DEBUG: partition.cpp:2331: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-21T14:10:55.712450Z node 7 :PERSQUEUE DEBUG: partition.cpp:2313: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-21T14:10:55.712471Z node 7 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-21T14:10:55.712473Z node 7 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-21T14:10:55.712476Z node 7 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-21T14:10:55.712478Z node 7 :PERSQUEUE DEBUG: partition.cpp:2331: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-21T14:10:55.812433Z node 7 :PERSQUEUE DEBUG: partition.cpp:2313: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-21T14:10:55.812451Z node 7 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-21T14:10:55.812454Z node 7 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-21T14:10:55.812460Z node 7 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-21T14:10:55.812463Z node 7 :PERSQUEUE DEBUG: partition.cpp:2331: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-21T14:10:55.918424Z node 7 :PERSQUEUE DEBUG: partition.cpp:2313: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-21T14:10:55.918446Z node 7 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-21T14:10:55.918449Z node 7 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-21T14:10:55.918454Z node 7 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-21T14:10:55.918458Z node 7 :PERSQUEUE DEBUG: partition.cpp:2331: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-21T14:10:56.014683Z node 7 :PERSQUEUE DEBUG: partition.cpp:2313: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-21T14:10:56.014706Z node 7 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-21T14:10:56.014713Z node 7 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-21T14:10:56.014717Z node 7 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-21T14:10:56.014721Z node 7 :PERSQUEUE DEBUG: partition.cpp:2331: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-21T14:10:56.114974Z node 7 :PERSQUEUE DEBUG: partition.cpp:2313: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-21T14:10:56.114991Z node 7 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-21T14:10:56.114994Z node 7 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-21T14:10:56.114997Z node 7 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-21T14:10:56.115000Z node 7 :PERSQUEUE DEBUG: partition.cpp:2331: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-21T14:10:56.218558Z node 7 :PERSQUEUE DEBUG: partition.cpp:2313: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-21T14:10:56.218575Z node 7 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-21T14:10:56.218577Z node 7 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-21T14:10:56.218580Z node 7 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-21T14:10:56.218582Z node 7 :PERSQUEUE DEBUG: partition.cpp:2331: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-21T14:10:56.322489Z node 7 :PERSQUEUE DEBUG: partition.cpp:2313: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-21T14:10:56.322505Z node 7 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-21T14:10:56.322508Z node 7 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-21T14:10:56.322512Z node 7 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-21T14:10:56.322515Z node 7 :PERSQUEUE DEBUG: partition.cpp:2331: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-21T14:10:56.426478Z node 7 :PERSQUEUE DEBUG: partition.cpp:2313: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-21T14:10:56.426507Z node 7 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-21T14:10:56.426511Z node 7 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-21T14:10:56.426516Z node 7 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-21T14:10:56.426520Z node 7 :PERSQUEUE DEBUG: partition.cpp:2331: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-21T14:10:56.482616Z :INFO: [] [] [13e92436-20538e01-57bcc6dd-bc92c1ad] Closing read session. Close timeout: 0.000000s
2025-11-21T14:10:56.482648Z :INFO: [] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:topic1:0:1:9:0
2025-11-21T14:10:56.482658Z :INFO: [] [] [13e92436-20538e01-57bcc6dd-bc92c1ad] Counters: { Errors: 0 CurrentSessionLifetimeMs: 2264 BytesRead: 3142656 MessagesRead: 3 BytesReadCompressed: 3150 BytesInflightUncompressed: 3142656 BytesInflightCompressed: 7350 BytesInflightTotal: 3150006 MessagesInflight: 10 }
2025-11-21T14:10:56.482675Z :NOTICE: [] [] [13e92436-20538e01-57bcc6dd-bc92c1ad] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Close with zero timeout " }
2025-11-21T14:10:56.482769Z :DEBUG: [] [] [13e92436-20538e01-57bcc6dd-bc92c1ad] [null] Abort session to cluster
2025-11-21T14:10:56.482945Z :NOTICE: [] [] [13e92436-20538e01-57bcc6dd-bc92c1ad] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
2025-11-21T14:10:56.486539Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_7_1_3034911298628433174_v1 grpc read done: success# 0, data# {  }
2025-11-21T14:10:56.486556Z node 7 :PQ_READ_PROXY INFO: read_session_actor.cpp:125: session cookie 1 consumer shared/user session shared/user_7_1_3034911298628433174_v1 grpc read failed
2025-11-21T14:10:56.486564Z node 7 :PQ_READ_PROXY INFO: read_session_actor.cpp:92: session cookie 1 consumer shared/user session shared/user_7_1_3034911298628433174_v1 grpc closed
2025-11-21T14:10:56.486584Z node 7 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 1 consumer shared/user session shared/user_7_1_3034911298628433174_v1 is DEAD
2025-11-21T14:10:56.490745Z node 8 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1660: [72075186224037893][rt3.dc1--topic1] pipe [7:7575180942520981889:2443] disconnected.
2025-11-21T14:10:56.490766Z node 8 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1671: [72075186224037893][rt3.dc1--topic1] pipe [7:7575180942520981889:2443] disconnected; active server actors: 1
2025-11-21T14:10:56.490772Z node 8 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1680: [72075186224037893][rt3.dc1--topic1] pipe [7:7575180942520981889:2443] client user disconnected session shared/user_7_1_3034911298628433174_v1
2025-11-21T14:10:56.491035Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:2258: [PQ: 72075186224037892] Destroy direct read session shared/user_7_1_3034911298628433174_v1
2025-11-21T14:10:56.491066Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [7:7575180942520981891:2447] destroyed
2025-11-21T14:10:56.491090Z node 7 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_7_1_3034911298628433174_v1
2025-11-21T14:10:56.526428Z node 7 :PERSQUEUE DEBUG: partition.cpp:2313: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-21T14:10:56.526452Z node 7 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-21T14:10:56.526455Z node 7 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-21T14:10:56.526459Z node 7 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-21T14:10:56.526462Z node 7 :PERSQUEUE DEBUG: partition.cpp:2331: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-21T14:10:56.640022Z node 7 :PERSQUEUE DEBUG: partition.cpp:2313: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-21T14:10:56.640040Z node 7 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-21T14:10:56.640043Z node 7 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-21T14:10:56.640047Z node 7 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-21T14:10:56.640050Z node 7 :PERSQUEUE DEBUG: partition.cpp:2331: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-21T14:10:56.746498Z node 7 :PERSQUEUE DEBUG: partition.cpp:2313: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-21T14:10:56.746517Z node 7 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-21T14:10:56.746520Z node 7 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-21T14:10:56.746523Z node 7 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-21T14:10:56.746525Z node 7 :PERSQUEUE DEBUG: partition.cpp:2331: [72075186224037892][Partition][0][StateIdle] Try persist
