2025-10-31T10:42:29.940887Z node 7 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[7:7567334444984892697:2083];send_to=[0:7307199536658146131:7762515];
2025-10-31T10:42:29.941251Z node 7 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
2025-10-31T10:42:29.943154Z node 7 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
test_client.cpp: SetPath # /home/runner/.ya/build/build_root/p7ex/0013e6/r3tmp/tmpa420QK/pdisk_1.dat
2025-10-31T10:42:29.943428Z node 7 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-31T10:42:29.946451Z node 8 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-10-31T10:42:29.946817Z node 8 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-31T10:42:29.946851Z node 8 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=incorrect path status: LookupError;
2025-10-31T10:42:29.969610Z node 7 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
2025-10-31T10:42:29.986571Z node 7 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(8, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-10-31T10:42:29.986598Z node 7 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(8, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-10-31T10:42:29.987748Z node 7 :HIVE WARN: hive_impl.cpp:811: HIVE#72057594037968897 Handle TEvInterconnect::TEvNodeConnected, NodeId 8 Cookie 8
2025-10-31T10:42:29.988114Z node 7 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(8, (0,0,0,0)) VolatileState: Connecting -> Connected
TServer::EnableGrpc on GrpcPort 2244, node 7
2025-10-31T10:42:29.998100Z node 7 :NET_CLASSIFIER WARN: net_classifier.cpp:190: distributable config is empty, broken or outdated, will use file: /home/runner/.ya/build/build_root/p7ex/0013e6/r3tmp/yandexICA5Xe.tmp
2025-10-31T10:42:29.998116Z node 7 :NET_CLASSIFIER WARN: net_classifier.cpp:196: will try to initialize from file: /home/runner/.ya/build/build_root/p7ex/0013e6/r3tmp/yandexICA5Xe.tmp
2025-10-31T10:42:29.998181Z node 7 :NET_CLASSIFIER WARN: net_classifier.cpp:202: successfully initialized from file: /home/runner/.ya/build/build_root/p7ex/0013e6/r3tmp/yandexICA5Xe.tmp
2025-10-31T10:42:29.998256Z node 7 :NET_CLASSIFIER ERROR: net_classifier.cpp:228: got bad distributable configuration
2025-10-31T10:42:30.001283Z INFO: TTestServer started on Port 5550 GrpcPort 2244
TClient is connected to server localhost:5550
PQClient connected to localhost:2244
WaitRootIsUp 'Root'...
TClient::Ls request: Root
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "Root"
    PathId: 1
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 1
    CreateStep: 0
    ParentPathId: 1
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 1
      SubDomainVersion: 0
      SecurityStateVersion: 0
    }
    ChildrenExist: false
  }
  Children {
    Name: ".sys"
    PathId: 18446744073709551615
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 0
    CreateStep: 0
    ParentPathId: 18446744073709551615
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 0
      Pl...
(TRUNCATED)
WaitRootIsUp 'Root' success.
2025-10-31T10:42:30.018902Z node 7 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpAlterSubDomain, opId: 281474976715657:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_alter_subdomain.cpp:311)
waiting...
waiting...
2025-10-31T10:42:30.032886Z node 7 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976715659:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:690)
waiting...
2025-10-31T10:42:30.042198Z node 7 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(7, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-10-31T10:42:30.042229Z node 7 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(7, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-10-31T10:42:30.044108Z node 7 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(7, (0,0,0,0)) VolatileState: Connecting -> Connected
waiting...
waiting...
2025-10-31T10:42:30.120006Z node 8 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-10-31T10:42:30.140796Z node 7 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-10-31T10:42:30.358165Z node 8 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [8:7567334447121236525:2300], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-31T10:42:30.358188Z node 8 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [8:7567334447121236545:2303], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-31T10:42:30.358198Z node 8 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-31T10:42:30.359248Z node 8 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [8:7567334447121236575:2305], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-31T10:42:30.359282Z node 8 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-31T10:42:30.359352Z node 8 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [8:7567334447121236577:2306], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-31T10:42:30.359368Z node 8 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-31T10:42:30.359499Z node 7 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateResourcePool, opId: 281474976720657:3, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_resource_pool.cpp:179)
2025-10-31T10:42:30.366584Z node 8 :KQP_WORKLOAD_SERVICE WARN: helpers.h:73: [WorkloadService] [TPoolCreatorActor] ActorId: [8:7567334447121236549:2304], DatabaseId: /Root, PoolId: default, Scheduled retry for error: { <main>: Error: Transaction 281474976720657 completed, doublechecking }
2025-10-31T10:42:30.394296Z node 7 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:570: Compilation failed, self: [7:7567334449279861042:2331], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-10-31T10:42:30.394829Z node 7 :KQP_SESSION WARN: kqp_session_actor.cpp:2500: SessionId: ydb://session/3?node_id=7&id=YTBkNzgzYTUtYzg5NTE0NTktOTI0MWVjOWEtM2VmZWM1Nzk=, ActorId: [7:7567334449279861000:2323], ActorState: ExecuteState, TraceId: 01k8wxs6vm7wsawd0dp9eeca8q, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-10-31T10:42:30.395160Z node 7 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-10-31T10:42:30.395981Z node 7 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976715662:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:690)
2025-10-31T10:42:30.409635Z node 7 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976715663:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:690)
2025-10-31T10:42:30.426078Z node 8 :TX_PROXY ERROR: schemereq.cpp:593: Actor# [8:7567334447121236581:2180] txid# 281474976720658, issues: { message: "Check failed: path: \'/Root/.metadata/workload_manager/pools/default\', error: path exist, request accepts it (id: [OwnerId: 72057594046644480, LocalPathId: 9], type: EPathTypeResourcePool, state: EPathStateNoChanges), source_location: ydb/core/tx/schemeshard/schemeshard__operation_create_resource_pool.cpp:92" severity: 1 }
2025-10-31T10:42:30.430123Z node 7 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976715664:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:690)
2025-10-31T10:42:30.430332Z node 8 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:570: Compilation failed, self: [8:7567334447121236595:2310], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:5:17: Error: At function: KiReadTable!
        <main>:5:17: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Versions]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-10-31T10:42:30.430415Z node 8 :KQP_SESSION WARN: kqp_session_actor.cpp:2500: SessionId: ydb://session/3?node_id=8&id=M2ZjNTRlYTctY2E5ZDlhZjMtNWUwZGQ0YWQtYmY1MzZlNWE=, ActorId: [8:7567334447121236517:2298], ActorState: ExecuteState, TraceId: 01k8wxs6tn6asgaa3ckqtc1bzh, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-10-31T10:42:30.430555Z node 8 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 5 column: 17 } message: "At function: KiReadTable!" end_position { row: 5 column: 17 } severity: 1 issues { position { row: 5 column: 17 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Versions]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 5 column: 17 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
=== Init DC: UPSERT INTO `/Root/PQ/Config/V2/Cluster` (name, balancer, local, enabled, weight) VALUES ("dc1", "localhost", true, true, 1000), ("dc2", "dc2.logbroker.yandex.net", false, true, 1000);
2025-10-31T10:42:30.461713Z node 7 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976715665. Ctx: { TraceId: 01k8wxs6xe9hjjahbp6f3p5p08, Database: , SessionId: ydb://session/3?node_id=7&id=N2ZiZWI3NDctZWM3YTc0MTUtNzJmMTQ5ODYtNGVkNTQ0MA==, PoolId: default, DatabaseId: /Root}. Database not set, use /Root
=== CheckClustersList. Subcribe to ClusterTracker from [7:7567334449279861469:3029] 
2025-10-31T10:42:30.942708Z node 7 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-10-31T10:42:30.944776Z node 8 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-10-31T10:42:34.940933Z node 7 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[7:7567334444984892697:2083];send_to=[0:7307199536658146131:7762515];
2025-10-31T10:42:34.940969Z node 7 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
=== CheckClustersList. Ok
PQ Client: create topic: rt3.dc1--topic1 with 1 partitions
CallPersQueueGRPC request to localhost:2244
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--topic1"
  }
}
2025-10-31T10:42:35.666547Z node 7 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--topic1, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
CallPersQueueGRPC request to localhost:2244
MetaRequest {
  CmdCreateTopic {
    Topic: "rt3.dc1--topic1"
    NumPartitions: 1
    Config {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
  }
}
CallPersQueueGRPC response:
Status: 129
ProxyErrorCode: 53
SchemeStatus: 1
FlatTxId {
  TxId: 281474976715671
  SchemeShardTabletId: 72057594046644480
  PathId: 13
}
ErrorCode: OK
AddTopic: rt3.dc1--topic1
===Run query:``DECLARE $version as Int64; DECLARE $path AS Utf8; DECLARE $cluster as Utf8; UPSERT INTO `/Root/PQ/Config/V2/Topics` (path, dc) VALUES ($path, $cluster); UPSERT INTO `/Root/PQ/Config/V2/Versions` (name, version) VALUES ("Topics", $version);`` with topic = topic1, dc = dc1
2025-10-31T10:42:35.678699Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:2960: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-31T10:42:35.680034Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:2992: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-31T10:42:35.680115Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:787: [PQ: 72075186224037892] no config, start with empty partitions and default config
2025-10-31T10:42:35.680133Z node 7 :PERSQUEUE NOTICE: pq_impl.cpp:913: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-31T10:42:35.680149Z node 7 :PERSQUEUE INFO: pq_impl.cpp:612: [PQ: 72075186224037892] doesn't have tx writes info
2025-10-31T10:42:35.680194Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [7:7567334470754698317:3237], now have 1 active actors on pipe
2025-10-31T10:42:35.680327Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-31T10:42:35.680743Z node 8 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1655: [72075186224037893][] pipe [7:7567334470754698318:3238] connected; active server actors: 1
2025-10-31T10:42:35.680953Z node 8 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1519: [72075186224037893][rt3.dc1--topic1] updating configuration. Deleted partitions []. Added partitions [0]
2025-10-31T10:42:35.681150Z node 8 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:971: [72075186224037893][rt3.dc1--topic1] Discovered subdomain [OwnerId: 72057594046644480, LocalPathId: 1] state, outOfSpace = 0 at RB 72075186224037893
2025-10-31T10:42:35.681577Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-31T10:42:35.683490Z node 8 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:140: [72075186224037893][rt3.dc1--topic1] BALANCER INIT DONE for rt3.dc1--topic1: (0, 72075186224037892) 
2025-10-31T10:42:35.683664Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [8:7567334468596073388:2377], now have 1 active actors on pipe
2025-10-31T10:42:35.683743Z node 8 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:404: [72075186224037893][rt3.dc1--topic1] TEvClientConnected TabletId 72075186224037892, NodeId 7, Generation 1
2025-10-31T10:42:35.691426Z node 7 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976715672. Ctx: { TraceId: 01k8wxsc0x1hd3kskwx8024pj0, Database: , SessionId: ydb://session/3?node_id=7&id=M2I4ODkyNWUtZjNiN2U3MWItYTRmYTJiYWItOGU4ZmNlN2M=, PoolId: default, DatabaseId: /Root}. Database not set, use /Root
2025-10-31T10:42:35.691861Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [7:7567334470754698395:3292], now have 1 active actors on pipe
2025-10-31T10:42:35.691920Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-31T10:42:35.692898Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-31T10:42:35.693050Z node 7 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--topic1:0:Initializer] Start initializing step TInitConfigStep
2025-10-31T10:42:35.693065Z node 7 :PERSQUEUE DEBUG: partition.cpp:1295: [72075186224037892][Partition][0][StateInit] HandleOnInit TEvPQ::TEvProposePartitionConfig
2025-10-31T10:42:35.693116Z node 7 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--topic1:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-31T10:42:35.693157Z node 7 :PERSQUEUE INFO: partition_init.cpp:1101: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [7:7567334470754698415:2439]
2025-10-31T10:42:35.693856Z node 7 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--topic1:0:Initializer] Start initializing step TInitFieldsStep
2025-10-31T10:42:35.693864Z node 7 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--topic1:0:Initializer] Initializing completed.
2025-10-31T10:42:35.693868Z node 7 :PERSQUEUE INFO: partition.cpp:707: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--topic1' partition 0 generation 1 [7:7567334470754698415:2439]
2025-10-31T10:42:35.693874Z node 7 :PERSQUEUE DEBUG: partition.cpp:721: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--topic1 partitition 0 so 0 endOffset 0 Head Offset 0 PartNo 0 PackedSize 0 count 0 nextOffset 0 batches 0
2025-10-31T10:42:35.693879Z node 7 :PERSQUEUE DEBUG: partition_mlp.cpp:83: [72075186224037892][Partition][0][StateIdle] Initializing MLP Consumers: 0
2025-10-31T10:42:35.694132Z node 7 :PERSQUEUE DEBUG: partition.cpp:4256: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 1
2025-10-31T10:42:35.694143Z node 7 :PERSQUEUE DEBUG: partition.cpp:2272: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T10:42:35.694157Z node 7 :PERSQUEUE DEBUG: partition.cpp:2281: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T10:42:35.694163Z node 7 :PERSQUEUE DEBUG: partition.cpp:2285: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-31T10:42:35.694166Z node 7 :PERSQUEUE DEBUG: partition.cpp:2301: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-10-31T10:42:35.694168Z node 7 :PERSQUEUE DEBUG: partition.cpp:2272: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-31T10:42:35.694170Z node 7 :PERSQUEUE DEBUG: partition.cpp:2281: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T10:42:35.694172Z node 7 :PERSQUEUE DEBUG: partition.cpp:2301: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-10-31T10:42:35.694177Z node 7 :PERSQUEUE DEBUG: partition_read.cpp:926: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-31T10:42:35.694184Z node 7 :PERSQUEUE DEBUG: partition_mlp.cpp:60: [72075186224037892][Partition][0][StateIdle] Process MLP pending events. Count 0
2025-10-31T10:42:35.694239Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-31T10:42:35.694268Z node 7 :PERSQUEUE DEBUG: partition_compaction.cpp:183: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-31T10:42:35.695435Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-31T10:42:35.695475Z node 7 :PERSQUEUE DEBUG: partition.cpp:1399: [72075186224037892][Partition][0][StateIdle] Handle TEvPQ::TEvTxCommit Step 1761907355740, TxId 281474976715671
2025-10-31T10:42:35.695484Z node 7 :PERSQUEUE DEBUG: partition.cpp:2272: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-31T10:42:35.695486Z node 7 :PERSQUEUE DEBUG: partition.cpp:2281: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T10:42:35.695509Z node 7 :PERSQUEUE DEBUG: partition.cpp:2304: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T10:42:35.695549Z node 7 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-31T10:42:35.696901Z node 7 :PERSQUEUE DEBUG: partition.cpp:2099: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-31T10:42:35.696931Z node 7 :PERSQUEUE DEBUG: partition_mlp.cpp:83: [72075186224037892][Partition][0][StateIdle] Initializing MLP Consumers: 0
2025-10-31T10:42:35.696964Z node 7 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-31T10:42:35.696968Z node 7 :PERSQUEUE DEBUG: partition.cpp:2272: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T10:42:35.696969Z node 7 :PERSQUEUE DEBUG: partition.cpp:2281: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T10:42:35.696970Z node 7 :PERSQUEUE DEBUG: partition.cpp:2304: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T10:42:35.696976Z node 7 :PERSQUEUE DEBUG: partition_compaction.cpp:183: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-31T10:42:35.697059Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:398: [PQ: 72075186224037892] Apply new config PartitionConfig { LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 } PartitionIds: 0 TopicName: "rt3.dc1--topic1" Version: 0 LocalDC: true Codecs { Ids: 0 Ids: 1 Ids: 2 Codecs: "raw" Codecs: "gzip" Codecs: "lzop" } TopicPath: "/Root/PQ/rt3.dc1--topic1" YcCloudId: "" YcFolderId: "" YdbDatabaseId: "" YdbDatabasePath: "/Root" Partitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } AllPartitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } Consumers { Name: "user" ReadFromTimestampsMs: 0 FormatVersion: 0 Version: 0 Generation: 0 } MonitoringProjectId: ""
2025-10-31T10:42:35.697073Z node 7 :PERSQUEUE NOTICE: pq_impl.cpp:913: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-31T10:42:35.697103Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
===Query complete
TClient::Ls request: /Root/PQ/rt3.dc1--topic1
2025-10-31T10:42:35.698278Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-31T10:42:35.698296Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-31T10:42:35.699089Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--topic1"
    PathId: 13
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976715671
    CreateStep: 1761907355740
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--topic1"
    PathId: 13
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 600000...
(TRUNCATED)
GetTopicVersionFromPath:  record Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--topic1"
    PathId: 13
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976715671
    CreateStep: 1761907355740
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--topic1"
    PathId: 13
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      YdbDatabasePath: "/Root"
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
    Partitions {
      PartitionId: 0
      TabletId: 72075186224037892
      Status: Active
    }
    AlterVersion: 1
    BalancerTabletID: 72075186224037893
    NextPartitionId: 1
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 1
      PlanResolution: 7
      Coordinators: 72057594046316545
      TimeCastBucketsPerMediator: 2
      Mediators: 72057594046382081
    }
    DomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    PathsInside: 12
    PathsLimit: 10000
    ShardsInside: 6
    ShardsLimit: 200000
    ResourcesDomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    DiskSpaceUsage {
      Tables {
        TotalSize: 0
        DataSize: 0
        IndexSize: 0
      }
      Topics {
        ReserveSize: 0
        AccountSize: 0
        DataSize: 0
        UsedReserveSize: 0
      }
    }
    PQPartitionsInside: 1
    PQPartitionsLimit: 1000000
    SchemeLimits {
      MaxDepth: 32
      MaxPaths: 10000
      MaxChildrenInDir: 100000
      MaxAclBytesSize: 10240
      MaxTableColumns: 200
      MaxTableColumnNameLength: 255
      MaxTableKeyColumns: 30
      MaxTableIndices: 20
      MaxShards: 200000
      MaxShardsInPath: 35000
      MaxConsistentCopyTargets: 10000
      MaxPathElementLength: 255
      ExtraPathSymbolsAllowed: "!\"#$%&\'()*+,-.:;<=>?@[\\]^_`{|}~"
      MaxPQPartitions: 1000000
      MaxTableCdcStreams: 5
      MaxExports: 10
      MaxImports: 10
      MaxColumnTableColumns: 10000
    }
  }
}
Path: "/Root/PQ/rt3.dc1--topic1"
 name rt3.dc1--topic1 version1
CallPersQueueGRPC request to localhost:2244
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--topic1"
  }
}
2025-10-31T10:42:35.702942Z node 7 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
MetaResponse {
  CmdGetTopicMetadataResult {
    TopicInfo {
      Topic: "rt3.dc1--topic1"
      NumPartitions: 1
      Config {
        PartitionConfig {
          LifetimeSeconds: 86400
          LowWatermark: 8388608
          SourceIdLifetimeSeconds: 86400
          WriteSpeedInBytesPerSecond: 20000000
          BurstSize: 20000000
          SourceIdMaxCounts: 6000000
        }
        Version: 1
        LocalDC: true
        Codecs {
          Ids: 0
          Ids: 1
          Ids: 2
          Codecs: "raw"
          Codecs: "gzip"
          Codecs: "lzop"
        }
        TopicPath: "/Root/PQ/rt3.dc1--topic1"
        YdbDatabasePath: "/Root"
        Consumers {
          Name: "user"
          ReadFromTimestampsMs: 0
          FormatVersion: 0
          Version: 0
        }
      }
      ErrorCode: OK
    }
  }
}
=== Topic created, have version: 1
2025-10-31T10:42:35.703931Z :INFO: [] [] [f78ceb12-4438829-f5e170b5-da18a51d] Starting read session
2025-10-31T10:42:35.703955Z :DEBUG: [] [] [f78ceb12-4438829-f5e170b5-da18a51d] Starting session to cluster null (localhost:2244)
2025-10-31T10:42:35.704297Z :DEBUG: [] [] [f78ceb12-4438829-f5e170b5-da18a51d] [null] In Reconnect, ReadSizeBudget = 2621440, ReadSizeServerDelta = 0
2025-10-31T10:42:35.704303Z :DEBUG: [] [] [f78ceb12-4438829-f5e170b5-da18a51d] [null] New values: ReadSizeBudget = 2621440, ReadSizeServerDelta = 0
2025-10-31T10:42:35.704306Z :DEBUG: [] [] [f78ceb12-4438829-f5e170b5-da18a51d] [null] Reconnecting session to cluster null in 0.000000s
2025-10-31T10:42:35.704461Z :DEBUG: [] [] [f78ceb12-4438829-f5e170b5-da18a51d] [null] Successfully connected. Initializing session
2025-10-31T10:42:35.704686Z node 7 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:109: new grpc connection
2025-10-31T10:42:35.704692Z node 7 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:131: new session created cookie 1
2025-10-31T10:42:35.712015Z :INFO: [] [] [f78ceb12-4438829-f5e170b5-da18a51d] [null] Server session id: shared/user_7_1_190747618541107145_v1
2025-10-31T10:42:35.710933Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { topic: "topic1" } read_only_original: true consumer: "shared/user" read_params { max_read_size: 5242880 } } }
2025-10-31T10:42:35.710995Z node 7 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 1 consumer shared/user session shared/user_7_1_190747618541107145_v1 read init: from# ipv6:[::1]:59884, request# { init_request { topics_read_settings { topic: "topic1" } read_only_original: true consumer: "shared/user" read_params { max_read_size: 5242880 } } }
2025-10-31T10:42:35.711134Z node 7 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 1 consumer shared/user session shared/user_7_1_190747618541107145_v1 auth for : user
2025-10-31T10:42:35.711469Z node 7 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 1 consumer shared/user session shared/user_7_1_190747618541107145_v1 Handle describe topics response
2025-10-31T10:42:35.711501Z node 7 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 1 consumer shared/user session shared/user_7_1_190747618541107145_v1 auth is DEAD
2025-10-31T10:42:35.711521Z node 7 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 1 consumer shared/user session shared/user_7_1_190747618541107145_v1 auth ok: topics# 1, initDone# 0
2025-10-31T10:42:35.711844Z node 7 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 1 consumer shared/user session shared/user_7_1_190747618541107145_v1 register session: topic# rt3.dc1--topic1
2025-10-31T10:42:35.712048Z node 8 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1655: [72075186224037893][rt3.dc1--topic1] pipe [7:7567334470754698500:2462] connected; active server actors: 1
2025-10-31T10:42:35.712108Z :DEBUG: [] [] [f78ceb12-4438829-f5e170b5-da18a51d] [null] After sending read request: ReadSizeBudget = 2621440, ReadSizeServerDelta = 0
2025-10-31T10:42:35.712186Z node 8 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1706: [72075186224037893][rt3.dc1--topic1] consumer "user" register session for pipe [7:7567334470754698500:2462] session shared/user_7_1_190747618541107145_v1
2025-10-31T10:42:35.712201Z node 8 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:639: [72075186224037893][rt3.dc1--topic1] consumer user register readable partition 0
2025-10-31T10:42:35.712211Z node 8 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:669: [72075186224037893][rt3.dc1--topic1] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-10-31T10:42:35.712218Z node 8 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:871: [72075186224037893][rt3.dc1--topic1] consumer user register reading session ReadingSession "shared/user_7_1_190747618541107145_v1" (Sender=[7:7567334470754698496:2462], Pipe=[7:7567334470754698500:2462], Partitions=[], ActiveFamilyCount=0)
2025-10-31T10:42:35.712221Z node 8 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1186: [72075186224037893][rt3.dc1--topic1] consumer user rebalancing was scheduled
2025-10-31T10:42:35.712232Z node 8 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1258: [72075186224037893][rt3.dc1--topic1] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-10-31T10:42:35.712241Z node 8 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1305: [72075186224037893][rt3.dc1--topic1] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_7_1_190747618541107145_v1" (Sender=[7:7567334470754698496:2462], Pipe=[7:7567334470754698500:2462], Partitions=[], ActiveFamilyCount=0)
2025-10-31T10:42:35.712250Z node 8 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:549: [72075186224037893][rt3.dc1--topic1] consumer user family 1 status Active partitions [0] session "shared/user_7_1_190747618541107145_v1" sender [7:7567334470754698496:2462] lock partition 0 for ReadingSession "shared/user_7_1_190747618541107145_v1" (Sender=[7:7567334470754698496:2462], Pipe=[7:7567334470754698500:2462], Partitions=[], ActiveFamilyCount=1) generation 1 step 1
2025-10-31T10:42:35.712263Z node 8 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1325: [72075186224037893][rt3.dc1--topic1] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-10-31T10:42:35.712267Z node 8 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1402: [72075186224037893][rt3.dc1--topic1] consumer user balancing duration: 0.000033s
2025-10-31T10:42:35.712543Z node 7 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 1 consumer shared/user session shared/user_7_1_190747618541107145_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--topic1" Generation: 1 Step: 1 Session: "shared/user_7_1_190747618541107145_v1" ClientId: "user" PipeClient { RawX1: 7567334470754698500 RawX2: 4503629692144030 } Path: "/Root/PQ/rt3.dc1--topic1" }
2025-10-31T10:42:35.712569Z node 7 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 1 consumer shared/user session shared/user_7_1_190747618541107145_v1 INITING TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1)
2025-10-31T10:42:35.712668Z node 7 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_7_1_190747618541107145_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 1, pipe: [7:7567334470754698502:2465]
2025-10-31T10:42:35.712680Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [7:7567334470754698502:2465], now have 1 active actors on pipe
2025-10-31T10:42:35.712688Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T10:42:35.712695Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T10:42:35.712718Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:1748: [PQ: 72075186224037892] Created session shared/user_7_1_190747618541107145_v1 on pipe: [7:7567334470754698502:2465]
2025-10-31T10:42:35.712737Z node 7 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_7_1_190747618541107145_v1:1 with generation 1
2025-10-31T10:42:35.712743Z node 7 :PERSQUEUE DEBUG: partition.cpp:2272: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T10:42:35.712748Z node 7 :PERSQUEUE DEBUG: partition.cpp:2281: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T10:42:35.712750Z node 7 :PERSQUEUE DEBUG: partition.cpp:2285: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-31T10:42:35.712765Z node 7 :PERSQUEUE DEBUG: partition.cpp:3649: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 user user session is set to 0 (startOffset 0) session shared/user_7_1_190747618541107145_v1
2025-10-31T10:42:35.712768Z node 7 :PERSQUEUE DEBUG: partition.cpp:2304: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T10:42:35.712795Z node 7 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-31T10:42:35.713780Z node 7 :PERSQUEUE DEBUG: partition.cpp:2099: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-31T10:42:35.713809Z node 7 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-31T10:42:35.713816Z node 7 :PERSQUEUE DEBUG: partition.cpp:2272: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T10:42:35.713819Z node 7 :PERSQUEUE DEBUG: partition.cpp:2281: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T10:42:35.713822Z node 7 :PERSQUEUE DEBUG: partition.cpp:2304: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T10:42:35.713828Z node 7 :PERSQUEUE DEBUG: partition_compaction.cpp:183: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-31T10:42:35.713839Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-10-31T10:42:35.713897Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_7_1_190747618541107145_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 0 SizeLag: 0 WriteTimestampEstimateMS: 1761907355696 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-10-31T10:42:35.713906Z node 7 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 1 consumer shared/user session shared/user_7_1_190747618541107145_v1 INIT DONE TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 0 readOffset 0 committedOffset 0
2025-10-31T10:42:35.713919Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 1 consumer shared/user session shared/user_7_1_190747618541107145_v1 sending to client partition status
2025-10-31T10:42:35.715030Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_7_1_190747618541107145_v1 grpc read done: success# 1, data# { read { } }
2025-10-31T10:42:35.715065Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_7_1_190747618541107145_v1 got read request: guid# ca1c54a8-5f56dcb6-256635b0-29abca48
>>>> message: CreatePartitionStream { PartitionStreamId: 1 TopicPath: topic1 Cluster: dc1 PartitionId: 0 CommittedOffset: 0 EndOffset: 0 }
2025-10-31T10:42:35.715673Z :INFO: [] [] [f78ceb12-4438829-f5e170b5-da18a51d] [null] Confirm partition stream create. Partition stream id: 1. Cluster: "dc1". Topic: "topic1". Partition: 0. Read offset: (NULL)
2025-10-31T10:42:35.715850Z :DEBUG: [] MessageGroupId [source0] SessionId [] Write session: try to update token
2025-10-31T10:42:35.716046Z :INFO: [] MessageGroupId [source0] SessionId [] Write session: Do CDS request
2025-10-31T10:42:35.716053Z :INFO: [] MessageGroupId [source0] SessionId [] Start write session. Will connect to endpoint: localhost:2244
2025-10-31T10:42:35.716055Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_7_1_190747618541107145_v1 grpc read done: success# 1, data# { start_read { topic { path: "topic1" } cluster: "dc1" assign_id: 1 } }
2025-10-31T10:42:35.716121Z node 7 :PQ_READ_PROXY INFO: read_session_actor.cpp:539: session cookie 1 consumer shared/user session shared/user_7_1_190747618541107145_v1 got StartRead from client: partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 0, commitOffset# 0
2025-10-31T10:42:35.716140Z node 7 :PQ_READ_PROXY INFO: partition_actor.cpp:1023: session cookie 1 consumer shared/user session shared/user_7_1_190747618541107145_v1 Start reading TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 0 readOffset 0 committedOffset 0 clientCommitOffset 0 clientReadOffset 0
2025-10-31T10:42:35.716147Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_7_1_190747618541107145_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 1 from offset 0
2025-10-31T10:42:35.717205Z :DEBUG: [] MessageGroupId [source0] SessionId [] Write session: send init request: init_request { topic: "topic1" message_group_id: "source0" }
2025-10-31T10:42:35.718597Z node 7 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-31T10:42:35.718619Z node 7 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1
2025-10-31T10:42:35.718783Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId:  grpc read done: success: 1 data: init_request { topic: "topic1" message_group_id: "source0" }
2025-10-31T10:42:35.718826Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1 topic: "topic1" message_group_id: "source0" from ipv6:[::1]:59884
2025-10-31T10:42:35.718832Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:59884 proto=v1  topic=topic1 durationSec=0
2025-10-31T10:42:35.718835Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-31T10:42:35.719297Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1 sessionId:  describe result for acl check
2025-10-31T10:42:35.719345Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-31T10:42:35.719347Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-31T10:42:35.719349Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-31T10:42:35.719354Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [7:7567334470754698510:2466] (SourceId=source0, PreferedPartition=(NULL)) StartKqpSession
2025-10-31T10:42:35.719984Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [7:7567334470754698510:2466] (SourceId=source0, PreferedPartition=(NULL)) Select from the table
2025-10-31T10:42:35.752139Z node 8 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1655: [72075186224037893][rt3.dc1--topic1] pipe [7:7567334470754698541:2466] connected; active server actors: 1
2025-10-31T10:42:35.751887Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [7:7567334470754698510:2466] (SourceId=source0, PreferedPartition=(NULL)) RequestPQRB
2025-10-31T10:42:35.752323Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [7:7567334470754698510:2466] (SourceId=source0, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=source0
2025-10-31T10:42:35.752329Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [7:7567334470754698510:2466] (SourceId=source0, PreferedPartition=(NULL)) Update the table
2025-10-31T10:42:35.757323Z node 8 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1659: [72075186224037893][rt3.dc1--topic1] pipe [7:7567334470754698541:2466] disconnected.
2025-10-31T10:42:35.757340Z node 8 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1670: [72075186224037893][rt3.dc1--topic1] pipe [7:7567334470754698541:2466] disconnected; active server actors: 1
2025-10-31T10:42:35.757343Z node 8 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1695: [72075186224037893][rt3.dc1--topic1] pipe [7:7567334470754698541:2466] disconnected no session
2025-10-31T10:42:35.771671Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [7:7567334470754698510:2466] (SourceId=source0, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-31T10:42:35.771688Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [7:7567334470754698510:2466] (SourceId=source0, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-10-31T10:42:35.771693Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [7:7567334470754698510:2466] (SourceId=source0, PreferedPartition=(NULL)) Start idle
2025-10-31T10:42:35.771703Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-31T10:42:35.772416Z :INFO: [] MessageGroupId [source0] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1761907355772 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-31T10:42:35.772485Z :INFO: [] MessageGroupId [source0] SessionId [] Write session established. Init response: session_id: "source0|a3dc2a95-6717cbe8-5c118fbb-ae28961f_0" topic: "topic1" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-31T10:42:35.773577Z :DEBUG: [] MessageGroupId [source0] SessionId [source0|a3dc2a95-6717cbe8-5c118fbb-ae28961f_0] Write 1 messages with Id from 1 to 1
2025-10-31T10:42:35.773634Z :INFO: [] MessageGroupId [source0] SessionId [source0|a3dc2a95-6717cbe8-5c118fbb-ae28961f_0] Write session: close. Timeout = 10000 ms
2025-10-31T10:42:35.771883Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 7, Generation: 1
2025-10-31T10:42:35.771898Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [7:7567334470754698562:2466], now have 1 active actors on pipe
2025-10-31T10:42:35.771906Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T10:42:35.771912Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T10:42:35.771934Z node 7 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie source0|a3dc2a95-6717cbe8-5c118fbb-ae28961f_0 generated for partition 0 topic 'rt3.dc1--topic1' owner source0
2025-10-31T10:42:35.771944Z node 7 :PERSQUEUE DEBUG: partition.cpp:2272: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T10:42:35.771949Z node 7 :PERSQUEUE DEBUG: partition.cpp:2281: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T10:42:35.771951Z node 7 :PERSQUEUE DEBUG: partition.cpp:2285: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-31T10:42:35.771961Z node 7 :PERSQUEUE DEBUG: partition.cpp:2304: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T10:42:35.771975Z node 7 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-31T10:42:35.771989Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-31T10:42:35.772032Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T10:42:35.772038Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T10:42:35.772059Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-31T10:42:35.772094Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1 partition: 0 MaxSeqNo: 0 sessionId: source0|a3dc2a95-6717cbe8-5c118fbb-ae28961f_0
2025-10-31T10:42:35.780081Z :DEBUG: [] MessageGroupId [source0] SessionId [source0|a3dc2a95-6717cbe8-5c118fbb-ae28961f_0] Write session: try to update token
2025-10-31T10:42:35.780107Z :DEBUG: [] MessageGroupId [source0] SessionId [source0|a3dc2a95-6717cbe8-5c118fbb-ae28961f_0] Send 1 message(s) (0 left), first sequence number is 1
2025-10-31T10:42:35.780794Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId: source0|a3dc2a95-6717cbe8-5c118fbb-ae28961f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-31T10:42:35.780957Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-31T10:42:35.781114Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T10:42:35.781127Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T10:42:35.781174Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-31T10:42:35.781199Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-31T10:42:35.781280Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T10:42:35.781292Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T10:42:35.781419Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: '\0source0' SeqNo: 1 partNo : 0 messageNo: 1 size 1122 offset: -1
2025-10-31T10:42:35.781433Z node 7 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-31T10:42:35.781450Z node 7 :PERSQUEUE DEBUG: partition.cpp:2272: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T10:42:35.781461Z node 7 :PERSQUEUE DEBUG: partition.cpp:2281: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T10:42:35.781464Z node 7 :PERSQUEUE DEBUG: partition.cpp:2285: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-31T10:42:35.781495Z node 7 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId '\0source0' seqNo 1 partNo 0
2025-10-31T10:42:35.781534Z node 7 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '\0source0' seqNo 1 partNo 0 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 1197 count 1 nextOffset 1 batches 1
2025-10-31T10:42:35.781542Z node 7 :PERSQUEUE DEBUG: partition.cpp:2304: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T10:42:35.781579Z node 7 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 0,1 HeadOffset 0 endOffset 0 curOffset 1 d0000000000_00000000000000000000_00000_0000000001_00000? size 1185 WTime 1761907355781
2025-10-31T10:42:35.781602Z node 7 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-31T10:42:35.781613Z node 7 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 0 partNo 0 count 1 size 1185
2025-10-31T10:42:35.783004Z node 7 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 0 count 1 size 1185 actorID [7:7567334470754698339:2439]
2025-10-31T10:42:35.783024Z node 7 :PERSQUEUE DEBUG: partition.cpp:2099: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-31T10:42:35.783040Z node 7 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1130 WriteNewSizeFromSupportivePartitions# 0
2025-10-31T10:42:35.783041Z node 7 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 0 suffix '63' size 1185
2025-10-31T10:42:35.783045Z node 7 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-31T10:42:35.783051Z node 7 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0source0', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 1, partNo: 0, Offset: 0 is stored on disk
2025-10-31T10:42:35.783081Z node 7 :PERSQUEUE DEBUG: partition_read.cpp:926: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-31T10:42:35.783086Z node 7 :PERSQUEUE DEBUG: partition_read.cpp:968: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-31T10:42:35.783089Z node 7 :PERSQUEUE DEBUG: partition.cpp:2272: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T10:42:35.783093Z node 7 :PERSQUEUE DEBUG: partition.cpp:2281: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T10:42:35.783096Z node 7 :PERSQUEUE DEBUG: partition.cpp:2304: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T10:42:35.783102Z node 7 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-31T10:42:35.783112Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 1  requestId: <none> cookie: 1
2025-10-31T10:42:35.783137Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 1 consumer shared/user session shared/user_7_1_190747618541107145_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 0 EndOffset 0 newEndOffset 1 commitOffset 0 clientCommitOffset 0 cookie 1 readingFinished 0 firstRead 1
2025-10-31T10:42:35.783139Z node 7 :PERSQUEUE DEBUG: partition_read.cpp:883: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--topic1' partition 0 user user offset 0 count 1 size 1024000 endOffset 1 max time lag 0ms effective offset 0
2025-10-31T10:42:35.783149Z node 7 :PERSQUEUE DEBUG: partition_read.cpp:1097: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 1185 count 1 last offset 0, current partition end offset: 1
2025-10-31T10:42:35.783151Z node 7 :PERSQUEUE DEBUG: partition_read.cpp:1123: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-31T10:42:35.783151Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_7_1_190747618541107145_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 0 endOffset 1
2025-10-31T10:42:35.783159Z node 7 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 0 partno 0 count 1 parts_count 0 source 1 size 1185 accessed 0 times before, last time 2025-10-31T10:42:35.000000Z
2025-10-31T10:42:35.783166Z node 7 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 3. All 1 blobs are from cache.
2025-10-31T10:42:35.783173Z node 7 :PERSQUEUE DEBUG: partition_read.cpp:581: FormAnswer for 1 blobs
2025-10-31T10:42:35.783179Z node 7 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 0 suffix '63'
2025-10-31T10:42:35.783183Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-31T10:42:35.783185Z node 7 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 0 totakecount 1 count 1 size 1165 from pos 0 cbcount 1
2025-10-31T10:42:35.783200Z node 7 :PERSQUEUE DEBUG: partition_read.cpp:1018: Topic 'rt3.dc1--topic1' partition 0 user user readTimeStamp done, result 1761907355781 queuesize 0 startOffset 0
2025-10-31T10:42:35.783222Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_7_1_190747618541107145_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 0, endOffset# 1, WTime# 0, sizeLag# 1185
2025-10-31T10:42:35.783225Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_7_1_190747618541107145_v1TEvPartitionReady. Aval parts: 1
2025-10-31T10:42:35.783236Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_7_1_190747618541107145_v1 performing read request: guid# ca1c54a8-5f56dcb6-256635b0-29abca48, from# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), count# 1, size# 1422, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-31T10:42:35.783283Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_7_1_190747618541107145_v1 READ FROM TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1)maxCount 1 maxSize 1422 maxTimeLagMs 0 readTimestampMs 0 readOffset 0 EndOffset 1 ClientCommitOffset 0 committedOffset 0 Guid ca1c54a8-5f56dcb6-256635b0-29abca48
2025-10-31T10:42:35.783316Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T10:42:35.783331Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T10:42:35.783347Z node 7 :PERSQUEUE DEBUG: partition_read.cpp:883: [72075186224037892][Partition][0][StateIdle] read cookie 4 Topic 'rt3.dc1--topic1' partition 0 user user offset 0 count 1 size 1422 endOffset 1 max time lag 0ms effective offset 0
2025-10-31T10:42:35.783359Z node 7 :PERSQUEUE DEBUG: partition_read.cpp:1097: [72075186224037892][Partition][0][StateIdle] read cookie 4 added 1 blobs, size 1185 count 1 last offset 0, current partition end offset: 1
2025-10-31T10:42:35.783361Z node 7 :PERSQUEUE DEBUG: partition_read.cpp:1123: [72075186224037892][Partition][0][StateIdle] Reading cookie 4. Send blob request.
2025-10-31T10:42:35.783368Z node 7 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 0 partno 0 count 1 parts_count 0 source 1 size 1185 accessed 1 times before, last time 2025-10-31T10:42:35.000000Z
2025-10-31T10:42:35.783375Z node 7 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 4. All 1 blobs are from cache.
2025-10-31T10:42:35.783380Z node 7 :PERSQUEUE DEBUG: partition_read.cpp:581: FormAnswer for 1 blobs
2025-10-31T10:42:35.783383Z node 7 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 0 suffix '63'
2025-10-31T10:42:35.783387Z node 7 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 0 totakecount 1 count 1 size 1165 from pos 0 cbcount 1
2025-10-31T10:42:35.783402Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-31T10:42:35.783484Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_7_1_190747618541107145_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 1 Result { Offset: 0 Data: "... 1122 bytes ..." SourceId: "\000source0" SeqNo: 1 WriteTimestampMS: 1761907355781 CreateTimestampMS: 1761907355772 UncompressedSize: 1047552 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 20 RealReadOffset: 0 WaitQuotaTimeMs: 0 EndOffset: 1 StartOffset: 0 } Cookie: 0 }
2025-10-31T10:42:35.783507Z :DEBUG: [] MessageGroupId [source0] SessionId [source0|a3dc2a95-6717cbe8-5c118fbb-ae28961f_0] Write session got write response: sequence_numbers: 1 offsets: 0 already_written: false write_statistics { persist_duration_ms: 1 }
2025-10-31T10:42:35.783518Z :DEBUG: [] MessageGroupId [source0] SessionId [source0|a3dc2a95-6717cbe8-5c118fbb-ae28961f_0] Write session: acknoledged message 1
2025-10-31T10:42:35.783514Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_7_1_190747618541107145_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 2 from offset 1
2025-10-31T10:42:35.783527Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_7_1_190747618541107145_v1 after read state TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 1 ReadOffset 1 ReadGuid ca1c54a8-5f56dcb6-256635b0-29abca48 has messages 1
2025-10-31T10:42:35.783567Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_7_1_190747618541107145_v1 read done: guid# ca1c54a8-5f56dcb6-256635b0-29abca48, partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), size# 1222
2025-10-31T10:42:35.783583Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_7_1_190747618541107145_v1 response to read: guid# ca1c54a8-5f56dcb6-256635b0-29abca48
2025-10-31T10:42:35.783699Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_7_1_190747618541107145_v1 Process answer. Aval parts: 0
2025-10-31T10:42:35.783947Z :DEBUG: [] [] [f78ceb12-4438829-f5e170b5-da18a51d] [null] After sending read request: ReadSizeBudget = 2621440, ReadSizeServerDelta = 0
2025-10-31T10:42:35.784040Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_7_1_190747618541107145_v1 grpc read done: success# 1, data# { read { } }
2025-10-31T10:42:35.784104Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_7_1_190747618541107145_v1 got read request: guid# 48d6e784-aff84072-82a59e51-fef47506
2025-10-31T10:42:35.794441Z node 7 :PERSQUEUE DEBUG: partition.cpp:2272: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T10:42:35.794464Z node 7 :PERSQUEUE DEBUG: partition.cpp:2281: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T10:42:35.794468Z node 7 :PERSQUEUE DEBUG: partition.cpp:2304: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T10:42:35.873737Z :INFO: [] MessageGroupId [source0] SessionId [source0|a3dc2a95-6717cbe8-5c118fbb-ae28961f_0] Write session will now close
2025-10-31T10:42:35.873764Z :DEBUG: [] MessageGroupId [source0] SessionId [source0|a3dc2a95-6717cbe8-5c118fbb-ae28961f_0] Write session: aborting
2025-10-31T10:42:35.873975Z :INFO: [] MessageGroupId [source0] SessionId [source0|a3dc2a95-6717cbe8-5c118fbb-ae28961f_0] Write session: gracefully shut down, all writes complete
2025-10-31T10:42:35.874032Z :DEBUG: [] MessageGroupId [source0] SessionId [source0|a3dc2a95-6717cbe8-5c118fbb-ae28961f_0] Write session: destroy
2025-10-31T10:42:35.874269Z :DEBUG: [] MessageGroupId [source1] SessionId [] Write session: try to update token
2025-10-31T10:42:35.874223Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId: source0|a3dc2a95-6717cbe8-5c118fbb-ae28961f_0 grpc read done: success: 0 data: 
2025-10-31T10:42:35.874243Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 1 sessionId: source0|a3dc2a95-6717cbe8-5c118fbb-ae28961f_0 grpc read failed
2025-10-31T10:42:35.874254Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 1 sessionId: source0|a3dc2a95-6717cbe8-5c118fbb-ae28961f_0 grpc closed
2025-10-31T10:42:35.874261Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1 sessionId: source0|a3dc2a95-6717cbe8-5c118fbb-ae28961f_0 is DEAD
2025-10-31T10:42:35.874395Z :INFO: [] MessageGroupId [source1] SessionId [] Write session: Do CDS request
2025-10-31T10:42:35.874399Z :INFO: [] MessageGroupId [source1] SessionId [] Start write session. Will connect to endpoint: localhost:2244
2025-10-31T10:42:35.874651Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-10-31T10:42:35.874713Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [7:7567334470754698562:2466] destroyed
2025-10-31T10:42:35.874732Z node 7 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-10-31T10:42:35.874743Z node 7 :PERSQUEUE DEBUG: partition.cpp:2272: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T10:42:35.874750Z node 7 :PERSQUEUE DEBUG: partition.cpp:2281: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T10:42:35.874752Z node 7 :PERSQUEUE DEBUG: partition.cpp:2304: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T10:42:35.875042Z :DEBUG: [] MessageGroupId [source1] SessionId [] Write session: send init request: init_request { topic: "topic1" message_group_id: "source1" }
2025-10-31T10:42:35.875154Z node 7 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-31T10:42:35.875168Z node 7 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2
2025-10-31T10:42:35.875297Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId:  grpc read done: success: 1 data: init_request { topic: "topic1" message_group_id: "source1" }
2025-10-31T10:42:35.875326Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2 topic: "topic1" message_group_id: "source1" from ipv6:[::1]:59884
2025-10-31T10:42:35.875331Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:59884 proto=v1  topic=topic1 durationSec=0
2025-10-31T10:42:35.875334Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-31T10:42:35.875960Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2 sessionId:  describe result for acl check
2025-10-31T10:42:35.876029Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-31T10:42:35.876037Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-31T10:42:35.876039Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-31T10:42:35.876046Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [7:7567334470754698577:2476] (SourceId=source1, PreferedPartition=(NULL)) StartKqpSession
2025-10-31T10:42:35.876729Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [7:7567334470754698577:2476] (SourceId=source1, PreferedPartition=(NULL)) Select from the table
2025-10-31T10:42:35.882092Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [7:7567334470754698577:2476] (SourceId=source1, PreferedPartition=(NULL)) RequestPQRB
2025-10-31T10:42:35.882308Z node 8 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1655: [72075186224037893][rt3.dc1--topic1] pipe [7:7567334470754698596:2476] connected; active server actors: 1
2025-10-31T10:42:35.882548Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [7:7567334470754698577:2476] (SourceId=source1, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=source1
2025-10-31T10:42:35.882562Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [7:7567334470754698577:2476] (SourceId=source1, PreferedPartition=(NULL)) Update the table
2025-10-31T10:42:35.882676Z node 8 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1659: [72075186224037893][rt3.dc1--topic1] pipe [7:7567334470754698596:2476] disconnected.
2025-10-31T10:42:35.882687Z node 8 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1670: [72075186224037893][rt3.dc1--topic1] pipe [7:7567334470754698596:2476] disconnected; active server actors: 1
2025-10-31T10:42:35.882693Z node 8 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1695: [72075186224037893][rt3.dc1--topic1] pipe [7:7567334470754698596:2476] disconnected no session
2025-10-31T10:42:35.889703Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [7:7567334470754698577:2476] (SourceId=source1, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-31T10:42:35.889740Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [7:7567334470754698577:2476] (SourceId=source1, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-10-31T10:42:35.889744Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [7:7567334470754698577:2476] (SourceId=source1, PreferedPartition=(NULL)) Start idle
2025-10-31T10:42:35.889754Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-31T10:42:35.889941Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 7, Generation: 1
2025-10-31T10:42:35.889960Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [7:7567334470754698610:2476], now have 1 active actors on pipe
2025-10-31T10:42:35.889968Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T10:42:35.889981Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T10:42:35.890009Z node 7 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie source1|a500561c-6a43eb86-228c1b73-5e68322f_0 generated for partition 0 topic 'rt3.dc1--topic1' owner source1
2025-10-31T10:42:35.890019Z node 7 :PERSQUEUE DEBUG: partition.cpp:2272: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T10:42:35.890023Z node 7 :PERSQUEUE DEBUG: partition.cpp:2281: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T10:42:35.890027Z node 7 :PERSQUEUE DEBUG: partition.cpp:2285: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-31T10:42:35.890037Z node 7 :PERSQUEUE DEBUG: partition.cpp:2304: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T10:42:35.890051Z node 7 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-31T10:42:35.890066Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-31T10:42:35.890153Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T10:42:35.890172Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T10:42:35.890196Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-31T10:42:35.890243Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2 partition: 0 MaxSeqNo: 0 sessionId: source1|a500561c-6a43eb86-228c1b73-5e68322f_0
2025-10-31T10:42:35.890567Z :INFO: [] MessageGroupId [source1] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1761907355890 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-31T10:42:35.890602Z :INFO: [] MessageGroupId [source1] SessionId [] Write session established. Init response: session_id: "source1|a500561c-6a43eb86-228c1b73-5e68322f_0" topic: "topic1" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-31T10:42:35.890893Z :DEBUG: [] MessageGroupId [source1] SessionId [source1|a500561c-6a43eb86-228c1b73-5e68322f_0] Write 1 messages with Id from 1 to 1
2025-10-31T10:42:35.890965Z :INFO: [] MessageGroupId [source1] SessionId [source1|a500561c-6a43eb86-228c1b73-5e68322f_0] Write session: close. Timeout = 10000 ms
2025-10-31T10:42:35.894766Z node 7 :PERSQUEUE DEBUG: partition.cpp:2272: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T10:42:35.894782Z node 7 :PERSQUEUE DEBUG: partition.cpp:2281: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T10:42:35.894785Z node 7 :PERSQUEUE DEBUG: partition.cpp:2304: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T10:42:35.896446Z :DEBUG: [] MessageGroupId [source1] SessionId [source1|a500561c-6a43eb86-228c1b73-5e68322f_0] Write session: try to update token
2025-10-31T10:42:35.896470Z :DEBUG: [] MessageGroupId [source1] SessionId [source1|a500561c-6a43eb86-228c1b73-5e68322f_0] Send 1 message(s) (0 left), first sequence number is 1
2025-10-31T10:42:35.896833Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: source1|a500561c-6a43eb86-228c1b73-5e68322f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-31T10:42:35.896957Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-31T10:42:35.897107Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T10:42:35.897123Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T10:42:35.897151Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-31T10:42:35.897180Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-31T10:42:35.897211Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T10:42:35.897218Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T10:42:35.897231Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: '\0source1' SeqNo: 1 partNo : 0 messageNo: 1 size 1122 offset: -1
2025-10-31T10:42:35.897243Z node 7 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-31T10:42:35.897253Z node 7 :PERSQUEUE DEBUG: partition.cpp:2272: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T10:42:35.897264Z node 7 :PERSQUEUE DEBUG: partition.cpp:2281: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T10:42:35.897266Z node 7 :PERSQUEUE DEBUG: partition.cpp:2285: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-31T10:42:35.897306Z node 7 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId '\0source1' seqNo 1 partNo 0
2025-10-31T10:42:35.897349Z node 7 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '\0source1' seqNo 1 partNo 0 FormedBlobsCount 0 NewHead: Offset 1 PartNo 0 PackedSize 1197 count 1 nextOffset 2 batches 1
2025-10-31T10:42:35.897361Z node 7 :PERSQUEUE DEBUG: partition.cpp:2304: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T10:42:35.897410Z node 7 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 1,1 HeadOffset 1 endOffset 1 curOffset 2 d0000000000_00000000000000000001_00000_0000000001_00000? size 1185 WTime 1761907355897
2025-10-31T10:42:35.897441Z node 7 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-31T10:42:35.897465Z node 7 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 1 partNo 0 count 1 size 1185
2025-10-31T10:42:35.899303Z node 7 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 1 count 1 size 1185 actorID [7:7567334470754698339:2439]
2025-10-31T10:42:35.899331Z node 7 :PERSQUEUE DEBUG: partition.cpp:2099: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-31T10:42:35.899351Z node 7 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 1 partno 0 count 1 parts 0 suffix '63' size 1185
2025-10-31T10:42:35.899354Z node 7 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1130 WriteNewSizeFromSupportivePartitions# 0
2025-10-31T10:42:35.899362Z node 7 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-31T10:42:35.899374Z node 7 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 1, partNo: 0, Offset: 1 is stored on disk
2025-10-31T10:42:35.899420Z node 7 :PERSQUEUE DEBUG: partition.cpp:2272: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T10:42:35.899430Z node 7 :PERSQUEUE DEBUG: partition.cpp:2281: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T10:42:35.899431Z node 7 :PERSQUEUE DEBUG: partition.cpp:2304: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T10:42:35.899437Z node 7 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-31T10:42:35.899447Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 1  requestId: <none> cookie: 1
2025-10-31T10:42:35.899466Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 1 consumer shared/user session shared/user_7_1_190747618541107145_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 1 EndOffset 1 newEndOffset 2 commitOffset 0 clientCommitOffset 0 cookie 2 readingFinished 0 firstRead 0
2025-10-31T10:42:35.899475Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_7_1_190747618541107145_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 1 endOffset 2
2025-10-31T10:42:35.899484Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-31T10:42:35.899627Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_7_1_190747618541107145_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 1, endOffset# 2, WTime# 1761907355781, sizeLag# 1185
2025-10-31T10:42:35.899635Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_7_1_190747618541107145_v1TEvPartitionReady. Aval parts: 1
2025-10-31T10:42:35.899644Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_7_1_190747618541107145_v1 performing read request: guid# 48d6e784-aff84072-82a59e51-fef47506, from# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), count# 1, size# 1422, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-31T10:42:35.899660Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_7_1_190747618541107145_v1 READ FROM TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1)maxCount 1 maxSize 1422 maxTimeLagMs 0 readTimestampMs 0 readOffset 1 EndOffset 2 ClientCommitOffset 0 committedOffset 0 Guid 48d6e784-aff84072-82a59e51-fef47506
2025-10-31T10:42:35.899704Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T10:42:35.899715Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T10:42:35.899751Z node 7 :PERSQUEUE DEBUG: partition_read.cpp:883: [72075186224037892][Partition][0][StateIdle] read cookie 5 Topic 'rt3.dc1--topic1' partition 0 user user offset 1 count 1 size 1422 endOffset 2 max time lag 0ms effective offset 1
2025-10-31T10:42:35.899773Z node 7 :PERSQUEUE DEBUG: partition_read.cpp:1097: [72075186224037892][Partition][0][StateIdle] read cookie 5 added 1 blobs, size 1185 count 1 last offset 1, current partition end offset: 2
2025-10-31T10:42:35.899782Z node 7 :PERSQUEUE DEBUG: partition_read.cpp:1123: [72075186224037892][Partition][0][StateIdle] Reading cookie 5. Send blob request.
2025-10-31T10:42:35.899787Z :DEBUG: [] MessageGroupId [source1] SessionId [source1|a500561c-6a43eb86-228c1b73-5e68322f_0] Write session got write response: sequence_numbers: 1 offsets: 1 already_written: false write_statistics { persist_duration_ms: 2 }
2025-10-31T10:42:35.899800Z :DEBUG: [] MessageGroupId [source1] SessionId [source1|a500561c-6a43eb86-228c1b73-5e68322f_0] Write session: acknoledged message 1
2025-10-31T10:42:35.899792Z node 7 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 1 partno 0 count 1 parts_count 0 source 1 size 1185 accessed 0 times before, last time 2025-10-31T10:42:35.000000Z
2025-10-31T10:42:35.899805Z node 7 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 5. All 1 blobs are from cache.
2025-10-31T10:42:35.899815Z node 7 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 1 partno 0 count 1 parts 0 suffix '63'
2025-10-31T10:42:35.899817Z node 7 :PERSQUEUE DEBUG: partition_read.cpp:581: FormAnswer for 1 blobs
2025-10-31T10:42:35.899831Z node 7 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 1 totakecount 1 count 1 size 1165 from pos 0 cbcount 1
2025-10-31T10:42:35.899863Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-31T10:42:35.899935Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_7_1_190747618541107145_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 2 Result { Offset: 1 Data: "... 1122 bytes ..." SourceId: "\000source1" SeqNo: 1 WriteTimestampMS: 1761907355897 CreateTimestampMS: 1761907355890 UncompressedSize: 1047552 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 20 RealReadOffset: 1 WaitQuotaTimeMs: 0 EndOffset: 2 StartOffset: 0 } Cookie: 1 }
2025-10-31T10:42:35.899964Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_7_1_190747618541107145_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 3 from offset 2
2025-10-31T10:42:35.899976Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_7_1_190747618541107145_v1 after read state TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 2 ReadOffset 2 ReadGuid 48d6e784-aff84072-82a59e51-fef47506 has messages 1
2025-10-31T10:42:35.899994Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_7_1_190747618541107145_v1 read done: guid# 48d6e784-aff84072-82a59e51-fef47506, partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), size# 1224
2025-10-31T10:42:35.900004Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_7_1_190747618541107145_v1 response to read: guid# 48d6e784-aff84072-82a59e51-fef47506
2025-10-31T10:42:35.900071Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_7_1_190747618541107145_v1 Process answer. Aval parts: 0
2025-10-31T10:42:35.900245Z :DEBUG: [] [] [f78ceb12-4438829-f5e170b5-da18a51d] [null] After sending read request: ReadSizeBudget = 2621440, ReadSizeServerDelta = 0
2025-10-31T10:42:35.900338Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_7_1_190747618541107145_v1 grpc read done: success# 1, data# { read { } }
2025-10-31T10:42:35.900388Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_7_1_190747618541107145_v1 got read request: guid# a4ffa871-1ebd9cd8-2ae2ad86-46f1ce1b
2025-10-31T10:42:35.991057Z :INFO: [] MessageGroupId [source1] SessionId [source1|a500561c-6a43eb86-228c1b73-5e68322f_0] Write session will now close
2025-10-31T10:42:35.991083Z :DEBUG: [] MessageGroupId [source1] SessionId [source1|a500561c-6a43eb86-228c1b73-5e68322f_0] Write session: aborting
2025-10-31T10:42:35.991477Z :INFO: [] MessageGroupId [source1] SessionId [source1|a500561c-6a43eb86-228c1b73-5e68322f_0] Write session: gracefully shut down, all writes complete
2025-10-31T10:42:35.991507Z :DEBUG: [] MessageGroupId [source1] SessionId [source1|a500561c-6a43eb86-228c1b73-5e68322f_0] Write session is aborting and will not restart
2025-10-31T10:42:35.991792Z :DEBUG: [] MessageGroupId [source1] SessionId [source1|a500561c-6a43eb86-228c1b73-5e68322f_0] Write session: destroy
2025-10-31T10:42:35.992760Z :DEBUG: [] MessageGroupId [source2] SessionId [] Write session: try to update token
2025-10-31T10:42:35.992906Z :INFO: [] MessageGroupId [source2] SessionId [] Write session: Do CDS request
2025-10-31T10:42:35.992913Z :INFO: [] MessageGroupId [source2] SessionId [] Start write session. Will connect to endpoint: localhost:2244
2025-10-31T10:42:35.994038Z :DEBUG: [] MessageGroupId [source2] SessionId [] Write session: send init request: init_request { topic: "topic1" message_group_id: "source2" }
2025-10-31T10:42:35.992973Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: source1|a500561c-6a43eb86-228c1b73-5e68322f_0 grpc read done: success: 0 data: 
2025-10-31T10:42:35.992993Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 2 sessionId: source1|a500561c-6a43eb86-228c1b73-5e68322f_0 grpc read failed
2025-10-31T10:42:35.993003Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 2 sessionId: source1|a500561c-6a43eb86-228c1b73-5e68322f_0 grpc closed
2025-10-31T10:42:35.993010Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2 sessionId: source1|a500561c-6a43eb86-228c1b73-5e68322f_0 is DEAD
2025-10-31T10:42:35.993283Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-10-31T10:42:35.993337Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [7:7567334470754698610:2476] destroyed
2025-10-31T10:42:35.993349Z node 7 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-10-31T10:42:35.993354Z node 7 :PERSQUEUE DEBUG: partition.cpp:2272: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T10:42:35.993357Z node 7 :PERSQUEUE DEBUG: partition.cpp:2281: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T10:42:35.993359Z node 7 :PERSQUEUE DEBUG: partition.cpp:2304: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T10:42:35.994171Z node 7 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-31T10:42:35.994178Z node 7 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3
2025-10-31T10:42:35.994286Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3 sessionId:  grpc read done: success: 1 data: init_request { topic: "topic1" message_group_id: "source2" }
2025-10-31T10:42:35.994317Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3 topic: "topic1" message_group_id: "source2" from ipv6:[::1]:59884
2025-10-31T10:42:35.994322Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:59884 proto=v1  topic=topic1 durationSec=0
2025-10-31T10:42:35.994326Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-31T10:42:35.994894Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3 sessionId:  describe result for acl check
2025-10-31T10:42:35.994927Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-31T10:42:35.994929Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-31T10:42:35.994931Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-31T10:42:35.994939Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [7:7567334470754698625:2482] (SourceId=source2, PreferedPartition=(NULL)) StartKqpSession
2025-10-31T10:42:35.995590Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [7:7567334470754698625:2482] (SourceId=source2, PreferedPartition=(NULL)) Select from the table
2025-10-31T10:42:35.996814Z node 7 :PERSQUEUE DEBUG: partition.cpp:2272: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T10:42:35.996820Z node 7 :PERSQUEUE DEBUG: partition.cpp:2281: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T10:42:35.996823Z node 7 :PERSQUEUE DEBUG: partition.cpp:2304: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T10:42:35.998429Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [7:7567334470754698625:2482] (SourceId=source2, PreferedPartition=(NULL)) RequestPQRB
2025-10-31T10:42:35.998643Z node 8 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1655: [72075186224037893][rt3.dc1--topic1] pipe [7:7567334470754698641:2482] connected; active server actors: 1
2025-10-31T10:42:35.998798Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [7:7567334470754698625:2482] (SourceId=source2, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=source2
2025-10-31T10:42:35.998821Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [7:7567334470754698625:2482] (SourceId=source2, PreferedPartition=(NULL)) Update the table
2025-10-31T10:42:35.999107Z node 8 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1659: [72075186224037893][rt3.dc1--topic1] pipe [7:7567334470754698641:2482] disconnected.
2025-10-31T10:42:35.999116Z node 8 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1670: [72075186224037893][rt3.dc1--topic1] pipe [7:7567334470754698641:2482] disconnected; active server actors: 1
2025-10-31T10:42:35.999119Z node 8 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1695: [72075186224037893][rt3.dc1--topic1] pipe [7:7567334470754698641:2482] disconnected no session
2025-10-31T10:42:36.007619Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [7:7567334470754698625:2482] (SourceId=source2, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-31T10:42:36.007642Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [7:7567334470754698625:2482] (SourceId=source2, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-10-31T10:42:36.007646Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [7:7567334470754698625:2482] (SourceId=source2, PreferedPartition=(NULL)) Start idle
2025-10-31T10:42:36.007655Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-31T10:42:36.008154Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 7, Generation: 1
2025-10-31T10:42:36.008177Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [7:7567334475049665950:2482], now have 1 active actors on pipe
2025-10-31T10:42:36.008186Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T10:42:36.008192Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T10:42:36.008218Z node 7 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie source2|319a1660-586dcc02-e8d82249-4a9e97d6_0 generated for partition 0 topic 'rt3.dc1--topic1' owner source2
2025-10-31T10:42:36.008233Z node 7 :PERSQUEUE DEBUG: partition.cpp:2272: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T10:42:36.008239Z node 7 :PERSQUEUE DEBUG: partition.cpp:2281: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T10:42:36.008242Z node 7 :PERSQUEUE DEBUG: partition.cpp:2285: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-31T10:42:36.008253Z node 7 :PERSQUEUE DEBUG: partition.cpp:2304: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T10:42:36.008272Z node 7 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-31T10:42:36.008295Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-31T10:42:36.008726Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T10:42:36.008743Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T10:42:36.008763Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-31T10:42:36.008800Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3 partition: 0 MaxSeqNo: 0 sessionId: source2|319a1660-586dcc02-e8d82249-4a9e97d6_0
2025-10-31T10:42:36.009428Z :INFO: [] MessageGroupId [source2] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1761907356009 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-31T10:42:36.009466Z :INFO: [] MessageGroupId [source2] SessionId [] Write session established. Init response: session_id: "source2|319a1660-586dcc02-e8d82249-4a9e97d6_0" topic: "topic1" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-31T10:42:36.009700Z :DEBUG: [] MessageGroupId [source2] SessionId [source2|319a1660-586dcc02-e8d82249-4a9e97d6_0] Write 1 messages with Id from 1 to 1
2025-10-31T10:42:36.009733Z :INFO: [] MessageGroupId [source2] SessionId [source2|319a1660-586dcc02-e8d82249-4a9e97d6_0] Write session: close. Timeout = 10000 ms
2025-10-31T10:42:36.014526Z :DEBUG: [] MessageGroupId [source2] SessionId [source2|319a1660-586dcc02-e8d82249-4a9e97d6_0] Write session: try to update token
2025-10-31T10:42:36.014546Z :DEBUG: [] MessageGroupId [source2] SessionId [source2|319a1660-586dcc02-e8d82249-4a9e97d6_0] Send 1 message(s) (0 left), first sequence number is 1
2025-10-31T10:42:36.017008Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3 sessionId: source2|319a1660-586dcc02-e8d82249-4a9e97d6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-31T10:42:36.017135Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-31T10:42:36.017284Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T10:42:36.017293Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T10:42:36.017322Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-31T10:42:36.017338Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-31T10:42:36.017453Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T10:42:36.017458Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T10:42:36.017475Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: '\0source2' SeqNo: 1 partNo : 0 messageNo: 1 size 1122 offset: -1
2025-10-31T10:42:36.017482Z node 7 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-31T10:42:36.017494Z node 7 :PERSQUEUE DEBUG: partition.cpp:2272: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T10:42:36.017502Z node 7 :PERSQUEUE DEBUG: partition.cpp:2281: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T10:42:36.017504Z node 7 :PERSQUEUE DEBUG: partition.cpp:2285: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-31T10:42:36.017537Z node 7 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId '\0source2' seqNo 1 partNo 0
2025-10-31T10:42:36.017577Z node 7 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '\0source2' seqNo 1 partNo 0 FormedBlobsCount 0 NewHead: Offset 2 PartNo 0 PackedSize 1197 count 1 nextOffset 3 batches 1
2025-10-31T10:42:36.017583Z node 7 :PERSQUEUE DEBUG: partition.cpp:2304: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T10:42:36.017630Z node 7 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 2,1 HeadOffset 2 endOffset 2 curOffset 3 d0000000000_00000000000000000002_00000_0000000001_00000? size 1185 WTime 1761907356016
2025-10-31T10:42:36.017654Z node 7 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-31T10:42:36.017665Z node 7 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 2 partNo 0 count 1 size 1185
2025-10-31T10:42:36.020276Z node 7 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 2 count 1 size 1185 actorID [7:7567334470754698339:2439]
2025-10-31T10:42:36.020300Z node 7 :PERSQUEUE DEBUG: partition.cpp:2099: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-31T10:42:36.020380Z node 7 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 2 partno 0 count 1 parts 0 suffix '63' size 1185
2025-10-31T10:42:36.020961Z node 7 :PERSQUEUE DEBUG: partition_write.cpp:490: [72075186224037892][Partition][0][StateIdle] Received TPartition::Handle TEvHandleWriteResponse.
2025-10-31T10:42:36.020993Z node 7 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1130 WriteNewSizeFromSupportivePartitions# 0
2025-10-31T10:42:36.021004Z node 7 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-31T10:42:36.021018Z node 7 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0source2', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 1, partNo: 0, Offset: 2 is stored on disk
2025-10-31T10:42:36.021068Z node 7 :PERSQUEUE DEBUG: partition.cpp:2272: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T10:42:36.021077Z node 7 :PERSQUEUE DEBUG: partition.cpp:2281: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T10:42:36.021079Z node 7 :PERSQUEUE DEBUG: partition.cpp:2304: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T10:42:36.021088Z node 7 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-31T10:42:36.021093Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 1 consumer shared/user session shared/user_7_1_190747618541107145_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 2 EndOffset 2 newEndOffset 3 commitOffset 0 clientCommitOffset 0 cookie 3 readingFinished 0 firstRead 0
2025-10-31T10:42:36.021100Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_7_1_190747618541107145_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 2 endOffset 3
2025-10-31T10:42:36.021102Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 1  requestId: <none> cookie: 1
2025-10-31T10:42:36.021116Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_7_1_190747618541107145_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 2, endOffset# 3, WTime# 1761907355897, sizeLag# 1185
2025-10-31T10:42:36.021119Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_7_1_190747618541107145_v1TEvPartitionReady. Aval parts: 1
2025-10-31T10:42:36.021125Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-31T10:42:36.021134Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_7_1_190747618541107145_v1 performing read request: guid# a4ffa871-1ebd9cd8-2ae2ad86-46f1ce1b, from# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), count# 1, size# 1422, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-31T10:42:36.021154Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_7_1_190747618541107145_v1 READ FROM TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1)maxCount 1 maxSize 1422 maxTimeLagMs 0 readTimestampMs 0 readOffset 2 EndOffset 3 ClientCommitOffset 0 committedOffset 0 Guid a4ffa871-1ebd9cd8-2ae2ad86-46f1ce1b
2025-10-31T10:42:36.021431Z :DEBUG: [] MessageGroupId [source2] SessionId [source2|319a1660-586dcc02-e8d82249-4a9e97d6_0] Write session got write response: sequence_numbers: 1 offsets: 2 already_written: false write_statistics { persist_duration_ms: 4 }
2025-10-31T10:42:36.021442Z :DEBUG: [] MessageGroupId [source2] SessionId [source2|319a1660-586dcc02-e8d82249-4a9e97d6_0] Write session: acknoledged message 1
2025-10-31T10:42:36.024309Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T10:42:36.024331Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T10:42:36.024379Z node 7 :PERSQUEUE DEBUG: partition_read.cpp:883: [72075186224037892][Partition][0][StateIdle] read cookie 6 Topic 'rt3.dc1--topic1' partition 0 user user offset 2 count 1 size 1422 endOffset 3 max time lag 0ms effective offset 2
2025-10-31T10:42:36.024403Z node 7 :PERSQUEUE DEBUG: partition_read.cpp:1097: [72075186224037892][Partition][0][StateIdle] read cookie 6 added 1 blobs, size 1185 count 1 last offset 2, current partition end offset: 3
2025-10-31T10:42:36.024408Z node 7 :PERSQUEUE DEBUG: partition_read.cpp:1123: [72075186224037892][Partition][0][StateIdle] Reading cookie 6. Send blob request.
2025-10-31T10:42:36.024421Z node 7 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 2 partno 0 count 1 parts_count 0 source 1 size 1185 accessed 0 times before, last time 2025-10-31T10:42:36.000000Z
2025-10-31T10:42:36.024435Z node 7 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 6. All 1 blobs are from cache.
2025-10-31T10:42:36.024451Z node 7 :PERSQUEUE DEBUG: partition_read.cpp:581: FormAnswer for 1 blobs
2025-10-31T10:42:36.024469Z node 7 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 2 totakecount 1 count 1 size 1165 from pos 0 cbcount 1
2025-10-31T10:42:36.024502Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 2
2025-10-31T10:42:36.024595Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_7_1_190747618541107145_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 3 Result { Offset: 2 Data: "... 1122 bytes ..." SourceId: "\000source2" SeqNo: 1 WriteTimestampMS: 1761907356016 CreateTimestampMS: 1761907356009 UncompressedSize: 1047552 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 20 RealReadOffset: 2 WaitQuotaTimeMs: 0 EndOffset: 3 StartOffset: 0 } Cookie: 2 }
2025-10-31T10:42:36.024625Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_7_1_190747618541107145_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 4 from offset 3
2025-10-31T10:42:36.024636Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_7_1_190747618541107145_v1 after read state TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 3 ReadOffset 3 ReadGuid a4ffa871-1ebd9cd8-2ae2ad86-46f1ce1b has messages 1
2025-10-31T10:42:36.024647Z node 7 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 2 partno 0 count 1 parts 0 suffix '63'
2025-10-31T10:42:36.024670Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_7_1_190747618541107145_v1 read done: guid# a4ffa871-1ebd9cd8-2ae2ad86-46f1ce1b, partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), size# 1224
2025-10-31T10:42:36.024678Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_7_1_190747618541107145_v1 response to read: guid# a4ffa871-1ebd9cd8-2ae2ad86-46f1ce1b
2025-10-31T10:42:36.024817Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_7_1_190747618541107145_v1 Process answer. Aval parts: 0
2025-10-31T10:42:36.025073Z :DEBUG: [] [] [f78ceb12-4438829-f5e170b5-da18a51d] [null] After sending read request: ReadSizeBudget = 2621440, ReadSizeServerDelta = 0
2025-10-31T10:42:36.025144Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_7_1_190747618541107145_v1 grpc read done: success# 1, data# { read { } }
2025-10-31T10:42:36.025191Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_7_1_190747618541107145_v1 got read request: guid# 93b9f127-c36dd42b-3c8c7e6a-16da2f18
2025-10-31T10:42:36.097057Z node 7 :PERSQUEUE DEBUG: partition.cpp:2272: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T10:42:36.097072Z node 7 :PERSQUEUE DEBUG: partition.cpp:2281: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T10:42:36.097074Z node 7 :PERSQUEUE DEBUG: partition.cpp:2304: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T10:42:36.109810Z :INFO: [] MessageGroupId [source2] SessionId [source2|319a1660-586dcc02-e8d82249-4a9e97d6_0] Write session will now close
2025-10-31T10:42:36.109835Z :DEBUG: [] MessageGroupId [source2] SessionId [source2|319a1660-586dcc02-e8d82249-4a9e97d6_0] Write session: aborting
2025-10-31T10:42:36.110146Z :INFO: [] MessageGroupId [source2] SessionId [source2|319a1660-586dcc02-e8d82249-4a9e97d6_0] Write session: gracefully shut down, all writes complete
2025-10-31T10:42:36.110161Z :DEBUG: [] MessageGroupId [source2] SessionId [source2|319a1660-586dcc02-e8d82249-4a9e97d6_0] Write session is aborting and will not restart
2025-10-31T10:42:36.110184Z :DEBUG: [] MessageGroupId [source2] SessionId [source2|319a1660-586dcc02-e8d82249-4a9e97d6_0] Write session: destroy
2025-10-31T10:42:36.110450Z :DEBUG: [] MessageGroupId [source3] SessionId [] Write session: try to update token
2025-10-31T10:42:36.110631Z :INFO: [] MessageGroupId [source3] SessionId [] Write session: Do CDS request
2025-10-31T10:42:36.110637Z :INFO: [] MessageGroupId [source3] SessionId [] Start write session. Will connect to endpoint: localhost:2244
2025-10-31T10:42:36.110733Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3 sessionId: source2|319a1660-586dcc02-e8d82249-4a9e97d6_0 grpc read done: success: 0 data: 
2025-10-31T10:42:36.110748Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 3 sessionId: source2|319a1660-586dcc02-e8d82249-4a9e97d6_0 grpc read failed
2025-10-31T10:42:36.110767Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 3 sessionId: source2|319a1660-586dcc02-e8d82249-4a9e97d6_0 grpc closed
2025-10-31T10:42:36.110775Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3 sessionId: source2|319a1660-586dcc02-e8d82249-4a9e97d6_0 is DEAD
2025-10-31T10:42:36.111003Z :DEBUG: [] MessageGroupId [source3] SessionId [] Write session: send init request: init_request { topic: "topic1" message_group_id: "source3" }
2025-10-31T10:42:36.111062Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-10-31T10:42:36.111176Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [7:7567334475049665950:2482] destroyed
2025-10-31T10:42:36.111195Z node 7 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-10-31T10:42:36.111207Z node 7 :PERSQUEUE DEBUG: partition.cpp:2272: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T10:42:36.111210Z node 7 :PERSQUEUE DEBUG: partition.cpp:2281: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T10:42:36.111212Z node 7 :PERSQUEUE DEBUG: partition.cpp:2304: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T10:42:36.112170Z node 7 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-31T10:42:36.112184Z node 7 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 4
2025-10-31T10:42:36.112294Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 4 sessionId:  grpc read done: success: 1 data: init_request { topic: "topic1" message_group_id: "source3" }
2025-10-31T10:42:36.112321Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 4 topic: "topic1" message_group_id: "source3" from ipv6:[::1]:59884
2025-10-31T10:42:36.112330Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=4 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:59884 proto=v1  topic=topic1 durationSec=0
2025-10-31T10:42:36.112338Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-31T10:42:36.112824Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 4 sessionId:  describe result for acl check
2025-10-31T10:42:36.112865Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-31T10:42:36.112867Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-31T10:42:36.112869Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-31T10:42:36.112874Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [7:7567334475049665967:2486] (SourceId=source3, PreferedPartition=(NULL)) StartKqpSession
2025-10-31T10:42:36.113506Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [7:7567334475049665967:2486] (SourceId=source3, PreferedPartition=(NULL)) Select from the table
2025-10-31T10:42:36.116099Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [7:7567334475049665967:2486] (SourceId=source3, PreferedPartition=(NULL)) RequestPQRB
2025-10-31T10:42:36.116267Z node 8 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1655: [72075186224037893][rt3.dc1--topic1] pipe [7:7567334475049665986:2486] connected; active server actors: 1
2025-10-31T10:42:36.116422Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [7:7567334475049665967:2486] (SourceId=source3, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=source3
2025-10-31T10:42:36.116434Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [7:7567334475049665967:2486] (SourceId=source3, PreferedPartition=(NULL)) Update the table
2025-10-31T10:42:36.116548Z node 8 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1659: [72075186224037893][rt3.dc1--topic1] pipe [7:7567334475049665986:2486] disconnected.
2025-10-31T10:42:36.116559Z node 8 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1670: [72075186224037893][rt3.dc1--topic1] pipe [7:7567334475049665986:2486] disconnected; active server actors: 1
2025-10-31T10:42:36.116562Z node 8 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1695: [72075186224037893][rt3.dc1--topic1] pipe [7:7567334475049665986:2486] disconnected no session
2025-10-31T10:42:36.123937Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [7:7567334475049665967:2486] (SourceId=source3, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-31T10:42:36.123956Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [7:7567334475049665967:2486] (SourceId=source3, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-10-31T10:42:36.123959Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [7:7567334475049665967:2486] (SourceId=source3, PreferedPartition=(NULL)) Start idle
2025-10-31T10:42:36.123968Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 4 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-31T10:42:36.124131Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 7, Generation: 1
2025-10-31T10:42:36.124150Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [7:7567334475049666000:2486], now have 1 active actors on pipe
2025-10-31T10:42:36.124156Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T10:42:36.124167Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T10:42:36.124194Z node 7 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie source3|b76c2867-2acca0f3-97f3ad44-6bf11f54_0 generated for partition 0 topic 'rt3.dc1--topic1' owner source3
2025-10-31T10:42:36.124208Z node 7 :PERSQUEUE DEBUG: partition.cpp:2272: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T10:42:36.124216Z node 7 :PERSQUEUE DEBUG: partition.cpp:2281: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T10:42:36.124220Z node 7 :PERSQUEUE DEBUG: partition.cpp:2285: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-31T10:42:36.124238Z node 7 :PERSQUEUE DEBUG: partition.cpp:2304: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T10:42:36.124266Z node 7 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-31T10:42:36.124292Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-31T10:42:36.124326Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T10:42:36.124330Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T10:42:36.124341Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-31T10:42:36.124366Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 4 partition: 0 MaxSeqNo: 0 sessionId: source3|b76c2867-2acca0f3-97f3ad44-6bf11f54_0
2025-10-31T10:42:36.124704Z :INFO: [] MessageGroupId [source3] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1761907356124 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-31T10:42:36.124759Z :INFO: [] MessageGroupId [source3] SessionId [] Write session established. Init response: session_id: "source3|b76c2867-2acca0f3-97f3ad44-6bf11f54_0" topic: "topic1" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-31T10:42:36.128932Z :DEBUG: [] MessageGroupId [source3] SessionId [source3|b76c2867-2acca0f3-97f3ad44-6bf11f54_0] Write 1 messages with Id from 1 to 1
2025-10-31T10:42:36.128985Z :INFO: [] MessageGroupId [source3] SessionId [source3|b76c2867-2acca0f3-97f3ad44-6bf11f54_0] Write session: close. Timeout = 10000 ms
2025-10-31T10:42:36.134852Z :DEBUG: [] MessageGroupId [source3] SessionId [source3|b76c2867-2acca0f3-97f3ad44-6bf11f54_0] Write session: try to update token
2025-10-31T10:42:36.134879Z :DEBUG: [] MessageGroupId [source3] SessionId [source3|b76c2867-2acca0f3-97f3ad44-6bf11f54_0] Send 1 message(s) (0 left), first sequence number is 1
2025-10-31T10:42:36.140777Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 4 sessionId: source3|b76c2867-2acca0f3-97f3ad44-6bf11f54_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-31T10:42:36.140971Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-31T10:42:36.141251Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T10:42:36.141265Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T10:42:36.141302Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-31T10:42:36.141325Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-31T10:42:36.141452Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T10:42:36.141458Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T10:42:36.141478Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: '\0source3' SeqNo: 1 partNo : 0 messageNo: 1 size 1122 offset: -1
2025-10-31T10:42:36.141486Z node 7 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-31T10:42:36.141501Z node 7 :PERSQUEUE DEBUG: partition.cpp:2272: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T10:42:36.141510Z node 7 :PERSQUEUE DEBUG: partition.cpp:2281: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T10:42:36.141514Z node 7 :PERSQUEUE DEBUG: partition.cpp:2285: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-31T10:42:36.141549Z node 7 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId '\0source3' seqNo 1 partNo 0
2025-10-31T10:42:36.141602Z node 7 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '\0source3' seqNo 1 partNo 0 FormedBlobsCount 0 NewHead: Offset 3 PartNo 0 PackedSize 1197 count 1 nextOffset 4 batches 1
2025-10-31T10:42:36.141608Z node 7 :PERSQUEUE DEBUG: partition.cpp:2304: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T10:42:36.141661Z node 7 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 3,1 HeadOffset 3 endOffset 3 curOffset 4 d0000000000_00000000000000000003_00000_0000000001_00000? size 1185 WTime 1761907356141
2025-10-31T10:42:36.141687Z node 7 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-31T10:42:36.141699Z node 7 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 3 partNo 0 count 1 size 1185
2025-10-31T10:42:36.150004Z node 7 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 3 count 1 size 1185 actorID [7:7567334470754698339:2439]
2025-10-31T10:42:36.150032Z node 7 :PERSQUEUE DEBUG: partition.cpp:2099: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-31T10:42:36.150056Z node 7 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1130 WriteNewSizeFromSupportivePartitions# 0
2025-10-31T10:42:36.150067Z node 7 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-31T10:42:36.150080Z node 7 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0source3', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 1, partNo: 0, Offset: 3 is stored on disk
2025-10-31T10:42:36.150121Z node 7 :PERSQUEUE DEBUG: partition.cpp:2272: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T10:42:36.150124Z node 7 :PERSQUEUE DEBUG: partition.cpp:2281: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T10:42:36.150127Z node 7 :PERSQUEUE DEBUG: partition.cpp:2304: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T10:42:36.150139Z node 7 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-31T10:42:36.150152Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 1  requestId: <none> cookie: 1
2025-10-31T10:42:36.150177Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 1 consumer shared/user session shared/user_7_1_190747618541107145_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 3 EndOffset 3 newEndOffset 4 commitOffset 0 clientCommitOffset 0 cookie 4 readingFinished 0 firstRead 0
2025-10-31T10:42:36.150182Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_7_1_190747618541107145_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 3 endOffset 4
2025-10-31T10:42:36.150194Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-31T10:42:36.150381Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_7_1_190747618541107145_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 3, endOffset# 4, WTime# 1761907356016, sizeLag# 1185
2025-10-31T10:42:36.150384Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_7_1_190747618541107145_v1TEvPartitionReady. Aval parts: 1
2025-10-31T10:42:36.150398Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_7_1_190747618541107145_v1 performing read request: guid# 93b9f127-c36dd42b-3c8c7e6a-16da2f18, from# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), count# 1, size# 1422, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-31T10:42:36.150413Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_7_1_190747618541107145_v1 READ FROM TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1)maxCount 1 maxSize 1422 maxTimeLagMs 0 readTimestampMs 0 readOffset 3 EndOffset 4 ClientCommitOffset 0 committedOffset 0 Guid 93b9f127-c36dd42b-3c8c7e6a-16da2f18
2025-10-31T10:42:36.150760Z :DEBUG: [] MessageGroupId [source3] SessionId [source3|b76c2867-2acca0f3-97f3ad44-6bf11f54_0] Write session got write response: sequence_numbers: 1 offsets: 3 already_written: false write_statistics { persist_duration_ms: 8 }
2025-10-31T10:42:36.150731Z node 7 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 3 partno 0 count 1 parts 0 suffix '63' size 1185
2025-10-31T10:42:36.150774Z :DEBUG: [] MessageGroupId [source3] SessionId [source3|b76c2867-2acca0f3-97f3ad44-6bf11f54_0] Write session: acknoledged message 1
2025-10-31T10:42:36.150837Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T10:42:36.150847Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T10:42:36.150881Z node 7 :PERSQUEUE DEBUG: partition_read.cpp:883: [72075186224037892][Partition][0][StateIdle] read cookie 7 Topic 'rt3.dc1--topic1' partition 0 user user offset 3 count 1 size 1422 endOffset 4 max time lag 0ms effective offset 3
2025-10-31T10:42:36.150900Z node 7 :PERSQUEUE DEBUG: partition_read.cpp:1097: [72075186224037892][Partition][0][StateIdle] read cookie 7 added 1 blobs, size 1185 count 1 last offset 3, current partition end offset: 4
2025-10-31T10:42:36.150903Z node 7 :PERSQUEUE DEBUG: partition_read.cpp:1123: [72075186224037892][Partition][0][StateIdle] Reading cookie 7. Send blob request.
2025-10-31T10:42:36.150913Z node 7 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 3 partno 0 count 1 parts_count 0 source 1 size 1185 accessed 0 times before, last time 2025-10-31T10:42:36.000000Z
2025-10-31T10:42:36.150925Z node 7 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 7. All 1 blobs are from cache.
2025-10-31T10:42:36.150939Z node 7 :PERSQUEUE DEBUG: partition_read.cpp:581: FormAnswer for 1 blobs
2025-10-31T10:42:36.150954Z node 7 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 3 totakecount 1 count 1 size 1165 from pos 0 cbcount 1
2025-10-31T10:42:36.150980Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 3
2025-10-31T10:42:36.151052Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_7_1_190747618541107145_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 4 Result { Offset: 3 Data: "... 1122 bytes ..." SourceId: "\000source3" SeqNo: 1 WriteTimestampMS: 1761907356141 CreateTimestampMS: 1761907356128 UncompressedSize: 1047552 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 20 RealReadOffset: 3 WaitQuotaTimeMs: 0 EndOffset: 4 StartOffset: 0 } Cookie: 3 }
2025-10-31T10:42:36.151082Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_7_1_190747618541107145_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 5 from offset 4
2025-10-31T10:42:36.151091Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_7_1_190747618541107145_v1 after read state TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 4 ReadOffset 4 ReadGuid 93b9f127-c36dd42b-3c8c7e6a-16da2f18 has messages 1
2025-10-31T10:42:36.151113Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_7_1_190747618541107145_v1 read done: guid# 93b9f127-c36dd42b-3c8c7e6a-16da2f18, partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), size# 1224
2025-10-31T10:42:36.151120Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_7_1_190747618541107145_v1 response to read: guid# 93b9f127-c36dd42b-3c8c7e6a-16da2f18
2025-10-31T10:42:36.151200Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_7_1_190747618541107145_v1 Process answer. Aval parts: 0
2025-10-31T10:42:36.151471Z :DEBUG: [] [] [f78ceb12-4438829-f5e170b5-da18a51d] [null] After sending read request: ReadSizeBudget = 2621440, ReadSizeServerDelta = 0
2025-10-31T10:42:36.151464Z node 7 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 3 partno 0 count 1 parts 0 suffix '63'
2025-10-31T10:42:36.152760Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_7_1_190747618541107145_v1 grpc read done: success# 1, data# { read { } }
2025-10-31T10:42:36.152822Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_7_1_190747618541107145_v1 got read request: guid# 679a0c25-d0d59948-44992e87-6b46a221
2025-10-31T10:42:36.198723Z node 7 :PERSQUEUE DEBUG: partition.cpp:2272: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T10:42:36.198739Z node 7 :PERSQUEUE DEBUG: partition.cpp:2281: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T10:42:36.198743Z node 7 :PERSQUEUE DEBUG: partition.cpp:2304: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T10:42:36.229098Z :INFO: [] MessageGroupId [source3] SessionId [source3|b76c2867-2acca0f3-97f3ad44-6bf11f54_0] Write session will now close
2025-10-31T10:42:36.229124Z :DEBUG: [] MessageGroupId [source3] SessionId [source3|b76c2867-2acca0f3-97f3ad44-6bf11f54_0] Write session: aborting
2025-10-31T10:42:36.229307Z :INFO: [] MessageGroupId [source3] SessionId [source3|b76c2867-2acca0f3-97f3ad44-6bf11f54_0] Write session: gracefully shut down, all writes complete
2025-10-31T10:42:36.229326Z :DEBUG: [] MessageGroupId [source3] SessionId [source3|b76c2867-2acca0f3-97f3ad44-6bf11f54_0] Write session: destroy
2025-10-31T10:42:36.229608Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 4 sessionId: source3|b76c2867-2acca0f3-97f3ad44-6bf11f54_0 grpc read done: success: 0 data: 
2025-10-31T10:42:36.229625Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 4 sessionId: source3|b76c2867-2acca0f3-97f3ad44-6bf11f54_0 grpc read failed
2025-10-31T10:42:36.229635Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 4 sessionId: source3|b76c2867-2acca0f3-97f3ad44-6bf11f54_0 grpc closed
2025-10-31T10:42:36.229642Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 4 sessionId: source3|b76c2867-2acca0f3-97f3ad44-6bf11f54_0 is DEAD
2025-10-31T10:42:36.229896Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-10-31T10:42:36.229949Z :DEBUG: [] MessageGroupId [source4] SessionId [] Write session: try to update token
2025-10-31T10:42:36.229959Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [7:7567334475049666000:2486] destroyed
2025-10-31T10:42:36.229978Z node 7 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-10-31T10:42:36.229991Z node 7 :PERSQUEUE DEBUG: partition.cpp:2272: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T10:42:36.229994Z node 7 :PERSQUEUE DEBUG: partition.cpp:2281: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T10:42:36.229996Z node 7 :PERSQUEUE DEBUG: partition.cpp:2304: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T10:42:36.230155Z :INFO: [] MessageGroupId [source4] SessionId [] Write session: Do CDS request
2025-10-31T10:42:36.230162Z :INFO: [] MessageGroupId [source4] SessionId [] Start write session. Will connect to endpoint: localhost:2244
2025-10-31T10:42:36.231077Z :DEBUG: [] MessageGroupId [source4] SessionId [] Write session: send init request: init_request { topic: "topic1" message_group_id: "source4" }
2025-10-31T10:42:36.231782Z node 7 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-31T10:42:36.231799Z node 7 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 5
2025-10-31T10:42:36.231944Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 5 sessionId:  grpc read done: success: 1 data: init_request { topic: "topic1" message_group_id: "source4" }
2025-10-31T10:42:36.231975Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 5 topic: "topic1" message_group_id: "source4" from ipv6:[::1]:59884
2025-10-31T10:42:36.231984Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=5 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:59884 proto=v1  topic=topic1 durationSec=0
2025-10-31T10:42:36.231988Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-31T10:42:36.232434Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 5 sessionId:  describe result for acl check
2025-10-31T10:42:36.232468Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-31T10:42:36.232473Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-31T10:42:36.232474Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-31T10:42:36.232479Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [7:7567334475049666011:2490] (SourceId=source4, PreferedPartition=(NULL)) StartKqpSession
2025-10-31T10:42:36.233134Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [7:7567334475049666011:2490] (SourceId=source4, PreferedPartition=(NULL)) Select from the table
2025-10-31T10:42:36.235983Z node 8 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1655: [72075186224037893][rt3.dc1--topic1] pipe [7:7567334475049666027:2490] connected; active server actors: 1
2025-10-31T10:42:36.236841Z node 8 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1659: [72075186224037893][rt3.dc1--topic1] pipe [7:7567334475049666027:2490] disconnected.
2025-10-31T10:42:36.236863Z node 8 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1670: [72075186224037893][rt3.dc1--topic1] pipe [7:7567334475049666027:2490] disconnected; active server actors: 1
2025-10-31T10:42:36.236866Z node 8 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1695: [72075186224037893][rt3.dc1--topic1] pipe [7:7567334475049666027:2490] disconnected no session
2025-10-31T10:42:36.235432Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [7:7567334475049666011:2490] (SourceId=source4, PreferedPartition=(NULL)) RequestPQRB
2025-10-31T10:42:36.236247Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [7:7567334475049666011:2490] (SourceId=source4, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=source4
2025-10-31T10:42:36.236252Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [7:7567334475049666011:2490] (SourceId=source4, PreferedPartition=(NULL)) Update the table
2025-10-31T10:42:36.240248Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [7:7567334475049666011:2490] (SourceId=source4, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-31T10:42:36.240265Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [7:7567334475049666011:2490] (SourceId=source4, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-10-31T10:42:36.240270Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [7:7567334475049666011:2490] (SourceId=source4, PreferedPartition=(NULL)) Start idle
2025-10-31T10:42:36.240279Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 5 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-31T10:42:36.240477Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 7, Generation: 1
2025-10-31T10:42:36.240482Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [7:7567334475049666041:2490], now have 1 active actors on pipe
2025-10-31T10:42:36.240490Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T10:42:36.240496Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T10:42:36.240523Z node 7 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie source4|deec1c07-584dd4e3-10a92890-f4e04ce0_0 generated for partition 0 topic 'rt3.dc1--topic1' owner source4
2025-10-31T10:42:36.240539Z node 7 :PERSQUEUE DEBUG: partition.cpp:2272: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T10:42:36.240543Z node 7 :PERSQUEUE DEBUG: partition.cpp:2281: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T10:42:36.240547Z node 7 :PERSQUEUE DEBUG: partition.cpp:2285: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-31T10:42:36.240556Z node 7 :PERSQUEUE DEBUG: partition.cpp:2304: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T10:42:36.240568Z node 7 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-31T10:42:36.240585Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-31T10:42:36.240635Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T10:42:36.240646Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T10:42:36.240670Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-31T10:42:36.240725Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 5 partition: 0 MaxSeqNo: 0 sessionId: source4|deec1c07-584dd4e3-10a92890-f4e04ce0_0
2025-10-31T10:42:36.241098Z :INFO: [] MessageGroupId [source4] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1761907356241 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-31T10:42:36.241136Z :INFO: [] MessageGroupId [source4] SessionId [] Write session established. Init response: session_id: "source4|deec1c07-584dd4e3-10a92890-f4e04ce0_0" topic: "topic1" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-31T10:42:36.241473Z :DEBUG: [] MessageGroupId [source4] SessionId [source4|deec1c07-584dd4e3-10a92890-f4e04ce0_0] Write 1 messages with Id from 1 to 1
2025-10-31T10:42:36.241525Z :INFO: [] MessageGroupId [source4] SessionId [source4|deec1c07-584dd4e3-10a92890-f4e04ce0_0] Write session: close. Timeout = 10000 ms
2025-10-31T10:42:36.247194Z :DEBUG: [] MessageGroupId [source4] SessionId [source4|deec1c07-584dd4e3-10a92890-f4e04ce0_0] Write session: try to update token
2025-10-31T10:42:36.247220Z :DEBUG: [] MessageGroupId [source4] SessionId [source4|deec1c07-584dd4e3-10a92890-f4e04ce0_0] Send 1 message(s) (0 left), first sequence number is 1
2025-10-31T10:42:36.247643Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 5 sessionId: source4|deec1c07-584dd4e3-10a92890-f4e04ce0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-31T10:42:36.247811Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-31T10:42:36.247884Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T10:42:36.247900Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T10:42:36.247937Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-31T10:42:36.247967Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-31T10:42:36.248699Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T10:42:36.248727Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T10:42:36.248748Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: '\0source4' SeqNo: 1 partNo : 0 messageNo: 1 size 1122 offset: -1
2025-10-31T10:42:36.248759Z node 7 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-31T10:42:36.248777Z node 7 :PERSQUEUE DEBUG: partition.cpp:2272: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T10:42:36.248785Z node 7 :PERSQUEUE DEBUG: partition.cpp:2281: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T10:42:36.248789Z node 7 :PERSQUEUE DEBUG: partition.cpp:2285: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-31T10:42:36.248822Z node 7 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId '\0source4' seqNo 1 partNo 0
2025-10-31T10:42:36.248870Z node 7 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '\0source4' seqNo 1 partNo 0 FormedBlobsCount 0 NewHead: Offset 4 PartNo 0 PackedSize 1197 count 1 nextOffset 5 batches 1
2025-10-31T10:42:36.248878Z node 7 :PERSQUEUE DEBUG: partition.cpp:2304: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T10:42:36.248930Z node 7 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 4,1 HeadOffset 4 endOffset 4 curOffset 5 d0000000000_00000000000000000004_00000_0000000001_00000? size 1185 WTime 1761907356248
2025-10-31T10:42:36.248957Z node 7 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-31T10:42:36.248969Z node 7 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 4 partNo 0 count 1 size 1185
2025-10-31T10:42:36.251036Z node 7 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 4 count 1 size 1185 actorID [7:7567334470754698339:2439]
2025-10-31T10:42:36.251077Z node 7 :PERSQUEUE DEBUG: partition.cpp:2099: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-31T10:42:36.251762Z :DEBUG: [] MessageGroupId [source4] SessionId [source4|deec1c07-584dd4e3-10a92890-f4e04ce0_0] Write session got write response: sequence_numbers: 1 offsets: 4 already_written: false write_statistics { persist_duration_ms: 2 }
2025-10-31T10:42:36.251777Z :DEBUG: [] MessageGroupId [source4] SessionId [source4|deec1c07-584dd4e3-10a92890-f4e04ce0_0] Write session: acknoledged message 1
2025-10-31T10:42:36.251102Z node 7 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1130 WriteNewSizeFromSupportivePartitions# 0
2025-10-31T10:42:36.251121Z node 7 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-31T10:42:36.252117Z :DEBUG: [] [] [f78ceb12-4438829-f5e170b5-da18a51d] [null] After sending read request: ReadSizeBudget = 2621440, ReadSizeServerDelta = 0
2025-10-31T10:42:36.251136Z node 7 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0source4', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 1, partNo: 0, Offset: 4 is stored on disk
2025-10-31T10:42:36.251193Z node 7 :PERSQUEUE DEBUG: partition.cpp:2272: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T10:42:36.251196Z node 7 :PERSQUEUE DEBUG: partition.cpp:2281: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T10:42:36.251198Z node 7 :PERSQUEUE DEBUG: partition.cpp:2304: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T10:42:36.251211Z node 7 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-31T10:42:36.251233Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 1  requestId: <none> cookie: 1
2025-10-31T10:42:36.251259Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-31T10:42:36.251273Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 1 consumer shared/user session shared/user_7_1_190747618541107145_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 4 EndOffset 4 newEndOffset 5 commitOffset 0 clientCommitOffset 0 cookie 5 readingFinished 0 firstRead 0
2025-10-31T10:42:36.251286Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_7_1_190747618541107145_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 4 endOffset 5
2025-10-31T10:42:36.251306Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_7_1_190747618541107145_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 4, endOffset# 5, WTime# 1761907356141, sizeLag# 1185
2025-10-31T10:42:36.251309Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_7_1_190747618541107145_v1TEvPartitionReady. Aval parts: 1
2025-10-31T10:42:36.251326Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_7_1_190747618541107145_v1 performing read request: guid# 679a0c25-d0d59948-44992e87-6b46a221, from# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), count# 1, size# 1422, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-31T10:42:36.251344Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_7_1_190747618541107145_v1 READ FROM TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1)maxCount 1 maxSize 1422 maxTimeLagMs 0 readTimestampMs 0 readOffset 4 EndOffset 5 ClientCommitOffset 0 committedOffset 0 Guid 679a0c25-d0d59948-44992e87-6b46a221
2025-10-31T10:42:36.251413Z node 7 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 4 partno 0 count 1 parts 0 suffix '63' size 1185
2025-10-31T10:42:36.251462Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T10:42:36.251470Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T10:42:36.251510Z node 7 :PERSQUEUE DEBUG: partition_read.cpp:883: [72075186224037892][Partition][0][StateIdle] read cookie 8 Topic 'rt3.dc1--topic1' partition 0 user user offset 4 count 1 size 1422 endOffset 5 max time lag 0ms effective offset 4
2025-10-31T10:42:36.251532Z node 7 :PERSQUEUE DEBUG: partition_read.cpp:1097: [72075186224037892][Partition][0][StateIdle] read cookie 8 added 1 blobs, size 1185 count 1 last offset 4, current partition end offset: 5
2025-10-31T10:42:36.251538Z node 7 :PERSQUEUE DEBUG: partition_read.cpp:1123: [72075186224037892][Partition][0][StateIdle] Reading cookie 8. Send blob request.
2025-10-31T10:42:36.251550Z node 7 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 4 partno 0 count 1 parts_count 0 source 1 size 1185 accessed 0 times before, last time 2025-10-31T10:42:36.000000Z
2025-10-31T10:42:36.251562Z node 7 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 8. All 1 blobs are from cache.
2025-10-31T10:42:36.251579Z node 7 :PERSQUEUE DEBUG: partition_read.cpp:581: FormAnswer for 1 blobs
2025-10-31T10:42:36.251596Z node 7 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 4 totakecount 1 count 1 size 1165 from pos 0 cbcount 1
2025-10-31T10:42:36.251624Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 4
2025-10-31T10:42:36.251687Z node 7 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 4 partno 0 count 1 parts 0 suffix '63'
2025-10-31T10:42:36.251735Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_7_1_190747618541107145_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 5 Result { Offset: 4 Data: "... 1122 bytes ..." SourceId: "\000source4" SeqNo: 1 WriteTimestampMS: 1761907356248 CreateTimestampMS: 1761907356241 UncompressedSize: 1047552 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 20 RealReadOffset: 4 WaitQuotaTimeMs: 0 EndOffset: 5 StartOffset: 0 } Cookie: 4 }
2025-10-31T10:42:36.251774Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_7_1_190747618541107145_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 6 from offset 5
2025-10-31T10:42:36.251784Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_7_1_190747618541107145_v1 after read state TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 5 ReadOffset 5 ReadGuid 679a0c25-d0d59948-44992e87-6b46a221 has messages 1
2025-10-31T10:42:36.251828Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_7_1_190747618541107145_v1 read done: guid# 679a0c25-d0d59948-44992e87-6b46a221, partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), size# 1224
2025-10-31T10:42:36.251837Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_7_1_190747618541107145_v1 response to read: guid# 679a0c25-d0d59948-44992e87-6b46a221
2025-10-31T10:42:36.251933Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_7_1_190747618541107145_v1 Process answer. Aval parts: 0
2025-10-31T10:42:36.252230Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_7_1_190747618541107145_v1 grpc read done: success# 1, data# { read { } }
2025-10-31T10:42:36.252265Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_7_1_190747618541107145_v1 got read request: guid# c899d1ea-512eda35-8efd2506-ba3c9269
2025-10-31T10:42:36.298764Z node 7 :PERSQUEUE DEBUG: partition.cpp:2272: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T10:42:36.298783Z node 7 :PERSQUEUE DEBUG: partition.cpp:2281: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T10:42:36.298786Z node 7 :PERSQUEUE DEBUG: partition.cpp:2304: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T10:42:36.341632Z :INFO: [] MessageGroupId [source4] SessionId [source4|deec1c07-584dd4e3-10a92890-f4e04ce0_0] Write session will now close
2025-10-31T10:42:36.341657Z :DEBUG: [] MessageGroupId [source4] SessionId [source4|deec1c07-584dd4e3-10a92890-f4e04ce0_0] Write session: aborting
2025-10-31T10:42:36.341916Z :INFO: [] MessageGroupId [source4] SessionId [source4|deec1c07-584dd4e3-10a92890-f4e04ce0_0] Write session: gracefully shut down, all writes complete
2025-10-31T10:42:36.341942Z :DEBUG: [] MessageGroupId [source4] SessionId [source4|deec1c07-584dd4e3-10a92890-f4e04ce0_0] Write session: destroy
2025-10-31T10:42:36.342166Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 5 sessionId: source4|deec1c07-584dd4e3-10a92890-f4e04ce0_0 grpc read done: success: 0 data: 
2025-10-31T10:42:36.342183Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 5 sessionId: source4|deec1c07-584dd4e3-10a92890-f4e04ce0_0 grpc read failed
2025-10-31T10:42:36.342195Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 5 sessionId: source4|deec1c07-584dd4e3-10a92890-f4e04ce0_0 grpc closed
2025-10-31T10:42:36.342202Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 5 sessionId: source4|deec1c07-584dd4e3-10a92890-f4e04ce0_0 is DEAD
2025-10-31T10:42:36.342543Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-10-31T10:42:36.342594Z :DEBUG: [] MessageGroupId [source5] SessionId [] Write session: try to update token
2025-10-31T10:42:36.342627Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [7:7567334475049666041:2490] destroyed
2025-10-31T10:42:36.342649Z node 7 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-10-31T10:42:36.342660Z node 7 :PERSQUEUE DEBUG: partition.cpp:2272: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T10:42:36.342666Z node 7 :PERSQUEUE DEBUG: partition.cpp:2281: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T10:42:36.342668Z node 7 :PERSQUEUE DEBUG: partition.cpp:2304: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T10:42:36.342766Z :INFO: [] MessageGroupId [source5] SessionId [] Write session: Do CDS request
2025-10-31T10:42:36.342773Z :INFO: [] MessageGroupId [source5] SessionId [] Start write session. Will connect to endpoint: localhost:2244
2025-10-31T10:42:36.344179Z :DEBUG: [] MessageGroupId [source5] SessionId [] Write session: send init request: init_request { topic: "topic1" message_group_id: "source5" }
2025-10-31T10:42:36.344326Z node 7 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-31T10:42:36.344341Z node 7 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 6
2025-10-31T10:42:36.344606Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 6 sessionId:  grpc read done: success: 1 data: init_request { topic: "topic1" message_group_id: "source5" }
2025-10-31T10:42:36.344646Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 6 topic: "topic1" message_group_id: "source5" from ipv6:[::1]:59884
2025-10-31T10:42:36.344657Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=6 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:59884 proto=v1  topic=topic1 durationSec=0
2025-10-31T10:42:36.344662Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-31T10:42:36.345095Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 6 sessionId:  describe result for acl check
2025-10-31T10:42:36.345119Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-31T10:42:36.345120Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-31T10:42:36.345121Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-31T10:42:36.345126Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [7:7567334475049666054:2494] (SourceId=source5, PreferedPartition=(NULL)) StartKqpSession
2025-10-31T10:42:36.345752Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [7:7567334475049666054:2494] (SourceId=source5, PreferedPartition=(NULL)) Select from the table
2025-10-31T10:42:36.349309Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [7:7567334475049666054:2494] (SourceId=source5, PreferedPartition=(NULL)) RequestPQRB
2025-10-31T10:42:36.350066Z node 8 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1655: [72075186224037893][rt3.dc1--topic1] pipe [7:7567334475049666073:2494] connected; active server actors: 1
2025-10-31T10:42:36.350152Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [7:7567334475049666054:2494] (SourceId=source5, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=source5
2025-10-31T10:42:36.350161Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [7:7567334475049666054:2494] (SourceId=source5, PreferedPartition=(NULL)) Update the table
2025-10-31T10:42:36.350954Z node 8 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1659: [72075186224037893][rt3.dc1--topic1] pipe [7:7567334475049666073:2494] disconnected.
2025-10-31T10:42:36.350966Z node 8 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1670: [72075186224037893][rt3.dc1--topic1] pipe [7:7567334475049666073:2494] disconnected; active server actors: 1
2025-10-31T10:42:36.350969Z node 8 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1695: [72075186224037893][rt3.dc1--topic1] pipe [7:7567334475049666073:2494] disconnected no session
2025-10-31T10:42:36.357391Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [7:7567334475049666054:2494] (SourceId=source5, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-31T10:42:36.357413Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [7:7567334475049666054:2494] (SourceId=source5, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-10-31T10:42:36.357417Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [7:7567334475049666054:2494] (SourceId=source5, PreferedPartition=(NULL)) Start idle
2025-10-31T10:42:36.357426Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 6 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-31T10:42:36.357978Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 7, Generation: 1
2025-10-31T10:42:36.357999Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [7:7567334475049666087:2494], now have 1 active actors on pipe
2025-10-31T10:42:36.358074Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T10:42:36.358084Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T10:42:36.358111Z node 7 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie source5|54f3e25f-bc765a4-99c8ef77-6b8e2e4_0 generated for partition 0 topic 'rt3.dc1--topic1' owner source5
2025-10-31T10:42:36.358121Z node 7 :PERSQUEUE DEBUG: partition.cpp:2272: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T10:42:36.358127Z node 7 :PERSQUEUE DEBUG: partition.cpp:2281: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T10:42:36.358130Z node 7 :PERSQUEUE DEBUG: partition.cpp:2285: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-31T10:42:36.358142Z node 7 :PERSQUEUE DEBUG: partition.cpp:2304: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T10:42:36.358157Z node 7 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-31T10:42:36.358183Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-31T10:42:36.358273Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T10:42:36.358282Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T10:42:36.358295Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-31T10:42:36.358321Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 6 partition: 0 MaxSeqNo: 0 sessionId: source5|54f3e25f-bc765a4-99c8ef77-6b8e2e4_0
2025-10-31T10:42:36.360803Z :INFO: [] MessageGroupId [source5] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1761907356360 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-31T10:42:36.360848Z :INFO: [] MessageGroupId [source5] SessionId [] Write session established. Init response: session_id: "source5|54f3e25f-bc765a4-99c8ef77-6b8e2e4_0" topic: "topic1" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-31T10:42:36.361104Z :DEBUG: [] MessageGroupId [source5] SessionId [source5|54f3e25f-bc765a4-99c8ef77-6b8e2e4_0] Write 1 messages with Id from 1 to 1
2025-10-31T10:42:36.361134Z :INFO: [] MessageGroupId [source5] SessionId [source5|54f3e25f-bc765a4-99c8ef77-6b8e2e4_0] Write session: close. Timeout = 10000 ms
2025-10-31T10:42:36.366609Z :DEBUG: [] MessageGroupId [source5] SessionId [source5|54f3e25f-bc765a4-99c8ef77-6b8e2e4_0] Write session: try to update token
2025-10-31T10:42:36.366630Z :DEBUG: [] MessageGroupId [source5] SessionId [source5|54f3e25f-bc765a4-99c8ef77-6b8e2e4_0] Send 1 message(s) (0 left), first sequence number is 1
2025-10-31T10:42:36.366997Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 6 sessionId: source5|54f3e25f-bc765a4-99c8ef77-6b8e2e4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-31T10:42:36.367264Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-31T10:42:36.367684Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T10:42:36.367700Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T10:42:36.367749Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-31T10:42:36.367777Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-31T10:42:36.367826Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T10:42:36.367829Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T10:42:36.367852Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: '\0source5' SeqNo: 1 partNo : 0 messageNo: 1 size 1122 offset: -1
2025-10-31T10:42:36.367862Z node 7 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-31T10:42:36.367883Z node 7 :PERSQUEUE DEBUG: partition.cpp:2272: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T10:42:36.367893Z node 7 :PERSQUEUE DEBUG: partition.cpp:2281: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T10:42:36.367896Z node 7 :PERSQUEUE DEBUG: partition.cpp:2285: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-31T10:42:36.367945Z node 7 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId '\0source5' seqNo 1 partNo 0
2025-10-31T10:42:36.367997Z node 7 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '\0source5' seqNo 1 partNo 0 FormedBlobsCount 0 NewHead: Offset 5 PartNo 0 PackedSize 1197 count 1 nextOffset 6 batches 1
2025-10-31T10:42:36.368006Z node 7 :PERSQUEUE DEBUG: partition.cpp:2304: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T10:42:36.368074Z node 7 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 5,1 HeadOffset 5 endOffset 5 curOffset 6 d0000000000_00000000000000000005_00000_0000000001_00000? size 1185 WTime 1761907356367
2025-10-31T10:42:36.368108Z node 7 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-31T10:42:36.368134Z node 7 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 5 partNo 0 count 1 size 1185
2025-10-31T10:42:36.369599Z node 7 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 5 count 1 size 1185 actorID [7:7567334470754698339:2439]
2025-10-31T10:42:36.369621Z node 7 :PERSQUEUE DEBUG: partition.cpp:2099: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-31T10:42:36.369636Z node 7 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 5 partno 0 count 1 parts 0 suffix '63' size 1185
2025-10-31T10:42:36.369640Z node 7 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1130 WriteNewSizeFromSupportivePartitions# 0
2025-10-31T10:42:36.369648Z node 7 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-31T10:42:36.369655Z node 7 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0source5', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 1, partNo: 0, Offset: 5 is stored on disk
2025-10-31T10:42:36.369696Z node 7 :PERSQUEUE DEBUG: partition.cpp:2272: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T10:42:36.369704Z node 7 :PERSQUEUE DEBUG: partition.cpp:2281: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T10:42:36.369706Z node 7 :PERSQUEUE DEBUG: partition.cpp:2304: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T10:42:36.369712Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 1 consumer shared/user session shared/user_7_1_190747618541107145_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 5 EndOffset 5 newEndOffset 6 commitOffset 0 clientCommitOffset 0 cookie 6 readingFinished 0 firstRead 0
2025-10-31T10:42:36.369712Z node 7 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-31T10:42:36.369717Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_7_1_190747618541107145_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 5 endOffset 6
2025-10-31T10:42:36.369721Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 1  requestId: <none> cookie: 1
2025-10-31T10:42:36.369728Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_7_1_190747618541107145_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 5, endOffset# 6, WTime# 1761907356248, sizeLag# 1185
2025-10-31T10:42:36.369730Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_7_1_190747618541107145_v1TEvPartitionReady. Aval parts: 1
2025-10-31T10:42:36.369735Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-31T10:42:36.369740Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_7_1_190747618541107145_v1 performing read request: guid# c899d1ea-512eda35-8efd2506-ba3c9269, from# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), count# 1, size# 1422, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-31T10:42:36.369750Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_7_1_190747618541107145_v1 READ FROM TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1)maxCount 1 maxSize 1422 maxTimeLagMs 0 readTimestampMs 0 readOffset 5 EndOffset 6 ClientCommitOffset 0 committedOffset 0 Guid c899d1ea-512eda35-8efd2506-ba3c9269
2025-10-31T10:42:36.369806Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T10:42:36.369819Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T10:42:36.369850Z node 7 :PERSQUEUE DEBUG: partition_read.cpp:883: [72075186224037892][Partition][0][StateIdle] read cookie 9 Topic 'rt3.dc1--topic1' partition 0 user user offset 5 count 1 size 1422 endOffset 6 max time lag 0ms effective offset 5
2025-10-31T10:42:36.369871Z node 7 :PERSQUEUE DEBUG: partition_read.cpp:1097: [72075186224037892][Partition][0][StateIdle] read cookie 9 added 1 blobs, size 1185 count 1 last offset 5, current partition end offset: 6
2025-10-31T10:42:36.369874Z node 7 :PERSQUEUE DEBUG: partition_read.cpp:1123: [72075186224037892][Partition][0][StateIdle] Reading cookie 9. Send blob request.
2025-10-31T10:42:36.369893Z node 7 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 5 partno 0 count 1 parts_count 0 source 1 size 1185 accessed 0 times before, last time 2025-10-31T10:42:36.000000Z
2025-10-31T10:42:36.369908Z node 7 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 9. All 1 blobs are from cache.
2025-10-31T10:42:36.369918Z node 7 :PERSQUEUE DEBUG: partition_read.cpp:581: FormAnswer for 1 blobs
2025-10-31T10:42:36.369926Z node 7 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 5 partno 0 count 1 parts 0 suffix '63'
2025-10-31T10:42:36.369936Z node 7 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 5 totakecount 1 count 1 size 1165 from pos 0 cbcount 1
2025-10-31T10:42:36.369966Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 5
2025-10-31T10:42:36.370036Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_7_1_190747618541107145_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 6 Result { Offset: 5 Data: "... 1122 bytes ..." SourceId: "\000source5" SeqNo: 1 WriteTimestampMS: 1761907356367 CreateTimestampMS: 1761907356360 UncompressedSize: 1047552 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 20 RealReadOffset: 5 WaitQuotaTimeMs: 0 EndOffset: 6 StartOffset: 0 } Cookie: 5 }
2025-10-31T10:42:36.370062Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_7_1_190747618541107145_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 7 from offset 6
2025-10-31T10:42:36.370071Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_7_1_190747618541107145_v1 after read state TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 6 ReadOffset 6 ReadGuid c899d1ea-512eda35-8efd2506-ba3c9269 has messages 1
2025-10-31T10:42:36.370087Z :DEBUG: [] MessageGroupId [source5] SessionId [source5|54f3e25f-bc765a4-99c8ef77-6b8e2e4_0] Write session got write response: sequence_numbers: 1 offsets: 5 already_written: false write_statistics { persist_duration_ms: 1 }
2025-10-31T10:42:36.370101Z :DEBUG: [] MessageGroupId [source5] SessionId [source5|54f3e25f-bc765a4-99c8ef77-6b8e2e4_0] Write session: acknoledged message 1
2025-10-31T10:42:36.370091Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_7_1_190747618541107145_v1 read done: guid# c899d1ea-512eda35-8efd2506-ba3c9269, partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), size# 1224
2025-10-31T10:42:36.370102Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_7_1_190747618541107145_v1 response to read: guid# c899d1ea-512eda35-8efd2506-ba3c9269
2025-10-31T10:42:36.370194Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_7_1_190747618541107145_v1 Process answer. Aval parts: 0
2025-10-31T10:42:36.370384Z :DEBUG: [] [] [f78ceb12-4438829-f5e170b5-da18a51d] [null] After sending read request: ReadSizeBudget = 2621440, ReadSizeServerDelta = 0
2025-10-31T10:42:36.370544Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_7_1_190747618541107145_v1 grpc read done: success# 1, data# { read { } }
2025-10-31T10:42:36.370628Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_7_1_190747618541107145_v1 got read request: guid# bee4da6e-eb1dd760-faf5d38a-1315fbdd
2025-10-31T10:42:36.399080Z node 7 :PERSQUEUE DEBUG: partition.cpp:2272: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T10:42:36.399094Z node 7 :PERSQUEUE DEBUG: partition.cpp:2281: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T10:42:36.399096Z node 7 :PERSQUEUE DEBUG: partition.cpp:2304: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T10:42:36.461220Z :INFO: [] MessageGroupId [source5] SessionId [source5|54f3e25f-bc765a4-99c8ef77-6b8e2e4_0] Write session will now close
2025-10-31T10:42:36.461244Z :DEBUG: [] MessageGroupId [source5] SessionId [source5|54f3e25f-bc765a4-99c8ef77-6b8e2e4_0] Write session: aborting
2025-10-31T10:42:36.461436Z :INFO: [] MessageGroupId [source5] SessionId [source5|54f3e25f-bc765a4-99c8ef77-6b8e2e4_0] Write session: gracefully shut down, all writes complete
2025-10-31T10:42:36.461457Z :DEBUG: [] MessageGroupId [source5] SessionId [source5|54f3e25f-bc765a4-99c8ef77-6b8e2e4_0] Write session: destroy
2025-10-31T10:42:36.461662Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 6 sessionId: source5|54f3e25f-bc765a4-99c8ef77-6b8e2e4_0 grpc read done: success: 0 data: 
2025-10-31T10:42:36.461692Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 6 sessionId: source5|54f3e25f-bc765a4-99c8ef77-6b8e2e4_0 grpc read failed
2025-10-31T10:42:36.461704Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 6 sessionId: source5|54f3e25f-bc765a4-99c8ef77-6b8e2e4_0 grpc closed
2025-10-31T10:42:36.461712Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 6 sessionId: source5|54f3e25f-bc765a4-99c8ef77-6b8e2e4_0 is DEAD
2025-10-31T10:42:36.461768Z :DEBUG: [] MessageGroupId [source6] SessionId [] Write session: try to update token
2025-10-31T10:42:36.461935Z :INFO: [] MessageGroupId [source6] SessionId [] Write session: Do CDS request
2025-10-31T10:42:36.461940Z :INFO: [] MessageGroupId [source6] SessionId [] Start write session. Will connect to endpoint: localhost:2244
2025-10-31T10:42:36.462050Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-10-31T10:42:36.462137Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [7:7567334475049666087:2494] destroyed
2025-10-31T10:42:36.462156Z node 7 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-10-31T10:42:36.462164Z node 7 :PERSQUEUE DEBUG: partition.cpp:2272: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T10:42:36.462172Z node 7 :PERSQUEUE DEBUG: partition.cpp:2281: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T10:42:36.462174Z node 7 :PERSQUEUE DEBUG: partition.cpp:2304: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T10:42:36.463074Z :DEBUG: [] MessageGroupId [source6] SessionId [] Write session: send init request: init_request { topic: "topic1" message_group_id: "source6" }
2025-10-31T10:42:36.463163Z node 7 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-31T10:42:36.463177Z node 7 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 7
2025-10-31T10:42:36.463325Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 7 sessionId:  grpc read done: success: 1 data: init_request { topic: "topic1" message_group_id: "source6" }
2025-10-31T10:42:36.463361Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 7 topic: "topic1" message_group_id: "source6" from ipv6:[::1]:59884
2025-10-31T10:42:36.463372Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=7 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:59884 proto=v1  topic=topic1 durationSec=0
2025-10-31T10:42:36.463376Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-31T10:42:36.463851Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 7 sessionId:  describe result for acl check
2025-10-31T10:42:36.463891Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-31T10:42:36.463900Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-31T10:42:36.463902Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-31T10:42:36.463907Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [7:7567334475049666101:2499] (SourceId=source6, PreferedPartition=(NULL)) StartKqpSession
2025-10-31T10:42:36.464415Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [7:7567334475049666101:2499] (SourceId=source6, PreferedPartition=(NULL)) Select from the table
2025-10-31T10:42:36.466985Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [7:7567334475049666101:2499] (SourceId=source6, PreferedPartition=(NULL)) RequestPQRB
2025-10-31T10:42:36.467125Z node 8 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1655: [72075186224037893][rt3.dc1--topic1] pipe [7:7567334475049666117:2499] connected; active server actors: 1
2025-10-31T10:42:36.467294Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [7:7567334475049666101:2499] (SourceId=source6, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=source6
2025-10-31T10:42:36.467320Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [7:7567334475049666101:2499] (SourceId=source6, PreferedPartition=(NULL)) Update the table
2025-10-31T10:42:36.467436Z node 8 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1659: [72075186224037893][rt3.dc1--topic1] pipe [7:7567334475049666117:2499] disconnected.
2025-10-31T10:42:36.467444Z node 8 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1670: [72075186224037893][rt3.dc1--topic1] pipe [7:7567334475049666117:2499] disconnected; active server actors: 1
2025-10-31T10:42:36.467447Z node 8 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1695: [72075186224037893][rt3.dc1--topic1] pipe [7:7567334475049666117:2499] disconnected no session
2025-10-31T10:42:36.473757Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [7:7567334475049666101:2499] (SourceId=source6, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-31T10:42:36.473777Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [7:7567334475049666101:2499] (SourceId=source6, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-10-31T10:42:36.473794Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [7:7567334475049666101:2499] (SourceId=source6, PreferedPartition=(NULL)) Start idle
2025-10-31T10:42:36.473803Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 7 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-31T10:42:36.474090Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 7, Generation: 1
2025-10-31T10:42:36.474107Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [7:7567334475049666131:2499], now have 1 active actors on pipe
2025-10-31T10:42:36.474127Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T10:42:36.474140Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T10:42:36.474176Z node 7 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie source6|4e7cf805-25474357-a0be9f8a-ee5849c_0 generated for partition 0 topic 'rt3.dc1--topic1' owner source6
2025-10-31T10:42:36.474191Z node 7 :PERSQUEUE DEBUG: partition.cpp:2272: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T10:42:36.474210Z node 7 :PERSQUEUE DEBUG: partition.cpp:2281: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T10:42:36.474219Z node 7 :PERSQUEUE DEBUG: partition.cpp:2285: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-31T10:42:36.474234Z node 7 :PERSQUEUE DEBUG: partition.cpp:2304: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T10:42:36.474251Z node 7 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-31T10:42:36.474271Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-31T10:42:36.474322Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T10:42:36.474334Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T10:42:36.474359Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-31T10:42:36.474401Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 7 partition: 0 MaxSeqNo: 0 sessionId: source6|4e7cf805-25474357-a0be9f8a-ee5849c_0
2025-10-31T10:42:36.474831Z :INFO: [] MessageGroupId [source6] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1761907356474 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-31T10:42:36.474875Z :INFO: [] MessageGroupId [source6] SessionId [] Write session established. Init response: session_id: "source6|4e7cf805-25474357-a0be9f8a-ee5849c_0" topic: "topic1" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-31T10:42:36.475154Z :DEBUG: [] MessageGroupId [source6] SessionId [source6|4e7cf805-25474357-a0be9f8a-ee5849c_0] Write 1 messages with Id from 1 to 1
2025-10-31T10:42:36.475204Z :INFO: [] MessageGroupId [source6] SessionId [source6|4e7cf805-25474357-a0be9f8a-ee5849c_0] Write session: close. Timeout = 10000 ms
2025-10-31T10:42:36.481244Z :DEBUG: [] MessageGroupId [source6] SessionId [source6|4e7cf805-25474357-a0be9f8a-ee5849c_0] Write session: try to update token
2025-10-31T10:42:36.481266Z :DEBUG: [] MessageGroupId [source6] SessionId [source6|4e7cf805-25474357-a0be9f8a-ee5849c_0] Send 1 message(s) (0 left), first sequence number is 1
2025-10-31T10:42:36.481604Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 7 sessionId: source6|4e7cf805-25474357-a0be9f8a-ee5849c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-31T10:42:36.481801Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-31T10:42:36.481854Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T10:42:36.481866Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T10:42:36.481924Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-31T10:42:36.481948Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-31T10:42:36.481972Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T10:42:36.481978Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T10:42:36.481998Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: '\0source6' SeqNo: 1 partNo : 0 messageNo: 1 size 1122 offset: -1
2025-10-31T10:42:36.482010Z node 7 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-31T10:42:36.482030Z node 7 :PERSQUEUE DEBUG: partition.cpp:2272: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T10:42:36.482042Z node 7 :PERSQUEUE DEBUG: partition.cpp:2281: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T10:42:36.482049Z node 7 :PERSQUEUE DEBUG: partition.cpp:2285: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-31T10:42:36.482093Z node 7 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId '\0source6' seqNo 1 partNo 0
2025-10-31T10:42:36.482144Z node 7 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '\0source6' seqNo 1 partNo 0 FormedBlobsCount 0 NewHead: Offset 6 PartNo 0 PackedSize 1197 count 1 nextOffset 7 batches 1
2025-10-31T10:42:36.482155Z node 7 :PERSQUEUE DEBUG: partition.cpp:2304: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T10:42:36.482215Z node 7 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 6,1 HeadOffset 6 endOffset 6 curOffset 7 d0000000000_00000000000000000006_00000_0000000001_00000? size 1185 WTime 1761907356481
2025-10-31T10:42:36.482245Z node 7 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-31T10:42:36.482260Z node 7 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 6 partNo 0 count 1 size 1185
2025-10-31T10:42:36.483763Z node 7 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 6 count 1 size 1185 actorID [7:7567334470754698339:2439]
2025-10-31T10:42:36.483786Z node 7 :PERSQUEUE DEBUG: partition.cpp:2099: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-31T10:42:36.483803Z node 7 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1130 WriteNewSizeFromSupportivePartitions# 0
2025-10-31T10:42:36.483805Z node 7 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 6 partno 0 count 1 parts 0 suffix '63' size 1185
2025-10-31T10:42:36.483812Z node 7 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-31T10:42:36.483820Z node 7 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0source6', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 1, partNo: 0, Offset: 6 is stored on disk
2025-10-31T10:42:36.483865Z node 7 :PERSQUEUE DEBUG: partition.cpp:2272: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T10:42:36.483871Z node 7 :PERSQUEUE DEBUG: partition.cpp:2281: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T10:42:36.483874Z node 7 :PERSQUEUE DEBUG: partition.cpp:2304: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T10:42:36.483881Z node 7 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-31T10:42:36.483887Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 1 consumer shared/user session shared/user_7_1_190747618541107145_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 6 EndOffset 6 newEndOffset 7 commitOffset 0 clientCommitOffset 0 cookie 7 readingFinished 0 firstRead 0
2025-10-31T10:42:36.483891Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 1  requestId: <none> cookie: 1
2025-10-31T10:42:36.483899Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_7_1_190747618541107145_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 6 endOffset 7
2025-10-31T10:42:36.483906Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-31T10:42:36.483916Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_7_1_190747618541107145_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 6, endOffset# 7, WTime# 1761907356367, sizeLag# 1185
2025-10-31T10:42:36.483923Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_7_1_190747618541107145_v1TEvPartitionReady. Aval parts: 1
2025-10-31T10:42:36.483939Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_7_1_190747618541107145_v1 performing read request: guid# bee4da6e-eb1dd760-faf5d38a-1315fbdd, from# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), count# 1, size# 1422, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-31T10:42:36.483956Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_7_1_190747618541107145_v1 READ FROM TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1)maxCount 1 maxSize 1422 maxTimeLagMs 0 readTimestampMs 0 readOffset 6 EndOffset 7 ClientCommitOffset 0 committedOffset 0 Guid bee4da6e-eb1dd760-faf5d38a-1315fbdd
2025-10-31T10:42:36.483999Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T10:42:36.484009Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T10:42:36.484040Z node 7 :PERSQUEUE DEBUG: partition_read.cpp:883: [72075186224037892][Partition][0][StateIdle] read cookie 10 Topic 'rt3.dc1--topic1' partition 0 user user offset 6 count 1 size 1422 endOffset 7 max time lag 0ms effective offset 6
2025-10-31T10:42:36.484067Z node 7 :PERSQUEUE DEBUG: partition_read.cpp:1097: [72075186224037892][Partition][0][StateIdle] read cookie 10 added 1 blobs, size 1185 count 1 last offset 6, current partition end offset: 7
2025-10-31T10:42:36.484076Z node 7 :PERSQUEUE DEBUG: partition_read.cpp:1123: [72075186224037892][Partition][0][StateIdle] Reading cookie 10. Send blob request.
2025-10-31T10:42:36.484088Z node 7 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 6 partno 0 count 1 parts_count 0 source 1 size 1185 accessed 0 times before, last time 2025-10-31T10:42:36.000000Z
2025-10-31T10:42:36.484101Z node 7 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 10. All 1 blobs are from cache.
2025-10-31T10:42:36.484110Z node 7 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 6 partno 0 count 1 parts 0 suffix '63'
2025-10-31T10:42:36.484117Z node 7 :PERSQUEUE DEBUG: partition_read.cpp:581: FormAnswer for 1 blobs
2025-10-31T10:42:36.484139Z node 7 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 6 totakecount 1 count 1 size 1165 from pos 0 cbcount 1
2025-10-31T10:42:36.484168Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 6
2025-10-31T10:42:36.484251Z :DEBUG: [] MessageGroupId [source6] SessionId [source6|4e7cf805-25474357-a0be9f8a-ee5849c_0] Write session got write response: sequence_numbers: 1 offsets: 6 already_written: false write_statistics { persist_duration_ms: 1 }
2025-10-31T10:42:36.484263Z :DEBUG: [] MessageGroupId [source6] SessionId [source6|4e7cf805-25474357-a0be9f8a-ee5849c_0] Write session: acknoledged message 1
2025-10-31T10:42:36.484283Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_7_1_190747618541107145_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 7 Result { Offset: 6 Data: "... 1122 bytes ..." SourceId: "\000source6" SeqNo: 1 WriteTimestampMS: 1761907356481 CreateTimestampMS: 1761907356475 UncompressedSize: 1047552 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 20 RealReadOffset: 6 WaitQuotaTimeMs: 0 EndOffset: 7 StartOffset: 0 } Cookie: 6 }
2025-10-31T10:42:36.484322Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_7_1_190747618541107145_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 8 from offset 7
2025-10-31T10:42:36.484333Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_7_1_190747618541107145_v1 after read state TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 7 ReadOffset 7 ReadGuid bee4da6e-eb1dd760-faf5d38a-1315fbdd has messages 1
2025-10-31T10:42:36.484372Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_7_1_190747618541107145_v1 read done: guid# bee4da6e-eb1dd760-faf5d38a-1315fbdd, partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), size# 1224
2025-10-31T10:42:36.484386Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_7_1_190747618541107145_v1 response to read: guid# bee4da6e-eb1dd760-faf5d38a-1315fbdd
2025-10-31T10:42:36.484487Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_7_1_190747618541107145_v1 Process answer. Aval parts: 0
2025-10-31T10:42:36.484676Z :DEBUG: [] [] [f78ceb12-4438829-f5e170b5-da18a51d] [null] After sending read request: ReadSizeBudget = 2621440, ReadSizeServerDelta = 0
2025-10-31T10:42:36.484758Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_7_1_190747618541107145_v1 grpc read done: success# 1, data# { read { } }
2025-10-31T10:42:36.484824Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_7_1_190747618541107145_v1 got read request: guid# 46e5d4d7-bda00df2-e07185b-87dbfe4b
2025-10-31T10:42:36.499455Z node 7 :PERSQUEUE DEBUG: partition.cpp:2272: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T10:42:36.499473Z node 7 :PERSQUEUE DEBUG: partition.cpp:2281: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T10:42:36.499480Z node 7 :PERSQUEUE DEBUG: partition.cpp:2304: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T10:42:36.575289Z :INFO: [] MessageGroupId [source6] SessionId [source6|4e7cf805-25474357-a0be9f8a-ee5849c_0] Write session will now close
2025-10-31T10:42:36.575310Z :DEBUG: [] MessageGroupId [source6] SessionId [source6|4e7cf805-25474357-a0be9f8a-ee5849c_0] Write session: aborting
2025-10-31T10:42:36.575498Z :INFO: [] MessageGroupId [source6] SessionId [source6|4e7cf805-25474357-a0be9f8a-ee5849c_0] Write session: gracefully shut down, all writes complete
2025-10-31T10:42:36.575520Z :DEBUG: [] MessageGroupId [source6] SessionId [source6|4e7cf805-25474357-a0be9f8a-ee5849c_0] Write session: destroy
2025-10-31T10:42:36.575772Z :DEBUG: [] MessageGroupId [source7] SessionId [] Write session: try to update token
2025-10-31T10:42:36.575782Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 7 sessionId: source6|4e7cf805-25474357-a0be9f8a-ee5849c_0 grpc read done: success: 0 data: 
2025-10-31T10:42:36.575799Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 7 sessionId: source6|4e7cf805-25474357-a0be9f8a-ee5849c_0 grpc read failed
2025-10-31T10:42:36.575810Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 7 sessionId: source6|4e7cf805-25474357-a0be9f8a-ee5849c_0 grpc closed
2025-10-31T10:42:36.575816Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 7 sessionId: source6|4e7cf805-25474357-a0be9f8a-ee5849c_0 is DEAD
2025-10-31T10:42:36.575949Z :INFO: [] MessageGroupId [source7] SessionId [] Write session: Do CDS request
2025-10-31T10:42:36.575956Z :INFO: [] MessageGroupId [source7] SessionId [] Start write session. Will connect to endpoint: localhost:2244
2025-10-31T10:42:36.576099Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-10-31T10:42:36.576172Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [7:7567334475049666131:2499] destroyed
2025-10-31T10:42:36.576191Z node 7 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-10-31T10:42:36.576199Z node 7 :PERSQUEUE DEBUG: partition.cpp:2272: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T10:42:36.576202Z node 7 :PERSQUEUE DEBUG: partition.cpp:2281: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T10:42:36.576205Z node 7 :PERSQUEUE DEBUG: partition.cpp:2304: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T10:42:36.577021Z :DEBUG: [] MessageGroupId [source7] SessionId [] Write session: send init request: init_request { topic: "topic1" message_group_id: "source7" }
2025-10-31T10:42:36.577155Z node 7 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-31T10:42:36.577168Z node 7 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 8
2025-10-31T10:42:36.577276Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 8 sessionId:  grpc read done: success: 1 data: init_request { topic: "topic1" message_group_id: "source7" }
2025-10-31T10:42:36.577310Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 8 topic: "topic1" message_group_id: "source7" from ipv6:[::1]:59884
2025-10-31T10:42:36.577320Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=8 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:59884 proto=v1  topic=topic1 durationSec=0
2025-10-31T10:42:36.577323Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-31T10:42:36.577811Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 8 sessionId:  describe result for acl check
2025-10-31T10:42:36.577852Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-31T10:42:36.577861Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-31T10:42:36.577863Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-31T10:42:36.577869Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [7:7567334475049666143:2503] (SourceId=source7, PreferedPartition=(NULL)) StartKqpSession
2025-10-31T10:42:36.578509Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [7:7567334475049666143:2503] (SourceId=source7, PreferedPartition=(NULL)) Select from the table
2025-10-31T10:42:36.580698Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [7:7567334475049666143:2503] (SourceId=source7, PreferedPartition=(NULL)) RequestPQRB
2025-10-31T10:42:36.580935Z node 8 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1655: [72075186224037893][rt3.dc1--topic1] pipe [7:7567334475049666162:2503] connected; active server actors: 1
2025-10-31T10:42:36.581156Z node 8 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1659: [72075186224037893][rt3.dc1--topic1] pipe [7:7567334475049666162:2503] disconnected.
2025-10-31T10:42:36.581168Z node 8 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1670: [72075186224037893][rt3.dc1--topic1] pipe [7:7567334475049666162:2503] disconnected; active server actors: 1
2025-10-31T10:42:36.581170Z node 8 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1695: [72075186224037893][rt3.dc1--topic1] pipe [7:7567334475049666162:2503] disconnected no session
2025-10-31T10:42:36.581051Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [7:7567334475049666143:2503] (SourceId=source7, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=source7
2025-10-31T10:42:36.581061Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [7:7567334475049666143:2503] (SourceId=source7, PreferedPartition=(NULL)) Update the table
2025-10-31T10:42:36.584576Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [7:7567334475049666143:2503] (SourceId=source7, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-31T10:42:36.584591Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [7:7567334475049666143:2503] (SourceId=source7, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-10-31T10:42:36.584595Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [7:7567334475049666143:2503] (SourceId=source7, PreferedPartition=(NULL)) Start idle
2025-10-31T10:42:36.584603Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 8 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-31T10:42:36.584783Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 7, Generation: 1
2025-10-31T10:42:36.584803Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [7:7567334475049666176:2503], now have 1 active actors on pipe
2025-10-31T10:42:36.584810Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T10:42:36.584816Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T10:42:36.584839Z node 7 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie source7|2f0d99-bd41c948-c32639a5-b850b03b_0 generated for partition 0 topic 'rt3.dc1--topic1' owner source7
2025-10-31T10:42:36.584852Z node 7 :PERSQUEUE DEBUG: partition.cpp:2272: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T10:42:36.584857Z node 7 :PERSQUEUE DEBUG: partition.cpp:2281: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T10:42:36.584860Z node 7 :PERSQUEUE DEBUG: partition.cpp:2285: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-31T10:42:36.584871Z node 7 :PERSQUEUE DEBUG: partition.cpp:2304: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T10:42:36.584888Z node 7 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-31T10:42:36.584907Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-31T10:42:36.584957Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T10:42:36.584966Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T10:42:36.584977Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-31T10:42:36.585005Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 8 partition: 0 MaxSeqNo: 0 sessionId: source7|2f0d99-bd41c948-c32639a5-b850b03b_0
2025-10-31T10:42:36.585315Z :INFO: [] MessageGroupId [source7] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1761907356585 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-31T10:42:36.585352Z :INFO: [] MessageGroupId [source7] SessionId [] Write session established. Init response: session_id: "source7|2f0d99-bd41c948-c32639a5-b850b03b_0" topic: "topic1" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-31T10:42:36.585598Z :DEBUG: [] MessageGroupId [source7] SessionId [source7|2f0d99-bd41c948-c32639a5-b850b03b_0] Write 1 messages with Id from 1 to 1
2025-10-31T10:42:36.585632Z :INFO: [] MessageGroupId [source7] SessionId [source7|2f0d99-bd41c948-c32639a5-b850b03b_0] Write session: close. Timeout = 10000 ms
2025-10-31T10:42:36.591046Z :DEBUG: [] MessageGroupId [source7] SessionId [source7|2f0d99-bd41c948-c32639a5-b850b03b_0] Write session: try to update token
2025-10-31T10:42:36.591068Z :DEBUG: [] MessageGroupId [source7] SessionId [source7|2f0d99-bd41c948-c32639a5-b850b03b_0] Send 1 message(s) (0 left), first sequence number is 1
2025-10-31T10:42:36.591437Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 8 sessionId: source7|2f0d99-bd41c948-c32639a5-b850b03b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-31T10:42:36.591588Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-31T10:42:36.591642Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T10:42:36.591667Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T10:42:36.591701Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-31T10:42:36.591723Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-31T10:42:36.591754Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T10:42:36.591760Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T10:42:36.591777Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: '\0source7' SeqNo: 1 partNo : 0 messageNo: 1 size 1122 offset: -1
2025-10-31T10:42:36.591788Z node 7 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-31T10:42:36.591814Z node 7 :PERSQUEUE DEBUG: partition.cpp:2272: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T10:42:36.591827Z node 7 :PERSQUEUE DEBUG: partition.cpp:2281: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T10:42:36.591829Z node 7 :PERSQUEUE DEBUG: partition.cpp:2285: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-31T10:42:36.591858Z node 7 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId '\0source7' seqNo 1 partNo 0
2025-10-31T10:42:36.591920Z node 7 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '\0source7' seqNo 1 partNo 0 FormedBlobsCount 0 NewHead: Offset 7 PartNo 0 PackedSize 1197 count 1 nextOffset 8 batches 1
2025-10-31T10:42:36.591932Z node 7 :PERSQUEUE DEBUG: partition.cpp:2304: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T10:42:36.591977Z node 7 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 7,1 HeadOffset 7 endOffset 7 curOffset 8 d0000000000_00000000000000000007_00000_0000000001_00000? size 1185 WTime 1761907356591
2025-10-31T10:42:36.592004Z node 7 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-31T10:42:36.592018Z node 7 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 7 partNo 0 count 1 size 1185
2025-10-31T10:42:36.593507Z node 7 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 7 count 1 size 1185 actorID [7:7567334470754698339:2439]
2025-10-31T10:42:36.593534Z node 7 :PERSQUEUE DEBUG: partition.cpp:2099: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-31T10:42:36.593553Z node 7 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1130 WriteNewSizeFromSupportivePartitions# 0
2025-10-31T10:42:36.593553Z node 7 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 7 partno 0 count 1 parts 0 suffix '63' size 1185
2025-10-31T10:42:36.593567Z node 7 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-31T10:42:36.593575Z node 7 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0source7', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 1, partNo: 0, Offset: 7 is stored on disk
2025-10-31T10:42:36.593610Z node 7 :PERSQUEUE DEBUG: partition.cpp:2272: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T10:42:36.593615Z node 7 :PERSQUEUE DEBUG: partition.cpp:2281: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T10:42:36.593618Z node 7 :PERSQUEUE DEBUG: partition.cpp:2304: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T10:42:36.593625Z node 7 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-31T10:42:36.593634Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 1  requestId: <none> cookie: 1
2025-10-31T10:42:36.593637Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 1 consumer shared/user session shared/user_7_1_190747618541107145_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 7 EndOffset 7 newEndOffset 8 commitOffset 0 clientCommitOffset 0 cookie 8 readingFinished 0 firstRead 0
2025-10-31T10:42:36.593644Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_7_1_190747618541107145_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 7 endOffset 8
2025-10-31T10:42:36.593653Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-31T10:42:36.593661Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_7_1_190747618541107145_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 7, endOffset# 8, WTime# 1761907356481, sizeLag# 1185
2025-10-31T10:42:36.593670Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_7_1_190747618541107145_v1TEvPartitionReady. Aval parts: 1
2025-10-31T10:42:36.593684Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_7_1_190747618541107145_v1 performing read request: guid# 46e5d4d7-bda00df2-e07185b-87dbfe4b, from# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), count# 1, size# 1422, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-31T10:42:36.593702Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_7_1_190747618541107145_v1 READ FROM TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1)maxCount 1 maxSize 1422 maxTimeLagMs 0 readTimestampMs 0 readOffset 7 EndOffset 8 ClientCommitOffset 0 committedOffset 0 Guid 46e5d4d7-bda00df2-e07185b-87dbfe4b
2025-10-31T10:42:36.593780Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T10:42:36.593791Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T10:42:36.593816Z node 7 :PERSQUEUE DEBUG: partition_read.cpp:883: [72075186224037892][Partition][0][StateIdle] read cookie 11 Topic 'rt3.dc1--topic1' partition 0 user user offset 7 count 1 size 1422 endOffset 8 max time lag 0ms effective offset 7
2025-10-31T10:42:36.593831Z node 7 :PERSQUEUE DEBUG: partition_read.cpp:1097: [72075186224037892][Partition][0][StateIdle] read cookie 11 added 1 blobs, size 1185 count 1 last offset 7, current partition end offset: 8
2025-10-31T10:42:36.593841Z node 7 :PERSQUEUE DEBUG: partition_read.cpp:1123: [72075186224037892][Partition][0][StateIdle] Reading cookie 11. Send blob request.
2025-10-31T10:42:36.593849Z node 7 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 7 partno 0 count 1 parts_count 0 source 1 size 1185 accessed 0 times before, last time 2025-10-31T10:42:36.000000Z
2025-10-31T10:42:36.593863Z node 7 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 11. All 1 blobs are from cache.
2025-10-31T10:42:36.593877Z node 7 :PERSQUEUE DEBUG: partition_read.cpp:581: FormAnswer for 1 blobs
2025-10-31T10:42:36.593892Z node 7 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 7 totakecount 1 count 1 size 1165 from pos 0 cbcount 1
2025-10-31T10:42:36.593892Z node 7 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 7 partno 0 count 1 parts 0 suffix '63'
2025-10-31T10:42:36.593916Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 7
2025-10-31T10:42:36.593993Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_7_1_190747618541107145_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 8 Result { Offset: 7 Data: "... 1122 bytes ..." SourceId: "\000source7" SeqNo: 1 WriteTimestampMS: 1761907356591 CreateTimestampMS: 1761907356585 UncompressedSize: 1047552 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 20 RealReadOffset: 7 WaitQuotaTimeMs: 0 EndOffset: 8 StartOffset: 0 } Cookie: 7 }
2025-10-31T10:42:36.594019Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_7_1_190747618541107145_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 9 from offset 8
2025-10-31T10:42:36.594030Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_7_1_190747618541107145_v1 after read state TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 8 ReadOffset 8 ReadGuid 46e5d4d7-bda00df2-e07185b-87dbfe4b has messages 1
2025-10-31T10:42:36.594068Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_7_1_190747618541107145_v1 read done: guid# 46e5d4d7-bda00df2-e07185b-87dbfe4b, partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), size# 1224
2025-10-31T10:42:36.594081Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_7_1_190747618541107145_v1 response to read: guid# 46e5d4d7-bda00df2-e07185b-87dbfe4b
2025-10-31T10:42:36.594161Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_7_1_190747618541107145_v1 Process answer. Aval parts: 0
2025-10-31T10:42:36.594369Z :DEBUG: [] MessageGroupId [source7] SessionId [source7|2f0d99-bd41c948-c32639a5-b850b03b_0] Write session got write response: sequence_numbers: 1 offsets: 7 already_written: false write_statistics { persist_duration_ms: 1 }
2025-10-31T10:42:36.594383Z :DEBUG: [] MessageGroupId [source7] SessionId [source7|2f0d99-bd41c948-c32639a5-b850b03b_0] Write session: acknoledged message 1
2025-10-31T10:42:36.594420Z :DEBUG: [] [] [f78ceb12-4438829-f5e170b5-da18a51d] [null] After sending read request: ReadSizeBudget = 2621440, ReadSizeServerDelta = 0
2025-10-31T10:42:36.594652Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_7_1_190747618541107145_v1 grpc read done: success# 1, data# { read { } }
2025-10-31T10:42:36.594711Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_7_1_190747618541107145_v1 got read request: guid# 964f5918-6222060c-2547cb33-1f14b1b0
2025-10-31T10:42:36.599814Z node 7 :PERSQUEUE DEBUG: partition.cpp:2272: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T10:42:36.599826Z node 7 :PERSQUEUE DEBUG: partition.cpp:2281: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T10:42:36.599831Z node 7 :PERSQUEUE DEBUG: partition.cpp:2304: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T10:42:36.685720Z :INFO: [] MessageGroupId [source7] SessionId [source7|2f0d99-bd41c948-c32639a5-b850b03b_0] Write session will now close
2025-10-31T10:42:36.685740Z :DEBUG: [] MessageGroupId [source7] SessionId [source7|2f0d99-bd41c948-c32639a5-b850b03b_0] Write session: aborting
2025-10-31T10:42:36.685911Z :INFO: [] MessageGroupId [source7] SessionId [source7|2f0d99-bd41c948-c32639a5-b850b03b_0] Write session: gracefully shut down, all writes complete
2025-10-31T10:42:36.685929Z :DEBUG: [] MessageGroupId [source7] SessionId [source7|2f0d99-bd41c948-c32639a5-b850b03b_0] Write session: destroy
2025-10-31T10:42:36.686131Z :DEBUG: [] MessageGroupId [source8] SessionId [] Write session: try to update token
2025-10-31T10:42:36.686106Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 8 sessionId: source7|2f0d99-bd41c948-c32639a5-b850b03b_0 grpc read done: success: 0 data: 
2025-10-31T10:42:36.686124Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 8 sessionId: source7|2f0d99-bd41c948-c32639a5-b850b03b_0 grpc read failed
2025-10-31T10:42:36.686136Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 8 sessionId: source7|2f0d99-bd41c948-c32639a5-b850b03b_0 grpc closed
2025-10-31T10:42:36.686145Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 8 sessionId: source7|2f0d99-bd41c948-c32639a5-b850b03b_0 is DEAD
2025-10-31T10:42:36.686281Z :INFO: [] MessageGroupId [source8] SessionId [] Write session: Do CDS request
2025-10-31T10:42:36.686286Z :INFO: [] MessageGroupId [source8] SessionId [] Start write session. Will connect to endpoint: localhost:2244
2025-10-31T10:42:36.686611Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-10-31T10:42:36.686680Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [7:7567334475049666176:2503] destroyed
2025-10-31T10:42:36.686702Z node 7 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-10-31T10:42:36.686710Z node 7 :PERSQUEUE DEBUG: partition.cpp:2272: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T10:42:36.686719Z node 7 :PERSQUEUE DEBUG: partition.cpp:2281: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T10:42:36.686721Z node 7 :PERSQUEUE DEBUG: partition.cpp:2304: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T10:42:36.687123Z :DEBUG: [] MessageGroupId [source8] SessionId [] Write session: send init request: init_request { topic: "topic1" message_group_id: "source8" }
2025-10-31T10:42:36.687308Z node 7 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-31T10:42:36.687325Z node 7 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 9
2025-10-31T10:42:36.687474Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 9 sessionId:  grpc read done: success: 1 data: init_request { topic: "topic1" message_group_id: "source8" }
2025-10-31T10:42:36.687507Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 9 topic: "topic1" message_group_id: "source8" from ipv6:[::1]:59884
2025-10-31T10:42:36.687513Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=9 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:59884 proto=v1  topic=topic1 durationSec=0
2025-10-31T10:42:36.687517Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-31T10:42:36.687952Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 9 sessionId:  describe result for acl check
2025-10-31T10:42:36.687989Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-31T10:42:36.687998Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-31T10:42:36.687999Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-31T10:42:36.688005Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [7:7567334475049666200:2513] (SourceId=source8, PreferedPartition=(NULL)) StartKqpSession
2025-10-31T10:42:36.688544Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [7:7567334475049666200:2513] (SourceId=source8, PreferedPartition=(NULL)) Select from the table
2025-10-31T10:42:36.690832Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [7:7567334475049666200:2513] (SourceId=source8, PreferedPartition=(NULL)) RequestPQRB
2025-10-31T10:42:36.691051Z node 8 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1655: [72075186224037893][rt3.dc1--topic1] pipe [7:7567334475049666216:2513] connected; active server actors: 1
2025-10-31T10:42:36.691170Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [7:7567334475049666200:2513] (SourceId=source8, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=source8
2025-10-31T10:42:36.691182Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [7:7567334475049666200:2513] (SourceId=source8, PreferedPartition=(NULL)) Update the table
2025-10-31T10:42:36.691285Z node 8 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1659: [72075186224037893][rt3.dc1--topic1] pipe [7:7567334475049666216:2513] disconnected.
2025-10-31T10:42:36.691295Z node 8 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1670: [72075186224037893][rt3.dc1--topic1] pipe [7:7567334475049666216:2513] disconnected; active server actors: 1
2025-10-31T10:42:36.691297Z node 8 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1695: [72075186224037893][rt3.dc1--topic1] pipe [7:7567334475049666216:2513] disconnected no session
2025-10-31T10:42:36.694202Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [7:7567334475049666200:2513] (SourceId=source8, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-31T10:42:36.694218Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [7:7567334475049666200:2513] (SourceId=source8, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-10-31T10:42:36.694222Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [7:7567334475049666200:2513] (SourceId=source8, PreferedPartition=(NULL)) Start idle
2025-10-31T10:42:36.694240Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 9 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-31T10:42:36.694625Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [7:7567334475049666229:2513], now have 1 active actors on pipe
2025-10-31T10:42:36.694673Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 7, Generation: 1
2025-10-31T10:42:36.694686Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T10:42:36.694692Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T10:42:36.694720Z node 7 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie source8|8d6a9393-5bda05da-4f283d1-7690b2c0_0 generated for partition 0 topic 'rt3.dc1--topic1' owner source8
2025-10-31T10:42:36.694741Z node 7 :PERSQUEUE DEBUG: partition.cpp:2272: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T10:42:36.694747Z node 7 :PERSQUEUE DEBUG: partition.cpp:2281: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T10:42:36.694750Z node 7 :PERSQUEUE DEBUG: partition.cpp:2285: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-31T10:42:36.694762Z node 7 :PERSQUEUE DEBUG: partition.cpp:2304: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T10:42:36.694780Z node 7 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-31T10:42:36.694797Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-31T10:42:36.694854Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T10:42:36.694865Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T10:42:36.694880Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-31T10:42:36.694904Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 9 partition: 0 MaxSeqNo: 0 sessionId: source8|8d6a9393-5bda05da-4f283d1-7690b2c0_0
2025-10-31T10:42:36.695254Z :INFO: [] MessageGroupId [source8] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1761907356695 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-31T10:42:36.695313Z :INFO: [] MessageGroupId [source8] SessionId [] Write session established. Init response: session_id: "source8|8d6a9393-5bda05da-4f283d1-7690b2c0_0" topic: "topic1" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-31T10:42:36.695555Z :DEBUG: [] MessageGroupId [source8] SessionId [source8|8d6a9393-5bda05da-4f283d1-7690b2c0_0] Write 1 messages with Id from 1 to 1
2025-10-31T10:42:36.695592Z :INFO: [] MessageGroupId [source8] SessionId [source8|8d6a9393-5bda05da-4f283d1-7690b2c0_0] Write session: close. Timeout = 10000 ms
2025-10-31T10:42:36.700147Z node 7 :PERSQUEUE DEBUG: partition.cpp:2272: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T10:42:36.700162Z node 7 :PERSQUEUE DEBUG: partition.cpp:2281: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T10:42:36.700166Z node 7 :PERSQUEUE DEBUG: partition.cpp:2304: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T10:42:36.701122Z :DEBUG: [] MessageGroupId [source8] SessionId [source8|8d6a9393-5bda05da-4f283d1-7690b2c0_0] Write session: try to update token
2025-10-31T10:42:36.701139Z :DEBUG: [] MessageGroupId [source8] SessionId [source8|8d6a9393-5bda05da-4f283d1-7690b2c0_0] Send 1 message(s) (0 left), first sequence number is 1
2025-10-31T10:42:36.701430Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 9 sessionId: source8|8d6a9393-5bda05da-4f283d1-7690b2c0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-31T10:42:36.701621Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-31T10:42:36.701679Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T10:42:36.701696Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T10:42:36.701741Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-31T10:42:36.701762Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-31T10:42:36.701875Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T10:42:36.701895Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T10:42:36.701918Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: '\0source8' SeqNo: 1 partNo : 0 messageNo: 1 size 1122 offset: -1
2025-10-31T10:42:36.701935Z node 7 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-31T10:42:36.701970Z node 7 :PERSQUEUE DEBUG: partition.cpp:2272: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T10:42:36.701985Z node 7 :PERSQUEUE DEBUG: partition.cpp:2281: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T10:42:36.701988Z node 7 :PERSQUEUE DEBUG: partition.cpp:2285: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-31T10:42:36.702030Z node 7 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId '\0source8' seqNo 1 partNo 0
2025-10-31T10:42:36.702080Z node 7 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '\0source8' seqNo 1 partNo 0 FormedBlobsCount 0 NewHead: Offset 8 PartNo 0 PackedSize 1197 count 1 nextOffset 9 batches 1
2025-10-31T10:42:36.702100Z node 7 :PERSQUEUE DEBUG: partition.cpp:2304: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T10:42:36.702162Z node 7 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 8,1 HeadOffset 8 endOffset 8 curOffset 9 d0000000000_00000000000000000008_00000_0000000001_00000? size 1185 WTime 1761907356702
2025-10-31T10:42:36.702197Z node 7 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-31T10:42:36.702212Z node 7 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 8 partNo 0 count 1 size 1185
2025-10-31T10:42:36.703866Z node 7 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 8 count 1 size 1185 actorID [7:7567334470754698339:2439]
2025-10-31T10:42:36.703902Z node 7 :PERSQUEUE DEBUG: partition.cpp:2099: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-31T10:42:36.703925Z node 7 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1130 WriteNewSizeFromSupportivePartitions# 0
2025-10-31T10:42:36.703942Z node 7 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-31T10:42:36.703958Z node 7 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0source8', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 1, partNo: 0, Offset: 8 is stored on disk
2025-10-31T10:42:36.703962Z node 7 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 8 partno 0 count 1 parts 0 suffix '63' size 1185
2025-10-31T10:42:36.703994Z node 7 :PERSQUEUE DEBUG: partition.cpp:2272: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T10:42:36.704002Z node 7 :PERSQUEUE DEBUG: partition.cpp:2281: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T10:42:36.704004Z node 7 :PERSQUEUE DEBUG: partition.cpp:2304: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T10:42:36.704015Z node 7 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-31T10:42:36.704032Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 1  requestId: <none> cookie: 1
2025-10-31T10:42:36.704061Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 1 consumer shared/user session shared/user_7_1_190747618541107145_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 8 EndOffset 8 newEndOffset 9 commitOffset 0 clientCommitOffset 0 cookie 9 readingFinished 0 firstRead 0
2025-10-31T10:42:36.704071Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_7_1_190747618541107145_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 8 endOffset 9
2025-10-31T10:42:36.704086Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-31T10:42:36.704235Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_7_1_190747618541107145_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 8, endOffset# 9, WTime# 1761907356591, sizeLag# 1185
2025-10-31T10:42:36.704244Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_7_1_190747618541107145_v1TEvPartitionReady. Aval parts: 1
2025-10-31T10:42:36.704256Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_7_1_190747618541107145_v1 performing read request: guid# 964f5918-6222060c-2547cb33-1f14b1b0, from# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), count# 1, size# 1422, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-31T10:42:36.704305Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_7_1_190747618541107145_v1 READ FROM TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1)maxCount 1 maxSize 1422 maxTimeLagMs 0 readTimestampMs 0 readOffset 8 EndOffset 9 ClientCommitOffset 0 committedOffset 0 Guid 964f5918-6222060c-2547cb33-1f14b1b0
2025-10-31T10:42:36.704383Z :DEBUG: [] MessageGroupId [source8] SessionId [source8|8d6a9393-5bda05da-4f283d1-7690b2c0_0] Write session got write response: sequence_numbers: 1 offsets: 8 already_written: false write_statistics { persist_duration_ms: 2 }
2025-10-31T10:42:36.704409Z :DEBUG: [] MessageGroupId [source8] SessionId [source8|8d6a9393-5bda05da-4f283d1-7690b2c0_0] Write session: acknoledged message 1
2025-10-31T10:42:36.704444Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T10:42:36.704458Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T10:42:36.704489Z node 7 :PERSQUEUE DEBUG: partition_read.cpp:883: [72075186224037892][Partition][0][StateIdle] read cookie 12 Topic 'rt3.dc1--topic1' partition 0 user user offset 8 count 1 size 1422 endOffset 9 max time lag 0ms effective offset 8
2025-10-31T10:42:36.704511Z node 7 :PERSQUEUE DEBUG: partition_read.cpp:1097: [72075186224037892][Partition][0][StateIdle] read cookie 12 added 1 blobs, size 1185 count 1 last offset 8, current partition end offset: 9
2025-10-31T10:42:36.704514Z node 7 :PERSQUEUE DEBUG: partition_read.cpp:1123: [72075186224037892][Partition][0][StateIdle] Reading cookie 12. Send blob request.
2025-10-31T10:42:36.704524Z node 7 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 8 partno 0 count 1 parts_count 0 source 1 size 1185 accessed 0 times before, last time 2025-10-31T10:42:36.000000Z
2025-10-31T10:42:36.704539Z node 7 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 12. All 1 blobs are from cache.
2025-10-31T10:42:36.704555Z node 7 :PERSQUEUE DEBUG: partition_read.cpp:581: FormAnswer for 1 blobs
2025-10-31T10:42:36.704556Z node 7 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 8 partno 0 count 1 parts 0 suffix '63'
2025-10-31T10:42:36.704587Z node 7 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 8 totakecount 1 count 1 size 1165 from pos 0 cbcount 1
2025-10-31T10:42:36.704614Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 8
2025-10-31T10:42:36.704744Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_7_1_190747618541107145_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 9 Result { Offset: 8 Data: "... 1122 bytes ..." SourceId: "\000source8" SeqNo: 1 WriteTimestampMS: 1761907356701 CreateTimestampMS: 1761907356695 UncompressedSize: 1047552 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 20 RealReadOffset: 8 WaitQuotaTimeMs: 0 EndOffset: 9 StartOffset: 0 } Cookie: 8 }
2025-10-31T10:42:36.704773Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_7_1_190747618541107145_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 10 from offset 9
2025-10-31T10:42:36.704785Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_7_1_190747618541107145_v1 after read state TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 9 ReadOffset 9 ReadGuid 964f5918-6222060c-2547cb33-1f14b1b0 has messages 1
2025-10-31T10:42:36.704793Z :INFO: [] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:topic1:0:1:7:0
2025-10-31T10:42:36.704808Z :INFO: [] [] [f78ceb12-4438829-f5e170b5-da18a51d] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1000 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 8400 BytesInflightTotal: 8400 MessagesInflight: 8 }
2025-10-31T10:42:36.704936Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_7_1_190747618541107145_v1 read done: guid# 964f5918-6222060c-2547cb33-1f14b1b0, partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), size# 1224
2025-10-31T10:42:36.704945Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_7_1_190747618541107145_v1 response to read: guid# 964f5918-6222060c-2547cb33-1f14b1b0
2025-10-31T10:42:36.705036Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_7_1_190747618541107145_v1 Process answer. Aval parts: 0
2025-10-31T10:42:36.705215Z :DEBUG: [] [] [f78ceb12-4438829-f5e170b5-da18a51d] [null] After sending read request: ReadSizeBudget = 2621440, ReadSizeServerDelta = 0
2025-10-31T10:42:36.705329Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_7_1_190747618541107145_v1 grpc read done: success# 1, data# { read { } }
2025-10-31T10:42:36.705372Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_7_1_190747618541107145_v1 got read request: guid# b1e3984-46773221-5b169492-b31d10ff
2025-10-31T10:42:36.800519Z node 7 :PERSQUEUE DEBUG: partition.cpp:2272: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T10:42:36.800540Z node 7 :PERSQUEUE DEBUG: partition.cpp:2281: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T10:42:36.800543Z node 7 :PERSQUEUE DEBUG: partition.cpp:2304: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T10:42:36.800744Z :INFO: [] MessageGroupId [source8] SessionId [source8|8d6a9393-5bda05da-4f283d1-7690b2c0_0] Write session will now close
2025-10-31T10:42:36.800762Z :DEBUG: [] MessageGroupId [source8] SessionId [source8|8d6a9393-5bda05da-4f283d1-7690b2c0_0] Write session: aborting
2025-10-31T10:42:36.800951Z :INFO: [] MessageGroupId [source8] SessionId [source8|8d6a9393-5bda05da-4f283d1-7690b2c0_0] Write session: gracefully shut down, all writes complete
2025-10-31T10:42:36.800968Z :DEBUG: [] MessageGroupId [source8] SessionId [source8|8d6a9393-5bda05da-4f283d1-7690b2c0_0] Write session: destroy
2025-10-31T10:42:36.801130Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 9 sessionId: source8|8d6a9393-5bda05da-4f283d1-7690b2c0_0 grpc read done: success: 0 data: 
2025-10-31T10:42:36.801142Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 9 sessionId: source8|8d6a9393-5bda05da-4f283d1-7690b2c0_0 grpc read failed
2025-10-31T10:42:36.801151Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 9 sessionId: source8|8d6a9393-5bda05da-4f283d1-7690b2c0_0 grpc closed
2025-10-31T10:42:36.801158Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 9 sessionId: source8|8d6a9393-5bda05da-4f283d1-7690b2c0_0 is DEAD
2025-10-31T10:42:36.801468Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-10-31T10:42:36.801534Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [7:7567334475049666229:2513] destroyed
2025-10-31T10:42:36.801548Z node 7 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-10-31T10:42:36.801558Z node 7 :PERSQUEUE DEBUG: partition.cpp:2272: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T10:42:36.801560Z node 7 :PERSQUEUE DEBUG: partition.cpp:2281: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T10:42:36.801563Z node 7 :PERSQUEUE DEBUG: partition.cpp:2304: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T10:42:36.804970Z :DEBUG: [] MessageGroupId [source9] SessionId [] Write session: try to update token
2025-10-31T10:42:36.805103Z :INFO: [] MessageGroupId [source9] SessionId [] Write session: Do CDS request
2025-10-31T10:42:36.805111Z :INFO: [] MessageGroupId [source9] SessionId [] Start write session. Will connect to endpoint: localhost:2244
2025-10-31T10:42:36.806075Z :DEBUG: [] MessageGroupId [source9] SessionId [] Write session: send init request: init_request { topic: "topic1" message_group_id: "source9" }
2025-10-31T10:42:36.806226Z node 7 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-31T10:42:36.806240Z node 7 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 10
2025-10-31T10:42:36.806367Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 10 sessionId:  grpc read done: success: 1 data: init_request { topic: "topic1" message_group_id: "source9" }
2025-10-31T10:42:36.806402Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 10 topic: "topic1" message_group_id: "source9" from ipv6:[::1]:59884
2025-10-31T10:42:36.806412Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=10 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:59884 proto=v1  topic=topic1 durationSec=0
2025-10-31T10:42:36.806416Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-31T10:42:36.806907Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 10 sessionId:  describe result for acl check
2025-10-31T10:42:36.806945Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-31T10:42:36.806951Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-31T10:42:36.806953Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-31T10:42:36.806958Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [7:7567334475049666262:2521] (SourceId=source9, PreferedPartition=(NULL)) StartKqpSession
2025-10-31T10:42:36.807543Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [7:7567334475049666262:2521] (SourceId=source9, PreferedPartition=(NULL)) Select from the table
2025-10-31T10:42:36.809607Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [7:7567334475049666262:2521] (SourceId=source9, PreferedPartition=(NULL)) RequestPQRB
2025-10-31T10:42:36.809766Z node 8 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1655: [72075186224037893][rt3.dc1--topic1] pipe [7:7567334475049666278:2521] connected; active server actors: 1
2025-10-31T10:42:36.809952Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [7:7567334475049666262:2521] (SourceId=source9, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=source9
2025-10-31T10:42:36.809960Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [7:7567334475049666262:2521] (SourceId=source9, PreferedPartition=(NULL)) Update the table
2025-10-31T10:42:36.810102Z node 8 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1659: [72075186224037893][rt3.dc1--topic1] pipe [7:7567334475049666278:2521] disconnected.
2025-10-31T10:42:36.810111Z node 8 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1670: [72075186224037893][rt3.dc1--topic1] pipe [7:7567334475049666278:2521] disconnected; active server actors: 1
2025-10-31T10:42:36.810124Z node 8 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1695: [72075186224037893][rt3.dc1--topic1] pipe [7:7567334475049666278:2521] disconnected no session
2025-10-31T10:42:36.812746Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [7:7567334475049666262:2521] (SourceId=source9, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-31T10:42:36.812758Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [7:7567334475049666262:2521] (SourceId=source9, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-10-31T10:42:36.812761Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [7:7567334475049666262:2521] (SourceId=source9, PreferedPartition=(NULL)) Start idle
2025-10-31T10:42:36.812767Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 10 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-31T10:42:36.812885Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 7, Generation: 1
2025-10-31T10:42:36.812908Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [7:7567334475049666292:2521], now have 1 active actors on pipe
2025-10-31T10:42:36.812916Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T10:42:36.812922Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T10:42:36.812943Z node 7 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie source9|ea0473c5-a11aa016-d15f043c-b5ec0aee_0 generated for partition 0 topic 'rt3.dc1--topic1' owner source9
2025-10-31T10:42:36.812956Z node 7 :PERSQUEUE DEBUG: partition.cpp:2272: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T10:42:36.812964Z node 7 :PERSQUEUE DEBUG: partition.cpp:2281: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T10:42:36.812967Z node 7 :PERSQUEUE DEBUG: partition.cpp:2285: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-31T10:42:36.812979Z node 7 :PERSQUEUE DEBUG: partition.cpp:2304: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T10:42:36.812997Z node 7 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-31T10:42:36.813017Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-31T10:42:36.813057Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T10:42:36.813064Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T10:42:36.813075Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-31T10:42:36.813107Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 10 partition: 0 MaxSeqNo: 0 sessionId: source9|ea0473c5-a11aa016-d15f043c-b5ec0aee_0
2025-10-31T10:42:36.813376Z :INFO: [] MessageGroupId [source9] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1761907356813 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-31T10:42:36.813413Z :INFO: [] MessageGroupId [source9] SessionId [] Write session established. Init response: session_id: "source9|ea0473c5-a11aa016-d15f043c-b5ec0aee_0" topic: "topic1" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-31T10:42:36.813632Z :DEBUG: [] MessageGroupId [source9] SessionId [source9|ea0473c5-a11aa016-d15f043c-b5ec0aee_0] Write 1 messages with Id from 1 to 1
2025-10-31T10:42:36.813658Z :INFO: [] MessageGroupId [source9] SessionId [source9|ea0473c5-a11aa016-d15f043c-b5ec0aee_0] Write session: close. Timeout = 10000 ms
2025-10-31T10:42:36.818707Z :DEBUG: [] MessageGroupId [source9] SessionId [source9|ea0473c5-a11aa016-d15f043c-b5ec0aee_0] Write session: try to update token
2025-10-31T10:42:36.818722Z :DEBUG: [] MessageGroupId [source9] SessionId [source9|ea0473c5-a11aa016-d15f043c-b5ec0aee_0] Send 1 message(s) (0 left), first sequence number is 1
2025-10-31T10:42:36.818987Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 10 sessionId: source9|ea0473c5-a11aa016-d15f043c-b5ec0aee_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-31T10:42:36.819103Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-31T10:42:36.819153Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T10:42:36.819163Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T10:42:36.819190Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-31T10:42:36.819207Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-31T10:42:36.819238Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T10:42:36.819242Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T10:42:36.819257Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: '\0source9' SeqNo: 1 partNo : 0 messageNo: 1 size 1122 offset: -1
2025-10-31T10:42:36.819266Z node 7 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-31T10:42:36.819278Z node 7 :PERSQUEUE DEBUG: partition.cpp:2272: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T10:42:36.819287Z node 7 :PERSQUEUE DEBUG: partition.cpp:2281: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T10:42:36.819289Z node 7 :PERSQUEUE DEBUG: partition.cpp:2285: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-31T10:42:36.819313Z node 7 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId '\0source9' seqNo 1 partNo 0
2025-10-31T10:42:36.819352Z node 7 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '\0source9' seqNo 1 partNo 0 FormedBlobsCount 0 NewHead: Offset 9 PartNo 0 PackedSize 1197 count 1 nextOffset 10 batches 1
2025-10-31T10:42:36.819360Z node 7 :PERSQUEUE DEBUG: partition.cpp:2304: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T10:42:36.819394Z node 7 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 9,1 HeadOffset 9 endOffset 9 curOffset 10 d0000000000_00000000000000000009_00000_0000000001_00000? size 1185 WTime 1761907356819
2025-10-31T10:42:36.819415Z node 7 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-31T10:42:36.819426Z node 7 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 9 partNo 0 count 1 size 1185
2025-10-31T10:42:36.820787Z node 7 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 9 count 1 size 1185 actorID [7:7567334470754698339:2439]
2025-10-31T10:42:36.820811Z node 7 :PERSQUEUE DEBUG: partition.cpp:2099: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-31T10:42:36.820827Z node 7 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 9 partno 0 count 1 parts 0 suffix '63' size 1185
2025-10-31T10:42:36.820828Z node 7 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1130 WriteNewSizeFromSupportivePartitions# 0
2025-10-31T10:42:36.820838Z node 7 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-31T10:42:36.820848Z node 7 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0source9', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 1, partNo: 0, Offset: 9 is stored on disk
2025-10-31T10:42:36.820888Z node 7 :PERSQUEUE DEBUG: partition.cpp:2272: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T10:42:36.820894Z node 7 :PERSQUEUE DEBUG: partition.cpp:2281: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T10:42:36.820896Z node 7 :PERSQUEUE DEBUG: partition.cpp:2304: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T10:42:36.820904Z node 7 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-31T10:42:36.820906Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 1 consumer shared/user session shared/user_7_1_190747618541107145_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 9 EndOffset 9 newEndOffset 10 commitOffset 0 clientCommitOffset 0 cookie 10 readingFinished 0 firstRead 0
2025-10-31T10:42:36.820911Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_7_1_190747618541107145_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 9 endOffset 10
2025-10-31T10:42:36.820920Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 1  requestId: <none> cookie: 1
2025-10-31T10:42:36.820925Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_7_1_190747618541107145_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 9, endOffset# 10, WTime# 1761907356701, sizeLag# 1185
2025-10-31T10:42:36.820927Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_7_1_190747618541107145_v1TEvPartitionReady. Aval parts: 1
2025-10-31T10:42:36.820935Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-31T10:42:36.820940Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_7_1_190747618541107145_v1 performing read request: guid# b1e3984-46773221-5b169492-b31d10ff, from# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), count# 1, size# 1422, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-31T10:42:36.820952Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_7_1_190747618541107145_v1 READ FROM TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1)maxCount 1 maxSize 1422 maxTimeLagMs 0 readTimestampMs 0 readOffset 9 EndOffset 10 ClientCommitOffset 0 committedOffset 0 Guid b1e3984-46773221-5b169492-b31d10ff
2025-10-31T10:42:36.820990Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T10:42:36.821000Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T10:42:36.821028Z node 7 :PERSQUEUE DEBUG: partition_read.cpp:883: [72075186224037892][Partition][0][StateIdle] read cookie 13 Topic 'rt3.dc1--topic1' partition 0 user user offset 9 count 1 size 1422 endOffset 10 max time lag 0ms effective offset 9
2025-10-31T10:42:36.821053Z node 7 :PERSQUEUE DEBUG: partition_read.cpp:1097: [72075186224037892][Partition][0][StateIdle] read cookie 13 added 1 blobs, size 1185 count 1 last offset 9, current partition end offset: 10
2025-10-31T10:42:36.821061Z node 7 :PERSQUEUE DEBUG: partition_read.cpp:1123: [72075186224037892][Partition][0][StateIdle] Reading cookie 13. Send blob request.
2025-10-31T10:42:36.821071Z node 7 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 9 partno 0 count 1 parts_count 0 source 1 size 1185 accessed 0 times before, last time 2025-10-31T10:42:36.000000Z
2025-10-31T10:42:36.821085Z node 7 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 13. All 1 blobs are from cache.
2025-10-31T10:42:36.821100Z node 7 :PERSQUEUE DEBUG: partition_read.cpp:581: FormAnswer for 1 blobs
2025-10-31T10:42:36.821107Z node 7 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 9 partno 0 count 1 parts 0 suffix '63'
2025-10-31T10:42:36.821118Z node 7 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 9 totakecount 1 count 1 size 1165 from pos 0 cbcount 1
2025-10-31T10:42:36.821146Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 9
2025-10-31T10:42:36.821164Z :DEBUG: [] MessageGroupId [source9] SessionId [source9|ea0473c5-a11aa016-d15f043c-b5ec0aee_0] Write session got write response: sequence_numbers: 1 offsets: 9 already_written: false write_statistics { persist_duration_ms: 1 }
2025-10-31T10:42:36.821174Z :DEBUG: [] MessageGroupId [source9] SessionId [source9|ea0473c5-a11aa016-d15f043c-b5ec0aee_0] Write session: acknoledged message 1
2025-10-31T10:42:36.821220Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_7_1_190747618541107145_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 10 Result { Offset: 9 Data: "... 1122 bytes ..." SourceId: "\000source9" SeqNo: 1 WriteTimestampMS: 1761907356818 CreateTimestampMS: 1761907356813 UncompressedSize: 1047552 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 20 RealReadOffset: 9 WaitQuotaTimeMs: 0 EndOffset: 10 StartOffset: 0 } Cookie: 9 }
2025-10-31T10:42:36.821249Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_7_1_190747618541107145_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 11 from offset 10
2025-10-31T10:42:36.821257Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_7_1_190747618541107145_v1 after read state TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 10 ReadOffset 10 ReadGuid b1e3984-46773221-5b169492-b31d10ff has messages 1
2025-10-31T10:42:36.821296Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_7_1_190747618541107145_v1 read done: guid# b1e3984-46773221-5b169492-b31d10ff, partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), size# 1224
2025-10-31T10:42:36.821311Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_7_1_190747618541107145_v1 response to read: guid# b1e3984-46773221-5b169492-b31d10ff
2025-10-31T10:42:36.821395Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_7_1_190747618541107145_v1 Process answer. Aval parts: 0
2025-10-31T10:42:36.821614Z :DEBUG: [] [] [f78ceb12-4438829-f5e170b5-da18a51d] [null] After sending read request: ReadSizeBudget = 2621440, ReadSizeServerDelta = 0
2025-10-31T10:42:36.821711Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_7_1_190747618541107145_v1 grpc read done: success# 1, data# { read { } }
2025-10-31T10:42:36.821752Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_7_1_190747618541107145_v1 got read request: guid# c1fd5b25-a5b1eabf-56239116-5e63155
2025-10-31T10:42:36.900913Z node 7 :PERSQUEUE DEBUG: partition.cpp:2272: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T10:42:36.900932Z node 7 :PERSQUEUE DEBUG: partition.cpp:2281: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T10:42:36.900936Z node 7 :PERSQUEUE DEBUG: partition.cpp:2304: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T10:42:36.913744Z :INFO: [] MessageGroupId [source9] SessionId [source9|ea0473c5-a11aa016-d15f043c-b5ec0aee_0] Write session will now close
2025-10-31T10:42:36.913765Z :DEBUG: [] MessageGroupId [source9] SessionId [source9|ea0473c5-a11aa016-d15f043c-b5ec0aee_0] Write session: aborting
2025-10-31T10:42:36.913921Z :INFO: [] MessageGroupId [source9] SessionId [source9|ea0473c5-a11aa016-d15f043c-b5ec0aee_0] Write session: gracefully shut down, all writes complete
2025-10-31T10:42:36.913939Z :DEBUG: [] MessageGroupId [source9] SessionId [source9|ea0473c5-a11aa016-d15f043c-b5ec0aee_0] Write session: destroy
2025-10-31T10:42:36.914174Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 10 sessionId: source9|ea0473c5-a11aa016-d15f043c-b5ec0aee_0 grpc read done: success: 0 data: 
2025-10-31T10:42:36.914194Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 10 sessionId: source9|ea0473c5-a11aa016-d15f043c-b5ec0aee_0 grpc read failed
2025-10-31T10:42:36.914207Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 10 sessionId: source9|ea0473c5-a11aa016-d15f043c-b5ec0aee_0 grpc closed
2025-10-31T10:42:36.914216Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 10 sessionId: source9|ea0473c5-a11aa016-d15f043c-b5ec0aee_0 is DEAD
2025-10-31T10:42:36.914664Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-10-31T10:42:36.914891Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [7:7567334475049666292:2521] destroyed
2025-10-31T10:42:36.914906Z node 7 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-10-31T10:42:36.914916Z node 7 :PERSQUEUE DEBUG: partition.cpp:2272: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T10:42:36.914920Z node 7 :PERSQUEUE DEBUG: partition.cpp:2281: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T10:42:36.914923Z node 7 :PERSQUEUE DEBUG: partition.cpp:2304: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T10:42:36.918959Z :DEBUG: [] Decompression task done. Partition/PartitionSessionId: 0 (0-0)
2025-10-31T10:42:36.919077Z :DEBUG: [] Decompression task done. Partition/PartitionSessionId: 0 (1-1)
2025-10-31T10:42:36.922306Z :DEBUG: [] Decompression task done. Partition/PartitionSessionId: 0 (2-2)
2025-10-31T10:42:37.001540Z node 7 :PERSQUEUE DEBUG: partition.cpp:2272: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T10:42:37.001557Z node 7 :PERSQUEUE DEBUG: partition.cpp:2281: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T10:42:37.001560Z node 7 :PERSQUEUE DEBUG: partition.cpp:2304: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T10:42:37.102153Z node 7 :PERSQUEUE DEBUG: partition.cpp:2272: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T10:42:37.102170Z node 7 :PERSQUEUE DEBUG: partition.cpp:2281: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T10:42:37.102174Z node 7 :PERSQUEUE DEBUG: partition.cpp:2304: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T10:42:37.206453Z node 7 :PERSQUEUE DEBUG: partition.cpp:2272: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T10:42:37.206473Z node 7 :PERSQUEUE DEBUG: partition.cpp:2281: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T10:42:37.206476Z node 7 :PERSQUEUE DEBUG: partition.cpp:2304: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T10:42:37.306375Z node 7 :PERSQUEUE DEBUG: partition.cpp:2272: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T10:42:37.306393Z node 7 :PERSQUEUE DEBUG: partition.cpp:2281: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T10:42:37.306396Z node 7 :PERSQUEUE DEBUG: partition.cpp:2304: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T10:42:37.408763Z node 7 :PERSQUEUE DEBUG: partition.cpp:2272: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T10:42:37.408781Z node 7 :PERSQUEUE DEBUG: partition.cpp:2281: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T10:42:37.408784Z node 7 :PERSQUEUE DEBUG: partition.cpp:2304: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T10:42:37.509130Z node 7 :PERSQUEUE DEBUG: partition.cpp:2272: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T10:42:37.509150Z node 7 :PERSQUEUE DEBUG: partition.cpp:2281: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T10:42:37.509152Z node 7 :PERSQUEUE DEBUG: partition.cpp:2304: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T10:42:37.609461Z node 7 :PERSQUEUE DEBUG: partition.cpp:2272: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T10:42:37.609477Z node 7 :PERSQUEUE DEBUG: partition.cpp:2281: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T10:42:37.609479Z node 7 :PERSQUEUE DEBUG: partition.cpp:2304: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T10:42:37.709807Z node 7 :PERSQUEUE DEBUG: partition.cpp:2272: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T10:42:37.709819Z node 7 :PERSQUEUE DEBUG: partition.cpp:2281: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T10:42:37.709821Z node 7 :PERSQUEUE DEBUG: partition.cpp:2304: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T10:42:37.812774Z node 7 :PERSQUEUE DEBUG: partition.cpp:2272: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T10:42:37.812793Z node 7 :PERSQUEUE DEBUG: partition.cpp:2281: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T10:42:37.812797Z node 7 :PERSQUEUE DEBUG: partition.cpp:2304: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T10:42:37.916761Z :INFO: [] [] [f78ceb12-4438829-f5e170b5-da18a51d] Closing read session. Close timeout: 0.000000s
2025-10-31T10:42:37.916802Z :INFO: [] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:topic1:0:1:9:0
2025-10-31T10:42:37.916818Z :INFO: [] [] [f78ceb12-4438829-f5e170b5-da18a51d] Counters: { Errors: 0 CurrentSessionLifetimeMs: 2212 BytesRead: 3142656 MessagesRead: 3 BytesReadCompressed: 3150 BytesInflightUncompressed: 3142656 BytesInflightCompressed: 7350 BytesInflightTotal: 3150006 MessagesInflight: 10 }
2025-10-31T10:42:37.916848Z :NOTICE: [] [] [f78ceb12-4438829-f5e170b5-da18a51d] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Close with zero timeout " }
2025-10-31T10:42:37.916961Z :DEBUG: [] [] [f78ceb12-4438829-f5e170b5-da18a51d] [null] Abort session to cluster
2025-10-31T10:42:37.917159Z :NOTICE: [] [] [f78ceb12-4438829-f5e170b5-da18a51d] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
2025-10-31T10:42:37.917125Z node 7 :PERSQUEUE DEBUG: partition.cpp:2272: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T10:42:37.917141Z node 7 :PERSQUEUE DEBUG: partition.cpp:2281: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T10:42:37.917144Z node 7 :PERSQUEUE DEBUG: partition.cpp:2304: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T10:42:37.921214Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_7_1_190747618541107145_v1 grpc read done: success# 0, data# {  }
2025-10-31T10:42:37.921234Z node 7 :PQ_READ_PROXY INFO: read_session_actor.cpp:125: session cookie 1 consumer shared/user session shared/user_7_1_190747618541107145_v1 grpc read failed
2025-10-31T10:42:37.921244Z node 7 :PQ_READ_PROXY INFO: read_session_actor.cpp:92: session cookie 1 consumer shared/user session shared/user_7_1_190747618541107145_v1 grpc closed
2025-10-31T10:42:37.921266Z node 7 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 1 consumer shared/user session shared/user_7_1_190747618541107145_v1 is DEAD
2025-10-31T10:42:37.924925Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:2258: [PQ: 72075186224037892] Destroy direct read session shared/user_7_1_190747618541107145_v1
2025-10-31T10:42:37.924964Z node 7 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [7:7567334470754698502:2465] destroyed
2025-10-31T10:42:37.924987Z node 7 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_7_1_190747618541107145_v1
2025-10-31T10:42:37.928035Z node 8 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1659: [72075186224037893][rt3.dc1--topic1] pipe [7:7567334470754698500:2462] disconnected.
2025-10-31T10:42:37.928053Z node 8 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1670: [72075186224037893][rt3.dc1--topic1] pipe [7:7567334470754698500:2462] disconnected; active server actors: 1
2025-10-31T10:42:37.928059Z node 8 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1679: [72075186224037893][rt3.dc1--topic1] pipe [7:7567334470754698500:2462] client user disconnected session shared/user_7_1_190747618541107145_v1
2025-10-31T10:42:38.023918Z node 7 :PERSQUEUE DEBUG: partition.cpp:2272: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T10:42:38.023935Z node 7 :PERSQUEUE DEBUG: partition.cpp:2281: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T10:42:38.023938Z node 7 :PERSQUEUE DEBUG: partition.cpp:2304: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T10:42:38.124815Z node 7 :PERSQUEUE DEBUG: partition.cpp:2272: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T10:42:38.124831Z node 7 :PERSQUEUE DEBUG: partition.cpp:2281: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T10:42:38.124834Z node 7 :PERSQUEUE DEBUG: partition.cpp:2304: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T10:42:38.225843Z node 7 :PERSQUEUE DEBUG: partition.cpp:2272: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T10:42:38.225866Z node 7 :PERSQUEUE DEBUG: partition.cpp:2281: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T10:42:38.225869Z node 7 :PERSQUEUE DEBUG: partition.cpp:2304: [72075186224037892][Partition][0][StateIdle] Try persist
