2025-10-31T13:55:28.487299Z node 7 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[7:7567384175055445378:2081];send_to=[0:7307199536658146131:7762515];
2025-10-31T13:55:28.487764Z node 7 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
2025-10-31T13:55:28.565120Z node 7 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-31T13:55:28.581024Z node 7 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
test_client.cpp: SetPath # /home/runner/.ya/build/build_root/zwqj/001c51/r3tmp/tmpylUa4P/pdisk_1.dat
2025-10-31T13:55:28.708791Z node 8 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-10-31T13:55:28.710646Z node 8 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-31T13:55:28.710813Z node 8 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=incorrect path status: LookupError;
2025-10-31T13:55:28.908983Z node 7 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-31T13:55:28.935686Z node 7 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(7, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-10-31T13:55:28.935823Z node 7 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(7, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-10-31T13:55:28.938111Z node 7 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
2025-10-31T13:55:28.968192Z node 7 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(8, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-10-31T13:55:28.977153Z node 7 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(8, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-10-31T13:55:28.986418Z node 7 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(7, (0,0,0,0)) VolatileState: Connecting -> Connected
2025-10-31T13:55:28.989425Z node 8 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-31T13:55:28.995894Z node 7 :HIVE WARN: hive_impl.cpp:811: HIVE#72057594037968897 Handle TEvInterconnect::TEvNodeConnected, NodeId 8 Cookie 8
2025-10-31T13:55:29.002238Z node 7 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(8, (0,0,0,0)) VolatileState: Connecting -> Connected
TServer::EnableGrpc on GrpcPort 27948, node 7
2025-10-31T13:55:29.260071Z node 7 :NET_CLASSIFIER WARN: net_classifier.cpp:190: distributable config is empty, broken or outdated, will use file: /home/runner/.ya/build/build_root/zwqj/001c51/r3tmp/yandexzOd4ZQ.tmp
2025-10-31T13:55:29.260100Z node 7 :NET_CLASSIFIER WARN: net_classifier.cpp:196: will try to initialize from file: /home/runner/.ya/build/build_root/zwqj/001c51/r3tmp/yandexzOd4ZQ.tmp
2025-10-31T13:55:29.260251Z node 7 :NET_CLASSIFIER WARN: net_classifier.cpp:202: successfully initialized from file: /home/runner/.ya/build/build_root/zwqj/001c51/r3tmp/yandexzOd4ZQ.tmp
2025-10-31T13:55:29.260385Z node 7 :NET_CLASSIFIER ERROR: net_classifier.cpp:228: got bad distributable configuration
2025-10-31T13:55:29.289441Z node 7 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-10-31T13:55:29.357664Z INFO: TTestServer started on Port 19527 GrpcPort 27948
2025-10-31T13:55:29.453634Z node 8 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-10-31T13:55:29.485776Z node 7 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-10-31T13:55:29.677090Z node 8 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
TClient is connected to server localhost:19527
PQClient connected to localhost:27948
WaitRootIsUp 'Root'...
TClient::Ls request: Root
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "Root"
    PathId: 1
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 1
    CreateStep: 0
    ParentPathId: 1
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 1
      SubDomainVersion: 0
      SecurityStateVersion: 0
    }
    ChildrenExist: false
  }
  Children {
    Name: ".sys"
    PathId: 18446744073709551615
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 0
    CreateStep: 0
    ParentPathId: 18446744073709551615
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 0
      Pl...
(TRUNCATED)
WaitRootIsUp 'Root' success.
2025-10-31T13:55:29.792446Z node 7 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpAlterSubDomain, opId: 281474976710657:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_alter_subdomain.cpp:311)
waiting...
waiting...
2025-10-31T13:55:29.840200Z node 7 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710659:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:690)
waiting...
waiting...
waiting...
2025-10-31T13:55:33.456191Z node 7 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[7:7567384175055445378:2081];send_to=[0:7307199536658146131:7762515];
2025-10-31T13:55:33.456277Z node 7 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
2025-10-31T13:55:33.751944Z node 7 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [7:7567384196530282930:2330], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-31T13:55:33.752076Z node 7 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-31T13:55:33.753601Z node 7 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [7:7567384196530282944:2335], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-31T13:55:33.753696Z node 7 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-31T13:55:33.753874Z node 7 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [7:7567384196530282943:2334], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-31T13:55:33.759627Z node 7 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateResourcePool, opId: 281474976710662:3, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_resource_pool.cpp:179)
2025-10-31T13:55:33.770357Z node 7 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [7:7567384196530282979:2338], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-31T13:55:33.770938Z node 7 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-31T13:55:33.804492Z node 7 :KQP_WORKLOAD_SERVICE WARN: helpers.h:73: [WorkloadService] [TPoolCreatorActor] ActorId: [7:7567384196530282947:2336], DatabaseId: /Root, PoolId: default, Scheduled retry for error: { <main>: Error: Transaction 281474976710662 completed, doublechecking }
2025-10-31T13:55:33.836438Z node 7 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710663:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:690)
2025-10-31T13:55:33.857160Z node 8 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:570: Compilation failed, self: [8:7567384197701821168:2310], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-10-31T13:55:33.858888Z node 8 :KQP_SESSION WARN: kqp_session_actor.cpp:2500: SessionId: ydb://session/3?node_id=8&id=NDdjOWE4ZGItYzE3NjRkNDQtZDVhZTkyOTctOGE0ZGZmNzc=, ActorId: [8:7567384197701821125:2301], ActorState: ExecuteState, TraceId: 01k8x8tps91aj9jzgkytyzbnj9, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-10-31T13:55:33.859500Z node 8 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-10-31T13:55:33.911293Z node 7 :TX_PROXY ERROR: schemereq.cpp:593: Actor# [7:7567384196530283128:2826] txid# 281474976710664, issues: { message: "Check failed: path: \'/Root/.metadata/workload_manager/pools/default\', error: path exist, request accepts it (id: [OwnerId: 72057594046644480, LocalPathId: 9], type: EPathTypeResourcePool, state: EPathStateNoChanges)" severity: 1 }
2025-10-31T13:55:33.968372Z node 7 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:570: Compilation failed, self: [7:7567384196530283148:2350], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-10-31T13:55:33.972110Z node 7 :KQP_SESSION WARN: kqp_session_actor.cpp:2500: SessionId: ydb://session/3?node_id=7&id=ZjJjNjc2ODAtNmI2NzRjZWItMTg3YmY0ZDAtMjYzNTNiZDU=, ActorId: [7:7567384196530282928:2329], ActorState: ExecuteState, TraceId: 01k8x8tpqg36bb8fd0y0mfqeby, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-10-31T13:55:33.972651Z node 7 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-10-31T13:55:34.027788Z node 7 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710665:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:690)
2025-10-31T13:55:34.389919Z node 7 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710666:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:690)
=== Init DC: UPSERT INTO `/Root/PQ/Config/V2/Cluster` (name, balancer, local, enabled, weight) VALUES ("dc1", "localhost", true, true, 1000), ("dc2", "dc2.logbroker.yandex.net", false, true, 1000);
2025-10-31T13:55:34.718665Z node 7 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976710667. Ctx: { TraceId: 01k8x8tqgm6mxjqqecykfrkwq2, Database: , SessionId: ydb://session/3?node_id=7&id=MTg2OGI3MzMtZDczOTEzZTctZjRiOTI0ZTQtZDE2YWYxY2U=, PoolId: default, DatabaseId: /Root}. Database not set, use /Root
=== CheckClustersList. Subcribe to ClusterTracker from [7:7567384200825250802:3106] 
=== CheckClustersList. Ok
PQ Client: create topic: rt3.dc1--topic1 with 1 partitions
CallPersQueueGRPC request to localhost:27948
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--topic1"
  }
}
2025-10-31T13:55:41.544281Z node 7 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--topic1, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
CallPersQueueGRPC request to localhost:27948
MetaRequest {
  CmdCreateTopic {
    Topic: "rt3.dc1--topic1"
    NumPartitions: 1
    Config {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
  }
}
CallPersQueueGRPC response:
Status: 129
ProxyErrorCode: 53
SchemeStatus: 1
FlatTxId {
  TxId: 281474976710672
  SchemeShardTabletId: 72057594046644480
  PathId: 13
}
ErrorCode: OK
AddTopic: rt3.dc1--topic1
===Run query:``DECLARE $version as Int64; DECLARE $path AS Utf8; DECLARE $cluster as Utf8; UPSERT INTO `/Root/PQ/Config/V2/Topics` (path, dc) VALUES ($path, $cluster); UPSERT INTO `/Root/PQ/Config/V2/Versions` (name, version) VALUES ("Topics", $version);`` with topic = topic1, dc = dc1
2025-10-31T13:55:41.614846Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1655: [72075186224037893][] pipe [7:7567384230890022298:3350] connected; active server actors: 1
2025-10-31T13:55:41.614046Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2960: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-31T13:55:41.616345Z node 7 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1519: [72075186224037893][rt3.dc1--topic1] updating configuration. Deleted partitions []. Added partitions [0]
2025-10-31T13:55:41.618080Z node 7 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:971: [72075186224037893][rt3.dc1--topic1] Discovered subdomain [OwnerId: 72057594046644480, LocalPathId: 1] state, outOfSpace = 0 at RB 72075186224037893
2025-10-31T13:55:41.620360Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2992: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-31T13:55:41.620627Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:787: [PQ: 72075186224037892] no config, start with empty partitions and default config
2025-10-31T13:55:41.620658Z node 8 :PERSQUEUE NOTICE: pq_impl.cpp:913: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-31T13:55:41.620706Z node 8 :PERSQUEUE INFO: pq_impl.cpp:612: [PQ: 72075186224037892] doesn't have tx writes info
2025-10-31T13:55:41.621408Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [7:7567384230890022297:3349], now have 1 active actors on pipe
2025-10-31T13:55:41.623040Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-31T13:55:41.624730Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [7:7567384230890022331:2460], now have 1 active actors on pipe
2025-10-31T13:55:41.629021Z node 7 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:140: [72075186224037893][rt3.dc1--topic1] BALANCER INIT DONE for rt3.dc1--topic1: (0, 72075186224037892) 
2025-10-31T13:55:41.629222Z node 7 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:404: [72075186224037893][rt3.dc1--topic1] TEvClientConnected TabletId 72075186224037892, NodeId 8, Generation 1
2025-10-31T13:55:41.635965Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-31T13:55:41.655213Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [7:7567384230890022363:3400], now have 1 active actors on pipe
2025-10-31T13:55:41.659503Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-31T13:55:41.673089Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-31T13:55:41.674240Z node 8 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--topic1:0:Initializer] Start initializing step TInitConfigStep
2025-10-31T13:55:41.674314Z node 8 :PERSQUEUE DEBUG: partition.cpp:1295: [72075186224037892][Partition][0][StateInit] HandleOnInit TEvPQ::TEvProposePartitionConfig
2025-10-31T13:55:41.674648Z node 8 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--topic1:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-31T13:55:41.674893Z node 8 :PERSQUEUE INFO: partition_init.cpp:1101: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [8:7567384232061559786:2359]
2025-10-31T13:55:41.678758Z node 8 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--topic1:0:Initializer] Start initializing step TInitFieldsStep
2025-10-31T13:55:41.678801Z node 8 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--topic1:0:Initializer] Initializing completed.
2025-10-31T13:55:41.678828Z node 8 :PERSQUEUE INFO: partition.cpp:707: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--topic1' partition 0 generation 1 [8:7567384232061559786:2359]
2025-10-31T13:55:41.678858Z node 8 :PERSQUEUE DEBUG: partition.cpp:721: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--topic1 partitition 0 so 0 endOffset 0 Head Offset 0 PartNo 0 PackedSize 0 count 0 nextOffset 0 batches 0
2025-10-31T13:55:41.678899Z node 8 :PERSQUEUE DEBUG: partition_mlp.cpp:83: [72075186224037892][Partition][0][StateIdle] Initializing MLP Consumers: 0
2025-10-31T13:55:41.680495Z node 8 :PERSQUEUE DEBUG: partition.cpp:4256: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 1
2025-10-31T13:55:41.680545Z node 8 :PERSQUEUE DEBUG: partition.cpp:2272: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T13:55:41.680652Z node 8 :PERSQUEUE DEBUG: partition.cpp:2281: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T13:55:41.680676Z node 8 :PERSQUEUE DEBUG: partition.cpp:2285: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-31T13:55:41.680706Z node 8 :PERSQUEUE DEBUG: partition.cpp:2301: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-10-31T13:55:41.680729Z node 8 :PERSQUEUE DEBUG: partition.cpp:2272: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-31T13:55:41.680744Z node 8 :PERSQUEUE DEBUG: partition.cpp:2281: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T13:55:41.680760Z node 8 :PERSQUEUE DEBUG: partition.cpp:2301: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-10-31T13:55:41.680799Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:926: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-31T13:55:41.681155Z node 8 :PERSQUEUE DEBUG: partition_mlp.cpp:60: [72075186224037892][Partition][0][StateIdle] Process MLP pending events. Count 0
2025-10-31T13:55:41.681866Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-31T13:55:41.682035Z node 8 :PERSQUEUE DEBUG: partition_compaction.cpp:183: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-31T13:55:41.687694Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-31T13:55:41.687878Z node 8 :PERSQUEUE DEBUG: partition.cpp:1399: [72075186224037892][Partition][0][StateIdle] Handle TEvPQ::TEvTxCommit Step 1761918941692, TxId 281474976710672
2025-10-31T13:55:41.687912Z node 8 :PERSQUEUE DEBUG: partition.cpp:2272: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-31T13:55:41.687927Z node 8 :PERSQUEUE DEBUG: partition.cpp:2281: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T13:55:41.688085Z node 8 :PERSQUEUE DEBUG: partition.cpp:2304: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T13:55:41.688343Z node 8 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-31T13:55:41.691785Z node 8 :PERSQUEUE DEBUG: partition.cpp:2099: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-31T13:55:41.692126Z node 8 :PERSQUEUE DEBUG: partition_mlp.cpp:83: [72075186224037892][Partition][0][StateIdle] Initializing MLP Consumers: 0
2025-10-31T13:55:41.692278Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-31T13:55:41.692316Z node 8 :PERSQUEUE DEBUG: partition.cpp:2272: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T13:55:41.692336Z node 8 :PERSQUEUE DEBUG: partition.cpp:2281: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T13:55:41.692351Z node 8 :PERSQUEUE DEBUG: partition.cpp:2304: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T13:55:41.692388Z node 8 :PERSQUEUE DEBUG: partition_compaction.cpp:183: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-31T13:55:41.692842Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:398: [PQ: 72075186224037892] Apply new config PartitionConfig { LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 } PartitionIds: 0 TopicName: "rt3.dc1--topic1" Version: 0 LocalDC: true Codecs { Ids: 0 Ids: 1 Ids: 2 Codecs: "raw" Codecs: "gzip" Codecs: "lzop" } TopicPath: "/Root/PQ/rt3.dc1--topic1" YcCloudId: "" YcFolderId: "" YdbDatabaseId: "" YdbDatabasePath: "/Root" Partitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } AllPartitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } Consumers { Name: "user" ReadFromTimestampsMs: 0 FormatVersion: 0 Version: 0 Generation: 0 } MonitoringProjectId: ""
2025-10-31T13:55:41.692986Z node 8 :PERSQUEUE NOTICE: pq_impl.cpp:913: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-31T13:55:41.693318Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-31T13:55:41.700280Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-31T13:55:41.700394Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-31T13:55:41.703850Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-31T13:55:41.755071Z node 7 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976710673. Ctx: { TraceId: 01k8x8tyde6j1nc7n69br7pxjx, Database: , SessionId: ydb://session/3?node_id=7&id=ZWY0Mjc4ZDEtNmNjNjg5MzQtZjUwZGIxZGYtZTUzMDk3Y2Q=, PoolId: default, DatabaseId: /Root}. Database not set, use /Root
2025-10-31T13:55:41.781209Z node 8 :PERSQUEUE DEBUG: partition.cpp:2272: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T13:55:41.781242Z node 8 :PERSQUEUE DEBUG: partition.cpp:2281: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T13:55:41.781273Z node 8 :PERSQUEUE DEBUG: partition.cpp:2304: [72075186224037892][Partition][0][StateIdle] Try persist
===Query complete
TClient::Ls request: /Root/PQ/rt3.dc1--topic1
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--topic1"
    PathId: 13
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976710672
    CreateStep: 1761918941692
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--topic1"
    PathId: 13
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 600000...
(TRUNCATED)
GetTopicVersionFromPath:  record Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--topic1"
    PathId: 13
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976710672
    CreateStep: 1761918941692
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--topic1"
    PathId: 13
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      YdbDatabasePath: "/Root"
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
    Partitions {
      PartitionId: 0
      TabletId: 72075186224037892
      Status: Active
    }
    AlterVersion: 1
    BalancerTabletID: 72075186224037893
    NextPartitionId: 1
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 1
      PlanResolution: 7
      Coordinators: 72057594046316545
      TimeCastBucketsPerMediator: 2
      Mediators: 72057594046382081
    }
    DomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    PathsInside: 12
    PathsLimit: 10000
    ShardsInside: 6
    ShardsLimit: 200000
    ResourcesDomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    DiskSpaceUsage {
      Tables {
        TotalSize: 0
        DataSize: 0
        IndexSize: 0
      }
      Topics {
        ReserveSize: 0
        AccountSize: 0
        DataSize: 0
        UsedReserveSize: 0
      }
    }
    PQPartitionsInside: 1
    PQPartitionsLimit: 1000000
    SchemeLimits {
      MaxDepth: 32
      MaxPaths: 10000
      MaxChildrenInDir: 100000
      MaxAclBytesSize: 10240
      MaxTableColumns: 200
      MaxTableColumnNameLength: 255
      MaxTableKeyColumns: 30
      MaxTableIndices: 20
      MaxShards: 200000
      MaxShardsInPath: 35000
      MaxConsistentCopyTargets: 10000
      MaxPathElementLength: 255
      ExtraPathSymbolsAllowed: "!\"#$%&\'()*+,-.:;<=>?@[\\]^_`{|}~"
      MaxPQPartitions: 1000000
      MaxTableCdcStreams: 5
      MaxExports: 10
      MaxImports: 10
      MaxColumnTableColumns: 10000
    }
  }
}
Path: "/Root/PQ/rt3.dc1--topic1"
 name rt3.dc1--topic1 version1
CallPersQueueGRPC request to localhost:27948
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--topic1"
  }
}
2025-10-31T13:55:41.814860Z node 7 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
MetaResponse {
  CmdGetTopicMetadataResult {
    TopicInfo {
      Topic: "rt3.dc1--topic1"
      NumPartitions: 1
      Config {
        PartitionConfig {
          LifetimeSeconds: 86400
          LowWatermark: 8388608
          SourceIdLifetimeSeconds: 86400
          WriteSpeedInBytesPerSecond: 20000000
          BurstSize: 20000000
          SourceIdMaxCounts: 6000000
        }
        Version: 1
        LocalDC: true
        Codecs {
          Ids: 0
          Ids: 1
          Ids: 2
          Codecs: "raw"
          Codecs: "gzip"
          Codecs: "lzop"
        }
        TopicPath: "/Root/PQ/rt3.dc1--topic1"
        YdbDatabasePath: "/Root"
        Consumers {
          Name: "user"
          ReadFromTimestampsMs: 0
          FormatVersion: 0
          Version: 0
        }
      }
      ErrorCode: OK
    }
  }
}
=== Topic created, have version: 1
2025-10-31T13:55:41.837418Z :INFO: [] [] [62469704-a5dc4062-4187ee1e-3d4dce2f] Starting read session
2025-10-31T13:55:41.837524Z :DEBUG: [] [] [62469704-a5dc4062-4187ee1e-3d4dce2f] Starting session to cluster null (localhost:27948)
2025-10-31T13:55:41.843002Z :DEBUG: [] [] [62469704-a5dc4062-4187ee1e-3d4dce2f] [null] In Reconnect, ReadSizeBudget = 2621440, ReadSizeServerDelta = 0
2025-10-31T13:55:41.843053Z :DEBUG: [] [] [62469704-a5dc4062-4187ee1e-3d4dce2f] [null] New values: ReadSizeBudget = 2621440, ReadSizeServerDelta = 0
2025-10-31T13:55:41.843096Z :DEBUG: [] [] [62469704-a5dc4062-4187ee1e-3d4dce2f] [null] Reconnecting session to cluster null in 0.000000s
2025-10-31T13:55:41.851843Z :DEBUG: [] [] [62469704-a5dc4062-4187ee1e-3d4dce2f] [null] Successfully connected. Initializing session
2025-10-31T13:55:41.853528Z node 7 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:109: new grpc connection
2025-10-31T13:55:41.853560Z node 7 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:131: new session created cookie 1
2025-10-31T13:55:41.854659Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { topic: "topic1" } read_only_original: true consumer: "shared/user" read_params { max_read_size: 5242880 } } }
2025-10-31T13:55:41.854907Z node 7 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 1 consumer shared/user session shared/user_7_1_11346096038620304364_v1 read init: from# ipv6:[::1]:55092, request# { init_request { topics_read_settings { topic: "topic1" } read_only_original: true consumer: "shared/user" read_params { max_read_size: 5242880 } } }
2025-10-31T13:55:41.855484Z node 7 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 1 consumer shared/user session shared/user_7_1_11346096038620304364_v1 auth for : user
2025-10-31T13:55:41.856126Z node 7 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 1 consumer shared/user session shared/user_7_1_11346096038620304364_v1 Handle describe topics response
2025-10-31T13:55:41.856268Z node 7 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 1 consumer shared/user session shared/user_7_1_11346096038620304364_v1 auth is DEAD
2025-10-31T13:55:41.856350Z node 7 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 1 consumer shared/user session shared/user_7_1_11346096038620304364_v1 auth ok: topics# 1, initDone# 0
2025-10-31T13:55:41.858582Z :INFO: [] [] [62469704-a5dc4062-4187ee1e-3d4dce2f] [null] Server session id: shared/user_7_1_11346096038620304364_v1
2025-10-31T13:55:41.858839Z :DEBUG: [] [] [62469704-a5dc4062-4187ee1e-3d4dce2f] [null] After sending read request: ReadSizeBudget = 2621440, ReadSizeServerDelta = 0
2025-10-31T13:55:41.857714Z node 7 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 1 consumer shared/user session shared/user_7_1_11346096038620304364_v1 register session: topic# rt3.dc1--topic1
2025-10-31T13:55:41.860467Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1655: [72075186224037893][rt3.dc1--topic1] pipe [7:7567384230890022439:2476] connected; active server actors: 1
2025-10-31T13:55:41.860894Z node 7 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1706: [72075186224037893][rt3.dc1--topic1] consumer "user" register session for pipe [7:7567384230890022439:2476] session shared/user_7_1_11346096038620304364_v1
2025-10-31T13:55:41.860957Z node 7 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:639: [72075186224037893][rt3.dc1--topic1] consumer user register readable partition 0
2025-10-31T13:55:41.861029Z node 7 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:669: [72075186224037893][rt3.dc1--topic1] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-10-31T13:55:41.861086Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:871: [72075186224037893][rt3.dc1--topic1] consumer user register reading session ReadingSession "shared/user_7_1_11346096038620304364_v1" (Sender=[7:7567384230890022434:2476], Pipe=[7:7567384230890022439:2476], Partitions=[], ActiveFamilyCount=0)
2025-10-31T13:55:41.861128Z node 7 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1186: [72075186224037893][rt3.dc1--topic1] consumer user rebalancing was scheduled
2025-10-31T13:55:41.861193Z node 7 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1258: [72075186224037893][rt3.dc1--topic1] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-10-31T13:55:41.864145Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [7:7567384230890022444:2480], now have 1 active actors on pipe
2025-10-31T13:55:41.861279Z node 7 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1305: [72075186224037893][rt3.dc1--topic1] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_7_1_11346096038620304364_v1" (Sender=[7:7567384230890022434:2476], Pipe=[7:7567384230890022439:2476], Partitions=[], ActiveFamilyCount=0)
2025-10-31T13:55:41.861372Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:549: [72075186224037893][rt3.dc1--topic1] consumer user family 1 status Active partitions [0] session "shared/user_7_1_11346096038620304364_v1" sender [7:7567384230890022434:2476] lock partition 0 for ReadingSession "shared/user_7_1_11346096038620304364_v1" (Sender=[7:7567384230890022434:2476], Pipe=[7:7567384230890022439:2476], Partitions=[], ActiveFamilyCount=1) generation 1 step 1
2025-10-31T13:55:41.861430Z node 7 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1325: [72075186224037893][rt3.dc1--topic1] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-10-31T13:55:41.861469Z node 7 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1402: [72075186224037893][rt3.dc1--topic1] consumer user balancing duration: 0.000243s
2025-10-31T13:55:41.862577Z node 7 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 1 consumer shared/user session shared/user_7_1_11346096038620304364_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--topic1" Generation: 1 Step: 1 Session: "shared/user_7_1_11346096038620304364_v1" ClientId: "user" PipeClient { RawX1: 7567384230890022439 RawX2: 4503629692144044 } Path: "/Root/PQ/rt3.dc1--topic1" }
2025-10-31T13:55:41.862674Z node 7 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 1 consumer shared/user session shared/user_7_1_11346096038620304364_v1 INITING TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1)
2025-10-31T13:55:41.863323Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_7_1_11346096038620304364_v1 grpc read done: success# 1, data# { read { } }
2025-10-31T13:55:41.863400Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_7_1_11346096038620304364_v1 got read request: guid# cf716761-b6399d5c-59170d8c-1f560326
2025-10-31T13:55:41.864532Z node 7 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_7_1_11346096038620304364_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 1, pipe: [7:7567384230890022444:2480]
2025-10-31T13:55:41.864815Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T13:55:41.864920Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T13:55:41.864963Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:1748: [PQ: 72075186224037892] Created session shared/user_7_1_11346096038620304364_v1 on pipe: [7:7567384230890022444:2480]
2025-10-31T13:55:41.865047Z node 8 :PERSQUEUE DEBUG: partition.cpp:2272: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T13:55:41.865080Z node 8 :PERSQUEUE DEBUG: partition.cpp:2281: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T13:55:41.865096Z node 8 :PERSQUEUE DEBUG: partition.cpp:2285: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-31T13:55:41.865126Z node 8 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_7_1_11346096038620304364_v1:1 with generation 1
2025-10-31T13:55:41.865170Z node 8 :PERSQUEUE DEBUG: partition.cpp:3649: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 user user session is set to 0 (startOffset 0) session shared/user_7_1_11346096038620304364_v1
2025-10-31T13:55:41.865190Z node 8 :PERSQUEUE DEBUG: partition.cpp:2304: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T13:55:41.865370Z node 8 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-31T13:55:41.874018Z node 8 :PERSQUEUE DEBUG: partition.cpp:2099: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-31T13:55:41.874119Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-31T13:55:41.874156Z node 8 :PERSQUEUE DEBUG: partition.cpp:2272: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T13:55:41.874176Z node 8 :PERSQUEUE DEBUG: partition.cpp:2281: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T13:55:41.874195Z node 8 :PERSQUEUE DEBUG: partition.cpp:2304: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T13:55:41.874230Z node 8 :PERSQUEUE DEBUG: partition_compaction.cpp:183: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-31T13:55:41.874273Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-10-31T13:55:41.875012Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_7_1_11346096038620304364_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 0 SizeLag: 0 WriteTimestampEstimateMS: 1761918941781 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-10-31T13:55:41.875082Z node 7 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 1 consumer shared/user session shared/user_7_1_11346096038620304364_v1 INIT DONE TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 0 readOffset 0 committedOffset 0
2025-10-31T13:55:41.875152Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 1 consumer shared/user session shared/user_7_1_11346096038620304364_v1 sending to client partition status
>>>> message: CreatePartitionStream { PartitionStreamId: 1 TopicPath: topic1 Cluster: dc1 PartitionId: 0 CommittedOffset: 0 EndOffset: 0 }
2025-10-31T13:55:41.880349Z :INFO: [] [] [62469704-a5dc4062-4187ee1e-3d4dce2f] [null] Confirm partition stream create. Partition stream id: 1. Cluster: "dc1". Topic: "topic1". Partition: 0. Read offset: (NULL)
2025-10-31T13:55:41.881186Z :DEBUG: [] MessageGroupId [source0] SessionId [] Write session: try to update token
2025-10-31T13:55:41.881304Z node 8 :PERSQUEUE DEBUG: partition.cpp:2272: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T13:55:41.881339Z node 8 :PERSQUEUE DEBUG: partition.cpp:2281: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T13:55:41.881360Z node 8 :PERSQUEUE DEBUG: partition.cpp:2304: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T13:55:41.882030Z :INFO: [] MessageGroupId [source0] SessionId [] Write session: Do CDS request
2025-10-31T13:55:41.882099Z :INFO: [] MessageGroupId [source0] SessionId [] Start write session. Will connect to endpoint: localhost:27948
2025-10-31T13:55:41.881845Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_7_1_11346096038620304364_v1 grpc read done: success# 1, data# { start_read { topic { path: "topic1" } cluster: "dc1" assign_id: 1 } }
2025-10-31T13:55:41.882086Z node 7 :PQ_READ_PROXY INFO: read_session_actor.cpp:539: session cookie 1 consumer shared/user session shared/user_7_1_11346096038620304364_v1 got StartRead from client: partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 0, commitOffset# 0
2025-10-31T13:55:41.882164Z node 7 :PQ_READ_PROXY INFO: partition_actor.cpp:1023: session cookie 1 consumer shared/user session shared/user_7_1_11346096038620304364_v1 Start reading TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 0 readOffset 0 committedOffset 0 clientCommitOffset 0 clientReadOffset 0
2025-10-31T13:55:41.882222Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_7_1_11346096038620304364_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 1 from offset 0
2025-10-31T13:55:41.889614Z :DEBUG: [] MessageGroupId [source0] SessionId [] Write session: send init request: init_request { topic: "topic1" message_group_id: "source0" }
2025-10-31T13:55:41.889948Z node 7 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-31T13:55:41.890005Z node 7 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1
2025-10-31T13:55:41.891042Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId:  grpc read done: success: 1 data: init_request { topic: "topic1" message_group_id: "source0" }
2025-10-31T13:55:41.891185Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1 topic: "topic1" message_group_id: "source0" from ipv6:[::1]:55092
2025-10-31T13:55:41.891207Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:55092 proto=v1  topic=topic1 durationSec=0
2025-10-31T13:55:41.891219Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-31T13:55:41.893306Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1 sessionId:  describe result for acl check
2025-10-31T13:55:41.893492Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-31T13:55:41.893510Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-31T13:55:41.893524Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-31T13:55:41.893550Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [7:7567384230890022448:2481] (SourceId=source0, PreferedPartition=(NULL)) StartKqpSession
2025-10-31T13:55:41.897715Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [7:7567384230890022448:2481] (SourceId=source0, PreferedPartition=(NULL)) Select from the table
2025-10-31T13:55:41.983218Z node 8 :PERSQUEUE DEBUG: partition.cpp:2272: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T13:55:41.983255Z node 8 :PERSQUEUE DEBUG: partition.cpp:2281: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T13:55:41.983271Z node 8 :PERSQUEUE DEBUG: partition.cpp:2304: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T13:55:42.084758Z node 8 :PERSQUEUE DEBUG: partition.cpp:2272: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T13:55:42.084796Z node 8 :PERSQUEUE DEBUG: partition.cpp:2281: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T13:55:42.084815Z node 8 :PERSQUEUE DEBUG: partition.cpp:2304: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T13:55:42.179195Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [7:7567384230890022448:2481] (SourceId=source0, PreferedPartition=(NULL)) RequestPQRB
2025-10-31T13:55:42.180207Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1655: [72075186224037893][rt3.dc1--topic1] pipe [7:7567384235184989783:2481] connected; active server actors: 1
2025-10-31T13:55:42.180348Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [7:7567384230890022448:2481] (SourceId=source0, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=source0
2025-10-31T13:55:42.180395Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [7:7567384230890022448:2481] (SourceId=source0, PreferedPartition=(NULL)) Update the table
2025-10-31T13:55:42.184960Z node 7 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1659: [72075186224037893][rt3.dc1--topic1] pipe [7:7567384235184989783:2481] disconnected.
2025-10-31T13:55:42.185009Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1670: [72075186224037893][rt3.dc1--topic1] pipe [7:7567384235184989783:2481] disconnected; active server actors: 1
2025-10-31T13:55:42.185028Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1695: [72075186224037893][rt3.dc1--topic1] pipe [7:7567384235184989783:2481] disconnected no session
2025-10-31T13:55:42.187309Z node 8 :PERSQUEUE DEBUG: partition.cpp:2272: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T13:55:42.187352Z node 8 :PERSQUEUE DEBUG: partition.cpp:2281: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T13:55:42.187371Z node 8 :PERSQUEUE DEBUG: partition.cpp:2304: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T13:55:42.287328Z node 8 :PERSQUEUE DEBUG: partition.cpp:2272: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T13:55:42.287361Z node 8 :PERSQUEUE DEBUG: partition.cpp:2281: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T13:55:42.287373Z node 8 :PERSQUEUE DEBUG: partition.cpp:2304: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T13:55:42.341994Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [7:7567384230890022448:2481] (SourceId=source0, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-31T13:55:42.342041Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [7:7567384230890022448:2481] (SourceId=source0, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-10-31T13:55:42.342064Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [7:7567384230890022448:2481] (SourceId=source0, PreferedPartition=(NULL)) Start idle
2025-10-31T13:55:42.342102Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-31T13:55:42.344142Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 8, Generation: 1
2025-10-31T13:55:42.344037Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [7:7567384235184989809:2481], now have 1 active actors on pipe
2025-10-31T13:55:42.344316Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T13:55:42.344345Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T13:55:42.344445Z node 8 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie source0|e3c3d897-4bf739b7-ee3ec483-95661b8a_0 generated for partition 0 topic 'rt3.dc1--topic1' owner source0
2025-10-31T13:55:42.344482Z node 8 :PERSQUEUE DEBUG: partition.cpp:2272: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T13:55:42.344501Z node 8 :PERSQUEUE DEBUG: partition.cpp:2281: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T13:55:42.344517Z node 8 :PERSQUEUE DEBUG: partition.cpp:2285: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-31T13:55:42.344566Z node 8 :PERSQUEUE DEBUG: partition.cpp:2304: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T13:55:42.344599Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-31T13:55:42.344647Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-31T13:55:42.345190Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T13:55:42.345211Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T13:55:42.345311Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-31T13:55:42.345613Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1 partition: 0 MaxSeqNo: 0 sessionId: source0|e3c3d897-4bf739b7-ee3ec483-95661b8a_0
2025-10-31T13:55:42.348180Z :INFO: [] MessageGroupId [source0] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1761918942348 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-31T13:55:42.348331Z :INFO: [] MessageGroupId [source0] SessionId [] Write session established. Init response: session_id: "source0|e3c3d897-4bf739b7-ee3ec483-95661b8a_0" topic: "topic1" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-31T13:55:42.349517Z :DEBUG: [] MessageGroupId [source0] SessionId [source0|e3c3d897-4bf739b7-ee3ec483-95661b8a_0] Write 1 messages with Id from 1 to 1
2025-10-31T13:55:42.349632Z :INFO: [] MessageGroupId [source0] SessionId [source0|e3c3d897-4bf739b7-ee3ec483-95661b8a_0] Write session: close. Timeout = 10000 ms
2025-10-31T13:55:42.385391Z :DEBUG: [] MessageGroupId [source0] SessionId [source0|e3c3d897-4bf739b7-ee3ec483-95661b8a_0] Write session: try to update token
2025-10-31T13:55:42.385472Z :DEBUG: [] MessageGroupId [source0] SessionId [source0|e3c3d897-4bf739b7-ee3ec483-95661b8a_0] Send 1 message(s) (0 left), first sequence number is 1
2025-10-31T13:55:42.386287Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId: source0|e3c3d897-4bf739b7-ee3ec483-95661b8a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-31T13:55:42.386576Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-31T13:55:42.387187Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T13:55:42.387234Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T13:55:42.387315Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-31T13:55:42.387693Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-31T13:55:42.387950Z node 8 :PERSQUEUE DEBUG: partition.cpp:2272: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T13:55:42.387971Z node 8 :PERSQUEUE DEBUG: partition.cpp:2281: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T13:55:42.387984Z node 8 :PERSQUEUE DEBUG: partition.cpp:2304: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T13:55:42.388369Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T13:55:42.388394Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T13:55:42.388760Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: '\0source0' SeqNo: 1 partNo : 0 messageNo: 1 size 1122 offset: -1
2025-10-31T13:55:42.388804Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-31T13:55:42.388890Z node 8 :PERSQUEUE DEBUG: partition.cpp:2272: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T13:55:42.388918Z node 8 :PERSQUEUE DEBUG: partition.cpp:2281: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T13:55:42.388932Z node 8 :PERSQUEUE DEBUG: partition.cpp:2285: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-31T13:55:42.389040Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId '\0source0' seqNo 1 partNo 0
2025-10-31T13:55:42.389957Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '\0source0' seqNo 1 partNo 0 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 1197 count 1 nextOffset 1 batches 1
2025-10-31T13:55:42.390011Z node 8 :PERSQUEUE DEBUG: partition.cpp:2304: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T13:55:42.390528Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 0,1 HeadOffset 0 endOffset 0 curOffset 1 d0000000000_00000000000000000000_00000_0000000001_00000? size 1185 WTime 1761918942390
2025-10-31T13:55:42.390671Z node 8 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-31T13:55:42.390785Z node 8 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 0 partNo 0 count 1 size 1185
2025-10-31T13:55:42.400879Z node 8 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 0 count 1 size 1185 actorID [8:7567384232061559767:2359]
2025-10-31T13:55:42.400948Z node 8 :PERSQUEUE DEBUG: partition.cpp:2099: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-31T13:55:42.401006Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1130 WriteNewSizeFromSupportivePartitions# 0
2025-10-31T13:55:42.401041Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-31T13:55:42.401078Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0source0', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 1, partNo: 0, Offset: 0 is stored on disk
2025-10-31T13:55:42.401326Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:926: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-31T13:55:42.401348Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:968: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-31T13:55:42.401371Z node 8 :PERSQUEUE DEBUG: partition.cpp:2272: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T13:55:42.401387Z node 8 :PERSQUEUE DEBUG: partition.cpp:2281: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T13:55:42.401400Z node 8 :PERSQUEUE DEBUG: partition.cpp:2304: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T13:55:42.401433Z node 8 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-31T13:55:42.401475Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 1  requestId: <none> cookie: 1
2025-10-31T13:55:42.401577Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:883: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--topic1' partition 0 user user offset 0 count 1 size 1024000 endOffset 1 max time lag 0ms effective offset 0
2025-10-31T13:55:42.401792Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:1097: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 1185 count 1 last offset 0, current partition end offset: 1
2025-10-31T13:55:42.401812Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:1123: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-31T13:55:42.401855Z node 8 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 0 partno 0 count 1 parts_count 0 source 1 size 1185 accessed 0 times before, last time 2025-10-31T13:55:42.000000Z
2025-10-31T13:55:42.401880Z node 8 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 3. All 1 blobs are from cache.
2025-10-31T13:55:42.401920Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:581: FormAnswer for 1 blobs
2025-10-31T13:55:42.402047Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 0 totakecount 1 count 1 size 1165 from pos 0 cbcount 1
2025-10-31T13:55:42.402111Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:1018: Topic 'rt3.dc1--topic1' partition 0 user user readTimeStamp done, result 1761918942388 queuesize 0 startOffset 0
2025-10-31T13:55:42.403169Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 1 consumer shared/user session shared/user_7_1_11346096038620304364_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 0 EndOffset 0 newEndOffset 1 commitOffset 0 clientCommitOffset 0 cookie 1 readingFinished 0 firstRead 1
2025-10-31T13:55:42.403214Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_7_1_11346096038620304364_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 0 endOffset 1
2025-10-31T13:55:42.403272Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-31T13:55:42.403734Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_7_1_11346096038620304364_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 0, endOffset# 1, WTime# 0, sizeLag# 1185
2025-10-31T13:55:42.403751Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_7_1_11346096038620304364_v1TEvPartitionReady. Aval parts: 1
2025-10-31T13:55:42.403797Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_7_1_11346096038620304364_v1 performing read request: guid# cf716761-b6399d5c-59170d8c-1f560326, from# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), count# 1, size# 1422, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-31T13:55:42.403871Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_7_1_11346096038620304364_v1 READ FROM TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1)maxCount 1 maxSize 1422 maxTimeLagMs 0 readTimestampMs 0 readOffset 0 EndOffset 1 ClientCommitOffset 0 committedOffset 0 Guid cf716761-b6399d5c-59170d8c-1f560326
2025-10-31T13:55:42.402845Z node 8 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 0 suffix '63' size 1185
2025-10-31T13:55:42.402908Z node 8 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 0 suffix '63'
2025-10-31T13:55:42.405144Z :DEBUG: [] MessageGroupId [source0] SessionId [source0|e3c3d897-4bf739b7-ee3ec483-95661b8a_0] Write session got write response: sequence_numbers: 1 offsets: 0 already_written: false write_statistics { persist_duration_ms: 11 queued_in_partition_duration_ms: 1 }
2025-10-31T13:55:42.405205Z :DEBUG: [] MessageGroupId [source0] SessionId [source0|e3c3d897-4bf739b7-ee3ec483-95661b8a_0] Write session: acknoledged message 1
2025-10-31T13:55:42.405124Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T13:55:42.405158Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T13:55:42.405253Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:883: [72075186224037892][Partition][0][StateIdle] read cookie 4 Topic 'rt3.dc1--topic1' partition 0 user user offset 0 count 1 size 1422 endOffset 1 max time lag 0ms effective offset 0
2025-10-31T13:55:42.405472Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:1097: [72075186224037892][Partition][0][StateIdle] read cookie 4 added 1 blobs, size 1185 count 1 last offset 0, current partition end offset: 1
2025-10-31T13:55:42.405490Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:1123: [72075186224037892][Partition][0][StateIdle] Reading cookie 4. Send blob request.
2025-10-31T13:55:42.405530Z node 8 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 0 partno 0 count 1 parts_count 0 source 1 size 1185 accessed 1 times before, last time 2025-10-31T13:55:42.000000Z
2025-10-31T13:55:42.405564Z node 8 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 4. All 1 blobs are from cache.
2025-10-31T13:55:42.405601Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:581: FormAnswer for 1 blobs
2025-10-31T13:55:42.405716Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 0 totakecount 1 count 1 size 1165 from pos 0 cbcount 1
2025-10-31T13:55:42.405805Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-31T13:55:42.406097Z node 8 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 0 suffix '63'
2025-10-31T13:55:42.409175Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_7_1_11346096038620304364_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 1 Result { Offset: 0 Data: "... 1122 bytes ..." SourceId: "\000source0" SeqNo: 1 WriteTimestampMS: 1761918942388 CreateTimestampMS: 1761918942348 UncompressedSize: 1047552 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 20 RealReadOffset: 0 WaitQuotaTimeMs: 0 EndOffset: 1 StartOffset: 0 } Cookie: 0 }
2025-10-31T13:55:42.409350Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_7_1_11346096038620304364_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 2 from offset 1
2025-10-31T13:55:42.409399Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_7_1_11346096038620304364_v1 after read state TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 1 ReadOffset 1 ReadGuid cf716761-b6399d5c-59170d8c-1f560326 has messages 1
2025-10-31T13:55:42.409528Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_7_1_11346096038620304364_v1 read done: guid# cf716761-b6399d5c-59170d8c-1f560326, partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), size# 1222
2025-10-31T13:55:42.409560Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_7_1_11346096038620304364_v1 response to read: guid# cf716761-b6399d5c-59170d8c-1f560326
2025-10-31T13:55:42.409796Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_7_1_11346096038620304364_v1 Process answer. Aval parts: 0
2025-10-31T13:55:42.410544Z :DEBUG: [] [] [62469704-a5dc4062-4187ee1e-3d4dce2f] [null] After sending read request: ReadSizeBudget = 2621440, ReadSizeServerDelta = 0
2025-10-31T13:55:42.410754Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_7_1_11346096038620304364_v1 grpc read done: success# 1, data# { read { } }
2025-10-31T13:55:42.410858Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_7_1_11346096038620304364_v1 got read request: guid# d449d9a8-87ec2eb3-27bcc94-1545b5b0
2025-10-31T13:55:42.449932Z :INFO: [] MessageGroupId [source0] SessionId [source0|e3c3d897-4bf739b7-ee3ec483-95661b8a_0] Write session will now close
2025-10-31T13:55:42.450032Z :DEBUG: [] MessageGroupId [source0] SessionId [source0|e3c3d897-4bf739b7-ee3ec483-95661b8a_0] Write session: aborting
2025-10-31T13:55:42.450627Z :INFO: [] MessageGroupId [source0] SessionId [source0|e3c3d897-4bf739b7-ee3ec483-95661b8a_0] Write session: gracefully shut down, all writes complete
2025-10-31T13:55:42.450916Z :DEBUG: [] MessageGroupId [source0] SessionId [source0|e3c3d897-4bf739b7-ee3ec483-95661b8a_0] Write session: destroy
2025-10-31T13:55:42.452040Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId: source0|e3c3d897-4bf739b7-ee3ec483-95661b8a_0 grpc read done: success: 0 data: 
2025-10-31T13:55:42.452063Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 1 sessionId: source0|e3c3d897-4bf739b7-ee3ec483-95661b8a_0 grpc read failed
2025-10-31T13:55:42.452102Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 1 sessionId: source0|e3c3d897-4bf739b7-ee3ec483-95661b8a_0 grpc closed
2025-10-31T13:55:42.452122Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1 sessionId: source0|e3c3d897-4bf739b7-ee3ec483-95661b8a_0 is DEAD
2025-10-31T13:55:42.453633Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [7:7567384235184989809:2481] destroyed
2025-10-31T13:55:42.453833Z :DEBUG: [] MessageGroupId [source1] SessionId [] Write session: try to update token
2025-10-31T13:55:42.453692Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-10-31T13:55:42.453723Z node 8 :PERSQUEUE DEBUG: partition.cpp:2272: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T13:55:42.453736Z node 8 :PERSQUEUE DEBUG: partition.cpp:2281: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T13:55:42.464559Z :INFO: [] MessageGroupId [source1] SessionId [] Write session: Do CDS request
2025-10-31T13:55:42.464604Z :INFO: [] MessageGroupId [source1] SessionId [] Start write session. Will connect to endpoint: localhost:27948
2025-10-31T13:55:42.453003Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-10-31T13:55:42.453751Z node 8 :PERSQUEUE DEBUG: partition.cpp:2304: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T13:55:42.488977Z :DEBUG: [] MessageGroupId [source1] SessionId [] Write session: send init request: init_request { topic: "topic1" message_group_id: "source1" }
2025-10-31T13:55:42.488839Z node 8 :PERSQUEUE DEBUG: partition.cpp:2272: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T13:55:42.488882Z node 8 :PERSQUEUE DEBUG: partition.cpp:2281: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T13:55:42.488897Z node 8 :PERSQUEUE DEBUG: partition.cpp:2304: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T13:55:42.489305Z node 7 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-31T13:55:42.489331Z node 7 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2
2025-10-31T13:55:42.497094Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId:  grpc read done: success: 1 data: init_request { topic: "topic1" message_group_id: "source1" }
2025-10-31T13:55:42.497234Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2 topic: "topic1" message_group_id: "source1" from ipv6:[::1]:55092
2025-10-31T13:55:42.497252Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:55092 proto=v1  topic=topic1 durationSec=0
2025-10-31T13:55:42.497265Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-31T13:55:42.499071Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2 sessionId:  describe result for acl check
2025-10-31T13:55:42.499201Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-31T13:55:42.499213Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-31T13:55:42.499225Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-31T13:55:42.499245Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [7:7567384235184989819:2491] (SourceId=source1, PreferedPartition=(NULL)) StartKqpSession
2025-10-31T13:55:42.502300Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [7:7567384235184989819:2491] (SourceId=source1, PreferedPartition=(NULL)) Select from the table
2025-10-31T13:55:42.530119Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [7:7567384235184989819:2491] (SourceId=source1, PreferedPartition=(NULL)) RequestPQRB
2025-10-31T13:55:42.540978Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1655: [72075186224037893][rt3.dc1--topic1] pipe [7:7567384235184989843:2491] connected; active server actors: 1
2025-10-31T13:55:42.544940Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [7:7567384235184989819:2491] (SourceId=source1, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=source1
2025-10-31T13:55:42.544970Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [7:7567384235184989819:2491] (SourceId=source1, PreferedPartition=(NULL)) Update the table
2025-10-31T13:55:42.546072Z node 7 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1659: [72075186224037893][rt3.dc1--topic1] pipe [7:7567384235184989843:2491] disconnected.
2025-10-31T13:55:42.546097Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1670: [72075186224037893][rt3.dc1--topic1] pipe [7:7567384235184989843:2491] disconnected; active server actors: 1
2025-10-31T13:55:42.546119Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1695: [72075186224037893][rt3.dc1--topic1] pipe [7:7567384235184989843:2491] disconnected no session
2025-10-31T13:55:42.566949Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [7:7567384235184989819:2491] (SourceId=source1, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-31T13:55:42.566986Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [7:7567384235184989819:2491] (SourceId=source1, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-10-31T13:55:42.567005Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [7:7567384235184989819:2491] (SourceId=source1, PreferedPartition=(NULL)) Start idle
2025-10-31T13:55:42.567036Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-31T13:55:42.568944Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [7:7567384235184989863:2491], now have 1 active actors on pipe
2025-10-31T13:55:42.569224Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 8, Generation: 1
2025-10-31T13:55:42.572540Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2 partition: 0 MaxSeqNo: 0 sessionId: source1|2f709a32-b921bc86-6da919b8-a062e9d6_0
2025-10-31T13:55:42.569484Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T13:55:42.569525Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T13:55:42.569599Z node 8 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie source1|2f709a32-b921bc86-6da919b8-a062e9d6_0 generated for partition 0 topic 'rt3.dc1--topic1' owner source1
2025-10-31T13:55:42.569631Z node 8 :PERSQUEUE DEBUG: partition.cpp:2272: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T13:55:42.569648Z node 8 :PERSQUEUE DEBUG: partition.cpp:2281: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T13:55:42.569662Z node 8 :PERSQUEUE DEBUG: partition.cpp:2285: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-31T13:55:42.569701Z node 8 :PERSQUEUE DEBUG: partition.cpp:2304: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T13:55:42.569740Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-31T13:55:42.569793Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-31T13:55:42.570243Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T13:55:42.570263Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T13:55:42.570322Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-31T13:55:42.577020Z :INFO: [] MessageGroupId [source1] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1761918942576 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-31T13:55:42.577138Z :INFO: [] MessageGroupId [source1] SessionId [] Write session established. Init response: session_id: "source1|2f709a32-b921bc86-6da919b8-a062e9d6_0" topic: "topic1" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-31T13:55:42.581972Z :DEBUG: [] MessageGroupId [source1] SessionId [source1|2f709a32-b921bc86-6da919b8-a062e9d6_0] Write 1 messages with Id from 1 to 1
2025-10-31T13:55:42.582079Z :INFO: [] MessageGroupId [source1] SessionId [source1|2f709a32-b921bc86-6da919b8-a062e9d6_0] Write session: close. Timeout = 10000 ms
2025-10-31T13:55:42.592950Z node 8 :PERSQUEUE DEBUG: partition.cpp:2272: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T13:55:42.592983Z node 8 :PERSQUEUE DEBUG: partition.cpp:2281: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T13:55:42.592996Z node 8 :PERSQUEUE DEBUG: partition.cpp:2304: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T13:55:42.614842Z :DEBUG: [] MessageGroupId [source1] SessionId [source1|2f709a32-b921bc86-6da919b8-a062e9d6_0] Write session: try to update token
2025-10-31T13:55:42.614900Z :DEBUG: [] MessageGroupId [source1] SessionId [source1|2f709a32-b921bc86-6da919b8-a062e9d6_0] Send 1 message(s) (0 left), first sequence number is 1
2025-10-31T13:55:42.617062Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: source1|2f709a32-b921bc86-6da919b8-a062e9d6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-31T13:55:42.617311Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-31T13:55:42.621543Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T13:55:42.621590Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T13:55:42.621666Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-31T13:55:42.627477Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-31T13:55:42.632634Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T13:55:42.632676Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T13:55:42.632733Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: '\0source1' SeqNo: 1 partNo : 0 messageNo: 1 size 1122 offset: -1
2025-10-31T13:55:42.632779Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-31T13:55:42.632828Z node 8 :PERSQUEUE DEBUG: partition.cpp:2272: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T13:55:42.632874Z node 8 :PERSQUEUE DEBUG: partition.cpp:2281: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T13:55:42.632889Z node 8 :PERSQUEUE DEBUG: partition.cpp:2285: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-31T13:55:42.633002Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId '\0source1' seqNo 1 partNo 0
2025-10-31T13:55:42.634078Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '\0source1' seqNo 1 partNo 0 FormedBlobsCount 0 NewHead: Offset 1 PartNo 0 PackedSize 1197 count 1 nextOffset 2 batches 1
2025-10-31T13:55:42.634115Z node 8 :PERSQUEUE DEBUG: partition.cpp:2304: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T13:55:42.634615Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 1,1 HeadOffset 1 endOffset 1 curOffset 2 d0000000000_00000000000000000001_00000_0000000001_00000? size 1185 WTime 1761918942634
2025-10-31T13:55:42.634767Z node 8 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-31T13:55:42.634884Z node 8 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 1 partNo 0 count 1 size 1185
2025-10-31T13:55:42.653656Z node 8 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 1 count 1 size 1185 actorID [8:7567384232061559767:2359]
2025-10-31T13:55:42.653723Z node 8 :PERSQUEUE DEBUG: partition.cpp:2099: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-31T13:55:42.653780Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1130 WriteNewSizeFromSupportivePartitions# 0
2025-10-31T13:55:42.653815Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-31T13:55:42.653852Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 1, partNo: 0, Offset: 1 is stored on disk
2025-10-31T13:55:42.654057Z node 8 :PERSQUEUE DEBUG: partition.cpp:2272: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T13:55:42.654073Z node 8 :PERSQUEUE DEBUG: partition.cpp:2281: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T13:55:42.654088Z node 8 :PERSQUEUE DEBUG: partition.cpp:2304: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T13:55:42.654121Z node 8 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-31T13:55:42.654159Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 1  requestId: <none> cookie: 1
2025-10-31T13:55:42.654306Z node 8 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 1 partno 0 count 1 parts 0 suffix '63' size 1185
2025-10-31T13:55:42.656294Z :DEBUG: [] MessageGroupId [source1] SessionId [source1|2f709a32-b921bc86-6da919b8-a062e9d6_0] Write session got write response: sequence_numbers: 1 offsets: 1 already_written: false write_statistics { persist_duration_ms: 17 queued_in_partition_duration_ms: 1 }
2025-10-31T13:55:42.656341Z :DEBUG: [] MessageGroupId [source1] SessionId [source1|2f709a32-b921bc86-6da919b8-a062e9d6_0] Write session: acknoledged message 1
2025-10-31T13:55:42.655845Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T13:55:42.655878Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T13:55:42.655978Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:883: [72075186224037892][Partition][0][StateIdle] read cookie 5 Topic 'rt3.dc1--topic1' partition 0 user user offset 1 count 1 size 1422 endOffset 2 max time lag 0ms effective offset 1
2025-10-31T13:55:42.656185Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:1097: [72075186224037892][Partition][0][StateIdle] read cookie 5 added 1 blobs, size 1185 count 1 last offset 1, current partition end offset: 2
2025-10-31T13:55:42.656202Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:1123: [72075186224037892][Partition][0][StateIdle] Reading cookie 5. Send blob request.
2025-10-31T13:55:42.656248Z node 8 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 1 partno 0 count 1 parts_count 0 source 1 size 1185 accessed 0 times before, last time 2025-10-31T13:55:42.000000Z
2025-10-31T13:55:42.656280Z node 8 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 5. All 1 blobs are from cache.
2025-10-31T13:55:42.656320Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:581: FormAnswer for 1 blobs
2025-10-31T13:55:42.654800Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 1 consumer shared/user session shared/user_7_1_11346096038620304364_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 1 EndOffset 1 newEndOffset 2 commitOffset 0 clientCommitOffset 0 cookie 2 readingFinished 0 firstRead 0
2025-10-31T13:55:42.656469Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 1 totakecount 1 count 1 size 1165 from pos 0 cbcount 1
2025-10-31T13:55:42.654833Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_7_1_11346096038620304364_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 1 endOffset 2
2025-10-31T13:55:42.656560Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-31T13:55:42.654881Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-31T13:55:42.656695Z node 8 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 1 partno 0 count 1 parts 0 suffix '63'
2025-10-31T13:55:42.655211Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_7_1_11346096038620304364_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 1, endOffset# 2, WTime# 1761918942388, sizeLag# 1185
2025-10-31T13:55:42.655229Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_7_1_11346096038620304364_v1TEvPartitionReady. Aval parts: 1
2025-10-31T13:55:42.655274Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_7_1_11346096038620304364_v1 performing read request: guid# d449d9a8-87ec2eb3-27bcc94-1545b5b0, from# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), count# 1, size# 1422, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-31T13:55:42.655325Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_7_1_11346096038620304364_v1 READ FROM TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1)maxCount 1 maxSize 1422 maxTimeLagMs 0 readTimestampMs 0 readOffset 1 EndOffset 2 ClientCommitOffset 0 committedOffset 0 Guid d449d9a8-87ec2eb3-27bcc94-1545b5b0
2025-10-31T13:55:42.657192Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_7_1_11346096038620304364_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 2 Result { Offset: 1 Data: "... 1122 bytes ..." SourceId: "\000source1" SeqNo: 1 WriteTimestampMS: 1761918942632 CreateTimestampMS: 1761918942580 UncompressedSize: 1047552 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 20 RealReadOffset: 1 WaitQuotaTimeMs: 0 EndOffset: 2 StartOffset: 0 } Cookie: 1 }
2025-10-31T13:55:42.657333Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_7_1_11346096038620304364_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 3 from offset 2
2025-10-31T13:55:42.657368Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_7_1_11346096038620304364_v1 after read state TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 2 ReadOffset 2 ReadGuid d449d9a8-87ec2eb3-27bcc94-1545b5b0 has messages 1
2025-10-31T13:55:42.657476Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_7_1_11346096038620304364_v1 read done: guid# d449d9a8-87ec2eb3-27bcc94-1545b5b0, partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), size# 1224
2025-10-31T13:55:42.657502Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_7_1_11346096038620304364_v1 response to read: guid# d449d9a8-87ec2eb3-27bcc94-1545b5b0
2025-10-31T13:55:42.657687Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_7_1_11346096038620304364_v1 Process answer. Aval parts: 0
2025-10-31T13:55:42.661876Z :DEBUG: [] [] [62469704-a5dc4062-4187ee1e-3d4dce2f] [null] After sending read request: ReadSizeBudget = 2621440, ReadSizeServerDelta = 0
2025-10-31T13:55:42.665035Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_7_1_11346096038620304364_v1 grpc read done: success# 1, data# { read { } }
2025-10-31T13:55:42.665183Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_7_1_11346096038620304364_v1 got read request: guid# c2698987-aed5b7c3-3a7b772-8d44ab08
2025-10-31T13:55:42.684925Z :INFO: [] MessageGroupId [source1] SessionId [source1|2f709a32-b921bc86-6da919b8-a062e9d6_0] Write session will now close
2025-10-31T13:55:42.684987Z :DEBUG: [] MessageGroupId [source1] SessionId [source1|2f709a32-b921bc86-6da919b8-a062e9d6_0] Write session: aborting
2025-10-31T13:55:42.685414Z :INFO: [] MessageGroupId [source1] SessionId [source1|2f709a32-b921bc86-6da919b8-a062e9d6_0] Write session: gracefully shut down, all writes complete
2025-10-31T13:55:42.685794Z :DEBUG: [] MessageGroupId [source1] SessionId [source1|2f709a32-b921bc86-6da919b8-a062e9d6_0] Write session: destroy
2025-10-31T13:55:42.694312Z :DEBUG: [] MessageGroupId [source2] SessionId [] Write session: try to update token
2025-10-31T13:55:42.693386Z node 8 :PERSQUEUE DEBUG: partition.cpp:2272: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T13:55:42.695242Z :INFO: [] MessageGroupId [source2] SessionId [] Write session: Do CDS request
2025-10-31T13:55:42.695278Z :INFO: [] MessageGroupId [source2] SessionId [] Start write session. Will connect to endpoint: localhost:27948
2025-10-31T13:55:42.693424Z node 8 :PERSQUEUE DEBUG: partition.cpp:2281: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T13:55:42.693087Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 2 sessionId: source1|2f709a32-b921bc86-6da919b8-a062e9d6_0 grpc closed
2025-10-31T13:55:42.693115Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2 sessionId: source1|2f709a32-b921bc86-6da919b8-a062e9d6_0 is DEAD
2025-10-31T13:55:42.693865Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-10-31T13:55:42.693442Z node 8 :PERSQUEUE DEBUG: partition.cpp:2304: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T13:55:42.709193Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [7:7567384235184989863:2491] destroyed
2025-10-31T13:55:42.709246Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-10-31T13:55:42.709292Z node 8 :PERSQUEUE DEBUG: partition.cpp:2272: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T13:55:42.709311Z node 8 :PERSQUEUE DEBUG: partition.cpp:2281: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T13:55:42.709332Z node 8 :PERSQUEUE DEBUG: partition.cpp:2304: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T13:55:42.730215Z node 7 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-31T13:55:42.730244Z node 7 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3
2025-10-31T13:55:42.733077Z :DEBUG: [] MessageGroupId [source2] SessionId [] Write session: send init request: init_request { topic: "topic1" message_group_id: "source2" }
2025-10-31T13:55:42.737333Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3 sessionId:  grpc read done: success: 1 data: init_request { topic: "topic1" message_group_id: "source2" }
2025-10-31T13:55:42.737455Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3 topic: "topic1" message_group_id: "source2" from ipv6:[::1]:55092
2025-10-31T13:55:42.737470Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:55092 proto=v1  topic=topic1 durationSec=0
2025-10-31T13:55:42.737480Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-31T13:55:42.738993Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3 sessionId:  describe result for acl check
2025-10-31T13:55:42.739114Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-31T13:55:42.739125Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-31T13:55:42.739137Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-31T13:55:42.739153Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [7:7567384235184989879:2503] (SourceId=source2, PreferedPartition=(NULL)) StartKqpSession
2025-10-31T13:55:42.742468Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [7:7567384235184989879:2503] (SourceId=source2, PreferedPartition=(NULL)) Select from the table
2025-10-31T13:55:42.755315Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [7:7567384235184989879:2503] (SourceId=source2, PreferedPartition=(NULL)) RequestPQRB
2025-10-31T13:55:42.761033Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1655: [72075186224037893][rt3.dc1--topic1] pipe [7:7567384235184989898:2503] connected; active server actors: 1
2025-10-31T13:55:42.761226Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [7:7567384235184989879:2503] (SourceId=source2, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=source2
2025-10-31T13:55:42.761245Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [7:7567384235184989879:2503] (SourceId=source2, PreferedPartition=(NULL)) Update the table
2025-10-31T13:55:42.762129Z node 7 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1659: [72075186224037893][rt3.dc1--topic1] pipe [7:7567384235184989898:2503] disconnected.
2025-10-31T13:55:42.762151Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1670: [72075186224037893][rt3.dc1--topic1] pipe [7:7567384235184989898:2503] disconnected; active server actors: 1
2025-10-31T13:55:42.762165Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1695: [72075186224037893][rt3.dc1--topic1] pipe [7:7567384235184989898:2503] disconnected no session
2025-10-31T13:55:42.771240Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [7:7567384235184989879:2503] (SourceId=source2, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-31T13:55:42.771280Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [7:7567384235184989879:2503] (SourceId=source2, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-10-31T13:55:42.771296Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [7:7567384235184989879:2503] (SourceId=source2, PreferedPartition=(NULL)) Start idle
2025-10-31T13:55:42.771325Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-31T13:55:42.773301Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [7:7567384235184989912:2503], now have 1 active actors on pipe
2025-10-31T13:55:42.773961Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T13:55:42.773995Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T13:55:42.774079Z node 8 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie source2|5f7e99a7-873f570f-ef5e8f3c-9c4740de_0 generated for partition 0 topic 'rt3.dc1--topic1' owner source2
2025-10-31T13:55:42.774110Z node 8 :PERSQUEUE DEBUG: partition.cpp:2272: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T13:55:42.774127Z node 8 :PERSQUEUE DEBUG: partition.cpp:2281: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T13:55:42.774142Z node 8 :PERSQUEUE DEBUG: partition.cpp:2285: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-31T13:55:42.774180Z node 8 :PERSQUEUE DEBUG: partition.cpp:2304: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T13:55:42.774219Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-31T13:55:42.774267Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-31T13:55:42.775044Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T13:55:42.775070Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T13:55:42.775130Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-31T13:55:42.773688Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 8, Generation: 1
2025-10-31T13:55:42.775507Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3 partition: 0 MaxSeqNo: 0 sessionId: source2|5f7e99a7-873f570f-ef5e8f3c-9c4740de_0
2025-10-31T13:55:42.777404Z :INFO: [] MessageGroupId [source2] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1761918942777 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-31T13:55:42.777511Z :INFO: [] MessageGroupId [source2] SessionId [] Write session established. Init response: session_id: "source2|5f7e99a7-873f570f-ef5e8f3c-9c4740de_0" topic: "topic1" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-31T13:55:42.779060Z :DEBUG: [] MessageGroupId [source2] SessionId [source2|5f7e99a7-873f570f-ef5e8f3c-9c4740de_0] Write 1 messages with Id from 1 to 1
2025-10-31T13:55:42.779148Z :INFO: [] MessageGroupId [source2] SessionId [source2|5f7e99a7-873f570f-ef5e8f3c-9c4740de_0] Write session: close. Timeout = 10000 ms
2025-10-31T13:55:42.796960Z node 8 :PERSQUEUE DEBUG: partition.cpp:2272: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T13:55:42.796994Z node 8 :PERSQUEUE DEBUG: partition.cpp:2281: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T13:55:42.797008Z node 8 :PERSQUEUE DEBUG: partition.cpp:2304: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T13:55:42.799157Z :DEBUG: [] MessageGroupId [source2] SessionId [source2|5f7e99a7-873f570f-ef5e8f3c-9c4740de_0] Write session: try to update token
2025-10-31T13:55:42.799213Z :DEBUG: [] MessageGroupId [source2] SessionId [source2|5f7e99a7-873f570f-ef5e8f3c-9c4740de_0] Send 1 message(s) (0 left), first sequence number is 1
2025-10-31T13:55:42.801285Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3 sessionId: source2|5f7e99a7-873f570f-ef5e8f3c-9c4740de_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-31T13:55:42.801566Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-31T13:55:42.802119Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T13:55:42.802158Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T13:55:42.802223Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-31T13:55:42.802534Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-31T13:55:42.802993Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T13:55:42.803018Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T13:55:42.803071Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: '\0source2' SeqNo: 1 partNo : 0 messageNo: 1 size 1122 offset: -1
2025-10-31T13:55:42.803105Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-31T13:55:42.803145Z node 8 :PERSQUEUE DEBUG: partition.cpp:2272: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T13:55:42.803168Z node 8 :PERSQUEUE DEBUG: partition.cpp:2281: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T13:55:42.803181Z node 8 :PERSQUEUE DEBUG: partition.cpp:2285: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-31T13:55:42.803284Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId '\0source2' seqNo 1 partNo 0
2025-10-31T13:55:42.804157Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '\0source2' seqNo 1 partNo 0 FormedBlobsCount 0 NewHead: Offset 2 PartNo 0 PackedSize 1197 count 1 nextOffset 3 batches 1
2025-10-31T13:55:42.804191Z node 8 :PERSQUEUE DEBUG: partition.cpp:2304: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T13:55:42.804683Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 2,1 HeadOffset 2 endOffset 2 curOffset 3 d0000000000_00000000000000000002_00000_0000000001_00000? size 1185 WTime 1761918942804
2025-10-31T13:55:42.804816Z node 8 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-31T13:55:42.804949Z node 8 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 2 partNo 0 count 1 size 1185
2025-10-31T13:55:42.817244Z node 8 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 2 count 1 size 1185 actorID [8:7567384232061559767:2359]
2025-10-31T13:55:42.817335Z node 8 :PERSQUEUE DEBUG: partition.cpp:2099: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-31T13:55:42.817389Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1130 WriteNewSizeFromSupportivePartitions# 0
2025-10-31T13:55:42.817421Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-31T13:55:42.817458Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0source2', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 1, partNo: 0, Offset: 2 is stored on disk
2025-10-31T13:55:42.817465Z node 8 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 2 partno 0 count 1 parts 0 suffix '63' size 1185
2025-10-31T13:55:42.817655Z node 8 :PERSQUEUE DEBUG: partition.cpp:2272: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T13:55:42.817670Z node 8 :PERSQUEUE DEBUG: partition.cpp:2281: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T13:55:42.817683Z node 8 :PERSQUEUE DEBUG: partition.cpp:2304: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T13:55:42.817715Z node 8 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-31T13:55:42.817751Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 1  requestId: <none> cookie: 1
2025-10-31T13:55:42.818347Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 1 consumer shared/user session shared/user_7_1_11346096038620304364_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 2 EndOffset 2 newEndOffset 3 commitOffset 0 clientCommitOffset 0 cookie 3 readingFinished 0 firstRead 0
2025-10-31T13:55:42.818392Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_7_1_11346096038620304364_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 2 endOffset 3
2025-10-31T13:55:42.818465Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-31T13:55:42.818879Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_7_1_11346096038620304364_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 2, endOffset# 3, WTime# 1761918942632, sizeLag# 1185
2025-10-31T13:55:42.818915Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_7_1_11346096038620304364_v1TEvPartitionReady. Aval parts: 1
2025-10-31T13:55:42.818975Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_7_1_11346096038620304364_v1 performing read request: guid# c2698987-aed5b7c3-3a7b772-8d44ab08, from# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), count# 1, size# 1422, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-31T13:55:42.819039Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_7_1_11346096038620304364_v1 READ FROM TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1)maxCount 1 maxSize 1422 maxTimeLagMs 0 readTimestampMs 0 readOffset 2 EndOffset 3 ClientCommitOffset 0 committedOffset 0 Guid c2698987-aed5b7c3-3a7b772-8d44ab08
2025-10-31T13:55:42.821308Z :DEBUG: [] MessageGroupId [source2] SessionId [source2|5f7e99a7-873f570f-ef5e8f3c-9c4740de_0] Write session got write response: sequence_numbers: 1 offsets: 2 already_written: false write_statistics { persist_duration_ms: 13 queued_in_partition_duration_ms: 1 }
2025-10-31T13:55:42.821352Z :DEBUG: [] MessageGroupId [source2] SessionId [source2|5f7e99a7-873f570f-ef5e8f3c-9c4740de_0] Write session: acknoledged message 1
2025-10-31T13:55:42.822032Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T13:55:42.822071Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T13:55:42.822187Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:883: [72075186224037892][Partition][0][StateIdle] read cookie 6 Topic 'rt3.dc1--topic1' partition 0 user user offset 2 count 1 size 1422 endOffset 3 max time lag 0ms effective offset 2
2025-10-31T13:55:42.822385Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:1097: [72075186224037892][Partition][0][StateIdle] read cookie 6 added 1 blobs, size 1185 count 1 last offset 2, current partition end offset: 3
2025-10-31T13:55:42.822401Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:1123: [72075186224037892][Partition][0][StateIdle] Reading cookie 6. Send blob request.
2025-10-31T13:55:42.822441Z node 8 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 2 partno 0 count 1 parts_count 0 source 1 size 1185 accessed 0 times before, last time 2025-10-31T13:55:42.000000Z
2025-10-31T13:55:42.822477Z node 8 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 6. All 1 blobs are from cache.
2025-10-31T13:55:42.822522Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:581: FormAnswer for 1 blobs
2025-10-31T13:55:42.822647Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 2 totakecount 1 count 1 size 1165 from pos 0 cbcount 1
2025-10-31T13:55:42.822738Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 2
2025-10-31T13:55:42.823188Z node 8 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 2 partno 0 count 1 parts 0 suffix '63'
2025-10-31T13:55:42.823698Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_7_1_11346096038620304364_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 3 Result { Offset: 2 Data: "... 1122 bytes ..." SourceId: "\000source2" SeqNo: 1 WriteTimestampMS: 1761918942802 CreateTimestampMS: 1761918942777 UncompressedSize: 1047552 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 20 RealReadOffset: 2 WaitQuotaTimeMs: 0 EndOffset: 3 StartOffset: 0 } Cookie: 2 }
2025-10-31T13:55:42.823833Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_7_1_11346096038620304364_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 4 from offset 3
2025-10-31T13:55:42.823870Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_7_1_11346096038620304364_v1 after read state TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 3 ReadOffset 3 ReadGuid c2698987-aed5b7c3-3a7b772-8d44ab08 has messages 1
2025-10-31T13:55:42.824014Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_7_1_11346096038620304364_v1 read done: guid# c2698987-aed5b7c3-3a7b772-8d44ab08, partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), size# 1224
2025-10-31T13:55:42.824039Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_7_1_11346096038620304364_v1 response to read: guid# c2698987-aed5b7c3-3a7b772-8d44ab08
2025-10-31T13:55:42.824278Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_7_1_11346096038620304364_v1 Process answer. Aval parts: 0
2025-10-31T13:55:42.827756Z :DEBUG: [] [] [62469704-a5dc4062-4187ee1e-3d4dce2f] [null] After sending read request: ReadSizeBudget = 2621440, ReadSizeServerDelta = 0
2025-10-31T13:55:42.828227Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_7_1_11346096038620304364_v1 grpc read done: success# 1, data# { read { } }
2025-10-31T13:55:42.828369Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_7_1_11346096038620304364_v1 got read request: guid# 2fb3720a-e063a37d-61e8acb8-5878db64
2025-10-31T13:55:42.849976Z :INFO: [] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:topic1:0:1:2:0
2025-10-31T13:55:42.850062Z :INFO: [] [] [62469704-a5dc4062-4187ee1e-3d4dce2f] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1012 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 3150 BytesInflightTotal: 3150 MessagesInflight: 3 }
2025-10-31T13:55:42.880905Z :INFO: [] MessageGroupId [source2] SessionId [source2|5f7e99a7-873f570f-ef5e8f3c-9c4740de_0] Write session will now close
2025-10-31T13:55:42.880961Z :DEBUG: [] MessageGroupId [source2] SessionId [source2|5f7e99a7-873f570f-ef5e8f3c-9c4740de_0] Write session: aborting
2025-10-31T13:55:42.881365Z :INFO: [] MessageGroupId [source2] SessionId [source2|5f7e99a7-873f570f-ef5e8f3c-9c4740de_0] Write session: gracefully shut down, all writes complete
2025-10-31T13:55:42.881773Z :DEBUG: [] MessageGroupId [source2] SessionId [source2|5f7e99a7-873f570f-ef5e8f3c-9c4740de_0] Write session: destroy
2025-10-31T13:55:42.883356Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3 sessionId: source2|5f7e99a7-873f570f-ef5e8f3c-9c4740de_0 grpc read done: success: 0 data: 
2025-10-31T13:55:42.883375Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 3 sessionId: source2|5f7e99a7-873f570f-ef5e8f3c-9c4740de_0 grpc read failed
2025-10-31T13:55:42.883394Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 3 sessionId: source2|5f7e99a7-873f570f-ef5e8f3c-9c4740de_0 grpc closed
2025-10-31T13:55:42.883407Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3 sessionId: source2|5f7e99a7-873f570f-ef5e8f3c-9c4740de_0 is DEAD
2025-10-31T13:55:42.883953Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-10-31T13:55:42.884522Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [7:7567384235184989912:2503] destroyed
2025-10-31T13:55:42.884559Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-10-31T13:55:42.884580Z node 8 :PERSQUEUE DEBUG: partition.cpp:2272: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T13:55:42.884589Z node 8 :PERSQUEUE DEBUG: partition.cpp:2281: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T13:55:42.884599Z node 8 :PERSQUEUE DEBUG: partition.cpp:2304: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T13:55:42.896715Z :DEBUG: [] MessageGroupId [source3] SessionId [] Write session: try to update token
2025-10-31T13:55:42.897052Z :INFO: [] MessageGroupId [source3] SessionId [] Write session: Do CDS request
2025-10-31T13:55:42.897079Z :INFO: [] MessageGroupId [source3] SessionId [] Start write session. Will connect to endpoint: localhost:27948
2025-10-31T13:55:42.897126Z node 8 :PERSQUEUE DEBUG: partition.cpp:2272: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T13:55:42.897182Z node 8 :PERSQUEUE DEBUG: partition.cpp:2281: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T13:55:42.897199Z node 8 :PERSQUEUE DEBUG: partition.cpp:2304: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T13:55:42.909095Z :DEBUG: [] MessageGroupId [source3] SessionId [] Write session: send init request: init_request { topic: "topic1" message_group_id: "source3" }
2025-10-31T13:55:42.909289Z node 7 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-31T13:55:42.909320Z node 7 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 4
2025-10-31T13:55:42.910224Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 4 sessionId:  grpc read done: success: 1 data: init_request { topic: "topic1" message_group_id: "source3" }
2025-10-31T13:55:42.910337Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 4 topic: "topic1" message_group_id: "source3" from ipv6:[::1]:55092
2025-10-31T13:55:42.910351Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=4 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:55092 proto=v1  topic=topic1 durationSec=0
2025-10-31T13:55:42.910362Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-31T13:55:42.911999Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 4 sessionId:  describe result for acl check
2025-10-31T13:55:42.912111Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-31T13:55:42.912123Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-31T13:55:42.912133Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-31T13:55:42.912151Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [7:7567384235184989917:2507] (SourceId=source3, PreferedPartition=(NULL)) StartKqpSession
2025-10-31T13:55:42.915405Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [7:7567384235184989917:2507] (SourceId=source3, PreferedPartition=(NULL)) Select from the table
2025-10-31T13:55:42.923997Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [7:7567384235184989917:2507] (SourceId=source3, PreferedPartition=(NULL)) RequestPQRB
2025-10-31T13:55:42.926338Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1655: [72075186224037893][rt3.dc1--topic1] pipe [7:7567384235184989937:2507] connected; active server actors: 1
2025-10-31T13:55:42.927478Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [7:7567384235184989917:2507] (SourceId=source3, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=source3
2025-10-31T13:55:42.927504Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [7:7567384235184989917:2507] (SourceId=source3, PreferedPartition=(NULL)) Update the table
2025-10-31T13:55:42.928756Z node 7 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1659: [72075186224037893][rt3.dc1--topic1] pipe [7:7567384235184989937:2507] disconnected.
2025-10-31T13:55:42.928782Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1670: [72075186224037893][rt3.dc1--topic1] pipe [7:7567384235184989937:2507] disconnected; active server actors: 1
2025-10-31T13:55:42.928796Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1695: [72075186224037893][rt3.dc1--topic1] pipe [7:7567384235184989937:2507] disconnected no session
2025-10-31T13:55:42.942507Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [7:7567384235184989917:2507] (SourceId=source3, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-31T13:55:42.942545Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [7:7567384235184989917:2507] (SourceId=source3, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-10-31T13:55:42.942563Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [7:7567384235184989917:2507] (SourceId=source3, PreferedPartition=(NULL)) Start idle
2025-10-31T13:55:42.942605Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 4 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-31T13:55:42.944793Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [7:7567384235184989951:2507], now have 1 active actors on pipe
2025-10-31T13:55:42.945258Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 8, Generation: 1
2025-10-31T13:55:42.945743Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T13:55:42.945777Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T13:55:42.945848Z node 8 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie source3|9cd4846f-67c959db-a6f82497-b933673d_0 generated for partition 0 topic 'rt3.dc1--topic1' owner source3
2025-10-31T13:55:42.945880Z node 8 :PERSQUEUE DEBUG: partition.cpp:2272: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T13:55:42.945906Z node 8 :PERSQUEUE DEBUG: partition.cpp:2281: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T13:55:42.945920Z node 8 :PERSQUEUE DEBUG: partition.cpp:2285: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-31T13:55:42.945962Z node 8 :PERSQUEUE DEBUG: partition.cpp:2304: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T13:55:42.946002Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-31T13:55:42.946047Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-31T13:55:42.946908Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T13:55:42.946943Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T13:55:42.947009Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-31T13:55:42.947435Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 4 partition: 0 MaxSeqNo: 0 sessionId: source3|9cd4846f-67c959db-a6f82497-b933673d_0
2025-10-31T13:55:42.952994Z :INFO: [] MessageGroupId [source3] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1761918942952 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-31T13:55:42.953118Z :INFO: [] MessageGroupId [source3] SessionId [] Write session established. Init response: session_id: "source3|9cd4846f-67c959db-a6f82497-b933673d_0" topic: "topic1" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-31T13:55:42.954592Z :DEBUG: [] MessageGroupId [source3] SessionId [source3|9cd4846f-67c959db-a6f82497-b933673d_0] Write 1 messages with Id from 1 to 1
2025-10-31T13:55:42.954684Z :INFO: [] MessageGroupId [source3] SessionId [source3|9cd4846f-67c959db-a6f82497-b933673d_0] Write session: close. Timeout = 10000 ms
2025-10-31T13:55:42.975039Z :DEBUG: [] MessageGroupId [source3] SessionId [source3|9cd4846f-67c959db-a6f82497-b933673d_0] Write session: try to update token
2025-10-31T13:55:42.975113Z :DEBUG: [] MessageGroupId [source3] SessionId [source3|9cd4846f-67c959db-a6f82497-b933673d_0] Send 1 message(s) (0 left), first sequence number is 1
2025-10-31T13:55:42.976026Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 4 sessionId: source3|9cd4846f-67c959db-a6f82497-b933673d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-31T13:55:42.976363Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-31T13:55:42.977223Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T13:55:42.977332Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T13:55:42.977413Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-31T13:55:42.977763Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-31T13:55:42.981169Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T13:55:42.981211Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T13:55:42.981286Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: '\0source3' SeqNo: 1 partNo : 0 messageNo: 1 size 1122 offset: -1
2025-10-31T13:55:42.981333Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-31T13:55:42.981382Z node 8 :PERSQUEUE DEBUG: partition.cpp:2272: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T13:55:42.981408Z node 8 :PERSQUEUE DEBUG: partition.cpp:2281: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T13:55:42.981421Z node 8 :PERSQUEUE DEBUG: partition.cpp:2285: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-31T13:55:42.981533Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId '\0source3' seqNo 1 partNo 0
2025-10-31T13:55:42.982512Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '\0source3' seqNo 1 partNo 0 FormedBlobsCount 0 NewHead: Offset 3 PartNo 0 PackedSize 1197 count 1 nextOffset 4 batches 1
2025-10-31T13:55:42.982552Z node 8 :PERSQUEUE DEBUG: partition.cpp:2304: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T13:55:42.983087Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 3,1 HeadOffset 3 endOffset 3 curOffset 4 d0000000000_00000000000000000003_00000_0000000001_00000? size 1185 WTime 1761918942982
2025-10-31T13:55:42.983237Z node 8 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-31T13:55:42.983369Z node 8 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 3 partNo 0 count 1 size 1185
2025-10-31T13:55:42.998588Z node 8 :PERSQUEUE DEBUG: partition.cpp:2251: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-31T13:55:42.998652Z node 8 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 3 count 1 size 1185 actorID [8:7567384232061559767:2359]
2025-10-31T13:55:42.998702Z node 8 :PERSQUEUE DEBUG: partition.cpp:2099: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-31T13:55:42.998758Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1130 WriteNewSizeFromSupportivePartitions# 0
2025-10-31T13:55:42.998792Z node 8 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 3 partno 0 count 1 parts 0 suffix '63' size 1185
2025-10-31T13:55:42.998800Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-31T13:55:42.998838Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0source3', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 1, partNo: 0, Offset: 3 is stored on disk
2025-10-31T13:55:42.999060Z node 8 :PERSQUEUE DEBUG: partition.cpp:2272: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T13:55:42.999076Z node 8 :PERSQUEUE DEBUG: partition.cpp:2281: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T13:55:42.999089Z node 8 :PERSQUEUE DEBUG: partition.cpp:2304: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T13:55:42.999122Z node 8 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-31T13:55:42.999159Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 1  requestId: <none> cookie: 1
2025-10-31T13:55:43.000691Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 1 consumer shared/user session shared/user_7_1_11346096038620304364_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 3 EndOffset 3 newEndOffset 4 commitOffset 0 clientCommitOffset 0 cookie 4 readingFinished 0 firstRead 0
2025-10-31T13:55:43.000725Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_7_1_11346096038620304364_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 3 endOffset 4
2025-10-31T13:55:43.000775Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-31T13:55:43.001204Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_7_1_11346096038620304364_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 3, endOffset# 4, WTime# 1761918942802, sizeLag# 1185
2025-10-31T13:55:43.001224Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_7_1_11346096038620304364_v1TEvPartitionReady. Aval parts: 1
2025-10-31T13:55:43.001270Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_7_1_11346096038620304364_v1 performing read request: guid# 2fb3720a-e063a37d-61e8acb8-5878db64, from# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), count# 1, size# 1422, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-31T13:55:43.001349Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_7_1_11346096038620304364_v1 READ FROM TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1)maxCount 1 maxSize 1422 maxTimeLagMs 0 readTimestampMs 0 readOffset 3 EndOffset 4 ClientCommitOffset 0 committedOffset 0 Guid 2fb3720a-e063a37d-61e8acb8-5878db64
2025-10-31T13:55:43.002289Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T13:55:43.002325Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T13:55:43.002432Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:883: [72075186224037892][Partition][0][StateIdle] read cookie 7 Topic 'rt3.dc1--topic1' partition 0 user user offset 3 count 1 size 1422 endOffset 4 max time lag 0ms effective offset 3
2025-10-31T13:55:43.002658Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:1097: [72075186224037892][Partition][0][StateIdle] read cookie 7 added 1 blobs, size 1185 count 1 last offset 3, current partition end offset: 4
2025-10-31T13:55:43.002678Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:1123: [72075186224037892][Partition][0][StateIdle] Reading cookie 7. Send blob request.
2025-10-31T13:55:43.002721Z node 8 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 3 partno 0 count 1 parts_count 0 source 1 size 1185 accessed 0 times before, last time 2025-10-31T13:55:42.000000Z
2025-10-31T13:55:43.002756Z node 8 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 7. All 1 blobs are from cache.
2025-10-31T13:55:43.002798Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:581: FormAnswer for 1 blobs
2025-10-31T13:55:43.002824Z node 8 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 3 partno 0 count 1 parts 0 suffix '63'
2025-10-31T13:55:43.002923Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 3 totakecount 1 count 1 size 1165 from pos 0 cbcount 1
2025-10-31T13:55:43.003017Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 3
2025-10-31T13:55:43.007443Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_7_1_11346096038620304364_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 4 Result { Offset: 3 Data: "... 1122 bytes ..." SourceId: "\000source3" SeqNo: 1 WriteTimestampMS: 1761918942979 CreateTimestampMS: 1761918942953 UncompressedSize: 1047552 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 20 RealReadOffset: 3 WaitQuotaTimeMs: 0 EndOffset: 4 StartOffset: 0 } Cookie: 3 }
2025-10-31T13:55:43.007608Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_7_1_11346096038620304364_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 5 from offset 4
2025-10-31T13:55:43.007653Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_7_1_11346096038620304364_v1 after read state TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 4 ReadOffset 4 ReadGuid 2fb3720a-e063a37d-61e8acb8-5878db64 has messages 1
2025-10-31T13:55:43.008355Z :DEBUG: [] MessageGroupId [source3] SessionId [source3|9cd4846f-67c959db-a6f82497-b933673d_0] Write session got write response: sequence_numbers: 1 offsets: 3 already_written: false write_statistics { persist_duration_ms: 16 queued_in_partition_duration_ms: 2 }
2025-10-31T13:55:43.007802Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_7_1_11346096038620304364_v1 read done: guid# 2fb3720a-e063a37d-61e8acb8-5878db64, partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), size# 1224
2025-10-31T13:55:43.008406Z :DEBUG: [] MessageGroupId [source3] SessionId [source3|9cd4846f-67c959db-a6f82497-b933673d_0] Write session: acknoledged message 1
2025-10-31T13:55:43.007830Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_7_1_11346096038620304364_v1 response to read: guid# 2fb3720a-e063a37d-61e8acb8-5878db64
2025-10-31T13:55:43.008128Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_7_1_11346096038620304364_v1 Process answer. Aval parts: 0
2025-10-31T13:55:43.008929Z :DEBUG: [] [] [62469704-a5dc4062-4187ee1e-3d4dce2f] [null] After sending read request: ReadSizeBudget = 2621440, ReadSizeServerDelta = 0
2025-10-31T13:55:43.013469Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_7_1_11346096038620304364_v1 grpc read done: success# 1, data# { read { } }
2025-10-31T13:55:43.013620Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_7_1_11346096038620304364_v1 got read request: guid# 35d23d07-cbad3fc1-6adc776b-b3e04285
2025-10-31T13:55:43.054858Z :INFO: [] MessageGroupId [source3] SessionId [source3|9cd4846f-67c959db-a6f82497-b933673d_0] Write session will now close
2025-10-31T13:55:43.054920Z :DEBUG: [] MessageGroupId [source3] SessionId [source3|9cd4846f-67c959db-a6f82497-b933673d_0] Write session: aborting
2025-10-31T13:55:43.055361Z :INFO: [] MessageGroupId [source3] SessionId [source3|9cd4846f-67c959db-a6f82497-b933673d_0] Write session: gracefully shut down, all writes complete
2025-10-31T13:55:43.055609Z :DEBUG: [] MessageGroupId [source3] SessionId [source3|9cd4846f-67c959db-a6f82497-b933673d_0] Write session: destroy
2025-10-31T13:55:43.057403Z :DEBUG: [] MessageGroupId [source4] SessionId [] Write session: try to update token
2025-10-31T13:55:43.077107Z :INFO: [] MessageGroupId [source4] SessionId [] Write session: Do CDS request
2025-10-31T13:55:43.077159Z :INFO: [] MessageGroupId [source4] SessionId [] Start write session. Will connect to endpoint: localhost:27948
2025-10-31T13:55:43.078835Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 4 sessionId: source3|9cd4846f-67c959db-a6f82497-b933673d_0 grpc read done: success: 0 data: 
2025-10-31T13:55:43.078862Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 4 sessionId: source3|9cd4846f-67c959db-a6f82497-b933673d_0 grpc read failed
2025-10-31T13:55:43.078891Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 4 sessionId: source3|9cd4846f-67c959db-a6f82497-b933673d_0 grpc closed
2025-10-31T13:55:43.078906Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 4 sessionId: source3|9cd4846f-67c959db-a6f82497-b933673d_0 is DEAD
2025-10-31T13:55:43.079694Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-10-31T13:55:43.084873Z :DEBUG: [] MessageGroupId [source4] SessionId [] Write session: send init request: init_request { topic: "topic1" message_group_id: "source4" }
2025-10-31T13:55:43.084950Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [7:7567384235184989951:2507] destroyed
2025-10-31T13:55:43.085009Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-10-31T13:55:43.085041Z node 8 :PERSQUEUE DEBUG: partition.cpp:2272: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T13:55:43.085055Z node 8 :PERSQUEUE DEBUG: partition.cpp:2281: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T13:55:43.085071Z node 8 :PERSQUEUE DEBUG: partition.cpp:2304: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T13:55:43.086133Z node 7 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-31T13:55:43.086163Z node 7 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 5
2025-10-31T13:55:43.086546Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 5 sessionId:  grpc read done: success: 1 data: init_request { topic: "topic1" message_group_id: "source4" }
2025-10-31T13:55:43.086653Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 5 topic: "topic1" message_group_id: "source4" from ipv6:[::1]:55092
2025-10-31T13:55:43.086670Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=5 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:55092 proto=v1  topic=topic1 durationSec=0
2025-10-31T13:55:43.086681Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-31T13:55:43.088239Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 5 sessionId:  describe result for acl check
2025-10-31T13:55:43.088377Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-31T13:55:43.088389Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-31T13:55:43.088400Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-31T13:55:43.088418Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [7:7567384239479957280:2517] (SourceId=source4, PreferedPartition=(NULL)) StartKqpSession
2025-10-31T13:55:43.091912Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [7:7567384239479957280:2517] (SourceId=source4, PreferedPartition=(NULL)) Select from the table
2025-10-31T13:55:43.098846Z node 8 :PERSQUEUE DEBUG: partition.cpp:2272: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T13:55:43.098883Z node 8 :PERSQUEUE DEBUG: partition.cpp:2281: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T13:55:43.098903Z node 8 :PERSQUEUE DEBUG: partition.cpp:2304: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T13:55:43.101197Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [7:7567384239479957280:2517] (SourceId=source4, PreferedPartition=(NULL)) RequestPQRB
2025-10-31T13:55:43.102730Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1655: [72075186224037893][rt3.dc1--topic1] pipe [7:7567384239479957299:2517] connected; active server actors: 1
2025-10-31T13:55:43.102899Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [7:7567384239479957280:2517] (SourceId=source4, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=source4
2025-10-31T13:55:43.102918Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [7:7567384239479957280:2517] (SourceId=source4, PreferedPartition=(NULL)) Update the table
2025-10-31T13:55:43.103954Z node 7 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1659: [72075186224037893][rt3.dc1--topic1] pipe [7:7567384239479957299:2517] disconnected.
2025-10-31T13:55:43.103982Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1670: [72075186224037893][rt3.dc1--topic1] pipe [7:7567384239479957299:2517] disconnected; active server actors: 1
2025-10-31T13:55:43.103999Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1695: [72075186224037893][rt3.dc1--topic1] pipe [7:7567384239479957299:2517] disconnected no session
2025-10-31T13:55:43.113970Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [7:7567384239479957280:2517] (SourceId=source4, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-31T13:55:43.114019Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [7:7567384239479957280:2517] (SourceId=source4, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-10-31T13:55:43.114045Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [7:7567384239479957280:2517] (SourceId=source4, PreferedPartition=(NULL)) Start idle
2025-10-31T13:55:43.114083Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 5 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-31T13:55:43.122654Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 8, Generation: 1
2025-10-31T13:55:43.124410Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 5 partition: 0 MaxSeqNo: 0 sessionId: source4|a718bc95-98ba1c6e-1079a8c3-5283e3f4_0
2025-10-31T13:55:43.122277Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [7:7567384239479957313:2517], now have 1 active actors on pipe
2025-10-31T13:55:43.123025Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T13:55:43.123066Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T13:55:43.123160Z node 8 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie source4|a718bc95-98ba1c6e-1079a8c3-5283e3f4_0 generated for partition 0 topic 'rt3.dc1--topic1' owner source4
2025-10-31T13:55:43.123199Z node 8 :PERSQUEUE DEBUG: partition.cpp:2272: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T13:55:43.123223Z node 8 :PERSQUEUE DEBUG: partition.cpp:2281: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T13:55:43.123244Z node 8 :PERSQUEUE DEBUG: partition.cpp:2285: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-31T13:55:43.123298Z node 8 :PERSQUEUE DEBUG: partition.cpp:2304: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T13:55:43.123352Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-31T13:55:43.123412Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-31T13:55:43.123984Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T13:55:43.124009Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T13:55:43.124091Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-31T13:55:43.125665Z :INFO: [] MessageGroupId [source4] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1761918943125 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-31T13:55:43.125824Z :INFO: [] MessageGroupId [source4] SessionId [] Write session established. Init response: session_id: "source4|a718bc95-98ba1c6e-1079a8c3-5283e3f4_0" topic: "topic1" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-31T13:55:43.130048Z :DEBUG: [] MessageGroupId [source4] SessionId [source4|a718bc95-98ba1c6e-1079a8c3-5283e3f4_0] Write 1 messages with Id from 1 to 1
2025-10-31T13:55:43.130179Z :INFO: [] MessageGroupId [source4] SessionId [source4|a718bc95-98ba1c6e-1079a8c3-5283e3f4_0] Write session: close. Timeout = 10000 ms
2025-10-31T13:55:43.154246Z :DEBUG: [] MessageGroupId [source4] SessionId [source4|a718bc95-98ba1c6e-1079a8c3-5283e3f4_0] Write session: try to update token
2025-10-31T13:55:43.154316Z :DEBUG: [] MessageGroupId [source4] SessionId [source4|a718bc95-98ba1c6e-1079a8c3-5283e3f4_0] Send 1 message(s) (0 left), first sequence number is 1
2025-10-31T13:55:43.155205Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 5 sessionId: source4|a718bc95-98ba1c6e-1079a8c3-5283e3f4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-31T13:55:43.155484Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-31T13:55:43.156339Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-31T13:55:43.155957Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T13:55:43.156019Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T13:55:43.156098Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-31T13:55:43.156731Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T13:55:43.156751Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T13:55:43.156810Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: '\0source4' SeqNo: 1 partNo : 0 messageNo: 1 size 1122 offset: -1
2025-10-31T13:55:43.156933Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-31T13:55:43.156991Z node 8 :PERSQUEUE DEBUG: partition.cpp:2272: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T13:55:43.157020Z node 8 :PERSQUEUE DEBUG: partition.cpp:2281: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T13:55:43.157037Z node 8 :PERSQUEUE DEBUG: partition.cpp:2285: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-31T13:55:43.157154Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId '\0source4' seqNo 1 partNo 0
2025-10-31T13:55:43.158281Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '\0source4' seqNo 1 partNo 0 FormedBlobsCount 0 NewHead: Offset 4 PartNo 0 PackedSize 1197 count 1 nextOffset 5 batches 1
2025-10-31T13:55:43.158333Z node 8 :PERSQUEUE DEBUG: partition.cpp:2304: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T13:55:43.158914Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 4,1 HeadOffset 4 endOffset 4 curOffset 5 d0000000000_00000000000000000004_00000_0000000001_00000? size 1185 WTime 1761918943158
2025-10-31T13:55:43.159080Z node 8 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-31T13:55:43.159205Z node 8 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 4 partNo 0 count 1 size 1185
2025-10-31T13:55:43.166086Z node 8 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 4 count 1 size 1185 actorID [8:7567384232061559767:2359]
2025-10-31T13:55:43.166159Z node 8 :PERSQUEUE DEBUG: partition.cpp:2099: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-31T13:55:43.166221Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1130 WriteNewSizeFromSupportivePartitions# 0
2025-10-31T13:55:43.166261Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-31T13:55:43.166305Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0source4', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 1, partNo: 0, Offset: 4 is stored on disk
2025-10-31T13:55:43.166540Z node 8 :PERSQUEUE DEBUG: partition.cpp:2272: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T13:55:43.166558Z node 8 :PERSQUEUE DEBUG: partition.cpp:2281: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T13:55:43.166571Z node 8 :PERSQUEUE DEBUG: partition.cpp:2304: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T13:55:43.166606Z node 8 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-31T13:55:43.166650Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 1  requestId: <none> cookie: 1
2025-10-31T13:55:43.167102Z node 8 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 4 partno 0 count 1 parts 0 suffix '63' size 1185
2025-10-31T13:55:43.167376Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 1 consumer shared/user session shared/user_7_1_11346096038620304364_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 4 EndOffset 4 newEndOffset 5 commitOffset 0 clientCommitOffset 0 cookie 5 readingFinished 0 firstRead 0
2025-10-31T13:55:43.167413Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_7_1_11346096038620304364_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 4 endOffset 5
2025-10-31T13:55:43.167473Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-31T13:55:43.167890Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_7_1_11346096038620304364_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 4, endOffset# 5, WTime# 1761918942979, sizeLag# 1185
2025-10-31T13:55:43.167909Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_7_1_11346096038620304364_v1TEvPartitionReady. Aval parts: 1
2025-10-31T13:55:43.167953Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_7_1_11346096038620304364_v1 performing read request: guid# 35d23d07-cbad3fc1-6adc776b-b3e04285, from# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), count# 1, size# 1422, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-31T13:55:43.168006Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_7_1_11346096038620304364_v1 READ FROM TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1)maxCount 1 maxSize 1422 maxTimeLagMs 0 readTimestampMs 0 readOffset 4 EndOffset 5 ClientCommitOffset 0 committedOffset 0 Guid 35d23d07-cbad3fc1-6adc776b-b3e04285
2025-10-31T13:55:43.168895Z :DEBUG: [] MessageGroupId [source4] SessionId [source4|a718bc95-98ba1c6e-1079a8c3-5283e3f4_0] Write session got write response: sequence_numbers: 1 offsets: 4 already_written: false write_statistics { persist_duration_ms: 6 queued_in_partition_duration_ms: 1 }
2025-10-31T13:55:43.168941Z :DEBUG: [] MessageGroupId [source4] SessionId [source4|a718bc95-98ba1c6e-1079a8c3-5283e3f4_0] Write session: acknoledged message 1
2025-10-31T13:55:43.168451Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T13:55:43.168485Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T13:55:43.168595Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:883: [72075186224037892][Partition][0][StateIdle] read cookie 8 Topic 'rt3.dc1--topic1' partition 0 user user offset 4 count 1 size 1422 endOffset 5 max time lag 0ms effective offset 4
2025-10-31T13:55:43.168829Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:1097: [72075186224037892][Partition][0][StateIdle] read cookie 8 added 1 blobs, size 1185 count 1 last offset 4, current partition end offset: 5
2025-10-31T13:55:43.168874Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:1123: [72075186224037892][Partition][0][StateIdle] Reading cookie 8. Send blob request.
2025-10-31T13:55:43.168924Z node 8 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 4 partno 0 count 1 parts_count 0 source 1 size 1185 accessed 0 times before, last time 2025-10-31T13:55:43.000000Z
2025-10-31T13:55:43.168960Z node 8 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 8. All 1 blobs are from cache.
2025-10-31T13:55:43.169009Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:581: FormAnswer for 1 blobs
2025-10-31T13:55:43.169139Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 4 totakecount 1 count 1 size 1165 from pos 0 cbcount 1
2025-10-31T13:55:43.169236Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 4
2025-10-31T13:55:43.169736Z node 8 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 4 partno 0 count 1 parts 0 suffix '63'
2025-10-31T13:55:43.170118Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_7_1_11346096038620304364_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 5 Result { Offset: 4 Data: "... 1122 bytes ..." SourceId: "\000source4" SeqNo: 1 WriteTimestampMS: 1761918943157 CreateTimestampMS: 1761918943128 UncompressedSize: 1047552 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 20 RealReadOffset: 4 WaitQuotaTimeMs: 0 EndOffset: 5 StartOffset: 0 } Cookie: 4 }
2025-10-31T13:55:43.170256Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_7_1_11346096038620304364_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 6 from offset 5
2025-10-31T13:55:43.170296Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_7_1_11346096038620304364_v1 after read state TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 5 ReadOffset 5 ReadGuid 35d23d07-cbad3fc1-6adc776b-b3e04285 has messages 1
2025-10-31T13:55:43.170411Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_7_1_11346096038620304364_v1 read done: guid# 35d23d07-cbad3fc1-6adc776b-b3e04285, partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), size# 1224
2025-10-31T13:55:43.170439Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_7_1_11346096038620304364_v1 response to read: guid# 35d23d07-cbad3fc1-6adc776b-b3e04285
2025-10-31T13:55:43.170641Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_7_1_11346096038620304364_v1 Process answer. Aval parts: 0
2025-10-31T13:55:43.171636Z :DEBUG: [] [] [62469704-a5dc4062-4187ee1e-3d4dce2f] [null] After sending read request: ReadSizeBudget = 2621440, ReadSizeServerDelta = 0
2025-10-31T13:55:43.171828Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_7_1_11346096038620304364_v1 grpc read done: success# 1, data# { read { } }
2025-10-31T13:55:43.171937Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_7_1_11346096038620304364_v1 got read request: guid# 578225ec-3cc2fa61-adbaa895-11d429fd
2025-10-31T13:55:43.199218Z node 8 :PERSQUEUE DEBUG: partition.cpp:2272: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T13:55:43.199269Z node 8 :PERSQUEUE DEBUG: partition.cpp:2281: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T13:55:43.199288Z node 8 :PERSQUEUE DEBUG: partition.cpp:2304: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T13:55:43.230260Z :INFO: [] MessageGroupId [source4] SessionId [source4|a718bc95-98ba1c6e-1079a8c3-5283e3f4_0] Write session will now close
2025-10-31T13:55:43.230329Z :DEBUG: [] MessageGroupId [source4] SessionId [source4|a718bc95-98ba1c6e-1079a8c3-5283e3f4_0] Write session: aborting
2025-10-31T13:55:43.230810Z :INFO: [] MessageGroupId [source4] SessionId [source4|a718bc95-98ba1c6e-1079a8c3-5283e3f4_0] Write session: gracefully shut down, all writes complete
2025-10-31T13:55:43.231211Z :DEBUG: [] MessageGroupId [source4] SessionId [source4|a718bc95-98ba1c6e-1079a8c3-5283e3f4_0] Write session: destroy
2025-10-31T13:55:43.231776Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 5 sessionId: source4|a718bc95-98ba1c6e-1079a8c3-5283e3f4_0 grpc read done: success: 0 data: 
2025-10-31T13:55:43.231801Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 5 sessionId: source4|a718bc95-98ba1c6e-1079a8c3-5283e3f4_0 grpc read failed
2025-10-31T13:55:43.231827Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 5 sessionId: source4|a718bc95-98ba1c6e-1079a8c3-5283e3f4_0 grpc closed
2025-10-31T13:55:43.231843Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 5 sessionId: source4|a718bc95-98ba1c6e-1079a8c3-5283e3f4_0 is DEAD
2025-10-31T13:55:43.232525Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-10-31T13:55:43.233561Z :DEBUG: [] MessageGroupId [source5] SessionId [] Write session: try to update token
2025-10-31T13:55:43.233354Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [7:7567384239479957313:2517] destroyed
2025-10-31T13:55:43.233423Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-10-31T13:55:43.233461Z node 8 :PERSQUEUE DEBUG: partition.cpp:2272: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T13:55:43.233477Z node 8 :PERSQUEUE DEBUG: partition.cpp:2281: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T13:55:43.233497Z node 8 :PERSQUEUE DEBUG: partition.cpp:2304: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T13:55:43.241216Z :INFO: [] MessageGroupId [source5] SessionId [] Write session: Do CDS request
2025-10-31T13:55:43.241249Z :INFO: [] MessageGroupId [source5] SessionId [] Start write session. Will connect to endpoint: localhost:27948
2025-10-31T13:55:43.249433Z node 7 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-31T13:55:43.249458Z node 7 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 6
2025-10-31T13:55:43.253090Z :DEBUG: [] MessageGroupId [source5] SessionId [] Write session: send init request: init_request { topic: "topic1" message_group_id: "source5" }
2025-10-31T13:55:43.254059Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 6 sessionId:  grpc read done: success: 1 data: init_request { topic: "topic1" message_group_id: "source5" }
2025-10-31T13:55:43.254206Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 6 topic: "topic1" message_group_id: "source5" from ipv6:[::1]:55092
2025-10-31T13:55:43.254232Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=6 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:55092 proto=v1  topic=topic1 durationSec=0
2025-10-31T13:55:43.254244Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-31T13:55:43.256035Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 6 sessionId:  describe result for acl check
2025-10-31T13:55:43.256149Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-31T13:55:43.256161Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-31T13:55:43.256173Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-31T13:55:43.256192Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [7:7567384239479957320:2521] (SourceId=source5, PreferedPartition=(NULL)) StartKqpSession
2025-10-31T13:55:43.263015Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [7:7567384239479957320:2521] (SourceId=source5, PreferedPartition=(NULL)) Select from the table
2025-10-31T13:55:43.276134Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [7:7567384239479957320:2521] (SourceId=source5, PreferedPartition=(NULL)) RequestPQRB
2025-10-31T13:55:43.278682Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1655: [72075186224037893][rt3.dc1--topic1] pipe [7:7567384239479957340:2521] connected; active server actors: 1
2025-10-31T13:55:43.279445Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [7:7567384239479957320:2521] (SourceId=source5, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=source5
2025-10-31T13:55:43.279470Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [7:7567384239479957320:2521] (SourceId=source5, PreferedPartition=(NULL)) Update the table
2025-10-31T13:55:43.281445Z node 7 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1659: [72075186224037893][rt3.dc1--topic1] pipe [7:7567384239479957340:2521] disconnected.
2025-10-31T13:55:43.281480Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1670: [72075186224037893][rt3.dc1--topic1] pipe [7:7567384239479957340:2521] disconnected; active server actors: 1
2025-10-31T13:55:43.281495Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1695: [72075186224037893][rt3.dc1--topic1] pipe [7:7567384239479957340:2521] disconnected no session
2025-10-31T13:55:43.297989Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [7:7567384239479957320:2521] (SourceId=source5, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-31T13:55:43.298029Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [7:7567384239479957320:2521] (SourceId=source5, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-10-31T13:55:43.298048Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [7:7567384239479957320:2521] (SourceId=source5, PreferedPartition=(NULL)) Start idle
2025-10-31T13:55:43.298080Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 6 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-31T13:55:43.299574Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 8, Generation: 1
2025-10-31T13:55:43.299527Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [7:7567384239479957355:2521], now have 1 active actors on pipe
2025-10-31T13:55:43.299586Z node 8 :PERSQUEUE DEBUG: partition.cpp:2272: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T13:55:43.299599Z node 8 :PERSQUEUE DEBUG: partition.cpp:2281: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T13:55:43.299612Z node 8 :PERSQUEUE DEBUG: partition.cpp:2304: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T13:55:43.299873Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T13:55:43.299903Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T13:55:43.299977Z node 8 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie source5|e510aff9-d9b5f0c-aa435684-41efee8a_0 generated for partition 0 topic 'rt3.dc1--topic1' owner source5
2025-10-31T13:55:43.300017Z node 8 :PERSQUEUE DEBUG: partition.cpp:2272: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T13:55:43.300033Z node 8 :PERSQUEUE DEBUG: partition.cpp:2281: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T13:55:43.300048Z node 8 :PERSQUEUE DEBUG: partition.cpp:2285: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-31T13:55:43.300087Z node 8 :PERSQUEUE DEBUG: partition.cpp:2304: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T13:55:43.300124Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-31T13:55:43.300174Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-31T13:55:43.305834Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T13:55:43.305881Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T13:55:43.305974Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-31T13:55:43.312406Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 6 partition: 0 MaxSeqNo: 0 sessionId: source5|e510aff9-d9b5f0c-aa435684-41efee8a_0
2025-10-31T13:55:43.317006Z :INFO: [] MessageGroupId [source5] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1761918943316 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-31T13:55:43.317133Z :INFO: [] MessageGroupId [source5] SessionId [] Write session established. Init response: session_id: "source5|e510aff9-d9b5f0c-aa435684-41efee8a_0" topic: "topic1" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-31T13:55:43.318492Z :DEBUG: [] MessageGroupId [source5] SessionId [source5|e510aff9-d9b5f0c-aa435684-41efee8a_0] Write 1 messages with Id from 1 to 1
2025-10-31T13:55:43.318586Z :INFO: [] MessageGroupId [source5] SessionId [source5|e510aff9-d9b5f0c-aa435684-41efee8a_0] Write session: close. Timeout = 10000 ms
2025-10-31T13:55:43.345418Z :DEBUG: [] MessageGroupId [source5] SessionId [source5|e510aff9-d9b5f0c-aa435684-41efee8a_0] Write session: try to update token
2025-10-31T13:55:43.345486Z :DEBUG: [] MessageGroupId [source5] SessionId [source5|e510aff9-d9b5f0c-aa435684-41efee8a_0] Send 1 message(s) (0 left), first sequence number is 1
2025-10-31T13:55:43.348957Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 6 sessionId: source5|e510aff9-d9b5f0c-aa435684-41efee8a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-31T13:55:43.349221Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-31T13:55:43.350408Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T13:55:43.350451Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T13:55:43.350522Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-31T13:55:43.351812Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-31T13:55:43.352271Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T13:55:43.352301Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T13:55:43.352356Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: '\0source5' SeqNo: 1 partNo : 0 messageNo: 1 size 1122 offset: -1
2025-10-31T13:55:43.352397Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-31T13:55:43.352440Z node 8 :PERSQUEUE DEBUG: partition.cpp:2272: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T13:55:43.352465Z node 8 :PERSQUEUE DEBUG: partition.cpp:2281: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T13:55:43.352478Z node 8 :PERSQUEUE DEBUG: partition.cpp:2285: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-31T13:55:43.352582Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId '\0source5' seqNo 1 partNo 0
2025-10-31T13:55:43.353563Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '\0source5' seqNo 1 partNo 0 FormedBlobsCount 0 NewHead: Offset 5 PartNo 0 PackedSize 1197 count 1 nextOffset 6 batches 1
2025-10-31T13:55:43.353601Z node 8 :PERSQUEUE DEBUG: partition.cpp:2304: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T13:55:43.354105Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 5,1 HeadOffset 5 endOffset 5 curOffset 6 d0000000000_00000000000000000005_00000_0000000001_00000? size 1185 WTime 1761918943349
2025-10-31T13:55:43.354254Z node 8 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-31T13:55:43.354368Z node 8 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 5 partNo 0 count 1 size 1185
2025-10-31T13:55:43.367990Z node 8 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 5 count 1 size 1185 actorID [8:7567384232061559767:2359]
2025-10-31T13:55:43.368059Z node 8 :PERSQUEUE DEBUG: partition.cpp:2099: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-31T13:55:43.368127Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1130 WriteNewSizeFromSupportivePartitions# 0
2025-10-31T13:55:43.368165Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-31T13:55:43.368203Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0source5', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 1, partNo: 0, Offset: 5 is stored on disk
2025-10-31T13:55:43.368429Z node 8 :PERSQUEUE DEBUG: partition.cpp:2272: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T13:55:43.368444Z node 8 :PERSQUEUE DEBUG: partition.cpp:2281: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T13:55:43.368457Z node 8 :PERSQUEUE DEBUG: partition.cpp:2304: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T13:55:43.368489Z node 8 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-31T13:55:43.368523Z node 8 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 5 partno 0 count 1 parts 0 suffix '63' size 1185
2025-10-31T13:55:43.368530Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 1  requestId: <none> cookie: 1
2025-10-31T13:55:43.368793Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 1 consumer shared/user session shared/user_7_1_11346096038620304364_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 5 EndOffset 5 newEndOffset 6 commitOffset 0 clientCommitOffset 0 cookie 6 readingFinished 0 firstRead 0
2025-10-31T13:55:43.368818Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-31T13:55:43.368825Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_7_1_11346096038620304364_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 5 endOffset 6
2025-10-31T13:55:43.368899Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_7_1_11346096038620304364_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 5, endOffset# 6, WTime# 1761918943157, sizeLag# 1185
2025-10-31T13:55:43.368916Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_7_1_11346096038620304364_v1TEvPartitionReady. Aval parts: 1
2025-10-31T13:55:43.368962Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_7_1_11346096038620304364_v1 performing read request: guid# 578225ec-3cc2fa61-adbaa895-11d429fd, from# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), count# 1, size# 1422, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-31T13:55:43.369009Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_7_1_11346096038620304364_v1 READ FROM TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1)maxCount 1 maxSize 1422 maxTimeLagMs 0 readTimestampMs 0 readOffset 5 EndOffset 6 ClientCommitOffset 0 committedOffset 0 Guid 578225ec-3cc2fa61-adbaa895-11d429fd
2025-10-31T13:55:43.369647Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T13:55:43.369719Z :DEBUG: [] MessageGroupId [source5] SessionId [source5|e510aff9-d9b5f0c-aa435684-41efee8a_0] Write session got write response: sequence_numbers: 1 offsets: 5 already_written: false write_statistics { persist_duration_ms: 16 }
2025-10-31T13:55:43.369684Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T13:55:43.369766Z :DEBUG: [] MessageGroupId [source5] SessionId [source5|e510aff9-d9b5f0c-aa435684-41efee8a_0] Write session: acknoledged message 1
2025-10-31T13:55:43.369784Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:883: [72075186224037892][Partition][0][StateIdle] read cookie 9 Topic 'rt3.dc1--topic1' partition 0 user user offset 5 count 1 size 1422 endOffset 6 max time lag 0ms effective offset 5
2025-10-31T13:55:43.370006Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:1097: [72075186224037892][Partition][0][StateIdle] read cookie 9 added 1 blobs, size 1185 count 1 last offset 5, current partition end offset: 6
2025-10-31T13:55:43.370029Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:1123: [72075186224037892][Partition][0][StateIdle] Reading cookie 9. Send blob request.
2025-10-31T13:55:43.370073Z node 8 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 5 partno 0 count 1 parts_count 0 source 1 size 1185 accessed 0 times before, last time 2025-10-31T13:55:43.000000Z
2025-10-31T13:55:43.370105Z node 8 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 9. All 1 blobs are from cache.
2025-10-31T13:55:43.370144Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:581: FormAnswer for 1 blobs
2025-10-31T13:55:43.370277Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 5 totakecount 1 count 1 size 1165 from pos 0 cbcount 1
2025-10-31T13:55:43.370376Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 5
2025-10-31T13:55:43.370523Z node 8 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 5 partno 0 count 1 parts 0 suffix '63'
2025-10-31T13:55:43.370887Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_7_1_11346096038620304364_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 6 Result { Offset: 5 Data: "... 1122 bytes ..." SourceId: "\000source5" SeqNo: 1 WriteTimestampMS: 1761918943349 CreateTimestampMS: 1761918943317 UncompressedSize: 1047552 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 20 RealReadOffset: 5 WaitQuotaTimeMs: 0 EndOffset: 6 StartOffset: 0 } Cookie: 5 }
2025-10-31T13:55:43.371026Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_7_1_11346096038620304364_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 7 from offset 6
2025-10-31T13:55:43.371065Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_7_1_11346096038620304364_v1 after read state TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 6 ReadOffset 6 ReadGuid 578225ec-3cc2fa61-adbaa895-11d429fd has messages 1
2025-10-31T13:55:43.371172Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_7_1_11346096038620304364_v1 read done: guid# 578225ec-3cc2fa61-adbaa895-11d429fd, partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), size# 1224
2025-10-31T13:55:43.371198Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_7_1_11346096038620304364_v1 response to read: guid# 578225ec-3cc2fa61-adbaa895-11d429fd
2025-10-31T13:55:43.371418Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_7_1_11346096038620304364_v1 Process answer. Aval parts: 0
2025-10-31T13:55:43.372314Z :DEBUG: [] [] [62469704-a5dc4062-4187ee1e-3d4dce2f] [null] After sending read request: ReadSizeBudget = 2621440, ReadSizeServerDelta = 0
2025-10-31T13:55:43.373681Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_7_1_11346096038620304364_v1 grpc read done: success# 1, data# { read { } }
2025-10-31T13:55:43.373807Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_7_1_11346096038620304364_v1 got read request: guid# 27c7d7e5-43a2fe84-b1d3800c-ef04317a
2025-10-31T13:55:43.400961Z node 8 :PERSQUEUE DEBUG: partition.cpp:2272: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T13:55:43.400996Z node 8 :PERSQUEUE DEBUG: partition.cpp:2281: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T13:55:43.401011Z node 8 :PERSQUEUE DEBUG: partition.cpp:2304: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T13:55:43.419640Z :INFO: [] MessageGroupId [source5] SessionId [source5|e510aff9-d9b5f0c-aa435684-41efee8a_0] Write session will now close
2025-10-31T13:55:43.419689Z :DEBUG: [] MessageGroupId [source5] SessionId [source5|e510aff9-d9b5f0c-aa435684-41efee8a_0] Write session: aborting
2025-10-31T13:55:43.420027Z :INFO: [] MessageGroupId [source5] SessionId [source5|e510aff9-d9b5f0c-aa435684-41efee8a_0] Write session: gracefully shut down, all writes complete
2025-10-31T13:55:43.420200Z :DEBUG: [] MessageGroupId [source5] SessionId [source5|e510aff9-d9b5f0c-aa435684-41efee8a_0] Write session: destroy
2025-10-31T13:55:43.425563Z :DEBUG: [] MessageGroupId [source6] SessionId [] Write session: try to update token
2025-10-31T13:55:43.429556Z :INFO: [] MessageGroupId [source6] SessionId [] Write session: Do CDS request
2025-10-31T13:55:43.429606Z :INFO: [] MessageGroupId [source6] SessionId [] Start write session. Will connect to endpoint: localhost:27948
2025-10-31T13:55:43.428936Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 6 sessionId: source5|e510aff9-d9b5f0c-aa435684-41efee8a_0 grpc read done: success: 0 data: 
2025-10-31T13:55:43.428967Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 6 sessionId: source5|e510aff9-d9b5f0c-aa435684-41efee8a_0 grpc read failed
2025-10-31T13:55:43.428999Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 6 sessionId: source5|e510aff9-d9b5f0c-aa435684-41efee8a_0 grpc closed
2025-10-31T13:55:43.429017Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 6 sessionId: source5|e510aff9-d9b5f0c-aa435684-41efee8a_0 is DEAD
2025-10-31T13:55:43.429899Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-10-31T13:55:43.430696Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [7:7567384239479957355:2521] destroyed
2025-10-31T13:55:43.430753Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-10-31T13:55:43.430786Z node 8 :PERSQUEUE DEBUG: partition.cpp:2272: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T13:55:43.430799Z node 8 :PERSQUEUE DEBUG: partition.cpp:2281: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T13:55:43.430816Z node 8 :PERSQUEUE DEBUG: partition.cpp:2304: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T13:55:43.441969Z node 7 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-31T13:55:43.441995Z node 7 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 7
2025-10-31T13:55:43.445096Z :DEBUG: [] MessageGroupId [source6] SessionId [] Write session: send init request: init_request { topic: "topic1" message_group_id: "source6" }
2025-10-31T13:55:43.447014Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 7 sessionId:  grpc read done: success: 1 data: init_request { topic: "topic1" message_group_id: "source6" }
2025-10-31T13:55:43.447161Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 7 topic: "topic1" message_group_id: "source6" from ipv6:[::1]:55092
2025-10-31T13:55:43.447181Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=7 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:55092 proto=v1  topic=topic1 durationSec=0
2025-10-31T13:55:43.447195Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-31T13:55:43.449169Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 7 sessionId:  describe result for acl check
2025-10-31T13:55:43.449325Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-31T13:55:43.449337Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-31T13:55:43.449351Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-31T13:55:43.449371Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [7:7567384239479957368:2525] (SourceId=source6, PreferedPartition=(NULL)) StartKqpSession
2025-10-31T13:55:43.452196Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [7:7567384239479957368:2525] (SourceId=source6, PreferedPartition=(NULL)) Select from the table
2025-10-31T13:55:43.478440Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [7:7567384239479957368:2525] (SourceId=source6, PreferedPartition=(NULL)) RequestPQRB
2025-10-31T13:55:43.479246Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1655: [72075186224037893][rt3.dc1--topic1] pipe [7:7567384239479957389:2525] connected; active server actors: 1
2025-10-31T13:55:43.479403Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [7:7567384239479957368:2525] (SourceId=source6, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=source6
2025-10-31T13:55:43.479425Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [7:7567384239479957368:2525] (SourceId=source6, PreferedPartition=(NULL)) Update the table
2025-10-31T13:55:43.480467Z node 7 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1659: [72075186224037893][rt3.dc1--topic1] pipe [7:7567384239479957389:2525] disconnected.
2025-10-31T13:55:43.480501Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1670: [72075186224037893][rt3.dc1--topic1] pipe [7:7567384239479957389:2525] disconnected; active server actors: 1
2025-10-31T13:55:43.480516Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1695: [72075186224037893][rt3.dc1--topic1] pipe [7:7567384239479957389:2525] disconnected no session
2025-10-31T13:55:43.501165Z node 8 :PERSQUEUE DEBUG: partition.cpp:2272: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T13:55:43.501203Z node 8 :PERSQUEUE DEBUG: partition.cpp:2281: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T13:55:43.501223Z node 8 :PERSQUEUE DEBUG: partition.cpp:2304: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T13:55:43.510562Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [7:7567384239479957368:2525] (SourceId=source6, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-31T13:55:43.510604Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [7:7567384239479957368:2525] (SourceId=source6, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-10-31T13:55:43.510624Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [7:7567384239479957368:2525] (SourceId=source6, PreferedPartition=(NULL)) Start idle
2025-10-31T13:55:43.510658Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 7 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-31T13:55:43.515596Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [7:7567384239479957403:2525], now have 1 active actors on pipe
2025-10-31T13:55:43.515694Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 8, Generation: 1
2025-10-31T13:55:43.516574Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T13:55:43.516616Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T13:55:43.516693Z node 8 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie source6|4b403848-f068851b-58175052-27e4ebf4_0 generated for partition 0 topic 'rt3.dc1--topic1' owner source6
2025-10-31T13:55:43.516729Z node 8 :PERSQUEUE DEBUG: partition.cpp:2272: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T13:55:43.516747Z node 8 :PERSQUEUE DEBUG: partition.cpp:2281: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T13:55:43.516761Z node 8 :PERSQUEUE DEBUG: partition.cpp:2285: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-31T13:55:43.516802Z node 8 :PERSQUEUE DEBUG: partition.cpp:2304: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T13:55:43.516861Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-31T13:55:43.516918Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-31T13:55:43.517835Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T13:55:43.517868Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T13:55:43.517950Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-31T13:55:43.518357Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 7 partition: 0 MaxSeqNo: 0 sessionId: source6|4b403848-f068851b-58175052-27e4ebf4_0
2025-10-31T13:55:43.521381Z :INFO: [] MessageGroupId [source6] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1761918943521 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-31T13:55:43.521501Z :INFO: [] MessageGroupId [source6] SessionId [] Write session established. Init response: session_id: "source6|4b403848-f068851b-58175052-27e4ebf4_0" topic: "topic1" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-31T13:55:43.522741Z :DEBUG: [] MessageGroupId [source6] SessionId [source6|4b403848-f068851b-58175052-27e4ebf4_0] Write 1 messages with Id from 1 to 1
2025-10-31T13:55:43.522845Z :INFO: [] MessageGroupId [source6] SessionId [source6|4b403848-f068851b-58175052-27e4ebf4_0] Write session: close. Timeout = 10000 ms
2025-10-31T13:55:43.548442Z :DEBUG: [] MessageGroupId [source6] SessionId [source6|4b403848-f068851b-58175052-27e4ebf4_0] Write session: try to update token
2025-10-31T13:55:43.548514Z :DEBUG: [] MessageGroupId [source6] SessionId [source6|4b403848-f068851b-58175052-27e4ebf4_0] Send 1 message(s) (0 left), first sequence number is 1
2025-10-31T13:55:43.553078Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 7 sessionId: source6|4b403848-f068851b-58175052-27e4ebf4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-31T13:55:43.553523Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-31T13:55:43.557329Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T13:55:43.557389Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T13:55:43.557479Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-31T13:55:43.557896Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-31T13:55:43.561005Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T13:55:43.561062Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T13:55:43.561133Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: '\0source6' SeqNo: 1 partNo : 0 messageNo: 1 size 1122 offset: -1
2025-10-31T13:55:43.561191Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-31T13:55:43.561246Z node 8 :PERSQUEUE DEBUG: partition.cpp:2272: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T13:55:43.561292Z node 8 :PERSQUEUE DEBUG: partition.cpp:2281: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T13:55:43.561309Z node 8 :PERSQUEUE DEBUG: partition.cpp:2285: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-31T13:55:43.561438Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId '\0source6' seqNo 1 partNo 0
2025-10-31T13:55:43.733829Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '\0source6' seqNo 1 partNo 0 FormedBlobsCount 0 NewHead: Offset 6 PartNo 0 PackedSize 1197 count 1 nextOffset 7 batches 1
2025-10-31T13:55:43.733907Z node 8 :PERSQUEUE DEBUG: partition.cpp:2304: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T13:55:43.734577Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 6,1 HeadOffset 6 endOffset 6 curOffset 7 d0000000000_00000000000000000006_00000_0000000001_00000? size 1185 WTime 1761918943734
2025-10-31T13:55:43.734816Z node 8 :PERSQUEUE DEBUG: partition.cpp:2251: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-31T13:55:43.734864Z node 8 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-31T13:55:43.735017Z node 8 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 6 partNo 0 count 1 size 1185
2025-10-31T13:55:43.754391Z node 8 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 6 count 1 size 1185 actorID [8:7567384232061559767:2359]
2025-10-31T13:55:43.754480Z node 8 :PERSQUEUE DEBUG: partition.cpp:2099: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-31T13:55:43.754552Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1130 WriteNewSizeFromSupportivePartitions# 0
2025-10-31T13:55:43.754599Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-31T13:55:43.754646Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0source6', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 1, partNo: 0, Offset: 6 is stored on disk
2025-10-31T13:55:43.754924Z node 8 :PERSQUEUE DEBUG: partition.cpp:2272: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T13:55:43.754945Z node 8 :PERSQUEUE DEBUG: partition.cpp:2281: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T13:55:43.754963Z node 8 :PERSQUEUE DEBUG: partition.cpp:2304: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T13:55:43.755003Z node 8 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-31T13:55:43.755052Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 1  requestId: <none> cookie: 1
2025-10-31T13:55:43.756581Z node 8 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 6 partno 0 count 1 parts 0 suffix '63' size 1185
2025-10-31T13:55:43.758443Z :DEBUG: [] MessageGroupId [source6] SessionId [source6|4b403848-f068851b-58175052-27e4ebf4_0] Write session got write response: sequence_numbers: 1 offsets: 6 already_written: false write_statistics { persist_duration_ms: 20 queued_in_partition_duration_ms: 172 }
2025-10-31T13:55:43.758494Z :DEBUG: [] MessageGroupId [source6] SessionId [source6|4b403848-f068851b-58175052-27e4ebf4_0] Write session: acknoledged message 1
2025-10-31T13:55:43.758527Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T13:55:43.758579Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T13:55:43.758733Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:883: [72075186224037892][Partition][0][StateIdle] read cookie 10 Topic 'rt3.dc1--topic1' partition 0 user user offset 6 count 1 size 1422 endOffset 7 max time lag 0ms effective offset 6
2025-10-31T13:55:43.759039Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:1097: [72075186224037892][Partition][0][StateIdle] read cookie 10 added 1 blobs, size 1185 count 1 last offset 6, current partition end offset: 7
2025-10-31T13:55:43.759064Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:1123: [72075186224037892][Partition][0][StateIdle] Reading cookie 10. Send blob request.
2025-10-31T13:55:43.759122Z node 8 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 6 partno 0 count 1 parts_count 0 source 1 size 1185 accessed 0 times before, last time 2025-10-31T13:55:43.000000Z
2025-10-31T13:55:43.759176Z node 8 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 10. All 1 blobs are from cache.
2025-10-31T13:55:43.759232Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:581: FormAnswer for 1 blobs
2025-10-31T13:55:43.759398Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 6 totakecount 1 count 1 size 1165 from pos 0 cbcount 1
2025-10-31T13:55:43.759518Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 6
2025-10-31T13:55:43.757150Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 1 consumer shared/user session shared/user_7_1_11346096038620304364_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 6 EndOffset 6 newEndOffset 7 commitOffset 0 clientCommitOffset 0 cookie 7 readingFinished 0 firstRead 0
2025-10-31T13:55:43.757194Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_7_1_11346096038620304364_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 6 endOffset 7
2025-10-31T13:55:43.757257Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-31T13:55:43.757701Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_7_1_11346096038620304364_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 6, endOffset# 7, WTime# 1761918943349, sizeLag# 1185
2025-10-31T13:55:43.757721Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_7_1_11346096038620304364_v1TEvPartitionReady. Aval parts: 1
2025-10-31T13:55:43.757767Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_7_1_11346096038620304364_v1 performing read request: guid# 27c7d7e5-43a2fe84-b1d3800c-ef04317a, from# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), count# 1, size# 1422, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-31T13:55:43.757817Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_7_1_11346096038620304364_v1 READ FROM TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1)maxCount 1 maxSize 1422 maxTimeLagMs 0 readTimestampMs 0 readOffset 6 EndOffset 7 ClientCommitOffset 0 committedOffset 0 Guid 27c7d7e5-43a2fe84-b1d3800c-ef04317a
2025-10-31T13:55:43.760965Z node 8 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 6 partno 0 count 1 parts 0 suffix '63'
2025-10-31T13:55:43.765187Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_7_1_11346096038620304364_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 7 Result { Offset: 6 Data: "... 1122 bytes ..." SourceId: "\000source6" SeqNo: 1 WriteTimestampMS: 1761918943560 CreateTimestampMS: 1761918943521 UncompressedSize: 1047552 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 20 RealReadOffset: 6 WaitQuotaTimeMs: 0 EndOffset: 7 StartOffset: 0 } Cookie: 6 }
2025-10-31T13:55:43.765369Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_7_1_11346096038620304364_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 8 from offset 7
2025-10-31T13:55:43.765413Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_7_1_11346096038620304364_v1 after read state TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 7 ReadOffset 7 ReadGuid 27c7d7e5-43a2fe84-b1d3800c-ef04317a has messages 1
2025-10-31T13:55:43.765560Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_7_1_11346096038620304364_v1 read done: guid# 27c7d7e5-43a2fe84-b1d3800c-ef04317a, partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), size# 1224
2025-10-31T13:55:43.765587Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_7_1_11346096038620304364_v1 response to read: guid# 27c7d7e5-43a2fe84-b1d3800c-ef04317a
2025-10-31T13:55:43.765840Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_7_1_11346096038620304364_v1 Process answer. Aval parts: 0
2025-10-31T13:55:43.767891Z :DEBUG: [] [] [62469704-a5dc4062-4187ee1e-3d4dce2f] [null] After sending read request: ReadSizeBudget = 2621440, ReadSizeServerDelta = 0
2025-10-31T13:55:43.773074Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_7_1_11346096038620304364_v1 grpc read done: success# 1, data# { read { } }
2025-10-31T13:55:43.773246Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_7_1_11346096038620304364_v1 got read request: guid# d8b309fd-e72e16f7-bf4d80bd-e91c1f26
2025-10-31T13:55:43.824913Z :INFO: [] MessageGroupId [source6] SessionId [source6|4b403848-f068851b-58175052-27e4ebf4_0] Write session will now close
2025-10-31T13:55:43.824975Z :DEBUG: [] MessageGroupId [source6] SessionId [source6|4b403848-f068851b-58175052-27e4ebf4_0] Write session: aborting
2025-10-31T13:55:43.825420Z :INFO: [] MessageGroupId [source6] SessionId [source6|4b403848-f068851b-58175052-27e4ebf4_0] Write session: gracefully shut down, all writes complete
2025-10-31T13:55:43.825610Z :DEBUG: [] MessageGroupId [source6] SessionId [source6|4b403848-f068851b-58175052-27e4ebf4_0] Write session: destroy
2025-10-31T13:55:43.830439Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 7 sessionId: source6|4b403848-f068851b-58175052-27e4ebf4_0 grpc read done: success: 0 data: 
2025-10-31T13:55:43.830463Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 7 sessionId: source6|4b403848-f068851b-58175052-27e4ebf4_0 grpc read failed
2025-10-31T13:55:43.830489Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 7 sessionId: source6|4b403848-f068851b-58175052-27e4ebf4_0 grpc closed
2025-10-31T13:55:43.830505Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 7 sessionId: source6|4b403848-f068851b-58175052-27e4ebf4_0 is DEAD
2025-10-31T13:55:43.831493Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-10-31T13:55:43.832237Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [7:7567384239479957403:2525] destroyed
2025-10-31T13:55:43.832293Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-10-31T13:55:43.832324Z node 8 :PERSQUEUE DEBUG: partition.cpp:2272: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T13:55:43.832339Z node 8 :PERSQUEUE DEBUG: partition.cpp:2281: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T13:55:43.832355Z node 8 :PERSQUEUE DEBUG: partition.cpp:2304: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T13:55:43.836732Z node 8 :PERSQUEUE DEBUG: partition.cpp:2272: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T13:55:43.836762Z node 8 :PERSQUEUE DEBUG: partition.cpp:2281: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T13:55:43.836776Z node 8 :PERSQUEUE DEBUG: partition.cpp:2304: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T13:55:43.837191Z :DEBUG: [] MessageGroupId [source7] SessionId [] Write session: try to update token
2025-10-31T13:55:43.837516Z :INFO: [] MessageGroupId [source7] SessionId [] Write session: Do CDS request
2025-10-31T13:55:43.837547Z :INFO: [] MessageGroupId [source7] SessionId [] Start write session. Will connect to endpoint: localhost:27948
2025-10-31T13:55:43.846306Z :DEBUG: [] MessageGroupId [source7] SessionId [] Write session: send init request: init_request { topic: "topic1" message_group_id: "source7" }
2025-10-31T13:55:43.849744Z node 7 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-31T13:55:43.849786Z node 7 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 8
2025-10-31T13:55:43.850168Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 8 sessionId:  grpc read done: success: 1 data: init_request { topic: "topic1" message_group_id: "source7" }
2025-10-31T13:55:43.850281Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 8 topic: "topic1" message_group_id: "source7" from ipv6:[::1]:55092
2025-10-31T13:55:43.850304Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=8 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:55092 proto=v1  topic=topic1 durationSec=0
2025-10-31T13:55:43.850316Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-31T13:55:43.858574Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 8 sessionId:  describe result for acl check
2025-10-31T13:55:43.858709Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-31T13:55:43.858721Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-31T13:55:43.858734Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-31T13:55:43.858753Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [7:7567384239479957418:2531] (SourceId=source7, PreferedPartition=(NULL)) StartKqpSession
2025-10-31T13:55:43.862194Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [7:7567384239479957418:2531] (SourceId=source7, PreferedPartition=(NULL)) Select from the table
2025-10-31T13:55:43.878575Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [7:7567384239479957418:2531] (SourceId=source7, PreferedPartition=(NULL)) RequestPQRB
2025-10-31T13:55:43.878947Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1655: [72075186224037893][rt3.dc1--topic1] pipe [7:7567384239479957437:2531] connected; active server actors: 1
2025-10-31T13:55:43.878994Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [7:7567384239479957418:2531] (SourceId=source7, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=source7
2025-10-31T13:55:43.879025Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [7:7567384239479957418:2531] (SourceId=source7, PreferedPartition=(NULL)) Update the table
2025-10-31T13:55:43.879390Z node 7 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1659: [72075186224037893][rt3.dc1--topic1] pipe [7:7567384239479957437:2531] disconnected.
2025-10-31T13:55:43.879419Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1670: [72075186224037893][rt3.dc1--topic1] pipe [7:7567384239479957437:2531] disconnected; active server actors: 1
2025-10-31T13:55:43.879435Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1695: [72075186224037893][rt3.dc1--topic1] pipe [7:7567384239479957437:2531] disconnected no session
2025-10-31T13:55:43.903059Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [7:7567384239479957418:2531] (SourceId=source7, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-31T13:55:43.903099Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [7:7567384239479957418:2531] (SourceId=source7, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-10-31T13:55:43.903119Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [7:7567384239479957418:2531] (SourceId=source7, PreferedPartition=(NULL)) Start idle
2025-10-31T13:55:43.903153Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 8 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-31T13:55:43.904453Z node 7 :FLAT_TX_SCHEMESHARD WARN: schemeshard_impl.cpp:7727: Cannot get console configs
2025-10-31T13:55:43.904465Z node 7 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
2025-10-31T13:55:43.905638Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [7:7567384239479957451:2531], now have 1 active actors on pipe
2025-10-31T13:55:43.906406Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T13:55:43.906443Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T13:55:43.906519Z node 8 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie source7|f214521c-bf3e2724-d9e34808-bb8223d7_0 generated for partition 0 topic 'rt3.dc1--topic1' owner source7
2025-10-31T13:55:43.906549Z node 8 :PERSQUEUE DEBUG: partition.cpp:2272: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T13:55:43.906567Z node 8 :PERSQUEUE DEBUG: partition.cpp:2281: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T13:55:43.906581Z node 8 :PERSQUEUE DEBUG: partition.cpp:2285: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-31T13:55:43.906620Z node 8 :PERSQUEUE DEBUG: partition.cpp:2304: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T13:55:43.906675Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-31T13:55:43.906724Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-31T13:55:43.907412Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T13:55:43.907439Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T13:55:43.907521Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-31T13:55:43.905584Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 8, Generation: 1
2025-10-31T13:55:43.907911Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 8 partition: 0 MaxSeqNo: 0 sessionId: source7|f214521c-bf3e2724-d9e34808-bb8223d7_0
2025-10-31T13:55:43.908684Z :INFO: [] MessageGroupId [source7] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1761918943908 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-31T13:55:43.908818Z :INFO: [] MessageGroupId [source7] SessionId [] Write session established. Init response: session_id: "source7|f214521c-bf3e2724-d9e34808-bb8223d7_0" topic: "topic1" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-31T13:55:43.913972Z :DEBUG: [] MessageGroupId [source7] SessionId [source7|f214521c-bf3e2724-d9e34808-bb8223d7_0] Write 1 messages with Id from 1 to 1
2025-10-31T13:55:43.914076Z :INFO: [] MessageGroupId [source7] SessionId [source7|f214521c-bf3e2724-d9e34808-bb8223d7_0] Write session: close. Timeout = 10000 ms
2025-10-31T13:55:43.935189Z :DEBUG: [] MessageGroupId [source7] SessionId [source7|f214521c-bf3e2724-d9e34808-bb8223d7_0] Write session: try to update token
2025-10-31T13:55:43.935256Z :DEBUG: [] MessageGroupId [source7] SessionId [source7|f214521c-bf3e2724-d9e34808-bb8223d7_0] Send 1 message(s) (0 left), first sequence number is 1
2025-10-31T13:55:43.936507Z node 8 :PERSQUEUE DEBUG: partition.cpp:2272: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T13:55:43.936542Z node 8 :PERSQUEUE DEBUG: partition.cpp:2281: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T13:55:43.936563Z node 8 :PERSQUEUE DEBUG: partition.cpp:2304: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T13:55:43.937360Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 8 sessionId: source7|f214521c-bf3e2724-d9e34808-bb8223d7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-31T13:55:43.937674Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-31T13:55:43.938274Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T13:55:43.938328Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T13:55:43.938427Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-31T13:55:43.945125Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-31T13:55:43.945712Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T13:55:43.945762Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T13:55:43.945824Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: '\0source7' SeqNo: 1 partNo : 0 messageNo: 1 size 1122 offset: -1
2025-10-31T13:55:43.945886Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-31T13:55:43.945950Z node 8 :PERSQUEUE DEBUG: partition.cpp:2272: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T13:55:43.945989Z node 8 :PERSQUEUE DEBUG: partition.cpp:2281: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T13:55:43.946004Z node 8 :PERSQUEUE DEBUG: partition.cpp:2285: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-31T13:55:43.946128Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId '\0source7' seqNo 1 partNo 0
2025-10-31T13:55:43.947021Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '\0source7' seqNo 1 partNo 0 FormedBlobsCount 0 NewHead: Offset 7 PartNo 0 PackedSize 1197 count 1 nextOffset 8 batches 1
2025-10-31T13:55:43.947061Z node 8 :PERSQUEUE DEBUG: partition.cpp:2304: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T13:55:43.947616Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 7,1 HeadOffset 7 endOffset 7 curOffset 8 d0000000000_00000000000000000007_00000_0000000001_00000? size 1185 WTime 1761918943947
2025-10-31T13:55:43.947777Z node 8 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-31T13:55:43.947899Z node 8 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 7 partNo 0 count 1 size 1185
2025-10-31T13:55:43.979568Z node 8 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 7 count 1 size 1185 actorID [8:7567384232061559767:2359]
2025-10-31T13:55:43.979655Z node 8 :PERSQUEUE DEBUG: partition.cpp:2099: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-31T13:55:43.979710Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1130 WriteNewSizeFromSupportivePartitions# 0
2025-10-31T13:55:43.979707Z node 8 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 7 partno 0 count 1 parts 0 suffix '63' size 1185
2025-10-31T13:55:43.979761Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-31T13:55:43.979801Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0source7', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 1, partNo: 0, Offset: 7 is stored on disk
2025-10-31T13:55:43.980026Z node 8 :PERSQUEUE DEBUG: partition.cpp:2272: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T13:55:43.980043Z node 8 :PERSQUEUE DEBUG: partition.cpp:2281: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T13:55:43.980056Z node 8 :PERSQUEUE DEBUG: partition.cpp:2304: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T13:55:43.980091Z node 8 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-31T13:55:43.980133Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 1  requestId: <none> cookie: 1
2025-10-31T13:55:43.985190Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 1 consumer shared/user session shared/user_7_1_11346096038620304364_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 7 EndOffset 7 newEndOffset 8 commitOffset 0 clientCommitOffset 0 cookie 8 readingFinished 0 firstRead 0
2025-10-31T13:55:43.985223Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_7_1_11346096038620304364_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 7 endOffset 8
2025-10-31T13:55:43.985275Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-31T13:55:43.985688Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_7_1_11346096038620304364_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 7, endOffset# 8, WTime# 1761918943560, sizeLag# 1185
2025-10-31T13:55:43.985705Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_7_1_11346096038620304364_v1TEvPartitionReady. Aval parts: 1
2025-10-31T13:55:43.985750Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_7_1_11346096038620304364_v1 performing read request: guid# d8b309fd-e72e16f7-bf4d80bd-e91c1f26, from# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), count# 1, size# 1422, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-31T13:55:43.985803Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_7_1_11346096038620304364_v1 READ FROM TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1)maxCount 1 maxSize 1422 maxTimeLagMs 0 readTimestampMs 0 readOffset 7 EndOffset 8 ClientCommitOffset 0 committedOffset 0 Guid d8b309fd-e72e16f7-bf4d80bd-e91c1f26
2025-10-31T13:55:43.986555Z :DEBUG: [] MessageGroupId [source7] SessionId [source7|f214521c-bf3e2724-d9e34808-bb8223d7_0] Write session got write response: sequence_numbers: 1 offsets: 7 already_written: false write_statistics { persist_duration_ms: 32 }
2025-10-31T13:55:43.986600Z :DEBUG: [] MessageGroupId [source7] SessionId [source7|f214521c-bf3e2724-d9e34808-bb8223d7_0] Write session: acknoledged message 1
2025-10-31T13:55:43.987163Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T13:55:43.987204Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T13:55:43.987318Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:883: [72075186224037892][Partition][0][StateIdle] read cookie 11 Topic 'rt3.dc1--topic1' partition 0 user user offset 7 count 1 size 1422 endOffset 8 max time lag 0ms effective offset 7
2025-10-31T13:55:43.987540Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:1097: [72075186224037892][Partition][0][StateIdle] read cookie 11 added 1 blobs, size 1185 count 1 last offset 7, current partition end offset: 8
2025-10-31T13:55:43.987560Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:1123: [72075186224037892][Partition][0][StateIdle] Reading cookie 11. Send blob request.
2025-10-31T13:55:43.987607Z node 8 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 7 partno 0 count 1 parts_count 0 source 1 size 1185 accessed 0 times before, last time 2025-10-31T13:55:43.000000Z
2025-10-31T13:55:43.987656Z node 8 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 11. All 1 blobs are from cache.
2025-10-31T13:55:43.987702Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:581: FormAnswer for 1 blobs
2025-10-31T13:55:43.987832Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 7 totakecount 1 count 1 size 1165 from pos 0 cbcount 1
2025-10-31T13:55:43.987931Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 7
2025-10-31T13:55:43.992973Z node 8 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 7 partno 0 count 1 parts 0 suffix '63'
2025-10-31T13:55:43.993573Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_7_1_11346096038620304364_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 8 Result { Offset: 7 Data: "... 1122 bytes ..." SourceId: "\000source7" SeqNo: 1 WriteTimestampMS: 1761918943946 CreateTimestampMS: 1761918943912 UncompressedSize: 1047552 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 20 RealReadOffset: 7 WaitQuotaTimeMs: 0 EndOffset: 8 StartOffset: 0 } Cookie: 7 }
2025-10-31T13:55:43.993734Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_7_1_11346096038620304364_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 9 from offset 8
2025-10-31T13:55:43.993775Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_7_1_11346096038620304364_v1 after read state TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 8 ReadOffset 8 ReadGuid d8b309fd-e72e16f7-bf4d80bd-e91c1f26 has messages 1
2025-10-31T13:55:43.993899Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_7_1_11346096038620304364_v1 read done: guid# d8b309fd-e72e16f7-bf4d80bd-e91c1f26, partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), size# 1224
2025-10-31T13:55:43.993929Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_7_1_11346096038620304364_v1 response to read: guid# d8b309fd-e72e16f7-bf4d80bd-e91c1f26
2025-10-31T13:55:43.994208Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_7_1_11346096038620304364_v1 Process answer. Aval parts: 0
2025-10-31T13:55:43.994976Z :DEBUG: [] [] [62469704-a5dc4062-4187ee1e-3d4dce2f] [null] After sending read request: ReadSizeBudget = 2621440, ReadSizeServerDelta = 0
2025-10-31T13:55:43.995511Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_7_1_11346096038620304364_v1 grpc read done: success# 1, data# { read { } }
2025-10-31T13:55:43.995620Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_7_1_11346096038620304364_v1 got read request: guid# e6107c2a-b11cec9f-4667fa50-84d88a10
2025-10-31T13:55:44.016915Z :INFO: [] MessageGroupId [source7] SessionId [source7|f214521c-bf3e2724-d9e34808-bb8223d7_0] Write session will now close
2025-10-31T13:55:44.016976Z :DEBUG: [] MessageGroupId [source7] SessionId [source7|f214521c-bf3e2724-d9e34808-bb8223d7_0] Write session: aborting
2025-10-31T13:55:44.017398Z :INFO: [] MessageGroupId [source7] SessionId [source7|f214521c-bf3e2724-d9e34808-bb8223d7_0] Write session: gracefully shut down, all writes complete
2025-10-31T13:55:44.017772Z :DEBUG: [] MessageGroupId [source7] SessionId [source7|f214521c-bf3e2724-d9e34808-bb8223d7_0] Write session: destroy
2025-10-31T13:55:44.025422Z :DEBUG: [] MessageGroupId [source8] SessionId [] Write session: try to update token
2025-10-31T13:55:44.025714Z :INFO: [] MessageGroupId [source8] SessionId [] Write session: Do CDS request
2025-10-31T13:55:44.025741Z :INFO: [] MessageGroupId [source8] SessionId [] Start write session. Will connect to endpoint: localhost:27948
2025-10-31T13:55:44.024973Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 8 sessionId: source7|f214521c-bf3e2724-d9e34808-bb8223d7_0 grpc read done: success: 0 data: 
2025-10-31T13:55:44.025014Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 8 sessionId: source7|f214521c-bf3e2724-d9e34808-bb8223d7_0 grpc read failed
2025-10-31T13:55:44.025048Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 8 sessionId: source7|f214521c-bf3e2724-d9e34808-bb8223d7_0 grpc closed
2025-10-31T13:55:44.025066Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 8 sessionId: source7|f214521c-bf3e2724-d9e34808-bb8223d7_0 is DEAD
2025-10-31T13:55:44.025872Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-10-31T13:55:44.027809Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [7:7567384239479957451:2531] destroyed
2025-10-31T13:55:44.027892Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-10-31T13:55:44.027939Z node 8 :PERSQUEUE DEBUG: partition.cpp:2272: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T13:55:44.027956Z node 8 :PERSQUEUE DEBUG: partition.cpp:2281: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T13:55:44.027977Z node 8 :PERSQUEUE DEBUG: partition.cpp:2304: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T13:55:44.031055Z :DEBUG: [] MessageGroupId [source8] SessionId [] Write session: send init request: init_request { topic: "topic1" message_group_id: "source8" }
2025-10-31T13:55:44.031672Z node 7 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-31T13:55:44.031701Z node 7 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 9
2025-10-31T13:55:44.036815Z node 8 :PERSQUEUE DEBUG: partition.cpp:2272: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T13:55:44.036856Z node 8 :PERSQUEUE DEBUG: partition.cpp:2281: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T13:55:44.036875Z node 8 :PERSQUEUE DEBUG: partition.cpp:2304: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T13:55:44.037088Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 9 sessionId:  grpc read done: success: 1 data: init_request { topic: "topic1" message_group_id: "source8" }
2025-10-31T13:55:44.037225Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 9 topic: "topic1" message_group_id: "source8" from ipv6:[::1]:55092
2025-10-31T13:55:44.037242Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=9 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:55092 proto=v1  topic=topic1 durationSec=0
2025-10-31T13:55:44.037253Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-31T13:55:44.038699Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 9 sessionId:  describe result for acl check
2025-10-31T13:55:44.038818Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-31T13:55:44.038832Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-31T13:55:44.038845Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-31T13:55:44.038864Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [7:7567384243774924770:2541] (SourceId=source8, PreferedPartition=(NULL)) StartKqpSession
2025-10-31T13:55:44.042254Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [7:7567384243774924770:2541] (SourceId=source8, PreferedPartition=(NULL)) Select from the table
2025-10-31T13:55:44.090706Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [7:7567384243774924770:2541] (SourceId=source8, PreferedPartition=(NULL)) RequestPQRB
2025-10-31T13:55:44.093656Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1655: [72075186224037893][rt3.dc1--topic1] pipe [7:7567384243774924789:2541] connected; active server actors: 1
2025-10-31T13:55:44.093837Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [7:7567384243774924770:2541] (SourceId=source8, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=source8
2025-10-31T13:55:44.093858Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [7:7567384243774924770:2541] (SourceId=source8, PreferedPartition=(NULL)) Update the table
2025-10-31T13:55:44.094853Z node 7 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1659: [72075186224037893][rt3.dc1--topic1] pipe [7:7567384243774924789:2541] disconnected.
2025-10-31T13:55:44.094877Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1670: [72075186224037893][rt3.dc1--topic1] pipe [7:7567384243774924789:2541] disconnected; active server actors: 1
2025-10-31T13:55:44.094890Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1695: [72075186224037893][rt3.dc1--topic1] pipe [7:7567384243774924789:2541] disconnected no session
2025-10-31T13:55:44.116545Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [7:7567384243774924770:2541] (SourceId=source8, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-31T13:55:44.116584Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [7:7567384243774924770:2541] (SourceId=source8, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-10-31T13:55:44.116601Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [7:7567384243774924770:2541] (SourceId=source8, PreferedPartition=(NULL)) Start idle
2025-10-31T13:55:44.116635Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 9 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-31T13:55:44.125105Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 8, Generation: 1
2025-10-31T13:55:44.124889Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [7:7567384243774924803:2541], now have 1 active actors on pipe
2025-10-31T13:55:44.126486Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T13:55:44.126508Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T13:55:44.126575Z node 8 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie source8|e1469495-1f1645ff-170531aa-268dcaae_0 generated for partition 0 topic 'rt3.dc1--topic1' owner source8
2025-10-31T13:55:44.126600Z node 8 :PERSQUEUE DEBUG: partition.cpp:2272: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T13:55:44.126618Z node 8 :PERSQUEUE DEBUG: partition.cpp:2281: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T13:55:44.126633Z node 8 :PERSQUEUE DEBUG: partition.cpp:2285: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-31T13:55:44.126673Z node 8 :PERSQUEUE DEBUG: partition.cpp:2304: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T13:55:44.126704Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-31T13:55:44.126738Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-31T13:55:44.130671Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 9 partition: 0 MaxSeqNo: 0 sessionId: source8|e1469495-1f1645ff-170531aa-268dcaae_0
2025-10-31T13:55:44.131395Z :INFO: [] MessageGroupId [source8] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1761918944131 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-31T13:55:44.131501Z :INFO: [] MessageGroupId [source8] SessionId [] Write session established. Init response: session_id: "source8|e1469495-1f1645ff-170531aa-268dcaae_0" topic: "topic1" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-31T13:55:44.132672Z :DEBUG: [] MessageGroupId [source8] SessionId [source8|e1469495-1f1645ff-170531aa-268dcaae_0] Write 1 messages with Id from 1 to 1
2025-10-31T13:55:44.132757Z :INFO: [] MessageGroupId [source8] SessionId [source8|e1469495-1f1645ff-170531aa-268dcaae_0] Write session: close. Timeout = 10000 ms
2025-10-31T13:55:44.130267Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T13:55:44.130307Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T13:55:44.130381Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-31T13:55:44.137158Z node 8 :PERSQUEUE DEBUG: partition.cpp:2272: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T13:55:44.137188Z node 8 :PERSQUEUE DEBUG: partition.cpp:2281: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T13:55:44.137202Z node 8 :PERSQUEUE DEBUG: partition.cpp:2304: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T13:55:44.150484Z :DEBUG: [] MessageGroupId [source8] SessionId [source8|e1469495-1f1645ff-170531aa-268dcaae_0] Write session: try to update token
2025-10-31T13:55:44.150538Z :DEBUG: [] MessageGroupId [source8] SessionId [source8|e1469495-1f1645ff-170531aa-268dcaae_0] Send 1 message(s) (0 left), first sequence number is 1
2025-10-31T13:55:44.151234Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 9 sessionId: source8|e1469495-1f1645ff-170531aa-268dcaae_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-31T13:55:44.151490Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-31T13:55:44.152098Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T13:55:44.152141Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T13:55:44.152207Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-31T13:55:44.152818Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-31T13:55:44.153498Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T13:55:44.153554Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T13:55:44.153632Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: '\0source8' SeqNo: 1 partNo : 0 messageNo: 1 size 1122 offset: -1
2025-10-31T13:55:44.153682Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-31T13:55:44.153749Z node 8 :PERSQUEUE DEBUG: partition.cpp:2272: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T13:55:44.153779Z node 8 :PERSQUEUE DEBUG: partition.cpp:2281: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T13:55:44.153794Z node 8 :PERSQUEUE DEBUG: partition.cpp:2285: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-31T13:55:44.153919Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId '\0source8' seqNo 1 partNo 0
2025-10-31T13:55:44.154851Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '\0source8' seqNo 1 partNo 0 FormedBlobsCount 0 NewHead: Offset 8 PartNo 0 PackedSize 1197 count 1 nextOffset 9 batches 1
2025-10-31T13:55:44.154900Z node 8 :PERSQUEUE DEBUG: partition.cpp:2304: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T13:55:44.155524Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 8,1 HeadOffset 8 endOffset 8 curOffset 9 d0000000000_00000000000000000008_00000_0000000001_00000? size 1185 WTime 1761918944152
2025-10-31T13:55:44.155731Z node 8 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-31T13:55:44.155871Z node 8 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 8 partNo 0 count 1 size 1185
2025-10-31T13:55:44.167316Z node 8 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 8 count 1 size 1185 actorID [8:7567384232061559767:2359]
2025-10-31T13:55:44.167383Z node 8 :PERSQUEUE DEBUG: partition.cpp:2099: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-31T13:55:44.167435Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1130 WriteNewSizeFromSupportivePartitions# 0
2025-10-31T13:55:44.167472Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-31T13:55:44.167509Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0source8', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 1, partNo: 0, Offset: 8 is stored on disk
2025-10-31T13:55:44.167715Z node 8 :PERSQUEUE DEBUG: partition.cpp:2272: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T13:55:44.167729Z node 8 :PERSQUEUE DEBUG: partition.cpp:2281: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T13:55:44.167740Z node 8 :PERSQUEUE DEBUG: partition.cpp:2304: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T13:55:44.167774Z node 8 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-31T13:55:44.167811Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 1  requestId: <none> cookie: 1
2025-10-31T13:55:44.168176Z node 8 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 8 partno 0 count 1 parts 0 suffix '63' size 1185
2025-10-31T13:55:44.168473Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 1 consumer shared/user session shared/user_7_1_11346096038620304364_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 8 EndOffset 8 newEndOffset 9 commitOffset 0 clientCommitOffset 0 cookie 9 readingFinished 0 firstRead 0
2025-10-31T13:55:44.168513Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_7_1_11346096038620304364_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 8 endOffset 9
2025-10-31T13:55:44.168571Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-31T13:55:44.169786Z :DEBUG: [] MessageGroupId [source8] SessionId [source8|e1469495-1f1645ff-170531aa-268dcaae_0] Write session got write response: sequence_numbers: 1 offsets: 8 already_written: false write_statistics { persist_duration_ms: 11 }
2025-10-31T13:55:44.169826Z :DEBUG: [] MessageGroupId [source8] SessionId [source8|e1469495-1f1645ff-170531aa-268dcaae_0] Write session: acknoledged message 1
2025-10-31T13:55:44.170294Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T13:55:44.170328Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T13:55:44.170429Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:883: [72075186224037892][Partition][0][StateIdle] read cookie 12 Topic 'rt3.dc1--topic1' partition 0 user user offset 8 count 1 size 1422 endOffset 9 max time lag 0ms effective offset 8
2025-10-31T13:55:44.170628Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:1097: [72075186224037892][Partition][0][StateIdle] read cookie 12 added 1 blobs, size 1185 count 1 last offset 8, current partition end offset: 9
2025-10-31T13:55:44.170645Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:1123: [72075186224037892][Partition][0][StateIdle] Reading cookie 12. Send blob request.
2025-10-31T13:55:44.170686Z node 8 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 8 partno 0 count 1 parts_count 0 source 1 size 1185 accessed 0 times before, last time 2025-10-31T13:55:44.000000Z
2025-10-31T13:55:44.170717Z node 8 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 12. All 1 blobs are from cache.
2025-10-31T13:55:44.170757Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:581: FormAnswer for 1 blobs
2025-10-31T13:55:44.170908Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 8 totakecount 1 count 1 size 1165 from pos 0 cbcount 1
2025-10-31T13:55:44.171002Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 8
2025-10-31T13:55:44.171425Z node 8 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 8 partno 0 count 1 parts 0 suffix '63'
2025-10-31T13:55:44.169082Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_7_1_11346096038620304364_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 8, endOffset# 9, WTime# 1761918943946, sizeLag# 1185
2025-10-31T13:55:44.169114Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_7_1_11346096038620304364_v1TEvPartitionReady. Aval parts: 1
2025-10-31T13:55:44.169168Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_7_1_11346096038620304364_v1 performing read request: guid# e6107c2a-b11cec9f-4667fa50-84d88a10, from# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), count# 1, size# 1422, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-31T13:55:44.169217Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_7_1_11346096038620304364_v1 READ FROM TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1)maxCount 1 maxSize 1422 maxTimeLagMs 0 readTimestampMs 0 readOffset 8 EndOffset 9 ClientCommitOffset 0 committedOffset 0 Guid e6107c2a-b11cec9f-4667fa50-84d88a10
2025-10-31T13:55:44.171828Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_7_1_11346096038620304364_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 9 Result { Offset: 8 Data: "... 1122 bytes ..." SourceId: "\000source8" SeqNo: 1 WriteTimestampMS: 1761918944152 CreateTimestampMS: 1761918944131 UncompressedSize: 1047552 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 20 RealReadOffset: 8 WaitQuotaTimeMs: 0 EndOffset: 9 StartOffset: 0 } Cookie: 8 }
2025-10-31T13:55:44.171951Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_7_1_11346096038620304364_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 10 from offset 9
2025-10-31T13:55:44.173234Z :DEBUG: [] [] [62469704-a5dc4062-4187ee1e-3d4dce2f] [null] After sending read request: ReadSizeBudget = 2621440, ReadSizeServerDelta = 0
2025-10-31T13:55:44.171990Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_7_1_11346096038620304364_v1 after read state TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 9 ReadOffset 9 ReadGuid e6107c2a-b11cec9f-4667fa50-84d88a10 has messages 1
2025-10-31T13:55:44.172096Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_7_1_11346096038620304364_v1 read done: guid# e6107c2a-b11cec9f-4667fa50-84d88a10, partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), size# 1224
2025-10-31T13:55:44.172120Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_7_1_11346096038620304364_v1 response to read: guid# e6107c2a-b11cec9f-4667fa50-84d88a10
2025-10-31T13:55:44.172334Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_7_1_11346096038620304364_v1 Process answer. Aval parts: 0
2025-10-31T13:55:44.173819Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_7_1_11346096038620304364_v1 grpc read done: success# 1, data# { read { } }
2025-10-31T13:55:44.173942Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_7_1_11346096038620304364_v1 got read request: guid# f5b15461-b75f22b-d4c8837a-5fa56ab7
2025-10-31T13:55:44.232908Z :INFO: [] MessageGroupId [source8] SessionId [source8|e1469495-1f1645ff-170531aa-268dcaae_0] Write session will now close
2025-10-31T13:55:44.232970Z :DEBUG: [] MessageGroupId [source8] SessionId [source8|e1469495-1f1645ff-170531aa-268dcaae_0] Write session: aborting
2025-10-31T13:55:44.233420Z :INFO: [] MessageGroupId [source8] SessionId [source8|e1469495-1f1645ff-170531aa-268dcaae_0] Write session: gracefully shut down, all writes complete
2025-10-31T13:55:44.234809Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 9 sessionId: source8|e1469495-1f1645ff-170531aa-268dcaae_0 grpc read done: success: 0 data: 
2025-10-31T13:55:44.234839Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 9 sessionId: source8|e1469495-1f1645ff-170531aa-268dcaae_0 grpc read failed
2025-10-31T13:55:44.234879Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 9 sessionId: source8|e1469495-1f1645ff-170531aa-268dcaae_0 grpc closed
2025-10-31T13:55:44.234894Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 9 sessionId: source8|e1469495-1f1645ff-170531aa-268dcaae_0 is DEAD
2025-10-31T13:55:44.235609Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-10-31T13:55:44.236210Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [7:7567384243774924803:2541] destroyed
2025-10-31T13:55:44.236259Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-10-31T13:55:44.236293Z node 8 :PERSQUEUE DEBUG: partition.cpp:2272: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T13:55:44.236309Z node 8 :PERSQUEUE DEBUG: partition.cpp:2281: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T13:55:44.236325Z node 8 :PERSQUEUE DEBUG: partition.cpp:2304: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T13:55:44.241004Z :DEBUG: [] MessageGroupId [source8] SessionId [source8|e1469495-1f1645ff-170531aa-268dcaae_0] Write session: destroy
2025-10-31T13:55:44.240989Z node 8 :PERSQUEUE DEBUG: partition.cpp:2272: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T13:55:44.241023Z node 8 :PERSQUEUE DEBUG: partition.cpp:2281: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T13:55:44.241037Z node 8 :PERSQUEUE DEBUG: partition.cpp:2304: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T13:55:44.249314Z :DEBUG: [] MessageGroupId [source9] SessionId [] Write session: try to update token
2025-10-31T13:55:44.249687Z :INFO: [] MessageGroupId [source9] SessionId [] Write session: Do CDS request
2025-10-31T13:55:44.249736Z :INFO: [] MessageGroupId [source9] SessionId [] Start write session. Will connect to endpoint: localhost:27948
2025-10-31T13:55:44.255206Z :DEBUG: [] MessageGroupId [source9] SessionId [] Write session: send init request: init_request { topic: "topic1" message_group_id: "source9" }
2025-10-31T13:55:44.262385Z node 7 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-31T13:55:44.262419Z node 7 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 10
2025-10-31T13:55:44.265143Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 10 sessionId:  grpc read done: success: 1 data: init_request { topic: "topic1" message_group_id: "source9" }
2025-10-31T13:55:44.265311Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 10 topic: "topic1" message_group_id: "source9" from ipv6:[::1]:55092
2025-10-31T13:55:44.265334Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=10 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:55092 proto=v1  topic=topic1 durationSec=0
2025-10-31T13:55:44.265348Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-31T13:55:44.267175Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 10 sessionId:  describe result for acl check
2025-10-31T13:55:44.267327Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-31T13:55:44.267342Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-31T13:55:44.267357Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-31T13:55:44.267375Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [7:7567384243774924812:2545] (SourceId=source9, PreferedPartition=(NULL)) StartKqpSession
2025-10-31T13:55:44.270770Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [7:7567384243774924812:2545] (SourceId=source9, PreferedPartition=(NULL)) Select from the table
2025-10-31T13:55:44.294615Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [7:7567384243774924812:2545] (SourceId=source9, PreferedPartition=(NULL)) RequestPQRB
2025-10-31T13:55:44.295764Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1655: [72075186224037893][rt3.dc1--topic1] pipe [7:7567384243774924831:2545] connected; active server actors: 1
2025-10-31T13:55:44.295871Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [7:7567384243774924812:2545] (SourceId=source9, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=source9
2025-10-31T13:55:44.295888Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [7:7567384243774924812:2545] (SourceId=source9, PreferedPartition=(NULL)) Update the table
2025-10-31T13:55:44.296890Z node 7 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1659: [72075186224037893][rt3.dc1--topic1] pipe [7:7567384243774924831:2545] disconnected.
2025-10-31T13:55:44.296922Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1670: [72075186224037893][rt3.dc1--topic1] pipe [7:7567384243774924831:2545] disconnected; active server actors: 1
2025-10-31T13:55:44.296939Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1695: [72075186224037893][rt3.dc1--topic1] pipe [7:7567384243774924831:2545] disconnected no session
2025-10-31T13:55:44.312646Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [7:7567384243774924845:2545], now have 1 active actors on pipe
2025-10-31T13:55:44.309725Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [7:7567384243774924812:2545] (SourceId=source9, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-31T13:55:44.309770Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [7:7567384243774924812:2545] (SourceId=source9, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-10-31T13:55:44.309796Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [7:7567384243774924812:2545] (SourceId=source9, PreferedPartition=(NULL)) Start idle
2025-10-31T13:55:44.309842Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 10 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-31T13:55:44.314895Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T13:55:44.314937Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T13:55:44.315018Z node 8 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie source9|281a78a0-84b38b50-3bc9a70a-fc4d9c73_0 generated for partition 0 topic 'rt3.dc1--topic1' owner source9
2025-10-31T13:55:44.315052Z node 8 :PERSQUEUE DEBUG: partition.cpp:2272: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T13:55:44.315068Z node 8 :PERSQUEUE DEBUG: partition.cpp:2281: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T13:55:44.315082Z node 8 :PERSQUEUE DEBUG: partition.cpp:2285: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-31T13:55:44.315126Z node 8 :PERSQUEUE DEBUG: partition.cpp:2304: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T13:55:44.315171Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-31T13:55:44.315222Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-31T13:55:44.313660Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 8, Generation: 1
2025-10-31T13:55:44.321162Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T13:55:44.321907Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 10 partition: 0 MaxSeqNo: 0 sessionId: source9|281a78a0-84b38b50-3bc9a70a-fc4d9c73_0
2025-10-31T13:55:44.321214Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T13:55:44.321329Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-31T13:55:44.325413Z :INFO: [] MessageGroupId [source9] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1761918944325 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-31T13:55:44.325517Z :INFO: [] MessageGroupId [source9] SessionId [] Write session established. Init response: session_id: "source9|281a78a0-84b38b50-3bc9a70a-fc4d9c73_0" topic: "topic1" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-31T13:55:44.326790Z :DEBUG: [] MessageGroupId [source9] SessionId [source9|281a78a0-84b38b50-3bc9a70a-fc4d9c73_0] Write 1 messages with Id from 1 to 1
2025-10-31T13:55:44.326877Z :INFO: [] MessageGroupId [source9] SessionId [source9|281a78a0-84b38b50-3bc9a70a-fc4d9c73_0] Write session: close. Timeout = 10000 ms
2025-10-31T13:55:44.346846Z :DEBUG: [] MessageGroupId [source9] SessionId [source9|281a78a0-84b38b50-3bc9a70a-fc4d9c73_0] Write session: try to update token
2025-10-31T13:55:44.346912Z :DEBUG: [] MessageGroupId [source9] SessionId [source9|281a78a0-84b38b50-3bc9a70a-fc4d9c73_0] Send 1 message(s) (0 left), first sequence number is 1
2025-10-31T13:55:44.347334Z node 8 :PERSQUEUE DEBUG: partition.cpp:2272: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T13:55:44.347377Z node 8 :PERSQUEUE DEBUG: partition.cpp:2281: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T13:55:44.347398Z node 8 :PERSQUEUE DEBUG: partition.cpp:2304: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T13:55:44.353146Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 10 sessionId: source9|281a78a0-84b38b50-3bc9a70a-fc4d9c73_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-31T13:55:44.353442Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-31T13:55:44.356326Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T13:55:44.356387Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T13:55:44.356483Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-31T13:55:44.358216Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-31T13:55:44.358666Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T13:55:44.358718Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T13:55:44.358795Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: '\0source9' SeqNo: 1 partNo : 0 messageNo: 1 size 1122 offset: -1
2025-10-31T13:55:44.358866Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-31T13:55:44.358924Z node 8 :PERSQUEUE DEBUG: partition.cpp:2272: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T13:55:44.358955Z node 8 :PERSQUEUE DEBUG: partition.cpp:2281: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T13:55:44.358973Z node 8 :PERSQUEUE DEBUG: partition.cpp:2285: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-31T13:55:44.359112Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId '\0source9' seqNo 1 partNo 0
2025-10-31T13:55:44.360091Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '\0source9' seqNo 1 partNo 0 FormedBlobsCount 0 NewHead: Offset 9 PartNo 0 PackedSize 1197 count 1 nextOffset 10 batches 1
2025-10-31T13:55:44.360160Z node 8 :PERSQUEUE DEBUG: partition.cpp:2304: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T13:55:44.361640Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 9,1 HeadOffset 9 endOffset 9 curOffset 10 d0000000000_00000000000000000009_00000_0000000001_00000? size 1185 WTime 1761918944361
2025-10-31T13:55:44.361850Z node 8 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-31T13:55:44.362006Z node 8 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 9 partNo 0 count 1 size 1185
2025-10-31T13:55:44.370584Z node 8 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 9 count 1 size 1185 actorID [8:7567384232061559767:2359]
2025-10-31T13:55:44.370672Z node 8 :PERSQUEUE DEBUG: partition.cpp:2099: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-31T13:55:44.370740Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1130 WriteNewSizeFromSupportivePartitions# 0
2025-10-31T13:55:44.370787Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-31T13:55:44.370837Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0source9', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 1, partNo: 0, Offset: 9 is stored on disk
2025-10-31T13:55:44.371115Z node 8 :PERSQUEUE DEBUG: partition.cpp:2272: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T13:55:44.371135Z node 8 :PERSQUEUE DEBUG: partition.cpp:2281: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T13:55:44.371148Z node 8 :PERSQUEUE DEBUG: partition.cpp:2304: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T13:55:44.371186Z node 8 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-31T13:55:44.371237Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 1  requestId: <none> cookie: 1
2025-10-31T13:55:44.371288Z node 8 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 9 partno 0 count 1 parts 0 suffix '63' size 1185
2025-10-31T13:55:44.373099Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 1 consumer shared/user session shared/user_7_1_11346096038620304364_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 9 EndOffset 9 newEndOffset 10 commitOffset 0 clientCommitOffset 0 cookie 10 readingFinished 0 firstRead 0
2025-10-31T13:55:44.373138Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_7_1_11346096038620304364_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 9 endOffset 10
2025-10-31T13:55:44.373199Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-31T13:55:44.373609Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_7_1_11346096038620304364_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 9, endOffset# 10, WTime# 1761918944152, sizeLag# 1185
2025-10-31T13:55:44.373633Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_7_1_11346096038620304364_v1TEvPartitionReady. Aval parts: 1
2025-10-31T13:55:44.373679Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_7_1_11346096038620304364_v1 performing read request: guid# f5b15461-b75f22b-d4c8837a-5fa56ab7, from# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), count# 1, size# 1422, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-31T13:55:44.373728Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_7_1_11346096038620304364_v1 READ FROM TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1)maxCount 1 maxSize 1422 maxTimeLagMs 0 readTimestampMs 0 readOffset 9 EndOffset 10 ClientCommitOffset 0 committedOffset 0 Guid f5b15461-b75f22b-d4c8837a-5fa56ab7
2025-10-31T13:55:44.374235Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T13:55:44.374276Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T13:55:44.374407Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:883: [72075186224037892][Partition][0][StateIdle] read cookie 13 Topic 'rt3.dc1--topic1' partition 0 user user offset 9 count 1 size 1422 endOffset 10 max time lag 0ms effective offset 9
2025-10-31T13:55:44.374676Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:1097: [72075186224037892][Partition][0][StateIdle] read cookie 13 added 1 blobs, size 1185 count 1 last offset 9, current partition end offset: 10
2025-10-31T13:55:44.374692Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:1123: [72075186224037892][Partition][0][StateIdle] Reading cookie 13. Send blob request.
2025-10-31T13:55:44.374738Z node 8 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 9 partno 0 count 1 parts_count 0 source 1 size 1185 accessed 0 times before, last time 2025-10-31T13:55:44.000000Z
2025-10-31T13:55:44.374798Z node 8 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 13. All 1 blobs are from cache.
2025-10-31T13:55:44.374866Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:581: FormAnswer for 1 blobs
2025-10-31T13:55:44.374867Z node 8 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 9 partno 0 count 1 parts 0 suffix '63'
2025-10-31T13:55:44.375056Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 9 totakecount 1 count 1 size 1165 from pos 0 cbcount 1
2025-10-31T13:55:44.375150Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 9
2025-10-31T13:55:44.375688Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_7_1_11346096038620304364_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 10 Result { Offset: 9 Data: "... 1122 bytes ..." SourceId: "\000source9" SeqNo: 1 WriteTimestampMS: 1761918944357 CreateTimestampMS: 1761918944325 UncompressedSize: 1047552 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 20 RealReadOffset: 9 WaitQuotaTimeMs: 0 EndOffset: 10 StartOffset: 0 } Cookie: 9 }
2025-10-31T13:55:44.375813Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_7_1_11346096038620304364_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 11 from offset 10
2025-10-31T13:55:44.375865Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_7_1_11346096038620304364_v1 after read state TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 10 ReadOffset 10 ReadGuid f5b15461-b75f22b-d4c8837a-5fa56ab7 has messages 1
2025-10-31T13:55:44.375991Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_7_1_11346096038620304364_v1 read done: guid# f5b15461-b75f22b-d4c8837a-5fa56ab7, partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), size# 1224
2025-10-31T13:55:44.376026Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_7_1_11346096038620304364_v1 response to read: guid# f5b15461-b75f22b-d4c8837a-5fa56ab7
2025-10-31T13:55:44.376236Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_7_1_11346096038620304364_v1 Process answer. Aval parts: 0
2025-10-31T13:55:44.381103Z :DEBUG: [] MessageGroupId [source9] SessionId [source9|281a78a0-84b38b50-3bc9a70a-fc4d9c73_0] Write session got write response: sequence_numbers: 1 offsets: 9 already_written: false write_statistics { persist_duration_ms: 12 }
2025-10-31T13:55:44.381154Z :DEBUG: [] MessageGroupId [source9] SessionId [source9|281a78a0-84b38b50-3bc9a70a-fc4d9c73_0] Write session: acknoledged message 1
2025-10-31T13:55:44.381681Z :DEBUG: [] [] [62469704-a5dc4062-4187ee1e-3d4dce2f] [null] After sending read request: ReadSizeBudget = 2621440, ReadSizeServerDelta = 0
2025-10-31T13:55:44.383444Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_7_1_11346096038620304364_v1 grpc read done: success# 1, data# { read { } }
2025-10-31T13:55:44.383697Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_7_1_11346096038620304364_v1 got read request: guid# d4724bd4-469ade9-90491d86-434b05fd
2025-10-31T13:55:44.428940Z :INFO: [] MessageGroupId [source9] SessionId [source9|281a78a0-84b38b50-3bc9a70a-fc4d9c73_0] Write session will now close
2025-10-31T13:55:44.429008Z :DEBUG: [] MessageGroupId [source9] SessionId [source9|281a78a0-84b38b50-3bc9a70a-fc4d9c73_0] Write session: aborting
2025-10-31T13:55:44.429472Z :INFO: [] MessageGroupId [source9] SessionId [source9|281a78a0-84b38b50-3bc9a70a-fc4d9c73_0] Write session: gracefully shut down, all writes complete
2025-10-31T13:55:44.429830Z :DEBUG: [] MessageGroupId [source9] SessionId [source9|281a78a0-84b38b50-3bc9a70a-fc4d9c73_0] Write session: destroy
2025-10-31T13:55:44.435161Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [7:7567384243774924845:2545] destroyed
2025-10-31T13:55:44.435212Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-10-31T13:55:44.435245Z node 8 :PERSQUEUE DEBUG: partition.cpp:2272: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T13:55:44.435260Z node 8 :PERSQUEUE DEBUG: partition.cpp:2281: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T13:55:44.435276Z node 8 :PERSQUEUE DEBUG: partition.cpp:2304: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T13:55:44.433570Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 10 sessionId: source9|281a78a0-84b38b50-3bc9a70a-fc4d9c73_0 grpc read done: success: 0 data: 
2025-10-31T13:55:44.433608Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 10 sessionId: source9|281a78a0-84b38b50-3bc9a70a-fc4d9c73_0 grpc read failed
2025-10-31T13:55:44.433642Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 10 sessionId: source9|281a78a0-84b38b50-3bc9a70a-fc4d9c73_0 grpc closed
2025-10-31T13:55:44.433659Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 10 sessionId: source9|281a78a0-84b38b50-3bc9a70a-fc4d9c73_0 is DEAD
2025-10-31T13:55:44.434459Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-10-31T13:55:44.445738Z node 8 :PERSQUEUE DEBUG: partition.cpp:2272: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T13:55:44.445774Z node 8 :PERSQUEUE DEBUG: partition.cpp:2281: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T13:55:44.445789Z node 8 :PERSQUEUE DEBUG: partition.cpp:2304: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T13:55:44.462108Z :DEBUG: [] Decompression task done. Partition/PartitionSessionId: 0 (0-0)
2025-10-31T13:55:44.465711Z :DEBUG: [] Decompression task done. Partition/PartitionSessionId: 0 (1-1)
2025-10-31T13:55:44.519309Z :DEBUG: [] Decompression task done. Partition/PartitionSessionId: 0 (2-2)
2025-10-31T13:55:44.552563Z node 8 :PERSQUEUE DEBUG: partition.cpp:2272: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T13:55:44.552601Z node 8 :PERSQUEUE DEBUG: partition.cpp:2281: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T13:55:44.552616Z node 8 :PERSQUEUE DEBUG: partition.cpp:2304: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T13:55:44.652108Z node 8 :PERSQUEUE DEBUG: partition.cpp:2272: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T13:55:44.652143Z node 8 :PERSQUEUE DEBUG: partition.cpp:2281: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T13:55:44.652160Z node 8 :PERSQUEUE DEBUG: partition.cpp:2304: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T13:55:44.751652Z node 8 :PERSQUEUE DEBUG: partition.cpp:2272: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T13:55:44.751702Z node 8 :PERSQUEUE DEBUG: partition.cpp:2281: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T13:55:44.751720Z node 8 :PERSQUEUE DEBUG: partition.cpp:2304: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T13:55:44.853074Z node 8 :PERSQUEUE DEBUG: partition.cpp:2272: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T13:55:44.853119Z node 8 :PERSQUEUE DEBUG: partition.cpp:2281: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T13:55:44.853140Z node 8 :PERSQUEUE DEBUG: partition.cpp:2304: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T13:55:44.954380Z node 8 :PERSQUEUE DEBUG: partition.cpp:2272: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T13:55:44.954420Z node 8 :PERSQUEUE DEBUG: partition.cpp:2281: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T13:55:44.954437Z node 8 :PERSQUEUE DEBUG: partition.cpp:2304: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T13:55:45.053660Z node 8 :PERSQUEUE DEBUG: partition.cpp:2272: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T13:55:45.053696Z node 8 :PERSQUEUE DEBUG: partition.cpp:2281: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T13:55:45.053714Z node 8 :PERSQUEUE DEBUG: partition.cpp:2304: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T13:55:45.155999Z node 8 :PERSQUEUE DEBUG: partition.cpp:2272: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T13:55:45.156045Z node 8 :PERSQUEUE DEBUG: partition.cpp:2281: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T13:55:45.156064Z node 8 :PERSQUEUE DEBUG: partition.cpp:2304: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T13:55:45.256433Z node 8 :PERSQUEUE DEBUG: partition.cpp:2272: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T13:55:45.256471Z node 8 :PERSQUEUE DEBUG: partition.cpp:2281: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T13:55:45.256491Z node 8 :PERSQUEUE DEBUG: partition.cpp:2304: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T13:55:45.357066Z node 8 :PERSQUEUE DEBUG: partition.cpp:2272: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T13:55:45.357109Z node 8 :PERSQUEUE DEBUG: partition.cpp:2281: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T13:55:45.357130Z node 8 :PERSQUEUE DEBUG: partition.cpp:2304: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T13:55:45.437618Z :INFO: [] [] [62469704-a5dc4062-4187ee1e-3d4dce2f] Closing read session. Close timeout: 0.000000s
2025-10-31T13:55:45.437707Z :INFO: [] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:topic1:0:1:9:0
2025-10-31T13:55:45.437785Z :INFO: [] [] [62469704-a5dc4062-4187ee1e-3d4dce2f] Counters: { Errors: 0 CurrentSessionLifetimeMs: 3600 BytesRead: 3142656 MessagesRead: 3 BytesReadCompressed: 3150 BytesInflightUncompressed: 3142656 BytesInflightCompressed: 7350 BytesInflightTotal: 3150006 MessagesInflight: 10 }
2025-10-31T13:55:45.437951Z :NOTICE: [] [] [62469704-a5dc4062-4187ee1e-3d4dce2f] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Close with zero timeout " }
2025-10-31T13:55:45.459322Z node 8 :PERSQUEUE DEBUG: partition.cpp:2272: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T13:55:45.459361Z node 8 :PERSQUEUE DEBUG: partition.cpp:2281: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T13:55:45.459399Z node 8 :PERSQUEUE DEBUG: partition.cpp:2304: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T13:55:45.465684Z :DEBUG: [] [] [62469704-a5dc4062-4187ee1e-3d4dce2f] [null] Abort session to cluster
2025-10-31T13:55:45.466358Z :NOTICE: [] [] [62469704-a5dc4062-4187ee1e-3d4dce2f] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
2025-10-31T13:55:45.470577Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_7_1_11346096038620304364_v1 grpc read done: success# 0, data# {  }
2025-10-31T13:55:45.470610Z node 7 :PQ_READ_PROXY INFO: read_session_actor.cpp:125: session cookie 1 consumer shared/user session shared/user_7_1_11346096038620304364_v1 grpc read failed
2025-10-31T13:55:45.470641Z node 7 :PQ_READ_PROXY INFO: read_session_actor.cpp:92: session cookie 1 consumer shared/user session shared/user_7_1_11346096038620304364_v1 grpc closed
2025-10-31T13:55:45.470679Z node 7 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 1 consumer shared/user session shared/user_7_1_11346096038620304364_v1 is DEAD
2025-10-31T13:55:45.482730Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2258: [PQ: 72075186224037892] Destroy direct read session shared/user_7_1_11346096038620304364_v1
2025-10-31T13:55:45.482795Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [7:7567384230890022444:2480] destroyed
2025-10-31T13:55:45.482847Z node 8 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_7_1_11346096038620304364_v1
2025-10-31T13:55:45.481903Z node 7 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1659: [72075186224037893][rt3.dc1--topic1] pipe [7:7567384230890022439:2476] disconnected.
2025-10-31T13:55:45.481947Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1670: [72075186224037893][rt3.dc1--topic1] pipe [7:7567384230890022439:2476] disconnected; active server actors: 1
2025-10-31T13:55:45.481971Z node 7 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1679: [72075186224037893][rt3.dc1--topic1] pipe [7:7567384230890022439:2476] client user disconnected session shared/user_7_1_11346096038620304364_v1
2025-10-31T13:55:45.560212Z node 8 :PERSQUEUE DEBUG: partition.cpp:2272: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T13:55:45.560249Z node 8 :PERSQUEUE DEBUG: partition.cpp:2281: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T13:55:45.560264Z node 8 :PERSQUEUE DEBUG: partition.cpp:2304: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T13:55:45.664989Z node 8 :PERSQUEUE DEBUG: partition.cpp:2272: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T13:55:45.665032Z node 8 :PERSQUEUE DEBUG: partition.cpp:2281: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T13:55:45.665049Z node 8 :PERSQUEUE DEBUG: partition.cpp:2304: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T13:55:45.768984Z node 8 :PERSQUEUE DEBUG: partition.cpp:2272: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T13:55:45.769023Z node 8 :PERSQUEUE DEBUG: partition.cpp:2281: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T13:55:45.769040Z node 8 :PERSQUEUE DEBUG: partition.cpp:2304: [72075186224037892][Partition][0][StateIdle] Try persist
