2025-11-01T04:40:02.860591Z node 7 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[7:7567612128468366883:2080];send_to=[0:7307199536658146131:7762515];
2025-11-01T04:40:02.860678Z node 7 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
2025-11-01T04:40:02.869081Z node 8 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[8:7567612129247057353:2086];send_to=[0:7307199536658146131:7762515];
2025-11-01T04:40:02.869491Z node 8 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
2025-11-01T04:40:02.870584Z node 7 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-11-01T04:40:02.871493Z node 7 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
test_client.cpp: SetPath # /home/runner/.ya/build/build_root/ni8w/002110/r3tmp/tmp2ifxwV/pdisk_1.dat
2025-11-01T04:40:02.876083Z node 8 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-11-01T04:40:02.877388Z node 8 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-11-01T04:40:02.960427Z node 7 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
2025-11-01T04:40:02.981574Z node 7 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(7, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-11-01T04:40:02.981644Z node 7 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(7, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-11-01T04:40:02.982207Z node 7 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(8, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-11-01T04:40:02.982251Z node 7 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(8, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-11-01T04:40:02.987367Z node 7 :HIVE WARN: hive_impl.cpp:811: HIVE#72057594037968897 Handle TEvInterconnect::TEvNodeConnected, NodeId 8 Cookie 8
2025-11-01T04:40:02.987485Z node 7 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(7, (0,0,0,0)) VolatileState: Connecting -> Connected
2025-11-01T04:40:02.987988Z node 7 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(8, (0,0,0,0)) VolatileState: Connecting -> Connected
TServer::EnableGrpc on GrpcPort 24723, node 7
2025-11-01T04:40:03.026770Z node 7 :NET_CLASSIFIER WARN: net_classifier.cpp:190: distributable config is empty, broken or outdated, will use file: /home/runner/.ya/build/build_root/ni8w/002110/r3tmp/yandexHzY13G.tmp
2025-11-01T04:40:03.026795Z node 7 :NET_CLASSIFIER WARN: net_classifier.cpp:196: will try to initialize from file: /home/runner/.ya/build/build_root/ni8w/002110/r3tmp/yandexHzY13G.tmp
2025-11-01T04:40:03.026907Z node 7 :NET_CLASSIFIER WARN: net_classifier.cpp:202: successfully initialized from file: /home/runner/.ya/build/build_root/ni8w/002110/r3tmp/yandexHzY13G.tmp
2025-11-01T04:40:03.027040Z node 7 :NET_CLASSIFIER ERROR: net_classifier.cpp:228: got bad distributable configuration
2025-11-01T04:40:03.056157Z INFO: TTestServer started on Port 25344 GrpcPort 24723
2025-11-01T04:40:03.103990Z node 8 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-11-01T04:40:03.114268Z node 7 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
TClient is connected to server localhost:25344
PQClient connected to localhost:24723
WaitRootIsUp 'Root'...
TClient::Ls request: Root
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "Root"
    PathId: 1
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 1
    CreateStep: 0
    ParentPathId: 1
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 1
      SubDomainVersion: 0
      SecurityStateVersion: 0
    }
    ChildrenExist: false
  }
  Children {
    Name: ".sys"
    PathId: 18446744073709551615
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 0
    CreateStep: 0
    ParentPathId: 18446744073709551615
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 0
      Pl...
(TRUNCATED)
WaitRootIsUp 'Root' success.
2025-11-01T04:40:03.214107Z node 7 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpAlterSubDomain, opId: 281474976720657:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_alter_subdomain.cpp:311)
waiting...
waiting...
2025-11-01T04:40:03.241369Z node 7 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720659:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:690)
waiting...
waiting...
waiting...
2025-11-01T04:40:03.865954Z node 7 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-11-01T04:40:03.872071Z node 8 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-11-01T04:40:05.346279Z node 7 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [7:7567612141353269804:2330], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-01T04:40:05.346368Z node 7 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [7:7567612141353269796:2327], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-01T04:40:05.346501Z node 7 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-01T04:40:05.346878Z node 7 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [7:7567612141353269811:2332], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-01T04:40:05.346915Z node 7 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-01T04:40:05.350072Z node 7 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateResourcePool, opId: 281474976720662:3, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_resource_pool.cpp:179)
2025-11-01T04:40:05.367435Z node 7 :KQP_WORKLOAD_SERVICE WARN: helpers.h:73: [WorkloadService] [TPoolCreatorActor] ActorId: [7:7567612141353269810:2331], DatabaseId: /Root, PoolId: default, Scheduled retry for error: { <main>: Error: Transaction 281474976720662 completed, doublechecking }
2025-11-01T04:40:05.424676Z node 7 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720663:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:690)
2025-11-01T04:40:05.430857Z node 7 :TX_PROXY ERROR: schemereq.cpp:593: Actor# [7:7567612141353269939:2765] txid# 281474976720664, issues: { message: "Check failed: path: \'/Root/.metadata/workload_manager/pools/default\', error: path exist, request accepts it (id: [OwnerId: 72057594046644480, LocalPathId: 9], type: EPathTypeResourcePool, state: EPathStateNoChanges)" severity: 1 }
2025-11-01T04:40:05.441583Z node 8 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:570: Compilation failed, self: [8:7567612142131959634:2307], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-11-01T04:40:05.441782Z node 8 :KQP_SESSION WARN: kqp_session_actor.cpp:2500: SessionId: ydb://session/3?node_id=8&id=NWExZTQzZmUtNmI1YjcxNjAtODBlZWM4MmYtNjc3OTc5ZDM=, ActorId: [8:7567612142131959610:2301], ActorState: ExecuteState, TraceId: 01k8yveah249fqyhdy4dt13pmq, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-11-01T04:40:05.442205Z node 8 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-11-01T04:40:05.460926Z node 7 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:570: Compilation failed, self: [7:7567612141353269970:2344], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-11-01T04:40:05.461147Z node 7 :KQP_SESSION WARN: kqp_session_actor.cpp:2500: SessionId: ydb://session/3?node_id=7&id=NDQ1MWQ0YTAtMTM0ZmZmYjUtN2MxMDA5YzYtNGViMTQ0NDM=, ActorId: [7:7567612141353269794:2326], ActorState: ExecuteState, TraceId: 01k8yveaf1a2wdebrd96nb2tr4, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-11-01T04:40:05.461563Z node 7 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-11-01T04:40:05.479265Z node 7 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720665:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:690)
2025-11-01T04:40:05.574907Z node 7 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720666:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:690)
=== Init DC: UPSERT INTO `/Root/PQ/Config/V2/Cluster` (name, balancer, local, enabled, weight) VALUES ("dc1", "localhost", true, true, 1000), ("dc2", "dc2.logbroker.yandex.net", false, true, 1000);
2025-11-01T04:40:05.809701Z node 7 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976720667. Ctx: { TraceId: 01k8yveard4pw7fqptnscsafx9, Database: , SessionId: ydb://session/3?node_id=7&id=NzVhMGRlNDItZWE5ZjFjMmQtZGIzOTEzMDYtNTg2ZjU5MTU=, PoolId: default, DatabaseId: /Root}. Database not set, use /Root
=== CheckClustersList. Subcribe to ClusterTracker from [7:7567612141353270356:3078] 
2025-11-01T04:40:07.861104Z node 7 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[7:7567612128468366883:2080];send_to=[0:7307199536658146131:7762515];
2025-11-01T04:40:07.861189Z node 7 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
2025-11-01T04:40:07.868776Z node 8 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[8:7567612129247057353:2086];send_to=[0:7307199536658146131:7762515];
2025-11-01T04:40:07.868858Z node 8 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
=== CheckClustersList. Ok
PQ Client: create topic: rt3.dc1--topic1 with 1 partitions
CallPersQueueGRPC request to localhost:24723
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--topic1"
  }
}
2025-11-01T04:40:12.372495Z node 7 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--topic1, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
CallPersQueueGRPC request to localhost:24723
MetaRequest {
  CmdCreateTopic {
    Topic: "rt3.dc1--topic1"
    NumPartitions: 1
    Config {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
  }
}
CallPersQueueGRPC response:
Status: 129
ProxyErrorCode: 53
SchemeStatus: 1
FlatTxId {
  TxId: 281474976720672
  SchemeShardTabletId: 72057594046644480
  PathId: 13
}
ErrorCode: OK
AddTopic: rt3.dc1--topic1
===Run query:``DECLARE $version as Int64; DECLARE $path AS Utf8; DECLARE $cluster as Utf8; UPSERT INTO `/Root/PQ/Config/V2/Topics` (path, dc) VALUES ($path, $cluster); UPSERT INTO `/Root/PQ/Config/V2/Versions` (name, version) VALUES ("Topics", $version);`` with topic = topic1, dc = dc1
2025-11-01T04:40:12.396098Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1655: [72075186224037893][] pipe [7:7567612171418041829:3308] connected; active server actors: 1
2025-11-01T04:40:12.396150Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2960: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-11-01T04:40:12.396782Z node 7 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1519: [72075186224037893][rt3.dc1--topic1] updating configuration. Deleted partitions []. Added partitions [0]
2025-11-01T04:40:12.397371Z node 7 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:971: [72075186224037893][rt3.dc1--topic1] Discovered subdomain [OwnerId: 72057594046644480, LocalPathId: 1] state, outOfSpace = 0 at RB 72075186224037893
2025-11-01T04:40:12.399028Z node 7 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:140: [72075186224037893][rt3.dc1--topic1] BALANCER INIT DONE for rt3.dc1--topic1: (0, 72075186224037892) 
2025-11-01T04:40:12.399265Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2992: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-11-01T04:40:12.399472Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:787: [PQ: 72075186224037892] no config, start with empty partitions and default config
2025-11-01T04:40:12.399506Z node 8 :PERSQUEUE NOTICE: pq_impl.cpp:913: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-11-01T04:40:12.399546Z node 8 :PERSQUEUE INFO: pq_impl.cpp:612: [PQ: 72075186224037892] doesn't have tx writes info
2025-11-01T04:40:12.399863Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [7:7567612171418041858:2449], now have 1 active actors on pipe
2025-11-01T04:40:12.399915Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [7:7567612171418041828:3307], now have 1 active actors on pipe
2025-11-01T04:40:12.400057Z node 7 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:404: [72075186224037893][rt3.dc1--topic1] TEvClientConnected TabletId 72075186224037892, NodeId 8, Generation 1
2025-11-01T04:40:12.400632Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-01T04:40:12.403814Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-01T04:40:12.409830Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [7:7567612171418041890:3358], now have 1 active actors on pipe
2025-11-01T04:40:12.410754Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-01T04:40:12.414671Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-01T04:40:12.415702Z node 8 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--topic1:0:Initializer] Start initializing step TInitConfigStep
2025-11-01T04:40:12.415769Z node 8 :PERSQUEUE DEBUG: partition.cpp:1312: [72075186224037892][Partition][0][StateInit] HandleOnInit TEvPQ::TEvProposePartitionConfig
2025-11-01T04:40:12.416040Z node 8 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--topic1:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-11-01T04:40:12.416280Z node 8 :PERSQUEUE INFO: partition_init.cpp:1101: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [8:7567612172196730954:2358]
2025-11-01T04:40:12.419064Z node 8 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--topic1:0:Initializer] Start initializing step TInitFieldsStep
2025-11-01T04:40:12.419102Z node 8 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--topic1:0:Initializer] Initializing completed.
2025-11-01T04:40:12.419124Z node 8 :PERSQUEUE INFO: partition.cpp:707: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--topic1' partition 0 generation 1 [8:7567612172196730954:2358]
2025-11-01T04:40:12.419151Z node 8 :PERSQUEUE DEBUG: partition.cpp:727: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--topic1 partitition 0 so 0 endOffset 0 Head Offset 0 PartNo 0 PackedSize 0 count 0 nextOffset 0 batches 0
2025-11-01T04:40:12.419181Z node 8 :PERSQUEUE DEBUG: partition_mlp.cpp:83: [72075186224037892][Partition][0][StateIdle] Initializing MLP Consumers: 0
2025-11-01T04:40:12.420530Z node 8 :PERSQUEUE DEBUG: partition.cpp:4273: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 1
2025-11-01T04:40:12.420571Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T04:40:12.420640Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T04:40:12.420653Z node 8 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-01T04:40:12.420674Z node 8 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-11-01T04:40:12.420686Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-11-01T04:40:12.420698Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T04:40:12.420710Z node 8 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-11-01T04:40:12.420742Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:923: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-11-01T04:40:12.420781Z node 8 :PERSQUEUE DEBUG: partition_mlp.cpp:60: [72075186224037892][Partition][0][StateIdle] Process MLP pending events. Count 0
2025-11-01T04:40:12.421263Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-01T04:40:12.421415Z node 8 :PERSQUEUE DEBUG: partition_compaction.cpp:183: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-01T04:40:12.424752Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-01T04:40:12.424881Z node 8 :PERSQUEUE DEBUG: partition.cpp:1416: [72075186224037892][Partition][0][StateIdle] Handle TEvPQ::TEvTxCommit Step 1761972012451, TxId 281474976720672
2025-11-01T04:40:12.424907Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-11-01T04:40:12.424918Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T04:40:12.425019Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-01T04:40:12.425269Z node 8 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-01T04:40:12.427700Z node 8 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-01T04:40:12.427893Z node 8 :PERSQUEUE DEBUG: partition_mlp.cpp:83: [72075186224037892][Partition][0][StateIdle] Initializing MLP Consumers: 0
2025-11-01T04:40:12.428006Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-11-01T04:40:12.428035Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T04:40:12.428050Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T04:40:12.428065Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-01T04:40:12.428093Z node 8 :PERSQUEUE DEBUG: partition_compaction.cpp:183: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-01T04:40:12.428440Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:398: [PQ: 72075186224037892] Apply new config PartitionConfig { LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 } PartitionIds: 0 TopicName: "rt3.dc1--topic1" Version: 0 LocalDC: true Codecs { Ids: 0 Ids: 1 Ids: 2 Codecs: "raw" Codecs: "gzip" Codecs: "lzop" } TopicPath: "/Root/PQ/rt3.dc1--topic1" YcCloudId: "" YcFolderId: "" YdbDatabaseId: "" YdbDatabasePath: "/Root" Partitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } AllPartitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } Consumers { Name: "user" ReadFromTimestampsMs: 0 FormatVersion: 0 Version: 0 Generation: 0 } MonitoringProjectId: ""
2025-11-01T04:40:12.428546Z node 8 :PERSQUEUE NOTICE: pq_impl.cpp:913: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-11-01T04:40:12.428807Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-01T04:40:12.433173Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-01T04:40:12.433263Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-01T04:40:12.434735Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-01T04:40:12.520836Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T04:40:12.520876Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T04:40:12.520892Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-01T04:40:12.528675Z node 7 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976720673. Ctx: { TraceId: 01k8yvehbn1qx8qvsgbg9vbhkx, Database: , SessionId: ydb://session/3?node_id=7&id=MzhhOTRkZWQtYTRiNTVjY2YtY2E4MGY5YjktM2JmMTJjMzg=, PoolId: default, DatabaseId: /Root}. Database not set, use /Root
===Query complete
TClient::Ls request: /Root/PQ/rt3.dc1--topic1
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--topic1"
    PathId: 13
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976720672
    CreateStep: 1761972012451
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--topic1"
    PathId: 13
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 600000...
(TRUNCATED)
GetTopicVersionFromPath:  record Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--topic1"
    PathId: 13
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976720672
    CreateStep: 1761972012451
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--topic1"
    PathId: 13
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      YdbDatabasePath: "/Root"
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
    Partitions {
      PartitionId: 0
      TabletId: 72075186224037892
      Status: Active
    }
    AlterVersion: 1
    BalancerTabletID: 72075186224037893
    NextPartitionId: 1
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 1
      PlanResolution: 7
      Coordinators: 72057594046316545
      TimeCastBucketsPerMediator: 2
      Mediators: 72057594046382081
    }
    DomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    PathsInside: 12
    PathsLimit: 10000
    ShardsInside: 6
    ShardsLimit: 200000
    ResourcesDomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    DiskSpaceUsage {
      Tables {
        TotalSize: 0
        DataSize: 0
        IndexSize: 0
      }
      Topics {
        ReserveSize: 0
        AccountSize: 0
        DataSize: 0
        UsedReserveSize: 0
      }
    }
    PQPartitionsInside: 1
    PQPartitionsLimit: 1000000
    SchemeLimits {
      MaxDepth: 32
      MaxPaths: 10000
      MaxChildrenInDir: 100000
      MaxAclBytesSize: 10240
      MaxTableColumns: 200
      MaxTableColumnNameLength: 255
      MaxTableKeyColumns: 30
      MaxTableIndices: 20
      MaxShards: 200000
      MaxShardsInPath: 35000
      MaxConsistentCopyTargets: 10000
      MaxPathElementLength: 255
      ExtraPathSymbolsAllowed: "!\"#$%&\'()*+,-.:;<=>?@[\\]^_`{|}~"
      MaxPQPartitions: 1000000
      MaxTableCdcStreams: 5
      MaxExports: 10
      MaxImports: 10
      MaxColumnTableColumns: 10000
    }
  }
}
Path: "/Root/PQ/rt3.dc1--topic1"
 name rt3.dc1--topic1 version1
CallPersQueueGRPC request to localhost:24723
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--topic1"
  }
}
2025-11-01T04:40:12.582036Z node 7 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
MetaResponse {
  CmdGetTopicMetadataResult {
    TopicInfo {
      Topic: "rt3.dc1--topic1"
      NumPartitions: 1
      Config {
        PartitionConfig {
          LifetimeSeconds: 86400
          LowWatermark: 8388608
          SourceIdLifetimeSeconds: 86400
          WriteSpeedInBytesPerSecond: 20000000
          BurstSize: 20000000
          SourceIdMaxCounts: 6000000
        }
        Version: 1
        LocalDC: true
        Codecs {
          Ids: 0
          Ids: 1
          Ids: 2
          Codecs: "raw"
          Codecs: "gzip"
          Codecs: "lzop"
        }
        TopicPath: "/Root/PQ/rt3.dc1--topic1"
        YdbDatabasePath: "/Root"
        Consumers {
          Name: "user"
          ReadFromTimestampsMs: 0
          FormatVersion: 0
          Version: 0
        }
      }
      ErrorCode: OK
    }
  }
}
=== Topic created, have version: 1
2025-11-01T04:40:12.590531Z :INFO: [] [] [34cabe19-c16c0061-6a1e455c-44231d55] Starting read session
2025-11-01T04:40:12.590621Z :DEBUG: [] [] [34cabe19-c16c0061-6a1e455c-44231d55] Starting session to cluster null (localhost:24723)
2025-11-01T04:40:12.595484Z :DEBUG: [] [] [34cabe19-c16c0061-6a1e455c-44231d55] [null] In Reconnect, ReadSizeBudget = 2621440, ReadSizeServerDelta = 0
2025-11-01T04:40:12.595540Z :DEBUG: [] [] [34cabe19-c16c0061-6a1e455c-44231d55] [null] New values: ReadSizeBudget = 2621440, ReadSizeServerDelta = 0
2025-11-01T04:40:12.595583Z :DEBUG: [] [] [34cabe19-c16c0061-6a1e455c-44231d55] [null] Reconnecting session to cluster null in 0.000000s
2025-11-01T04:40:12.601720Z :DEBUG: [] [] [34cabe19-c16c0061-6a1e455c-44231d55] [null] Successfully connected. Initializing session
2025-11-01T04:40:12.602085Z node 7 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:109: new grpc connection
2025-11-01T04:40:12.602111Z node 7 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:131: new session created cookie 1
2025-11-01T04:40:12.602684Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { topic: "topic1" } read_only_original: true consumer: "shared/user" read_params { max_read_size: 5242880 } } }
2025-11-01T04:40:12.602961Z node 7 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 1 consumer shared/user session shared/user_7_1_3711639485680171386_v1 read init: from# ipv6:[::1]:35610, request# { init_request { topics_read_settings { topic: "topic1" } read_only_original: true consumer: "shared/user" read_params { max_read_size: 5242880 } } }
2025-11-01T04:40:12.603385Z node 7 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 1 consumer shared/user session shared/user_7_1_3711639485680171386_v1 auth for : user
2025-11-01T04:40:12.603970Z node 7 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 1 consumer shared/user session shared/user_7_1_3711639485680171386_v1 Handle describe topics response
2025-11-01T04:40:12.604110Z node 7 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 1 consumer shared/user session shared/user_7_1_3711639485680171386_v1 auth is DEAD
2025-11-01T04:40:12.604130Z node 7 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 1 consumer shared/user session shared/user_7_1_3711639485680171386_v1 auth ok: topics# 1, initDone# 0
2025-11-01T04:40:12.605561Z node 7 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 1 consumer shared/user session shared/user_7_1_3711639485680171386_v1 register session: topic# rt3.dc1--topic1
2025-11-01T04:40:12.605839Z :INFO: [] [] [34cabe19-c16c0061-6a1e455c-44231d55] [null] Server session id: shared/user_7_1_3711639485680171386_v1
2025-11-01T04:40:12.605881Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1655: [72075186224037893][rt3.dc1--topic1] pipe [7:7567612171418041973:2466] connected; active server actors: 1
2025-11-01T04:40:12.605927Z node 7 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1706: [72075186224037893][rt3.dc1--topic1] consumer "user" register session for pipe [7:7567612171418041973:2466] session shared/user_7_1_3711639485680171386_v1
2025-11-01T04:40:12.606020Z :DEBUG: [] [] [34cabe19-c16c0061-6a1e455c-44231d55] [null] After sending read request: ReadSizeBudget = 2621440, ReadSizeServerDelta = 0
2025-11-01T04:40:12.605995Z node 7 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:639: [72075186224037893][rt3.dc1--topic1] consumer user register readable partition 0
2025-11-01T04:40:12.606060Z node 7 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:669: [72075186224037893][rt3.dc1--topic1] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-11-01T04:40:12.606113Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:871: [72075186224037893][rt3.dc1--topic1] consumer user register reading session ReadingSession "shared/user_7_1_3711639485680171386_v1" (Sender=[7:7567612171418041970:2466], Pipe=[7:7567612171418041973:2466], Partitions=[], ActiveFamilyCount=0)
2025-11-01T04:40:12.606148Z node 7 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1186: [72075186224037893][rt3.dc1--topic1] consumer user rebalancing was scheduled
2025-11-01T04:40:12.606225Z node 7 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1258: [72075186224037893][rt3.dc1--topic1] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-11-01T04:40:12.606298Z node 7 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1305: [72075186224037893][rt3.dc1--topic1] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_7_1_3711639485680171386_v1" (Sender=[7:7567612171418041970:2466], Pipe=[7:7567612171418041973:2466], Partitions=[], ActiveFamilyCount=0)
2025-11-01T04:40:12.606329Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_7_1_3711639485680171386_v1 grpc read done: success# 1, data# { read { } }
2025-11-01T04:40:12.606370Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:549: [72075186224037893][rt3.dc1--topic1] consumer user family 1 status Active partitions [0] session "shared/user_7_1_3711639485680171386_v1" sender [7:7567612171418041970:2466] lock partition 0 for ReadingSession "shared/user_7_1_3711639485680171386_v1" (Sender=[7:7567612171418041970:2466], Pipe=[7:7567612171418041973:2466], Partitions=[], ActiveFamilyCount=1) generation 1 step 1
2025-11-01T04:40:12.606428Z node 7 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1325: [72075186224037893][rt3.dc1--topic1] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-11-01T04:40:12.606451Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_7_1_3711639485680171386_v1 got read request: guid# 4294103d-a09ccea7-27d15744-4a7637c
2025-11-01T04:40:12.606468Z node 7 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1402: [72075186224037893][rt3.dc1--topic1] consumer user balancing duration: 0.000209s
2025-11-01T04:40:12.607484Z node 7 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 1 consumer shared/user session shared/user_7_1_3711639485680171386_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--topic1" Generation: 1 Step: 1 Session: "shared/user_7_1_3711639485680171386_v1" ClientId: "user" PipeClient { RawX1: 7567612171418041973 RawX2: 4503629692144034 } Path: "/Root/PQ/rt3.dc1--topic1" }
2025-11-01T04:40:12.607572Z node 7 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 1 consumer shared/user session shared/user_7_1_3711639485680171386_v1 INITING TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1)
2025-11-01T04:40:12.608135Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [7:7567612171418041976:2469], now have 1 active actors on pipe
2025-11-01T04:40:12.608330Z node 7 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_7_1_3711639485680171386_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 1, pipe: [7:7567612171418041976:2469]
2025-11-01T04:40:12.608519Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-01T04:40:12.608559Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-01T04:40:12.608597Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:1748: [PQ: 72075186224037892] Created session shared/user_7_1_3711639485680171386_v1 on pipe: [7:7567612171418041976:2469]
2025-11-01T04:40:12.608687Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T04:40:12.608697Z node 8 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_7_1_3711639485680171386_v1:1 with generation 1
2025-11-01T04:40:12.608724Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T04:40:12.608740Z node 8 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-01T04:40:12.608810Z node 8 :PERSQUEUE DEBUG: partition.cpp:3666: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 user user session is set to 0 (startOffset 0) session shared/user_7_1_3711639485680171386_v1
2025-11-01T04:40:12.608837Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-01T04:40:12.608990Z node 8 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-01T04:40:12.611693Z node 8 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-01T04:40:12.611786Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-11-01T04:40:12.611817Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T04:40:12.611837Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T04:40:12.611855Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-01T04:40:12.611889Z node 8 :PERSQUEUE DEBUG: partition_compaction.cpp:183: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-01T04:40:12.611928Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-11-01T04:40:12.612224Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_7_1_3711639485680171386_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 0 SizeLag: 0 WriteTimestampEstimateMS: 1761972012520 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-11-01T04:40:12.612275Z node 7 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 1 consumer shared/user session shared/user_7_1_3711639485680171386_v1 INIT DONE TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 0 readOffset 0 committedOffset 0
2025-11-01T04:40:12.612353Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 1 consumer shared/user session shared/user_7_1_3711639485680171386_v1 sending to client partition status
>>>> message: CreatePartitionStream { PartitionStreamId: 1 TopicPath: topic1 Cluster: dc1 PartitionId: 0 CommittedOffset: 0 EndOffset: 0 }
2025-11-01T04:40:12.613437Z :INFO: [] [] [34cabe19-c16c0061-6a1e455c-44231d55] [null] Confirm partition stream create. Partition stream id: 1. Cluster: "dc1". Topic: "topic1". Partition: 0. Read offset: (NULL)
2025-11-01T04:40:12.614166Z :DEBUG: [] MessageGroupId [source0] SessionId [] Write session: try to update token
2025-11-01T04:40:12.614151Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_7_1_3711639485680171386_v1 grpc read done: success# 1, data# { start_read { topic { path: "topic1" } cluster: "dc1" assign_id: 1 } }
2025-11-01T04:40:12.614293Z node 7 :PQ_READ_PROXY INFO: read_session_actor.cpp:539: session cookie 1 consumer shared/user session shared/user_7_1_3711639485680171386_v1 got StartRead from client: partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 0, commitOffset# 0
2025-11-01T04:40:12.614358Z node 7 :PQ_READ_PROXY INFO: partition_actor.cpp:1023: session cookie 1 consumer shared/user session shared/user_7_1_3711639485680171386_v1 Start reading TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 0 readOffset 0 committedOffset 0 clientCommitOffset 0 clientReadOffset 0
2025-11-01T04:40:12.614399Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_7_1_3711639485680171386_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 1 from offset 0
2025-11-01T04:40:12.614713Z :INFO: [] MessageGroupId [source0] SessionId [] Write session: Do CDS request
2025-11-01T04:40:12.614763Z :INFO: [] MessageGroupId [source0] SessionId [] Start write session. Will connect to endpoint: localhost:24723
2025-11-01T04:40:12.619340Z :DEBUG: [] MessageGroupId [source0] SessionId [] Write session: send init request: init_request { topic: "topic1" message_group_id: "source0" }
2025-11-01T04:40:12.619782Z node 7 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-11-01T04:40:12.619817Z node 7 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1
2025-11-01T04:40:12.620166Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId:  grpc read done: success: 1 data: init_request { topic: "topic1" message_group_id: "source0" }
2025-11-01T04:40:12.620309Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1 topic: "topic1" message_group_id: "source0" from ipv6:[::1]:35610
2025-11-01T04:40:12.620334Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:35610 proto=v1  topic=topic1 durationSec=0
2025-11-01T04:40:12.620345Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-11-01T04:40:12.621135Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T04:40:12.621170Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T04:40:12.621188Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-01T04:40:12.621730Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1 sessionId:  describe result for acl check
2025-11-01T04:40:12.621815Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-11-01T04:40:12.621825Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-11-01T04:40:12.621832Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-11-01T04:40:12.621848Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [7:7567612171418041980:2470] (SourceId=source0, PreferedPartition=(NULL)) StartKqpSession
2025-11-01T04:40:12.624612Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [7:7567612171418041980:2470] (SourceId=source0, PreferedPartition=(NULL)) Select from the table
2025-11-01T04:40:12.721513Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T04:40:12.721550Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T04:40:12.721566Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-01T04:40:12.821892Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T04:40:12.821923Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T04:40:12.821938Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-01T04:40:12.822934Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [7:7567612171418041980:2470] (SourceId=source0, PreferedPartition=(NULL)) RequestPQRB
2025-11-01T04:40:12.823234Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1655: [72075186224037893][rt3.dc1--topic1] pipe [7:7567612171418042019:2470] connected; active server actors: 1
2025-11-01T04:40:12.823308Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [7:7567612171418041980:2470] (SourceId=source0, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=source0
2025-11-01T04:40:12.823326Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [7:7567612171418041980:2470] (SourceId=source0, PreferedPartition=(NULL)) Update the table
2025-11-01T04:40:12.823554Z node 7 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1659: [72075186224037893][rt3.dc1--topic1] pipe [7:7567612171418042019:2470] disconnected.
2025-11-01T04:40:12.823586Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1670: [72075186224037893][rt3.dc1--topic1] pipe [7:7567612171418042019:2470] disconnected; active server actors: 1
2025-11-01T04:40:12.823601Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1695: [72075186224037893][rt3.dc1--topic1] pipe [7:7567612171418042019:2470] disconnected no session
2025-11-01T04:40:12.922182Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T04:40:12.922218Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T04:40:12.922235Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-01T04:40:12.955094Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [7:7567612171418041980:2470] (SourceId=source0, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-11-01T04:40:12.955138Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [7:7567612171418041980:2470] (SourceId=source0, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-11-01T04:40:12.955156Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [7:7567612171418041980:2470] (SourceId=source0, PreferedPartition=(NULL)) Start idle
2025-11-01T04:40:12.955197Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-11-01T04:40:12.956125Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 8, Generation: 1
2025-11-01T04:40:12.955993Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [7:7567612171418042050:2470], now have 1 active actors on pipe
2025-11-01T04:40:12.956273Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-01T04:40:12.956301Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-01T04:40:12.956398Z node 8 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie source0|75e34e93-3c9e5783-8d3a7451-3401b577_0 generated for partition 0 topic 'rt3.dc1--topic1' owner source0
2025-11-01T04:40:12.956436Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T04:40:12.956456Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T04:40:12.956469Z node 8 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-01T04:40:12.956508Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-01T04:40:12.956545Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-01T04:40:12.956625Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-01T04:40:12.957075Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-01T04:40:12.957094Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-01T04:40:12.957156Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-01T04:40:12.957425Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1 partition: 0 MaxSeqNo: 0 sessionId: source0|75e34e93-3c9e5783-8d3a7451-3401b577_0
2025-11-01T04:40:12.958249Z :INFO: [] MessageGroupId [source0] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1761972012958 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-11-01T04:40:12.958384Z :INFO: [] MessageGroupId [source0] SessionId [] Write session established. Init response: session_id: "source0|75e34e93-3c9e5783-8d3a7451-3401b577_0" topic: "topic1" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-11-01T04:40:12.959706Z :DEBUG: [] MessageGroupId [source0] SessionId [source0|75e34e93-3c9e5783-8d3a7451-3401b577_0] Write 1 messages with Id from 1 to 1
2025-11-01T04:40:12.959867Z :INFO: [] MessageGroupId [source0] SessionId [source0|75e34e93-3c9e5783-8d3a7451-3401b577_0] Write session: close. Timeout = 10000 ms
2025-11-01T04:40:12.971738Z :DEBUG: [] MessageGroupId [source0] SessionId [source0|75e34e93-3c9e5783-8d3a7451-3401b577_0] Write session: try to update token
2025-11-01T04:40:12.971813Z :DEBUG: [] MessageGroupId [source0] SessionId [source0|75e34e93-3c9e5783-8d3a7451-3401b577_0] Send 1 message(s) (0 left), first sequence number is 1
2025-11-01T04:40:12.972628Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId: source0|75e34e93-3c9e5783-8d3a7451-3401b577_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-01T04:40:12.972935Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-01T04:40:12.973449Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-01T04:40:12.973501Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-01T04:40:12.973590Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-11-01T04:40:12.973798Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-01T04:40:12.974210Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-01T04:40:12.974247Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-01T04:40:12.974646Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: '\0source0' SeqNo: 1 partNo : 0 messageNo: 1 size 1122 offset: -1
2025-11-01T04:40:12.974706Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-01T04:40:12.974767Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T04:40:12.974804Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T04:40:12.974819Z node 8 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-01T04:40:12.974928Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId '\0source0' seqNo 1 partNo 0
2025-11-01T04:40:13.016922Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '\0source0' seqNo 1 partNo 0 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 1197 count 1 nextOffset 1 batches 1
2025-11-01T04:40:13.016993Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-01T04:40:13.017468Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 0,1 HeadOffset 0 endOffset 0 curOffset 1 d0000000000_00000000000000000000_00000_0000000001_00000? size 1185 WTime 1761972013017
2025-11-01T04:40:13.017633Z node 8 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-01T04:40:13.017741Z node 8 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 0 partNo 0 count 1 size 1185
2025-11-01T04:40:13.021974Z node 8 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 0 count 1 size 1185 actorID [8:7567612172196730934:2358]
2025-11-01T04:40:13.022036Z node 8 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-01T04:40:13.022081Z node 8 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 0 suffix '63' size 1185
2025-11-01T04:40:13.022091Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1130 WriteNewSizeFromSupportivePartitions# 0
2025-11-01T04:40:13.022121Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-01T04:40:13.022164Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0source0', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 1, partNo: 0, Offset: 0 is stored on disk
2025-11-01T04:40:13.022376Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:923: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-11-01T04:40:13.022401Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:965: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-11-01T04:40:13.022423Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T04:40:13.022441Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T04:40:13.022466Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-01T04:40:13.022498Z node 8 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-01T04:40:13.022538Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 1  requestId: <none> cookie: 1
2025-11-01T04:40:13.022602Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T04:40:13.022629Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T04:40:13.022644Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-01T04:40:13.022736Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:880: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--topic1' partition 0 user user offset 0 partno 0 count 1 size 1024000 endOffset 1 max time lag 0ms effective offset 0
2025-11-01T04:40:13.022948Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:1105: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 1185 count 1 last offset 0, current partition end offset: 1
2025-11-01T04:40:13.022969Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:1121: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-11-01T04:40:13.023010Z node 8 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 0 partno 0 count 1 parts_count 0 source 1 size 1185 accessed 0 times before, last time 2025-11-01T04:40:13.000000Z
2025-11-01T04:40:13.023041Z node 8 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 3. All 1 blobs are from cache.
2025-11-01T04:40:13.023083Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:572: FormAnswer for 1 blobs
2025-11-01T04:40:13.023098Z node 8 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 0 suffix '63'
2025-11-01T04:40:13.022662Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 1 consumer shared/user session shared/user_7_1_3711639485680171386_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 0 EndOffset 0 newEndOffset 1 commitOffset 0 clientCommitOffset 0 cookie 1 readingFinished 0 firstRead 1
2025-11-01T04:40:13.022720Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_7_1_3711639485680171386_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 0 endOffset 1
2025-11-01T04:40:13.023217Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 0 totakecount 1 count 1 size 1165 from pos 0 cbcount 1
2025-11-01T04:40:13.022761Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-01T04:40:13.022817Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_7_1_3711639485680171386_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 0, endOffset# 1, WTime# 0, sizeLag# 1185
2025-11-01T04:40:13.022841Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_7_1_3711639485680171386_v1TEvPartitionReady. Aval parts: 1
2025-11-01T04:40:13.022896Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_7_1_3711639485680171386_v1 performing read request: guid# 4294103d-a09ccea7-27d15744-4a7637c, from# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), count# 1, size# 1422, partitionsAsked# 1, maxTimeLag# 0ms
2025-11-01T04:40:13.023349Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-01T04:40:13.022988Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_7_1_3711639485680171386_v1 READ FROM TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1)maxCount 1 maxSize 1422 maxTimeLagMs 0 readTimestampMs 0 readOffset 0 EndOffset 1 ClientCommitOffset 0 committedOffset 0 Guid 4294103d-a09ccea7-27d15744-4a7637c
2025-11-01T04:40:13.023376Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-01T04:40:13.023420Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:1015: Topic 'rt3.dc1--topic1' partition 0 user user readTimeStamp done, result 1761972012974 queuesize 0 startOffset 0
2025-11-01T04:40:13.023478Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:880: [72075186224037892][Partition][0][StateIdle] read cookie 4 Topic 'rt3.dc1--topic1' partition 0 user user offset 0 partno 0 count 1 size 1422 endOffset 1 max time lag 0ms effective offset 0
2025-11-01T04:40:13.023614Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:1105: [72075186224037892][Partition][0][StateIdle] read cookie 4 added 1 blobs, size 1185 count 1 last offset 0, current partition end offset: 1
2025-11-01T04:40:13.023627Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:1121: [72075186224037892][Partition][0][StateIdle] Reading cookie 4. Send blob request.
2025-11-01T04:40:13.023671Z :DEBUG: [] MessageGroupId [source0] SessionId [source0|75e34e93-3c9e5783-8d3a7451-3401b577_0] Write session got write response: sequence_numbers: 1 offsets: 0 already_written: false write_statistics { persist_duration_ms: 5 queued_in_partition_duration_ms: 42 }
2025-11-01T04:40:13.023654Z node 8 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 0 partno 0 count 1 parts_count 0 source 1 size 1185 accessed 1 times before, last time 2025-11-01T04:40:13.000000Z
2025-11-01T04:40:13.023749Z :DEBUG: [] MessageGroupId [source0] SessionId [source0|75e34e93-3c9e5783-8d3a7451-3401b577_0] Write session: acknoledged message 1
2025-11-01T04:40:13.023671Z node 8 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 4. All 1 blobs are from cache.
2025-11-01T04:40:13.023687Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:572: FormAnswer for 1 blobs
2025-11-01T04:40:13.023713Z node 8 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 0 suffix '63'
2025-11-01T04:40:13.023780Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 0 totakecount 1 count 1 size 1165 from pos 0 cbcount 1
2025-11-01T04:40:13.023833Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-01T04:40:13.024290Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_7_1_3711639485680171386_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 1 Result { Offset: 0 Data: "... 1122 bytes ..." SourceId: "\000source0" SeqNo: 1 WriteTimestampMS: 1761972012974 CreateTimestampMS: 1761972012958 UncompressedSize: 1047552 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 20 RealReadOffset: 0 WaitQuotaTimeMs: 0 EndOffset: 1 StartOffset: 0 } Cookie: 0 }
2025-11-01T04:40:13.024457Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_7_1_3711639485680171386_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 2 from offset 1
2025-11-01T04:40:13.024507Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_7_1_3711639485680171386_v1 after read state TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 1 ReadOffset 1 ReadGuid 4294103d-a09ccea7-27d15744-4a7637c has messages 1
2025-11-01T04:40:13.024632Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_7_1_3711639485680171386_v1 read done: guid# 4294103d-a09ccea7-27d15744-4a7637c, partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), size# 1222
2025-11-01T04:40:13.024671Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_7_1_3711639485680171386_v1 response to read: guid# 4294103d-a09ccea7-27d15744-4a7637c
2025-11-01T04:40:13.024882Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_7_1_3711639485680171386_v1 Process answer. Aval parts: 0
2025-11-01T04:40:13.025474Z :DEBUG: [] [] [34cabe19-c16c0061-6a1e455c-44231d55] [null] After sending read request: ReadSizeBudget = 2621440, ReadSizeServerDelta = 0
2025-11-01T04:40:13.025702Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_7_1_3711639485680171386_v1 grpc read done: success# 1, data# { read { } }
2025-11-01T04:40:13.025823Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_7_1_3711639485680171386_v1 got read request: guid# 69cfdd35-3abaa242-6d8e6533-2fb90a9
2025-11-01T04:40:13.060045Z :INFO: [] MessageGroupId [source0] SessionId [source0|75e34e93-3c9e5783-8d3a7451-3401b577_0] Write session will now close
2025-11-01T04:40:13.060122Z :DEBUG: [] MessageGroupId [source0] SessionId [source0|75e34e93-3c9e5783-8d3a7451-3401b577_0] Write session: aborting
2025-11-01T04:40:13.061096Z :INFO: [] MessageGroupId [source0] SessionId [source0|75e34e93-3c9e5783-8d3a7451-3401b577_0] Write session: gracefully shut down, all writes complete
2025-11-01T04:40:13.061183Z :DEBUG: [] MessageGroupId [source0] SessionId [source0|75e34e93-3c9e5783-8d3a7451-3401b577_0] Write session is aborting and will not restart
2025-11-01T04:40:13.061378Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId: source0|75e34e93-3c9e5783-8d3a7451-3401b577_0 grpc read done: success: 0 data: 
2025-11-01T04:40:13.061590Z :DEBUG: [] MessageGroupId [source0] SessionId [source0|75e34e93-3c9e5783-8d3a7451-3401b577_0] Write session: destroy
2025-11-01T04:40:13.061432Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 1 sessionId: source0|75e34e93-3c9e5783-8d3a7451-3401b577_0 grpc read failed
2025-11-01T04:40:13.061959Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:824: session v1 closed cookie: 1 sessionId: source0|75e34e93-3c9e5783-8d3a7451-3401b577_0
2025-11-01T04:40:13.061989Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1 sessionId: source0|75e34e93-3c9e5783-8d3a7451-3401b577_0 is DEAD
2025-11-01T04:40:13.062430Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-11-01T04:40:13.062867Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [7:7567612171418042050:2470] destroyed
2025-11-01T04:40:13.062923Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-11-01T04:40:13.062955Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T04:40:13.062969Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T04:40:13.062984Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-01T04:40:13.064314Z :DEBUG: [] MessageGroupId [source1] SessionId [] Write session: try to update token
2025-11-01T04:40:13.064609Z :INFO: [] MessageGroupId [source1] SessionId [] Write session: Do CDS request
2025-11-01T04:40:13.064633Z :INFO: [] MessageGroupId [source1] SessionId [] Start write session. Will connect to endpoint: localhost:24723
2025-11-01T04:40:13.068128Z :DEBUG: [] MessageGroupId [source1] SessionId [] Write session: send init request: init_request { topic: "topic1" message_group_id: "source1" }
2025-11-01T04:40:13.068559Z node 7 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-11-01T04:40:13.068604Z node 7 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2
2025-11-01T04:40:13.069001Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId:  grpc read done: success: 1 data: init_request { topic: "topic1" message_group_id: "source1" }
2025-11-01T04:40:13.069169Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2 topic: "topic1" message_group_id: "source1" from ipv6:[::1]:35610
2025-11-01T04:40:13.069188Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:35610 proto=v1  topic=topic1 durationSec=0
2025-11-01T04:40:13.069201Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-11-01T04:40:13.070816Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2 sessionId:  describe result for acl check
2025-11-01T04:40:13.070951Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-11-01T04:40:13.070962Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-11-01T04:40:13.070974Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-11-01T04:40:13.070995Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [7:7567612175713009356:2480] (SourceId=source1, PreferedPartition=(NULL)) StartKqpSession
2025-11-01T04:40:13.074297Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [7:7567612175713009356:2480] (SourceId=source1, PreferedPartition=(NULL)) Select from the table
2025-11-01T04:40:13.080524Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [7:7567612175713009356:2480] (SourceId=source1, PreferedPartition=(NULL)) RequestPQRB
2025-11-01T04:40:13.080794Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1655: [72075186224037893][rt3.dc1--topic1] pipe [7:7567612175713009372:2480] connected; active server actors: 1
2025-11-01T04:40:13.080849Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [7:7567612175713009356:2480] (SourceId=source1, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=source1
2025-11-01T04:40:13.080870Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [7:7567612175713009356:2480] (SourceId=source1, PreferedPartition=(NULL)) Update the table
2025-11-01T04:40:13.081379Z node 7 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1659: [72075186224037893][rt3.dc1--topic1] pipe [7:7567612175713009372:2480] disconnected.
2025-11-01T04:40:13.081410Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1670: [72075186224037893][rt3.dc1--topic1] pipe [7:7567612175713009372:2480] disconnected; active server actors: 1
2025-11-01T04:40:13.081426Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1695: [72075186224037893][rt3.dc1--topic1] pipe [7:7567612175713009372:2480] disconnected no session
2025-11-01T04:40:13.091583Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [7:7567612175713009356:2480] (SourceId=source1, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-11-01T04:40:13.091626Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [7:7567612175713009356:2480] (SourceId=source1, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-11-01T04:40:13.091644Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [7:7567612175713009356:2480] (SourceId=source1, PreferedPartition=(NULL)) Start idle
2025-11-01T04:40:13.091677Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-11-01T04:40:13.092451Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [7:7567612175713009387:2480], now have 1 active actors on pipe
2025-11-01T04:40:13.092568Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 8, Generation: 1
2025-11-01T04:40:13.092745Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-01T04:40:13.092785Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-01T04:40:13.092864Z node 8 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie source1|d6c09cad-665b8493-aee59e69-13add758_0 generated for partition 0 topic 'rt3.dc1--topic1' owner source1
2025-11-01T04:40:13.092904Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T04:40:13.092926Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T04:40:13.092939Z node 8 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-01T04:40:13.092983Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-01T04:40:13.093029Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-01T04:40:13.093113Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-01T04:40:13.093609Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-01T04:40:13.093640Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-01T04:40:13.093705Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-01T04:40:13.094725Z :INFO: [] MessageGroupId [source1] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1761972013094 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-11-01T04:40:13.094818Z :INFO: [] MessageGroupId [source1] SessionId [] Write session established. Init response: session_id: "source1|d6c09cad-665b8493-aee59e69-13add758_0" topic: "topic1" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-11-01T04:40:13.093988Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2 partition: 0 MaxSeqNo: 0 sessionId: source1|d6c09cad-665b8493-aee59e69-13add758_0
2025-11-01T04:40:13.096027Z :DEBUG: [] MessageGroupId [source1] SessionId [source1|d6c09cad-665b8493-aee59e69-13add758_0] Write 1 messages with Id from 1 to 1
2025-11-01T04:40:13.096109Z :INFO: [] MessageGroupId [source1] SessionId [source1|d6c09cad-665b8493-aee59e69-13add758_0] Write session: close. Timeout = 10000 ms
2025-11-01T04:40:13.108169Z :DEBUG: [] MessageGroupId [source1] SessionId [source1|d6c09cad-665b8493-aee59e69-13add758_0] Write session: try to update token
2025-11-01T04:40:13.108229Z :DEBUG: [] MessageGroupId [source1] SessionId [source1|d6c09cad-665b8493-aee59e69-13add758_0] Send 1 message(s) (0 left), first sequence number is 1
2025-11-01T04:40:13.109164Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: source1|d6c09cad-665b8493-aee59e69-13add758_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-01T04:40:13.109558Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-01T04:40:13.110057Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-01T04:40:13.110113Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-01T04:40:13.110200Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-11-01T04:40:13.110429Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-01T04:40:13.110780Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-01T04:40:13.110802Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-01T04:40:13.110857Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: '\0source1' SeqNo: 1 partNo : 0 messageNo: 1 size 1122 offset: -1
2025-11-01T04:40:13.110899Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-01T04:40:13.110946Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T04:40:13.110976Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T04:40:13.110990Z node 8 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-01T04:40:13.111097Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId '\0source1' seqNo 1 partNo 0
2025-11-01T04:40:13.111872Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '\0source1' seqNo 1 partNo 0 FormedBlobsCount 0 NewHead: Offset 1 PartNo 0 PackedSize 1197 count 1 nextOffset 2 batches 1
2025-11-01T04:40:13.111916Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-01T04:40:13.112343Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 1,1 HeadOffset 1 endOffset 1 curOffset 2 d0000000000_00000000000000000001_00000_0000000001_00000? size 1185 WTime 1761972013111
2025-11-01T04:40:13.112459Z node 8 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-01T04:40:13.112555Z node 8 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 1 partNo 0 count 1 size 1185
2025-11-01T04:40:13.116574Z node 8 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 1 count 1 size 1185 actorID [8:7567612172196730934:2358]
2025-11-01T04:40:13.116634Z node 8 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-01T04:40:13.116675Z node 8 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 1 partno 0 count 1 parts 0 suffix '63' size 1185
2025-11-01T04:40:13.116683Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1130 WriteNewSizeFromSupportivePartitions# 0
2025-11-01T04:40:13.116712Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-01T04:40:13.116751Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 1, partNo: 0, Offset: 1 is stored on disk
2025-11-01T04:40:13.116982Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T04:40:13.117006Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T04:40:13.117035Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-01T04:40:13.117084Z node 8 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-01T04:40:13.117128Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 1  requestId: <none> cookie: 1
2025-11-01T04:40:13.117228Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 1 consumer shared/user session shared/user_7_1_3711639485680171386_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 1 EndOffset 1 newEndOffset 2 commitOffset 0 clientCommitOffset 0 cookie 2 readingFinished 0 firstRead 0
2025-11-01T04:40:13.117264Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_7_1_3711639485680171386_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 1 endOffset 2
2025-11-01T04:40:13.117292Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-01T04:40:13.117325Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_7_1_3711639485680171386_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 1, endOffset# 2, WTime# 1761972012974, sizeLag# 1185
2025-11-01T04:40:13.117350Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_7_1_3711639485680171386_v1TEvPartitionReady. Aval parts: 1
2025-11-01T04:40:13.117409Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_7_1_3711639485680171386_v1 performing read request: guid# 69cfdd35-3abaa242-6d8e6533-2fb90a9, from# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), count# 1, size# 1422, partitionsAsked# 1, maxTimeLag# 0ms
2025-11-01T04:40:13.117471Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_7_1_3711639485680171386_v1 READ FROM TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1)maxCount 1 maxSize 1422 maxTimeLagMs 0 readTimestampMs 0 readOffset 1 EndOffset 2 ClientCommitOffset 0 committedOffset 0 Guid 69cfdd35-3abaa242-6d8e6533-2fb90a9
2025-11-01T04:40:13.117858Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-01T04:40:13.117891Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-01T04:40:13.117975Z :DEBUG: [] MessageGroupId [source1] SessionId [source1|d6c09cad-665b8493-aee59e69-13add758_0] Write session got write response: sequence_numbers: 1 offsets: 1 already_written: false write_statistics { persist_duration_ms: 5 queued_in_partition_duration_ms: 2 }
2025-11-01T04:40:13.117985Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:880: [72075186224037892][Partition][0][StateIdle] read cookie 5 Topic 'rt3.dc1--topic1' partition 0 user user offset 1 partno 0 count 1 size 1422 endOffset 2 max time lag 0ms effective offset 1
2025-11-01T04:40:13.118029Z :DEBUG: [] MessageGroupId [source1] SessionId [source1|d6c09cad-665b8493-aee59e69-13add758_0] Write session: acknoledged message 1
2025-11-01T04:40:13.118203Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:1105: [72075186224037892][Partition][0][StateIdle] read cookie 5 added 1 blobs, size 1185 count 1 last offset 1, current partition end offset: 2
2025-11-01T04:40:13.118228Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:1121: [72075186224037892][Partition][0][StateIdle] Reading cookie 5. Send blob request.
2025-11-01T04:40:13.118271Z node 8 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 1 partno 0 count 1 parts_count 0 source 1 size 1185 accessed 0 times before, last time 2025-11-01T04:40:13.000000Z
2025-11-01T04:40:13.118301Z node 8 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 5. All 1 blobs are from cache.
2025-11-01T04:40:13.118338Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:572: FormAnswer for 1 blobs
2025-11-01T04:40:13.118355Z node 8 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 1 partno 0 count 1 parts 0 suffix '63'
2025-11-01T04:40:13.118460Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 1 totakecount 1 count 1 size 1165 from pos 0 cbcount 1
2025-11-01T04:40:13.118550Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-11-01T04:40:13.119100Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_7_1_3711639485680171386_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 2 Result { Offset: 1 Data: "... 1122 bytes ..." SourceId: "\000source1" SeqNo: 1 WriteTimestampMS: 1761972013109 CreateTimestampMS: 1761972013095 UncompressedSize: 1047552 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 20 RealReadOffset: 1 WaitQuotaTimeMs: 0 EndOffset: 2 StartOffset: 0 } Cookie: 1 }
2025-11-01T04:40:13.119239Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_7_1_3711639485680171386_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 3 from offset 2
2025-11-01T04:40:13.119281Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_7_1_3711639485680171386_v1 after read state TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 2 ReadOffset 2 ReadGuid 69cfdd35-3abaa242-6d8e6533-2fb90a9 has messages 1
2025-11-01T04:40:13.119421Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_7_1_3711639485680171386_v1 read done: guid# 69cfdd35-3abaa242-6d8e6533-2fb90a9, partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), size# 1224
2025-11-01T04:40:13.119455Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_7_1_3711639485680171386_v1 response to read: guid# 69cfdd35-3abaa242-6d8e6533-2fb90a9
2025-11-01T04:40:13.119758Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_7_1_3711639485680171386_v1 Process answer. Aval parts: 0
2025-11-01T04:40:13.120187Z :DEBUG: [] [] [34cabe19-c16c0061-6a1e455c-44231d55] [null] After sending read request: ReadSizeBudget = 2621440, ReadSizeServerDelta = 0
2025-11-01T04:40:13.120402Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_7_1_3711639485680171386_v1 grpc read done: success# 1, data# { read { } }
2025-11-01T04:40:13.120534Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_7_1_3711639485680171386_v1 got read request: guid# f9bcf441-355186c-29275fd7-6d28d40f
2025-11-01T04:40:13.122877Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T04:40:13.122909Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T04:40:13.122924Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-01T04:40:13.196236Z :INFO: [] MessageGroupId [source1] SessionId [source1|d6c09cad-665b8493-aee59e69-13add758_0] Write session will now close
2025-11-01T04:40:13.196284Z :DEBUG: [] MessageGroupId [source1] SessionId [source1|d6c09cad-665b8493-aee59e69-13add758_0] Write session: aborting
2025-11-01T04:40:13.197099Z :INFO: [] MessageGroupId [source1] SessionId [source1|d6c09cad-665b8493-aee59e69-13add758_0] Write session: gracefully shut down, all writes complete
2025-11-01T04:40:13.197124Z :DEBUG: [] MessageGroupId [source1] SessionId [source1|d6c09cad-665b8493-aee59e69-13add758_0] Write session is aborting and will not restart
2025-11-01T04:40:13.197488Z :DEBUG: [] MessageGroupId [source1] SessionId [source1|d6c09cad-665b8493-aee59e69-13add758_0] Write session: destroy
2025-11-01T04:40:13.198973Z :DEBUG: [] MessageGroupId [source2] SessionId [] Write session: try to update token
2025-11-01T04:40:13.199286Z :INFO: [] MessageGroupId [source2] SessionId [] Write session: Do CDS request
2025-11-01T04:40:13.199311Z :INFO: [] MessageGroupId [source2] SessionId [] Start write session. Will connect to endpoint: localhost:24723
2025-11-01T04:40:13.199672Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [7:7567612175713009387:2480] destroyed
2025-11-01T04:40:13.199737Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-11-01T04:40:13.199774Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T04:40:13.199790Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T04:40:13.199807Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-01T04:40:13.197475Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: source1|d6c09cad-665b8493-aee59e69-13add758_0 grpc read done: success: 0 data: 
2025-11-01T04:40:13.197517Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 2 sessionId: source1|d6c09cad-665b8493-aee59e69-13add758_0 grpc read failed
2025-11-01T04:40:13.197565Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 2 sessionId: source1|d6c09cad-665b8493-aee59e69-13add758_0 grpc closed
2025-11-01T04:40:13.197605Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2 sessionId: source1|d6c09cad-665b8493-aee59e69-13add758_0 is DEAD
2025-11-01T04:40:13.199124Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-11-01T04:40:13.202831Z :DEBUG: [] MessageGroupId [source2] SessionId [] Write session: send init request: init_request { topic: "topic1" message_group_id: "source2" }
2025-11-01T04:40:13.203141Z node 7 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-11-01T04:40:13.203175Z node 7 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3
2025-11-01T04:40:13.203489Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3 sessionId:  grpc read done: success: 1 data: init_request { topic: "topic1" message_group_id: "source2" }
2025-11-01T04:40:13.203616Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3 topic: "topic1" message_group_id: "source2" from ipv6:[::1]:35610
2025-11-01T04:40:13.203638Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:35610 proto=v1  topic=topic1 durationSec=0
2025-11-01T04:40:13.203649Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-11-01T04:40:13.205031Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3 sessionId:  describe result for acl check
2025-11-01T04:40:13.205175Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-11-01T04:40:13.205192Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-11-01T04:40:13.205202Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-11-01T04:40:13.205225Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [7:7567612175713009394:2484] (SourceId=source2, PreferedPartition=(NULL)) StartKqpSession
2025-11-01T04:40:13.207678Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [7:7567612175713009394:2484] (SourceId=source2, PreferedPartition=(NULL)) Select from the table
2025-11-01T04:40:13.213904Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [7:7567612175713009394:2484] (SourceId=source2, PreferedPartition=(NULL)) RequestPQRB
2025-11-01T04:40:13.214318Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1655: [72075186224037893][rt3.dc1--topic1] pipe [7:7567612175713009413:2484] connected; active server actors: 1
2025-11-01T04:40:13.214359Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [7:7567612175713009394:2484] (SourceId=source2, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=source2
2025-11-01T04:40:13.214378Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [7:7567612175713009394:2484] (SourceId=source2, PreferedPartition=(NULL)) Update the table
2025-11-01T04:40:13.214712Z node 7 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1659: [72075186224037893][rt3.dc1--topic1] pipe [7:7567612175713009413:2484] disconnected.
2025-11-01T04:40:13.214737Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1670: [72075186224037893][rt3.dc1--topic1] pipe [7:7567612175713009413:2484] disconnected; active server actors: 1
2025-11-01T04:40:13.214754Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1695: [72075186224037893][rt3.dc1--topic1] pipe [7:7567612175713009413:2484] disconnected no session
2025-11-01T04:40:13.224105Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T04:40:13.224138Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T04:40:13.224157Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-01T04:40:13.227210Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [7:7567612175713009394:2484] (SourceId=source2, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-11-01T04:40:13.227255Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [7:7567612175713009394:2484] (SourceId=source2, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-11-01T04:40:13.227275Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [7:7567612175713009394:2484] (SourceId=source2, PreferedPartition=(NULL)) Start idle
2025-11-01T04:40:13.227310Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-11-01T04:40:13.228081Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [7:7567612175713009428:2484], now have 1 active actors on pipe
2025-11-01T04:40:13.228324Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 8, Generation: 1
2025-11-01T04:40:13.229128Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-01T04:40:13.229177Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-01T04:40:13.229250Z node 8 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie source2|c57c430f-c3794348-1d2c0304-6c814096_0 generated for partition 0 topic 'rt3.dc1--topic1' owner source2
2025-11-01T04:40:13.229289Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T04:40:13.229313Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T04:40:13.229326Z node 8 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-01T04:40:13.229369Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-01T04:40:13.229414Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-01T04:40:13.229462Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-01T04:40:13.229986Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-01T04:40:13.230012Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-01T04:40:13.230078Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-01T04:40:13.230402Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3 partition: 0 MaxSeqNo: 0 sessionId: source2|c57c430f-c3794348-1d2c0304-6c814096_0
2025-11-01T04:40:13.231071Z :INFO: [] MessageGroupId [source2] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1761972013231 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-11-01T04:40:13.231175Z :INFO: [] MessageGroupId [source2] SessionId [] Write session established. Init response: session_id: "source2|c57c430f-c3794348-1d2c0304-6c814096_0" topic: "topic1" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-11-01T04:40:13.232652Z :DEBUG: [] MessageGroupId [source2] SessionId [source2|c57c430f-c3794348-1d2c0304-6c814096_0] Write 1 messages with Id from 1 to 1
2025-11-01T04:40:13.232743Z :INFO: [] MessageGroupId [source2] SessionId [source2|c57c430f-c3794348-1d2c0304-6c814096_0] Write session: close. Timeout = 10000 ms
2025-11-01T04:40:13.250253Z :DEBUG: [] MessageGroupId [source2] SessionId [source2|c57c430f-c3794348-1d2c0304-6c814096_0] Write session: try to update token
2025-11-01T04:40:13.250313Z :DEBUG: [] MessageGroupId [source2] SessionId [source2|c57c430f-c3794348-1d2c0304-6c814096_0] Send 1 message(s) (0 left), first sequence number is 1
2025-11-01T04:40:13.251010Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3 sessionId: source2|c57c430f-c3794348-1d2c0304-6c814096_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-01T04:40:13.251325Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-01T04:40:13.251817Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-01T04:40:13.251861Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-01T04:40:13.251942Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-11-01T04:40:13.252134Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-01T04:40:13.252561Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-01T04:40:13.252589Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-01T04:40:13.252647Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: '\0source2' SeqNo: 1 partNo : 0 messageNo: 1 size 1122 offset: -1
2025-11-01T04:40:13.252694Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-01T04:40:13.252743Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T04:40:13.252777Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T04:40:13.252798Z node 8 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-01T04:40:13.252922Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId '\0source2' seqNo 1 partNo 0
2025-11-01T04:40:13.325687Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '\0source2' seqNo 1 partNo 0 FormedBlobsCount 0 NewHead: Offset 2 PartNo 0 PackedSize 1197 count 1 nextOffset 3 batches 1
2025-11-01T04:40:13.325759Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-01T04:40:13.326328Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 2,1 HeadOffset 2 endOffset 2 curOffset 3 d0000000000_00000000000000000002_00000_0000000001_00000? size 1185 WTime 1761972013326
2025-11-01T04:40:13.326545Z node 8 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-01T04:40:13.326570Z node 8 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-01T04:40:13.326704Z node 8 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 2 partNo 0 count 1 size 1185
2025-11-01T04:40:13.330964Z node 8 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 2 count 1 size 1185 actorID [8:7567612172196730934:2358]
2025-11-01T04:40:13.331046Z node 8 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-01T04:40:13.331098Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1130 WriteNewSizeFromSupportivePartitions# 0
2025-11-01T04:40:13.331097Z node 8 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 2 partno 0 count 1 parts 0 suffix '63' size 1185
2025-11-01T04:40:13.331138Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-01T04:40:13.331176Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0source2', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 1, partNo: 0, Offset: 2 is stored on disk
2025-11-01T04:40:13.331392Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T04:40:13.331416Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T04:40:13.331430Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-01T04:40:13.331463Z node 8 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-01T04:40:13.331503Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 1  requestId: <none> cookie: 1
2025-11-01T04:40:13.331736Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 1 consumer shared/user session shared/user_7_1_3711639485680171386_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 2 EndOffset 2 newEndOffset 3 commitOffset 0 clientCommitOffset 0 cookie 3 readingFinished 0 firstRead 0
2025-11-01T04:40:13.331776Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_7_1_3711639485680171386_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 2 endOffset 3
2025-11-01T04:40:13.332581Z :DEBUG: [] MessageGroupId [source2] SessionId [source2|c57c430f-c3794348-1d2c0304-6c814096_0] Write session got write response: sequence_numbers: 1 offsets: 2 already_written: false write_statistics { persist_duration_ms: 5 queued_in_partition_duration_ms: 73 }
2025-11-01T04:40:13.331843Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-01T04:40:13.332085Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_7_1_3711639485680171386_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 2, endOffset# 3, WTime# 1761972013109, sizeLag# 1185
2025-11-01T04:40:13.332625Z :DEBUG: [] MessageGroupId [source2] SessionId [source2|c57c430f-c3794348-1d2c0304-6c814096_0] Write session: acknoledged message 1
2025-11-01T04:40:13.332109Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_7_1_3711639485680171386_v1TEvPartitionReady. Aval parts: 1
2025-11-01T04:40:13.332169Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_7_1_3711639485680171386_v1 performing read request: guid# f9bcf441-355186c-29275fd7-6d28d40f, from# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), count# 1, size# 1422, partitionsAsked# 1, maxTimeLag# 0ms
2025-11-01T04:40:13.332239Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_7_1_3711639485680171386_v1 READ FROM TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1)maxCount 1 maxSize 1422 maxTimeLagMs 0 readTimestampMs 0 readOffset 2 EndOffset 3 ClientCommitOffset 0 committedOffset 0 Guid f9bcf441-355186c-29275fd7-6d28d40f
2025-11-01T04:40:13.332651Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-01T04:40:13.332694Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-01T04:40:13.332785Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:880: [72075186224037892][Partition][0][StateIdle] read cookie 6 Topic 'rt3.dc1--topic1' partition 0 user user offset 2 partno 0 count 1 size 1422 endOffset 3 max time lag 0ms effective offset 2
2025-11-01T04:40:13.332921Z :INFO: [] MessageGroupId [source2] SessionId [source2|c57c430f-c3794348-1d2c0304-6c814096_0] Write session will now close
2025-11-01T04:40:13.332959Z :DEBUG: [] MessageGroupId [source2] SessionId [source2|c57c430f-c3794348-1d2c0304-6c814096_0] Write session: aborting
2025-11-01T04:40:13.333269Z :INFO: [] MessageGroupId [source2] SessionId [source2|c57c430f-c3794348-1d2c0304-6c814096_0] Write session: gracefully shut down, all writes complete
2025-11-01T04:40:13.333673Z :DEBUG: [] MessageGroupId [source2] SessionId [source2|c57c430f-c3794348-1d2c0304-6c814096_0] Write session: destroy
2025-11-01T04:40:13.332999Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:1105: [72075186224037892][Partition][0][StateIdle] read cookie 6 added 1 blobs, size 1185 count 1 last offset 2, current partition end offset: 3
2025-11-01T04:40:13.333023Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:1121: [72075186224037892][Partition][0][StateIdle] Reading cookie 6. Send blob request.
2025-11-01T04:40:13.333082Z node 8 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 2 partno 0 count 1 parts_count 0 source 1 size 1185 accessed 0 times before, last time 2025-11-01T04:40:13.000000Z
2025-11-01T04:40:13.334029Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_7_1_3711639485680171386_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 3 Result { Offset: 2 Data: "... 1122 bytes ..." SourceId: "\000source2" SeqNo: 1 WriteTimestampMS: 1761972013252 CreateTimestampMS: 1761972013231 UncompressedSize: 1047552 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 20 RealReadOffset: 2 WaitQuotaTimeMs: 0 EndOffset: 3 StartOffset: 0 } Cookie: 2 }
2025-11-01T04:40:13.333117Z node 8 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 6. All 1 blobs are from cache.
2025-11-01T04:40:13.333159Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:572: FormAnswer for 1 blobs
2025-11-01T04:40:13.333177Z node 8 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 2 partno 0 count 1 parts 0 suffix '63'
2025-11-01T04:40:13.333285Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 2 totakecount 1 count 1 size 1165 from pos 0 cbcount 1
2025-11-01T04:40:13.333475Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 2
2025-11-01T04:40:13.334169Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_7_1_3711639485680171386_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 4 from offset 3
2025-11-01T04:40:13.334213Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_7_1_3711639485680171386_v1 after read state TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 3 ReadOffset 3 ReadGuid f9bcf441-355186c-29275fd7-6d28d40f has messages 1
2025-11-01T04:40:13.334332Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_7_1_3711639485680171386_v1 read done: guid# f9bcf441-355186c-29275fd7-6d28d40f, partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), size# 1224
2025-11-01T04:40:13.334376Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_7_1_3711639485680171386_v1 response to read: guid# f9bcf441-355186c-29275fd7-6d28d40f
2025-11-01T04:40:13.334547Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_7_1_3711639485680171386_v1 Process answer. Aval parts: 0
2025-11-01T04:40:13.335104Z :DEBUG: [] [] [34cabe19-c16c0061-6a1e455c-44231d55] [null] After sending read request: ReadSizeBudget = 2621440, ReadSizeServerDelta = 0
2025-11-01T04:40:13.334841Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3 sessionId: source2|c57c430f-c3794348-1d2c0304-6c814096_0 grpc read done: success: 0 data: 
2025-11-01T04:40:13.334861Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 3 sessionId: source2|c57c430f-c3794348-1d2c0304-6c814096_0 grpc read failed
2025-11-01T04:40:13.334887Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 3 sessionId: source2|c57c430f-c3794348-1d2c0304-6c814096_0 grpc closed
2025-11-01T04:40:13.334903Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3 sessionId: source2|c57c430f-c3794348-1d2c0304-6c814096_0 is DEAD
2025-11-01T04:40:13.335307Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_7_1_3711639485680171386_v1 grpc read done: success# 1, data# { read { } }
2025-11-01T04:40:13.335366Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_7_1_3711639485680171386_v1 got read request: guid# df7d6854-a8e47daa-d7a9de46-3305b833
2025-11-01T04:40:13.335721Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-11-01T04:40:13.336152Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [7:7567612175713009428:2484] destroyed
2025-11-01T04:40:13.336190Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-11-01T04:40:13.336222Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T04:40:13.336236Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T04:40:13.336252Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-01T04:40:13.338673Z :DEBUG: [] MessageGroupId [source3] SessionId [] Write session: try to update token
2025-11-01T04:40:13.339400Z :INFO: [] MessageGroupId [source3] SessionId [] Write session: Do CDS request
2025-11-01T04:40:13.339440Z :INFO: [] MessageGroupId [source3] SessionId [] Start write session. Will connect to endpoint: localhost:24723
2025-11-01T04:40:13.345907Z :DEBUG: [] MessageGroupId [source3] SessionId [] Write session: send init request: init_request { topic: "topic1" message_group_id: "source3" }
2025-11-01T04:40:13.349701Z node 7 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-11-01T04:40:13.349726Z node 7 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 4
2025-11-01T04:40:13.350017Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 4 sessionId:  grpc read done: success: 1 data: init_request { topic: "topic1" message_group_id: "source3" }
2025-11-01T04:40:13.350111Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 4 topic: "topic1" message_group_id: "source3" from ipv6:[::1]:35610
2025-11-01T04:40:13.350140Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=4 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:35610 proto=v1  topic=topic1 durationSec=0
2025-11-01T04:40:13.350152Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-11-01T04:40:13.351696Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 4 sessionId:  describe result for acl check
2025-11-01T04:40:13.351858Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-11-01T04:40:13.351869Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-11-01T04:40:13.351880Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-11-01T04:40:13.351899Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [7:7567612175713009432:2488] (SourceId=source3, PreferedPartition=(NULL)) StartKqpSession
2025-11-01T04:40:13.354665Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [7:7567612175713009432:2488] (SourceId=source3, PreferedPartition=(NULL)) Select from the table
2025-11-01T04:40:13.360189Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [7:7567612175713009432:2488] (SourceId=source3, PreferedPartition=(NULL)) RequestPQRB
2025-11-01T04:40:13.360667Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1655: [72075186224037893][rt3.dc1--topic1] pipe [7:7567612175713009451:2488] connected; active server actors: 1
2025-11-01T04:40:13.360752Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [7:7567612175713009432:2488] (SourceId=source3, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=source3
2025-11-01T04:40:13.360771Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [7:7567612175713009432:2488] (SourceId=source3, PreferedPartition=(NULL)) Update the table
2025-11-01T04:40:13.361536Z node 7 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1659: [72075186224037893][rt3.dc1--topic1] pipe [7:7567612175713009451:2488] disconnected.
2025-11-01T04:40:13.361571Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1670: [72075186224037893][rt3.dc1--topic1] pipe [7:7567612175713009451:2488] disconnected; active server actors: 1
2025-11-01T04:40:13.361588Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1695: [72075186224037893][rt3.dc1--topic1] pipe [7:7567612175713009451:2488] disconnected no session
2025-11-01T04:40:13.371930Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [7:7567612175713009432:2488] (SourceId=source3, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-11-01T04:40:13.371967Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [7:7567612175713009432:2488] (SourceId=source3, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-11-01T04:40:13.371985Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [7:7567612175713009432:2488] (SourceId=source3, PreferedPartition=(NULL)) Start idle
2025-11-01T04:40:13.372017Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 4 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-11-01T04:40:13.373373Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [7:7567612175713009475:2488], now have 1 active actors on pipe
2025-11-01T04:40:13.373476Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 8, Generation: 1
2025-11-01T04:40:13.373860Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-01T04:40:13.373905Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-01T04:40:13.373985Z node 8 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie source3|7ae7912d-5e7ee3ec-98d990c6-c5bbc791_0 generated for partition 0 topic 'rt3.dc1--topic1' owner source3
2025-11-01T04:40:13.374021Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T04:40:13.374041Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T04:40:13.374053Z node 8 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-01T04:40:13.374096Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-01T04:40:13.374141Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-01T04:40:13.374188Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-01T04:40:13.377629Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-01T04:40:13.377659Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-01T04:40:13.377718Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-01T04:40:13.378002Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 4 partition: 0 MaxSeqNo: 0 sessionId: source3|7ae7912d-5e7ee3ec-98d990c6-c5bbc791_0
2025-11-01T04:40:13.378722Z :INFO: [] MessageGroupId [source3] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1761972013378 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-11-01T04:40:13.378813Z :INFO: [] MessageGroupId [source3] SessionId [] Write session established. Init response: session_id: "source3|7ae7912d-5e7ee3ec-98d990c6-c5bbc791_0" topic: "topic1" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-11-01T04:40:13.382163Z :DEBUG: [] MessageGroupId [source3] SessionId [source3|7ae7912d-5e7ee3ec-98d990c6-c5bbc791_0] Write 1 messages with Id from 1 to 1
2025-11-01T04:40:13.382263Z :INFO: [] MessageGroupId [source3] SessionId [source3|7ae7912d-5e7ee3ec-98d990c6-c5bbc791_0] Write session: close. Timeout = 10000 ms
2025-11-01T04:40:13.399594Z :DEBUG: [] MessageGroupId [source3] SessionId [source3|7ae7912d-5e7ee3ec-98d990c6-c5bbc791_0] Write session: try to update token
2025-11-01T04:40:13.399650Z :DEBUG: [] MessageGroupId [source3] SessionId [source3|7ae7912d-5e7ee3ec-98d990c6-c5bbc791_0] Send 1 message(s) (0 left), first sequence number is 1
2025-11-01T04:40:13.401209Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 4 sessionId: source3|7ae7912d-5e7ee3ec-98d990c6-c5bbc791_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-01T04:40:13.401502Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-01T04:40:13.406078Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-01T04:40:13.406127Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-01T04:40:13.406205Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-11-01T04:40:13.408818Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-01T04:40:13.409518Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-01T04:40:13.409555Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-01T04:40:13.409609Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: '\0source3' SeqNo: 1 partNo : 0 messageNo: 1 size 1122 offset: -1
2025-11-01T04:40:13.409649Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-01T04:40:13.409690Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T04:40:13.409717Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T04:40:13.409729Z node 8 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-01T04:40:13.409829Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId '\0source3' seqNo 1 partNo 0
2025-11-01T04:40:13.410662Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '\0source3' seqNo 1 partNo 0 FormedBlobsCount 0 NewHead: Offset 3 PartNo 0 PackedSize 1197 count 1 nextOffset 4 batches 1
2025-11-01T04:40:13.410700Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-01T04:40:13.411198Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 3,1 HeadOffset 3 endOffset 3 curOffset 4 d0000000000_00000000000000000003_00000_0000000001_00000? size 1185 WTime 1761972013410
2025-11-01T04:40:13.411344Z node 8 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-01T04:40:13.411452Z node 8 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 3 partNo 0 count 1 size 1185
2025-11-01T04:40:13.416268Z node 8 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 3 count 1 size 1185 actorID [8:7567612172196730934:2358]
2025-11-01T04:40:13.416322Z node 8 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-01T04:40:13.416371Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1130 WriteNewSizeFromSupportivePartitions# 0
2025-11-01T04:40:13.416370Z node 8 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 3 partno 0 count 1 parts 0 suffix '63' size 1185
2025-11-01T04:40:13.416401Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-01T04:40:13.416779Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 1 consumer shared/user session shared/user_7_1_3711639485680171386_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 3 EndOffset 3 newEndOffset 4 commitOffset 0 clientCommitOffset 0 cookie 4 readingFinished 0 firstRead 0
2025-11-01T04:40:13.416437Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0source3', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 1, partNo: 0, Offset: 3 is stored on disk
2025-11-01T04:40:13.416630Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T04:40:13.416813Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_7_1_3711639485680171386_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 3 endOffset 4
2025-11-01T04:40:13.416645Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T04:40:13.416858Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_7_1_3711639485680171386_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 3, endOffset# 4, WTime# 1761972013252, sizeLag# 1185
2025-11-01T04:40:13.416659Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-01T04:40:13.416686Z node 8 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-01T04:40:13.416875Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_7_1_3711639485680171386_v1TEvPartitionReady. Aval parts: 1
2025-11-01T04:40:13.416721Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 1  requestId: <none> cookie: 1
2025-11-01T04:40:13.416923Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_7_1_3711639485680171386_v1 performing read request: guid# df7d6854-a8e47daa-d7a9de46-3305b833, from# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), count# 1, size# 1422, partitionsAsked# 1, maxTimeLag# 0ms
2025-11-01T04:40:13.416975Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_7_1_3711639485680171386_v1 READ FROM TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1)maxCount 1 maxSize 1422 maxTimeLagMs 0 readTimestampMs 0 readOffset 3 EndOffset 4 ClientCommitOffset 0 committedOffset 0 Guid df7d6854-a8e47daa-d7a9de46-3305b833
2025-11-01T04:40:13.422266Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-01T04:40:13.423154Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-01T04:40:13.423192Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-01T04:40:13.423296Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:880: [72075186224037892][Partition][0][StateIdle] read cookie 7 Topic 'rt3.dc1--topic1' partition 0 user user offset 3 partno 0 count 1 size 1422 endOffset 4 max time lag 0ms effective offset 3
2025-11-01T04:40:13.423494Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:1105: [72075186224037892][Partition][0][StateIdle] read cookie 7 added 1 blobs, size 1185 count 1 last offset 3, current partition end offset: 4
2025-11-01T04:40:13.423518Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:1121: [72075186224037892][Partition][0][StateIdle] Reading cookie 7. Send blob request.
2025-11-01T04:40:13.423562Z node 8 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 3 partno 0 count 1 parts_count 0 source 1 size 1185 accessed 0 times before, last time 2025-11-01T04:40:13.000000Z
2025-11-01T04:40:13.423597Z node 8 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 7. All 1 blobs are from cache.
2025-11-01T04:40:13.423642Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:572: FormAnswer for 1 blobs
2025-11-01T04:40:13.423781Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 3 totakecount 1 count 1 size 1165 from pos 0 cbcount 1
2025-11-01T04:40:13.423876Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 3
2025-11-01T04:40:13.424370Z node 8 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 3 partno 0 count 1 parts 0 suffix '63'
2025-11-01T04:40:13.424806Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_7_1_3711639485680171386_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 4 Result { Offset: 3 Data: "... 1122 bytes ..." SourceId: "\000source3" SeqNo: 1 WriteTimestampMS: 1761972013409 CreateTimestampMS: 1761972013381 UncompressedSize: 1047552 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 20 RealReadOffset: 3 WaitQuotaTimeMs: 0 EndOffset: 4 StartOffset: 0 } Cookie: 3 }
2025-11-01T04:40:13.424938Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_7_1_3711639485680171386_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 5 from offset 4
2025-11-01T04:40:13.424982Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_7_1_3711639485680171386_v1 after read state TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 4 ReadOffset 4 ReadGuid df7d6854-a8e47daa-d7a9de46-3305b833 has messages 1
2025-11-01T04:40:13.425117Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_7_1_3711639485680171386_v1 read done: guid# df7d6854-a8e47daa-d7a9de46-3305b833, partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), size# 1224
2025-11-01T04:40:13.425159Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_7_1_3711639485680171386_v1 response to read: guid# df7d6854-a8e47daa-d7a9de46-3305b833
2025-11-01T04:40:13.425300Z :DEBUG: [] MessageGroupId [source3] SessionId [source3|7ae7912d-5e7ee3ec-98d990c6-c5bbc791_0] Write session got write response: sequence_numbers: 1 offsets: 3 already_written: false write_statistics { persist_duration_ms: 5 queued_in_partition_duration_ms: 1 }
2025-11-01T04:40:13.425355Z :DEBUG: [] MessageGroupId [source3] SessionId [source3|7ae7912d-5e7ee3ec-98d990c6-c5bbc791_0] Write session: acknoledged message 1
2025-11-01T04:40:13.425393Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_7_1_3711639485680171386_v1 Process answer. Aval parts: 0
2025-11-01T04:40:13.426542Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T04:40:13.426570Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T04:40:13.426585Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-01T04:40:13.429544Z :DEBUG: [] [] [34cabe19-c16c0061-6a1e455c-44231d55] [null] After sending read request: ReadSizeBudget = 2621440, ReadSizeServerDelta = 0
2025-11-01T04:40:13.430024Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_7_1_3711639485680171386_v1 grpc read done: success# 1, data# { read { } }
2025-11-01T04:40:13.430162Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_7_1_3711639485680171386_v1 got read request: guid# d679ae8b-358ce8ee-5969d487-c957710
2025-11-01T04:40:13.482393Z :INFO: [] MessageGroupId [source3] SessionId [source3|7ae7912d-5e7ee3ec-98d990c6-c5bbc791_0] Write session will now close
2025-11-01T04:40:13.482448Z :DEBUG: [] MessageGroupId [source3] SessionId [source3|7ae7912d-5e7ee3ec-98d990c6-c5bbc791_0] Write session: aborting
2025-11-01T04:40:13.482864Z :INFO: [] MessageGroupId [source3] SessionId [source3|7ae7912d-5e7ee3ec-98d990c6-c5bbc791_0] Write session: gracefully shut down, all writes complete
2025-11-01T04:40:13.483312Z :DEBUG: [] MessageGroupId [source3] SessionId [source3|7ae7912d-5e7ee3ec-98d990c6-c5bbc791_0] Write session: destroy
2025-11-01T04:40:13.483955Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 4 sessionId: source3|7ae7912d-5e7ee3ec-98d990c6-c5bbc791_0 grpc read done: success: 0 data: 
2025-11-01T04:40:13.483981Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 4 sessionId: source3|7ae7912d-5e7ee3ec-98d990c6-c5bbc791_0 grpc read failed
2025-11-01T04:40:13.484010Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 4 sessionId: source3|7ae7912d-5e7ee3ec-98d990c6-c5bbc791_0 grpc closed
2025-11-01T04:40:13.484027Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 4 sessionId: source3|7ae7912d-5e7ee3ec-98d990c6-c5bbc791_0 is DEAD
2025-11-01T04:40:13.484811Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-11-01T04:40:13.485457Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [7:7567612175713009475:2488] destroyed
2025-11-01T04:40:13.485517Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-11-01T04:40:13.485557Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T04:40:13.485571Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T04:40:13.485586Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-01T04:40:13.489623Z :DEBUG: [] MessageGroupId [source4] SessionId [] Write session: try to update token
2025-11-01T04:40:13.489957Z :INFO: [] MessageGroupId [source4] SessionId [] Write session: Do CDS request
2025-11-01T04:40:13.489980Z :INFO: [] MessageGroupId [source4] SessionId [] Start write session. Will connect to endpoint: localhost:24723
2025-11-01T04:40:13.493924Z :DEBUG: [] MessageGroupId [source4] SessionId [] Write session: send init request: init_request { topic: "topic1" message_group_id: "source4" }
2025-11-01T04:40:13.494470Z node 7 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-11-01T04:40:13.494494Z node 7 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 5
2025-11-01T04:40:13.494709Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 5 sessionId:  grpc read done: success: 1 data: init_request { topic: "topic1" message_group_id: "source4" }
2025-11-01T04:40:13.494789Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 5 topic: "topic1" message_group_id: "source4" from ipv6:[::1]:35610
2025-11-01T04:40:13.494801Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=5 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:35610 proto=v1  topic=topic1 durationSec=0
2025-11-01T04:40:13.494809Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-11-01T04:40:13.496020Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 5 sessionId:  describe result for acl check
2025-11-01T04:40:13.496112Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-11-01T04:40:13.496119Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-11-01T04:40:13.496125Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-11-01T04:40:13.496138Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [7:7567612175713009489:2500] (SourceId=source4, PreferedPartition=(NULL)) StartKqpSession
2025-11-01T04:40:13.498482Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [7:7567612175713009489:2500] (SourceId=source4, PreferedPartition=(NULL)) Select from the table
2025-11-01T04:40:13.506521Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [7:7567612175713009489:2500] (SourceId=source4, PreferedPartition=(NULL)) RequestPQRB
2025-11-01T04:40:13.507141Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1655: [72075186224037893][rt3.dc1--topic1] pipe [7:7567612175713009508:2500] connected; active server actors: 1
2025-11-01T04:40:13.507210Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [7:7567612175713009489:2500] (SourceId=source4, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=source4
2025-11-01T04:40:13.507232Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [7:7567612175713009489:2500] (SourceId=source4, PreferedPartition=(NULL)) Update the table
2025-11-01T04:40:13.507568Z node 7 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1659: [72075186224037893][rt3.dc1--topic1] pipe [7:7567612175713009508:2500] disconnected.
2025-11-01T04:40:13.507600Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1670: [72075186224037893][rt3.dc1--topic1] pipe [7:7567612175713009508:2500] disconnected; active server actors: 1
2025-11-01T04:40:13.507616Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1695: [72075186224037893][rt3.dc1--topic1] pipe [7:7567612175713009508:2500] disconnected no session
2025-11-01T04:40:13.515405Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [7:7567612175713009489:2500] (SourceId=source4, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-11-01T04:40:13.515449Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [7:7567612175713009489:2500] (SourceId=source4, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-11-01T04:40:13.515500Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [7:7567612175713009489:2500] (SourceId=source4, PreferedPartition=(NULL)) Start idle
2025-11-01T04:40:13.515545Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 5 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-11-01T04:40:13.517122Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [7:7567612175713009522:2500], now have 1 active actors on pipe
2025-11-01T04:40:13.517152Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 8, Generation: 1
2025-11-01T04:40:13.517358Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-01T04:40:13.517400Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-01T04:40:13.517470Z node 8 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie source4|1abc522b-707fc275-77b37796-ee7d035c_0 generated for partition 0 topic 'rt3.dc1--topic1' owner source4
2025-11-01T04:40:13.517505Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T04:40:13.517524Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T04:40:13.517537Z node 8 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-01T04:40:13.517579Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-01T04:40:13.517624Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-01T04:40:13.517674Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-01T04:40:13.518592Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-01T04:40:13.518615Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-01T04:40:13.518682Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-01T04:40:13.518954Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 5 partition: 0 MaxSeqNo: 0 sessionId: source4|1abc522b-707fc275-77b37796-ee7d035c_0
2025-11-01T04:40:13.519652Z :INFO: [] MessageGroupId [source4] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1761972013519 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-11-01T04:40:13.519773Z :INFO: [] MessageGroupId [source4] SessionId [] Write session established. Init response: session_id: "source4|1abc522b-707fc275-77b37796-ee7d035c_0" topic: "topic1" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-11-01T04:40:13.520834Z :DEBUG: [] MessageGroupId [source4] SessionId [source4|1abc522b-707fc275-77b37796-ee7d035c_0] Write 1 messages with Id from 1 to 1
2025-11-01T04:40:13.520896Z :INFO: [] MessageGroupId [source4] SessionId [source4|1abc522b-707fc275-77b37796-ee7d035c_0] Write session: close. Timeout = 10000 ms
2025-11-01T04:40:13.526863Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T04:40:13.526896Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T04:40:13.526912Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-01T04:40:13.541611Z :DEBUG: [] MessageGroupId [source4] SessionId [source4|1abc522b-707fc275-77b37796-ee7d035c_0] Write session: try to update token
2025-11-01T04:40:13.541664Z :DEBUG: [] MessageGroupId [source4] SessionId [source4|1abc522b-707fc275-77b37796-ee7d035c_0] Send 1 message(s) (0 left), first sequence number is 1
2025-11-01T04:40:13.543586Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 5 sessionId: source4|1abc522b-707fc275-77b37796-ee7d035c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-01T04:40:13.543937Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-01T04:40:13.544370Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-01T04:40:13.544426Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-01T04:40:13.544521Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-11-01T04:40:13.544705Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-01T04:40:13.545029Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-01T04:40:13.545073Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-01T04:40:13.545149Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: '\0source4' SeqNo: 1 partNo : 0 messageNo: 1 size 1122 offset: -1
2025-11-01T04:40:13.545201Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-01T04:40:13.545253Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T04:40:13.545286Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T04:40:13.545301Z node 8 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-01T04:40:13.545427Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId '\0source4' seqNo 1 partNo 0
2025-11-01T04:40:13.582720Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '\0source4' seqNo 1 partNo 0 FormedBlobsCount 0 NewHead: Offset 4 PartNo 0 PackedSize 1197 count 1 nextOffset 5 batches 1
2025-11-01T04:40:13.582791Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-01T04:40:13.583323Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 4,1 HeadOffset 4 endOffset 4 curOffset 5 d0000000000_00000000000000000004_00000_0000000001_00000? size 1185 WTime 1761972013583
2025-11-01T04:40:13.583575Z node 8 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-01T04:40:13.583713Z node 8 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 4 partNo 0 count 1 size 1185
2025-11-01T04:40:13.589041Z node 8 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 4 count 1 size 1185 actorID [8:7567612172196730934:2358]
2025-11-01T04:40:13.589126Z node 8 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-01T04:40:13.589182Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1130 WriteNewSizeFromSupportivePartitions# 0
2025-11-01T04:40:13.589183Z node 8 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 4 partno 0 count 1 parts 0 suffix '63' size 1185
2025-11-01T04:40:13.589235Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-01T04:40:13.589277Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0source4', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 1, partNo: 0, Offset: 4 is stored on disk
2025-11-01T04:40:13.589525Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T04:40:13.589543Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T04:40:13.589558Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-01T04:40:13.589599Z node 8 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-01T04:40:13.589648Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 1  requestId: <none> cookie: 1
2025-11-01T04:40:13.589709Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 1 consumer shared/user session shared/user_7_1_3711639485680171386_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 4 EndOffset 4 newEndOffset 5 commitOffset 0 clientCommitOffset 0 cookie 5 readingFinished 0 firstRead 0
2025-11-01T04:40:13.589759Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_7_1_3711639485680171386_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 4 endOffset 5
2025-11-01T04:40:13.589816Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_7_1_3711639485680171386_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 4, endOffset# 5, WTime# 1761972013409, sizeLag# 1185
2025-11-01T04:40:13.589835Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_7_1_3711639485680171386_v1TEvPartitionReady. Aval parts: 1
2025-11-01T04:40:13.589876Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_7_1_3711639485680171386_v1 performing read request: guid# d679ae8b-358ce8ee-5969d487-c957710, from# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), count# 1, size# 1422, partitionsAsked# 1, maxTimeLag# 0ms
2025-11-01T04:40:13.589920Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-01T04:40:13.590345Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_7_1_3711639485680171386_v1 READ FROM TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1)maxCount 1 maxSize 1422 maxTimeLagMs 0 readTimestampMs 0 readOffset 4 EndOffset 5 ClientCommitOffset 0 committedOffset 0 Guid d679ae8b-358ce8ee-5969d487-c957710
2025-11-01T04:40:13.590667Z :DEBUG: [] MessageGroupId [source4] SessionId [source4|1abc522b-707fc275-77b37796-ee7d035c_0] Write session got write response: sequence_numbers: 1 offsets: 4 already_written: false write_statistics { persist_duration_ms: 6 queued_in_partition_duration_ms: 37 }
2025-11-01T04:40:13.590719Z :DEBUG: [] MessageGroupId [source4] SessionId [source4|1abc522b-707fc275-77b37796-ee7d035c_0] Write session: acknoledged message 1
2025-11-01T04:40:13.590701Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-01T04:40:13.590736Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-01T04:40:13.590851Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:880: [72075186224037892][Partition][0][StateIdle] read cookie 8 Topic 'rt3.dc1--topic1' partition 0 user user offset 4 partno 0 count 1 size 1422 endOffset 5 max time lag 0ms effective offset 4
2025-11-01T04:40:13.591066Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:1105: [72075186224037892][Partition][0][StateIdle] read cookie 8 added 1 blobs, size 1185 count 1 last offset 4, current partition end offset: 5
2025-11-01T04:40:13.591083Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:1121: [72075186224037892][Partition][0][StateIdle] Reading cookie 8. Send blob request.
2025-11-01T04:40:13.591127Z node 8 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 4 partno 0 count 1 parts_count 0 source 1 size 1185 accessed 0 times before, last time 2025-11-01T04:40:13.000000Z
2025-11-01T04:40:13.591161Z node 8 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 8. All 1 blobs are from cache.
2025-11-01T04:40:13.591195Z node 8 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 4 partno 0 count 1 parts 0 suffix '63'
2025-11-01T04:40:13.591205Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:572: FormAnswer for 1 blobs
2025-11-01T04:40:13.591332Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 4 totakecount 1 count 1 size 1165 from pos 0 cbcount 1
2025-11-01T04:40:13.591428Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 4
2025-11-01T04:40:13.591888Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_7_1_3711639485680171386_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 5 Result { Offset: 4 Data: "... 1122 bytes ..." SourceId: "\000source4" SeqNo: 1 WriteTimestampMS: 1761972013545 CreateTimestampMS: 1761972013520 UncompressedSize: 1047552 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 20 RealReadOffset: 4 WaitQuotaTimeMs: 0 EndOffset: 5 StartOffset: 0 } Cookie: 4 }
2025-11-01T04:40:13.591983Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_7_1_3711639485680171386_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 6 from offset 5
2025-11-01T04:40:13.592011Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_7_1_3711639485680171386_v1 after read state TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 5 ReadOffset 5 ReadGuid d679ae8b-358ce8ee-5969d487-c957710 has messages 1
2025-11-01T04:40:13.592117Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_7_1_3711639485680171386_v1 read done: guid# d679ae8b-358ce8ee-5969d487-c957710, partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), size# 1224
2025-11-01T04:40:13.592146Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_7_1_3711639485680171386_v1 response to read: guid# d679ae8b-358ce8ee-5969d487-c957710
2025-11-01T04:40:13.592329Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_7_1_3711639485680171386_v1 Process answer. Aval parts: 0
2025-11-01T04:40:13.593746Z :DEBUG: [] [] [34cabe19-c16c0061-6a1e455c-44231d55] [null] After sending read request: ReadSizeBudget = 2621440, ReadSizeServerDelta = 0
2025-11-01T04:40:13.594038Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_7_1_3711639485680171386_v1 grpc read done: success# 1, data# { read { } }
2025-11-01T04:40:13.594120Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_7_1_3711639485680171386_v1 got read request: guid# 6054a63c-440c940b-31eaf306-90ffd94c
2025-11-01T04:40:13.595223Z :INFO: [] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:topic1:0:1:4:0
2025-11-01T04:40:13.595276Z :INFO: [] [] [34cabe19-c16c0061-6a1e455c-44231d55] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1004 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 5250 BytesInflightTotal: 5250 MessagesInflight: 5 }
2025-11-01T04:40:13.621010Z :INFO: [] MessageGroupId [source4] SessionId [source4|1abc522b-707fc275-77b37796-ee7d035c_0] Write session will now close
2025-11-01T04:40:13.621081Z :DEBUG: [] MessageGroupId [source4] SessionId [source4|1abc522b-707fc275-77b37796-ee7d035c_0] Write session: aborting
2025-11-01T04:40:13.621445Z :INFO: [] MessageGroupId [source4] SessionId [source4|1abc522b-707fc275-77b37796-ee7d035c_0] Write session: gracefully shut down, all writes complete
2025-11-01T04:40:13.621815Z :DEBUG: [] MessageGroupId [source4] SessionId [source4|1abc522b-707fc275-77b37796-ee7d035c_0] Write session: destroy
2025-11-01T04:40:13.623354Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 5 sessionId: source4|1abc522b-707fc275-77b37796-ee7d035c_0 grpc read done: success: 0 data: 
2025-11-01T04:40:13.623378Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 5 sessionId: source4|1abc522b-707fc275-77b37796-ee7d035c_0 grpc read failed
2025-11-01T04:40:13.623402Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 5 sessionId: source4|1abc522b-707fc275-77b37796-ee7d035c_0 grpc closed
2025-11-01T04:40:13.623420Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 5 sessionId: source4|1abc522b-707fc275-77b37796-ee7d035c_0 is DEAD
2025-11-01T04:40:13.624073Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-11-01T04:40:13.624468Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [7:7567612175713009522:2500] destroyed
2025-11-01T04:40:13.624515Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-11-01T04:40:13.624541Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T04:40:13.624551Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T04:40:13.624563Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-01T04:40:13.625276Z :DEBUG: [] MessageGroupId [source5] SessionId [] Write session: try to update token
2025-11-01T04:40:13.625543Z :INFO: [] MessageGroupId [source5] SessionId [] Write session: Do CDS request
2025-11-01T04:40:13.625566Z :INFO: [] MessageGroupId [source5] SessionId [] Start write session. Will connect to endpoint: localhost:24723
2025-11-01T04:40:13.629589Z :DEBUG: [] MessageGroupId [source5] SessionId [] Write session: send init request: init_request { topic: "topic1" message_group_id: "source5" }
2025-11-01T04:40:13.630160Z node 7 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-11-01T04:40:13.630192Z node 7 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 6
2025-11-01T04:40:13.630596Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 6 sessionId:  grpc read done: success: 1 data: init_request { topic: "topic1" message_group_id: "source5" }
2025-11-01T04:40:13.630716Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 6 topic: "topic1" message_group_id: "source5" from ipv6:[::1]:35610
2025-11-01T04:40:13.630734Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=6 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:35610 proto=v1  topic=topic1 durationSec=0
2025-11-01T04:40:13.630745Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-11-01T04:40:13.627222Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T04:40:13.627248Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T04:40:13.627264Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-01T04:40:13.632308Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 6 sessionId:  describe result for acl check
2025-11-01T04:40:13.632427Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-11-01T04:40:13.632438Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-11-01T04:40:13.632447Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-11-01T04:40:13.632467Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [7:7567612175713009528:2504] (SourceId=source5, PreferedPartition=(NULL)) StartKqpSession
2025-11-01T04:40:13.635596Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [7:7567612175713009528:2504] (SourceId=source5, PreferedPartition=(NULL)) Select from the table
2025-11-01T04:40:13.642086Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [7:7567612175713009528:2504] (SourceId=source5, PreferedPartition=(NULL)) RequestPQRB
2025-11-01T04:40:13.642873Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1655: [72075186224037893][rt3.dc1--topic1] pipe [7:7567612175713009547:2504] connected; active server actors: 1
2025-11-01T04:40:13.642964Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [7:7567612175713009528:2504] (SourceId=source5, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=source5
2025-11-01T04:40:13.642989Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [7:7567612175713009528:2504] (SourceId=source5, PreferedPartition=(NULL)) Update the table
2025-11-01T04:40:13.643261Z node 7 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1659: [72075186224037893][rt3.dc1--topic1] pipe [7:7567612175713009547:2504] disconnected.
2025-11-01T04:40:13.643287Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1670: [72075186224037893][rt3.dc1--topic1] pipe [7:7567612175713009547:2504] disconnected; active server actors: 1
2025-11-01T04:40:13.643299Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1695: [72075186224037893][rt3.dc1--topic1] pipe [7:7567612175713009547:2504] disconnected no session
2025-11-01T04:40:13.654762Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [7:7567612175713009528:2504] (SourceId=source5, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-11-01T04:40:13.654791Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [7:7567612175713009528:2504] (SourceId=source5, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-11-01T04:40:13.654804Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [7:7567612175713009528:2504] (SourceId=source5, PreferedPartition=(NULL)) Start idle
2025-11-01T04:40:13.654829Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 6 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-11-01T04:40:13.656287Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 8, Generation: 1
2025-11-01T04:40:13.656101Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [7:7567612175713009561:2504], now have 1 active actors on pipe
2025-11-01T04:40:13.656542Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-01T04:40:13.656572Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-01T04:40:13.656651Z node 8 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie source5|c072cf13-383797d8-b1ccdaa6-174369f4_0 generated for partition 0 topic 'rt3.dc1--topic1' owner source5
2025-11-01T04:40:13.656688Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T04:40:13.656710Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T04:40:13.656723Z node 8 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-01T04:40:13.656766Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-01T04:40:13.656815Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-01T04:40:13.656866Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-01T04:40:13.657726Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 6 partition: 0 MaxSeqNo: 0 sessionId: source5|c072cf13-383797d8-b1ccdaa6-174369f4_0
2025-11-01T04:40:13.658309Z :INFO: [] MessageGroupId [source5] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1761972013658 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-11-01T04:40:13.658402Z :INFO: [] MessageGroupId [source5] SessionId [] Write session established. Init response: session_id: "source5|c072cf13-383797d8-b1ccdaa6-174369f4_0" topic: "topic1" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-11-01T04:40:13.659653Z :DEBUG: [] MessageGroupId [source5] SessionId [source5|c072cf13-383797d8-b1ccdaa6-174369f4_0] Write 1 messages with Id from 1 to 1
2025-11-01T04:40:13.659757Z :INFO: [] MessageGroupId [source5] SessionId [source5|c072cf13-383797d8-b1ccdaa6-174369f4_0] Write session: close. Timeout = 10000 ms
2025-11-01T04:40:13.657428Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-01T04:40:13.657447Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-01T04:40:13.657493Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-01T04:40:13.676397Z :DEBUG: [] MessageGroupId [source5] SessionId [source5|c072cf13-383797d8-b1ccdaa6-174369f4_0] Write session: try to update token
2025-11-01T04:40:13.676449Z :DEBUG: [] MessageGroupId [source5] SessionId [source5|c072cf13-383797d8-b1ccdaa6-174369f4_0] Send 1 message(s) (0 left), first sequence number is 1
2025-11-01T04:40:13.677368Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 6 sessionId: source5|c072cf13-383797d8-b1ccdaa6-174369f4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-01T04:40:13.677592Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-01T04:40:13.678428Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-01T04:40:13.678098Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-01T04:40:13.678139Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-01T04:40:13.678213Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-11-01T04:40:13.678750Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-01T04:40:13.678768Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-01T04:40:13.678821Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: '\0source5' SeqNo: 1 partNo : 0 messageNo: 1 size 1122 offset: -1
2025-11-01T04:40:13.678857Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-01T04:40:13.678902Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T04:40:13.678929Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T04:40:13.678943Z node 8 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-01T04:40:13.679058Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId '\0source5' seqNo 1 partNo 0
2025-11-01T04:40:13.679928Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '\0source5' seqNo 1 partNo 0 FormedBlobsCount 0 NewHead: Offset 5 PartNo 0 PackedSize 1197 count 1 nextOffset 6 batches 1
2025-11-01T04:40:13.679967Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-01T04:40:13.680488Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 5,1 HeadOffset 5 endOffset 5 curOffset 6 d0000000000_00000000000000000005_00000_0000000001_00000? size 1185 WTime 1761972013680
2025-11-01T04:40:13.680642Z node 8 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-01T04:40:13.680762Z node 8 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 5 partNo 0 count 1 size 1185
2025-11-01T04:40:13.686532Z node 8 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 5 count 1 size 1185 actorID [8:7567612172196730934:2358]
2025-11-01T04:40:13.686610Z node 8 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-01T04:40:13.686669Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1130 WriteNewSizeFromSupportivePartitions# 0
2025-11-01T04:40:13.686707Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-01T04:40:13.686750Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0source5', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 1, partNo: 0, Offset: 5 is stored on disk
2025-11-01T04:40:13.686993Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T04:40:13.687018Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T04:40:13.687034Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-01T04:40:13.687065Z node 8 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-01T04:40:13.687106Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 1  requestId: <none> cookie: 1
2025-11-01T04:40:13.687151Z node 8 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 5 partno 0 count 1 parts 0 suffix '63' size 1185
2025-11-01T04:40:13.687405Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 1 consumer shared/user session shared/user_7_1_3711639485680171386_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 5 EndOffset 5 newEndOffset 6 commitOffset 0 clientCommitOffset 0 cookie 6 readingFinished 0 firstRead 0
2025-11-01T04:40:13.687439Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_7_1_3711639485680171386_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 5 endOffset 6
2025-11-01T04:40:13.687485Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-01T04:40:13.687871Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_7_1_3711639485680171386_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 5, endOffset# 6, WTime# 1761972013545, sizeLag# 1185
2025-11-01T04:40:13.687889Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_7_1_3711639485680171386_v1TEvPartitionReady. Aval parts: 1
2025-11-01T04:40:13.687941Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_7_1_3711639485680171386_v1 performing read request: guid# 6054a63c-440c940b-31eaf306-90ffd94c, from# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), count# 1, size# 1422, partitionsAsked# 1, maxTimeLag# 0ms
2025-11-01T04:40:13.687993Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_7_1_3711639485680171386_v1 READ FROM TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1)maxCount 1 maxSize 1422 maxTimeLagMs 0 readTimestampMs 0 readOffset 5 EndOffset 6 ClientCommitOffset 0 committedOffset 0 Guid 6054a63c-440c940b-31eaf306-90ffd94c
2025-11-01T04:40:13.688474Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-01T04:40:13.688510Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-01T04:40:13.688615Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:880: [72075186224037892][Partition][0][StateIdle] read cookie 9 Topic 'rt3.dc1--topic1' partition 0 user user offset 5 partno 0 count 1 size 1422 endOffset 6 max time lag 0ms effective offset 5
2025-11-01T04:40:13.688749Z :DEBUG: [] MessageGroupId [source5] SessionId [source5|c072cf13-383797d8-b1ccdaa6-174369f4_0] Write session got write response: sequence_numbers: 1 offsets: 5 already_written: false write_statistics { persist_duration_ms: 7 }
2025-11-01T04:40:13.688789Z :DEBUG: [] MessageGroupId [source5] SessionId [source5|c072cf13-383797d8-b1ccdaa6-174369f4_0] Write session: acknoledged message 1
2025-11-01T04:40:13.688861Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:1105: [72075186224037892][Partition][0][StateIdle] read cookie 9 added 1 blobs, size 1185 count 1 last offset 5, current partition end offset: 6
2025-11-01T04:40:13.688893Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:1121: [72075186224037892][Partition][0][StateIdle] Reading cookie 9. Send blob request.
2025-11-01T04:40:13.688942Z node 8 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 5 partno 0 count 1 parts_count 0 source 1 size 1185 accessed 0 times before, last time 2025-11-01T04:40:13.000000Z
2025-11-01T04:40:13.688979Z node 8 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 9. All 1 blobs are from cache.
2025-11-01T04:40:13.689025Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:572: FormAnswer for 1 blobs
2025-11-01T04:40:13.689041Z node 8 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 5 partno 0 count 1 parts 0 suffix '63'
2025-11-01T04:40:13.689170Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 5 totakecount 1 count 1 size 1165 from pos 0 cbcount 1
2025-11-01T04:40:13.689272Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 5
2025-11-01T04:40:13.689769Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_7_1_3711639485680171386_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 6 Result { Offset: 5 Data: "... 1122 bytes ..." SourceId: "\000source5" SeqNo: 1 WriteTimestampMS: 1761972013678 CreateTimestampMS: 1761972013658 UncompressedSize: 1047552 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 20 RealReadOffset: 5 WaitQuotaTimeMs: 0 EndOffset: 6 StartOffset: 0 } Cookie: 5 }
2025-11-01T04:40:13.689901Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_7_1_3711639485680171386_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 7 from offset 6
2025-11-01T04:40:13.689941Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_7_1_3711639485680171386_v1 after read state TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 6 ReadOffset 6 ReadGuid 6054a63c-440c940b-31eaf306-90ffd94c has messages 1
2025-11-01T04:40:13.690054Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_7_1_3711639485680171386_v1 read done: guid# 6054a63c-440c940b-31eaf306-90ffd94c, partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), size# 1224
2025-11-01T04:40:13.690083Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_7_1_3711639485680171386_v1 response to read: guid# 6054a63c-440c940b-31eaf306-90ffd94c
2025-11-01T04:40:13.690286Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_7_1_3711639485680171386_v1 Process answer. Aval parts: 0
2025-11-01T04:40:13.691016Z :DEBUG: [] [] [34cabe19-c16c0061-6a1e455c-44231d55] [null] After sending read request: ReadSizeBudget = 2621440, ReadSizeServerDelta = 0
2025-11-01T04:40:13.691331Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_7_1_3711639485680171386_v1 grpc read done: success# 1, data# { read { } }
2025-11-01T04:40:13.691427Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_7_1_3711639485680171386_v1 got read request: guid# 86ccb22a-32071004-972d097a-3f8643c6
2025-11-01T04:40:13.727626Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T04:40:13.727663Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T04:40:13.727679Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-01T04:40:13.761195Z :INFO: [] MessageGroupId [source5] SessionId [source5|c072cf13-383797d8-b1ccdaa6-174369f4_0] Write session will now close
2025-11-01T04:40:13.761235Z :DEBUG: [] MessageGroupId [source5] SessionId [source5|c072cf13-383797d8-b1ccdaa6-174369f4_0] Write session: aborting
2025-11-01T04:40:13.762156Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 6 sessionId: source5|c072cf13-383797d8-b1ccdaa6-174369f4_0 grpc read done: success: 0 data: 
2025-11-01T04:40:13.762184Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 6 sessionId: source5|c072cf13-383797d8-b1ccdaa6-174369f4_0 grpc read failed
2025-11-01T04:40:13.762211Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 6 sessionId: source5|c072cf13-383797d8-b1ccdaa6-174369f4_0 grpc closed
2025-11-01T04:40:13.762233Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 6 sessionId: source5|c072cf13-383797d8-b1ccdaa6-174369f4_0 is DEAD
2025-11-01T04:40:13.763116Z :INFO: [] MessageGroupId [source5] SessionId [source5|c072cf13-383797d8-b1ccdaa6-174369f4_0] Write session: gracefully shut down, all writes complete
2025-11-01T04:40:13.763005Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-11-01T04:40:13.763705Z :DEBUG: [] MessageGroupId [source5] SessionId [source5|c072cf13-383797d8-b1ccdaa6-174369f4_0] Write session is aborting and will not restart
2025-11-01T04:40:13.763683Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [7:7567612175713009561:2504] destroyed
2025-11-01T04:40:13.763752Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-11-01T04:40:13.763826Z :DEBUG: [] MessageGroupId [source5] SessionId [source5|c072cf13-383797d8-b1ccdaa6-174369f4_0] Write session: destroy
2025-11-01T04:40:13.763789Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T04:40:13.763805Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T04:40:13.763824Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-01T04:40:13.765004Z :DEBUG: [] MessageGroupId [source6] SessionId [] Write session: try to update token
2025-11-01T04:40:13.765319Z :INFO: [] MessageGroupId [source6] SessionId [] Write session: Do CDS request
2025-11-01T04:40:13.765344Z :INFO: [] MessageGroupId [source6] SessionId [] Start write session. Will connect to endpoint: localhost:24723
2025-11-01T04:40:13.768527Z :DEBUG: [] MessageGroupId [source6] SessionId [] Write session: send init request: init_request { topic: "topic1" message_group_id: "source6" }
2025-11-01T04:40:13.768935Z node 7 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-11-01T04:40:13.768960Z node 7 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 7
2025-11-01T04:40:13.769351Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 7 sessionId:  grpc read done: success: 1 data: init_request { topic: "topic1" message_group_id: "source6" }
2025-11-01T04:40:13.769475Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 7 topic: "topic1" message_group_id: "source6" from ipv6:[::1]:35610
2025-11-01T04:40:13.769487Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=7 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:35610 proto=v1  topic=topic1 durationSec=0
2025-11-01T04:40:13.769496Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-11-01T04:40:13.770659Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 7 sessionId:  describe result for acl check
2025-11-01T04:40:13.770748Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-11-01T04:40:13.770762Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-11-01T04:40:13.770768Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-11-01T04:40:13.770783Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [7:7567612175713009595:2514] (SourceId=source6, PreferedPartition=(NULL)) StartKqpSession
2025-11-01T04:40:13.772944Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [7:7567612175713009595:2514] (SourceId=source6, PreferedPartition=(NULL)) Select from the table
2025-11-01T04:40:13.780782Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [7:7567612175713009595:2514] (SourceId=source6, PreferedPartition=(NULL)) RequestPQRB
2025-11-01T04:40:13.781133Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1655: [72075186224037893][rt3.dc1--topic1] pipe [7:7567612175713009611:2514] connected; active server actors: 1
2025-11-01T04:40:13.781186Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [7:7567612175713009595:2514] (SourceId=source6, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=source6
2025-11-01T04:40:13.781218Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [7:7567612175713009595:2514] (SourceId=source6, PreferedPartition=(NULL)) Update the table
2025-11-01T04:40:13.781739Z node 7 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1659: [72075186224037893][rt3.dc1--topic1] pipe [7:7567612175713009611:2514] disconnected.
2025-11-01T04:40:13.781780Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1670: [72075186224037893][rt3.dc1--topic1] pipe [7:7567612175713009611:2514] disconnected; active server actors: 1
2025-11-01T04:40:13.781796Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1695: [72075186224037893][rt3.dc1--topic1] pipe [7:7567612175713009611:2514] disconnected no session
2025-11-01T04:40:13.790326Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [7:7567612175713009595:2514] (SourceId=source6, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-11-01T04:40:13.790369Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [7:7567612175713009595:2514] (SourceId=source6, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-11-01T04:40:13.790388Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [7:7567612175713009595:2514] (SourceId=source6, PreferedPartition=(NULL)) Start idle
2025-11-01T04:40:13.790420Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 7 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-11-01T04:40:13.791886Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 8, Generation: 1
2025-11-01T04:40:13.791859Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [7:7567612175713009625:2514], now have 1 active actors on pipe
2025-11-01T04:40:13.792030Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-01T04:40:13.792078Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-01T04:40:13.792158Z node 8 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie source6|8657042b-a61b6028-cadb6d-f4a03b75_0 generated for partition 0 topic 'rt3.dc1--topic1' owner source6
2025-11-01T04:40:13.792199Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T04:40:13.792225Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T04:40:13.792239Z node 8 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-01T04:40:13.792282Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-01T04:40:13.792329Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-01T04:40:13.792386Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-01T04:40:13.793242Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-01T04:40:13.793274Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-01T04:40:13.793348Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-01T04:40:13.793850Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 7 partition: 0 MaxSeqNo: 0 sessionId: source6|8657042b-a61b6028-cadb6d-f4a03b75_0
2025-11-01T04:40:13.794530Z :INFO: [] MessageGroupId [source6] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1761972013794 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-11-01T04:40:13.794636Z :INFO: [] MessageGroupId [source6] SessionId [] Write session established. Init response: session_id: "source6|8657042b-a61b6028-cadb6d-f4a03b75_0" topic: "topic1" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-11-01T04:40:13.795753Z :DEBUG: [] MessageGroupId [source6] SessionId [source6|8657042b-a61b6028-cadb6d-f4a03b75_0] Write 1 messages with Id from 1 to 1
2025-11-01T04:40:13.795830Z :INFO: [] MessageGroupId [source6] SessionId [source6|8657042b-a61b6028-cadb6d-f4a03b75_0] Write session: close. Timeout = 10000 ms
2025-11-01T04:40:13.811577Z :DEBUG: [] MessageGroupId [source6] SessionId [source6|8657042b-a61b6028-cadb6d-f4a03b75_0] Write session: try to update token
2025-11-01T04:40:13.811624Z :DEBUG: [] MessageGroupId [source6] SessionId [source6|8657042b-a61b6028-cadb6d-f4a03b75_0] Send 1 message(s) (0 left), first sequence number is 1
2025-11-01T04:40:13.812386Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 7 sessionId: source6|8657042b-a61b6028-cadb6d-f4a03b75_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-01T04:40:13.812711Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-01T04:40:13.813880Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-01T04:40:13.813933Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-01T04:40:13.814019Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-11-01T04:40:13.814374Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-01T04:40:13.814795Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-01T04:40:13.814824Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-01T04:40:13.814885Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: '\0source6' SeqNo: 1 partNo : 0 messageNo: 1 size 1122 offset: -1
2025-11-01T04:40:13.814928Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-01T04:40:13.814976Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T04:40:13.815007Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T04:40:13.815033Z node 8 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-01T04:40:13.815155Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId '\0source6' seqNo 1 partNo 0
2025-11-01T04:40:13.816022Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '\0source6' seqNo 1 partNo 0 FormedBlobsCount 0 NewHead: Offset 6 PartNo 0 PackedSize 1197 count 1 nextOffset 7 batches 1
2025-11-01T04:40:13.816075Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-01T04:40:13.816663Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 6,1 HeadOffset 6 endOffset 6 curOffset 7 d0000000000_00000000000000000006_00000_0000000001_00000? size 1185 WTime 1761972013816
2025-11-01T04:40:13.816827Z node 8 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-01T04:40:13.816960Z node 8 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 6 partNo 0 count 1 size 1185
2025-11-01T04:40:13.822263Z node 8 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 6 count 1 size 1185 actorID [8:7567612172196730934:2358]
2025-11-01T04:40:13.822321Z node 8 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-01T04:40:13.822378Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1130 WriteNewSizeFromSupportivePartitions# 0
2025-11-01T04:40:13.822415Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-01T04:40:13.822458Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0source6', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 1, partNo: 0, Offset: 6 is stored on disk
2025-11-01T04:40:13.822686Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T04:40:13.822711Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T04:40:13.822727Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-01T04:40:13.822759Z node 8 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-01T04:40:13.822762Z node 8 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 6 partno 0 count 1 parts 0 suffix '63' size 1185
2025-11-01T04:40:13.822799Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 1  requestId: <none> cookie: 1
2025-11-01T04:40:13.822991Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 1 consumer shared/user session shared/user_7_1_3711639485680171386_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 6 EndOffset 6 newEndOffset 7 commitOffset 0 clientCommitOffset 0 cookie 7 readingFinished 0 firstRead 0
2025-11-01T04:40:13.823028Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_7_1_3711639485680171386_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 6 endOffset 7
2025-11-01T04:40:13.823086Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-01T04:40:13.823514Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_7_1_3711639485680171386_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 6, endOffset# 7, WTime# 1761972013678, sizeLag# 1185
2025-11-01T04:40:13.823543Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_7_1_3711639485680171386_v1TEvPartitionReady. Aval parts: 1
2025-11-01T04:40:13.823598Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_7_1_3711639485680171386_v1 performing read request: guid# 86ccb22a-32071004-972d097a-3f8643c6, from# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), count# 1, size# 1422, partitionsAsked# 1, maxTimeLag# 0ms
2025-11-01T04:40:13.823683Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_7_1_3711639485680171386_v1 READ FROM TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1)maxCount 1 maxSize 1422 maxTimeLagMs 0 readTimestampMs 0 readOffset 6 EndOffset 7 ClientCommitOffset 0 committedOffset 0 Guid 86ccb22a-32071004-972d097a-3f8643c6
2025-11-01T04:40:13.823902Z :DEBUG: [] MessageGroupId [source6] SessionId [source6|8657042b-a61b6028-cadb6d-f4a03b75_0] Write session got write response: sequence_numbers: 1 offsets: 6 already_written: false write_statistics { persist_duration_ms: 6 queued_in_partition_duration_ms: 1 }
2025-11-01T04:40:13.823964Z :DEBUG: [] MessageGroupId [source6] SessionId [source6|8657042b-a61b6028-cadb6d-f4a03b75_0] Write session: acknoledged message 1
2025-11-01T04:40:13.824155Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-01T04:40:13.824189Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-01T04:40:13.824294Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:880: [72075186224037892][Partition][0][StateIdle] read cookie 10 Topic 'rt3.dc1--topic1' partition 0 user user offset 6 partno 0 count 1 size 1422 endOffset 7 max time lag 0ms effective offset 6
2025-11-01T04:40:13.824533Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:1105: [72075186224037892][Partition][0][StateIdle] read cookie 10 added 1 blobs, size 1185 count 1 last offset 6, current partition end offset: 7
2025-11-01T04:40:13.824762Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:1121: [72075186224037892][Partition][0][StateIdle] Reading cookie 10. Send blob request.
2025-11-01T04:40:13.824816Z node 8 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 6 partno 0 count 1 parts_count 0 source 1 size 1185 accessed 0 times before, last time 2025-11-01T04:40:13.000000Z
2025-11-01T04:40:13.824848Z node 8 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 10. All 1 blobs are from cache.
2025-11-01T04:40:13.824893Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:572: FormAnswer for 1 blobs
2025-11-01T04:40:13.824934Z node 8 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 6 partno 0 count 1 parts 0 suffix '63'
2025-11-01T04:40:13.825039Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 6 totakecount 1 count 1 size 1165 from pos 0 cbcount 1
2025-11-01T04:40:13.825155Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 6
2025-11-01T04:40:13.825653Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_7_1_3711639485680171386_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 7 Result { Offset: 6 Data: "... 1122 bytes ..." SourceId: "\000source6" SeqNo: 1 WriteTimestampMS: 1761972013815 CreateTimestampMS: 1761972013794 UncompressedSize: 1047552 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 20 RealReadOffset: 6 WaitQuotaTimeMs: 0 EndOffset: 7 StartOffset: 0 } Cookie: 6 }
2025-11-01T04:40:13.826529Z :DEBUG: [] [] [34cabe19-c16c0061-6a1e455c-44231d55] [null] After sending read request: ReadSizeBudget = 2621440, ReadSizeServerDelta = 0
2025-11-01T04:40:13.825754Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_7_1_3711639485680171386_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 8 from offset 7
2025-11-01T04:40:13.825783Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_7_1_3711639485680171386_v1 after read state TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 7 ReadOffset 7 ReadGuid 86ccb22a-32071004-972d097a-3f8643c6 has messages 1
2025-11-01T04:40:13.825865Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_7_1_3711639485680171386_v1 read done: guid# 86ccb22a-32071004-972d097a-3f8643c6, partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), size# 1224
2025-11-01T04:40:13.825890Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_7_1_3711639485680171386_v1 response to read: guid# 86ccb22a-32071004-972d097a-3f8643c6
2025-11-01T04:40:13.826067Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_7_1_3711639485680171386_v1 Process answer. Aval parts: 0
2025-11-01T04:40:13.827042Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_7_1_3711639485680171386_v1 grpc read done: success# 1, data# { read { } }
2025-11-01T04:40:13.827150Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_7_1_3711639485680171386_v1 got read request: guid# 967708dd-ecad58b2-74a2456b-d8c83e62
2025-11-01T04:40:13.827934Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T04:40:13.827959Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T04:40:13.827976Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-01T04:40:13.895981Z :INFO: [] MessageGroupId [source6] SessionId [source6|8657042b-a61b6028-cadb6d-f4a03b75_0] Write session will now close
2025-11-01T04:40:13.896041Z :DEBUG: [] MessageGroupId [source6] SessionId [source6|8657042b-a61b6028-cadb6d-f4a03b75_0] Write session: aborting
2025-11-01T04:40:13.896460Z :INFO: [] MessageGroupId [source6] SessionId [source6|8657042b-a61b6028-cadb6d-f4a03b75_0] Write session: gracefully shut down, all writes complete
2025-11-01T04:40:13.896743Z :DEBUG: [] MessageGroupId [source6] SessionId [source6|8657042b-a61b6028-cadb6d-f4a03b75_0] Write session: destroy
2025-11-01T04:40:13.898526Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 7 sessionId: source6|8657042b-a61b6028-cadb6d-f4a03b75_0 grpc read done: success: 0 data: 
2025-11-01T04:40:13.898556Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 7 sessionId: source6|8657042b-a61b6028-cadb6d-f4a03b75_0 grpc read failed
2025-11-01T04:40:13.898584Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 7 sessionId: source6|8657042b-a61b6028-cadb6d-f4a03b75_0 grpc closed
2025-11-01T04:40:13.898598Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 7 sessionId: source6|8657042b-a61b6028-cadb6d-f4a03b75_0 is DEAD
2025-11-01T04:40:13.899330Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-11-01T04:40:13.900909Z :DEBUG: [] MessageGroupId [source7] SessionId [] Write session: try to update token
2025-11-01T04:40:13.899821Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [7:7567612175713009625:2514] destroyed
2025-11-01T04:40:13.899880Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-11-01T04:40:13.899919Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T04:40:13.901201Z :INFO: [] MessageGroupId [source7] SessionId [] Write session: Do CDS request
2025-11-01T04:40:13.899936Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T04:40:13.901230Z :INFO: [] MessageGroupId [source7] SessionId [] Start write session. Will connect to endpoint: localhost:24723
2025-11-01T04:40:13.899954Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-01T04:40:13.904775Z :DEBUG: [] MessageGroupId [source7] SessionId [] Write session: send init request: init_request { topic: "topic1" message_group_id: "source7" }
2025-11-01T04:40:13.905892Z node 7 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-11-01T04:40:13.905928Z node 7 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 8
2025-11-01T04:40:13.906324Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 8 sessionId:  grpc read done: success: 1 data: init_request { topic: "topic1" message_group_id: "source7" }
2025-11-01T04:40:13.906468Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 8 topic: "topic1" message_group_id: "source7" from ipv6:[::1]:35610
2025-11-01T04:40:13.906496Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=8 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:35610 proto=v1  topic=topic1 durationSec=0
2025-11-01T04:40:13.906508Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-11-01T04:40:13.908223Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 8 sessionId:  describe result for acl check
2025-11-01T04:40:13.908380Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-11-01T04:40:13.908400Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-11-01T04:40:13.908410Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-11-01T04:40:13.908432Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [7:7567612175713009638:2518] (SourceId=source7, PreferedPartition=(NULL)) StartKqpSession
2025-11-01T04:40:13.911898Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [7:7567612175713009638:2518] (SourceId=source7, PreferedPartition=(NULL)) Select from the table
2025-11-01T04:40:13.920984Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [7:7567612175713009638:2518] (SourceId=source7, PreferedPartition=(NULL)) RequestPQRB
2025-11-01T04:40:13.921474Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1655: [72075186224037893][rt3.dc1--topic1] pipe [7:7567612175713009657:2518] connected; active server actors: 1
2025-11-01T04:40:13.921511Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [7:7567612175713009638:2518] (SourceId=source7, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=source7
2025-11-01T04:40:13.921531Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [7:7567612175713009638:2518] (SourceId=source7, PreferedPartition=(NULL)) Update the table
2025-11-01T04:40:13.921926Z node 7 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1659: [72075186224037893][rt3.dc1--topic1] pipe [7:7567612175713009657:2518] disconnected.
2025-11-01T04:40:13.921960Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1670: [72075186224037893][rt3.dc1--topic1] pipe [7:7567612175713009657:2518] disconnected; active server actors: 1
2025-11-01T04:40:13.921980Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1695: [72075186224037893][rt3.dc1--topic1] pipe [7:7567612175713009657:2518] disconnected no session
2025-11-01T04:40:13.928643Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T04:40:13.928690Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T04:40:13.928710Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-01T04:40:13.933109Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [7:7567612175713009638:2518] (SourceId=source7, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-11-01T04:40:13.933152Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [7:7567612175713009638:2518] (SourceId=source7, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-11-01T04:40:13.933171Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [7:7567612175713009638:2518] (SourceId=source7, PreferedPartition=(NULL)) Start idle
2025-11-01T04:40:13.933208Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 8 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-11-01T04:40:13.935614Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [7:7567612175713009671:2518], now have 1 active actors on pipe
2025-11-01T04:40:13.936057Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 8, Generation: 1
2025-11-01T04:40:13.936342Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-01T04:40:13.936392Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-01T04:40:13.936467Z node 8 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie source7|4b4e7873-9fa4ef06-34ee2a0d-7e460e2c_0 generated for partition 0 topic 'rt3.dc1--topic1' owner source7
2025-11-01T04:40:13.936509Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T04:40:13.936534Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T04:40:13.936547Z node 8 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-01T04:40:13.936594Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-01T04:40:13.936649Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-01T04:40:13.936706Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-01T04:40:13.937282Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-01T04:40:13.937311Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-01T04:40:13.937384Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-01T04:40:13.937722Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 8 partition: 0 MaxSeqNo: 0 sessionId: source7|4b4e7873-9fa4ef06-34ee2a0d-7e460e2c_0
2025-11-01T04:40:13.939686Z :INFO: [] MessageGroupId [source7] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1761972013939 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-11-01T04:40:13.939812Z :INFO: [] MessageGroupId [source7] SessionId [] Write session established. Init response: session_id: "source7|4b4e7873-9fa4ef06-34ee2a0d-7e460e2c_0" topic: "topic1" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-11-01T04:40:13.941190Z :DEBUG: [] MessageGroupId [source7] SessionId [source7|4b4e7873-9fa4ef06-34ee2a0d-7e460e2c_0] Write 1 messages with Id from 1 to 1
2025-11-01T04:40:13.941291Z :INFO: [] MessageGroupId [source7] SessionId [source7|4b4e7873-9fa4ef06-34ee2a0d-7e460e2c_0] Write session: close. Timeout = 10000 ms
2025-11-01T04:40:13.961023Z :DEBUG: [] MessageGroupId [source7] SessionId [source7|4b4e7873-9fa4ef06-34ee2a0d-7e460e2c_0] Write session: try to update token
2025-11-01T04:40:13.961096Z :DEBUG: [] MessageGroupId [source7] SessionId [source7|4b4e7873-9fa4ef06-34ee2a0d-7e460e2c_0] Send 1 message(s) (0 left), first sequence number is 1
2025-11-01T04:40:13.961818Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 8 sessionId: source7|4b4e7873-9fa4ef06-34ee2a0d-7e460e2c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-01T04:40:13.962146Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-01T04:40:13.962631Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-01T04:40:13.962682Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-01T04:40:13.962768Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-11-01T04:40:13.963239Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-01T04:40:13.963615Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-01T04:40:13.963645Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-01T04:40:13.963711Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: '\0source7' SeqNo: 1 partNo : 0 messageNo: 1 size 1122 offset: -1
2025-11-01T04:40:13.963766Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-01T04:40:13.963830Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T04:40:13.963860Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T04:40:13.963877Z node 8 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-01T04:40:13.964017Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId '\0source7' seqNo 1 partNo 0
2025-11-01T04:40:13.995628Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '\0source7' seqNo 1 partNo 0 FormedBlobsCount 0 NewHead: Offset 7 PartNo 0 PackedSize 1197 count 1 nextOffset 8 batches 1
2025-11-01T04:40:13.995703Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-01T04:40:13.996292Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 7,1 HeadOffset 7 endOffset 7 curOffset 8 d0000000000_00000000000000000007_00000_0000000001_00000? size 1185 WTime 1761972013995
2025-11-01T04:40:13.996513Z node 8 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-01T04:40:13.996663Z node 8 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 7 partNo 0 count 1 size 1185
2025-11-01T04:40:14.005404Z node 8 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 7 count 1 size 1185 actorID [8:7567612172196730934:2358]
2025-11-01T04:40:14.005498Z node 8 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-01T04:40:14.005562Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1130 WriteNewSizeFromSupportivePartitions# 0
2025-11-01T04:40:14.005586Z node 8 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 7 partno 0 count 1 parts 0 suffix '63' size 1185
2025-11-01T04:40:14.005627Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-01T04:40:14.005679Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0source7', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 1, partNo: 0, Offset: 7 is stored on disk
2025-11-01T04:40:14.005951Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T04:40:14.005975Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T04:40:14.005994Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-01T04:40:14.006033Z node 8 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-01T04:40:14.006091Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 1  requestId: <none> cookie: 1
2025-11-01T04:40:14.006210Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 1 consumer shared/user session shared/user_7_1_3711639485680171386_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 7 EndOffset 7 newEndOffset 8 commitOffset 0 clientCommitOffset 0 cookie 8 readingFinished 0 firstRead 0
2025-11-01T04:40:14.006248Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_7_1_3711639485680171386_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 7 endOffset 8
2025-11-01T04:40:14.006323Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_7_1_3711639485680171386_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 7, endOffset# 8, WTime# 1761972013815, sizeLag# 1185
2025-11-01T04:40:14.006345Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_7_1_3711639485680171386_v1TEvPartitionReady. Aval parts: 1
2025-11-01T04:40:14.006399Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_7_1_3711639485680171386_v1 performing read request: guid# 967708dd-ecad58b2-74a2456b-d8c83e62, from# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), count# 1, size# 1422, partitionsAsked# 1, maxTimeLag# 0ms
2025-11-01T04:40:14.006458Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_7_1_3711639485680171386_v1 READ FROM TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1)maxCount 1 maxSize 1422 maxTimeLagMs 0 readTimestampMs 0 readOffset 7 EndOffset 8 ClientCommitOffset 0 committedOffset 0 Guid 967708dd-ecad58b2-74a2456b-d8c83e62
2025-11-01T04:40:14.006913Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-01T04:40:14.007787Z :DEBUG: [] MessageGroupId [source7] SessionId [source7|4b4e7873-9fa4ef06-34ee2a0d-7e460e2c_0] Write session got write response: sequence_numbers: 1 offsets: 7 already_written: false write_statistics { persist_duration_ms: 10 queued_in_partition_duration_ms: 31 }
2025-11-01T04:40:14.007842Z :DEBUG: [] MessageGroupId [source7] SessionId [source7|4b4e7873-9fa4ef06-34ee2a0d-7e460e2c_0] Write session: acknoledged message 1
2025-11-01T04:40:14.007121Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-01T04:40:14.007157Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-01T04:40:14.007270Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:880: [72075186224037892][Partition][0][StateIdle] read cookie 11 Topic 'rt3.dc1--topic1' partition 0 user user offset 7 partno 0 count 1 size 1422 endOffset 8 max time lag 0ms effective offset 7
2025-11-01T04:40:14.007516Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:1105: [72075186224037892][Partition][0][StateIdle] read cookie 11 added 1 blobs, size 1185 count 1 last offset 7, current partition end offset: 8
2025-11-01T04:40:14.007538Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:1121: [72075186224037892][Partition][0][StateIdle] Reading cookie 11. Send blob request.
2025-11-01T04:40:14.007588Z node 8 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 7 partno 0 count 1 parts_count 0 source 1 size 1185 accessed 0 times before, last time 2025-11-01T04:40:14.000000Z
2025-11-01T04:40:14.007627Z node 8 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 11. All 1 blobs are from cache.
2025-11-01T04:40:14.007671Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:572: FormAnswer for 1 blobs
2025-11-01T04:40:14.007702Z node 8 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 7 partno 0 count 1 parts 0 suffix '63'
2025-11-01T04:40:14.007880Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 7 totakecount 1 count 1 size 1165 from pos 0 cbcount 1
2025-11-01T04:40:14.007980Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 7
2025-11-01T04:40:14.008520Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_7_1_3711639485680171386_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 8 Result { Offset: 7 Data: "... 1122 bytes ..." SourceId: "\000source7" SeqNo: 1 WriteTimestampMS: 1761972013964 CreateTimestampMS: 1761972013940 UncompressedSize: 1047552 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 20 RealReadOffset: 7 WaitQuotaTimeMs: 0 EndOffset: 8 StartOffset: 0 } Cookie: 7 }
2025-11-01T04:40:14.008668Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_7_1_3711639485680171386_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 9 from offset 8
2025-11-01T04:40:14.008711Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_7_1_3711639485680171386_v1 after read state TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 8 ReadOffset 8 ReadGuid 967708dd-ecad58b2-74a2456b-d8c83e62 has messages 1
2025-11-01T04:40:14.008826Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_7_1_3711639485680171386_v1 read done: guid# 967708dd-ecad58b2-74a2456b-d8c83e62, partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), size# 1224
2025-11-01T04:40:14.008859Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_7_1_3711639485680171386_v1 response to read: guid# 967708dd-ecad58b2-74a2456b-d8c83e62
2025-11-01T04:40:14.009100Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_7_1_3711639485680171386_v1 Process answer. Aval parts: 0
2025-11-01T04:40:14.009786Z :DEBUG: [] [] [34cabe19-c16c0061-6a1e455c-44231d55] [null] After sending read request: ReadSizeBudget = 2621440, ReadSizeServerDelta = 0
2025-11-01T04:40:14.010193Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_7_1_3711639485680171386_v1 grpc read done: success# 1, data# { read { } }
2025-11-01T04:40:14.010326Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_7_1_3711639485680171386_v1 got read request: guid# a37e0b3c-4a2a1e75-ef8064d4-fc29bd19
2025-11-01T04:40:14.029182Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T04:40:14.029216Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T04:40:14.029238Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-01T04:40:14.041403Z :INFO: [] MessageGroupId [source7] SessionId [source7|4b4e7873-9fa4ef06-34ee2a0d-7e460e2c_0] Write session will now close
2025-11-01T04:40:14.041463Z :DEBUG: [] MessageGroupId [source7] SessionId [source7|4b4e7873-9fa4ef06-34ee2a0d-7e460e2c_0] Write session: aborting
2025-11-01T04:40:14.041941Z :INFO: [] MessageGroupId [source7] SessionId [source7|4b4e7873-9fa4ef06-34ee2a0d-7e460e2c_0] Write session: gracefully shut down, all writes complete
2025-11-01T04:40:14.042143Z :DEBUG: [] MessageGroupId [source7] SessionId [source7|4b4e7873-9fa4ef06-34ee2a0d-7e460e2c_0] Write session: destroy
2025-11-01T04:40:14.045118Z :DEBUG: [] MessageGroupId [source8] SessionId [] Write session: try to update token
2025-11-01T04:40:14.044103Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 8 sessionId: source7|4b4e7873-9fa4ef06-34ee2a0d-7e460e2c_0 grpc read done: success: 0 data: 
2025-11-01T04:40:14.044142Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 8 sessionId: source7|4b4e7873-9fa4ef06-34ee2a0d-7e460e2c_0 grpc read failed
2025-11-01T04:40:14.044174Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 8 sessionId: source7|4b4e7873-9fa4ef06-34ee2a0d-7e460e2c_0 grpc closed
2025-11-01T04:40:14.044193Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 8 sessionId: source7|4b4e7873-9fa4ef06-34ee2a0d-7e460e2c_0 is DEAD
2025-11-01T04:40:14.045082Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-11-01T04:40:14.045537Z :INFO: [] MessageGroupId [source8] SessionId [] Write session: Do CDS request
2025-11-01T04:40:14.045566Z :INFO: [] MessageGroupId [source8] SessionId [] Start write session. Will connect to endpoint: localhost:24723
2025-11-01T04:40:14.046038Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [7:7567612175713009671:2518] destroyed
2025-11-01T04:40:14.046115Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-11-01T04:40:14.046163Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T04:40:14.046182Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T04:40:14.046200Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-01T04:40:14.050854Z :DEBUG: [] MessageGroupId [source8] SessionId [] Write session: send init request: init_request { topic: "topic1" message_group_id: "source8" }
2025-11-01T04:40:14.050958Z node 7 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-11-01T04:40:14.050990Z node 7 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 9
2025-11-01T04:40:14.051420Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 9 sessionId:  grpc read done: success: 1 data: init_request { topic: "topic1" message_group_id: "source8" }
2025-11-01T04:40:14.051542Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 9 topic: "topic1" message_group_id: "source8" from ipv6:[::1]:35610
2025-11-01T04:40:14.051571Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=9 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:35610 proto=v1  topic=topic1 durationSec=0
2025-11-01T04:40:14.051580Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-11-01T04:40:14.053091Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 9 sessionId:  describe result for acl check
2025-11-01T04:40:14.053212Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-11-01T04:40:14.053230Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-11-01T04:40:14.053238Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-11-01T04:40:14.053257Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [7:7567612180007976976:2522] (SourceId=source8, PreferedPartition=(NULL)) StartKqpSession
2025-11-01T04:40:14.056062Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [7:7567612180007976976:2522] (SourceId=source8, PreferedPartition=(NULL)) Select from the table
2025-11-01T04:40:14.061598Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [7:7567612180007976976:2522] (SourceId=source8, PreferedPartition=(NULL)) RequestPQRB
2025-11-01T04:40:14.062117Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1655: [72075186224037893][rt3.dc1--topic1] pipe [7:7567612180007976995:2522] connected; active server actors: 1
2025-11-01T04:40:14.062156Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [7:7567612180007976976:2522] (SourceId=source8, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=source8
2025-11-01T04:40:14.062172Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [7:7567612180007976976:2522] (SourceId=source8, PreferedPartition=(NULL)) Update the table
2025-11-01T04:40:14.062477Z node 7 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1659: [72075186224037893][rt3.dc1--topic1] pipe [7:7567612180007976995:2522] disconnected.
2025-11-01T04:40:14.062501Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1670: [72075186224037893][rt3.dc1--topic1] pipe [7:7567612180007976995:2522] disconnected; active server actors: 1
2025-11-01T04:40:14.062514Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1695: [72075186224037893][rt3.dc1--topic1] pipe [7:7567612180007976995:2522] disconnected no session
2025-11-01T04:40:14.071105Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [7:7567612180007976976:2522] (SourceId=source8, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-11-01T04:40:14.071143Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [7:7567612180007976976:2522] (SourceId=source8, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-11-01T04:40:14.071159Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [7:7567612180007976976:2522] (SourceId=source8, PreferedPartition=(NULL)) Start idle
2025-11-01T04:40:14.071189Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 9 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-11-01T04:40:14.071895Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [7:7567612180007977010:2522], now have 1 active actors on pipe
2025-11-01T04:40:14.072178Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 8, Generation: 1
2025-11-01T04:40:14.072438Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-01T04:40:14.072472Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-01T04:40:14.072543Z node 8 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie source8|aadc2fea-8ecc496b-c1966255-ab2c6d11_0 generated for partition 0 topic 'rt3.dc1--topic1' owner source8
2025-11-01T04:40:14.072578Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T04:40:14.072601Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T04:40:14.072613Z node 8 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-01T04:40:14.072658Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-01T04:40:14.072718Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-01T04:40:14.072768Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-01T04:40:14.073225Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-01T04:40:14.073254Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-01T04:40:14.073318Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-01T04:40:14.073588Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 9 partition: 0 MaxSeqNo: 0 sessionId: source8|aadc2fea-8ecc496b-c1966255-ab2c6d11_0
2025-11-01T04:40:14.074406Z :INFO: [] MessageGroupId [source8] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1761972014074 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-11-01T04:40:14.074508Z :INFO: [] MessageGroupId [source8] SessionId [] Write session established. Init response: session_id: "source8|aadc2fea-8ecc496b-c1966255-ab2c6d11_0" topic: "topic1" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-11-01T04:40:14.076590Z :DEBUG: [] MessageGroupId [source8] SessionId [source8|aadc2fea-8ecc496b-c1966255-ab2c6d11_0] Write 1 messages with Id from 1 to 1
2025-11-01T04:40:14.076695Z :INFO: [] MessageGroupId [source8] SessionId [source8|aadc2fea-8ecc496b-c1966255-ab2c6d11_0] Write session: close. Timeout = 10000 ms
2025-11-01T04:40:14.088312Z :DEBUG: [] MessageGroupId [source8] SessionId [source8|aadc2fea-8ecc496b-c1966255-ab2c6d11_0] Write session: try to update token
2025-11-01T04:40:14.088374Z :DEBUG: [] MessageGroupId [source8] SessionId [source8|aadc2fea-8ecc496b-c1966255-ab2c6d11_0] Send 1 message(s) (0 left), first sequence number is 1
2025-11-01T04:40:14.089153Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 9 sessionId: source8|aadc2fea-8ecc496b-c1966255-ab2c6d11_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-01T04:40:14.089437Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-01T04:40:14.089885Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-01T04:40:14.089926Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-01T04:40:14.090007Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-11-01T04:40:14.090418Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-01T04:40:14.090773Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-01T04:40:14.090798Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-01T04:40:14.090858Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: '\0source8' SeqNo: 1 partNo : 0 messageNo: 1 size 1122 offset: -1
2025-11-01T04:40:14.090898Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-01T04:40:14.090946Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T04:40:14.090976Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T04:40:14.090989Z node 8 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-01T04:40:14.091122Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId '\0source8' seqNo 1 partNo 0
2025-11-01T04:40:14.092017Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '\0source8' seqNo 1 partNo 0 FormedBlobsCount 0 NewHead: Offset 8 PartNo 0 PackedSize 1197 count 1 nextOffset 9 batches 1
2025-11-01T04:40:14.092062Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-01T04:40:14.092625Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 8,1 HeadOffset 8 endOffset 8 curOffset 9 d0000000000_00000000000000000008_00000_0000000001_00000? size 1185 WTime 1761972014092
2025-11-01T04:40:14.092784Z node 8 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-01T04:40:14.092916Z node 8 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 8 partNo 0 count 1 size 1185
2025-11-01T04:40:14.098097Z node 8 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 8 count 1 size 1185 actorID [8:7567612172196730934:2358]
2025-11-01T04:40:14.098154Z node 8 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-01T04:40:14.098208Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1130 WriteNewSizeFromSupportivePartitions# 0
2025-11-01T04:40:14.098260Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-01T04:40:14.098303Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0source8', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 1, partNo: 0, Offset: 8 is stored on disk
2025-11-01T04:40:14.098531Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T04:40:14.098550Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T04:40:14.098570Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-01T04:40:14.098604Z node 8 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-01T04:40:14.098640Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 1  requestId: <none> cookie: 1
2025-11-01T04:40:14.099262Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 1 consumer shared/user session shared/user_7_1_3711639485680171386_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 8 EndOffset 8 newEndOffset 9 commitOffset 0 clientCommitOffset 0 cookie 9 readingFinished 0 firstRead 0
2025-11-01T04:40:14.099298Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_7_1_3711639485680171386_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 8 endOffset 9
2025-11-01T04:40:14.099344Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-01T04:40:14.099760Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_7_1_3711639485680171386_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 8, endOffset# 9, WTime# 1761972013964, sizeLag# 1185
2025-11-01T04:40:14.099793Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_7_1_3711639485680171386_v1TEvPartitionReady. Aval parts: 1
2025-11-01T04:40:14.099848Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_7_1_3711639485680171386_v1 performing read request: guid# a37e0b3c-4a2a1e75-ef8064d4-fc29bd19, from# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), count# 1, size# 1422, partitionsAsked# 1, maxTimeLag# 0ms
2025-11-01T04:40:14.099913Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_7_1_3711639485680171386_v1 READ FROM TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1)maxCount 1 maxSize 1422 maxTimeLagMs 0 readTimestampMs 0 readOffset 8 EndOffset 9 ClientCommitOffset 0 committedOffset 0 Guid a37e0b3c-4a2a1e75-ef8064d4-fc29bd19
2025-11-01T04:40:14.100516Z :DEBUG: [] MessageGroupId [source8] SessionId [source8|aadc2fea-8ecc496b-c1966255-ab2c6d11_0] Write session got write response: sequence_numbers: 1 offsets: 8 already_written: false write_statistics { persist_duration_ms: 6 queued_in_partition_duration_ms: 1 }
2025-11-01T04:40:14.100562Z :DEBUG: [] MessageGroupId [source8] SessionId [source8|aadc2fea-8ecc496b-c1966255-ab2c6d11_0] Write session: acknoledged message 1
2025-11-01T04:40:14.099027Z node 8 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 8 partno 0 count 1 parts 0 suffix '63' size 1185
2025-11-01T04:40:14.100767Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-01T04:40:14.100797Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-01T04:40:14.100906Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:880: [72075186224037892][Partition][0][StateIdle] read cookie 12 Topic 'rt3.dc1--topic1' partition 0 user user offset 8 partno 0 count 1 size 1422 endOffset 9 max time lag 0ms effective offset 8
2025-11-01T04:40:14.101143Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:1105: [72075186224037892][Partition][0][StateIdle] read cookie 12 added 1 blobs, size 1185 count 1 last offset 8, current partition end offset: 9
2025-11-01T04:40:14.101164Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:1121: [72075186224037892][Partition][0][StateIdle] Reading cookie 12. Send blob request.
2025-11-01T04:40:14.101215Z node 8 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 8 partno 0 count 1 parts_count 0 source 1 size 1185 accessed 0 times before, last time 2025-11-01T04:40:14.000000Z
2025-11-01T04:40:14.101249Z node 8 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 12. All 1 blobs are from cache.
2025-11-01T04:40:14.101293Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:572: FormAnswer for 1 blobs
2025-11-01T04:40:14.101435Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 8 totakecount 1 count 1 size 1165 from pos 0 cbcount 1
2025-11-01T04:40:14.101530Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 8
2025-11-01T04:40:14.102069Z node 8 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 8 partno 0 count 1 parts 0 suffix '63'
2025-11-01T04:40:14.102451Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_7_1_3711639485680171386_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 9 Result { Offset: 8 Data: "... 1122 bytes ..." SourceId: "\000source8" SeqNo: 1 WriteTimestampMS: 1761972014090 CreateTimestampMS: 1761972014074 UncompressedSize: 1047552 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 20 RealReadOffset: 8 WaitQuotaTimeMs: 0 EndOffset: 9 StartOffset: 0 } Cookie: 8 }
2025-11-01T04:40:14.102585Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_7_1_3711639485680171386_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 10 from offset 9
2025-11-01T04:40:14.102635Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_7_1_3711639485680171386_v1 after read state TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 9 ReadOffset 9 ReadGuid a37e0b3c-4a2a1e75-ef8064d4-fc29bd19 has messages 1
2025-11-01T04:40:14.102746Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_7_1_3711639485680171386_v1 read done: guid# a37e0b3c-4a2a1e75-ef8064d4-fc29bd19, partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), size# 1224
2025-11-01T04:40:14.102777Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_7_1_3711639485680171386_v1 response to read: guid# a37e0b3c-4a2a1e75-ef8064d4-fc29bd19
2025-11-01T04:40:14.102988Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_7_1_3711639485680171386_v1 Process answer. Aval parts: 0
2025-11-01T04:40:14.103742Z :DEBUG: [] [] [34cabe19-c16c0061-6a1e455c-44231d55] [null] After sending read request: ReadSizeBudget = 2621440, ReadSizeServerDelta = 0
2025-11-01T04:40:14.104102Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_7_1_3711639485680171386_v1 grpc read done: success# 1, data# { read { } }
2025-11-01T04:40:14.104221Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_7_1_3711639485680171386_v1 got read request: guid# aa8b189c-1ef2b71e-f0311b93-3f508545
2025-11-01T04:40:14.129528Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T04:40:14.129563Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T04:40:14.129577Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-01T04:40:14.176934Z :INFO: [] MessageGroupId [source8] SessionId [source8|aadc2fea-8ecc496b-c1966255-ab2c6d11_0] Write session will now close
2025-11-01T04:40:14.176992Z :DEBUG: [] MessageGroupId [source8] SessionId [source8|aadc2fea-8ecc496b-c1966255-ab2c6d11_0] Write session: aborting
2025-11-01T04:40:14.177407Z :INFO: [] MessageGroupId [source8] SessionId [source8|aadc2fea-8ecc496b-c1966255-ab2c6d11_0] Write session: gracefully shut down, all writes complete
2025-11-01T04:40:14.177706Z :DEBUG: [] MessageGroupId [source8] SessionId [source8|aadc2fea-8ecc496b-c1966255-ab2c6d11_0] Write session: destroy
2025-11-01T04:40:14.182664Z :DEBUG: [] MessageGroupId [source9] SessionId [] Write session: try to update token
2025-11-01T04:40:14.185705Z :INFO: [] MessageGroupId [source9] SessionId [] Write session: Do CDS request
2025-11-01T04:40:14.185743Z :INFO: [] MessageGroupId [source9] SessionId [] Start write session. Will connect to endpoint: localhost:24723
2025-11-01T04:40:14.189220Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 9 sessionId: source8|aadc2fea-8ecc496b-c1966255-ab2c6d11_0 grpc read done: success: 0 data: 
2025-11-01T04:40:14.189247Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 9 sessionId: source8|aadc2fea-8ecc496b-c1966255-ab2c6d11_0 grpc read failed
2025-11-01T04:40:14.189279Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 9 sessionId: source8|aadc2fea-8ecc496b-c1966255-ab2c6d11_0 grpc closed
2025-11-01T04:40:14.189297Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 9 sessionId: source8|aadc2fea-8ecc496b-c1966255-ab2c6d11_0 is DEAD
2025-11-01T04:40:14.190078Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-11-01T04:40:14.190454Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [7:7567612180007977010:2522] destroyed
2025-11-01T04:40:14.190510Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-11-01T04:40:14.190544Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T04:40:14.190560Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T04:40:14.190578Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-01T04:40:14.193770Z :DEBUG: [] MessageGroupId [source9] SessionId [] Write session: send init request: init_request { topic: "topic1" message_group_id: "source9" }
2025-11-01T04:40:14.194050Z node 7 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-11-01T04:40:14.194083Z node 7 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 10
2025-11-01T04:40:14.194481Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 10 sessionId:  grpc read done: success: 1 data: init_request { topic: "topic1" message_group_id: "source9" }
2025-11-01T04:40:14.194595Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 10 topic: "topic1" message_group_id: "source9" from ipv6:[::1]:35610
2025-11-01T04:40:14.194617Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=10 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:35610 proto=v1  topic=topic1 durationSec=0
2025-11-01T04:40:14.194628Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-11-01T04:40:14.196047Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 10 sessionId:  describe result for acl check
2025-11-01T04:40:14.196151Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-11-01T04:40:14.196159Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-11-01T04:40:14.196167Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-11-01T04:40:14.196185Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [7:7567612180007977014:2526] (SourceId=source9, PreferedPartition=(NULL)) StartKqpSession
2025-11-01T04:40:14.198847Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [7:7567612180007977014:2526] (SourceId=source9, PreferedPartition=(NULL)) Select from the table
2025-11-01T04:40:14.206032Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [7:7567612180007977014:2526] (SourceId=source9, PreferedPartition=(NULL)) RequestPQRB
2025-11-01T04:40:14.206952Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1655: [72075186224037893][rt3.dc1--topic1] pipe [7:7567612180007977033:2526] connected; active server actors: 1
2025-11-01T04:40:14.207090Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [7:7567612180007977014:2526] (SourceId=source9, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=source9
2025-11-01T04:40:14.207109Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [7:7567612180007977014:2526] (SourceId=source9, PreferedPartition=(NULL)) Update the table
2025-11-01T04:40:14.208063Z node 7 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1659: [72075186224037893][rt3.dc1--topic1] pipe [7:7567612180007977033:2526] disconnected.
2025-11-01T04:40:14.208090Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1670: [72075186224037893][rt3.dc1--topic1] pipe [7:7567612180007977033:2526] disconnected; active server actors: 1
2025-11-01T04:40:14.208105Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1695: [72075186224037893][rt3.dc1--topic1] pipe [7:7567612180007977033:2526] disconnected no session
2025-11-01T04:40:14.216873Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [7:7567612180007977014:2526] (SourceId=source9, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-11-01T04:40:14.216914Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [7:7567612180007977014:2526] (SourceId=source9, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-11-01T04:40:14.216931Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [7:7567612180007977014:2526] (SourceId=source9, PreferedPartition=(NULL)) Start idle
2025-11-01T04:40:14.216966Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 10 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-11-01T04:40:14.217608Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [7:7567612180007977049:2526], now have 1 active actors on pipe
2025-11-01T04:40:14.217699Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 8, Generation: 1
2025-11-01T04:40:14.217885Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-01T04:40:14.217915Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-01T04:40:14.217982Z node 8 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie source9|f3488ef4-6938e945-bcee6bd3-9421b848_0 generated for partition 0 topic 'rt3.dc1--topic1' owner source9
2025-11-01T04:40:14.218015Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T04:40:14.218033Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T04:40:14.218044Z node 8 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-01T04:40:14.218080Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-01T04:40:14.218118Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-01T04:40:14.218162Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-01T04:40:14.218769Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-01T04:40:14.218791Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-01T04:40:14.218849Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-01T04:40:14.219167Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 10 partition: 0 MaxSeqNo: 0 sessionId: source9|f3488ef4-6938e945-bcee6bd3-9421b848_0
2025-11-01T04:40:14.220041Z :INFO: [] MessageGroupId [source9] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1761972014220 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-11-01T04:40:14.220149Z :INFO: [] MessageGroupId [source9] SessionId [] Write session established. Init response: session_id: "source9|f3488ef4-6938e945-bcee6bd3-9421b848_0" topic: "topic1" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-11-01T04:40:14.221697Z :DEBUG: [] MessageGroupId [source9] SessionId [source9|f3488ef4-6938e945-bcee6bd3-9421b848_0] Write 1 messages with Id from 1 to 1
2025-11-01T04:40:14.221783Z :INFO: [] MessageGroupId [source9] SessionId [source9|f3488ef4-6938e945-bcee6bd3-9421b848_0] Write session: close. Timeout = 10000 ms
2025-11-01T04:40:14.231460Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T04:40:14.231500Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T04:40:14.231520Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-01T04:40:14.240936Z :DEBUG: [] MessageGroupId [source9] SessionId [source9|f3488ef4-6938e945-bcee6bd3-9421b848_0] Write session: try to update token
2025-11-01T04:40:14.240999Z :DEBUG: [] MessageGroupId [source9] SessionId [source9|f3488ef4-6938e945-bcee6bd3-9421b848_0] Send 1 message(s) (0 left), first sequence number is 1
2025-11-01T04:40:14.245324Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 10 sessionId: source9|f3488ef4-6938e945-bcee6bd3-9421b848_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-01T04:40:14.245683Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-01T04:40:14.246162Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-01T04:40:14.246207Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-01T04:40:14.246288Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-11-01T04:40:14.246469Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-01T04:40:14.246906Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-01T04:40:14.246929Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-01T04:40:14.246983Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: '\0source9' SeqNo: 1 partNo : 0 messageNo: 1 size 1122 offset: -1
2025-11-01T04:40:14.247025Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-01T04:40:14.247076Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T04:40:14.247107Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T04:40:14.247132Z node 8 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-01T04:40:14.247249Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId '\0source9' seqNo 1 partNo 0
2025-11-01T04:40:14.271425Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '\0source9' seqNo 1 partNo 0 FormedBlobsCount 0 NewHead: Offset 9 PartNo 0 PackedSize 1197 count 1 nextOffset 10 batches 1
2025-11-01T04:40:14.271504Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-01T04:40:14.272063Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 9,1 HeadOffset 9 endOffset 9 curOffset 10 d0000000000_00000000000000000009_00000_0000000001_00000? size 1185 WTime 1761972014271
2025-11-01T04:40:14.272272Z node 8 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-01T04:40:14.272399Z node 8 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 9 partNo 0 count 1 size 1185
2025-11-01T04:40:14.282444Z node 8 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 9 count 1 size 1185 actorID [8:7567612172196730934:2358]
2025-11-01T04:40:14.282522Z node 8 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-01T04:40:14.282576Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1130 WriteNewSizeFromSupportivePartitions# 0
2025-11-01T04:40:14.282611Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-01T04:40:14.282648Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0source9', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 1, partNo: 0, Offset: 9 is stored on disk
2025-11-01T04:40:14.283230Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 1 consumer shared/user session shared/user_7_1_3711639485680171386_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 9 EndOffset 9 newEndOffset 10 commitOffset 0 clientCommitOffset 0 cookie 10 readingFinished 0 firstRead 0
2025-11-01T04:40:14.283263Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_7_1_3711639485680171386_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 9 endOffset 10
2025-11-01T04:40:14.283324Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-01T04:40:14.283574Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_7_1_3711639485680171386_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 9, endOffset# 10, WTime# 1761972014090, sizeLag# 1185
2025-11-01T04:40:14.283599Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_7_1_3711639485680171386_v1TEvPartitionReady. Aval parts: 1
2025-11-01T04:40:14.283654Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_7_1_3711639485680171386_v1 performing read request: guid# aa8b189c-1ef2b71e-f0311b93-3f508545, from# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), count# 1, size# 1422, partitionsAsked# 1, maxTimeLag# 0ms
2025-11-01T04:40:14.283719Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_7_1_3711639485680171386_v1 READ FROM TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1)maxCount 1 maxSize 1422 maxTimeLagMs 0 readTimestampMs 0 readOffset 9 EndOffset 10 ClientCommitOffset 0 committedOffset 0 Guid aa8b189c-1ef2b71e-f0311b93-3f508545
2025-11-01T04:40:14.284020Z :DEBUG: [] MessageGroupId [source9] SessionId [source9|f3488ef4-6938e945-bcee6bd3-9421b848_0] Write session got write response: sequence_numbers: 1 offsets: 9 already_written: false write_statistics { persist_duration_ms: 11 queued_in_partition_duration_ms: 23 }
2025-11-01T04:40:14.284063Z :DEBUG: [] MessageGroupId [source9] SessionId [source9|f3488ef4-6938e945-bcee6bd3-9421b848_0] Write session: acknoledged message 1
2025-11-01T04:40:14.282866Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T04:40:14.282888Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T04:40:14.282903Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-01T04:40:14.282931Z node 8 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-01T04:40:14.282960Z node 8 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 9 partno 0 count 1 parts 0 suffix '63' size 1185
2025-11-01T04:40:14.282969Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 1  requestId: <none> cookie: 1
2025-11-01T04:40:14.284147Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-01T04:40:14.284173Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-01T04:40:14.284263Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:880: [72075186224037892][Partition][0][StateIdle] read cookie 13 Topic 'rt3.dc1--topic1' partition 0 user user offset 9 partno 0 count 1 size 1422 endOffset 10 max time lag 0ms effective offset 9
2025-11-01T04:40:14.284467Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:1105: [72075186224037892][Partition][0][StateIdle] read cookie 13 added 1 blobs, size 1185 count 1 last offset 9, current partition end offset: 10
2025-11-01T04:40:14.284496Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:1121: [72075186224037892][Partition][0][StateIdle] Reading cookie 13. Send blob request.
2025-11-01T04:40:14.284537Z node 8 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 9 partno 0 count 1 parts_count 0 source 1 size 1185 accessed 0 times before, last time 2025-11-01T04:40:14.000000Z
2025-11-01T04:40:14.284562Z node 8 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 13. All 1 blobs are from cache.
2025-11-01T04:40:14.284598Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:572: FormAnswer for 1 blobs
2025-11-01T04:40:14.284722Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 9 totakecount 1 count 1 size 1165 from pos 0 cbcount 1
2025-11-01T04:40:14.284802Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 9
2025-11-01T04:40:14.284975Z node 8 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 9 partno 0 count 1 parts 0 suffix '63'
2025-11-01T04:40:14.285455Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_7_1_3711639485680171386_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 10 Result { Offset: 9 Data: "... 1122 bytes ..." SourceId: "\000source9" SeqNo: 1 WriteTimestampMS: 1761972014247 CreateTimestampMS: 1761972014220 UncompressedSize: 1047552 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 20 RealReadOffset: 9 WaitQuotaTimeMs: 0 EndOffset: 10 StartOffset: 0 } Cookie: 9 }
2025-11-01T04:40:14.285601Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_7_1_3711639485680171386_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 11 from offset 10
2025-11-01T04:40:14.285638Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_7_1_3711639485680171386_v1 after read state TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 10 ReadOffset 10 ReadGuid aa8b189c-1ef2b71e-f0311b93-3f508545 has messages 1
2025-11-01T04:40:14.285745Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_7_1_3711639485680171386_v1 read done: guid# aa8b189c-1ef2b71e-f0311b93-3f508545, partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), size# 1224
2025-11-01T04:40:14.285775Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_7_1_3711639485680171386_v1 response to read: guid# aa8b189c-1ef2b71e-f0311b93-3f508545
2025-11-01T04:40:14.285965Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_7_1_3711639485680171386_v1 Process answer. Aval parts: 0
2025-11-01T04:40:14.286532Z :DEBUG: [] [] [34cabe19-c16c0061-6a1e455c-44231d55] [null] After sending read request: ReadSizeBudget = 2621440, ReadSizeServerDelta = 0
2025-11-01T04:40:14.287568Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_7_1_3711639485680171386_v1 grpc read done: success# 1, data# { read { } }
2025-11-01T04:40:14.287712Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_7_1_3711639485680171386_v1 got read request: guid# 14044f41-beb9229a-29be6292-b52758d7
2025-11-01T04:40:14.321931Z :INFO: [] MessageGroupId [source9] SessionId [source9|f3488ef4-6938e945-bcee6bd3-9421b848_0] Write session will now close
2025-11-01T04:40:14.321997Z :DEBUG: [] MessageGroupId [source9] SessionId [source9|f3488ef4-6938e945-bcee6bd3-9421b848_0] Write session: aborting
2025-11-01T04:40:14.322935Z :INFO: [] MessageGroupId [source9] SessionId [source9|f3488ef4-6938e945-bcee6bd3-9421b848_0] Write session: gracefully shut down, all writes complete
2025-11-01T04:40:14.323244Z :DEBUG: [] MessageGroupId [source9] SessionId [source9|f3488ef4-6938e945-bcee6bd3-9421b848_0] Write session is aborting and will not restart
2025-11-01T04:40:14.323309Z :DEBUG: [] MessageGroupId [source9] SessionId [source9|f3488ef4-6938e945-bcee6bd3-9421b848_0] Write session: destroy
2025-11-01T04:40:14.325099Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 10 sessionId: source9|f3488ef4-6938e945-bcee6bd3-9421b848_0 grpc read done: success: 0 data: 
2025-11-01T04:40:14.325141Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 10 sessionId: source9|f3488ef4-6938e945-bcee6bd3-9421b848_0 grpc read failed
2025-11-01T04:40:14.325511Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:824: session v1 closed cookie: 10 sessionId: source9|f3488ef4-6938e945-bcee6bd3-9421b848_0
2025-11-01T04:40:14.325545Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 10 sessionId: source9|f3488ef4-6938e945-bcee6bd3-9421b848_0 is DEAD
2025-11-01T04:40:14.325896Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-11-01T04:40:14.326411Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [7:7567612180007977049:2526] destroyed
2025-11-01T04:40:14.326460Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-11-01T04:40:14.326492Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T04:40:14.326514Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T04:40:14.326531Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-01T04:40:14.332319Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T04:40:14.332354Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T04:40:14.332375Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-01T04:40:14.339602Z :DEBUG: [] Decompression task done. Partition/PartitionSessionId: 0 (0-0)
2025-11-01T04:40:14.340355Z :DEBUG: [] Decompression task done. Partition/PartitionSessionId: 0 (1-1)
2025-11-01T04:40:14.348349Z :DEBUG: [] Decompression task done. Partition/PartitionSessionId: 0 (2-2)
2025-11-01T04:40:14.432536Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T04:40:14.432566Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T04:40:14.432582Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-01T04:40:14.533077Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T04:40:14.533119Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T04:40:14.533137Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-01T04:40:14.633352Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T04:40:14.633389Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T04:40:14.633405Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-01T04:40:14.733777Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T04:40:14.733807Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T04:40:14.733819Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-01T04:40:14.837982Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T04:40:14.838018Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T04:40:14.838033Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-01T04:40:14.937979Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T04:40:14.938013Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T04:40:14.938027Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-01T04:40:15.038324Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T04:40:15.038370Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T04:40:15.038388Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-01T04:40:15.138687Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T04:40:15.138721Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T04:40:15.138738Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-01T04:40:15.239054Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T04:40:15.239096Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T04:40:15.239117Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-01T04:40:15.324336Z :INFO: [] [] [34cabe19-c16c0061-6a1e455c-44231d55] Closing read session. Close timeout: 0.000000s
2025-11-01T04:40:15.324435Z :INFO: [] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:topic1:0:1:9:0
2025-11-01T04:40:15.324486Z :INFO: [] [] [34cabe19-c16c0061-6a1e455c-44231d55] Counters: { Errors: 0 CurrentSessionLifetimeMs: 2733 BytesRead: 3142656 MessagesRead: 3 BytesReadCompressed: 3150 BytesInflightUncompressed: 3142656 BytesInflightCompressed: 7350 BytesInflightTotal: 3150006 MessagesInflight: 10 }
2025-11-01T04:40:15.324626Z :NOTICE: [] [] [34cabe19-c16c0061-6a1e455c-44231d55] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Close with zero timeout " }
2025-11-01T04:40:15.339333Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T04:40:15.339369Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T04:40:15.339381Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-01T04:40:15.344445Z :DEBUG: [] [] [34cabe19-c16c0061-6a1e455c-44231d55] [null] Abort session to cluster
2025-11-01T04:40:15.344980Z :NOTICE: [] [] [34cabe19-c16c0061-6a1e455c-44231d55] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
2025-11-01T04:40:15.345713Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_7_1_3711639485680171386_v1 grpc read done: success# 0, data# {  }
2025-11-01T04:40:15.345763Z node 7 :PQ_READ_PROXY INFO: read_session_actor.cpp:125: session cookie 1 consumer shared/user session shared/user_7_1_3711639485680171386_v1 grpc read failed
2025-11-01T04:40:15.345807Z node 7 :PQ_READ_PROXY INFO: read_session_actor.cpp:92: session cookie 1 consumer shared/user session shared/user_7_1_3711639485680171386_v1 grpc closed
2025-11-01T04:40:15.345867Z node 7 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 1 consumer shared/user session shared/user_7_1_3711639485680171386_v1 is DEAD
2025-11-01T04:40:15.346595Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2258: [PQ: 72075186224037892] Destroy direct read session shared/user_7_1_3711639485680171386_v1
2025-11-01T04:40:15.346673Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [7:7567612171418041976:2469] destroyed
2025-11-01T04:40:15.346726Z node 8 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_7_1_3711639485680171386_v1
2025-11-01T04:40:15.347376Z node 7 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1659: [72075186224037893][rt3.dc1--topic1] pipe [7:7567612171418041973:2466] disconnected.
2025-11-01T04:40:15.347417Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1670: [72075186224037893][rt3.dc1--topic1] pipe [7:7567612171418041973:2466] disconnected; active server actors: 1
2025-11-01T04:40:15.347444Z node 7 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1679: [72075186224037893][rt3.dc1--topic1] pipe [7:7567612171418041973:2466] client user disconnected session shared/user_7_1_3711639485680171386_v1
2025-11-01T04:40:15.439730Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T04:40:15.439778Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T04:40:15.439792Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-01T04:40:15.540063Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T04:40:15.540093Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T04:40:15.540107Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
