2025-11-01T16:05:15.763955Z node 7 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[7:7567788704366840091:2080];send_to=[0:7307199536658146131:7762515];
2025-11-01T16:05:15.763995Z node 7 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
2025-11-01T16:05:15.771860Z node 8 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[8:7567788706889550845:2080];send_to=[0:7307199536658146131:7762515];
2025-11-01T16:05:15.772549Z node 8 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
2025-11-01T16:05:15.773933Z node 7 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-11-01T16:05:15.774812Z node 7 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
test_client.cpp: SetPath # /home/runner/.ya/build/build_root/ewjv/002800/r3tmp/tmp7kqEp9/pdisk_1.dat
2025-11-01T16:05:15.781141Z node 8 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-11-01T16:05:15.782088Z node 8 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-11-01T16:05:15.853345Z node 7 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
2025-11-01T16:05:15.877999Z node 7 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(7, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-11-01T16:05:15.878068Z node 7 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(7, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-11-01T16:05:15.878729Z node 7 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(8, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-11-01T16:05:15.878773Z node 7 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(8, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-11-01T16:05:15.883092Z node 7 :HIVE WARN: hive_impl.cpp:811: HIVE#72057594037968897 Handle TEvInterconnect::TEvNodeConnected, NodeId 8 Cookie 8
2025-11-01T16:05:15.883184Z node 7 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(7, (0,0,0,0)) VolatileState: Connecting -> Connected
2025-11-01T16:05:15.883698Z node 7 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(8, (0,0,0,0)) VolatileState: Connecting -> Connected
TServer::EnableGrpc on GrpcPort 2406, node 7
2025-11-01T16:05:15.917888Z node 7 :NET_CLASSIFIER WARN: net_classifier.cpp:190: distributable config is empty, broken or outdated, will use file: /home/runner/.ya/build/build_root/ewjv/002800/r3tmp/yandexO5c5SQ.tmp
2025-11-01T16:05:15.917908Z node 7 :NET_CLASSIFIER WARN: net_classifier.cpp:196: will try to initialize from file: /home/runner/.ya/build/build_root/ewjv/002800/r3tmp/yandexO5c5SQ.tmp
2025-11-01T16:05:15.918007Z node 7 :NET_CLASSIFIER WARN: net_classifier.cpp:202: successfully initialized from file: /home/runner/.ya/build/build_root/ewjv/002800/r3tmp/yandexO5c5SQ.tmp
2025-11-01T16:05:15.918149Z node 7 :NET_CLASSIFIER ERROR: net_classifier.cpp:228: got bad distributable configuration
2025-11-01T16:05:15.930040Z node 7 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-11-01T16:05:15.948437Z INFO: TTestServer started on Port 4620 GrpcPort 2406
2025-11-01T16:05:15.995424Z node 8 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
TClient is connected to server localhost:4620
PQClient connected to localhost:2406
WaitRootIsUp 'Root'...
TClient::Ls request: Root
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "Root"
    PathId: 1
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 1
    CreateStep: 0
    ParentPathId: 1
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 1
      SubDomainVersion: 0
      SecurityStateVersion: 0
    }
    ChildrenExist: false
  }
  Children {
    Name: ".sys"
    PathId: 18446744073709551615
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 0
    CreateStep: 0
    ParentPathId: 18446744073709551615
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 0
      Pl...
(TRUNCATED)
WaitRootIsUp 'Root' success.
2025-11-01T16:05:16.129707Z node 7 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpAlterSubDomain, opId: 281474976720657:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_alter_subdomain.cpp:311)
waiting...
waiting...
2025-11-01T16:05:16.160422Z node 7 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720659:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:690)
waiting...
waiting...
waiting...
2025-11-01T16:05:16.770127Z node 7 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-11-01T16:05:16.777278Z node 8 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-11-01T16:05:18.901995Z node 7 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [7:7567788717251743034:2332], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-01T16:05:18.902081Z node 7 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [7:7567788717251743012:2329], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-01T16:05:18.902236Z node 7 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-01T16:05:18.902609Z node 7 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [7:7567788717251743039:2334], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-01T16:05:18.902662Z node 7 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-01T16:05:18.905915Z node 7 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateResourcePool, opId: 281474976720662:3, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_resource_pool.cpp:179)
2025-11-01T16:05:18.910457Z node 7 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [7:7567788717251743074:2336], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-01T16:05:18.910550Z node 7 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-01T16:05:18.912101Z node 7 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [7:7567788717251743082:2338], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-01T16:05:18.912185Z node 7 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-01T16:05:18.924224Z node 7 :KQP_WORKLOAD_SERVICE WARN: helpers.h:73: [WorkloadService] [TPoolCreatorActor] ActorId: [7:7567788717251743037:2333], DatabaseId: /Root, PoolId: default, Scheduled retry for error: { <main>: Error: Transaction 281474976720662 completed, doublechecking }
2025-11-01T16:05:18.943341Z node 7 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720663:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:690)
2025-11-01T16:05:18.970432Z node 8 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:570: Compilation failed, self: [8:7567788719774453136:2308], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-11-01T16:05:18.970700Z node 8 :KQP_SESSION WARN: kqp_session_actor.cpp:2506: SessionId: ydb://session/3?node_id=8&id=ZTVhZTdkZS02YmRhZWQ4Ni01YzFmZTAzYi04MmNmMDI0NA==, ActorId: [8:7567788719774453112:2302], ActorState: ExecuteState, TraceId: 01k902n0et92585kcm8mq6z73c, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-11-01T16:05:18.971203Z node 8 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-11-01T16:05:18.986619Z node 7 :TX_PROXY ERROR: schemereq.cpp:593: Actor# [7:7567788717251743234:2830] txid# 281474976720664, issues: { message: "Check failed: path: \'/Root/.metadata/workload_manager/pools/default\', error: path exist, request accepts it (id: [OwnerId: 72057594046644480, LocalPathId: 9], type: EPathTypeResourcePool, state: EPathStateNoChanges)" severity: 1 }
2025-11-01T16:05:19.006753Z node 7 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720665:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:690)
2025-11-01T16:05:19.011711Z node 7 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:570: Compilation failed, self: [7:7567788717251743262:2349], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:5:17: Error: At function: KiReadTable!
        <main>:5:17: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Versions]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-11-01T16:05:19.011905Z node 7 :KQP_SESSION WARN: kqp_session_actor.cpp:2506: SessionId: ydb://session/3?node_id=7&id=MTA1NjcxMmYtYjhiZGMwNGItOWQ4N2E0MjItYzExMmQwYmM=, ActorId: [7:7567788717251742996:2326], ActorState: ExecuteState, TraceId: 01k902n0dm2qg4sx785237czdz, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-11-01T16:05:19.012352Z node 7 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 5 column: 17 } message: "At function: KiReadTable!" end_position { row: 5 column: 17 } severity: 1 issues { position { row: 5 column: 17 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Versions]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 5 column: 17 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-11-01T16:05:19.153446Z node 7 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720666:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:690)
=== Init DC: UPSERT INTO `/Root/PQ/Config/V2/Cluster` (name, balancer, local, enabled, weight) VALUES ("dc1", "localhost", true, true, 1000), ("dc2", "dc2.logbroker.yandex.net", false, true, 1000);
2025-11-01T16:05:19.390393Z node 7 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976720667. Ctx: { TraceId: 01k902n0r6ese6yeffdf60m7xt, Database: , SessionId: ydb://session/3?node_id=7&id=NTVkODM3NjAtYWRkYWJjZGUtMTI0ZGY0NDQtMzRmYTY5MTI=, PoolId: default, DatabaseId: /Root}. Database not set, use /Root
=== CheckClustersList. Subcribe to ClusterTracker from [7:7567788721546710876:3093] 
2025-11-01T16:05:20.764259Z node 7 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[7:7567788704366840091:2080];send_to=[0:7307199536658146131:7762515];
2025-11-01T16:05:20.764378Z node 7 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
2025-11-01T16:05:20.771887Z node 8 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[8:7567788706889550845:2080];send_to=[0:7307199536658146131:7762515];
2025-11-01T16:05:20.771998Z node 8 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
=== CheckClustersList. Ok
PQ Client: create topic: rt3.dc1--topic1 with 1 partitions
CallPersQueueGRPC request to localhost:2406
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--topic1"
  }
}
2025-11-01T16:05:26.390980Z node 7 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--topic1, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
CallPersQueueGRPC request to localhost:2406
MetaRequest {
  CmdCreateTopic {
    Topic: "rt3.dc1--topic1"
    NumPartitions: 1
    Config {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
  }
}
CallPersQueueGRPC response:
Status: 129
ProxyErrorCode: 53
SchemeStatus: 1
FlatTxId {
  TxId: 281474976720672
  SchemeShardTabletId: 72057594046644480
  PathId: 13
}
ErrorCode: OK
AddTopic: rt3.dc1--topic1
===Run query:``DECLARE $version as Int64; DECLARE $path AS Utf8; DECLARE $cluster as Utf8; UPSERT INTO `/Root/PQ/Config/V2/Topics` (path, dc) VALUES ($path, $cluster); UPSERT INTO `/Root/PQ/Config/V2/Versions` (name, version) VALUES ("Topics", $version);`` with topic = topic1, dc = dc1
2025-11-01T16:05:26.420763Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1655: [72075186224037893][] pipe [7:7567788751611482381:3345] connected; active server actors: 1
2025-11-01T16:05:26.421520Z node 7 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1519: [72075186224037893][rt3.dc1--topic1] updating configuration. Deleted partitions []. Added partitions [0]
2025-11-01T16:05:26.422166Z node 7 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:971: [72075186224037893][rt3.dc1--topic1] Discovered subdomain [OwnerId: 72057594046644480, LocalPathId: 1] state, outOfSpace = 0 at RB 72075186224037893
2025-11-01T16:05:26.423595Z node 7 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:140: [72075186224037893][rt3.dc1--topic1] BALANCER INIT DONE for rt3.dc1--topic1: (0, 72075186224037892) 
2025-11-01T16:05:26.439382Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2960: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-11-01T16:05:26.442483Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2992: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-11-01T16:05:26.442761Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:787: [PQ: 72075186224037892] no config, start with empty partitions and default config
2025-11-01T16:05:26.442800Z node 8 :PERSQUEUE NOTICE: pq_impl.cpp:913: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-11-01T16:05:26.442837Z node 8 :PERSQUEUE INFO: pq_impl.cpp:612: [PQ: 72075186224037892] doesn't have tx writes info
2025-11-01T16:05:26.443220Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [7:7567788751611482398:2452], now have 1 active actors on pipe
2025-11-01T16:05:26.443261Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [7:7567788751611482380:3344], now have 1 active actors on pipe
2025-11-01T16:05:26.443573Z node 7 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:404: [72075186224037893][rt3.dc1--topic1] TEvClientConnected TabletId 72075186224037892, NodeId 8, Generation 1
2025-11-01T16:05:26.444680Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-01T16:05:26.448603Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-01T16:05:26.455393Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [7:7567788751611482436:3389], now have 1 active actors on pipe
2025-11-01T16:05:26.455886Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-01T16:05:26.459269Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-01T16:05:26.460283Z node 8 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--topic1:0:Initializer] Start initializing step TInitConfigStep
2025-11-01T16:05:26.460338Z node 8 :PERSQUEUE DEBUG: partition.cpp:1312: [72075186224037892][Partition][0][StateInit] HandleOnInit TEvPQ::TEvProposePartitionConfig
2025-11-01T16:05:26.460646Z node 8 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--topic1:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-11-01T16:05:26.460879Z node 8 :PERSQUEUE INFO: partition_init.cpp:1101: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [8:7567788754134191754:2362]
2025-11-01T16:05:26.464025Z node 8 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--topic1:0:Initializer] Start initializing step TInitFieldsStep
2025-11-01T16:05:26.464058Z node 8 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--topic1:0:Initializer] Initializing completed.
2025-11-01T16:05:26.464084Z node 8 :PERSQUEUE INFO: partition.cpp:707: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--topic1' partition 0 generation 1 [8:7567788754134191754:2362]
2025-11-01T16:05:26.464114Z node 8 :PERSQUEUE DEBUG: partition.cpp:727: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--topic1 partitition 0 so 0 endOffset 0 Head Offset 0 PartNo 0 PackedSize 0 count 0 nextOffset 0 batches 0
2025-11-01T16:05:26.464145Z node 8 :PERSQUEUE DEBUG: partition_mlp.cpp:83: [72075186224037892][Partition][0][StateIdle] Initializing MLP Consumers: 0
2025-11-01T16:05:26.465803Z node 8 :PERSQUEUE DEBUG: partition.cpp:4273: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 1
2025-11-01T16:05:26.465849Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T16:05:26.465934Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T16:05:26.465948Z node 8 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-01T16:05:26.465971Z node 8 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-11-01T16:05:26.465988Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-11-01T16:05:26.466002Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T16:05:26.466014Z node 8 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-11-01T16:05:26.466047Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:923: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-11-01T16:05:26.466114Z node 8 :PERSQUEUE DEBUG: partition_mlp.cpp:60: [72075186224037892][Partition][0][StateIdle] Process MLP pending events. Count 0
2025-11-01T16:05:26.466836Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-01T16:05:26.467019Z node 8 :PERSQUEUE DEBUG: partition_compaction.cpp:183: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-01T16:05:26.473523Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-01T16:05:26.473674Z node 8 :PERSQUEUE DEBUG: partition.cpp:1416: [72075186224037892][Partition][0][StateIdle] Handle TEvPQ::TEvTxCommit Step 1762013126503, TxId 281474976720672
2025-11-01T16:05:26.473697Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-11-01T16:05:26.473711Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T16:05:26.473849Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-01T16:05:26.474074Z node 8 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-01T16:05:26.476466Z node 8 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-01T16:05:26.476645Z node 8 :PERSQUEUE DEBUG: partition_mlp.cpp:83: [72075186224037892][Partition][0][StateIdle] Initializing MLP Consumers: 0
2025-11-01T16:05:26.476767Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-11-01T16:05:26.476798Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T16:05:26.476812Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T16:05:26.476825Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-01T16:05:26.476854Z node 8 :PERSQUEUE DEBUG: partition_compaction.cpp:183: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-01T16:05:26.477188Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:398: [PQ: 72075186224037892] Apply new config PartitionConfig { LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 } PartitionIds: 0 TopicName: "rt3.dc1--topic1" Version: 0 LocalDC: true Codecs { Ids: 0 Ids: 1 Ids: 2 Codecs: "raw" Codecs: "gzip" Codecs: "lzop" } TopicPath: "/Root/PQ/rt3.dc1--topic1" YcCloudId: "" YcFolderId: "" YdbDatabaseId: "" YdbDatabasePath: "/Root" Partitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } AllPartitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } Consumers { Name: "user" ReadFromTimestampsMs: 0 FormatVersion: 0 Version: 0 Generation: 0 } MonitoringProjectId: ""
2025-11-01T16:05:26.477280Z node 8 :PERSQUEUE NOTICE: pq_impl.cpp:913: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-11-01T16:05:26.477540Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-01T16:05:26.484059Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-01T16:05:26.484163Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-01T16:05:26.487202Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-01T16:05:26.544750Z node 7 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976720673. Ctx: { TraceId: 01k902n7ry082a0grr2cjcd2zq, Database: , SessionId: ydb://session/3?node_id=7&id=Yzc4MWViYS1hOWQ4YTRiNi03NGE0OTQ5YS0zMjI4NTFjMQ==, PoolId: default, DatabaseId: /Root}. Database not set, use /Root
===Query complete
TClient::Ls request: /Root/PQ/rt3.dc1--topic1
2025-11-01T16:05:26.566217Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T16:05:26.566266Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T16:05:26.566277Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--topic1"
    PathId: 13
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976720672
    CreateStep: 1762013126503
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--topic1"
    PathId: 13
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 600000...
(TRUNCATED)
GetTopicVersionFromPath:  record Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--topic1"
    PathId: 13
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976720672
    CreateStep: 1762013126503
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--topic1"
    PathId: 13
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      YdbDatabasePath: "/Root"
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
    Partitions {
      PartitionId: 0
      TabletId: 72075186224037892
      Status: Active
    }
    AlterVersion: 1
    BalancerTabletID: 72075186224037893
    NextPartitionId: 1
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 1
      PlanResolution: 7
      Coordinators: 72057594046316545
      TimeCastBucketsPerMediator: 2
      Mediators: 72057594046382081
    }
    DomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    PathsInside: 12
    PathsLimit: 10000
    ShardsInside: 6
    ShardsLimit: 200000
    ResourcesDomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    DiskSpaceUsage {
      Tables {
        TotalSize: 0
        DataSize: 0
        IndexSize: 0
      }
      Topics {
        ReserveSize: 0
        AccountSize: 0
        DataSize: 0
        UsedReserveSize: 0
      }
    }
    PQPartitionsInside: 1
    PQPartitionsLimit: 1000000
    SchemeLimits {
      MaxDepth: 32
      MaxPaths: 10000
      MaxChildrenInDir: 100000
      MaxAclBytesSize: 10240
      MaxTableColumns: 200
      MaxTableColumnNameLength: 255
      MaxTableKeyColumns: 30
      MaxTableIndices: 20
      MaxShards: 200000
      MaxShardsInPath: 35000
      MaxConsistentCopyTargets: 10000
      MaxPathElementLength: 255
      ExtraPathSymbolsAllowed: "!\"#$%&\'()*+,-.:;<=>?@[\\]^_`{|}~"
      MaxPQPartitions: 1000000
      MaxTableCdcStreams: 5
      MaxExports: 10
      MaxImports: 10
      MaxColumnTableColumns: 10000
    }
  }
}
Path: "/Root/PQ/rt3.dc1--topic1"
 name rt3.dc1--topic1 version1
CallPersQueueGRPC request to localhost:2406
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--topic1"
  }
}
2025-11-01T16:05:26.571081Z node 7 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
MetaResponse {
  CmdGetTopicMetadataResult {
    TopicInfo {
      Topic: "rt3.dc1--topic1"
      NumPartitions: 1
      Config {
        PartitionConfig {
          LifetimeSeconds: 86400
          LowWatermark: 8388608
          SourceIdLifetimeSeconds: 86400
          WriteSpeedInBytesPerSecond: 20000000
          BurstSize: 20000000
          SourceIdMaxCounts: 6000000
        }
        Version: 1
        LocalDC: true
        Codecs {
          Ids: 0
          Ids: 1
          Ids: 2
          Codecs: "raw"
          Codecs: "gzip"
          Codecs: "lzop"
        }
        TopicPath: "/Root/PQ/rt3.dc1--topic1"
        YdbDatabasePath: "/Root"
        Consumers {
          Name: "user"
          ReadFromTimestampsMs: 0
          FormatVersion: 0
          Version: 0
        }
      }
      ErrorCode: OK
    }
  }
}
=== Topic created, have version: 1
2025-11-01T16:05:26.579425Z :INFO: [] [] [aa6bd8f2-140b5929-e6291a97-498f8dbd] Starting read session
2025-11-01T16:05:26.579516Z :DEBUG: [] [] [aa6bd8f2-140b5929-e6291a97-498f8dbd] Starting session to cluster null (localhost:2406)
2025-11-01T16:05:26.584623Z :DEBUG: [] [] [aa6bd8f2-140b5929-e6291a97-498f8dbd] [null] In Reconnect, ReadSizeBudget = 2621440, ReadSizeServerDelta = 0
2025-11-01T16:05:26.584687Z :DEBUG: [] [] [aa6bd8f2-140b5929-e6291a97-498f8dbd] [null] New values: ReadSizeBudget = 2621440, ReadSizeServerDelta = 0
2025-11-01T16:05:26.584746Z :DEBUG: [] [] [aa6bd8f2-140b5929-e6291a97-498f8dbd] [null] Reconnecting session to cluster null in 0.000000s
2025-11-01T16:05:26.590310Z :DEBUG: [] [] [aa6bd8f2-140b5929-e6291a97-498f8dbd] [null] Successfully connected. Initializing session
2025-11-01T16:05:26.591352Z node 7 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:109: new grpc connection
2025-11-01T16:05:26.591374Z node 7 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:131: new session created cookie 1
2025-11-01T16:05:26.591843Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { topic: "topic1" } read_only_original: true consumer: "shared/user" read_params { max_read_size: 5242880 } } }
2025-11-01T16:05:26.592066Z node 7 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 1 consumer shared/user session shared/user_7_1_18026246482560886463_v1 read init: from# ipv6:[::1]:39382, request# { init_request { topics_read_settings { topic: "topic1" } read_only_original: true consumer: "shared/user" read_params { max_read_size: 5242880 } } }
2025-11-01T16:05:26.592539Z node 7 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 1 consumer shared/user session shared/user_7_1_18026246482560886463_v1 auth for : user
2025-11-01T16:05:26.593071Z node 7 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 1 consumer shared/user session shared/user_7_1_18026246482560886463_v1 Handle describe topics response
2025-11-01T16:05:26.593194Z node 7 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 1 consumer shared/user session shared/user_7_1_18026246482560886463_v1 auth is DEAD
2025-11-01T16:05:26.593275Z node 7 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 1 consumer shared/user session shared/user_7_1_18026246482560886463_v1 auth ok: topics# 1, initDone# 0
2025-11-01T16:05:26.594446Z node 7 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 1 consumer shared/user session shared/user_7_1_18026246482560886463_v1 register session: topic# rt3.dc1--topic1
2025-11-01T16:05:26.594761Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1655: [72075186224037893][rt3.dc1--topic1] pipe [7:7567788751611482507:2471] connected; active server actors: 1
2025-11-01T16:05:26.594794Z node 7 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1706: [72075186224037893][rt3.dc1--topic1] consumer "user" register session for pipe [7:7567788751611482507:2471] session shared/user_7_1_18026246482560886463_v1
2025-11-01T16:05:26.594843Z node 7 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:639: [72075186224037893][rt3.dc1--topic1] consumer user register readable partition 0
2025-11-01T16:05:26.594899Z node 7 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:669: [72075186224037893][rt3.dc1--topic1] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-11-01T16:05:26.594939Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:871: [72075186224037893][rt3.dc1--topic1] consumer user register reading session ReadingSession "shared/user_7_1_18026246482560886463_v1" (Sender=[7:7567788751611482504:2471], Pipe=[7:7567788751611482507:2471], Partitions=[], ActiveFamilyCount=0)
2025-11-01T16:05:26.594966Z node 7 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1186: [72075186224037893][rt3.dc1--topic1] consumer user rebalancing was scheduled
2025-11-01T16:05:26.595018Z node 7 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1258: [72075186224037893][rt3.dc1--topic1] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-11-01T16:05:26.595084Z node 7 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1305: [72075186224037893][rt3.dc1--topic1] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_7_1_18026246482560886463_v1" (Sender=[7:7567788751611482504:2471], Pipe=[7:7567788751611482507:2471], Partitions=[], ActiveFamilyCount=0)
2025-11-01T16:05:26.595148Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:549: [72075186224037893][rt3.dc1--topic1] consumer user family 1 status Active partitions [0] session "shared/user_7_1_18026246482560886463_v1" sender [7:7567788751611482504:2471] lock partition 0 for ReadingSession "shared/user_7_1_18026246482560886463_v1" (Sender=[7:7567788751611482504:2471], Pipe=[7:7567788751611482507:2471], Partitions=[], ActiveFamilyCount=1) generation 1 step 1
2025-11-01T16:05:26.595207Z node 7 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1325: [72075186224037893][rt3.dc1--topic1] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-11-01T16:05:26.595257Z node 7 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1402: [72075186224037893][rt3.dc1--topic1] consumer user balancing duration: 0.000191s
2025-11-01T16:05:26.595806Z :INFO: [] [] [aa6bd8f2-140b5929-e6291a97-498f8dbd] [null] Server session id: shared/user_7_1_18026246482560886463_v1
2025-11-01T16:05:26.596037Z :DEBUG: [] [] [aa6bd8f2-140b5929-e6291a97-498f8dbd] [null] After sending read request: ReadSizeBudget = 2621440, ReadSizeServerDelta = 0
2025-11-01T16:05:26.596125Z node 7 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 1 consumer shared/user session shared/user_7_1_18026246482560886463_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--topic1" Generation: 1 Step: 1 Session: "shared/user_7_1_18026246482560886463_v1" ClientId: "user" PipeClient { RawX1: 7567788751611482507 RawX2: 4503629692144039 } Path: "/Root/PQ/rt3.dc1--topic1" }
2025-11-01T16:05:26.596228Z node 7 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 1 consumer shared/user session shared/user_7_1_18026246482560886463_v1 INITING TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1)
2025-11-01T16:05:26.596458Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_7_1_18026246482560886463_v1 grpc read done: success# 1, data# { read { } }
2025-11-01T16:05:26.596610Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_7_1_18026246482560886463_v1 got read request: guid# 972c0b9e-4a37a4a6-9481a7f4-a2397d86
2025-11-01T16:05:26.596994Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [7:7567788751611482510:2474], now have 1 active actors on pipe
2025-11-01T16:05:26.597270Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-01T16:05:26.597312Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-01T16:05:26.597348Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:1748: [PQ: 72075186224037892] Created session shared/user_7_1_18026246482560886463_v1 on pipe: [7:7567788751611482510:2474]
2025-11-01T16:05:26.597430Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T16:05:26.597433Z node 8 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_7_1_18026246482560886463_v1:1 with generation 1
2025-11-01T16:05:26.597465Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T16:05:26.597478Z node 8 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-01T16:05:26.597537Z node 8 :PERSQUEUE DEBUG: partition.cpp:3666: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 user user session is set to 0 (startOffset 0) session shared/user_7_1_18026246482560886463_v1
2025-11-01T16:05:26.597554Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-01T16:05:26.597683Z node 8 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-01T16:05:26.597088Z node 7 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_7_1_18026246482560886463_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 1, pipe: [7:7567788751611482510:2474]
2025-11-01T16:05:26.600123Z node 8 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-01T16:05:26.600198Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-11-01T16:05:26.600246Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T16:05:26.600262Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T16:05:26.600278Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-01T16:05:26.600307Z node 8 :PERSQUEUE DEBUG: partition_compaction.cpp:183: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-01T16:05:26.600341Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-11-01T16:05:26.600637Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_7_1_18026246482560886463_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 0 SizeLag: 0 WriteTimestampEstimateMS: 1762013126566 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-11-01T16:05:26.600689Z node 7 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 1 consumer shared/user session shared/user_7_1_18026246482560886463_v1 INIT DONE TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 0 readOffset 0 committedOffset 0
2025-11-01T16:05:26.600745Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 1 consumer shared/user session shared/user_7_1_18026246482560886463_v1 sending to client partition status
>>>> message: CreatePartitionStream { PartitionStreamId: 1 TopicPath: topic1 Cluster: dc1 PartitionId: 0 CommittedOffset: 0 EndOffset: 0 }
2025-11-01T16:05:26.601424Z :INFO: [] [] [aa6bd8f2-140b5929-e6291a97-498f8dbd] [null] Confirm partition stream create. Partition stream id: 1. Cluster: "dc1". Topic: "topic1". Partition: 0. Read offset: (NULL)
2025-11-01T16:05:26.601966Z :DEBUG: [] MessageGroupId [source0] SessionId [] Write session: try to update token
2025-11-01T16:05:26.601838Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_7_1_18026246482560886463_v1 grpc read done: success# 1, data# { start_read { topic { path: "topic1" } cluster: "dc1" assign_id: 1 } }
2025-11-01T16:05:26.601982Z node 7 :PQ_READ_PROXY INFO: read_session_actor.cpp:539: session cookie 1 consumer shared/user session shared/user_7_1_18026246482560886463_v1 got StartRead from client: partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 0, commitOffset# 0
2025-11-01T16:05:26.602808Z :INFO: [] MessageGroupId [source0] SessionId [] Write session: Do CDS request
2025-11-01T16:05:26.602035Z node 7 :PQ_READ_PROXY INFO: partition_actor.cpp:1023: session cookie 1 consumer shared/user session shared/user_7_1_18026246482560886463_v1 Start reading TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 0 readOffset 0 committedOffset 0 clientCommitOffset 0 clientReadOffset 0
2025-11-01T16:05:26.602896Z :INFO: [] MessageGroupId [source0] SessionId [] Start write session. Will connect to endpoint: localhost:2406
2025-11-01T16:05:26.602069Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_7_1_18026246482560886463_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 1 from offset 0
2025-11-01T16:05:26.607110Z :DEBUG: [] MessageGroupId [source0] SessionId [] Write session: send init request: init_request { topic: "topic1" message_group_id: "source0" }
2025-11-01T16:05:26.607545Z node 7 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-11-01T16:05:26.607574Z node 7 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1
2025-11-01T16:05:26.607901Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId:  grpc read done: success: 1 data: init_request { topic: "topic1" message_group_id: "source0" }
2025-11-01T16:05:26.608017Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1 topic: "topic1" message_group_id: "source0" from ipv6:[::1]:39382
2025-11-01T16:05:26.608040Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:39382 proto=v1  topic=topic1 durationSec=0
2025-11-01T16:05:26.608050Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-11-01T16:05:26.609746Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1 sessionId:  describe result for acl check
2025-11-01T16:05:26.609879Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-11-01T16:05:26.609897Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-11-01T16:05:26.609907Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-11-01T16:05:26.609925Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [7:7567788751611482514:2475] (SourceId=source0, PreferedPartition=(NULL)) StartKqpSession
2025-11-01T16:05:26.613098Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [7:7567788751611482514:2475] (SourceId=source0, PreferedPartition=(NULL)) Select from the table
2025-11-01T16:05:26.666546Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T16:05:26.666572Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T16:05:26.666585Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-01T16:05:26.766930Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T16:05:26.766964Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T16:05:26.766980Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-01T16:05:26.798640Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [7:7567788751611482514:2475] (SourceId=source0, PreferedPartition=(NULL)) RequestPQRB
2025-11-01T16:05:26.799004Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1655: [72075186224037893][rt3.dc1--topic1] pipe [7:7567788751611482559:2475] connected; active server actors: 1
2025-11-01T16:05:26.799044Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [7:7567788751611482514:2475] (SourceId=source0, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=source0
2025-11-01T16:05:26.799063Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [7:7567788751611482514:2475] (SourceId=source0, PreferedPartition=(NULL)) Update the table
2025-11-01T16:05:26.799403Z node 7 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1659: [72075186224037893][rt3.dc1--topic1] pipe [7:7567788751611482559:2475] disconnected.
2025-11-01T16:05:26.799430Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1670: [72075186224037893][rt3.dc1--topic1] pipe [7:7567788751611482559:2475] disconnected; active server actors: 1
2025-11-01T16:05:26.799445Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1695: [72075186224037893][rt3.dc1--topic1] pipe [7:7567788751611482559:2475] disconnected no session
2025-11-01T16:05:26.867262Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T16:05:26.867298Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T16:05:26.867314Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-01T16:05:26.929400Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [7:7567788751611482514:2475] (SourceId=source0, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-11-01T16:05:26.929448Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [7:7567788751611482514:2475] (SourceId=source0, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-11-01T16:05:26.929467Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [7:7567788751611482514:2475] (SourceId=source0, PreferedPartition=(NULL)) Start idle
2025-11-01T16:05:26.929495Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-11-01T16:05:26.931272Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 8, Generation: 1
2025-11-01T16:05:26.932741Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [7:7567788751611482584:2475], now have 1 active actors on pipe
2025-11-01T16:05:26.932824Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-01T16:05:26.932855Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-01T16:05:26.932952Z node 8 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie source0|238013d2-cb05c644-ea089140-1087fd39_0 generated for partition 0 topic 'rt3.dc1--topic1' owner source0
2025-11-01T16:05:26.932999Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T16:05:26.933022Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T16:05:26.933039Z node 8 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-01T16:05:26.933086Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-01T16:05:26.933133Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-01T16:05:26.933197Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-01T16:05:26.934764Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-01T16:05:26.934812Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-01T16:05:26.934909Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-01T16:05:26.936526Z :INFO: [] MessageGroupId [source0] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1762013126936 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-11-01T16:05:26.936719Z :INFO: [] MessageGroupId [source0] SessionId [] Write session established. Init response: session_id: "source0|238013d2-cb05c644-ea089140-1087fd39_0" topic: "topic1" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-11-01T16:05:26.935654Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1 partition: 0 MaxSeqNo: 0 sessionId: source0|238013d2-cb05c644-ea089140-1087fd39_0
2025-11-01T16:05:26.938759Z :DEBUG: [] MessageGroupId [source0] SessionId [source0|238013d2-cb05c644-ea089140-1087fd39_0] Write 1 messages with Id from 1 to 1
2025-11-01T16:05:26.938888Z :INFO: [] MessageGroupId [source0] SessionId [source0|238013d2-cb05c644-ea089140-1087fd39_0] Write session: close. Timeout = 10000 ms
2025-11-01T16:05:26.954087Z :DEBUG: [] MessageGroupId [source0] SessionId [source0|238013d2-cb05c644-ea089140-1087fd39_0] Write session: try to update token
2025-11-01T16:05:26.954166Z :DEBUG: [] MessageGroupId [source0] SessionId [source0|238013d2-cb05c644-ea089140-1087fd39_0] Send 1 message(s) (0 left), first sequence number is 1
2025-11-01T16:05:26.954825Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId: source0|238013d2-cb05c644-ea089140-1087fd39_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-01T16:05:26.955027Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-01T16:05:26.956729Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-01T16:05:26.956772Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-01T16:05:26.956848Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-11-01T16:05:26.957038Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-01T16:05:26.957413Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-01T16:05:26.957431Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-01T16:05:26.957743Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: '\0source0' SeqNo: 1 partNo : 0 messageNo: 1 size 1122 offset: -1
2025-11-01T16:05:26.957780Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-01T16:05:26.957823Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T16:05:26.957848Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T16:05:26.957860Z node 8 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-01T16:05:26.957968Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId '\0source0' seqNo 1 partNo 0
2025-11-01T16:05:26.958923Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '\0source0' seqNo 1 partNo 0 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 1197 count 1 nextOffset 1 batches 1
2025-11-01T16:05:26.958963Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-01T16:05:26.959513Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 0,1 HeadOffset 0 endOffset 0 curOffset 1 d0000000000_00000000000000000000_00000_0000000001_00000? size 1185 WTime 1762013126959
2025-11-01T16:05:26.959688Z node 8 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-01T16:05:26.959831Z node 8 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 0 partNo 0 count 1 size 1185
2025-11-01T16:05:26.964293Z node 8 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 0 count 1 size 1185 actorID [8:7567788754134191738:2362]
2025-11-01T16:05:26.964358Z node 8 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-01T16:05:26.964421Z node 8 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 0 suffix '63' size 1185
2025-11-01T16:05:26.964424Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1130 WriteNewSizeFromSupportivePartitions# 0
2025-11-01T16:05:26.964463Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-01T16:05:26.964516Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0source0', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 1, partNo: 0, Offset: 0 is stored on disk
2025-11-01T16:05:26.964765Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:923: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-11-01T16:05:26.964795Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:965: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-11-01T16:05:26.964820Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T16:05:26.964835Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T16:05:26.964850Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-01T16:05:26.964881Z node 8 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-01T16:05:26.964921Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 1  requestId: <none> cookie: 1
2025-11-01T16:05:26.964947Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 1 consumer shared/user session shared/user_7_1_18026246482560886463_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 0 EndOffset 0 newEndOffset 1 commitOffset 0 clientCommitOffset 0 cookie 1 readingFinished 0 firstRead 1
2025-11-01T16:05:26.965049Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:880: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--topic1' partition 0 user user offset 0 partno 0 count 1 size 1024000 endOffset 1 max time lag 0ms effective offset 0
2025-11-01T16:05:26.965005Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_7_1_18026246482560886463_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 0 endOffset 1
2025-11-01T16:05:26.965102Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_7_1_18026246482560886463_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 0, endOffset# 1, WTime# 0, sizeLag# 1185
2025-11-01T16:05:26.965132Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_7_1_18026246482560886463_v1TEvPartitionReady. Aval parts: 1
2025-11-01T16:05:26.965256Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:1105: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 1185 count 1 last offset 0, current partition end offset: 1
2025-11-01T16:05:26.965280Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:1121: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-11-01T16:05:26.965318Z node 8 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 0 partno 0 count 1 parts_count 0 source 1 size 1185 accessed 0 times before, last time 2025-11-01T16:05:26.000000Z
2025-11-01T16:05:26.965357Z node 8 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 3. All 1 blobs are from cache.
2025-11-01T16:05:26.965396Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:572: FormAnswer for 1 blobs
2025-11-01T16:05:26.965413Z node 8 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 0 suffix '63'
2025-11-01T16:05:26.965179Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_7_1_18026246482560886463_v1 performing read request: guid# 972c0b9e-4a37a4a6-9481a7f4-a2397d86, from# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), count# 1, size# 1422, partitionsAsked# 1, maxTimeLag# 0ms
2025-11-01T16:05:26.965269Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-01T16:05:26.965553Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 0 totakecount 1 count 1 size 1165 from pos 0 cbcount 1
2025-11-01T16:05:26.965637Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:1015: Topic 'rt3.dc1--topic1' partition 0 user user readTimeStamp done, result 1762013126957 queuesize 0 startOffset 0
2025-11-01T16:05:26.966114Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-01T16:05:26.965740Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_7_1_18026246482560886463_v1 READ FROM TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1)maxCount 1 maxSize 1422 maxTimeLagMs 0 readTimestampMs 0 readOffset 0 EndOffset 1 ClientCommitOffset 0 committedOffset 0 Guid 972c0b9e-4a37a4a6-9481a7f4-a2397d86
2025-11-01T16:05:26.966148Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-01T16:05:26.966247Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:880: [72075186224037892][Partition][0][StateIdle] read cookie 4 Topic 'rt3.dc1--topic1' partition 0 user user offset 0 partno 0 count 1 size 1422 endOffset 1 max time lag 0ms effective offset 0
2025-11-01T16:05:26.966369Z :DEBUG: [] MessageGroupId [source0] SessionId [source0|238013d2-cb05c644-ea089140-1087fd39_0] Write session got write response: sequence_numbers: 1 offsets: 0 already_written: false write_statistics { persist_duration_ms: 5 queued_in_partition_duration_ms: 1 }
2025-11-01T16:05:26.966430Z :DEBUG: [] MessageGroupId [source0] SessionId [source0|238013d2-cb05c644-ea089140-1087fd39_0] Write session: acknoledged message 1
2025-11-01T16:05:26.966433Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:1105: [72075186224037892][Partition][0][StateIdle] read cookie 4 added 1 blobs, size 1185 count 1 last offset 0, current partition end offset: 1
2025-11-01T16:05:26.966453Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:1121: [72075186224037892][Partition][0][StateIdle] Reading cookie 4. Send blob request.
2025-11-01T16:05:26.966484Z node 8 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 0 partno 0 count 1 parts_count 0 source 1 size 1185 accessed 1 times before, last time 2025-11-01T16:05:26.000000Z
2025-11-01T16:05:26.966512Z node 8 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 4. All 1 blobs are from cache.
2025-11-01T16:05:26.966542Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:572: FormAnswer for 1 blobs
2025-11-01T16:05:26.966556Z node 8 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 0 suffix '63'
2025-11-01T16:05:26.966675Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 0 totakecount 1 count 1 size 1165 from pos 0 cbcount 1
2025-11-01T16:05:26.966761Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-01T16:05:26.967257Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_7_1_18026246482560886463_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 1 Result { Offset: 0 Data: "... 1122 bytes ..." SourceId: "\000source0" SeqNo: 1 WriteTimestampMS: 1762013126957 CreateTimestampMS: 1762013126937 UncompressedSize: 1047552 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 20 RealReadOffset: 0 WaitQuotaTimeMs: 0 EndOffset: 1 StartOffset: 0 } Cookie: 0 }
2025-11-01T16:05:26.967439Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_7_1_18026246482560886463_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 2 from offset 1
2025-11-01T16:05:26.967492Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_7_1_18026246482560886463_v1 after read state TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 1 ReadOffset 1 ReadGuid 972c0b9e-4a37a4a6-9481a7f4-a2397d86 has messages 1
2025-11-01T16:05:26.967575Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T16:05:26.967621Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_7_1_18026246482560886463_v1 read done: guid# 972c0b9e-4a37a4a6-9481a7f4-a2397d86, partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), size# 1222
2025-11-01T16:05:26.967598Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T16:05:26.967656Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_7_1_18026246482560886463_v1 response to read: guid# 972c0b9e-4a37a4a6-9481a7f4-a2397d86
2025-11-01T16:05:26.967613Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-01T16:05:26.967908Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_7_1_18026246482560886463_v1 Process answer. Aval parts: 0
2025-11-01T16:05:26.968470Z :DEBUG: [] [] [aa6bd8f2-140b5929-e6291a97-498f8dbd] [null] After sending read request: ReadSizeBudget = 2621440, ReadSizeServerDelta = 0
2025-11-01T16:05:26.968710Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_7_1_18026246482560886463_v1 grpc read done: success# 1, data# { read { } }
2025-11-01T16:05:26.968834Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_7_1_18026246482560886463_v1 got read request: guid# 4ed9ff1e-5ea9886e-b4d4a018-cbbfdb96
2025-11-01T16:05:27.039034Z :INFO: [] MessageGroupId [source0] SessionId [source0|238013d2-cb05c644-ea089140-1087fd39_0] Write session will now close
2025-11-01T16:05:27.039101Z :DEBUG: [] MessageGroupId [source0] SessionId [source0|238013d2-cb05c644-ea089140-1087fd39_0] Write session: aborting
2025-11-01T16:05:27.040424Z :INFO: [] MessageGroupId [source0] SessionId [source0|238013d2-cb05c644-ea089140-1087fd39_0] Write session: gracefully shut down, all writes complete
2025-11-01T16:05:27.040690Z :DEBUG: [] MessageGroupId [source0] SessionId [source0|238013d2-cb05c644-ea089140-1087fd39_0] Write session is aborting and will not restart
2025-11-01T16:05:27.040792Z :DEBUG: [] MessageGroupId [source0] SessionId [source0|238013d2-cb05c644-ea089140-1087fd39_0] Write session: destroy
2025-11-01T16:05:27.043171Z :DEBUG: [] MessageGroupId [source1] SessionId [] Write session: try to update token
2025-11-01T16:05:27.043535Z :INFO: [] MessageGroupId [source1] SessionId [] Write session: Do CDS request
2025-11-01T16:05:27.043562Z :INFO: [] MessageGroupId [source1] SessionId [] Start write session. Will connect to endpoint: localhost:2406
2025-11-01T16:05:27.049286Z :DEBUG: [] MessageGroupId [source1] SessionId [] Write session: send init request: init_request { topic: "topic1" message_group_id: "source1" }
2025-11-01T16:05:27.054064Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [7:7567788751611482584:2475] destroyed
2025-11-01T16:05:27.054143Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-11-01T16:05:27.054179Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T16:05:27.054196Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T16:05:27.054218Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-01T16:05:27.052643Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId: source0|238013d2-cb05c644-ea089140-1087fd39_0 grpc read done: success: 0 data: 
2025-11-01T16:05:27.052674Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 1 sessionId: source0|238013d2-cb05c644-ea089140-1087fd39_0 grpc read failed
2025-11-01T16:05:27.052712Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 1 sessionId: source0|238013d2-cb05c644-ea089140-1087fd39_0 grpc closed
2025-11-01T16:05:27.052735Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1 sessionId: source0|238013d2-cb05c644-ea089140-1087fd39_0 is DEAD
2025-11-01T16:05:27.053651Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-11-01T16:05:27.053793Z node 7 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-11-01T16:05:27.053805Z node 7 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2
2025-11-01T16:05:27.054416Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId:  grpc read done: success: 1 data: init_request { topic: "topic1" message_group_id: "source1" }
2025-11-01T16:05:27.054534Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2 topic: "topic1" message_group_id: "source1" from ipv6:[::1]:39382
2025-11-01T16:05:27.054552Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:39382 proto=v1  topic=topic1 durationSec=0
2025-11-01T16:05:27.054564Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-11-01T16:05:27.059472Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2 sessionId:  describe result for acl check
2025-11-01T16:05:27.059599Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-11-01T16:05:27.059607Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-11-01T16:05:27.059614Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-11-01T16:05:27.059625Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [7:7567788755906449889:2485] (SourceId=source1, PreferedPartition=(NULL)) StartKqpSession
2025-11-01T16:05:27.062596Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [7:7567788755906449889:2485] (SourceId=source1, PreferedPartition=(NULL)) Select from the table
2025-11-01T16:05:27.067979Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T16:05:27.068020Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T16:05:27.068037Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-01T16:05:27.084318Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [7:7567788755906449889:2485] (SourceId=source1, PreferedPartition=(NULL)) RequestPQRB
2025-11-01T16:05:27.085591Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1655: [72075186224037893][rt3.dc1--topic1] pipe [7:7567788755906449905:2485] connected; active server actors: 1
2025-11-01T16:05:27.085787Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [7:7567788755906449889:2485] (SourceId=source1, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=source1
2025-11-01T16:05:27.085810Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [7:7567788755906449889:2485] (SourceId=source1, PreferedPartition=(NULL)) Update the table
2025-11-01T16:05:27.086904Z node 7 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1659: [72075186224037893][rt3.dc1--topic1] pipe [7:7567788755906449905:2485] disconnected.
2025-11-01T16:05:27.086932Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1670: [72075186224037893][rt3.dc1--topic1] pipe [7:7567788755906449905:2485] disconnected; active server actors: 1
2025-11-01T16:05:27.086948Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1695: [72075186224037893][rt3.dc1--topic1] pipe [7:7567788755906449905:2485] disconnected no session
2025-11-01T16:05:27.096055Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [7:7567788755906449889:2485] (SourceId=source1, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-11-01T16:05:27.096101Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [7:7567788755906449889:2485] (SourceId=source1, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-11-01T16:05:27.096116Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [7:7567788755906449889:2485] (SourceId=source1, PreferedPartition=(NULL)) Start idle
2025-11-01T16:05:27.096142Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-11-01T16:05:27.097729Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [7:7567788755906449919:2485], now have 1 active actors on pipe
2025-11-01T16:05:27.097905Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 8, Generation: 1
2025-11-01T16:05:27.098068Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-01T16:05:27.098107Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-01T16:05:27.098185Z node 8 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie source1|46ed37ed-22b77d18-45f737a4-71531411_0 generated for partition 0 topic 'rt3.dc1--topic1' owner source1
2025-11-01T16:05:27.098228Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T16:05:27.098251Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T16:05:27.098269Z node 8 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-01T16:05:27.098313Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-01T16:05:27.098359Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-01T16:05:27.098414Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-01T16:05:27.099194Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-01T16:05:27.099222Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-01T16:05:27.099306Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-01T16:05:27.099716Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2 partition: 0 MaxSeqNo: 0 sessionId: source1|46ed37ed-22b77d18-45f737a4-71531411_0
2025-11-01T16:05:27.100588Z :INFO: [] MessageGroupId [source1] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1762013127100 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-11-01T16:05:27.100694Z :INFO: [] MessageGroupId [source1] SessionId [] Write session established. Init response: session_id: "source1|46ed37ed-22b77d18-45f737a4-71531411_0" topic: "topic1" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-11-01T16:05:27.102233Z :DEBUG: [] MessageGroupId [source1] SessionId [source1|46ed37ed-22b77d18-45f737a4-71531411_0] Write 1 messages with Id from 1 to 1
2025-11-01T16:05:27.102323Z :INFO: [] MessageGroupId [source1] SessionId [source1|46ed37ed-22b77d18-45f737a4-71531411_0] Write session: close. Timeout = 10000 ms
2025-11-01T16:05:27.121243Z :DEBUG: [] MessageGroupId [source1] SessionId [source1|46ed37ed-22b77d18-45f737a4-71531411_0] Write session: try to update token
2025-11-01T16:05:27.121303Z :DEBUG: [] MessageGroupId [source1] SessionId [source1|46ed37ed-22b77d18-45f737a4-71531411_0] Send 1 message(s) (0 left), first sequence number is 1
2025-11-01T16:05:27.122265Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: source1|46ed37ed-22b77d18-45f737a4-71531411_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-01T16:05:27.122572Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-01T16:05:27.123065Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-01T16:05:27.123115Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-01T16:05:27.123207Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-11-01T16:05:27.123390Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-01T16:05:27.123796Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-01T16:05:27.123826Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-01T16:05:27.123894Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: '\0source1' SeqNo: 1 partNo : 0 messageNo: 1 size 1122 offset: -1
2025-11-01T16:05:27.123948Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-01T16:05:27.124003Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T16:05:27.124033Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T16:05:27.124051Z node 8 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-01T16:05:27.124178Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId '\0source1' seqNo 1 partNo 0
2025-11-01T16:05:27.160510Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '\0source1' seqNo 1 partNo 0 FormedBlobsCount 0 NewHead: Offset 1 PartNo 0 PackedSize 1197 count 1 nextOffset 2 batches 1
2025-11-01T16:05:27.160585Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-01T16:05:27.161060Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 1,1 HeadOffset 1 endOffset 1 curOffset 2 d0000000000_00000000000000000001_00000_0000000001_00000? size 1185 WTime 1762013127161
2025-11-01T16:05:27.161239Z node 8 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-01T16:05:27.161357Z node 8 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 1 partNo 0 count 1 size 1185
2025-11-01T16:05:27.169088Z node 8 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-01T16:05:27.173303Z node 8 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 1 count 1 size 1185 actorID [8:7567788754134191738:2362]
2025-11-01T16:05:27.173387Z node 8 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-01T16:05:27.173465Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1130 WriteNewSizeFromSupportivePartitions# 0
2025-11-01T16:05:27.173502Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-01T16:05:27.173547Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 1, partNo: 0, Offset: 1 is stored on disk
2025-11-01T16:05:27.173800Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T16:05:27.173820Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T16:05:27.173840Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-01T16:05:27.173877Z node 8 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-01T16:05:27.173930Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 1  requestId: <none> cookie: 1
2025-11-01T16:05:27.174427Z node 8 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 1 partno 0 count 1 parts 0 suffix '63' size 1185
2025-11-01T16:05:27.174784Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 1 consumer shared/user session shared/user_7_1_18026246482560886463_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 1 EndOffset 1 newEndOffset 2 commitOffset 0 clientCommitOffset 0 cookie 2 readingFinished 0 firstRead 0
2025-11-01T16:05:27.174821Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_7_1_18026246482560886463_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 1 endOffset 2
2025-11-01T16:05:27.174883Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-01T16:05:27.175413Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_7_1_18026246482560886463_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 1, endOffset# 2, WTime# 1762013126957, sizeLag# 1185
2025-11-01T16:05:27.175432Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_7_1_18026246482560886463_v1TEvPartitionReady. Aval parts: 1
2025-11-01T16:05:27.175480Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_7_1_18026246482560886463_v1 performing read request: guid# 4ed9ff1e-5ea9886e-b4d4a018-cbbfdb96, from# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), count# 1, size# 1422, partitionsAsked# 1, maxTimeLag# 0ms
2025-11-01T16:05:27.175546Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_7_1_18026246482560886463_v1 READ FROM TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1)maxCount 1 maxSize 1422 maxTimeLagMs 0 readTimestampMs 0 readOffset 1 EndOffset 2 ClientCommitOffset 0 committedOffset 0 Guid 4ed9ff1e-5ea9886e-b4d4a018-cbbfdb96
2025-11-01T16:05:27.176229Z :DEBUG: [] MessageGroupId [source1] SessionId [source1|46ed37ed-22b77d18-45f737a4-71531411_0] Write session got write response: sequence_numbers: 1 offsets: 1 already_written: false write_statistics { persist_duration_ms: 11 queued_in_partition_duration_ms: 36 }
2025-11-01T16:05:27.176293Z :DEBUG: [] MessageGroupId [source1] SessionId [source1|46ed37ed-22b77d18-45f737a4-71531411_0] Write session: acknoledged message 1
2025-11-01T16:05:27.176963Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-01T16:05:27.176999Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-01T16:05:27.177126Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:880: [72075186224037892][Partition][0][StateIdle] read cookie 5 Topic 'rt3.dc1--topic1' partition 0 user user offset 1 partno 0 count 1 size 1422 endOffset 2 max time lag 0ms effective offset 1
2025-11-01T16:05:27.177363Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:1105: [72075186224037892][Partition][0][StateIdle] read cookie 5 added 1 blobs, size 1185 count 1 last offset 1, current partition end offset: 2
2025-11-01T16:05:27.177384Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:1121: [72075186224037892][Partition][0][StateIdle] Reading cookie 5. Send blob request.
2025-11-01T16:05:27.177431Z node 8 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 1 partno 0 count 1 parts_count 0 source 1 size 1185 accessed 0 times before, last time 2025-11-01T16:05:27.000000Z
2025-11-01T16:05:27.177463Z node 8 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 5. All 1 blobs are from cache.
2025-11-01T16:05:27.177507Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:572: FormAnswer for 1 blobs
2025-11-01T16:05:27.177647Z node 8 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 1 partno 0 count 1 parts 0 suffix '63'
2025-11-01T16:05:27.177676Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 1 totakecount 1 count 1 size 1165 from pos 0 cbcount 1
2025-11-01T16:05:27.177779Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-11-01T16:05:27.183651Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_7_1_18026246482560886463_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 2 Result { Offset: 1 Data: "... 1122 bytes ..." SourceId: "\000source1" SeqNo: 1 WriteTimestampMS: 1762013127123 CreateTimestampMS: 1762013127100 UncompressedSize: 1047552 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 20 RealReadOffset: 1 WaitQuotaTimeMs: 0 EndOffset: 2 StartOffset: 0 } Cookie: 1 }
2025-11-01T16:05:27.183823Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_7_1_18026246482560886463_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 3 from offset 2
2025-11-01T16:05:27.183871Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_7_1_18026246482560886463_v1 after read state TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 2 ReadOffset 2 ReadGuid 4ed9ff1e-5ea9886e-b4d4a018-cbbfdb96 has messages 1
2025-11-01T16:05:27.184053Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_7_1_18026246482560886463_v1 read done: guid# 4ed9ff1e-5ea9886e-b4d4a018-cbbfdb96, partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), size# 1224
2025-11-01T16:05:27.184084Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_7_1_18026246482560886463_v1 response to read: guid# 4ed9ff1e-5ea9886e-b4d4a018-cbbfdb96
2025-11-01T16:05:27.184496Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_7_1_18026246482560886463_v1 Process answer. Aval parts: 0
2025-11-01T16:05:27.185360Z :DEBUG: [] [] [aa6bd8f2-140b5929-e6291a97-498f8dbd] [null] After sending read request: ReadSizeBudget = 2621440, ReadSizeServerDelta = 0
2025-11-01T16:05:27.189616Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_7_1_18026246482560886463_v1 grpc read done: success# 1, data# { read { } }
2025-11-01T16:05:27.189733Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_7_1_18026246482560886463_v1 got read request: guid# 8ef58c68-7321439-a3227e32-43747078
2025-11-01T16:05:27.202464Z :INFO: [] MessageGroupId [source1] SessionId [source1|46ed37ed-22b77d18-45f737a4-71531411_0] Write session will now close
2025-11-01T16:05:27.202521Z :DEBUG: [] MessageGroupId [source1] SessionId [source1|46ed37ed-22b77d18-45f737a4-71531411_0] Write session: aborting
2025-11-01T16:05:27.202925Z :INFO: [] MessageGroupId [source1] SessionId [source1|46ed37ed-22b77d18-45f737a4-71531411_0] Write session: gracefully shut down, all writes complete
2025-11-01T16:05:27.203148Z :DEBUG: [] MessageGroupId [source1] SessionId [source1|46ed37ed-22b77d18-45f737a4-71531411_0] Write session: destroy
2025-11-01T16:05:27.208564Z :DEBUG: [] MessageGroupId [source2] SessionId [] Write session: try to update token
2025-11-01T16:05:27.208909Z :INFO: [] MessageGroupId [source2] SessionId [] Write session: Do CDS request
2025-11-01T16:05:27.208942Z :INFO: [] MessageGroupId [source2] SessionId [] Start write session. Will connect to endpoint: localhost:2406
2025-11-01T16:05:27.224084Z :DEBUG: [] MessageGroupId [source2] SessionId [] Write session: send init request: init_request { topic: "topic1" message_group_id: "source2" }
2025-11-01T16:05:27.224565Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: source1|46ed37ed-22b77d18-45f737a4-71531411_0 grpc read done: success: 0 data: 
2025-11-01T16:05:27.224610Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 2 sessionId: source1|46ed37ed-22b77d18-45f737a4-71531411_0 grpc read failed
2025-11-01T16:05:27.224617Z node 7 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-11-01T16:05:27.224632Z node 7 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3
2025-11-01T16:05:27.224639Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 2 sessionId: source1|46ed37ed-22b77d18-45f737a4-71531411_0 grpc closed
2025-11-01T16:05:27.224659Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2 sessionId: source1|46ed37ed-22b77d18-45f737a4-71531411_0 is DEAD
2025-11-01T16:05:27.225385Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-11-01T16:05:27.226214Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [7:7567788755906449919:2485] destroyed
2025-11-01T16:05:27.226260Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-11-01T16:05:27.226300Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T16:05:27.226313Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T16:05:27.226333Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-01T16:05:27.227476Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3 sessionId:  grpc read done: success: 1 data: init_request { topic: "topic1" message_group_id: "source2" }
2025-11-01T16:05:27.227619Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3 topic: "topic1" message_group_id: "source2" from ipv6:[::1]:39382
2025-11-01T16:05:27.227634Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:39382 proto=v1  topic=topic1 durationSec=0
2025-11-01T16:05:27.227648Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-11-01T16:05:27.229632Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3 sessionId:  describe result for acl check
2025-11-01T16:05:27.229775Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-11-01T16:05:27.229786Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-11-01T16:05:27.229798Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-11-01T16:05:27.229815Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [7:7567788755906449927:2489] (SourceId=source2, PreferedPartition=(NULL)) StartKqpSession
2025-11-01T16:05:27.233171Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [7:7567788755906449927:2489] (SourceId=source2, PreferedPartition=(NULL)) Select from the table
2025-11-01T16:05:27.243500Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [7:7567788755906449927:2489] (SourceId=source2, PreferedPartition=(NULL)) RequestPQRB
2025-11-01T16:05:27.244589Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1655: [72075186224037893][rt3.dc1--topic1] pipe [7:7567788755906449946:2489] connected; active server actors: 1
2025-11-01T16:05:27.244736Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [7:7567788755906449927:2489] (SourceId=source2, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=source2
2025-11-01T16:05:27.244757Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [7:7567788755906449927:2489] (SourceId=source2, PreferedPartition=(NULL)) Update the table
2025-11-01T16:05:27.246009Z node 7 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1659: [72075186224037893][rt3.dc1--topic1] pipe [7:7567788755906449946:2489] disconnected.
2025-11-01T16:05:27.246037Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1670: [72075186224037893][rt3.dc1--topic1] pipe [7:7567788755906449946:2489] disconnected; active server actors: 1
2025-11-01T16:05:27.246053Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1695: [72075186224037893][rt3.dc1--topic1] pipe [7:7567788755906449946:2489] disconnected no session
2025-11-01T16:05:27.254706Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [7:7567788755906449927:2489] (SourceId=source2, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-11-01T16:05:27.254750Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [7:7567788755906449927:2489] (SourceId=source2, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-11-01T16:05:27.254768Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [7:7567788755906449927:2489] (SourceId=source2, PreferedPartition=(NULL)) Start idle
2025-11-01T16:05:27.254797Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-11-01T16:05:27.257233Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [7:7567788755906449960:2489], now have 1 active actors on pipe
2025-11-01T16:05:27.257539Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 8, Generation: 1
2025-11-01T16:05:27.257868Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-01T16:05:27.257899Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-01T16:05:27.257975Z node 8 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie source2|35dd612e-22a16a3e-445539b4-a7ef9cdc_0 generated for partition 0 topic 'rt3.dc1--topic1' owner source2
2025-11-01T16:05:27.258010Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T16:05:27.258030Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T16:05:27.258046Z node 8 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-01T16:05:27.258088Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-01T16:05:27.258131Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-01T16:05:27.258182Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-01T16:05:27.258953Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-01T16:05:27.258977Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-01T16:05:27.259044Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-01T16:05:27.259460Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3 partition: 0 MaxSeqNo: 0 sessionId: source2|35dd612e-22a16a3e-445539b4-a7ef9cdc_0
2025-11-01T16:05:27.260376Z :INFO: [] MessageGroupId [source2] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1762013127260 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-11-01T16:05:27.260495Z :INFO: [] MessageGroupId [source2] SessionId [] Write session established. Init response: session_id: "source2|35dd612e-22a16a3e-445539b4-a7ef9cdc_0" topic: "topic1" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-11-01T16:05:27.261740Z :DEBUG: [] MessageGroupId [source2] SessionId [source2|35dd612e-22a16a3e-445539b4-a7ef9cdc_0] Write 1 messages with Id from 1 to 1
2025-11-01T16:05:27.261825Z :INFO: [] MessageGroupId [source2] SessionId [source2|35dd612e-22a16a3e-445539b4-a7ef9cdc_0] Write session: close. Timeout = 10000 ms
2025-11-01T16:05:27.269324Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T16:05:27.269358Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T16:05:27.269374Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-01T16:05:27.278375Z :DEBUG: [] MessageGroupId [source2] SessionId [source2|35dd612e-22a16a3e-445539b4-a7ef9cdc_0] Write session: try to update token
2025-11-01T16:05:27.278426Z :DEBUG: [] MessageGroupId [source2] SessionId [source2|35dd612e-22a16a3e-445539b4-a7ef9cdc_0] Send 1 message(s) (0 left), first sequence number is 1
2025-11-01T16:05:27.279442Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3 sessionId: source2|35dd612e-22a16a3e-445539b4-a7ef9cdc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-01T16:05:27.279666Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-01T16:05:27.280048Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-01T16:05:27.280083Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-01T16:05:27.280140Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-11-01T16:05:27.280504Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-01T16:05:27.280826Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-01T16:05:27.280843Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-01T16:05:27.280888Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: '\0source2' SeqNo: 1 partNo : 0 messageNo: 1 size 1122 offset: -1
2025-11-01T16:05:27.280919Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-01T16:05:27.280952Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T16:05:27.280974Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T16:05:27.280985Z node 8 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-01T16:05:27.281062Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId '\0source2' seqNo 1 partNo 0
2025-11-01T16:05:27.281699Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '\0source2' seqNo 1 partNo 0 FormedBlobsCount 0 NewHead: Offset 2 PartNo 0 PackedSize 1197 count 1 nextOffset 3 batches 1
2025-11-01T16:05:27.281727Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-01T16:05:27.282152Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 2,1 HeadOffset 2 endOffset 2 curOffset 3 d0000000000_00000000000000000002_00000_0000000001_00000? size 1185 WTime 1762013127281
2025-11-01T16:05:27.282261Z node 8 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-01T16:05:27.282346Z node 8 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 2 partNo 0 count 1 size 1185
2025-11-01T16:05:27.286737Z node 8 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 2 count 1 size 1185 actorID [8:7567788754134191738:2362]
2025-11-01T16:05:27.286782Z node 8 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-01T16:05:27.286822Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1130 WriteNewSizeFromSupportivePartitions# 0
2025-11-01T16:05:27.286848Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-01T16:05:27.286875Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0source2', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 1, partNo: 0, Offset: 2 is stored on disk
2025-11-01T16:05:27.287043Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T16:05:27.287059Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T16:05:27.287073Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-01T16:05:27.287097Z node 8 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-01T16:05:27.287125Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 1  requestId: <none> cookie: 1
2025-11-01T16:05:27.287155Z node 8 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 2 partno 0 count 1 parts 0 suffix '63' size 1185
2025-11-01T16:05:27.287474Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-01T16:05:27.287505Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 1 consumer shared/user session shared/user_7_1_18026246482560886463_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 2 EndOffset 2 newEndOffset 3 commitOffset 0 clientCommitOffset 0 cookie 3 readingFinished 0 firstRead 0
2025-11-01T16:05:27.287530Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_7_1_18026246482560886463_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 2 endOffset 3
2025-11-01T16:05:27.287589Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_7_1_18026246482560886463_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 2, endOffset# 3, WTime# 1762013127123, sizeLag# 1185
2025-11-01T16:05:27.287608Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_7_1_18026246482560886463_v1TEvPartitionReady. Aval parts: 1
2025-11-01T16:05:27.287657Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_7_1_18026246482560886463_v1 performing read request: guid# 8ef58c68-7321439-a3227e32-43747078, from# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), count# 1, size# 1422, partitionsAsked# 1, maxTimeLag# 0ms
2025-11-01T16:05:27.287710Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_7_1_18026246482560886463_v1 READ FROM TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1)maxCount 1 maxSize 1422 maxTimeLagMs 0 readTimestampMs 0 readOffset 2 EndOffset 3 ClientCommitOffset 0 committedOffset 0 Guid 8ef58c68-7321439-a3227e32-43747078
2025-11-01T16:05:27.288277Z :DEBUG: [] MessageGroupId [source2] SessionId [source2|35dd612e-22a16a3e-445539b4-a7ef9cdc_0] Write session got write response: sequence_numbers: 1 offsets: 2 already_written: false write_statistics { persist_duration_ms: 5 }
2025-11-01T16:05:27.288318Z :DEBUG: [] MessageGroupId [source2] SessionId [source2|35dd612e-22a16a3e-445539b4-a7ef9cdc_0] Write session: acknoledged message 1
2025-11-01T16:05:27.288092Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-01T16:05:27.288126Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-01T16:05:27.288229Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:880: [72075186224037892][Partition][0][StateIdle] read cookie 6 Topic 'rt3.dc1--topic1' partition 0 user user offset 2 partno 0 count 1 size 1422 endOffset 3 max time lag 0ms effective offset 2
2025-11-01T16:05:27.288465Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:1105: [72075186224037892][Partition][0][StateIdle] read cookie 6 added 1 blobs, size 1185 count 1 last offset 2, current partition end offset: 3
2025-11-01T16:05:27.288484Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:1121: [72075186224037892][Partition][0][StateIdle] Reading cookie 6. Send blob request.
2025-11-01T16:05:27.288536Z node 8 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 2 partno 0 count 1 parts_count 0 source 1 size 1185 accessed 0 times before, last time 2025-11-01T16:05:27.000000Z
2025-11-01T16:05:27.288587Z node 8 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 6. All 1 blobs are from cache.
2025-11-01T16:05:27.288634Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:572: FormAnswer for 1 blobs
2025-11-01T16:05:27.288772Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 2 totakecount 1 count 1 size 1165 from pos 0 cbcount 1
2025-11-01T16:05:27.288881Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 2
2025-11-01T16:05:27.288880Z node 8 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 2 partno 0 count 1 parts 0 suffix '63'
2025-11-01T16:05:27.289385Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_7_1_18026246482560886463_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 3 Result { Offset: 2 Data: "... 1122 bytes ..." SourceId: "\000source2" SeqNo: 1 WriteTimestampMS: 1762013127280 CreateTimestampMS: 1762013127260 UncompressedSize: 1047552 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 20 RealReadOffset: 2 WaitQuotaTimeMs: 0 EndOffset: 3 StartOffset: 0 } Cookie: 2 }
2025-11-01T16:05:27.289525Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_7_1_18026246482560886463_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 4 from offset 3
2025-11-01T16:05:27.289579Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_7_1_18026246482560886463_v1 after read state TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 3 ReadOffset 3 ReadGuid 8ef58c68-7321439-a3227e32-43747078 has messages 1
2025-11-01T16:05:27.289715Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_7_1_18026246482560886463_v1 read done: guid# 8ef58c68-7321439-a3227e32-43747078, partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), size# 1224
2025-11-01T16:05:27.289765Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_7_1_18026246482560886463_v1 response to read: guid# 8ef58c68-7321439-a3227e32-43747078
2025-11-01T16:05:27.290031Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_7_1_18026246482560886463_v1 Process answer. Aval parts: 0
2025-11-01T16:05:27.290540Z :DEBUG: [] [] [aa6bd8f2-140b5929-e6291a97-498f8dbd] [null] After sending read request: ReadSizeBudget = 2621440, ReadSizeServerDelta = 0
2025-11-01T16:05:27.291000Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_7_1_18026246482560886463_v1 grpc read done: success# 1, data# { read { } }
2025-11-01T16:05:27.291126Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_7_1_18026246482560886463_v1 got read request: guid# 3292a1-9909eca7-1f0da1d0-50834cb4
2025-11-01T16:05:27.363317Z :INFO: [] MessageGroupId [source2] SessionId [source2|35dd612e-22a16a3e-445539b4-a7ef9cdc_0] Write session will now close
2025-11-01T16:05:27.363382Z :DEBUG: [] MessageGroupId [source2] SessionId [source2|35dd612e-22a16a3e-445539b4-a7ef9cdc_0] Write session: aborting
2025-11-01T16:05:27.363876Z :INFO: [] MessageGroupId [source2] SessionId [source2|35dd612e-22a16a3e-445539b4-a7ef9cdc_0] Write session: gracefully shut down, all writes complete
2025-11-01T16:05:27.364087Z :DEBUG: [] MessageGroupId [source2] SessionId [source2|35dd612e-22a16a3e-445539b4-a7ef9cdc_0] Write session: destroy
2025-11-01T16:05:27.365499Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3 sessionId: source2|35dd612e-22a16a3e-445539b4-a7ef9cdc_0 grpc read done: success: 0 data: 
2025-11-01T16:05:27.365527Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 3 sessionId: source2|35dd612e-22a16a3e-445539b4-a7ef9cdc_0 grpc read failed
2025-11-01T16:05:27.365558Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 3 sessionId: source2|35dd612e-22a16a3e-445539b4-a7ef9cdc_0 grpc closed
2025-11-01T16:05:27.365575Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3 sessionId: source2|35dd612e-22a16a3e-445539b4-a7ef9cdc_0 is DEAD
2025-11-01T16:05:27.366464Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-11-01T16:05:27.367189Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [7:7567788755906449960:2489] destroyed
2025-11-01T16:05:27.367237Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-11-01T16:05:27.367283Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T16:05:27.367299Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T16:05:27.367318Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-01T16:05:27.368790Z :DEBUG: [] MessageGroupId [source3] SessionId [] Write session: try to update token
2025-11-01T16:05:27.369095Z :INFO: [] MessageGroupId [source3] SessionId [] Write session: Do CDS request
2025-11-01T16:05:27.369125Z :INFO: [] MessageGroupId [source3] SessionId [] Start write session. Will connect to endpoint: localhost:2406
2025-11-01T16:05:27.373449Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T16:05:27.373484Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T16:05:27.373500Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-01T16:05:27.374914Z :DEBUG: [] MessageGroupId [source3] SessionId [] Write session: send init request: init_request { topic: "topic1" message_group_id: "source3" }
2025-11-01T16:05:27.376381Z node 7 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-11-01T16:05:27.376410Z node 7 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 4
2025-11-01T16:05:27.377241Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 4 sessionId:  grpc read done: success: 1 data: init_request { topic: "topic1" message_group_id: "source3" }
2025-11-01T16:05:27.377362Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 4 topic: "topic1" message_group_id: "source3" from ipv6:[::1]:39382
2025-11-01T16:05:27.377378Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=4 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:39382 proto=v1  topic=topic1 durationSec=0
2025-11-01T16:05:27.377388Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-11-01T16:05:27.379204Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 4 sessionId:  describe result for acl check
2025-11-01T16:05:27.379352Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-11-01T16:05:27.379367Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-11-01T16:05:27.379379Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-11-01T16:05:27.379398Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [7:7567788755906449969:2495] (SourceId=source3, PreferedPartition=(NULL)) StartKqpSession
2025-11-01T16:05:27.386047Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [7:7567788755906449969:2495] (SourceId=source3, PreferedPartition=(NULL)) Select from the table
2025-11-01T16:05:27.400009Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [7:7567788755906449969:2495] (SourceId=source3, PreferedPartition=(NULL)) RequestPQRB
2025-11-01T16:05:27.404661Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1655: [72075186224037893][rt3.dc1--topic1] pipe [7:7567788755906449994:2495] connected; active server actors: 1
2025-11-01T16:05:27.404721Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [7:7567788755906449969:2495] (SourceId=source3, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=source3
2025-11-01T16:05:27.404742Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [7:7567788755906449969:2495] (SourceId=source3, PreferedPartition=(NULL)) Update the table
2025-11-01T16:05:27.405906Z node 7 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1659: [72075186224037893][rt3.dc1--topic1] pipe [7:7567788755906449994:2495] disconnected.
2025-11-01T16:05:27.405938Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1670: [72075186224037893][rt3.dc1--topic1] pipe [7:7567788755906449994:2495] disconnected; active server actors: 1
2025-11-01T16:05:27.405951Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1695: [72075186224037893][rt3.dc1--topic1] pipe [7:7567788755906449994:2495] disconnected no session
2025-11-01T16:05:27.416561Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [7:7567788755906449969:2495] (SourceId=source3, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-11-01T16:05:27.416618Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [7:7567788755906449969:2495] (SourceId=source3, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-11-01T16:05:27.416636Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [7:7567788755906449969:2495] (SourceId=source3, PreferedPartition=(NULL)) Start idle
2025-11-01T16:05:27.416670Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 4 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-11-01T16:05:27.418690Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [7:7567788755906450008:2495], now have 1 active actors on pipe
2025-11-01T16:05:27.419220Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-01T16:05:27.419263Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-01T16:05:27.419331Z node 8 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie source3|75202294-bf1aa27f-1a126377-23f06abc_0 generated for partition 0 topic 'rt3.dc1--topic1' owner source3
2025-11-01T16:05:27.419363Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T16:05:27.419382Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T16:05:27.419396Z node 8 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-01T16:05:27.419435Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-01T16:05:27.419479Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-01T16:05:27.419523Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-01T16:05:27.418931Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 8, Generation: 1
2025-11-01T16:05:27.420625Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 4 partition: 0 MaxSeqNo: 0 sessionId: source3|75202294-bf1aa27f-1a126377-23f06abc_0
2025-11-01T16:05:27.420212Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-01T16:05:27.420241Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-01T16:05:27.420308Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-01T16:05:27.424030Z :INFO: [] MessageGroupId [source3] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1762013127423 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-11-01T16:05:27.424140Z :INFO: [] MessageGroupId [source3] SessionId [] Write session established. Init response: session_id: "source3|75202294-bf1aa27f-1a126377-23f06abc_0" topic: "topic1" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-11-01T16:05:27.425781Z :DEBUG: [] MessageGroupId [source3] SessionId [source3|75202294-bf1aa27f-1a126377-23f06abc_0] Write 1 messages with Id from 1 to 1
2025-11-01T16:05:27.425874Z :INFO: [] MessageGroupId [source3] SessionId [source3|75202294-bf1aa27f-1a126377-23f06abc_0] Write session: close. Timeout = 10000 ms
2025-11-01T16:05:27.447172Z :DEBUG: [] MessageGroupId [source3] SessionId [source3|75202294-bf1aa27f-1a126377-23f06abc_0] Write session: try to update token
2025-11-01T16:05:27.447237Z :DEBUG: [] MessageGroupId [source3] SessionId [source3|75202294-bf1aa27f-1a126377-23f06abc_0] Send 1 message(s) (0 left), first sequence number is 1
2025-11-01T16:05:27.448179Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 4 sessionId: source3|75202294-bf1aa27f-1a126377-23f06abc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-01T16:05:27.448446Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-01T16:05:27.453312Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-01T16:05:27.453364Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-01T16:05:27.453449Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-11-01T16:05:27.454114Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-01T16:05:27.454620Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-01T16:05:27.454649Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-01T16:05:27.454709Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: '\0source3' SeqNo: 1 partNo : 0 messageNo: 1 size 1122 offset: -1
2025-11-01T16:05:27.454753Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-01T16:05:27.454798Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T16:05:27.454825Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T16:05:27.454841Z node 8 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-01T16:05:27.454942Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId '\0source3' seqNo 1 partNo 0
2025-11-01T16:05:27.546973Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '\0source3' seqNo 1 partNo 0 FormedBlobsCount 0 NewHead: Offset 3 PartNo 0 PackedSize 1197 count 1 nextOffset 4 batches 1
2025-11-01T16:05:27.548197Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-01T16:05:27.548731Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 3,1 HeadOffset 3 endOffset 3 curOffset 4 d0000000000_00000000000000000003_00000_0000000001_00000? size 1185 WTime 1762013127548
2025-11-01T16:05:27.548974Z node 8 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-01T16:05:27.548994Z node 8 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-01T16:05:27.549114Z node 8 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 3 partNo 0 count 1 size 1185
2025-11-01T16:05:27.559415Z node 8 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 3 count 1 size 1185 actorID [8:7567788754134191738:2362]
2025-11-01T16:05:27.559490Z node 8 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-01T16:05:27.559543Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1130 WriteNewSizeFromSupportivePartitions# 0
2025-11-01T16:05:27.559577Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-01T16:05:27.559618Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0source3', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 1, partNo: 0, Offset: 3 is stored on disk
2025-11-01T16:05:27.559858Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T16:05:27.559875Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T16:05:27.559890Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-01T16:05:27.559921Z node 8 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-01T16:05:27.559958Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 1  requestId: <none> cookie: 1
2025-11-01T16:05:27.561607Z node 8 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 3 partno 0 count 1 parts 0 suffix '63' size 1185
2025-11-01T16:05:27.563353Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 1 consumer shared/user session shared/user_7_1_18026246482560886463_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 3 EndOffset 3 newEndOffset 4 commitOffset 0 clientCommitOffset 0 cookie 4 readingFinished 0 firstRead 0
2025-11-01T16:05:27.563396Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_7_1_18026246482560886463_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 3 endOffset 4
2025-11-01T16:05:27.563461Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-01T16:05:27.563987Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_7_1_18026246482560886463_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 3, endOffset# 4, WTime# 1762013127280, sizeLag# 1185
2025-11-01T16:05:27.564008Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_7_1_18026246482560886463_v1TEvPartitionReady. Aval parts: 1
2025-11-01T16:05:27.564056Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_7_1_18026246482560886463_v1 performing read request: guid# 3292a1-9909eca7-1f0da1d0-50834cb4, from# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), count# 1, size# 1422, partitionsAsked# 1, maxTimeLag# 0ms
2025-11-01T16:05:27.564115Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_7_1_18026246482560886463_v1 READ FROM TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1)maxCount 1 maxSize 1422 maxTimeLagMs 0 readTimestampMs 0 readOffset 3 EndOffset 4 ClientCommitOffset 0 committedOffset 0 Guid 3292a1-9909eca7-1f0da1d0-50834cb4
2025-11-01T16:05:27.565077Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-01T16:05:27.565117Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-01T16:05:27.565230Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:880: [72075186224037892][Partition][0][StateIdle] read cookie 7 Topic 'rt3.dc1--topic1' partition 0 user user offset 3 partno 0 count 1 size 1422 endOffset 4 max time lag 0ms effective offset 3
2025-11-01T16:05:27.565458Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:1105: [72075186224037892][Partition][0][StateIdle] read cookie 7 added 1 blobs, size 1185 count 1 last offset 3, current partition end offset: 4
2025-11-01T16:05:27.565487Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:1121: [72075186224037892][Partition][0][StateIdle] Reading cookie 7. Send blob request.
2025-11-01T16:05:27.565537Z node 8 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 3 partno 0 count 1 parts_count 0 source 1 size 1185 accessed 0 times before, last time 2025-11-01T16:05:27.000000Z
2025-11-01T16:05:27.565577Z node 8 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 7. All 1 blobs are from cache.
2025-11-01T16:05:27.565623Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:572: FormAnswer for 1 blobs
2025-11-01T16:05:27.565756Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 3 totakecount 1 count 1 size 1165 from pos 0 cbcount 1
2025-11-01T16:05:27.565856Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 3
2025-11-01T16:05:27.566075Z node 8 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 3 partno 0 count 1 parts 0 suffix '63'
2025-11-01T16:05:27.566536Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_7_1_18026246482560886463_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 4 Result { Offset: 3 Data: "... 1122 bytes ..." SourceId: "\000source3" SeqNo: 1 WriteTimestampMS: 1762013127454 CreateTimestampMS: 1762013127424 UncompressedSize: 1047552 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 20 RealReadOffset: 3 WaitQuotaTimeMs: 0 EndOffset: 4 StartOffset: 0 } Cookie: 3 }
2025-11-01T16:05:27.566664Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_7_1_18026246482560886463_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 5 from offset 4
2025-11-01T16:05:27.566706Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_7_1_18026246482560886463_v1 after read state TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 4 ReadOffset 4 ReadGuid 3292a1-9909eca7-1f0da1d0-50834cb4 has messages 1
2025-11-01T16:05:27.566811Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_7_1_18026246482560886463_v1 read done: guid# 3292a1-9909eca7-1f0da1d0-50834cb4, partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), size# 1224
2025-11-01T16:05:27.566842Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_7_1_18026246482560886463_v1 response to read: guid# 3292a1-9909eca7-1f0da1d0-50834cb4
2025-11-01T16:05:27.567106Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_7_1_18026246482560886463_v1 Process answer. Aval parts: 0
2025-11-01T16:05:27.567840Z :DEBUG: [] MessageGroupId [source3] SessionId [source3|75202294-bf1aa27f-1a126377-23f06abc_0] Write session got write response: sequence_numbers: 1 offsets: 3 already_written: false write_statistics { persist_duration_ms: 11 queued_in_partition_duration_ms: 92 }
2025-11-01T16:05:27.567899Z :DEBUG: [] MessageGroupId [source3] SessionId [source3|75202294-bf1aa27f-1a126377-23f06abc_0] Write session: acknoledged message 1
2025-11-01T16:05:27.568427Z :DEBUG: [] [] [aa6bd8f2-140b5929-e6291a97-498f8dbd] [null] After sending read request: ReadSizeBudget = 2621440, ReadSizeServerDelta = 0
2025-11-01T16:05:27.570826Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_7_1_18026246482560886463_v1 grpc read done: success# 1, data# { read { } }
2025-11-01T16:05:27.571005Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_7_1_18026246482560886463_v1 got read request: guid# 18aa7c52-30f19b05-c2a9f16d-ff155129
2025-11-01T16:05:27.590813Z :INFO: [] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:topic1:0:1:3:0
2025-11-01T16:05:27.590915Z :INFO: [] [] [aa6bd8f2-140b5929-e6291a97-498f8dbd] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1011 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 4200 BytesInflightTotal: 4200 MessagesInflight: 4 }
2025-11-01T16:05:27.630892Z :INFO: [] MessageGroupId [source3] SessionId [source3|75202294-bf1aa27f-1a126377-23f06abc_0] Write session will now close
2025-11-01T16:05:27.630949Z :DEBUG: [] MessageGroupId [source3] SessionId [source3|75202294-bf1aa27f-1a126377-23f06abc_0] Write session: aborting
2025-11-01T16:05:27.631455Z :INFO: [] MessageGroupId [source3] SessionId [source3|75202294-bf1aa27f-1a126377-23f06abc_0] Write session: gracefully shut down, all writes complete
2025-11-01T16:05:27.631802Z :DEBUG: [] MessageGroupId [source3] SessionId [source3|75202294-bf1aa27f-1a126377-23f06abc_0] Write session: destroy
2025-11-01T16:05:27.634465Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 4 sessionId: source3|75202294-bf1aa27f-1a126377-23f06abc_0 grpc read done: success: 0 data: 
2025-11-01T16:05:27.635620Z :DEBUG: [] MessageGroupId [source4] SessionId [] Write session: try to update token
2025-11-01T16:05:27.635920Z :INFO: [] MessageGroupId [source4] SessionId [] Write session: Do CDS request
2025-11-01T16:05:27.635948Z :INFO: [] MessageGroupId [source4] SessionId [] Start write session. Will connect to endpoint: localhost:2406
2025-11-01T16:05:27.636110Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [7:7567788755906450008:2495] destroyed
2025-11-01T16:05:27.636156Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-11-01T16:05:27.636187Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T16:05:27.636202Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T16:05:27.634497Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 4 sessionId: source3|75202294-bf1aa27f-1a126377-23f06abc_0 grpc read failed
2025-11-01T16:05:27.636220Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-01T16:05:27.634531Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 4 sessionId: source3|75202294-bf1aa27f-1a126377-23f06abc_0 grpc closed
2025-11-01T16:05:27.647539Z :DEBUG: [] MessageGroupId [source4] SessionId [] Write session: send init request: init_request { topic: "topic1" message_group_id: "source4" }
2025-11-01T16:05:27.649882Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T16:05:27.649914Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T16:05:27.649933Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-01T16:05:27.634550Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 4 sessionId: source3|75202294-bf1aa27f-1a126377-23f06abc_0 is DEAD
2025-11-01T16:05:27.635654Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-11-01T16:05:27.656275Z node 7 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-11-01T16:05:27.656312Z node 7 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 5
2025-11-01T16:05:27.656738Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 5 sessionId:  grpc read done: success: 1 data: init_request { topic: "topic1" message_group_id: "source4" }
2025-11-01T16:05:27.656849Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 5 topic: "topic1" message_group_id: "source4" from ipv6:[::1]:39382
2025-11-01T16:05:27.656866Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=5 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:39382 proto=v1  topic=topic1 durationSec=0
2025-11-01T16:05:27.656879Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-11-01T16:05:27.658442Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 5 sessionId:  describe result for acl check
2025-11-01T16:05:27.658560Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-11-01T16:05:27.658569Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-11-01T16:05:27.658579Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-11-01T16:05:27.658594Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [7:7567788755906450024:2505] (SourceId=source4, PreferedPartition=(NULL)) StartKqpSession
2025-11-01T16:05:27.661629Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [7:7567788755906450024:2505] (SourceId=source4, PreferedPartition=(NULL)) Select from the table
2025-11-01T16:05:27.671224Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [7:7567788755906450024:2505] (SourceId=source4, PreferedPartition=(NULL)) RequestPQRB
2025-11-01T16:05:27.676066Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1655: [72075186224037893][rt3.dc1--topic1] pipe [7:7567788755906450043:2505] connected; active server actors: 1
2025-11-01T16:05:27.676291Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [7:7567788755906450024:2505] (SourceId=source4, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=source4
2025-11-01T16:05:27.676313Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [7:7567788755906450024:2505] (SourceId=source4, PreferedPartition=(NULL)) Update the table
2025-11-01T16:05:27.677487Z node 7 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1659: [72075186224037893][rt3.dc1--topic1] pipe [7:7567788755906450043:2505] disconnected.
2025-11-01T16:05:27.677519Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1670: [72075186224037893][rt3.dc1--topic1] pipe [7:7567788755906450043:2505] disconnected; active server actors: 1
2025-11-01T16:05:27.677535Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1695: [72075186224037893][rt3.dc1--topic1] pipe [7:7567788755906450043:2505] disconnected no session
2025-11-01T16:05:27.706764Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [7:7567788755906450024:2505] (SourceId=source4, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-11-01T16:05:27.706818Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [7:7567788755906450024:2505] (SourceId=source4, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-11-01T16:05:27.706835Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [7:7567788755906450024:2505] (SourceId=source4, PreferedPartition=(NULL)) Start idle
2025-11-01T16:05:27.706865Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 5 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-11-01T16:05:27.714686Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [7:7567788755906450057:2505], now have 1 active actors on pipe
2025-11-01T16:05:27.714612Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 8, Generation: 1
2025-11-01T16:05:27.719610Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-01T16:05:27.719664Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-01T16:05:27.719756Z node 8 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie source4|fd8d34e6-541faf8c-90d805a3-23ab4da8_0 generated for partition 0 topic 'rt3.dc1--topic1' owner source4
2025-11-01T16:05:27.719799Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T16:05:27.719821Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T16:05:27.719838Z node 8 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-01T16:05:27.719888Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-01T16:05:27.719940Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-01T16:05:27.719991Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-01T16:05:27.721139Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-01T16:05:27.721164Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-01T16:05:27.721235Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-01T16:05:27.721565Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 5 partition: 0 MaxSeqNo: 0 sessionId: source4|fd8d34e6-541faf8c-90d805a3-23ab4da8_0
2025-11-01T16:05:27.723408Z :INFO: [] MessageGroupId [source4] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1762013127723 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-11-01T16:05:27.723532Z :INFO: [] MessageGroupId [source4] SessionId [] Write session established. Init response: session_id: "source4|fd8d34e6-541faf8c-90d805a3-23ab4da8_0" topic: "topic1" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-11-01T16:05:27.728339Z :DEBUG: [] MessageGroupId [source4] SessionId [source4|fd8d34e6-541faf8c-90d805a3-23ab4da8_0] Write 1 messages with Id from 1 to 1
2025-11-01T16:05:27.728446Z :INFO: [] MessageGroupId [source4] SessionId [source4|fd8d34e6-541faf8c-90d805a3-23ab4da8_0] Write session: close. Timeout = 10000 ms
2025-11-01T16:05:27.749040Z :DEBUG: [] MessageGroupId [source4] SessionId [source4|fd8d34e6-541faf8c-90d805a3-23ab4da8_0] Write session: try to update token
2025-11-01T16:05:27.749095Z :DEBUG: [] MessageGroupId [source4] SessionId [source4|fd8d34e6-541faf8c-90d805a3-23ab4da8_0] Send 1 message(s) (0 left), first sequence number is 1
2025-11-01T16:05:27.751382Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T16:05:27.751421Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T16:05:27.751439Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-01T16:05:27.756296Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-01T16:05:27.756341Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-01T16:05:27.756423Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-11-01T16:05:27.757079Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-01T16:05:27.757100Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-01T16:05:27.757161Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: '\0source4' SeqNo: 1 partNo : 0 messageNo: 1 size 1122 offset: -1
2025-11-01T16:05:27.757204Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-01T16:05:27.757251Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T16:05:27.757279Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T16:05:27.757293Z node 8 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-01T16:05:27.757411Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId '\0source4' seqNo 1 partNo 0
2025-11-01T16:05:27.758344Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '\0source4' seqNo 1 partNo 0 FormedBlobsCount 0 NewHead: Offset 4 PartNo 0 PackedSize 1197 count 1 nextOffset 5 batches 1
2025-11-01T16:05:27.758383Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-01T16:05:27.758953Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 4,1 HeadOffset 4 endOffset 4 curOffset 5 d0000000000_00000000000000000004_00000_0000000001_00000? size 1185 WTime 1762013127758
2025-11-01T16:05:27.759117Z node 8 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-01T16:05:27.759264Z node 8 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 4 partNo 0 count 1 size 1185
2025-11-01T16:05:27.763844Z node 8 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 4 count 1 size 1185 actorID [8:7567788754134191738:2362]
2025-11-01T16:05:27.763915Z node 8 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-01T16:05:27.763967Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1130 WriteNewSizeFromSupportivePartitions# 0
2025-11-01T16:05:27.764009Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-01T16:05:27.764049Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0source4', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 1, partNo: 0, Offset: 4 is stored on disk
2025-11-01T16:05:27.764273Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T16:05:27.764290Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T16:05:27.764307Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-01T16:05:27.764345Z node 8 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-01T16:05:27.764384Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 1  requestId: <none> cookie: 1
2025-11-01T16:05:27.755358Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 5 sessionId: source4|fd8d34e6-541faf8c-90d805a3-23ab4da8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-01T16:05:27.755788Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-01T16:05:27.756718Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-01T16:05:27.765024Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 1 consumer shared/user session shared/user_7_1_18026246482560886463_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 4 EndOffset 4 newEndOffset 5 commitOffset 0 clientCommitOffset 0 cookie 5 readingFinished 0 firstRead 0
2025-11-01T16:05:27.765049Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_7_1_18026246482560886463_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 4 endOffset 5
2025-11-01T16:05:27.765100Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-01T16:05:27.765554Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_7_1_18026246482560886463_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 4, endOffset# 5, WTime# 1762013127454, sizeLag# 1185
2025-11-01T16:05:27.765589Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_7_1_18026246482560886463_v1TEvPartitionReady. Aval parts: 1
2025-11-01T16:05:27.765638Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_7_1_18026246482560886463_v1 performing read request: guid# 18aa7c52-30f19b05-c2a9f16d-ff155129, from# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), count# 1, size# 1422, partitionsAsked# 1, maxTimeLag# 0ms
2025-11-01T16:05:27.765697Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_7_1_18026246482560886463_v1 READ FROM TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1)maxCount 1 maxSize 1422 maxTimeLagMs 0 readTimestampMs 0 readOffset 4 EndOffset 5 ClientCommitOffset 0 committedOffset 0 Guid 18aa7c52-30f19b05-c2a9f16d-ff155129
2025-11-01T16:05:27.764801Z node 8 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 4 partno 0 count 1 parts 0 suffix '63' size 1185
2025-11-01T16:05:27.766209Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-01T16:05:27.766239Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-01T16:05:27.766349Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:880: [72075186224037892][Partition][0][StateIdle] read cookie 8 Topic 'rt3.dc1--topic1' partition 0 user user offset 4 partno 0 count 1 size 1422 endOffset 5 max time lag 0ms effective offset 4
2025-11-01T16:05:27.766563Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:1105: [72075186224037892][Partition][0][StateIdle] read cookie 8 added 1 blobs, size 1185 count 1 last offset 4, current partition end offset: 5
2025-11-01T16:05:27.766582Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:1121: [72075186224037892][Partition][0][StateIdle] Reading cookie 8. Send blob request.
2025-11-01T16:05:27.766638Z node 8 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 4 partno 0 count 1 parts_count 0 source 1 size 1185 accessed 0 times before, last time 2025-11-01T16:05:27.000000Z
2025-11-01T16:05:27.766669Z node 8 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 8. All 1 blobs are from cache.
2025-11-01T16:05:27.766712Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:572: FormAnswer for 1 blobs
2025-11-01T16:05:27.766847Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 4 totakecount 1 count 1 size 1165 from pos 0 cbcount 1
2025-11-01T16:05:27.767285Z node 8 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 4 partno 0 count 1 parts 0 suffix '63'
2025-11-01T16:05:27.767390Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 4
2025-11-01T16:05:27.767792Z :DEBUG: [] MessageGroupId [source4] SessionId [source4|fd8d34e6-541faf8c-90d805a3-23ab4da8_0] Write session got write response: sequence_numbers: 1 offsets: 4 already_written: false write_statistics { persist_duration_ms: 5 queued_in_partition_duration_ms: 1 }
2025-11-01T16:05:27.767842Z :DEBUG: [] MessageGroupId [source4] SessionId [source4|fd8d34e6-541faf8c-90d805a3-23ab4da8_0] Write session: acknoledged message 1
2025-11-01T16:05:27.769764Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_7_1_18026246482560886463_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 5 Result { Offset: 4 Data: "... 1122 bytes ..." SourceId: "\000source4" SeqNo: 1 WriteTimestampMS: 1762013127757 CreateTimestampMS: 1762013127727 UncompressedSize: 1047552 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 20 RealReadOffset: 4 WaitQuotaTimeMs: 0 EndOffset: 5 StartOffset: 0 } Cookie: 4 }
2025-11-01T16:05:27.769939Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_7_1_18026246482560886463_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 6 from offset 5
2025-11-01T16:05:27.769983Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_7_1_18026246482560886463_v1 after read state TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 5 ReadOffset 5 ReadGuid 18aa7c52-30f19b05-c2a9f16d-ff155129 has messages 1
2025-11-01T16:05:27.770119Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_7_1_18026246482560886463_v1 read done: guid# 18aa7c52-30f19b05-c2a9f16d-ff155129, partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), size# 1224
2025-11-01T16:05:27.770148Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_7_1_18026246482560886463_v1 response to read: guid# 18aa7c52-30f19b05-c2a9f16d-ff155129
2025-11-01T16:05:27.770475Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_7_1_18026246482560886463_v1 Process answer. Aval parts: 0
2025-11-01T16:05:27.772110Z :DEBUG: [] [] [aa6bd8f2-140b5929-e6291a97-498f8dbd] [null] After sending read request: ReadSizeBudget = 2621440, ReadSizeServerDelta = 0
2025-11-01T16:05:27.772508Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_7_1_18026246482560886463_v1 grpc read done: success# 1, data# { read { } }
2025-11-01T16:05:27.772641Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_7_1_18026246482560886463_v1 got read request: guid# 91910446-a1c9642d-5cb779c8-7da33119
2025-11-01T16:05:27.830475Z :INFO: [] MessageGroupId [source4] SessionId [source4|fd8d34e6-541faf8c-90d805a3-23ab4da8_0] Write session will now close
2025-11-01T16:05:27.830556Z :DEBUG: [] MessageGroupId [source4] SessionId [source4|fd8d34e6-541faf8c-90d805a3-23ab4da8_0] Write session: aborting
2025-11-01T16:05:27.831035Z :INFO: [] MessageGroupId [source4] SessionId [source4|fd8d34e6-541faf8c-90d805a3-23ab4da8_0] Write session: gracefully shut down, all writes complete
2025-11-01T16:05:27.831611Z :DEBUG: [] MessageGroupId [source4] SessionId [source4|fd8d34e6-541faf8c-90d805a3-23ab4da8_0] Write session: destroy
2025-11-01T16:05:27.832300Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 5 sessionId: source4|fd8d34e6-541faf8c-90d805a3-23ab4da8_0 grpc read done: success: 0 data: 
2025-11-01T16:05:27.834403Z :DEBUG: [] MessageGroupId [source5] SessionId [] Write session: try to update token
2025-11-01T16:05:27.832328Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 5 sessionId: source4|fd8d34e6-541faf8c-90d805a3-23ab4da8_0 grpc read failed
2025-11-01T16:05:27.832361Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 5 sessionId: source4|fd8d34e6-541faf8c-90d805a3-23ab4da8_0 grpc closed
2025-11-01T16:05:27.834445Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [7:7567788755906450057:2505] destroyed
2025-11-01T16:05:27.834505Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-11-01T16:05:27.832377Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 5 sessionId: source4|fd8d34e6-541faf8c-90d805a3-23ab4da8_0 is DEAD
2025-11-01T16:05:27.833190Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-11-01T16:05:27.834547Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T16:05:27.834564Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T16:05:27.834590Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-01T16:05:27.851359Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T16:05:27.851395Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T16:05:27.851411Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-01T16:05:27.855533Z :INFO: [] MessageGroupId [source5] SessionId [] Write session: Do CDS request
2025-11-01T16:05:27.855576Z :INFO: [] MessageGroupId [source5] SessionId [] Start write session. Will connect to endpoint: localhost:2406
2025-11-01T16:05:27.872706Z :DEBUG: [] MessageGroupId [source5] SessionId [] Write session: send init request: init_request { topic: "topic1" message_group_id: "source5" }
2025-11-01T16:05:27.872810Z node 7 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-11-01T16:05:27.872845Z node 7 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 6
2025-11-01T16:05:27.874818Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 6 sessionId:  grpc read done: success: 1 data: init_request { topic: "topic1" message_group_id: "source5" }
2025-11-01T16:05:27.874938Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 6 topic: "topic1" message_group_id: "source5" from ipv6:[::1]:39382
2025-11-01T16:05:27.874954Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=6 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:39382 proto=v1  topic=topic1 durationSec=0
2025-11-01T16:05:27.874965Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-11-01T16:05:27.879681Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 6 sessionId:  describe result for acl check
2025-11-01T16:05:27.879815Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-11-01T16:05:27.879825Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-11-01T16:05:27.879834Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-11-01T16:05:27.879851Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [7:7567788755906450088:2513] (SourceId=source5, PreferedPartition=(NULL)) StartKqpSession
2025-11-01T16:05:27.883751Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [7:7567788755906450088:2513] (SourceId=source5, PreferedPartition=(NULL)) Select from the table
2025-11-01T16:05:27.890851Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [7:7567788755906450088:2513] (SourceId=source5, PreferedPartition=(NULL)) RequestPQRB
2025-11-01T16:05:27.891793Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1655: [72075186224037893][rt3.dc1--topic1] pipe [7:7567788755906450104:2513] connected; active server actors: 1
2025-11-01T16:05:27.891835Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [7:7567788755906450088:2513] (SourceId=source5, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=source5
2025-11-01T16:05:27.891853Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [7:7567788755906450088:2513] (SourceId=source5, PreferedPartition=(NULL)) Update the table
2025-11-01T16:05:27.892183Z node 7 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1659: [72075186224037893][rt3.dc1--topic1] pipe [7:7567788755906450104:2513] disconnected.
2025-11-01T16:05:27.892204Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1670: [72075186224037893][rt3.dc1--topic1] pipe [7:7567788755906450104:2513] disconnected; active server actors: 1
2025-11-01T16:05:27.892220Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1695: [72075186224037893][rt3.dc1--topic1] pipe [7:7567788755906450104:2513] disconnected no session
2025-11-01T16:05:27.909219Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [7:7567788755906450088:2513] (SourceId=source5, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-11-01T16:05:27.909270Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [7:7567788755906450088:2513] (SourceId=source5, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-11-01T16:05:27.909289Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [7:7567788755906450088:2513] (SourceId=source5, PreferedPartition=(NULL)) Start idle
2025-11-01T16:05:27.909321Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 6 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-11-01T16:05:27.913989Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 8, Generation: 1
2025-11-01T16:05:27.914468Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [7:7567788755906450120:2513], now have 1 active actors on pipe
2025-11-01T16:05:27.915098Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-01T16:05:27.915139Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-01T16:05:27.915237Z node 8 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie source5|30851aba-73fb270f-a296afcc-a62e2fa4_0 generated for partition 0 topic 'rt3.dc1--topic1' owner source5
2025-11-01T16:05:27.915289Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T16:05:27.915318Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T16:05:27.915335Z node 8 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-01T16:05:27.915378Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-01T16:05:27.915433Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-01T16:05:27.915486Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-01T16:05:27.916079Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-01T16:05:27.916098Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-01T16:05:27.916168Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-01T16:05:27.917976Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 6 partition: 0 MaxSeqNo: 0 sessionId: source5|30851aba-73fb270f-a296afcc-a62e2fa4_0
2025-11-01T16:05:27.919221Z :INFO: [] MessageGroupId [source5] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1762013127919 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-11-01T16:05:27.919364Z :INFO: [] MessageGroupId [source5] SessionId [] Write session established. Init response: session_id: "source5|30851aba-73fb270f-a296afcc-a62e2fa4_0" topic: "topic1" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-11-01T16:05:27.920564Z :DEBUG: [] MessageGroupId [source5] SessionId [source5|30851aba-73fb270f-a296afcc-a62e2fa4_0] Write 1 messages with Id from 1 to 1
2025-11-01T16:05:27.920674Z :INFO: [] MessageGroupId [source5] SessionId [source5|30851aba-73fb270f-a296afcc-a62e2fa4_0] Write session: close. Timeout = 10000 ms
2025-11-01T16:05:27.939586Z :DEBUG: [] MessageGroupId [source5] SessionId [source5|30851aba-73fb270f-a296afcc-a62e2fa4_0] Write session: try to update token
2025-11-01T16:05:27.939639Z :DEBUG: [] MessageGroupId [source5] SessionId [source5|30851aba-73fb270f-a296afcc-a62e2fa4_0] Send 1 message(s) (0 left), first sequence number is 1
2025-11-01T16:05:27.940403Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 6 sessionId: source5|30851aba-73fb270f-a296afcc-a62e2fa4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-01T16:05:27.940648Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-01T16:05:27.941206Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-01T16:05:27.941257Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-01T16:05:27.941344Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-11-01T16:05:27.941551Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-01T16:05:27.941916Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-01T16:05:27.941947Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-01T16:05:27.942010Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: '\0source5' SeqNo: 1 partNo : 0 messageNo: 1 size 1122 offset: -1
2025-11-01T16:05:27.942061Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-01T16:05:27.942108Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T16:05:27.942136Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T16:05:27.942153Z node 8 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-01T16:05:27.942262Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId '\0source5' seqNo 1 partNo 0
2025-11-01T16:05:28.007194Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '\0source5' seqNo 1 partNo 0 FormedBlobsCount 0 NewHead: Offset 5 PartNo 0 PackedSize 1197 count 1 nextOffset 6 batches 1
2025-11-01T16:05:28.008559Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-01T16:05:28.009287Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 5,1 HeadOffset 5 endOffset 5 curOffset 6 d0000000000_00000000000000000005_00000_0000000001_00000? size 1185 WTime 1762013128008
2025-11-01T16:05:28.009518Z node 8 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-01T16:05:28.009539Z node 8 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-01T16:05:28.009671Z node 8 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 5 partNo 0 count 1 size 1185
2025-11-01T16:05:28.031635Z node 8 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 5 count 1 size 1185 actorID [8:7567788754134191738:2362]
2025-11-01T16:05:28.031716Z node 8 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-01T16:05:28.031779Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1130 WriteNewSizeFromSupportivePartitions# 0
2025-11-01T16:05:28.031822Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-01T16:05:28.031868Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0source5', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 1, partNo: 0, Offset: 5 is stored on disk
2025-11-01T16:05:28.032132Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T16:05:28.032149Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T16:05:28.032167Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-01T16:05:28.032203Z node 8 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-01T16:05:28.032248Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 1  requestId: <none> cookie: 1
2025-11-01T16:05:28.033026Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 1 consumer shared/user session shared/user_7_1_18026246482560886463_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 5 EndOffset 5 newEndOffset 6 commitOffset 0 clientCommitOffset 0 cookie 6 readingFinished 0 firstRead 0
2025-11-01T16:05:28.033062Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_7_1_18026246482560886463_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 5 endOffset 6
2025-11-01T16:05:28.033120Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-01T16:05:28.033568Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_7_1_18026246482560886463_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 5, endOffset# 6, WTime# 1762013127757, sizeLag# 1185
2025-11-01T16:05:28.033588Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_7_1_18026246482560886463_v1TEvPartitionReady. Aval parts: 1
2025-11-01T16:05:28.033640Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_7_1_18026246482560886463_v1 performing read request: guid# 91910446-a1c9642d-5cb779c8-7da33119, from# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), count# 1, size# 1422, partitionsAsked# 1, maxTimeLag# 0ms
2025-11-01T16:05:28.033698Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_7_1_18026246482560886463_v1 READ FROM TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1)maxCount 1 maxSize 1422 maxTimeLagMs 0 readTimestampMs 0 readOffset 5 EndOffset 6 ClientCommitOffset 0 committedOffset 0 Guid 91910446-a1c9642d-5cb779c8-7da33119
2025-11-01T16:05:28.032708Z node 8 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 5 partno 0 count 1 parts 0 suffix '63' size 1185
2025-11-01T16:05:28.034344Z :DEBUG: [] MessageGroupId [source5] SessionId [source5|30851aba-73fb270f-a296afcc-a62e2fa4_0] Write session got write response: sequence_numbers: 1 offsets: 5 already_written: false write_statistics { persist_duration_ms: 22 queued_in_partition_duration_ms: 64 }
2025-11-01T16:05:28.034405Z :DEBUG: [] MessageGroupId [source5] SessionId [source5|30851aba-73fb270f-a296afcc-a62e2fa4_0] Write session: acknoledged message 1
2025-11-01T16:05:28.034517Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-01T16:05:28.034555Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-01T16:05:28.034683Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:880: [72075186224037892][Partition][0][StateIdle] read cookie 9 Topic 'rt3.dc1--topic1' partition 0 user user offset 5 partno 0 count 1 size 1422 endOffset 6 max time lag 0ms effective offset 5
2025-11-01T16:05:28.034914Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:1105: [72075186224037892][Partition][0][StateIdle] read cookie 9 added 1 blobs, size 1185 count 1 last offset 5, current partition end offset: 6
2025-11-01T16:05:28.034941Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:1121: [72075186224037892][Partition][0][StateIdle] Reading cookie 9. Send blob request.
2025-11-01T16:05:28.034992Z node 8 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 5 partno 0 count 1 parts_count 0 source 1 size 1185 accessed 0 times before, last time 2025-11-01T16:05:28.000000Z
2025-11-01T16:05:28.035027Z node 8 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 9. All 1 blobs are from cache.
2025-11-01T16:05:28.035070Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:572: FormAnswer for 1 blobs
2025-11-01T16:05:28.035130Z node 8 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 5 partno 0 count 1 parts 0 suffix '63'
2025-11-01T16:05:28.035232Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 5 totakecount 1 count 1 size 1165 from pos 0 cbcount 1
2025-11-01T16:05:28.035359Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 5
2025-11-01T16:05:28.036078Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_7_1_18026246482560886463_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 6 Result { Offset: 5 Data: "... 1122 bytes ..." SourceId: "\000source5" SeqNo: 1 WriteTimestampMS: 1762013127941 CreateTimestampMS: 1762013127919 UncompressedSize: 1047552 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 20 RealReadOffset: 5 WaitQuotaTimeMs: 0 EndOffset: 6 StartOffset: 0 } Cookie: 5 }
2025-11-01T16:05:28.036227Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_7_1_18026246482560886463_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 7 from offset 6
2025-11-01T16:05:28.036272Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_7_1_18026246482560886463_v1 after read state TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 6 ReadOffset 6 ReadGuid 91910446-a1c9642d-5cb779c8-7da33119 has messages 1
2025-11-01T16:05:28.036415Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_7_1_18026246482560886463_v1 read done: guid# 91910446-a1c9642d-5cb779c8-7da33119, partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), size# 1224
2025-11-01T16:05:28.036447Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_7_1_18026246482560886463_v1 response to read: guid# 91910446-a1c9642d-5cb779c8-7da33119
2025-11-01T16:05:28.036682Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_7_1_18026246482560886463_v1 Process answer. Aval parts: 0
2025-11-01T16:05:28.037541Z :DEBUG: [] [] [aa6bd8f2-140b5929-e6291a97-498f8dbd] [null] After sending read request: ReadSizeBudget = 2621440, ReadSizeServerDelta = 0
2025-11-01T16:05:28.038417Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_7_1_18026246482560886463_v1 grpc read done: success# 1, data# { read { } }
2025-11-01T16:05:28.038543Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_7_1_18026246482560886463_v1 got read request: guid# 7d0d4db7-30b007a3-12023b8c-daccddda
2025-11-01T16:05:28.109398Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T16:05:28.109430Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T16:05:28.109448Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-01T16:05:28.123437Z :INFO: [] MessageGroupId [source5] SessionId [source5|30851aba-73fb270f-a296afcc-a62e2fa4_0] Write session will now close
2025-11-01T16:05:28.123509Z :DEBUG: [] MessageGroupId [source5] SessionId [source5|30851aba-73fb270f-a296afcc-a62e2fa4_0] Write session: aborting
2025-11-01T16:05:28.124410Z :INFO: [] MessageGroupId [source5] SessionId [source5|30851aba-73fb270f-a296afcc-a62e2fa4_0] Write session: gracefully shut down, all writes complete
2025-11-01T16:05:28.125478Z :DEBUG: [] MessageGroupId [source5] SessionId [source5|30851aba-73fb270f-a296afcc-a62e2fa4_0] Write session is aborting and will not restart
2025-11-01T16:05:28.124850Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 6 sessionId: source5|30851aba-73fb270f-a296afcc-a62e2fa4_0 grpc read done: success: 0 data: 
2025-11-01T16:05:28.124880Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 6 sessionId: source5|30851aba-73fb270f-a296afcc-a62e2fa4_0 grpc read failed
2025-11-01T16:05:28.124911Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 6 sessionId: source5|30851aba-73fb270f-a296afcc-a62e2fa4_0 grpc closed
2025-11-01T16:05:28.124929Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 6 sessionId: source5|30851aba-73fb270f-a296afcc-a62e2fa4_0 is DEAD
2025-11-01T16:05:28.125865Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-11-01T16:05:28.125984Z :DEBUG: [] MessageGroupId [source5] SessionId [source5|30851aba-73fb270f-a296afcc-a62e2fa4_0] Write session: destroy
2025-11-01T16:05:28.126321Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [7:7567788755906450120:2513] destroyed
2025-11-01T16:05:28.126370Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-11-01T16:05:28.126404Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T16:05:28.126420Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T16:05:28.126440Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-01T16:05:28.127014Z :DEBUG: [] MessageGroupId [source6] SessionId [] Write session: try to update token
2025-11-01T16:05:28.127347Z :INFO: [] MessageGroupId [source6] SessionId [] Write session: Do CDS request
2025-11-01T16:05:28.127375Z :INFO: [] MessageGroupId [source6] SessionId [] Start write session. Will connect to endpoint: localhost:2406
2025-11-01T16:05:28.133725Z :DEBUG: [] MessageGroupId [source6] SessionId [] Write session: send init request: init_request { topic: "topic1" message_group_id: "source6" }
2025-11-01T16:05:28.133756Z node 7 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-11-01T16:05:28.133791Z node 7 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 7
2025-11-01T16:05:28.134344Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 7 sessionId:  grpc read done: success: 1 data: init_request { topic: "topic1" message_group_id: "source6" }
2025-11-01T16:05:28.134476Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 7 topic: "topic1" message_group_id: "source6" from ipv6:[::1]:39382
2025-11-01T16:05:28.134498Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=7 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:39382 proto=v1  topic=topic1 durationSec=0
2025-11-01T16:05:28.134514Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-11-01T16:05:28.136301Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 7 sessionId:  describe result for acl check
2025-11-01T16:05:28.136453Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-11-01T16:05:28.136471Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-11-01T16:05:28.136483Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-11-01T16:05:28.136502Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [7:7567788760201417433:2519] (SourceId=source6, PreferedPartition=(NULL)) StartKqpSession
2025-11-01T16:05:28.139808Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [7:7567788760201417433:2519] (SourceId=source6, PreferedPartition=(NULL)) Select from the table
2025-11-01T16:05:28.148654Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [7:7567788760201417433:2519] (SourceId=source6, PreferedPartition=(NULL)) RequestPQRB
2025-11-01T16:05:28.149701Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1655: [72075186224037893][rt3.dc1--topic1] pipe [7:7567788760201417452:2519] connected; active server actors: 1
2025-11-01T16:05:28.149798Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [7:7567788760201417433:2519] (SourceId=source6, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=source6
2025-11-01T16:05:28.149814Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [7:7567788760201417433:2519] (SourceId=source6, PreferedPartition=(NULL)) Update the table
2025-11-01T16:05:28.150672Z node 7 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1659: [72075186224037893][rt3.dc1--topic1] pipe [7:7567788760201417452:2519] disconnected.
2025-11-01T16:05:28.150690Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1670: [72075186224037893][rt3.dc1--topic1] pipe [7:7567788760201417452:2519] disconnected; active server actors: 1
2025-11-01T16:05:28.150702Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1695: [72075186224037893][rt3.dc1--topic1] pipe [7:7567788760201417452:2519] disconnected no session
2025-11-01T16:05:28.159067Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [7:7567788760201417433:2519] (SourceId=source6, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-11-01T16:05:28.159110Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [7:7567788760201417433:2519] (SourceId=source6, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-11-01T16:05:28.159133Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [7:7567788760201417433:2519] (SourceId=source6, PreferedPartition=(NULL)) Start idle
2025-11-01T16:05:28.159166Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 7 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-11-01T16:05:28.161463Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [7:7567788760201417466:2519], now have 1 active actors on pipe
2025-11-01T16:05:28.161647Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 8, Generation: 1
2025-11-01T16:05:28.161906Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-01T16:05:28.161953Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-01T16:05:28.162044Z node 8 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie source6|58a63c2c-164ce2d3-c2f43701-f6ed6755_0 generated for partition 0 topic 'rt3.dc1--topic1' owner source6
2025-11-01T16:05:28.162092Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T16:05:28.162120Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T16:05:28.162139Z node 8 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-01T16:05:28.162190Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-01T16:05:28.162246Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-01T16:05:28.162310Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-01T16:05:28.163928Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-01T16:05:28.163980Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-01T16:05:28.164070Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-01T16:05:28.164490Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 7 partition: 0 MaxSeqNo: 0 sessionId: source6|58a63c2c-164ce2d3-c2f43701-f6ed6755_0
2025-11-01T16:05:28.165485Z :INFO: [] MessageGroupId [source6] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1762013128165 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-11-01T16:05:28.165613Z :INFO: [] MessageGroupId [source6] SessionId [] Write session established. Init response: session_id: "source6|58a63c2c-164ce2d3-c2f43701-f6ed6755_0" topic: "topic1" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-11-01T16:05:28.166929Z :DEBUG: [] MessageGroupId [source6] SessionId [source6|58a63c2c-164ce2d3-c2f43701-f6ed6755_0] Write 1 messages with Id from 1 to 1
2025-11-01T16:05:28.167033Z :INFO: [] MessageGroupId [source6] SessionId [source6|58a63c2c-164ce2d3-c2f43701-f6ed6755_0] Write session: close. Timeout = 10000 ms
2025-11-01T16:05:28.184636Z :DEBUG: [] MessageGroupId [source6] SessionId [source6|58a63c2c-164ce2d3-c2f43701-f6ed6755_0] Write session: try to update token
2025-11-01T16:05:28.184708Z :DEBUG: [] MessageGroupId [source6] SessionId [source6|58a63c2c-164ce2d3-c2f43701-f6ed6755_0] Send 1 message(s) (0 left), first sequence number is 1
2025-11-01T16:05:28.185609Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 7 sessionId: source6|58a63c2c-164ce2d3-c2f43701-f6ed6755_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-01T16:05:28.185932Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-01T16:05:28.187609Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-01T16:05:28.187676Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-01T16:05:28.187766Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-11-01T16:05:28.188087Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-01T16:05:28.188724Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-01T16:05:28.188756Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-01T16:05:28.188820Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: '\0source6' SeqNo: 1 partNo : 0 messageNo: 1 size 1122 offset: -1
2025-11-01T16:05:28.188864Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-01T16:05:28.188917Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T16:05:28.188949Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T16:05:28.188966Z node 8 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-01T16:05:28.189074Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId '\0source6' seqNo 1 partNo 0
2025-11-01T16:05:28.189791Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '\0source6' seqNo 1 partNo 0 FormedBlobsCount 0 NewHead: Offset 6 PartNo 0 PackedSize 1197 count 1 nextOffset 7 batches 1
2025-11-01T16:05:28.189842Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-01T16:05:28.190330Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 6,1 HeadOffset 6 endOffset 6 curOffset 7 d0000000000_00000000000000000006_00000_0000000001_00000? size 1185 WTime 1762013128190
2025-11-01T16:05:28.190485Z node 8 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-01T16:05:28.190627Z node 8 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 6 partNo 0 count 1 size 1185
2025-11-01T16:05:28.200650Z node 8 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 6 count 1 size 1185 actorID [8:7567788754134191738:2362]
2025-11-01T16:05:28.200743Z node 8 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-01T16:05:28.200804Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1130 WriteNewSizeFromSupportivePartitions# 0
2025-11-01T16:05:28.200841Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-01T16:05:28.200887Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0source6', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 1, partNo: 0, Offset: 6 is stored on disk
2025-11-01T16:05:28.200938Z node 8 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 6 partno 0 count 1 parts 0 suffix '63' size 1185
2025-11-01T16:05:28.201142Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T16:05:28.201158Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T16:05:28.201176Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-01T16:05:28.201211Z node 8 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-01T16:05:28.201253Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 1  requestId: <none> cookie: 1
2025-11-01T16:05:28.201556Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 1 consumer shared/user session shared/user_7_1_18026246482560886463_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 6 EndOffset 6 newEndOffset 7 commitOffset 0 clientCommitOffset 0 cookie 7 readingFinished 0 firstRead 0
2025-11-01T16:05:28.201580Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-01T16:05:28.201598Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_7_1_18026246482560886463_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 6 endOffset 7
2025-11-01T16:05:28.201667Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_7_1_18026246482560886463_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 6, endOffset# 7, WTime# 1762013127941, sizeLag# 1185
2025-11-01T16:05:28.201690Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_7_1_18026246482560886463_v1TEvPartitionReady. Aval parts: 1
2025-11-01T16:05:28.201742Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_7_1_18026246482560886463_v1 performing read request: guid# 7d0d4db7-30b007a3-12023b8c-daccddda, from# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), count# 1, size# 1422, partitionsAsked# 1, maxTimeLag# 0ms
2025-11-01T16:05:28.201800Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_7_1_18026246482560886463_v1 READ FROM TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1)maxCount 1 maxSize 1422 maxTimeLagMs 0 readTimestampMs 0 readOffset 6 EndOffset 7 ClientCommitOffset 0 committedOffset 0 Guid 7d0d4db7-30b007a3-12023b8c-daccddda
2025-11-01T16:05:28.202588Z :DEBUG: [] MessageGroupId [source6] SessionId [source6|58a63c2c-164ce2d3-c2f43701-f6ed6755_0] Write session got write response: sequence_numbers: 1 offsets: 6 already_written: false write_statistics { persist_duration_ms: 11 }
2025-11-01T16:05:28.202644Z :DEBUG: [] MessageGroupId [source6] SessionId [source6|58a63c2c-164ce2d3-c2f43701-f6ed6755_0] Write session: acknoledged message 1
2025-11-01T16:05:28.202456Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-01T16:05:28.202496Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-01T16:05:28.202607Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:880: [72075186224037892][Partition][0][StateIdle] read cookie 10 Topic 'rt3.dc1--topic1' partition 0 user user offset 6 partno 0 count 1 size 1422 endOffset 7 max time lag 0ms effective offset 6
2025-11-01T16:05:28.202835Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:1105: [72075186224037892][Partition][0][StateIdle] read cookie 10 added 1 blobs, size 1185 count 1 last offset 6, current partition end offset: 7
2025-11-01T16:05:28.202861Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:1121: [72075186224037892][Partition][0][StateIdle] Reading cookie 10. Send blob request.
2025-11-01T16:05:28.202906Z node 8 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 6 partno 0 count 1 parts_count 0 source 1 size 1185 accessed 0 times before, last time 2025-11-01T16:05:28.000000Z
2025-11-01T16:05:28.202947Z node 8 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 10. All 1 blobs are from cache.
2025-11-01T16:05:28.202992Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:572: FormAnswer for 1 blobs
2025-11-01T16:05:28.203032Z node 8 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 6 partno 0 count 1 parts 0 suffix '63'
2025-11-01T16:05:28.203123Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 6 totakecount 1 count 1 size 1165 from pos 0 cbcount 1
2025-11-01T16:05:28.203214Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 6
2025-11-01T16:05:28.203744Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_7_1_18026246482560886463_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 7 Result { Offset: 6 Data: "... 1122 bytes ..." SourceId: "\000source6" SeqNo: 1 WriteTimestampMS: 1762013128188 CreateTimestampMS: 1762013128165 UncompressedSize: 1047552 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 20 RealReadOffset: 6 WaitQuotaTimeMs: 0 EndOffset: 7 StartOffset: 0 } Cookie: 6 }
2025-11-01T16:05:28.203912Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_7_1_18026246482560886463_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 8 from offset 7
2025-11-01T16:05:28.203968Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_7_1_18026246482560886463_v1 after read state TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 7 ReadOffset 7 ReadGuid 7d0d4db7-30b007a3-12023b8c-daccddda has messages 1
2025-11-01T16:05:28.204110Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_7_1_18026246482560886463_v1 read done: guid# 7d0d4db7-30b007a3-12023b8c-daccddda, partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), size# 1224
2025-11-01T16:05:28.204159Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_7_1_18026246482560886463_v1 response to read: guid# 7d0d4db7-30b007a3-12023b8c-daccddda
2025-11-01T16:05:28.204414Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_7_1_18026246482560886463_v1 Process answer. Aval parts: 0
2025-11-01T16:05:28.204988Z :DEBUG: [] [] [aa6bd8f2-140b5929-e6291a97-498f8dbd] [null] After sending read request: ReadSizeBudget = 2621440, ReadSizeServerDelta = 0
2025-11-01T16:05:28.205382Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_7_1_18026246482560886463_v1 grpc read done: success# 1, data# { read { } }
2025-11-01T16:05:28.205526Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_7_1_18026246482560886463_v1 got read request: guid# 615dc524-ce137525-cd18f6ad-1c400855
2025-11-01T16:05:28.209859Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T16:05:28.209896Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T16:05:28.209913Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-01T16:05:28.267312Z :INFO: [] MessageGroupId [source6] SessionId [source6|58a63c2c-164ce2d3-c2f43701-f6ed6755_0] Write session will now close
2025-11-01T16:05:28.267376Z :DEBUG: [] MessageGroupId [source6] SessionId [source6|58a63c2c-164ce2d3-c2f43701-f6ed6755_0] Write session: aborting
2025-11-01T16:05:28.267803Z :INFO: [] MessageGroupId [source6] SessionId [source6|58a63c2c-164ce2d3-c2f43701-f6ed6755_0] Write session: gracefully shut down, all writes complete
2025-11-01T16:05:28.267979Z :DEBUG: [] MessageGroupId [source6] SessionId [source6|58a63c2c-164ce2d3-c2f43701-f6ed6755_0] Write session: destroy
2025-11-01T16:05:28.273818Z :DEBUG: [] MessageGroupId [source7] SessionId [] Write session: try to update token
2025-11-01T16:05:28.279935Z :INFO: [] MessageGroupId [source7] SessionId [] Write session: Do CDS request
2025-11-01T16:05:28.279982Z :INFO: [] MessageGroupId [source7] SessionId [] Start write session. Will connect to endpoint: localhost:2406
2025-11-01T16:05:28.282976Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 7 sessionId: source6|58a63c2c-164ce2d3-c2f43701-f6ed6755_0 grpc read done: success: 0 data: 
2025-11-01T16:05:28.283008Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 7 sessionId: source6|58a63c2c-164ce2d3-c2f43701-f6ed6755_0 grpc read failed
2025-11-01T16:05:28.283630Z :DEBUG: [] MessageGroupId [source7] SessionId [] Write session: send init request: init_request { topic: "topic1" message_group_id: "source7" }
2025-11-01T16:05:28.283493Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:824: session v1 closed cookie: 7 sessionId: source6|58a63c2c-164ce2d3-c2f43701-f6ed6755_0
2025-11-01T16:05:28.283525Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 7 sessionId: source6|58a63c2c-164ce2d3-c2f43701-f6ed6755_0 is DEAD
2025-11-01T16:05:28.283950Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-11-01T16:05:28.284438Z node 7 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-11-01T16:05:28.284465Z node 7 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 8
2025-11-01T16:05:28.284719Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [7:7567788760201417466:2519] destroyed
2025-11-01T16:05:28.284794Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 8 sessionId:  grpc read done: success: 1 data: init_request { topic: "topic1" message_group_id: "source7" }
2025-11-01T16:05:28.284773Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-11-01T16:05:28.284806Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T16:05:28.284821Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T16:05:28.284840Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-01T16:05:28.284919Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 8 topic: "topic1" message_group_id: "source7" from ipv6:[::1]:39382
2025-11-01T16:05:28.284941Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=8 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:39382 proto=v1  topic=topic1 durationSec=0
2025-11-01T16:05:28.284953Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-11-01T16:05:28.289071Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 8 sessionId:  describe result for acl check
2025-11-01T16:05:28.289229Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-11-01T16:05:28.289262Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-11-01T16:05:28.289275Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-11-01T16:05:28.289291Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [7:7567788760201417473:2523] (SourceId=source7, PreferedPartition=(NULL)) StartKqpSession
2025-11-01T16:05:28.294785Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [7:7567788760201417473:2523] (SourceId=source7, PreferedPartition=(NULL)) Select from the table
2025-11-01T16:05:28.301759Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [7:7567788760201417473:2523] (SourceId=source7, PreferedPartition=(NULL)) RequestPQRB
2025-11-01T16:05:28.302378Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1655: [72075186224037893][rt3.dc1--topic1] pipe [7:7567788760201417492:2523] connected; active server actors: 1
2025-11-01T16:05:28.302474Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [7:7567788760201417473:2523] (SourceId=source7, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=source7
2025-11-01T16:05:28.302493Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [7:7567788760201417473:2523] (SourceId=source7, PreferedPartition=(NULL)) Update the table
2025-11-01T16:05:28.303351Z node 7 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1659: [72075186224037893][rt3.dc1--topic1] pipe [7:7567788760201417492:2523] disconnected.
2025-11-01T16:05:28.303392Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1670: [72075186224037893][rt3.dc1--topic1] pipe [7:7567788760201417492:2523] disconnected; active server actors: 1
2025-11-01T16:05:28.303407Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1695: [72075186224037893][rt3.dc1--topic1] pipe [7:7567788760201417492:2523] disconnected no session
2025-11-01T16:05:28.310106Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T16:05:28.310135Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T16:05:28.310150Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-01T16:05:28.311141Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [7:7567788760201417473:2523] (SourceId=source7, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-11-01T16:05:28.311185Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [7:7567788760201417473:2523] (SourceId=source7, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-11-01T16:05:28.311199Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [7:7567788760201417473:2523] (SourceId=source7, PreferedPartition=(NULL)) Start idle
2025-11-01T16:05:28.311224Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 8 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-11-01T16:05:28.312512Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [7:7567788760201417507:2523], now have 1 active actors on pipe
2025-11-01T16:05:28.312598Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-01T16:05:28.312622Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-01T16:05:28.312707Z node 8 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie source7|e5fead70-9abd5894-51349a6b-6ad60f55_0 generated for partition 0 topic 'rt3.dc1--topic1' owner source7
2025-11-01T16:05:28.312748Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T16:05:28.312786Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T16:05:28.312802Z node 8 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-01T16:05:28.312272Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 8, Generation: 1
2025-11-01T16:05:28.312843Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-01T16:05:28.312906Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-01T16:05:28.312960Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-01T16:05:28.313516Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-01T16:05:28.313551Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-01T16:05:28.313618Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-01T16:05:28.313870Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 8 partition: 0 MaxSeqNo: 0 sessionId: source7|e5fead70-9abd5894-51349a6b-6ad60f55_0
2025-11-01T16:05:28.315404Z :INFO: [] MessageGroupId [source7] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1762013128315 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-11-01T16:05:28.315527Z :INFO: [] MessageGroupId [source7] SessionId [] Write session established. Init response: session_id: "source7|e5fead70-9abd5894-51349a6b-6ad60f55_0" topic: "topic1" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-11-01T16:05:28.316879Z :DEBUG: [] MessageGroupId [source7] SessionId [source7|e5fead70-9abd5894-51349a6b-6ad60f55_0] Write 1 messages with Id from 1 to 1
2025-11-01T16:05:28.316966Z :INFO: [] MessageGroupId [source7] SessionId [source7|e5fead70-9abd5894-51349a6b-6ad60f55_0] Write session: close. Timeout = 10000 ms
2025-11-01T16:05:28.338825Z :DEBUG: [] MessageGroupId [source7] SessionId [source7|e5fead70-9abd5894-51349a6b-6ad60f55_0] Write session: try to update token
2025-11-01T16:05:28.338888Z :DEBUG: [] MessageGroupId [source7] SessionId [source7|e5fead70-9abd5894-51349a6b-6ad60f55_0] Send 1 message(s) (0 left), first sequence number is 1
2025-11-01T16:05:28.343529Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 8 sessionId: source7|e5fead70-9abd5894-51349a6b-6ad60f55_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-01T16:05:28.343906Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-01T16:05:28.344500Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-01T16:05:28.344550Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-01T16:05:28.344640Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-11-01T16:05:28.344953Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-01T16:05:28.345343Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-01T16:05:28.345368Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-01T16:05:28.345427Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: '\0source7' SeqNo: 1 partNo : 0 messageNo: 1 size 1122 offset: -1
2025-11-01T16:05:28.345465Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-01T16:05:28.345522Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T16:05:28.345548Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T16:05:28.345565Z node 8 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-01T16:05:28.345671Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId '\0source7' seqNo 1 partNo 0
2025-11-01T16:05:28.372392Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '\0source7' seqNo 1 partNo 0 FormedBlobsCount 0 NewHead: Offset 7 PartNo 0 PackedSize 1197 count 1 nextOffset 8 batches 1
2025-11-01T16:05:28.372459Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-01T16:05:28.373040Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 7,1 HeadOffset 7 endOffset 7 curOffset 8 d0000000000_00000000000000000007_00000_0000000001_00000? size 1185 WTime 1762013128372
2025-11-01T16:05:28.373241Z node 8 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-01T16:05:28.373372Z node 8 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 7 partNo 0 count 1 size 1185
2025-11-01T16:05:28.388578Z node 8 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 7 count 1 size 1185 actorID [8:7567788754134191738:2362]
2025-11-01T16:05:28.388684Z node 8 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-01T16:05:28.388751Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1130 WriteNewSizeFromSupportivePartitions# 0
2025-11-01T16:05:28.388823Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-01T16:05:28.388871Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0source7', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 1, partNo: 0, Offset: 7 is stored on disk
2025-11-01T16:05:28.389109Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T16:05:28.389126Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T16:05:28.389145Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-01T16:05:28.389182Z node 8 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-01T16:05:28.389229Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 1  requestId: <none> cookie: 1
2025-11-01T16:05:28.389631Z node 8 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 7 partno 0 count 1 parts 0 suffix '63' size 1185
2025-11-01T16:05:28.389938Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 1 consumer shared/user session shared/user_7_1_18026246482560886463_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 7 EndOffset 7 newEndOffset 8 commitOffset 0 clientCommitOffset 0 cookie 8 readingFinished 0 firstRead 0
2025-11-01T16:05:28.389976Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_7_1_18026246482560886463_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 7 endOffset 8
2025-11-01T16:05:28.390026Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-01T16:05:28.390445Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_7_1_18026246482560886463_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 7, endOffset# 8, WTime# 1762013128188, sizeLag# 1185
2025-11-01T16:05:28.390471Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_7_1_18026246482560886463_v1TEvPartitionReady. Aval parts: 1
2025-11-01T16:05:28.390521Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_7_1_18026246482560886463_v1 performing read request: guid# 615dc524-ce137525-cd18f6ad-1c400855, from# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), count# 1, size# 1422, partitionsAsked# 1, maxTimeLag# 0ms
2025-11-01T16:05:28.390587Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_7_1_18026246482560886463_v1 READ FROM TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1)maxCount 1 maxSize 1422 maxTimeLagMs 0 readTimestampMs 0 readOffset 7 EndOffset 8 ClientCommitOffset 0 committedOffset 0 Guid 615dc524-ce137525-cd18f6ad-1c400855
2025-11-01T16:05:28.390787Z :DEBUG: [] MessageGroupId [source7] SessionId [source7|e5fead70-9abd5894-51349a6b-6ad60f55_0] Write session got write response: sequence_numbers: 1 offsets: 7 already_written: false write_statistics { persist_duration_ms: 11 queued_in_partition_duration_ms: 28 }
2025-11-01T16:05:28.390841Z :DEBUG: [] MessageGroupId [source7] SessionId [source7|e5fead70-9abd5894-51349a6b-6ad60f55_0] Write session: acknoledged message 1
2025-11-01T16:05:28.391108Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-01T16:05:28.391142Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-01T16:05:28.391266Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:880: [72075186224037892][Partition][0][StateIdle] read cookie 11 Topic 'rt3.dc1--topic1' partition 0 user user offset 7 partno 0 count 1 size 1422 endOffset 8 max time lag 0ms effective offset 7
2025-11-01T16:05:28.391493Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:1105: [72075186224037892][Partition][0][StateIdle] read cookie 11 added 1 blobs, size 1185 count 1 last offset 7, current partition end offset: 8
2025-11-01T16:05:28.391514Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:1121: [72075186224037892][Partition][0][StateIdle] Reading cookie 11. Send blob request.
2025-11-01T16:05:28.391568Z node 8 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 7 partno 0 count 1 parts_count 0 source 1 size 1185 accessed 0 times before, last time 2025-11-01T16:05:28.000000Z
2025-11-01T16:05:28.391598Z node 8 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 11. All 1 blobs are from cache.
2025-11-01T16:05:28.391645Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:572: FormAnswer for 1 blobs
2025-11-01T16:05:28.391659Z node 8 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 7 partno 0 count 1 parts 0 suffix '63'
2025-11-01T16:05:28.391778Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 7 totakecount 1 count 1 size 1165 from pos 0 cbcount 1
2025-11-01T16:05:28.391868Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 7
2025-11-01T16:05:28.392999Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_7_1_18026246482560886463_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 8 Result { Offset: 7 Data: "... 1122 bytes ..." SourceId: "\000source7" SeqNo: 1 WriteTimestampMS: 1762013128344 CreateTimestampMS: 1762013128315 UncompressedSize: 1047552 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 20 RealReadOffset: 7 WaitQuotaTimeMs: 0 EndOffset: 8 StartOffset: 0 } Cookie: 7 }
2025-11-01T16:05:28.393145Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_7_1_18026246482560886463_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 9 from offset 8
2025-11-01T16:05:28.393187Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_7_1_18026246482560886463_v1 after read state TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 8 ReadOffset 8 ReadGuid 615dc524-ce137525-cd18f6ad-1c400855 has messages 1
2025-11-01T16:05:28.393313Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_7_1_18026246482560886463_v1 read done: guid# 615dc524-ce137525-cd18f6ad-1c400855, partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), size# 1224
2025-11-01T16:05:28.393349Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_7_1_18026246482560886463_v1 response to read: guid# 615dc524-ce137525-cd18f6ad-1c400855
2025-11-01T16:05:28.393551Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_7_1_18026246482560886463_v1 Process answer. Aval parts: 0
2025-11-01T16:05:28.394059Z :DEBUG: [] [] [aa6bd8f2-140b5929-e6291a97-498f8dbd] [null] After sending read request: ReadSizeBudget = 2621440, ReadSizeServerDelta = 0
2025-11-01T16:05:28.394624Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_7_1_18026246482560886463_v1 grpc read done: success# 1, data# { read { } }
2025-11-01T16:05:28.394732Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_7_1_18026246482560886463_v1 got read request: guid# 72aec56-e7fcfee7-267c5661-e4b5c940
2025-11-01T16:05:28.412064Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T16:05:28.412103Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T16:05:28.412121Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-01T16:05:28.417248Z :INFO: [] MessageGroupId [source7] SessionId [source7|e5fead70-9abd5894-51349a6b-6ad60f55_0] Write session will now close
2025-11-01T16:05:28.417316Z :DEBUG: [] MessageGroupId [source7] SessionId [source7|e5fead70-9abd5894-51349a6b-6ad60f55_0] Write session: aborting
2025-11-01T16:05:28.417778Z :INFO: [] MessageGroupId [source7] SessionId [source7|e5fead70-9abd5894-51349a6b-6ad60f55_0] Write session: gracefully shut down, all writes complete
2025-11-01T16:05:28.418168Z :DEBUG: [] MessageGroupId [source7] SessionId [source7|e5fead70-9abd5894-51349a6b-6ad60f55_0] Write session: destroy
2025-11-01T16:05:28.420812Z :DEBUG: [] MessageGroupId [source8] SessionId [] Write session: try to update token
2025-11-01T16:05:28.423070Z :INFO: [] MessageGroupId [source8] SessionId [] Write session: Do CDS request
2025-11-01T16:05:28.423101Z :INFO: [] MessageGroupId [source8] SessionId [] Start write session. Will connect to endpoint: localhost:2406
2025-11-01T16:05:28.423304Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 8 sessionId: source7|e5fead70-9abd5894-51349a6b-6ad60f55_0 grpc read done: success: 0 data: 
2025-11-01T16:05:28.423340Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 8 sessionId: source7|e5fead70-9abd5894-51349a6b-6ad60f55_0 grpc read failed
2025-11-01T16:05:28.423374Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 8 sessionId: source7|e5fead70-9abd5894-51349a6b-6ad60f55_0 grpc closed
2025-11-01T16:05:28.423397Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 8 sessionId: source7|e5fead70-9abd5894-51349a6b-6ad60f55_0 is DEAD
2025-11-01T16:05:28.424877Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-11-01T16:05:28.428519Z :DEBUG: [] MessageGroupId [source8] SessionId [] Write session: send init request: init_request { topic: "topic1" message_group_id: "source8" }
2025-11-01T16:05:28.427655Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [7:7567788760201417507:2523] destroyed
2025-11-01T16:05:28.427726Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-11-01T16:05:28.427761Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T16:05:28.427776Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T16:05:28.427795Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-01T16:05:28.429460Z node 7 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-11-01T16:05:28.429486Z node 7 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 9
2025-11-01T16:05:28.429961Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 9 sessionId:  grpc read done: success: 1 data: init_request { topic: "topic1" message_group_id: "source8" }
2025-11-01T16:05:28.430083Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 9 topic: "topic1" message_group_id: "source8" from ipv6:[::1]:39382
2025-11-01T16:05:28.430100Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=9 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:39382 proto=v1  topic=topic1 durationSec=0
2025-11-01T16:05:28.430109Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-11-01T16:05:28.431854Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 9 sessionId:  describe result for acl check
2025-11-01T16:05:28.431993Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-11-01T16:05:28.432004Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-11-01T16:05:28.432015Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-11-01T16:05:28.432029Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [7:7567788760201417517:2529] (SourceId=source8, PreferedPartition=(NULL)) StartKqpSession
2025-11-01T16:05:28.435489Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [7:7567788760201417517:2529] (SourceId=source8, PreferedPartition=(NULL)) Select from the table
2025-11-01T16:05:28.450806Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [7:7567788760201417517:2529] (SourceId=source8, PreferedPartition=(NULL)) RequestPQRB
2025-11-01T16:05:28.451463Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1655: [72075186224037893][rt3.dc1--topic1] pipe [7:7567788760201417536:2529] connected; active server actors: 1
2025-11-01T16:05:28.451667Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [7:7567788760201417517:2529] (SourceId=source8, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=source8
2025-11-01T16:05:28.451695Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [7:7567788760201417517:2529] (SourceId=source8, PreferedPartition=(NULL)) Update the table
2025-11-01T16:05:28.451941Z node 7 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1659: [72075186224037893][rt3.dc1--topic1] pipe [7:7567788760201417536:2529] disconnected.
2025-11-01T16:05:28.451969Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1670: [72075186224037893][rt3.dc1--topic1] pipe [7:7567788760201417536:2529] disconnected; active server actors: 1
2025-11-01T16:05:28.451984Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1695: [72075186224037893][rt3.dc1--topic1] pipe [7:7567788760201417536:2529] disconnected no session
2025-11-01T16:05:28.461225Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [7:7567788760201417517:2529] (SourceId=source8, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-11-01T16:05:28.461261Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [7:7567788760201417517:2529] (SourceId=source8, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-11-01T16:05:28.461274Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [7:7567788760201417517:2529] (SourceId=source8, PreferedPartition=(NULL)) Start idle
2025-11-01T16:05:28.461295Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 9 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-11-01T16:05:28.463126Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [7:7567788760201417550:2529], now have 1 active actors on pipe
2025-11-01T16:05:28.463439Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 8, Generation: 1
2025-11-01T16:05:28.463723Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-01T16:05:28.463764Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-01T16:05:28.463861Z node 8 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie source8|1afc8fc4-600ba354-f285a96b-67274b1b_0 generated for partition 0 topic 'rt3.dc1--topic1' owner source8
2025-11-01T16:05:28.463902Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T16:05:28.463926Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T16:05:28.463940Z node 8 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-01T16:05:28.463984Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-01T16:05:28.464040Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-01T16:05:28.464102Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-01T16:05:28.464548Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-01T16:05:28.464567Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-01T16:05:28.464624Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-01T16:05:28.464834Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 9 partition: 0 MaxSeqNo: 0 sessionId: source8|1afc8fc4-600ba354-f285a96b-67274b1b_0
2025-11-01T16:05:28.465518Z :INFO: [] MessageGroupId [source8] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1762013128465 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-11-01T16:05:28.465613Z :INFO: [] MessageGroupId [source8] SessionId [] Write session established. Init response: session_id: "source8|1afc8fc4-600ba354-f285a96b-67274b1b_0" topic: "topic1" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-11-01T16:05:28.466824Z :DEBUG: [] MessageGroupId [source8] SessionId [source8|1afc8fc4-600ba354-f285a96b-67274b1b_0] Write 1 messages with Id from 1 to 1
2025-11-01T16:05:28.466912Z :INFO: [] MessageGroupId [source8] SessionId [source8|1afc8fc4-600ba354-f285a96b-67274b1b_0] Write session: close. Timeout = 10000 ms
2025-11-01T16:05:28.478667Z :DEBUG: [] MessageGroupId [source8] SessionId [source8|1afc8fc4-600ba354-f285a96b-67274b1b_0] Write session: try to update token
2025-11-01T16:05:28.478720Z :DEBUG: [] MessageGroupId [source8] SessionId [source8|1afc8fc4-600ba354-f285a96b-67274b1b_0] Send 1 message(s) (0 left), first sequence number is 1
2025-11-01T16:05:28.479937Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 9 sessionId: source8|1afc8fc4-600ba354-f285a96b-67274b1b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-01T16:05:28.480175Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-01T16:05:28.480681Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-01T16:05:28.480730Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-01T16:05:28.480810Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-11-01T16:05:28.481071Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-01T16:05:28.481462Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-01T16:05:28.481489Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-01T16:05:28.481548Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: '\0source8' SeqNo: 1 partNo : 0 messageNo: 1 size 1122 offset: -1
2025-11-01T16:05:28.481596Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-01T16:05:28.481645Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T16:05:28.481674Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T16:05:28.481691Z node 8 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-01T16:05:28.481827Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId '\0source8' seqNo 1 partNo 0
2025-11-01T16:05:28.482703Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '\0source8' seqNo 1 partNo 0 FormedBlobsCount 0 NewHead: Offset 8 PartNo 0 PackedSize 1197 count 1 nextOffset 9 batches 1
2025-11-01T16:05:28.482744Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-01T16:05:28.483329Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 8,1 HeadOffset 8 endOffset 8 curOffset 9 d0000000000_00000000000000000008_00000_0000000001_00000? size 1185 WTime 1762013128483
2025-11-01T16:05:28.483493Z node 8 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-01T16:05:28.483621Z node 8 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 8 partNo 0 count 1 size 1185
2025-11-01T16:05:28.488642Z node 8 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 8 count 1 size 1185 actorID [8:7567788754134191738:2362]
2025-11-01T16:05:28.488689Z node 8 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-01T16:05:28.488731Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1130 WriteNewSizeFromSupportivePartitions# 0
2025-11-01T16:05:28.488758Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-01T16:05:28.488787Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0source8', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 1, partNo: 0, Offset: 8 is stored on disk
2025-11-01T16:05:28.488957Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T16:05:28.488969Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T16:05:28.488984Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-01T16:05:28.489019Z node 8 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-01T16:05:28.489041Z node 8 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 8 partno 0 count 1 parts 0 suffix '63' size 1185
2025-11-01T16:05:28.489049Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 1  requestId: <none> cookie: 1
2025-11-01T16:05:28.489576Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 1 consumer shared/user session shared/user_7_1_18026246482560886463_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 8 EndOffset 8 newEndOffset 9 commitOffset 0 clientCommitOffset 0 cookie 9 readingFinished 0 firstRead 0
2025-11-01T16:05:28.489610Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_7_1_18026246482560886463_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 8 endOffset 9
2025-11-01T16:05:28.490312Z :DEBUG: [] MessageGroupId [source8] SessionId [source8|1afc8fc4-600ba354-f285a96b-67274b1b_0] Write session got write response: sequence_numbers: 1 offsets: 8 already_written: false write_statistics { persist_duration_ms: 6 queued_in_partition_duration_ms: 1 }
2025-11-01T16:05:28.489646Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-01T16:05:28.489992Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_7_1_18026246482560886463_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 8, endOffset# 9, WTime# 1762013128344, sizeLag# 1185
2025-11-01T16:05:28.490005Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_7_1_18026246482560886463_v1TEvPartitionReady. Aval parts: 1
2025-11-01T16:05:28.490370Z :DEBUG: [] MessageGroupId [source8] SessionId [source8|1afc8fc4-600ba354-f285a96b-67274b1b_0] Write session: acknoledged message 1
2025-11-01T16:05:28.490051Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_7_1_18026246482560886463_v1 performing read request: guid# 72aec56-e7fcfee7-267c5661-e4b5c940, from# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), count# 1, size# 1422, partitionsAsked# 1, maxTimeLag# 0ms
2025-11-01T16:05:28.490093Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_7_1_18026246482560886463_v1 READ FROM TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1)maxCount 1 maxSize 1422 maxTimeLagMs 0 readTimestampMs 0 readOffset 8 EndOffset 9 ClientCommitOffset 0 committedOffset 0 Guid 72aec56-e7fcfee7-267c5661-e4b5c940
2025-11-01T16:05:28.490689Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-01T16:05:28.490713Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-01T16:05:28.490789Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:880: [72075186224037892][Partition][0][StateIdle] read cookie 12 Topic 'rt3.dc1--topic1' partition 0 user user offset 8 partno 0 count 1 size 1422 endOffset 9 max time lag 0ms effective offset 8
2025-11-01T16:05:28.490942Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:1105: [72075186224037892][Partition][0][StateIdle] read cookie 12 added 1 blobs, size 1185 count 1 last offset 8, current partition end offset: 9
2025-11-01T16:05:28.490954Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:1121: [72075186224037892][Partition][0][StateIdle] Reading cookie 12. Send blob request.
2025-11-01T16:05:28.490994Z node 8 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 8 partno 0 count 1 parts_count 0 source 1 size 1185 accessed 0 times before, last time 2025-11-01T16:05:28.000000Z
2025-11-01T16:05:28.491024Z node 8 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 12. All 1 blobs are from cache.
2025-11-01T16:05:28.491072Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:572: FormAnswer for 1 blobs
2025-11-01T16:05:28.491203Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 8 totakecount 1 count 1 size 1165 from pos 0 cbcount 1
2025-11-01T16:05:28.491290Z node 8 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 8 partno 0 count 1 parts 0 suffix '63'
2025-11-01T16:05:28.491312Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 8
2025-11-01T16:05:28.491791Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_7_1_18026246482560886463_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 9 Result { Offset: 8 Data: "... 1122 bytes ..." SourceId: "\000source8" SeqNo: 1 WriteTimestampMS: 1762013128481 CreateTimestampMS: 1762013128465 UncompressedSize: 1047552 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 20 RealReadOffset: 8 WaitQuotaTimeMs: 0 EndOffset: 9 StartOffset: 0 } Cookie: 8 }
2025-11-01T16:05:28.491924Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_7_1_18026246482560886463_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 10 from offset 9
2025-11-01T16:05:28.491966Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_7_1_18026246482560886463_v1 after read state TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 9 ReadOffset 9 ReadGuid 72aec56-e7fcfee7-267c5661-e4b5c940 has messages 1
2025-11-01T16:05:28.492066Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_7_1_18026246482560886463_v1 read done: guid# 72aec56-e7fcfee7-267c5661-e4b5c940, partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), size# 1224
2025-11-01T16:05:28.492093Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_7_1_18026246482560886463_v1 response to read: guid# 72aec56-e7fcfee7-267c5661-e4b5c940
2025-11-01T16:05:28.492298Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_7_1_18026246482560886463_v1 Process answer. Aval parts: 0
2025-11-01T16:05:28.492761Z :DEBUG: [] [] [aa6bd8f2-140b5929-e6291a97-498f8dbd] [null] After sending read request: ReadSizeBudget = 2621440, ReadSizeServerDelta = 0
2025-11-01T16:05:28.492995Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_7_1_18026246482560886463_v1 grpc read done: success# 1, data# { read { } }
2025-11-01T16:05:28.493106Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_7_1_18026246482560886463_v1 got read request: guid# 3cf90120-489415ec-c41eac92-170fb7a3
2025-11-01T16:05:28.512346Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T16:05:28.512382Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T16:05:28.512400Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-01T16:05:28.567066Z :INFO: [] MessageGroupId [source8] SessionId [source8|1afc8fc4-600ba354-f285a96b-67274b1b_0] Write session will now close
2025-11-01T16:05:28.567124Z :DEBUG: [] MessageGroupId [source8] SessionId [source8|1afc8fc4-600ba354-f285a96b-67274b1b_0] Write session: aborting
2025-11-01T16:05:28.567736Z :INFO: [] MessageGroupId [source8] SessionId [source8|1afc8fc4-600ba354-f285a96b-67274b1b_0] Write session: gracefully shut down, all writes complete
2025-11-01T16:05:28.567935Z :DEBUG: [] MessageGroupId [source8] SessionId [source8|1afc8fc4-600ba354-f285a96b-67274b1b_0] Write session: destroy
2025-11-01T16:05:28.570403Z :DEBUG: [] MessageGroupId [source9] SessionId [] Write session: try to update token
2025-11-01T16:05:28.570713Z :INFO: [] MessageGroupId [source9] SessionId [] Write session: Do CDS request
2025-11-01T16:05:28.570757Z :INFO: [] MessageGroupId [source9] SessionId [] Start write session. Will connect to endpoint: localhost:2406
2025-11-01T16:05:28.572138Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 9 sessionId: source8|1afc8fc4-600ba354-f285a96b-67274b1b_0 grpc read done: success: 0 data: 
2025-11-01T16:05:28.572166Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 9 sessionId: source8|1afc8fc4-600ba354-f285a96b-67274b1b_0 grpc read failed
2025-11-01T16:05:28.572197Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 9 sessionId: source8|1afc8fc4-600ba354-f285a96b-67274b1b_0 grpc closed
2025-11-01T16:05:28.572214Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 9 sessionId: source8|1afc8fc4-600ba354-f285a96b-67274b1b_0 is DEAD
2025-11-01T16:05:28.572963Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-11-01T16:05:28.574745Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [7:7567788760201417550:2529] destroyed
2025-11-01T16:05:28.574807Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-11-01T16:05:28.574841Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T16:05:28.574856Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T16:05:28.574874Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-01T16:05:28.576311Z :DEBUG: [] MessageGroupId [source9] SessionId [] Write session: send init request: init_request { topic: "topic1" message_group_id: "source9" }
2025-11-01T16:05:28.578157Z node 7 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-11-01T16:05:28.578187Z node 7 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 10
2025-11-01T16:05:28.578672Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 10 sessionId:  grpc read done: success: 1 data: init_request { topic: "topic1" message_group_id: "source9" }
2025-11-01T16:05:28.578809Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 10 topic: "topic1" message_group_id: "source9" from ipv6:[::1]:39382
2025-11-01T16:05:28.578828Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=10 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:39382 proto=v1  topic=topic1 durationSec=0
2025-11-01T16:05:28.578839Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-11-01T16:05:28.580511Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 10 sessionId:  describe result for acl check
2025-11-01T16:05:28.580681Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-11-01T16:05:28.580694Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-11-01T16:05:28.580706Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-11-01T16:05:28.580724Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [7:7567788760201417557:2533] (SourceId=source9, PreferedPartition=(NULL)) StartKqpSession
2025-11-01T16:05:28.585063Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [7:7567788760201417557:2533] (SourceId=source9, PreferedPartition=(NULL)) Select from the table
2025-11-01T16:05:28.593658Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [7:7567788760201417557:2533] (SourceId=source9, PreferedPartition=(NULL)) RequestPQRB
2025-11-01T16:05:28.593950Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1655: [72075186224037893][rt3.dc1--topic1] pipe [7:7567788760201417576:2533] connected; active server actors: 1
2025-11-01T16:05:28.593998Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [7:7567788760201417557:2533] (SourceId=source9, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=source9
2025-11-01T16:05:28.594014Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [7:7567788760201417557:2533] (SourceId=source9, PreferedPartition=(NULL)) Update the table
2025-11-01T16:05:28.594426Z node 7 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1659: [72075186224037893][rt3.dc1--topic1] pipe [7:7567788760201417576:2533] disconnected.
2025-11-01T16:05:28.594453Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1670: [72075186224037893][rt3.dc1--topic1] pipe [7:7567788760201417576:2533] disconnected; active server actors: 1
2025-11-01T16:05:28.594469Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1695: [72075186224037893][rt3.dc1--topic1] pipe [7:7567788760201417576:2533] disconnected no session
2025-11-01T16:05:28.605188Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [7:7567788760201417557:2533] (SourceId=source9, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-11-01T16:05:28.605236Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [7:7567788760201417557:2533] (SourceId=source9, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-11-01T16:05:28.605254Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [7:7567788760201417557:2533] (SourceId=source9, PreferedPartition=(NULL)) Start idle
2025-11-01T16:05:28.605282Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 10 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-11-01T16:05:28.607117Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [7:7567788760201417590:2533], now have 1 active actors on pipe
2025-11-01T16:05:28.607296Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 8, Generation: 1
2025-11-01T16:05:28.607556Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-01T16:05:28.607598Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-01T16:05:28.607672Z node 8 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie source9|471005f4-5e20cefe-12f505a6-9d676f74_0 generated for partition 0 topic 'rt3.dc1--topic1' owner source9
2025-11-01T16:05:28.607712Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T16:05:28.607732Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T16:05:28.607747Z node 8 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-01T16:05:28.607788Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-01T16:05:28.607837Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-01T16:05:28.607888Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-01T16:05:28.608379Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-01T16:05:28.608405Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-01T16:05:28.608473Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-01T16:05:28.608781Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 10 partition: 0 MaxSeqNo: 0 sessionId: source9|471005f4-5e20cefe-12f505a6-9d676f74_0
2025-11-01T16:05:28.612659Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T16:05:28.612683Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T16:05:28.612694Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-01T16:05:28.615405Z :INFO: [] MessageGroupId [source9] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1762013128615 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-11-01T16:05:28.615515Z :INFO: [] MessageGroupId [source9] SessionId [] Write session established. Init response: session_id: "source9|471005f4-5e20cefe-12f505a6-9d676f74_0" topic: "topic1" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-11-01T16:05:28.617040Z :DEBUG: [] MessageGroupId [source9] SessionId [source9|471005f4-5e20cefe-12f505a6-9d676f74_0] Write 1 messages with Id from 1 to 1
2025-11-01T16:05:28.617132Z :INFO: [] MessageGroupId [source9] SessionId [source9|471005f4-5e20cefe-12f505a6-9d676f74_0] Write session: close. Timeout = 10000 ms
2025-11-01T16:05:28.637305Z :DEBUG: [] MessageGroupId [source9] SessionId [source9|471005f4-5e20cefe-12f505a6-9d676f74_0] Write session: try to update token
2025-11-01T16:05:28.637369Z :DEBUG: [] MessageGroupId [source9] SessionId [source9|471005f4-5e20cefe-12f505a6-9d676f74_0] Send 1 message(s) (0 left), first sequence number is 1
2025-11-01T16:05:28.638231Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 10 sessionId: source9|471005f4-5e20cefe-12f505a6-9d676f74_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-01T16:05:28.638537Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-01T16:05:28.639387Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-01T16:05:28.639440Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-01T16:05:28.639526Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-11-01T16:05:28.639806Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-01T16:05:28.640764Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-01T16:05:28.640798Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-01T16:05:28.640862Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: '\0source9' SeqNo: 1 partNo : 0 messageNo: 1 size 1122 offset: -1
2025-11-01T16:05:28.640911Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-01T16:05:28.640962Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T16:05:28.640990Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T16:05:28.641006Z node 8 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-01T16:05:28.641120Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId '\0source9' seqNo 1 partNo 0
2025-11-01T16:05:28.642013Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '\0source9' seqNo 1 partNo 0 FormedBlobsCount 0 NewHead: Offset 9 PartNo 0 PackedSize 1197 count 1 nextOffset 10 batches 1
2025-11-01T16:05:28.642052Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-01T16:05:28.642599Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 9,1 HeadOffset 9 endOffset 9 curOffset 10 d0000000000_00000000000000000009_00000_0000000001_00000? size 1185 WTime 1762013128642
2025-11-01T16:05:28.642755Z node 8 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-01T16:05:28.642884Z node 8 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 9 partNo 0 count 1 size 1185
2025-11-01T16:05:28.648039Z node 8 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 9 count 1 size 1185 actorID [8:7567788754134191738:2362]
2025-11-01T16:05:28.648101Z node 8 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-01T16:05:28.648154Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1130 WriteNewSizeFromSupportivePartitions# 0
2025-11-01T16:05:28.648189Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-01T16:05:28.648230Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0source9', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 1, partNo: 0, Offset: 9 is stored on disk
2025-11-01T16:05:28.648449Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T16:05:28.648464Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T16:05:28.648481Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-01T16:05:28.648512Z node 8 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-01T16:05:28.648553Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 1  requestId: <none> cookie: 1
2025-11-01T16:05:28.648922Z node 8 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 9 partno 0 count 1 parts 0 suffix '63' size 1185
2025-11-01T16:05:28.649173Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 1 consumer shared/user session shared/user_7_1_18026246482560886463_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 9 EndOffset 9 newEndOffset 10 commitOffset 0 clientCommitOffset 0 cookie 10 readingFinished 0 firstRead 0
2025-11-01T16:05:28.649205Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_7_1_18026246482560886463_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 9 endOffset 10
2025-11-01T16:05:28.649252Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-01T16:05:28.649350Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_7_1_18026246482560886463_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 9, endOffset# 10, WTime# 1762013128481, sizeLag# 1185
2025-11-01T16:05:28.649373Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_7_1_18026246482560886463_v1TEvPartitionReady. Aval parts: 1
2025-11-01T16:05:28.649422Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_7_1_18026246482560886463_v1 performing read request: guid# 3cf90120-489415ec-c41eac92-170fb7a3, from# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), count# 1, size# 1422, partitionsAsked# 1, maxTimeLag# 0ms
2025-11-01T16:05:28.649487Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_7_1_18026246482560886463_v1 READ FROM TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1)maxCount 1 maxSize 1422 maxTimeLagMs 0 readTimestampMs 0 readOffset 9 EndOffset 10 ClientCommitOffset 0 committedOffset 0 Guid 3cf90120-489415ec-c41eac92-170fb7a3
2025-11-01T16:05:28.650027Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-01T16:05:28.650067Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-01T16:05:28.650174Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:880: [72075186224037892][Partition][0][StateIdle] read cookie 13 Topic 'rt3.dc1--topic1' partition 0 user user offset 9 partno 0 count 1 size 1422 endOffset 10 max time lag 0ms effective offset 9
2025-11-01T16:05:28.650406Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:1105: [72075186224037892][Partition][0][StateIdle] read cookie 13 added 1 blobs, size 1185 count 1 last offset 9, current partition end offset: 10
2025-11-01T16:05:28.650438Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:1121: [72075186224037892][Partition][0][StateIdle] Reading cookie 13. Send blob request.
2025-11-01T16:05:28.650489Z node 8 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 9 partno 0 count 1 parts_count 0 source 1 size 1185 accessed 0 times before, last time 2025-11-01T16:05:28.000000Z
2025-11-01T16:05:28.650527Z node 8 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 13. All 1 blobs are from cache.
2025-11-01T16:05:28.650576Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:572: FormAnswer for 1 blobs
2025-11-01T16:05:28.650584Z node 8 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 9 partno 0 count 1 parts 0 suffix '63'
2025-11-01T16:05:28.650709Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 9 totakecount 1 count 1 size 1165 from pos 0 cbcount 1
2025-11-01T16:05:28.650809Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 9
2025-11-01T16:05:28.651174Z :DEBUG: [] MessageGroupId [source9] SessionId [source9|471005f4-5e20cefe-12f505a6-9d676f74_0] Write session got write response: sequence_numbers: 1 offsets: 9 already_written: false write_statistics { persist_duration_ms: 6 queued_in_partition_duration_ms: 1 }
2025-11-01T16:05:28.651224Z :DEBUG: [] MessageGroupId [source9] SessionId [source9|471005f4-5e20cefe-12f505a6-9d676f74_0] Write session: acknoledged message 1
2025-11-01T16:05:28.651267Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_7_1_18026246482560886463_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 10 Result { Offset: 9 Data: "... 1122 bytes ..." SourceId: "\000source9" SeqNo: 1 WriteTimestampMS: 1762013128640 CreateTimestampMS: 1762013128616 UncompressedSize: 1047552 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 20 RealReadOffset: 9 WaitQuotaTimeMs: 0 EndOffset: 10 StartOffset: 0 } Cookie: 9 }
2025-11-01T16:05:28.651421Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_7_1_18026246482560886463_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 11 from offset 10
2025-11-01T16:05:28.651467Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_7_1_18026246482560886463_v1 after read state TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 10 ReadOffset 10 ReadGuid 3cf90120-489415ec-c41eac92-170fb7a3 has messages 1
2025-11-01T16:05:28.651574Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_7_1_18026246482560886463_v1 read done: guid# 3cf90120-489415ec-c41eac92-170fb7a3, partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), size# 1224
2025-11-01T16:05:28.651599Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_7_1_18026246482560886463_v1 response to read: guid# 3cf90120-489415ec-c41eac92-170fb7a3
2025-11-01T16:05:28.651798Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_7_1_18026246482560886463_v1 Process answer. Aval parts: 0
2025-11-01T16:05:28.652717Z :DEBUG: [] [] [aa6bd8f2-140b5929-e6291a97-498f8dbd] [null] After sending read request: ReadSizeBudget = 2621440, ReadSizeServerDelta = 0
2025-11-01T16:05:28.653029Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_7_1_18026246482560886463_v1 grpc read done: success# 1, data# { read { } }
2025-11-01T16:05:28.653149Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_7_1_18026246482560886463_v1 got read request: guid# c2fdaac3-812885b9-a7502905-69bd597a
2025-11-01T16:05:28.713059Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T16:05:28.713097Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T16:05:28.713114Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-01T16:05:28.717268Z :INFO: [] MessageGroupId [source9] SessionId [source9|471005f4-5e20cefe-12f505a6-9d676f74_0] Write session will now close
2025-11-01T16:05:28.717340Z :DEBUG: [] MessageGroupId [source9] SessionId [source9|471005f4-5e20cefe-12f505a6-9d676f74_0] Write session: aborting
2025-11-01T16:05:28.717804Z :INFO: [] MessageGroupId [source9] SessionId [source9|471005f4-5e20cefe-12f505a6-9d676f74_0] Write session: gracefully shut down, all writes complete
2025-11-01T16:05:28.718174Z :DEBUG: [] MessageGroupId [source9] SessionId [source9|471005f4-5e20cefe-12f505a6-9d676f74_0] Write session: destroy
2025-11-01T16:05:28.719931Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 10 sessionId: source9|471005f4-5e20cefe-12f505a6-9d676f74_0 grpc read done: success: 0 data: 
2025-11-01T16:05:28.719960Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 10 sessionId: source9|471005f4-5e20cefe-12f505a6-9d676f74_0 grpc read failed
2025-11-01T16:05:28.719991Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 10 sessionId: source9|471005f4-5e20cefe-12f505a6-9d676f74_0 grpc closed
2025-11-01T16:05:28.720009Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 10 sessionId: source9|471005f4-5e20cefe-12f505a6-9d676f74_0 is DEAD
2025-11-01T16:05:28.720705Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-11-01T16:05:28.721145Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [7:7567788760201417590:2533] destroyed
2025-11-01T16:05:28.721203Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-11-01T16:05:28.721237Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T16:05:28.721253Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T16:05:28.721275Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-01T16:05:28.733648Z :DEBUG: [] Decompression task done. Partition/PartitionSessionId: 0 (1-1)
2025-11-01T16:05:28.736784Z :DEBUG: [] Decompression task done. Partition/PartitionSessionId: 0 (0-0)
2025-11-01T16:05:28.742033Z :DEBUG: [] Decompression task done. Partition/PartitionSessionId: 0 (2-2)
2025-11-01T16:05:28.813359Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T16:05:28.813399Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T16:05:28.813418Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-01T16:05:28.913750Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T16:05:28.913785Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T16:05:28.913802Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-01T16:05:29.016914Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T16:05:29.016951Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T16:05:29.016970Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-01T16:05:29.118399Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T16:05:29.118436Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T16:05:29.118449Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-01T16:05:29.218517Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T16:05:29.218553Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T16:05:29.218567Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-01T16:05:29.318761Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T16:05:29.318803Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T16:05:29.318821Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-01T16:05:29.423422Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T16:05:29.423462Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T16:05:29.423480Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-01T16:05:29.525919Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T16:05:29.525959Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T16:05:29.525979Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-01T16:05:29.626752Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T16:05:29.626788Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T16:05:29.626804Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-01T16:05:29.725890Z :INFO: [] [] [aa6bd8f2-140b5929-e6291a97-498f8dbd] Closing read session. Close timeout: 0.000000s
2025-11-01T16:05:29.725994Z :INFO: [] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:topic1:0:1:9:0
2025-11-01T16:05:29.726065Z :INFO: [] [] [aa6bd8f2-140b5929-e6291a97-498f8dbd] Counters: { Errors: 0 CurrentSessionLifetimeMs: 3146 BytesRead: 3142656 MessagesRead: 3 BytesReadCompressed: 3150 BytesInflightUncompressed: 3142656 BytesInflightCompressed: 7350 BytesInflightTotal: 3150006 MessagesInflight: 10 }
2025-11-01T16:05:29.726218Z :NOTICE: [] [] [aa6bd8f2-140b5929-e6291a97-498f8dbd] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Close with zero timeout " }
2025-11-01T16:05:29.727436Z :DEBUG: [] [] [aa6bd8f2-140b5929-e6291a97-498f8dbd] [null] Abort session to cluster
2025-11-01T16:05:29.728120Z :NOTICE: [] [] [aa6bd8f2-140b5929-e6291a97-498f8dbd] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
2025-11-01T16:05:29.731369Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T16:05:29.731406Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T16:05:29.731420Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-01T16:05:29.734647Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_7_1_18026246482560886463_v1 grpc read done: success# 0, data# {  }
2025-11-01T16:05:29.734683Z node 7 :PQ_READ_PROXY INFO: read_session_actor.cpp:125: session cookie 1 consumer shared/user session shared/user_7_1_18026246482560886463_v1 grpc read failed
2025-11-01T16:05:29.734718Z node 7 :PQ_READ_PROXY INFO: read_session_actor.cpp:1666: session cookie 1 consumer shared/user session shared/user_7_1_18026246482560886463_v1 closed
2025-11-01T16:05:29.735236Z node 7 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 1 consumer shared/user session shared/user_7_1_18026246482560886463_v1 is DEAD
2025-11-01T16:05:29.736268Z node 7 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1659: [72075186224037893][rt3.dc1--topic1] pipe [7:7567788751611482507:2471] disconnected.
2025-11-01T16:05:29.736318Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1670: [72075186224037893][rt3.dc1--topic1] pipe [7:7567788751611482507:2471] disconnected; active server actors: 1
2025-11-01T16:05:29.736350Z node 7 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1679: [72075186224037893][rt3.dc1--topic1] pipe [7:7567788751611482507:2471] client user disconnected session shared/user_7_1_18026246482560886463_v1
2025-11-01T16:05:29.739077Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2258: [PQ: 72075186224037892] Destroy direct read session shared/user_7_1_18026246482560886463_v1
2025-11-01T16:05:29.739132Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [7:7567788751611482510:2474] destroyed
2025-11-01T16:05:29.739202Z node 8 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_7_1_18026246482560886463_v1
2025-11-01T16:05:29.831382Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T16:05:29.831421Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T16:05:29.831442Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-01T16:05:29.931684Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T16:05:29.931716Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T16:05:29.931734Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-01T16:05:30.035377Z node 8 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T16:05:30.035418Z node 8 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T16:05:30.035436Z node 8 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-01T16:05:30.831092Z node 7 :FLAT_TX_SCHEMESHARD WARN: schemeshard_impl.cpp:7727: Cannot get console configs
2025-11-01T16:05:30.831129Z node 7 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
